How do I remove poster gummy from the walls?

We used white, yellow and blue poster gummy. Most of it comes off by pressing a blob of gummy against the gummy still stuck to the wall. However, the yellow and blue gummy has dried out a bit and left remnants on the wall. I'm painting the walls so I want to remove the tiny bits that are still stuck on.