3M makes a great adhesive remover which works well on glue from badges and old decals. It will not hurt paint (read directions on back side of product). Does not hurt *normal* paint.
Look for it at better autosupply stores, sometimes even at Pep Boys.
Haasman
3M™ General Purpose Adhesive Cleaner