Did you charge a dead battery with an external charger before connecting the battery terminals OR did you charge the battery by running the car ? If it was the later, that could explain problems in your alternator, must be a very old alternator. You can either buy a new one as David suggested or get yours rebuilt, dont just replace the regulator.

__________________
Saumil S. Patel