Check the connections to the alternator and battery (don't forget ground wires and ground wire to body / engine!) - might also have the battery tested just to rule that out as a possible cause.

If no problems found with the above, take alternator back and get another.