I wanted to add a follow up to hopefully help others in the future since I got my problem fixed.

I found that my header pipe had a break in it and this break wasn't too far from the starter. So I believe the heat of the escaping exhaust was cooking my starter solenoid. Also I believe that the cheap starters that I kept putting on my car were also a culprit. So my advice to anyone in the future with this problem is to check for any cracks in their header pipe and replace it if there are and when replacing the starter save yourself a lot of time and spend the extra money for a good Bosch starter. Avoid the cheap starters that some places like Autozone sell.