In my experience these "ice cube" relays get quite warm to the touch. This is probably the low speed relay for the auxiliary fan. If it's warm out and you are running the air conditioning, I would expect this relay to be switched on almost continuously.

It shouldn't be hot enough to burn your fingers. My off-the-cuff guess is 120F?? Unless it's warmer than that, don't worry about it.