300D won't start when engine hot/driven long distances?

[Orkrist2]

Sometimes when I drive longer distances, like 200 miles or so, and I shut off the car to fill up or something, it won't start again. The battery is good, everything works, but I get a click when I try to start the car. Then, after a few minutes, it starts like nothing was wrong. I've had starters go out on other cars, and it was either it worked or it didn't, which leads me to think its not a starter problem. But, maybe it is and I don't know something I should. But, if its not a starter problem, what is it? The regular 4 starts a day I do when I'm in town are normal, its only when I drive longer distances, turn it off, and then start it again. Any ideas? Anyone have it happen before?