Yeah, I wouldn't mind a huge garage, barn, metal shop, wood shop, whatever but that could be left un-climate controlled for most of the time as you said.

As far as HVAC'ed living space, I grew up in a house that was under 2k sq ft, and I can't see needing more.