It sounds like a partially clogged catalytic converter to me. I've seen situations identical to this one more than once.

If the cats' have been previously replaced, check for pieces of the old ones stuck in the pipes downstream. I've seen this on a few occasions as well.