I did check with the dealer and they said if that were the case it would not get quieter when it heated up and you would hear the rattle of the broken core inside. They suggested it might be the seal between the exhaust manifold and the pipe (part of the converter) that attaches to the manifold.

I would think I would see a black streak where it was leaking but maybe not.