I just wiggled it and it came off. The washers under the nuts were very tight on the threads though, mabye that id your problem.
I didn't even replace the gasket when I did mine. No leaks afterwards either.