Indeed, you just push it back down and there is no release tab.

The first time that I did it, I was sure that I was about to break something too.