I don’t know if rubber or teflon seals makes a big difference. However, if Teflon seals are indicated for my type of engine, I would not replace them with rubber seals.
Lubricating the valve guides with silicone was probably not a good idea. Making it easier to put on also makes it easier to pop off.
I suggest to take the top cover off and look with a strong light at the seals.