Silicone is not a good material for this repair. It is corrosive and will cause further rust.

Good news is that you can usually easily peel it out after it has cured. You can then clean the area well with a steel brush, then use something non corrosive like regular white caulk.

Glad you found the source of the leak.

Good luck,