The Neutral Safety Switch on your automatic transmission is faulty. It doubles as a switch to turn the reverse lights on. It is located on the automatic transmission, where the axle of the shift lever goes into the transmission (shift lever in the car > connected with a rod > shift lever on the transmission).

Sometimes adjusting it is enough.