Because the O2 sensor doesn't do anything until it's hot. At that point, it supplies input to the mixture correction. The fact that you don't have starting problems and the idle is fine when cold tells me that you should check your 02 sensor.
Start by reading this thread:
Testing the Oxygen Sensor