Okay, here's what happen. I switched the right and left window switch and my window did go up. So it was obviously the switch. These were supposed to be pretty new, but I opened them up anyway to find a piece of something stuck in between two of the contacts, preventing the window from going up but allowing it to go down. I cleaned this part off and put it back together.

Now it works fine!

Thanks everyone