He's not going anywhere. Even if GW said to himself "maybe I should find someone else", removing Rumsfeld would just set the Republican party back big time because the media would go absolutely bonkers for months and months. It would be a
PR nightmare at this point to dump Rumsfeld, and it wouldn't shut the Democrats up, they'd just scream louder.