How exactly would I go about removing the console to get to the switch?

Do I have to remove the entire console, or can I just remove the wood trim?

Thanks.