Yes, you have to put the car in neutral (Make sure the e-brake is set!), and PULL HARD on the sides of the lower center console by the shifter. It will pop up. You can unplug the cig lighter plug to remove the console and get it out of the way completely.
For the upper center console piece, pull the lower section of it (by the cubbyhole) towards you. It will pop up, then you can pull the rest of it up and towards you to remove it. You will need to remove the plug that goes into the HVAC controls (where the clock and lcd display is). It's a simple plug with a clip on it. The best thing to do is to close the radio door when you're removing it and putting it back on. It will tend to get in the way.
The HU is secured with 2 phillips head screws, and 2 10mm bolts, which you can use a screwdriver on as well. A 10mm ratchet with the extender socket arm will be easier to work with.