It must unplug, there is a bypass harness available to bypass the amp, and it just plugs into the input and output connectors on the amp. (But I've never tried to unplug mine either).
Good luck

Picture of 02-05 bypass cable, may help with connectors.

8471543-bypass.jpg (371 downloads)
Last edited by VitaminC; 03/26/15 09:46 AM.