It must unplug, there is a bypass harness available to bypass the amp, and it just plugs into the input and output connectors on the amp. (But I've never tried to unplug mine either). Good luck
Picture of 02-05 bypass cable, may help with connectors.