Might be the switch needs adjusting. Did you unplug the wire at the switch to see if the lights go out? That would tell you it's the switch. If you unplug it and the light stays on it's not the switch.