Lately my starter has been staying on even when I turn the key off. Its not turning the engine over though. To stop it I have to turn the key like im starting it again and it will quit. What would generally be the problem in this situation?

Do you mean the starter keeps spinning but disengages from the flywheel after the engine starts. If so it sounds like a bad starter.

Yes that is what it is doing. Even with the key off the starter is still turning.. just not engaged.

I think I'd try tapping on the starter relay to see if that stopped the starter from running.

When it's cranking with the key not in the start position. Unplug the small lug on the starter relay. It's hot during cranking from the ignition switch during cranking. If it stops the problem is before the relay. If it still cranks, it's the starter relay sticking.

I had the same thing happen on a Chibby I had once only the drive was engaged. Only way I found to get it to stop was to yank the battery cable off, which, by the way, was starting to smoke from the heat. cranked real slow like the battery was down. After three different starters and two battery cables, my friend decided he wanted the fairly fresh 400 SB out of it. I gave him the whole car! On the way home with it, he said the wiring harness started to smolder and then catch fire. Car was a total loss.