Sounds like wear on the coupler part that locks onto the ball.
The North40 store near me (kinda like Tractor Supply) has replacement tongue assemblies, you'll need to weld.