I have used narrow machine washers to take up a little space... but from the pic it looks like a lot of gap. Almost 1/4"?

Agree inspect and swap parts side to side to check it out. Maybe the receiving hole is wallowed out or the ball joint is not made correctly.