distributor advance plate end play

Was doing some recurve work on my distributor. Got the shaft end play down to around .007. But when I put the plastic spacer and advance plate back on. There is a whole lot of up down endplay between the clip and the advance plate. I seem to remember this being normal but it seems that this endplay would cause lots of timing inconsistencies considering the reluctor rides on the advance plate.

Should this endplay also be shimmed out? Or am I wrong about the timing inconstancies?