I would think that without the thrust buttons ,cornering would put a tremendous amount of side load on the axle bearings.
The axles will be getting in and out freely no matter the adjuster position, getting bearings out of the race, damaging inner seal and whatever else related to the axial play... drums against brakes assembly plate, pads etc. aside that, when axle bearings are not set into the race correctly, the axles will be getting up and down, side to side... moving out of the center.
( I heard you on the broomstick trick, but, damn! I found hard to get the roll pin and holes matched in that way! )
