I went and borrowed a puller from autozone. It worked! Pulled two pulleys from alternators and i am using the rotor from the spare, that has the bearing retainer in place compared to the rotor from my chrome unit.

Seems those retainers can be important! Maybe not today or tomorrow, but maybe twelve years down the line!