I primed all bare metal with several brands of rattle-can self etching primers with no drying or adhesion problems with regular Rustoleum. Maybe the primer absorbed your prep wipe with solvent and you didnt give it enough time to evaporate.

Bob