The problems arise when you try to mix and match the pulleys. If you use a matched set, things are fine since the attachment points are the same.
The factory had a dizzying array of combinations though. P/S or not, A/C or not, Police alternator or not, Smog pump or not...