Sorry you are having problems. That's odd that the rollers are different height. Like many Victor guys it seems, I have a love/hate relationship with mine. You may have read my combo before and I run a smaller cam but, if helps at all, here's my valvetrain combo:
solid roller .421 lobe lift w/1.6 HS rockers = .674 lift.
Trick Flow springs TFS-16943-16(which are actually PAC-1243)installed at 1.900,
Comp tool steel retainers 1732-16
Comp 4785-16 locators
611-16 locks
621-16 lash caps,
Smith Bros .375x.083 pushrods
Harland Sharp S70016EVK rockers.
No spring/retainer clearance issues even without lash caps. I decided to run the caps only because the sharp rockers sweep the roller from the center toward the outer tips of the valves at full lift and wanted more contact. I'm sure it's not the ideal setup but seems to be working OK. Has been to 7400 RPM a couple times but keep it below 7k now.