No, but if you use a big crank pulley, you'd need an even bigger pump pulley to keep from spinning the snot out of it. I don't know how fast is too fast, but if you use a 4" or bigger crank pulley, the pump pulley would need to be pretty daggum big to slow it down...and I've never seen a pump pulley bigger than 5".
The typical setup is a 3" crank pulley w/ a 5" pump pulley IIRC.

motorplate 2.jpg

CHIP
'70 hemicuda, 575" Hemi, 727, Dana 60
'69 road runner, 440-6, 18 spline 4 speed, Dana 60
'71 Demon, 340, low gear 904, 8.75
'73 Chrysler New Yorker, 440, 727, 8.75
'90 Chevy 454SS Silverado, 476" BBC, TH400, 14 bolt
'06 GMC 2500HD LBZ Duramax