There's really no reason to avoid a stroker, unless you don't want to re-gear or you really like high RPM.
But for best results at the track, you're gonna need better heads: W2s, W5s, Indybrocks, or TFS.
Did a 4.030 x 4.00 iron-head 360 Duster some years ago, great street car.