Get it running as is. As you say, you can always upgrade later if you're unhappy with it. TBH I think the 2 1/2" single will cope OK if the motor is done by 4500 but I would have thought a 280 duration cam would wake a 360 up a bit more than that shruggy

'74 Challenger..9.46 @ 145.9 1/4, 6.001 @ 118 1/8 so far. 4023lb !!! # N/A, Marsh performance 655ci, Indy Maxx, T/R, Indy 600-13 X's, Street legal, pump gas, full interior, Cal-Tracs, mufflers, 3:73's and real 10.5 radials.
9.51 @ 142.4 1/4, 6.003 @ 114 1/8 with our old mule KB, 572-13, 580 wedge.
RHD '68 Barracuda Fastback 323ci street/strip. Best ET 13.88 @ 99.03