Yes a set of 340/360 manifolds will flow more with a nice set of 2 1/2" dynomax super turbo duals cross over and x pipe.
But headers are real cheap?? or do you have the manifolds?
I'm a bb guy but My first car was a 64 273 valiant in 1968 so I have an affection for the 273.