If your racing it or looking for the most power and torque on the engine dyno sheets, bigger is better
The difference in head flow, cam LSA, actual rocker ratio and other parts have a direct effect on the engines ability to consume and use the air and fuel the carb allows into them
If your after the best mileage and street performance then think small primaries on the carb.
Years ago I did some carb size testing at the track on a 440 bracket race motor with a set of mild 906 iron heads and a big solid roller SS cam, it ran faster and quicker ET with the biggest carbs and intake I could put on it, I had assumed that by using a Holley 600 D.P. the car would 60 ft. better and get better reaction times and 60 ft. better, it didn't Every time I put a bigger carb . on the same intake it went faster and quicker
Theory and results are not always the same