What distributor are you using, and how is it triggering the spark? If it is a vr type you could try moving the tone wheel to another position. I believe they have two possible spots.
For a while I used a locked one from 78 ish. 318. It had a vr pickup. I always had a lot of noise with it. I switched to a crank pickup and the engine ran a lot better.