Wanted to give everyone an update: On closer inspection it turns out I was indeed plugged into manifold vacuum for the vacuum advance can on the distributor. Switched to ported vacuum and no more idle issues. Thanks for the advice!