Youre right, maybe a small intake manifold gasket leak, when it warms it swells. When its cold try and spray some carb cleaner around the gaskets and see if it smooths out.