I would recommend checking your distributor advance weights for sticking/ binding . I have seen them hang up a little,you set the idle,eventually they go back in place and the idle speed drops.
When yoyo blip the throttle it sticks again and the idle is back.
Keith