Maybe try installing your old idler then pitman and see if things change.

It has been noted recently in header fitment situations that not all brand idlers put the geometry in the same place. Someone changed brands of idler and headers didn't hit.