The intermediate shaft shim shouldn’t have to be changed unless you changed the intermediate or the output shaft.
It ultimately affects input shaft end play so make sure it’s there.