You description implies that that the cam might be flexing or simply loading the cam journal(s) against the bearing(s) with all 16 valve springs loading the cam, but not with only 8. Maybe under operating conditions with oil pressure, the symptom (and not necessarily a problem) goes away.