If you do that, you will probably wipe the cam...once broken in, the lifters MUST stay with the original lobes!!!!!!!!!

yes, the plunger should move down so you have a problem...get a couple of new lifters and do a fresh break in sequence just like you had changed cam and lifters....