I would do it with no break in and no worry, but I've pretty lucky with such things. If you're concerned and assuming the wear pattern on the cam itself looks normal, then get a fresh set of lifters and go through normal cam run in proceedure. Coat cam with high pressure grease, verify lifter rotation, break in additive, 30 min at 2200 rmp or so, change oil, etc. etc.