If you're pulling it yourself reusing the lifters is fine so long as you keep them in order. Not sure I would trust a used set even if the seller said they kept them in order I would break in a new set.

So long as the wear pattern on the cam looks good I would actually guess there is less likelyhood of wiping a cam while breaking in new lifters on it.