There are of course limits.
Too loose will destroy the parts, the tappet is not the only location of slack.
Too tight is only dangerous one way: the valve does not close. A valve left open .002" stops working, and says so (DV).