It's pretty simple. If you have plenty of clearance and they don't rub when you roll it over, your pushrods are not good enough. Now as mentioned, it will probably not hurt a thing, other than cost you power. Valvetrain deflection is one of the biggest power robbers there are. There is a reason that really high HP engines have pushrods that look like tree trunks and use large cam cores.

Monte