Did you ever have the motor or car on the dyno?

If not, I’d suggest you do......... see if you can nail down when the valve float/lifter unhappiness occurs, and keep the motor below that point.
With a hyd roller(or hyd flat tappet)....... it often occurs at a lower rpm than you might suspect.

Running the motor up into the rpm range where things get unhappy usually results in things happening like what you’re experiencing.