Yeah, leave the insides raw steel. Paint can flake off as well.

Speaking of valve covers I once had a set of old chromed DC valve covers for a small block and I pulled the baffles out and found large loose pieces of chrome plating just barely hanging on where the baffles were at. Having those fall off and end up in the oiling system would not be great.