That sounds like an interesting idea and I had sort of wondered if leaving them off would have more of a cooling effect on the engine compartment. However, I would be concerned with rocks/debris and mud getting thrown on your motor and the rest of the compartment with those covers off.
If they are like my inspection covers on my '73 Charger, I wouldn't leave them off in a normal driving situation as getting the engine bay dirty to shave a few degrees off the motor is not worth it to me.
Maybe if you did fab some type of scoop to close off most of the inspection holes, that might help but then I'd make sure they had plenty of clearance from the full sweep of the UCA's so you don't smash em when you hit a bump.
I'd also wonder how much air the scoop would actually pull as it would be contained in the fender which would keep the air mostly out of it?