If you have the room to mill it down that much, I don't feel you would hurt anything. Worst case, if it doesn't work, you could put spacers back to get your plenum depth in line. Maybe advancing the cam CL would help lower the power band.