How good are your grinding skills? Stick with the smaller bit, if there's any doubt. Or, depending upon how much material needs to be removed, use cartridge rolls to slow down the process enough to avoid removing too much too fast.