Along with the divots, use Loctite Stud and Bearing Mount and all will be well.
You used to be able to go to NAPA and get the bushing for the unreamed hole but I have a feeling it is off the books.
R.