Drill a 3/8 hole in the dowel, fill the hole nearly full with grease, then take a grade 5 bolt with the threads cut off, start the 3/8 bolt in the hole then hit the bolt with a 3 or 4lb hammer, the grease will push the dowel out, same thing works for removing a pilot bushing except there is no hole to drill.
