pitts, are you using any particular brand of burr? I have found the cross cut ones to be too slow for anything but finish work. Maybe the cheapo ones I have been using are just crap?
I use the heck out of this one from Summit. Its not the best place to get burrs but I usually place 2-3 orders a week so its convenient. I keep a plastic dish with a mixture of WD40 and transmission fluid and dip often. And I know its listed for cast iron but trust me keep it dipped and you will love it. Go slow because if you go like a wildman it will bend. They also offer a shorter one that is easier to handle.
https://www.summitracing.com/parts/sum-900643
