The "drilled hole" is undersized and it is not in the center of the crank. Hand clearancing the bushing exaggerates the problem. Don't ask me how I know this.

I would install a late model pilot bearing that fits in the torque converter hub. You should also correct the bellhousing runout. At least make sure all alignment dowels are engaged.