Sounds to me like 1 of maybe 2 things.
1st would be that the center hole in the drum is larger than the axle flange and is no longer hub centric.
2nd as previously mentioned the axles could be slightly bent.
I would flip the drum over on the axle (install it backwards) and check it for run out.