Hmm, I wonder if I just need another caliper then. I didn't take the cable off, but I did pump the arm quite a few times, and it would just suck the pad back each time. Both calipers were rebuilt ones from a local place.

I also had both calipers unbolted so I could move them around and tap on them while bleeding.