You need to pull all the bearings up to that one, they don't fit one inside the other.

Here's another trick a friend uses to some success. Install the back two bearing then install the cam and make sure it turns freely. If not, he wiggles the cam which sort of seats the bearing. Then he installs the next one and again tries the cam. He does this for each bearing.