Got it!!! After measuring both sides i found the button locked to the left. Apparently it cocked just enough that when I pushed the axle in it wedged it tight. I was able to take a broom handle and tap around on it and it finally get it freed up. Both axles slipped right in and adjusted out fine. Thanks to everyone for their advise!