Make sure you are pushing the button straight down, also sometimes you only have to push it half or three quarters down and the knob will come out.