You can change it as long as you're in there, but it will run a long time like that. Many new chains develop a little slack very soon after install.