IMO it sounds like you're better off just scraping off what's loose/flaking off, treating the rust with whatever rust product you were planning on doing, then re-doing the entire undercoating, applying fresh stuff over top of the original undercoating that was still in good shape.