Pull it back into position.
If its the header thats shoved forward put a strap on the collector flange and pull it back with a comealong. GENTLY.