I've had good results with RTV only with headers in a NA application. I understand the concern about growing but the RTV will shear and let the parts slide if there is a lot of force... its a lot better than direct metal to metal which might lock the parts up. Since the head is water cooled, temps at the flange surface shouldn't be too extreme despite the high exhaust temps. I'd use the RTV.