A non square housing will cause the car to dog track. A bent housing that has toe-in or toe-out will drive very poor. I've driven cars that were in accidents prior to doing the alignment. Those with bent rear housings would drive similar to driving a boat. It feels like it steers from the rear and very twitchy. If everything is tight I would definitely check the rear toe.
Doug