Of course it can be done, it's basically what the factory did. If you don't mind the slight change in wheelbase you can even use a Plymouth donor. One would be much better off starting with a 2 door that shares much of the inner panels and roof structure but it can be done with a 4 door.
The main part of the wheelbase change is in the front spring hangers, Dodge used longer than Plymouth . Since you are going to be changing the quarters, wheelhouses and trunk floor making a Plymouth into a Charger is not much different than staring with a Coronet