The handle shaft is probably swaged to the escutcheon. You'll have to remove the swage and reinstall the handle with some sort of homemade device....possibly a snap ring.

The INTERNET, the MISinformation superhighway