The biggest bang for the buck in dollars spent per pounds lost is in fiberglass body panels. Nothing else comes close. After that is the swiss cheesing and aluminum vs steel approach of various minor components throughout the car. Then come the big ticket items likes engine and suspension components, interior changes, etc.

In concert with that, as the battery discussion has pointed out, relocating existing weight within the car can net improvements without necessarily reducing weight.