After having 4 wheelers (quads for you northerners) for years, I got an old 2003 Polaris Ranger side by side a while back and I love it. Great for working around the property. This is more of a utility type vehicle w/ a dump bed. I ride all over the place w/ my 2 little girls and it's been great.
I still have my 1988 Honda 300 fourtrax in the barn that I've had since I was 9 years old.

As far as tearing up the trails, land, etc. That's not due to the weight of the side by side. Anything w/ real aggressive tires, decent power, and a driver that uses it will tear up the dirt. I ride all over the trails here that we share w/ locals on their big lifted 4 wheelers w/ tractor style tires and those things dig up everything.