It is the rearend. You have too much play. The reason you can hear it under power and it goes away in neutral is that you are taking the pressure off the pinion. It is probably the pinion bearing going bad.