Are you sure its not coming from your rear end? Thats the way they'll typically act when the Ring & pinion either isnt quite set up right, or is just worn. Once you plant the pinion into the ring gear (foot on pedal) it makes noise, once you let the pinion float a little (foot off pedal) noise goes away.

This condition would be much more typical than a tranny making a whining noise.