Bare metal would be okay. Older paint I'd sand to at least 180. Most primer is designed not to shrink and show sanding scratches, but 80 is coarse! If the undercoat is decent, consider it another chance to block for smoothness!

http://www.autobody101.com/forums/viewtopic.php?f=5&t=16568&start=0