Disclaimer: I'm not an electrician

If you leave wires from the barn to the house (or wherever that box is), whenever the new owners restores power, those (now) loose wires will become energized; a potentially deadly hazard.
I'd (permanently) cut the power from both ends. Whether you pull the wire is up to you.