It's too late now with lawyers involved but it seems like the simplest solution would have been to fence it in and if he claimed it was his it would turn into here's our land title or deed, here's the property line for what we bought and been paying taxes on, here's the fence around it.