i'd set up a camera. and put up another fence. if he tears it down again then u have evidence that he is messing up your stuff. can't have people disrespecting you man.
i'd go up to his house and tell him "i know where you live buddy"
anyways yeah i't put up something and catch him red handed. then u can get him in trouble.