Unless he has some definite proof to prove to the police that you did what he said you did, he can't get you in trouble. Because what would stop him from just making false complaints against people he didn't like? Innocent until PROVEN guilty. One man's word against yours isn't proof.