Say the kids' intentions were pure, and he just wanted to see his old house.... he goes home and tells his parents a strange man let him into his house... then what? You pretty much made the right decision.