NTA. Lie. He can't read your mind. And stop snitching on yourself-you created this problem by telling him you do it, then bringing it up during a fight. I rarely recommend lying but this one is harmless and will save you both a lot of grief. This is controlling behavior and a red flag, but I'm not suggesting you break up over it-just make a note of it for your files.