Daddy Confusion

For weeks now, Charlie has taken to pointing to random men when we are out in public and telling me (loudly) whether or not they're Daddy. 99.9% of the time they aren't, so it goes something like this:
CHARLIE: (pointing to random man) "That's not Daddy!" (Pointing again) "Noooo not Daddy!" (Yet again) "It's not Daddy!"
This afternoon we were taking the elevator at the T stop so of course Charlie had to take advantage of the dead silence and confined space to particularly embarress me.
CHARLIE: (locking eyes with unsuspecting man) "That's MY Mama! You not Daddy!"
Thanks for the clarification, kiddo...