Exactly. Everyone wants to believe that this person is actually this person. If you believe even half the theories out there then most of the characters we know are someone else. I guess that's what happens when you release one book every 5+ years, it gives people with way too much time on their hands to look into things way too hard.
I think GRRM does this on purpose though. He'll drop subtle hints into someone's appearance or background to make the reads start looking into it, but ultimately it will never be explained. Some examples like the identity of Coldhands, what happened to Benjen, the Septa with stretch makes from giving birth, who killed Euron, what's up with the Patchface, who is Jaqen H'ghar. There's dozens out there like those and I don't see how we'll ever get an answer to all of them.