Yes, but then you can have malicious servers sending fake numbers without other server operators being able to check whether this is at all plausible.
(It's still possible for malicious servers to send fake votes, but server operators can see which users they are stated to originate from, then block that server if that looks like it's doing that. At least that is my understanding.)
I hardly ever check how old anyone's account is. I try to be nice to everyone regardless of who they are, and discuss issues rather than posters.