Saying everyone is either a man or a woman is like saying everyone is either right or left handed.
For most people it’s true. But some of us are ambidextrous, or cross-dominant (like me).
A rough binary that seems right at a glance will never cover everyone. The world is just more complex than that.