Usually women use that phrase to state that the person is their boyfriend/husband, but in a possessive or fond way. It’s also often used towards men that aren’t even in a relationship with the speaker. It basically shows this person is proud/fond/in love with this man. Even if they are just a crush.
There’s an old r&b song called “Don’t mess with my man” by Nivea for context lol