My point is that they know what I want them to know. They know as much as I feel like telling them.

I mean, I don't really want to go here, but I know you're not out as trans to all of your co-workers. They might have their assumptions, but at the end of the day, all that they know is what you've told them, what you want them to know. Why are you arguing that anyone else should not be granted the luxury that you have?