You're right; it *does* depend on the individual.
So, if people want to be "safe rather than sorry" -- does that mean we should have separate changing/restroom spaces for heterosexual men, heterosexual women, homosexual men, and homosexual women? Where do bisexual people go? Where do transgender people go, if they are pre-transition?
Would you be ill-at-ease if you knew there was a lesbian woman changing near you in the locker room?
If a heterosexual woman expressed trepidation that there might be lesbian or bisexual women in the same locker room "checking her out" -- what would you say to her, regarding her fears?