Can horses tell men and women apart?

Likely, yes. In particular, horses are definitely going to notice if a woman handling them is menstruating (although it doesn't seem to bother a properly trained domestic horse much). They have a good sense of smell and are very good at reading body language.

Some horses do appear to be prefer to be handled and ridden by one sex over the other.