Not being asked out is also a form of rejection. Rejection is any sort of imbalance in interest. Women have plenty of experience of being rejected by men, so in that way it’s easy to sympathise with them (unless the guy exhibits entitlement toward women accepting his advances, or is off-putting in terms of hygiene or anti-social behaviour).
Women are just individuals, and thereforr not responsible for a guy feeling invisible to them en masse (compared to what, a super attractive man or woman?)