Women have to work harder in an all men’s environment and it’s leading me to change my job.

I would be careful with what you wish for. “Women’s jobs” are often much harder from the get go (caretaking, nursing, assistance, organisation, piece work, cashier, …) and paid less. At least, that’s my experience.