Should I not be using the Gender Neutral bathrooms?

Yeah so i've been using the gender Neutral bathrooms at 181 mercer everyday. I am a cis-gendered male (handsome) and am wondering if this is ethically wrong. I would like to use the boys' bathroom, but unfortunately the janitorial staff has been told to clean those facilities 175 times a day and I refuse to shit in the presence of those hardworking women. LET ME KNOW IF I SHOULD CHANGE MY TENDENCIES