Read his response here. It’s surprisingly restrained, polite, and explains further why he wouldn’t do it. There’s a little bit of “I can’t be a misogynist look at all these women in my life!” but it reads sincere to me.