Earlier this week, Mori said board meetings with women take too long because they talk too much.

Mori said, "What I have said was inappropriate and goes against the spirit of the Olympics and Paralympics. To that end, I deeply regret what I have done. And I want to retract my remark and I'll apologize to the people who were annoyed by what I said."

That remark came during Wednesday's meeting of the Japan Olympic Committee.

Over 50 participants were briefed, in person and online, on the goal of having women make up at least 40 percent of board members.

As the meeting drew to a close, Mori spoke about his experience leading the Japan Rugby Football Union.

He said when the number of female board members increased... meetings took twice as long.

He said women have a "strong sense of rivalry", and when one member raises her hand, everyone else thinks they also need to talk.

At the time, no participants objected.

But social media took notice, and calls for Mori's resignation began trending on Japanese Twitter.

Then, foreign media chimed in.... with the New York Times reporting the controversy will burden organizers already struggling with the rising costs of postponement.

Tokyo's governor responded to Mori's comment by saying female empowerment only helps society flourish.

Koike Yuriko said, "We must make use of women's voices. That's obvious. How long conversations take differs from person to person."

As word spread on the streets of the host city... people spoke out... calling the comments sexist.

A woman said, "It was frustrating that he put it that way."

Another woman said, "Japan's Equal Employment Law should have improved the issues of gender inequality. It is totally wrong for the head of an organization to make such a remark."

Former judo champion Yamaguchi Kaori sits on the Japan Olympic Committee.

She says it's regrettable that this sort of remark spread worldwide... since promoting diversity is central to the Games.