Pope Francis, who is an advocate for nuclear disarmament, is in the city of Hiroshima to attend a gathering for peace.
Earlier in the day, the pontiff visited Nagasaki where he called for nuclear weapons to be abolished, saying they're "an affront crying out to heaven."
It's the first time in nearly 40 years a sitting pontiff is visiting Japan, and the two atomic bombed cities.
Pope Francis visited a park marking the spot where American forces dropped the bomb 74 years ago.
Despite the heavy rain, survivors of the atomic bombing and other invited guests gathered to hear his message of peace. The attack on Nagasaki on August 9, 1945, left around 70,000 people dead by the end of that year.
The pope prayed for them twice, bowing deeply at the cenotaph.
He said, "This place makes us deeply aware of the pain and horror that we human beings are capable of inflicting upon one another. The damaged cross and statue of Our Lady recently discovered in the Cathedral of Nagasaki remind us once more of the unspeakable horror suffered in the flesh by the victims of the bombing and their families."
The pontiff also spoke about his commitment to support the international arms control framework, including a treaty prohibiting nuclear weapons.
That treaty has yet to be joined by many countries, such as Japan which relies on the US nuclear umbrella.
He called on world leaders to commit to the cause.
"Convinced as I am that a world without nuclear weapons is possible and necessary, I ask political leaders not to forget that these weapons cannot protect us from current threats to national and international security. We need to ponder the catastrophic impact of their deployment, especially from a humanitarian and environmental standpoint, and reject heightening a climate of fear, mistrust and hostility fomented by nuclear doctrines."