Meanwhile, it was OK for shipwreck survivors to be "white":
https://en.wikipedia.org/wiki/Normanton_incidentThe Normanton incident (ノルマントン号事件, Norumanton-gō jiken) was a set of reactions and events surrounding the sinking of a British merchant vessel named Normanton off the coast of what is now Japan's Wakayama Prefecture on October 24, 1886. When the Normanton ran aground, the ship's officers appear to have seized the lifeboats for the Europeans alone. Among the Asians aboard (Indian and Chinese crew, and the Japanese passengers) there were no survivors. Uproar in Japan obliged the British Consular Court to revisit its initial exoneration of the captain and to accept there had been criminal misconduct. But no compensation was offered. In Japan, the incident was widely interpreted as a further illustration of the humiliations visited upon the country since her forced opening to the West in the 1850s, and it led to new and persistent calls for the revision of the "unequal treaties".
...
On the evening of October 24, 1886, the 240-ton British cargo ship Normanton, registered to the Madamson & Bell Steamship Company, left Yokohama Harbor laden with both goods and 25 Japanese passengers for the port of Kobe. En route she was caught in heavy wind and rains all the way from Yokkaichi in Mie Prefecture to the Cape of Kashinozaki in Wakayama Prefecture, where the vessel was wrecked. She ran aground on an offshore reef and was lost.[2] The ship's captain John William Drake and all of his European crew (consisting of Britons and Germans) escaped the sinking ship in lifeboats, leaving the remaining crewmen (twelve Indians and Chinese) and the 25 Japanese passengers aboard to escape by themselves.[3] Drake and his European crewmen were picked up by coastal fishermen who took them in.[2]
As usual, the "non-whites" (being Eurocentrists) helped the "whites", while the "whites" (being ethnotribalists) left the "non-whites" to drown.
On October 28, Inoue Kaoru, Minister for Foreign Affairs for Prime Minister Itō Hirobumi's first cabinet, received a telegram from Matsumoto Kanae, Governor of Wakayama Prefecture, briefly outlining the events surrounding the shipwreck. He was alarmed by the fact that all the Japanese passengers were lost, and ordered an investigation of the situation on the spot.[2] However, Japanese officials were hindered in their efforts to verify the facts of the incident by the legal barriers imposed by the unequal treaties.
...
Public opinion in Japan was outraged over what was perceived to be a miscarriage of justice.[5][6] An example of public sentiment at the time was found in the Tokyo Nichi Nichi Shimbun (forerunner of the Mainichi Shimbun, founded in 1872.) The paper reported in an outrage that, "If the Captain and the more than 20 seamen under him were able to be rescued, it makes sense that at least one or two Japanese passengers would have been saved along with them. However, the ugly truth is all of them were lost." In another article, they claimed that, "If the passengers had been Westerners, they would have been rescued immediately. These men were left to die because they were Japanese".[7]
The Japanese were Westernizing heavily by then. It didn't matter. They were still "non-white". Here is a picture of Inoue:

His Western clothes and hairstyle didn't help his investigation!
The North China Herald in Shanghai called the decision of the Board of Enquiry a "farce", a "miscarriage of justice" and a "complete whitewash".[8]
"White" being the operative term.
Foreign Minister Inoue had been a staunch supporter of the country's Europeanization by hosting elaborate balls at the Rokumeikan
Did it help him in the end?