Down the Drain (Goes Back to the Sea)

When the iron wielding nin arrived over the horizon, Uzushio sharpened their swords and prepared for battle. They were prepared, the whole island was filled with seals along the walls and their young were to be ushered to secure places around the island. So... why was there barely anybody left among the Uzushio people?

Where did they go?