Police are investigating whether the blaze was started deliberately, public broadcaster NHK said.
The victims suffered cardiopulmonary arrest, a term often used in preliminary reports before a death is officially confirmed, reports say.
Footage showed blackened windows after dozens of firefighters extinguished the blaze on the fourth floor.
All of those feared dead were reportedly in a psychiatric clinic on the fourth floor of the building, located in a busy commercial and entertainment district.