The house takes its name from Thomas Glover (1838–1911), whose arms-importing operations played an important part in the Meiji Restoration; he built the first train line in Japan and helped establish the country's first modern shipyard. The place is nestled in hillside Glover Garden.