Adjacent to the magnificent Nippon Maru, is this comprehensive, if somewhat dry, port museum. It's worth a visit for its detailed model ships and ship simulator, where you can attempt to dock safely into Yokohama Port against the clock.
There's a nice little cafe-bar, Akito, on the terrace facing the Nippon Maru.
