Police in Beihai

Public Security Bureau

At the eastern end of the old town; can extend visas.
Bank in Beihai

ICBC

Has a 24-hour ATM for international cards.