Up a laneway 300m past the library is a fort, built in the early 19th century by Sikh governor general Man Singh (after whom Mansehra is named), and rebuilt by the British after the Second Sikh War and the annexation of the Sikh state. It now houses a police office and a jail. Very few traces of the original mud-and-rock structure can be seen inside.