This former palace of the Kullu rajas has a gaudily redecorated gateway with impressively heavy wooden doors, but inside is a fairly forgettable colonial-style house that's a private residence and not open to visitors.
It's beside the Archangel School, above the bus station on on the same minor hill-ridge as the Raghunath Temple.