There's great scuba diving at Lighthouse Bay (at the northern tip of the cape) at sites such as the Labyrinth, Blizzard Reef and Helga's Tunnels. Check out the DPaW book Dive and Snorkel Sites in Western Australia for other ideas. Dive operators in Exmouth can set you up and take you out.