On the Nepisiquit River, around 14km south of Bathurst, you'll find this pretty set of water rapids. They are hardly Niagara Falls, but it's a nice drive to get here and you can enjoy a picnic by the river. If you're lucky, you can sometimes see salmon swimming upriver to spawn.
Note: ask the tourist office for directions, as there is limited signage. It's on property owned by a former paper mill (you enter at own risk etc).