Planning family vacation-Help with destination

Hi all,
I am looking for advice about Caribbean destinations that would appeal to a family with different interests. I am primarily planning the trip, so I would like to accommodate everyone as best possible. We did Belize and Hawaii as a family and both were great. I'm getting stuck with the Caribbean because there are so many choices, so hearing about destinations that people love would be valuable at this early planning stage. Importantly, there will be 2 toddlers in the group, their parents and grandparents and several adult relatives. The most important considerations are flight time for the little ones (coming from Philadelphia), and being able to work with a range of budgets (only ruling out destinations that don't support midrange budgets, ie expensive). Additionally, many of us love to snorkel, and also love outdoor adventure type stuff, although we have some non-swimmers that would like some place culturally interesting. None of us is really into resorts or nightlife. We'd probably rent a place on airbnb, vbro or similar. I've been to Mexico, Caymans, Jamaica, and while I wouldn't rule any of those out, I always prefer to travel somewhere new. Any thoughts on great destinations to consider are appreciated!!!