There are a whole host of African countries to which this label applies. I'm going to pick Mozambique as a country with huge diversity and potential.

Can I chill out on the beach in Mozambique...Check.
Mozambique has stunning white sandy beaches, which are lapped by the warm waters of the Indian Ocean. There are islands off the coast which rival anything the Maldives have to offer and are largely uninhabited.

Can I go on Safari in Mozambique....Check.
There are excellent safari options in the Limpopo river valley.

Can I dive in Mozambique...Check
Go to Tofo and experience the wonderful reefs of Mozambique.

Can I experience history and culture in Mozambique..Check
The colonial architecture of Mozambique Island.

Can I get really off the beaten track...Check.
Gurungue Mountain Chain.

What else can I do in Mozambique...
Surfing...

Swim with Whale Sharks and Manta Rays (Seasonal)

Visit Maputo Covered Market.

Disadvantages of Mozambique....
It's not that easy to get to, and your flights will be long and relatively expensive and fiddley. Travel internally will either involve long uncomfortable land journeys or short expensive uncomfortable flights.

It's in the Malarial Zone.