Not just anyone is allowed to transform this abandoned tropical island once favoured by billionaires and Hollywood stars.