You just need to send 5 people there one year in advance, then you can run an tax-free while living there and running you bank, insurance or consulting business.
I was once consulting people on tax and tried to motivate to move there. They ended up elsewhere. USVI have a big army base and a lot is military. Schools are somewhat acceptable but not world-class.
I personally would move there is I was American. I do not care about how bad the people around me are. I do not care about schools. I care about the weather and taxes. Another option would be American Samoa.
For USVI you still need proper US to live there.