Dominican Republic = you can go and stay, as long as you leave the country every so often.
Dominica is porbably available as someone mentioned above
You can buy an apartment in Colombia and get a residency visa based on owning a home dwelling I believe. And it's a REALLY GOOD infrastructure...