I can tell that JustAnotherNomad has a strong preference for countries with a good reputation. I can imagine why after having lived in some third world countries, where the government is basically the worst organized crime organisation of the country. However, one advantage that poor countries do have is that they seem very bad at enforcing their own tax regulation
My preference is only about what the client sees and in regards to tax treaties. None of my clients would accept doing business with a company from Belize or Panama.
Otherwise I completely agree. Move to Bolivia, Nicaragua or some other country where taxes may even be high in theory, but enforcement is weak. But be prepared that banking may become even more difficult.