"Just pay some taxes", that is not the main reason for going offshore for most legit businesses, in our case it's regulation of speech in media and weird cryptocurrency regulations, so the logical thing to do is going where it's legal what you do, where is the risk in that? Following the laws of the country of operation is without alternative.
To setup a Offshore company is most often also is about privacy and reducing taxes. But there are a lot of other reasons for why people setup offshore companies.