This is apparently a common misconception. People think the country they grew up in will have them in their claws forever.
First thing here is that legally there is no such thing as "home country" , there is just country of citizenship, country of residency and sometimes country of domicile. By "home country" I assume you mean country of citizenship here.
If you are not a citizen of a country that taxes by citizenship, meaning the whole world except US and Eritrea, then you just need to get out of the tax net of your country of citizenship to no longer pay tax there. It doesnt matter that you keep the citizenship (except if you are a citizen of the US or Eritrea).
As to how to get out of the tax net, it depends from country to country, but typically it means moving out, not spending too much time in the country of citizenship, and not having ties in the country of citizenship like a house, family or a business.