Don't fall for no Polish trap and enter the country with its enticing low tax rate its a trap....lol. Yes, you could wind the company down and start same business in another EU country but this could be considered exit tax avoidance if you have start new business with same customers, business model, management, products etc but just different name. I wouldn't want to argue that in court.
In court you would dig up article 54 of the EU treaty, freedom of establishment. The country you exit might have an exit tax, but they cannot stop your new business from competing on equal terms.
https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:12016E054