I think a planet should go through a phase of neutrality if they are about to flip cultures. This way a player can get his own culture counter up to stop the flip. The bigger the culture difference the faster the flip from neutrality to the player

If there is a hugh equal culture war , a planet may remain neutral for longer. Neutrality means the planets resources go to waste.