Capitals

One thing I noticed in one of my first games (I'm still green so sorry if this has been asked before) Is that if my culture took over an enemy planet, the capital enhancements it had would stay there and I would have two capitals. Also I took one that was mid-production of a capital and I could let it keep producing.

Would it then be possible to give a planet with your capitals to an enemy, while keeping a culture terror star nearby of course, then start production of capitals at another planet and take the original back. Would this allow me as many as I want? This is probably an exploit, but I want to see if anyone else has tried this.