Sure the investment will pay off eventually (civilian infrastucture level 3 -4). But there are better investments to make first off:
Ice and Volcanic colonization techs.
Upgrading civ facilities on newly aquired planets.
TEC cost decrease for mining structures.
Also military investments can save money, especially against pirates:
Hangers-fighters can kill planet destroying frigates, while help is on route.
Repair bay reduces fleet losses and keeps your capital ship hull healthy when they arrive.
Better regen rates with hull, armor & shields upgrades. It makes it all the more easier to continue to aquire more planets.
A Marza Dreadnaught with the basic regen upgrades is impressive for clearing out the rabble around unsettled planets. Of course you want it "level up" some before taking on a unsettled Terran planet. The repair bay effect is impressive, if the trip to one is too long, it might be the first thing I build at the planet.