I played a game where I didn't build any trade ports. I got high infrastructure costs anyways. I now suspect this expense is tied to planet development, not buildings I built. Next I'll try to keep my planet development to a minimum to see if there is any impact.
Well, i have played the game only very little so far, so i would not know, but it would be rather weird, if tradeports, which are supposed to generate you credit income, would at the same time incur massive infrastructure costs. What would be the point in constructing them then?