You need to surround the elevator and port with as many high adjacency boosts as you can. You can get them up pretty high on your homeworld with galactic and player unique buildings adjacent to them and have a much much better score than 54. Just with full rings of factories, that's 3 base and 12 leveled points of ship production. Add another half dozen from asteroid mines and a few from population and you've already hit 20+ base production to work the percent modifiers against.
With the right circumstances, you can create a super planet with a few hundred of each. I quit one recent game in disgust because there were 16+ asteroids within +1 range of my homeworld, dozens more a little further out, and it had almost all of it's tiles grouped together. I could have won without colonizing a single planet, just drop the Antimatter Powerplant in the center, with the various flat increase buildings around it and their corresponding capitals next to them.