One way to improve the AI that should be relatively easy is to penalize diplomatic trading based on how far ahead you are in ranking compared to the AI you are trading with. The AI should not be giving me good trades for techs when I am double or triple his power score.