The influence and upgrades stay on the server where they were earned, so if you transfer server you have to start over. If you decide to transfer back at some point, the points and upgrades will still be there.
It is quite easy to upgrade again if you have a few people, since the rate of earning influence is often higher than the rate at which you can spend it due to the upgrade times.