Server merging
Then guest to other servers. It is free.
THe main issue with merging is the fact that they need to merge 3 servers at a time, due to WvW match-ups and such.
It is also rather unfair to suddenly give a server possibly massive queues in WvW due to merging all of a sudden.
Krall Peterson – Warrior
Piken Square
Your problem is timing, you see you say when you go around there is no one. In fact when you are online does not account for the whole server. There may be people who come online after you have gone to bed. As a whole your server might have more than you think and combining that with another server might very well over populate that one making it impossible to even log in during peek hours, this is why they restrict how many can get into one server.
I have to agree with Lord on this, just use the tools (aka Guesting)you have to find people who are on at your timing. Otherwise this suggestion is just a means for you to get into another server without having to pay the gem fee to do so.