Bad luck. You can't change or choose servers, so you're stuck with what you've got.
This, for me, is the biggest flaw in what is supposed to be a social game.