My internet connection is fibre optic 10M, which far enough for playing this game.
While users can lag due to their internet connection (and also due to the 'routing' between them and the server), the server or server connection can also be at fault. Sometimes, the 'jump' is 2 seconds, but 5 seconds is not acceptable. There has been at least one other complaint about this in the past.