Had this problem for few nights after 1.0.4.

IP change doesn't help, last friday and saturday on 1.0.3 green bars and lower than 200msec latency.
Now its minimum 400msec latency.

And before you ask, my modem uptime is over a month.