Ping times (latency) and bandwidth are really not related unless you are filling the pipe. Your ping times are too high. My understanding is that anything over 100ms is not good. Your problem probably lies with too many hops or slow or overburdened router along the path.