High Latency - sluggish internet

Recently moved into a new house where I got comcast business service installed. From the first day I have been having slow/dead slow internet issues.

Generally speaking the latency is very high for any service I want to browse. I have ping logs for google, amazon, azure and various other services I use. They were 2x higher than Verizon Fios I had installed at my previous house (moved 10 miles away in Ashburn, VA - which hosts most of the data centers in EAST US). Even the ping to my gateway takes 10ms or more, with Verizon Fios it used to be less than 5ms most of the time. And it doesn't make sense to be this high anyways when ping is only going to a hop away!

Then another issue is that it randomly becomes so sluggish that loading a web page from cnn or amazon would take 30+ seconds. This is totally random.

I was on call with support just a while back and all they did was restart the modem, which I have done multiple times already. They kept telling me to check bandwidth and I kept telling them back that the problem is the latency and bandwidth is not the true measure. 

I really need someone who understands network to help troubleshoot my problem.