Packet loss and latency problems random times during the day

I have had this issue on and off for quite some time.  It seems that random times during the day, latency to the first node beyond my router will spike, sometimes to crazy amounts.  When I am experiencing no issues I can ping it and will always get 8/9 ms, yet when I have the issue it can spike to the hundreds.  

Here is it currently, when I am lagging in games and voip, etc. but it has definitely been worse. https://gyazo.com/1b2cb6e5122cde55cb2c6a7cd80dde1e

I am on a wired connection and have not once had >1ms to my router so it can't be something internal, the issue also occurs when directly wired to my modem.  I have tried having techs come out but they are unable to catch the problem when it is happening and it seems like every time I schedule an appointment the issue stops before the appointment.

Here are some traceroutes, but I am unsure what to do at this point, I suspect that maybe one of my neighbors might be using all of the bandwidth, but my download and upload speeds are always what they should be which is strange, so I don't know what it could be. https://gyazo.com/5a35e8201b7de9e8dfc1ea02dd4c1dbc gyazo.com/8dbaaff78839a96c68dc5b6cf7f35d35