This case is a bit weird to understand, so I decided to ask here and see if someone can give me some guesses about what can be the root cause of the issue I'm about to describe.
Our company has 2 main switches, which are:
- HPE ProCurve 1800-24G Switch (J9028B)
- D-Link DGS-1016D
These two switches are connected to one another using one Cat6 UTP cable. They're almost at full capacity, but they work fine. There are also a few other unmanaged switches in our network (about 2 or 3) which distribute/repeat the communication to/from the 2 main switches mentioned above.
Up until 2 months ago we had a DSL connection with a crappy DSL modem from the ISP, this DSL modem was connected to one of the main switches (D-Link DGS-1016D), everything worked fine except the internet speed which was crappy by nature. About 2 months ago we got a fiber optic internet connection and got a fiber gateway from the ISP. The fiber gateway is 1Gbps and supposedly is top-notch (according to the ISP, of course). The DSL modem was removed from the network and the fiber gateway took its place, same IP and same spot in the switch.
Here comes the strange part(s)... The first issue I noticed was that when I logged into this fiber gateway, through its web interface, the web interface would become unresponsive, packet loss would start, and the internet would drop after about 2 or 3 minutes - the gateway soft rebooted itself - every time I logged in. Weird thing is that when I log into the same device without it being connected to our network's switch (using a single isolated connection laptop-gateway) then everything works fine. The home page loads fine, no packet loss, no drop in connectivity nor reboots.
After tinkering around a bit I found that, at least to some extent, the issue is caused by the gateway's home page. I'm not sure what it does, it shows a little graph of the network topology and gives you a count of devices connected to the LAN (which is off by at least 60%). The reason I came to this conclusion is because I set-up a JS script in the browser, using TamperMonkey, which redirects the browser to a different page of the gateway immediately after log in. This way the hanging was remedied permanently and I thought "well, f#ck it, everything is fine", until about a month ago when things became weirder.
Almost every day now, multiple times a day, eventually the gateway will have a packet loss ratio of 60+%. This is my big issue at the moment, I don't know to which degree the gateway is the issue, but there is some additional information that may be useful: the packet loss happens simultaneously on the LAN and WAN side, and on the WAN side the ping requests are handled "directly" by the gateway, there isn't any networking device of our own - the fiber optics cable connects directly to the gateway, which in turn connects to one of the switches.
The first few times I power-cycled the gateway, then power-cycled the switches, and then one day I noticed the strangest thing yet: when the gateway starts dropping packets, the temporary solution is as easy as unplugging for a couple seconds the cat6 UTP cable that bridges the 2 main switches and then plugging it back in. After this, the gateway will behave normally for a couple more hours, 3 tops, and then goes back into the same problematic behavior. It's as if the gateway becomes overloaded, yet a 10 year old DSL modem didn't with the same network configuration.
At this moment I have a few theories that I'll have to test:
- Problem is (one of) our switches. The reason why I haven't tested this yet is because I haven't a switch at hand, would have to buy one. It still doesn't account for the fact that there is no issue with the old DSL modem;
- Problem is the gateway itself; would need to buy a decent router/gateway to test this too;
- I think I'm forgetting another theory I had...
I tried getting the ISP to swap for another gateway (different model), but they refuse given that the issue only arises when connected to our network. The gateways are not professional grade, but how bad can they be compared to the old home DSL modem?!
Well, this is the issue that I'm facing. Any thoughts? Suggestions?
Thanks in advance.