Update on the pool downtime
Posted: Sun Jun 18, 2017 1:09 am
Hi Everyone,
We sincerely apologize for the downtime. If you are not already aware, we have been the victims of denial of service attacks. I have been working all morning trying to restore service, so far unsuccessfully.
We just signed up for a CloudFlare account and routed the site through it, and that service is working fine. However, the issue that prevents full restoration of service is in the hands of our internet service provider, Verizon. We own 5 IP addresses, and two of those IP addresses appear to be blocked from within Verizon's network. We cannot run the pool without at least 4 IP addresses.
I have talked with Verizon's customer today, and the two techs to which I talked cannot find any issues with their service, which I find to be highly implausible. I have taken our working servers and did nothing but switch their IP address to the "blocked" address, and they are no longer connectable externally and have no ability to connect to connect to the internet from within the servers themselves. Similarly, I have taken the servers that were on the "blocked" addresses and changed their IP addresses to the working addresses, and they become connectable and can reach the internet from within the servers themselves. Furthermore, all 5 IP addresses can connect to each other through their public IP addresses, but they can't connect to anything beyond Verizon's first router. I don't see any reason why this behavior would be due to anything but the ISP itself. I am planning to wait a few hours and call again when there is a shift change so that a different customer service representative can actually fix the issue or at least provide us with a completely new set of IP addresses.
I want to assure everyone that there was no intrusion into our system and all money is safe; this is simply a denial of service attack. I will be providing updates as I have them. In the meantime, if anyone has alternative suggestions on what could be causing this "blocked" IP addresses, I would appreciate the comments.
We sincerely apologize for the downtime. If you are not already aware, we have been the victims of denial of service attacks. I have been working all morning trying to restore service, so far unsuccessfully.
We just signed up for a CloudFlare account and routed the site through it, and that service is working fine. However, the issue that prevents full restoration of service is in the hands of our internet service provider, Verizon. We own 5 IP addresses, and two of those IP addresses appear to be blocked from within Verizon's network. We cannot run the pool without at least 4 IP addresses.
I have talked with Verizon's customer today, and the two techs to which I talked cannot find any issues with their service, which I find to be highly implausible. I have taken our working servers and did nothing but switch their IP address to the "blocked" address, and they are no longer connectable externally and have no ability to connect to connect to the internet from within the servers themselves. Similarly, I have taken the servers that were on the "blocked" addresses and changed their IP addresses to the working addresses, and they become connectable and can reach the internet from within the servers themselves. Furthermore, all 5 IP addresses can connect to each other through their public IP addresses, but they can't connect to anything beyond Verizon's first router. I don't see any reason why this behavior would be due to anything but the ISP itself. I am planning to wait a few hours and call again when there is a shift change so that a different customer service representative can actually fix the issue or at least provide us with a completely new set of IP addresses.
I want to assure everyone that there was no intrusion into our system and all money is safe; this is simply a denial of service attack. I will be providing updates as I have them. In the meantime, if anyone has alternative suggestions on what could be causing this "blocked" IP addresses, I would appreciate the comments.