Status as of Saturday, October 28, 2017
Posted: Sat Oct 28, 2017 7:43 am
Good morning!
- Chris discovered that one of servers closer to the edge of the network also had a connection limit. In this case, the limit affected all servers because connections passed through that system onto the rest of the network. The cause is that Debian 9 uses nftables, not iptables as older versions of Debian did. We are using Debian 9 on all new installations now, so this is the first time we encountered the problem. He fixed it this morning, which caused some downtime during the fixes, but everything is back to normal now and there should be fewer network connectivity issues.
- Today, as promised, we will be spending the weekend focused on resolving all old support tickets. We are right now up to October 10, although there are some customers who may have replied to tickets asking for an update and that pushed the "latest reply" date to the future. Regardless, we hope to reply to all of the tickets this weekend.
- Also this weekend, I think we figured out a way to deal with the "forgot password" tickets permanently. More details will become available when we complete the implementation.
- There are still just a few too many issues right now for us to feel comfortable expanding capacity. While performance is still acceptable for now, if it does become an issue, the system has become big enough that I don't think we should expand our services until we have put additional work into the issues that generate tickets and make the system less stable (like the password resets and the connections limit we just fixed.)