August 30, 2020 – Our preferred VOIP provider, Siptrunk, seems to be having some issues this morning. Problems started at approximately 5:00 am CDT. The problem stems from the fact that many subdomains for siptrunk.com are not resolving. Phone systems register to gw.siptrunk.com, which is not working at the moment. We have submitted a ticket and are awaiting reply from Siptrunk for a status and estimated time to repair (ETR). Updates will follow.
Update 7:55am – Siptrunk reports that their servers are not having issues but that there is “a widespread internet impairment affecting many online services at this time.” And that their “engineering teams are fully engaged and investigating.”
Update 8:00am – The page at downdetector.com is definitely showing widespread simultaneous outages across multiple providers, so this looks like more than just a VOIP issue. We recommend that customers check Downdetector for updates on their ISP (Comcast, Charter, etc). Right now, reports or outages are increasing.
Update 8:15am – Cloudflare, a large content delivery network (CDN) seems to be a common provider in this failure. Their status page is at https://www.cloudflarestatus.com Please note that times listed on that page are UTC which is 5 hours ahead of CDT (local time). Reports are also stating that issues at Centurylink may be a root cause of the problems being seen on the internet and with Cloudflare. Their status page is at https://status.ctl.io/. Currently, all involved providers seem to be “investigating” and are not listing any repair time estimates.
Update 10:15am – The network issues have been fixed at Centurylink and other providers have re-peered with them. Routing has stabilized and things have returned to normal for the most part.
We are monitoring firstname.lastname@example.org and Chat (use the window at the lower right of your screen). Our phone service is also affected, so we recommend one of those two contact methods if you have questions.
**Issues with phones are resolved. This incident is over.