Network Outage

by tnolen
/
Comment Closed

Sept. 29, 2011 10:52 – We are experiencing a network outage which seems to be upstream.  We are looking into the issue and will provide updates shortly.

Phones were out briefly as well, but we have gotten them back online.

12:00pm  – We have been informed that the issue with AT&T is affecting a large number of trunks.  They are aware of the issue, but have not provided us with an ETR (Estimated Time for Repair) yet.

2:30pm – The issue is a fiber cut outside Birmingham that is the root of the problem.  AT&T repair teams are onsite and the ETR is now 5:00pm.

6:15pm – Even though the initial ETR has passed, the circuit is still down.  We have called to get a new ETR, but they have none, so we are expecting resolution soon.

8:30pm – We checked on the status of the repair, and half an hour ago, technicians reported that they were having trouble splicing the cables together. There is not a new ETR. 🙁

11:45pm – New ETR is 12:30am.   We’ll see…

Sept 30, 2011 2:45am – AT&T is reporting the fiber cut is fixed, but we are still not seeing service. We are working on this now.

3:20 am – We’re up!  The last issue was a routing problem which has been resolved.  All services are functioning normally now.  We appreciate your understanding and are sorry for the inconvenience.

Update 6:00pm –  We just received word that the outage was caused by a construction crew between Birmingham and Childersberg.  The crew is building a new Alabama Power substation.