June 23, 2020 – 6:30am – Our virtual server infrastructure has been impacted due to an automatic update of a critical security issue. A critical vulnerability in NFS was patched and an upgrade sent out by the OS vendor. This was unplanned and unattended. Unfortunately, the update took VPS systems offline. We are in the process of restoring all functionality. Updates will be posted here.
Update 7:15am – We’ve been able to restore service to many of the machines. We do have a VPS host machine which is giving us some issues and we have an engineer physically working on it now. Email has not been impacted and neither has shared hosting services. The vast majority of our customers are either no longer impacted or were not impacted at all by this event.
Update 7:45am – We’ve identified a major hardware issue that did not present itself until the host was rebooted. Work is underway to replace the affected hardware. Unfortunately, one of the affected services is our phone system, but we do have backups in place.
Update 8:30am – Repairs have been completed. VPS machines are being powered up. Services should all be restored within minutes. Our phone services have also been fully restored.
If you have any questions about this issue, please email us at firstname.lastname@example.org.