Hq_dia_backup on NESPARC Operational Status

[Resolved] Core Network Maintenance

Tue, 18 Mar 2025 23:50:00 +0000

Tues March 18 2025 // MIDNIGHT: Completed

Maintenance has been completed

Tues March 18 2025 // MIDNIGHT: Maintenance

NE Fiber will perform scheduled maintenance beginning Tuesday Mar. 18 2025 at 11:50PM involving routers on the core backbone. The maintenance window will last until 6:00 am, although service interruptions should be brief, if any as core routers are rebooted.

If you experience service issues after 06:00 am Wednesday morning, please first power cycle your equipment (router and ONT/Modem) and if not resolved contact our Helpdesk.

We appreciate your patience while we work to continually improve the resiliency of our network. Thanks for using NESPARC.

[Resolved] DIA Down

Wed, 15 May 2024 17:16:00 +0000

DIA Down : 1:23am 5/16 RESOLVED

Splicing and cable replacement for the upstrem provider near Jackson is complete. Servivces are restoring to all affected subscribers.

DIA Down : 9:03pm Mitigating

Crews have located the damaged fiber on one of our circuits and multiple repair crews are working as quickly as possible to clear the damage. Repairs also continue on the other circuits. While we have not been given an offical ETR on any of the damaged circuits, we do expect progress to be made throughout the evening. Traffic control, splicing, and cable repair preparations are being done as rapidly as possible. We will provide more specific updates as we have them.

DIA Down : 8:13pm Mitigating

To clarify NESPARC has multiple transports to the internet. Today, an unprecedented event occured: our main DIA experienced an outage as well as multiple backup circuits. C-levels at all providers are engaged and the issues have and are being escalated. Crews are working to repair the damages in multiple areas. We do not currently have an ETR, but are taking all measures possible to mitigate the issue while repairs are being made.

DIA Down : 5:15pm Investigating

The primary circuit for NE SPARC went offline at 5:16pm and the cause is unknown. We know that the issue is outside of the NE SPARC network. We continue to work with our upstream provider to isolate the issue and resolve it.

Prior to this event, our redundant circuit was damaged in Tennessee. Repairs are underway on this circuit and we continue to monitor their progress.

[Resolved] 40 gig DIA

Mon, 04 Apr 2022 12:45:00 +0000

DIA Issues: 10:00 AM 4/7: All circuits online

All circuits are online and functioning. We continue to monitor the circuits for issues.

DIA Issues: 05:30 AM 4/6: Windstream circuit back online

Service was restored to the Windstream circuit. Traffic begin automatically going between the two circuits.

DIA Issues: 1:42 AM : Update : New Circuit Operational

New circuit has been enabled, routing adjusted, and traffic is flowing for customers.

The affected upstream provider has isolated the issue with a handoff between their network and TVA, and continue to work to resolve. **HOWEVER we have fully mitigated this issue by activating the new circuit **

More updates as they are available, NESPARC customers should be functioning optimally.

DIA Issues: 11:42 PM : Update : New circuit activation

We have been successful in the acceleration of an additional circuit activation. While customers are still currently passing traffic, congestion on our other circuits has caused issues for latency-dependent services such as gaming. However most customers have been surfing successfully.
We will enable the new circuit at 12:00 am (midnight) to get traffic moved off the backup circuits. This new path is geographically diverse and significantly increases total bandwidth, while also providing another additional primary/backup path for internet traffic. This should prevent any further issues similar to what we experienced today.
When we make the changes to activate this new circuit, services will be interrupted briefly while routes propagate. This should be a brief interruption.

Thank you for your patience.

DIA Issues: 6:42 PM Mitigation in Progress

We have feet on the ground working to accelerate the activation of a new circuit to provide an additional route for traffic. The affected upstream provider is actively working the outage and providing updates as available. Currently their assessment is indicating possibly a fiber cut in addition to hardware issues which affect multiple large customers.
We have preliminary information that could see the new path activated within the hour, although this is not guaranteed. More updates as they become available.

DIA Issues: Investigating and Mitigating

Our upstream provider is continuing to investigate the root cause of the issue. We have re-routed all customers to a backup circuit to restore service. Until repairs are made, some services may be degraded.

DIA Issues: Investigating

Our upstream provider is experiencing an issue that has caused our primary circuit to go offline. We are currently investigating and will provide updates once available.

[Resolved] Windstream Degradation

Tue, 22 Mar 2022 08:30:00 +0000

DIA Issues: Resolved

The issue has been resolved and services are restored. The upstream providers experienced a damaged fiber across a roadway and took longer than expected to repair.
We had taken measures to prevent an outage of this type from happening in the future.
More information about these measures will be posted in the near future.

Thank you for your patience.

DIA Issues: 10:25pm Update

Additional crews are en-route to assist with the issue. Crews continue to work to resolve the issue.

DIA Issues: 6:25pm Update

We are in contact with engineers and field techs from the upstream providers, and their management is involved and working diligently to resolve the issue. It appears at this time a fiber cut near Holly Springs MS has affected multiple providers and geographically diverse fiber circuits. Field engineers are on-site working the issue. We will continue to provide updates here as they are available.

DIA Issues: 4:30pm Update

The Upstream Providers have located the issue and have engineers on-site working to resolve. More updates will be provided as available.
Traffic has significantly increased throughout the afternoon which has caused the other available circuits to near capacity. We are working with our NOC and upstream provider engineering team to mitigate as much as possible until repairs are complete.
Thank you for your patience.

DIA Issues: 2:30pm // 3rd Escalation

We are in constant communication with high level contacts at the affected upstream providers, and expecting more detailed information to be forthcoming.

We are taking all available measures to manually re-route traffic as possible to our other circuits. We appreciate your patience as we work towards a resolution.

DIA Issues: Mitigation In Progress

We are still working through our upstream and one of back-up circuits being down due to the severe weather throughout the country. We are rerouting customers as we can to other available circuits. We ask those that have service to be mindful of your usage until our upstream has this issue resolved

DIA Issues: Investigating

We are working with our upstream provider on the issue. We have determined that it is not due to any damages in our area. We have also learned that other Co-Ops that use this upstream provider are also having similar issues.

DIA Issues: Investigating`

Our upstream provider is experiencing an issue that has caused our primary circuit to go offline. We are currently investigating and will provide updates once available.

[Resolved] Upstream Routing Issue

Tue, 28 Dec 2021 14:36:00 +0000

UPDATE : 12/28 3:05pm : Services restored

After further investigation, the issue was not on the NESPARC network, but rather related to routing of upstream providers. The providers resolved the issue quickly and provided sufficient RFO, and are also working to implement measures to prevent similar events going forward.

ISSUE NOTIFICATION: 12/28 2:40PM : Investigating

One of our DIA connections has experienced and event which is causing routing anomalies. Engineers are working to isolate the issue. Services may be degraded until the issue is resolved. More details will be posted on our status site as available.

[Resolved] PLANNED MAINTENANCE

Wed, 15 Dec 2021 00:00:00 +0000

UPDATE 12/15 2:37am : Maintenance Complete

The planned maintenance has been completed and systems are operating optimally at this time.

NESPARC Core Network : Upcoming Maintenance

On Wednesday 12/15/2021 between 00:00 and 06:00am, Network Engineering will perform software upgrades on our core routers than handle transit internet traffic. These software updates will be performed in sequences and there should be minimal impact to subscriber services during the maintenance window. However, due to the nature of the maintenance, there is a possibility of service interruptions while routers are reloaded, but these should be brief.

Thanks for your patience while we strive to improve and streamline our network.