Now that we are up and running with the replacement router, we shall continue to to work with Juniper Networks to fix the failed router.
We may at some point need to revert back to the original router or new replacement depending what we are required to do by Juniper.
We will open a Maintenance window out of hours to do any work that would result in an outage.
For now, full service is up and working.
Posted Jan 13, 2025 - 17:05 GMT
Monitoring
The replacement router is now live and in service and leased lines are now up.
Posted Jan 13, 2025 - 16:57 GMT
Update
The new router is now doing a reboot to apply config.
Posted Jan 13, 2025 - 16:29 GMT
Update
We are continuing to work on a fix for this issue.
Posted Jan 13, 2025 - 15:48 GMT
Update
We have now put in a final workaround which will restore all SIP services,. while we continue to wait for Juniper to transfer the licence to the new router.
Posted Jan 13, 2025 - 15:42 GMT
Update
We are continuing to work on a fix for this issue.
Posted Jan 13, 2025 - 15:41 GMT
Update
We are waiting for Juniper to transfer the licence to the cold spare router.
Posted Jan 13, 2025 - 15:08 GMT
Update
Phil has checked the primary router and its Dead and will no longer boot up.
Phil is now looking at using one of our spare-backup routers (Same Make/Model) which is designed so that we can restore services should we have a router fail.
Phil will load the config from backup and put the spare router into service, We will then make a call with Juniper for them to fix the primary router.
We do not yet have an ETA to when the new router will be online. Hopefully within an hour.
Posted Jan 13, 2025 - 14:39 GMT
Update
Phil has now arrived at the Data Centre.
Posted Jan 13, 2025 - 14:25 GMT
Update
We are continuing to work on a fix for this issue.
Posted Jan 13, 2025 - 14:16 GMT
Update
We are still waiting for Phil to arrive at the Data Centre to investigate the issue.
SIP and PBX services still seem to be affected despite moving the gateways to the other router.
It seems our network cannot see the Google DNS Servers, We have applied another workaround to SIP Trunk servers to use our own DNS Servers which seems to be resolving ok.
More tests to be done to try and bring up services while Phil fixes the Primary Router issue.
Posted Jan 13, 2025 - 14:08 GMT
Identified
We have lost one of our primary routers at Volta Data Centre,
We have applied workarounds to most services, with the exception of Leased Lines and DSL Connections.
Phil is going to site to investigate the router issue.
Posted Jan 13, 2025 - 13:30 GMT
This incident affected: VoIP Calls (Outbound Calling, Inbound Calling), Network Infrastructure (Volta Juniper MX Router, IP Transit), and Customer Internet Access (Customer Leased Lines, DSL Broadband Network).