Events

No Events Scheduled

Notifications

• 2026-04-22 00:00 - We will be doing some SMS re-routing tonight which will allow Rina to provide more advanced SMS features.   We plan on running this work tonight at midnight Mountain time.  We will have handsets to verify that there are no intercarrier SMS issues post route update.   This is just a notice for transparency.    There should be no outage nor any lost SMSs during the window.

  2026-04-23 03:24:15: This work has been completed and all carrier testing was successful. Please reach out if you experience any issues.
  
  ✓

• 2026-04-22 23:00 - During this maintenance, Ericsson will be migrating Cross's core nodes to the new ENM. There should be no customer impact.

  2026-04-23 03:24:44: Core nodes have been migrated with no issue.
  
  ✓

Outages

• We have opened a ticket with the vendor to investigate why devices are going into SOS mode.

  2026-04-01 16:37:18: The vendor is still working the issue of phones going to SOS. It has been stable for an 1.5 hours now. We will continue to monitor the situation.
  2026-04-01 18:07:41: The vendor is aware of the urgency and we are monitoring the situation. Services dropped just after the last update, and just dropped again about 5:55 PM MST. We will try to keep everyone current. Thank you for your patience.
  2026-04-01 20:20:36: The core recovered subscriber count @ 6:15 pm MT. It has held for 2 hours without dropping. The vendor has not given an update on the cause of failure, we will continue monitoring and update when there is a resolution. Thank you.
  2026-04-01 22:10:57: The latest update is the vendor believes the system is hitting a resource constraint and they are looking at ways to optimize it. It is likely the system will be stable through the night due to lower resource usage. The system has been stable for 4 hours without dropping, and we will continue to monitor the situation. This will be the last update until tomorrow, given the expected stability over night. Thank you.
  2026-04-02 08:05:13: Updates were made to the core at midnight. We are continuing to monitor the situation and hopeful that changes will resolve the issue. We appreciate your patience and respect your concern. Thank you.
  2026-04-02 12:02:11: Under the normal load on the core for the morning the core remains stabile. We are continuing to monitor the situation.
  2026-04-02 20:09:27: The core has remained stable, with nominal statistics throughout the day. There were cases of devices being in an odd state assumably due to the issues with the core, but most if not all came back with a forced reattach or power cycle. The core has remained stable since the maintenance at midnight MT. We are still monitoring the situation. This will be the last update for the day, thank you for your patience and understanding.
  2026-04-03 10:21:26: We are currently working with the vendor to investigate this morning's issues, which include no LTE data, inability to make calls, and devices entering SOS mode.
  2026-04-03 12:12:56: The vendor is looking at the issues internally. We will try to keep everyone updated. Thank you.
  2026-04-03 15:06:37: The vendor has not given an update at this time. They are still working on the issue. Thank you.
  2026-04-03 20:09:53: There has been no change or update from the vendor. The resource fix seems to be partially working. But in some instances a device will show connected but still not work correctly. Currently the only thing we know that works is to go to NOS. Reattach the device and see if it works. Sometimes it can take two tries and occasionally it will need to be airplaned in the case of a phone. The vendor is still working on the issue. We will update as soon as they update us. Thank you.
  2026-04-04 08:56:41: I have asked, but not received an update from the vendor this morning. Core statistic are stable and look normal. Unfortunately we do not have a way to see active sessions that are in a odd state. We will continue to monitor and assist in getting devices operational as we are made aware of them today. Thank you for your understanding and patience.
  2026-04-04 14:01:08: No change in status. Vendor did not make any more changes to core provisioning. We are exploring all possible methods to resolve this issue. Thank you.
  2026-04-06 06:51:03: There have been no changes or updates to the core over the weekend. Most issues are resolved by reattaching devices using NOS. On occasion it may require two reattaches to fully restore a device giving device about 1 minute between reattaches. We are still looking at resolutions to the issues exposed. Thank you for your patience.
  2026-04-07 09:03:54: There was a change made in the core over night. Vendor allocated more resources, so we will see if that helps today. The vendor is also sending an additional server. This server will be here on Wednesday. We will get that installed and turned up hopefully Wednesday night into Thursday.
  2026-04-07 23:25:03: There were changes in the core network tonight. We believe the work fixed the issues going on. We are also going to to do a reconnect for all devices. This should give us a clean network. If you are still seeing some issues please open a ticket.
  2026-04-08 09:50:47: We are getting complaints this morning of the same sort of problems that have been going on. The Vendor has captured some data and we are waiting for their analysis. We'll update once we hear back.
  2026-04-09 19:45:56: The vendor has identified an issue with downlink traffic not reaching the eNBs from the UPF. They have switched over to the backup UPFs and are continuing to monitor the situation.
  

• We are currently investigating issues with outbound inter-carrier SMS and have opened a ticket with Syniverse to assist with the investigation.

  2026-04-25 17:14:19: I am still working with Syniverse, out SMS bind for outbound traffic is down.
  2026-04-25 18:33:14: No update at this time, I am waiting on Syniverse Engineer to investigate.
  2026-04-25 19:05:25: Services have been restored. I am waiting for the root cause analysis (RCA) to determine what happened.
  

• NTP Alarm: I have opened a ticket with Ericsson to investigate the NTP alarm that recently triggered across all sites.

  2026-04-25 22:35:58: The ENM Team is currently investigating this alarm and will provide an update once more information is available. At this time, this issue is not impacting service.
  2026-04-26 01:12:53: These alarms are additional alerts for the old ENM expired certificates; Ericsson is scheduled to address them on Monday. I spot-checked several sites across different carriers, and they are all displaying the correct date and time. There is no service impact.