CHPC - Notice history

System Under Maintenance

100% - uptime

Homepage and documentation - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Portal - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

License servers (commercial software) - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Group- and project-specific websites (hosted on VMs) - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Helpdesk platform - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026
100% - uptime

HPC clusters - Operational

99% - uptime
May 2026 · 98.26%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Open OnDemand - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Windows servers - Under maintenance

99% - uptime
May 2026 · 98.26%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Virtual machines (VMs) - Operational

100% - uptime
May 2026 · 99.42%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Computational servers, independent of clusters - Under maintenance

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Storage systems - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Data Transfer Nodes (DTNs) - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026
100% - uptime

HPC clusters - Under maintenance

99% - uptime
May 2026 · 98.26%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Open OnDemand - Under maintenance

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Windows servers - Operational

99% - uptime
May 2026 · 98.26%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Virtual machines (VMs) - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Computational servers, independent of clusters - Under maintenance

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Storage systems - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Data Transfer Nodes (DTNs) - Operational

100% - uptime
May 2026 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2026
Jun 2026
Jul 2026

Slack - Operational

Notice history

Jul 2026

Scheduled maintenance on July 14: Software updates on HPC clusters and standalone servers
Scheduled for July 14, 2026 at 2:00 PM – 2:00 PMUTC
  • Update
    July 15, 2026 at 4:27 AMUTC
    Update
    July 15, 2026 at 4:27 AMUTC

    Redwood is back in production. Please, let us know at helpdesk@chpc.utah.edu if there is any outstanding issue. We will wrap things up tomorrow morning.

  • Update
    July 15, 2026 at 1:37 AMUTC
    Update
    July 15, 2026 at 1:37 AMUTC

    Clusters in the General Environment (granite, notchpeak, kingspeak, and lonepeak) have been returned to service. The team at the CHPC is continuing work on other systems.

  • Update
    July 15, 2026 at 1:13 AMUTC
    Update
    July 15, 2026 at 1:13 AMUTC

    Narwhal, the Windows server in the Protected Environment, has been returned to service. System administrators are continuing work on other systems; thank you for your patience.

  • Update
    July 14, 2026 at 4:31 PMUTC
    Update
    July 14, 2026 at 4:31 PMUTC

    Virtual machines (VMs) in the General Environment have been returned to service.

  • In progress
    July 14, 2026 at 2:00 PMUTC
    In progress
    July 14, 2026 at 2:00 PMUTC
    Maintenance is now in progress
  • Update
    July 06, 2026 at 10:30 PMUTC
    Update
    July 06, 2026 at 10:30 PMUTC

    Update to scope of planned maintenance on July 14: CHPC storage administrators will need to reboot storage systems in the General Environment as part of planned maintenance. As a result, home directories, the sys branch (/uufs/chpc.utah.edu/sys/), and virtual machines (VMs) in the General Environment will be briefly unavailable during the planned maintenance window. This outage is necessary to replace fans that have failed in the storage system. If you have questions about the impacts of this outage, please contact the CHPC at helpdesk@chpc.utah.edu.

  • Planned
    June 22, 2026 at 10:24 PMUTC
    Planned
    June 22, 2026 at 10:24 PMUTC

    The Center for High Performance Computing will have a downtime on Tuesday, July 14, 2026. The downtime will begin at 8:00 a.m. MDT and continue through the afternoon. It will affect high-performance computing clusters (granite, notchpeak, kingspeak, lonepeak, redwood; Open OnDemand) and standalone servers (including narwhal, beehive, and CryoSPARC and ColabFold servers) in the General and Protected Environments. In addition, storage systems in the General Environment will be rebooted during the maintenance window, which will affect access to storage and virtual machines. This downtime is necessary to apply patches and updates to systems following recent operating system vulnerabilities.

    CHPC system administrators will apply updates and reboot systems in a rolling fashion throughout the day on July 14. There will be interruptions to the availability of HPC clusters and standalone servers during this time. CHPC staff will also migrate some internal services and systems, which will briefly affect the availability of metrics reported on the CHPC Portal.

    Network administrators will also update software on network devices in the Protected Environment, though network updates are not expected to cause outages or interruptions. Additionally, storage administrators will update firmware; this, too, should have no effect on availability.

    If you have any questions or concerns about the downtime or its effects, please contact the CHPC at helpdesk@chpc.utah.edu. Thanks for your support while we work to keep research computing resources secure.

Issues with FastX licenses on July 1
  • Resolved
    UTC
    Resolved

    The issue with FastX licenses has been resolved by the vendor. FastX sessions should now be functional again. If you encounter further issues, please contact the CHPC at helpdesk@chpc.utah.edu. Thanks again for your patience.

  • Investigating
    UTC
    Investigating

    The CHPC is aware that users connecting to Linux systems through FastX are receiving error messages related to the license. System administrators are working to correct the issue as quickly as possible and have contacted the software vendor. In the interim, we recommend using Open OnDemand (https://ondemand.chpc.utah.edu/ in the General Environment and https://pe-ondemand.chpc.utah.edu/ in the Protected Environment) or SSH to connect to CHPC systems. We apologize for the inconvenience and appreciate your patience. If you have any questions or concerns about connecting to CHPC systems while FastX is unavailable, please contact the CHPC at helpdesk@chpc.utah.edu; we'd be happy to help.

Jun 2026

VM outage due to new hardware migration
  • Completed
    June 03, 2026 at 10:48 PMUTC
    Completed
    June 03, 2026 at 10:48 PMUTC

    CHPC system administrators have migrated most virtual machines and are in contact with groups with any remaining virtual machines. If you encounter any issues with a virtual machine, please contact the CHPC at helpdesk@chpc.utah.edu. Thank you for your patience and continued support.

  • In progress
    June 02, 2026 at 6:00 AMUTC
    In progress
    June 02, 2026 at 6:00 AMUTC
    Maintenance is now in progress
  • Planned
    June 02, 2026 at 6:00 AMUTC
    Planned
    June 02, 2026 at 6:00 AMUTC

    On June 2nd and 3rd, we will be performing mandatory maintenance on all CHPC hosted VMs in the both the protected and general environments.  During this time there will be up to a 2-hour downtime for individual VMs where we will be migrating them to new hardware and the VM will need to be shutdown.  The individual VM outages should not exceed 2 hours, but we will be migrating all remaining VMs that have not yet been migrated over the 2-day outage window.

May 2026

Nvidia GPU driver critical update
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Update
    UTC
    Update

    All the HPC cluster GPU drivers were updated and queues were released. Most of standalone servers have been updated as well.

  • Update
    UTC
    Update
    We are continuing to work on a fix for this incident.
  • Identified
    UTC
    Identified

    Nvidia released new GPU drivers that address critical vulnerability, https://nvidia.custhelp.com/app/answers/detail/a_id/5821

    All systems with Nvidia GPUs is affected. We will be updating the drivers, or have updated them already, on HPC clusters, owner interactive nodes such as the Cryosparc machines, and Virtual Machines. The processes running on GPUs have to be killed for the driver update to apply. On the Linux systems, the update should not require a reboot, but, it's possible that some machines will have to be rebooted.

    If you have any questions, please, contact our helpdesk, helpdesk@chpc.utah.edu

Debugging disabled on Linux system due to vulnerability
  • Identified
    UTC
    Identified

    A new Linux kernel vulnerability has been announced last night. A workaround mitigation before patched kernels are released involves disabling the ptrace scope, which among others prevents debuggers from attaching to executables. Due to this, debugging on our Linux systems will be disabled till the kernels are patched.
    More details on this vulnerability are at https://almalinux.org/blog/2026-05-15-ssh-keysign-pwn-cve-2026-46333/.

    If you have immediate debugging needs, please, consult with our helpdesk@chpc.utah.edu.

May 2026 to Jul 2026

Next