DH3 cooling outage
Akademiska Hus had some technicians perform maintenance on the cooling system that's connected to DH3 without notifying us. Unfortunately, an error on their end resulted in the DH3 part of the cooling circuit getting cut off from the circulation at around 17:00 last Wednesday causing DH3 to start overheating and requiring us to shutdown all non-critical servers to keep temperatures manageable. Cooling was restored during Thursday and most services should be online or coming back online within the coming days. LCNet servers should also be booting up in short order. We also took care of some upgrades that would've otherwise caused downtime such as upgrading our Ceph cluster and the router. If you are experiencing issues or are encountering issues with your server, feel free to reach out to us at adm@ludd.ltu.se (or on telegram/matrix/discord until our mailing lists come back online).