Kubernetes infrastructure issues - Incident details - UTHPC - Status

Kubernetes infrastructure issues

Resolved

Major outage

Started almost 3 years ago 26. December 2023Lasted 50 minutes 26. December 202319:54:5320:45:46UTC

Affected

ETAIS

minu.etais.ee

UT HPC webservices

hpc.ut.ee

docs.hpc.ut.ee

Waldur portals

Updates

Resolved
26. December 2023 at 20:45:46UTC
Resolved
26. December 2023 at 20:45:46UTC
The issues have now been resolved. All the workloads and storage has healed nicely, with no damage to data resiliency.
Monitoring
26. December 2023 at 20:32:09UTC
Monitoring
26. December 2023 at 20:32:09UTC
The issue has been found and remedied. The workloads are recovering.
Investigating
26. December 2023 at 19:54:53UTC
Investigating
26. December 2023 at 19:54:53UTC
There's a problem with Kubernetes, which causes all the dependant services to also be impacted. We are trying to find a resolution.