Hosted Private Cloud Status

OVHCloud Private Cloud Status

Current status

Legend

Operational
Degraded performance
Partial Outage
Major Outage
Under maintenance

[Global][VMware] - Vrops upgrade

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 10, 09:00 UTC

Scheduled - Start time : 10/01/2022 09:00 UTC
End time : 21/01/2022 18:00 UTC
Technical impact (DC/geographical area) : All zones Vrops
Service impact : No access to vrops during the maintenance
Service improvement : Solve multiple vulnerabilities in VMware vRealize Operations by upgrading to v8.6.2

[Worldwide][Veeam] - Veeam upgrade

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 6, 21:00 UTC

Update - We will be undergoing scheduled maintenance during this time.

Scheduled - Start time : 06/01/2022 21:00 UTC
End time : 11/01/2022 17:00 UTC
Service impact : Backup and restore are not available during the maintenance
Service improvement : Upgrade Veeam managed solution to v10.1

About This Site

Welcome to the Hosted Private Cloud status page for real-time information on system performance and availability.

Nutanix || BHS Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || ERI Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || FRA Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || LIM Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || LON Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || RBX Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || SBG Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Nutanix || WAW Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

VMware Private Cloud || BHS Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || ERI Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || FRA Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || LIM Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || LON Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || RBX Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || SBG Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

VMware Private Cloud || WAW Under Maintenance

Network Operational

Management plane Under Maintenance

Compute Operational

Storage Operational

Veeam || BHS Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || ERI Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || FRA Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || LIM Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || LON Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || RBX Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || SBG Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Veeam || WAW Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Anthos || RBX Operational

Network Operational

Management plane Operational

Compute Operational

Persistent Storage Operational

Backup as a Service || Veeam Backup Managed Under Maintenance

Veeam || LON Operational

Network Operational

Management plane Operational

Compute Operational

Storage Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

[ERI1C][Hosted Private Cloud] - Datastores migration Jan 19, 07:30-12:00 UTC

Start time : 19/01/2022 07:30 UTC
End time : 19/01/2022 12:00 UTC
Service impact : None
Service improvement : The purpose of this operation is to migrating LIM1C datastores to a new configuration management tool for high performance
Posted on Jan 11, 02:07 UTC

[LIM1C][Hosted Private Cloud] - Migration of datastores Jan 19, 07:30 - Jan 20, 12:00 UTC

Start time : 19/01/2022 07:30 UTC
End time : 20/01/2022 12:00 UTC
Service impact : None
Service improvement : The purpose of this operation is to migrating LIM1C datastores to a new configuration management tool for high performance
Posted on Jan 11, 01:40 UTC

[Global][vCenter] - VCSA Minor Upgrade Jan 19, 09:00 - Jan 20, 18:00 UTC

Start time : 19/01/2022 09:00 UTC
End time : 20/01/2022 18:00 UTC
Service impact : Management down during 1 hour
Service improvement : The objective of this change is to upgrade VCSA minor to version 6.7U8
Posted on Jan 13, 21:45 UTC

[Worldwide][Hosted Private Cloud] - Zerto v8.0 Jan 20, 09:00-18:00 UTC

Scheduled - Due to an unforeseen event, the change had to be postponed.

Start time : 20/01/2022 09:00 UTC
End time : 20/01/2022 18:00 UTC
Service impact : zerto replication cut during the maintenance
Service improvement : Upgrade Zerto to v8.0
Jan 12, 10:20 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 11, 09:00 UTC

Scheduled - Start time : 11/01/2022 09:00 UTC
End time : 20/01/2022 18:00 UTC
Service impact : zerto replication cut during the maintenance
Service improvement : Upgrade Zerto to v8.0
Jan 6, 21:55 UTC

[WAW1C ][Hosted Private Cloud] - Datastores migration Jan 24, 07:30-12:00 UTC

Start time : 24/01/2022 07:30 UTC
End time : 24/01/2022 12:00 UTC
Service impact : None
Service improvement : The purpose of this operation is to migrating LIM1C datastores to a new configuration management tool for high performance
Posted on Jan 11, 02:21 UTC

Past Incidents

Jan 18, 2022

[RBX2][Storage] - Tete-3316

Resolved - Start Time : 18/01/2022 05:10 UTC
End Time : 18/01/2022 06:55 UTC
Technical impact (DC/geographical area) : RBX2A
Root cause : Water leakage from the Watercooling system
Jan 18, 07:38 UTC

Update - Update : The service is up for the moment on the slave head. Our teams are working to re-establish the master head.
We apologize for the inconvenience and thank you for your understanding.
Jan 18, 06:59 UTC

Identified - Start time: 18/01/2022 05:10 UTC
User impact : Datastore unavailable: pcc-003402
Technical impact (DC/geographical area) : RBX2A
Scope of impact : Both Master and slave of Tete-3316 are down.
Root cause : Water leakage from the Watercooling system
Ongoin Actions: Our teams are working to solve the problem.
Jan 18, 06:50 UTC

Investigating - Please note the incident on pcc master and slave in RBX2A

Following all the necessary information.

Start time : 18/01/2022 05:10 UTC
User impact : Datastore unavailable: pcc-003402
Technical impact (DC/geographical area) : RBX2A
Scope of impact : Both Master and slave of Tete-3316 are down.
Ongoin Actions: Our teams are working to solve the problem.
We apologize for the inconvenience caused.

Thank you for your understanding

OVHcloud Technical team
Jan 18, 05:46 UTC

Jan 17, 2022

No incidents reported.

Jan 16, 2022

No incidents reported.

Jan 15, 2022

No incidents reported.

Jan 14, 2022

[RBX7/RBX2A][Hosted Private Cloud] - Datastore

Resolved - Start Time : 14/01/2022 11:14 UTC
End Time : 14/01/2022 11:22 UTC
Root cause : The incident was due to a hardware malfunction.
Jan 14, 13:42 UTC

Update - Scope of impact :We have identified other impacted datastores.
Here is the updated list :
- pcc-008983
- pcc-008981
- pcc-008988
- pcc-009413
- pcc-009415
- pcc-010129
- pcc-011907
- pcc-014059
- pcc-014060
- pcc-014061
- pcc-014062

Thank you for your understanding

OVHcloud Technical team
Jan 14, 11:45 UTC

Investigating - Please note the incident on Hosted Private Cloud datastore

Following all the necessary information.
Start time : 14/01/2022 11:14 UTC
Technical impact (DC/geographical area) : RBX7 / RBX2A
Scope of impact : tete-4354
- pcc-009415
- pcc-011907
- pcc-014061
- pcc-008983
- pcc-014062
- pcc-009413
- pcc-010129
- pcc-011907
Ongoin Actions: Our technical teams investigate to determine the origin of the incident

We will post a next update soon with more information on the situation
Thank you for your understanding

OVHcloud Technical team
Jan 14, 11:34 UTC

Jan 13, 2022

No incidents reported.

Jan 12, 2022

No incidents reported.

Jan 11, 2022

[Worldwide][Veeam Backup] - Veeam Proxies

Completed - The scheduled maintenance has been completed.
Jan 11, 22:45 UTC

Update - Update :We extend the intervention until Tuesday 11 January 2022 at 19:00 UTC
Dec 22, 20:37 UTC

Update - Scheduled maintenance is still in progress. We will provide updates as necessary.
Dec 17, 08:58 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 13, 09:00 UTC

Scheduled - Start time : 13/12/2021 09:00 UTC
End time : 23/12/2021 19:00 UTC
Service impact : None
Service improvement : Deployment of a new feature (Veeam Proxies) for better load balancing of backups
Dec 8, 16:38 UTC

Jan 10, 2022

[ERI1][Hosted Private Cloud] - Maintenance on datastore servers

Completed - The scheduled maintenance has been completed.
Jan 10, 14:06 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 10, 07:00 UTC

Update - We will be undergoing scheduled maintenance during this time.
Jan 6, 11:05 UTC

Scheduled - Start time : 10/01/2022 07:00 UTC
End time : 10/01/2022 12:00 UTC
Service impact : None
Service improvement : An updated Puppet infrastructure is available. Production servers need to be migrated to this new infrastructure.
Jan 5, 22:39 UTC

Jan 9, 2022

[RBX2A][Hosted Private Cloud] - No nfs access to datastores

Resolved - Start time : 09/01/2022 16:29 UTC
End time : 09/01/2022 16:59 UTC
Service impact : no nfs access to datastores on tete-2181 pcc-004771, pcc-004773, pcc-004774, pcc-004782, pcc-004785, pcc-004788
Root cause : Hardware failure (cluster poweroff)
Jan 9, 16:29 UTC

Jan 8, 2022

No incidents reported.

Jan 7, 2022

[RBX7][Hosted Private Cloud] - R701A05

Resolved - Start Time : 07/01/2022 04:07 UTC
End Time : 07/01/2022 07:45 UTC
Technical impact (DC/geographical area) : RBX2a
Root cause : A network equipment was the cause of this unavailability
Jan 7, 21:26 UTC

Identified - All hosts are back following the network intervention. The network equipment replacement is still in progress
Jan 7, 10:27 UTC

Update - Ongoing Actions: A network equipment is the cause of this unavailability, a replacement is underway. We will get back to you as soon as possible.
Jan 7, 05:48 UTC

Update - User impact : 24 host down including 9 host PCC master (vm admin).
Ongoing Actions: We are still investigating the cause of the problem. We will get back to you as soon as possible.
Jan 7, 05:12 UTC

Investigating - Following all the necessary information.

Start time: 07/01/2022 04:07 UTC
User impact : 9 host down on PCC master
Technical impact (DC/geographical area) : RBX2a
Scope of impact : R701A05
Ongoing Actions: We are currently investigating the cause of the problem. We will get back to you as soon as possible.

Thank you for your understanding

OVHcloud Technical team
Jan 7, 04:23 UTC

[RBX][Hosted private cloud] - vSphere

Resolved - Start Time : 07/01/2022 18:00 UTC
End Time : 07/01/2022 21:00 UTC
Technical impact (DC/geographical area) : RBX2B
Jan 7, 21:26 UTC

Identified - Start time: 07/01/2022 18:00 UTC
User impact : Unreachable vSphere due to an automation error.
Technical impact (DC/geographical area) : RBX2B
Scope of impact : 150 customer on rbx2b
Ongoing Actions: We are working on fixing the problem. We apologize for any inconvenience caused.
Jan 7, 19:56 UTC

Jan 6, 2022

[ERI1][PCC] - E102A15

Resolved - Start time: 06/01/2022 01:07 UTC
End time: 06/01/2022 02:55 UTC
Technical impact (DC/geographical area) : ERI1C
Root cause : The incident is over, the VMs are UP.
The cause of this incident is the following change: https://network.status-ovhcloud.com/incidents/vcs23gx5ch7v
Jan 6, 02:59 UTC

Identified - Start time: 06/01/2022 01:07 UTC
User impact : The rack E102A15 has random failures on different hosts
Technical impact (DC/geographical area) : ERI1C
Scope of impact : E102A15
Ongoing Actions: Our teams are currently fixing the last impacted VMs. We'll get back to you when all are fixed.
Root cause : A change is the cause of this incident
https://network.status-ovhcloud.com/incidents/vcs23gx5ch7v
Jan 6, 02:51 UTC

Jan 5, 2022

[Worldwide][VMware] - Log4j CVE-2

Completed - The scheduled maintenance has been completed.
Jan 5, 17:04 UTC

Update - Update :All VMware components have been updated regarding LOG4J CVE-2, except HCX. Due to an unexpected behavior on this component during the update tests, we are working with VMware teams to upgrade HCX in a secure way. We will update this task as soon as a solution is available.
Dec 29, 11:47 UTC

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 17, 19:30 UTC

Scheduled - Start time : 17/12/2021 19:30 UTC
End time : 21/12/2021 18:00 UTC
Service impact : None
Service improvement : This change is related to VMware - Log4j CVE- VMSA-2021-0028. We need to mitigate CVE on VMware (LogInsight , Vcsa , Nsx , Vrops)
Dec 17, 19:20 UTC

Jan 4, 2022

No incidents reported.