Update - As stated in our previous update the spike that just occurred might have caused some web request time outs but it has returned to normal operation at this time. Latency numbers are currently showing back to normal levels (pre incident).
Adeptcloud staff is still going through all virtual environments and infrastructure making sure customers are able to log in. And we are still awaiting datacenter storage engineering to provide the next update.
Oct 12, 2024 - 14:37 CDT
Adeptcloud staff is still going through all virtual environments and infrastructure making sure customers are able to log in. And we are still awaiting datacenter storage engineering to provide the next update.
Oct 12, 2024 - 14:37 CDT
Update - We have just detect a large spike in latency after the last 1.5 hour of normalized latency and are continuing to monitor the issue. We believe the latency spike at this time is related to the bug fix being applied by HPE and datacenter storage engineers and is a temporary spike.
Oct 12, 2024 - 14:28 CDT
Oct 12, 2024 - 14:28 CDT
Update - We have received an update from datacenter storage engineers that HPE has determined the storage latency issue is being caused by a software bug and they are working on a potential fix at this time. No current ETA has been provided but we are seeing latency numbers normalized to about 10-15% of baseline.
We are continuing to monitor and work with the datacenter on getting this resolved.
We are seeing majority of virtual machines have returned back to normal operations. Adeptcloud staff is rebooting some of the VMs that are experiencing issues from the previous latency and testing the log in process.
Oct 12, 2024 - 13:33 CDT
We are continuing to monitor and work with the datacenter on getting this resolved.
We are seeing majority of virtual machines have returned back to normal operations. Adeptcloud staff is rebooting some of the VMs that are experiencing issues from the previous latency and testing the log in process.
Oct 12, 2024 - 13:33 CDT
Update - We are seeing latency for the affected storage array have been reduced greatly over the last 30 minutes and we are seeing all virtual machines returning back operational status.
Adeptcloud staff is confirming functionality at this time and continuing to monitor the situation. While we do not have the all clear from datacenter storage engineers yet, they have been offloading workloads from the affected array.
We still may experience intermitted latency until we have confirmation of the exact issue and are leaving this degraded performance status on our status page.
Oct 12, 2024 - 13:12 CDT
Adeptcloud staff is confirming functionality at this time and continuing to monitor the situation. While we do not have the all clear from datacenter storage engineers yet, they have been offloading workloads from the affected array.
We still may experience intermitted latency until we have confirmation of the exact issue and are leaving this degraded performance status on our status page.
Oct 12, 2024 - 13:12 CDT
Monitoring - Datacenter storage engineers have engaged with HPE regarding the latency in PHX Cluster 101 and will provide updates as they become available.
We are continuing to monitor the situation and have seen latency slowly returning to normal.
We are aware of virtual machines still experiencing intermittent accessibility and performance issues.
Oct 12, 2024 - 10:28 CDT
We are continuing to monitor the situation and have seen latency slowly returning to normal.
We are aware of virtual machines still experiencing intermittent accessibility and performance issues.
Oct 12, 2024 - 10:28 CDT
Identified - We have been receiving alerts since early this morning of increased latency on one of the arrays, more specifically the PHX Storage Array 101 as well as reports of some virtual machines taking a long time to reboot.
We are attempting to move workloads off the affected storage array to alleviate any issues. This process might take a longer time than usual due to the high read latency.
In the last hour, latency has decreased approximately 20% and we are continuing to monitor it while working on resolving the problem.
We have engaged with the datacenter storage engineers to investigate the issue.
Oct 12, 2024 - 07:22 CDT
We are attempting to move workloads off the affected storage array to alleviate any issues. This process might take a longer time than usual due to the high read latency.
In the last hour, latency has decreased approximately 20% and we are continuing to monitor it while working on resolving the problem.
We have engaged with the datacenter storage engineers to investigate the issue.
Oct 12, 2024 - 07:22 CDT
About This Site
Welcome to Adeptcore, Inc. home of the Adeptcloud. Our status page was designed to give you a quick glance at our commitment to keeping you and your clients running.
Adeptcloud Infrastructure
Degraded Performance
ACP - Network
?
Operational
ACP - Storage
?
Degraded Performance
ACP - Nodes
?
Operational
ACP - Power
?
Operational
Cloud-Hosted
Operational
ACP - Cloud-Hosted
?
Operational
Third Party Tools
Operational
Zoom Zoom Cloud Room Connector
Operational
Zoom Zoom Software
Operational
Zoom Zoom Meetings
Operational
mailgun Inbound email processing
Operational
mailgun SMTP
Operational
mailgun Events & Logs
Operational
PagerDuty Notification Delivery
Operational
PagerDuty Web Application
Operational
PagerDuty REST API
Operational
PagerDuty Webhooks
Operational
Third Party Service Advisories
?
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.