{"success":true,"data":{"page":{"id":"368113f9-a57e-45c5-bec4-8ef99b655e2a","slug":"bluehive","title":"BlueHive Health Status Page"},"overall":{"level":"down","label":"Major outage"},"aggregate":{"24h":92.7928,"7d":98.28213333333333,"30d":98.92363333333333,"90d":98.92363333333333},"monitors":[{"check_id":"79d4a2d1-b06f-42da-8a12-1d28192ffcaa","url":"https://bluehive.com","display_name":"BlueHive Marketing Site","status":"up","status_changed_at":"2026-06-13 21:34:17","uptime":{"24h":100,"7d":100,"30d":100,"90d":100},"avg_latency_ms":66.26,"group_id":null,"group_ids":[]},{"check_id":"3241cbf2-bcff-45bf-a7c0-5e8849dccc37","url":"https://provider.bluehive.com","display_name":"BlueHive for Providers","status":"down","status_changed_at":"2026-08-14 20:05:58","uptime":{"24h":89.1892,"7d":97.671,"30d":98.2591,"90d":98.2591},"avg_latency_ms":219.58,"group_id":"a5452ba7-4d07-41fe-a507-80710bab110b","group_ids":["a5452ba7-4d07-41fe-a507-80710bab110b"]},{"check_id":"4828404a-21ae-4dfe-861a-d66ad1978a2e","url":"https://employer.bluehive.com","display_name":"BlueHive for Employers","status":"down","status_changed_at":"2026-08-14 20:05:58","uptime":{"24h":89.1892,"7d":97.1754,"30d":98.5118,"90d":98.5118},"avg_latency_ms":338.1,"group_id":"a5452ba7-4d07-41fe-a507-80710bab110b","group_ids":["a5452ba7-4d07-41fe-a507-80710bab110b"]}],"incidents":[{"id":"1786c353-629e-4531-9785-7fa02de78cb7","status":"open","title":"BlueHive Service Disruption — Fort Wayne Datacenter Power Failure","severity":"major","impact":"major","created_at":"2026-08-14 20:26:59","updated_at":"2026-08-14 21:45:29","resolved_at":null,"group_scope_mode":"derived","monitor_ids":["3241cbf2-bcff-45bf-a7c0-5e8849dccc37","4828404a-21ae-4dfe-861a-d66ad1978a2e"],"latest_update":"Restoration efforts remain actively underway at our Fort Wayne datacenter.\n\nOur technical teams are currently focused on restoring our edge networking infrastructure, a critical step toward bringing BlueHive services back online. We are making progress and are hopeful that services will begin restoring shortly.\n\nThe backup generator remains operational while utility power to the area continues to be impacted by the severe weather.\n\nMultiple technicians and emergency crews continue to work on-site to restore affected infrastructure and services as quickly and safely as possible.\n\nWe appreciate your continued patience and will provide another update within 30 minutes, or sooner if there is a significant change in service availability.","latest_update_status":"identified"},{"id":"a09f6c13-8fee-4dd6-811d-381e530f7d2a","status":"resolved","title":"Investigating – Phoenix Datacenter Service Disruption","severity":"critical","impact":"major","created_at":"2026-08-13 13:56:38","updated_at":null,"resolved_at":"2026-08-13 14:46:59","group_scope_mode":"derived","monitor_ids":["3241cbf2-bcff-45bf-a7c0-5e8849dccc37","4828404a-21ae-4dfe-861a-d66ad1978a2e"],"latest_update":"All affected checks are reporting up. Incident resolved automatically.","latest_update_status":"resolved"},{"id":"2705a115-530a-410e-abea-e7a5f0dbe123","status":"resolved","title":"BlueHive Service Incident – July 16, 2026","severity":"critical","impact":"major","created_at":"2026-07-16 21:56:00","updated_at":"2026-07-17 21:27:30","resolved_at":"2026-07-17 07:06:00","group_scope_mode":"derived","monitor_ids":["3241cbf2-bcff-45bf-a7c0-5e8849dccc37","4828404a-21ae-4dfe-861a-d66ad1978a2e"],"latest_update":"# BlueHive Incident Report\n\n## July 16, 2026 Production Service Interruption\n\n**Incident Date:** July 16–17, 2026\n**Status:** Resolved\n**Severity:** Major Service Interruption\n\n---\n\n# Executive Summary\n\nOn July 16, 2026, at approximately **2:56 PM MST**, BlueHive experienced a significant production service interruption affecting customers hosted within our Phoenix production environment.\n\nThe incident was initiated by an emergency power event within our colocation facility that resulted in an unexpected loss of power across portions of our production infrastructure. Although electrical service was restored relatively quickly, the event exposed several infrastructure dependencies that complicated recovery, including networking, storage, DNS, and application startup sequencing.\n\nOur engineering team immediately initiated incident response, dispatched personnel onsite to the data center, engaged our colocation provider's facilities and engineering teams, and worked continuously throughout the event to restore customer services while validating infrastructure integrity.\n\nCustomer-facing services were fully restored by **12:06 AM MST on July 17**.\n\nMost importantly, **no customer data was lost or corrupted** during this incident.\n\nWhile the platform has been fully restored, the duration of this outage did not meet our standards. We are conducting a comprehensive engineering review with our colocation provider and implementing several architectural improvements to further strengthen platform resiliency.\n\n---\n\n# Customer Impact\n\n**Incident Start**\n\nJuly 16, 2026 – 2:56 PM MST\n\n**Service Restored**\n\nJuly 17, 2026 – 12:06 AM MST\n\n### Impact\n\nA subset of BlueHive customers experienced:\n\n* Inability to access the BlueHive platform\n* Delayed or unavailable API requests\n* Delayed order processing\n* Temporary interruption of provider connectivity\n* Intermittent service availability during recovery\n\nNo evidence of customer data loss or database corruption was identified during post-recovery validation. \n\n---\n\n# Timeline\n\n### 2:56 PM\n\nAutomated monitoring detected the loss of multiple production systems hosted within the Phoenix environment.\n\nIncident response procedures were immediately initiated while engineering teams began assessing scope and engaging our colocation provider.\n\n---\n\n### 3:15 PM\n\nOn-site engineers confirmed that multiple infrastructure racks had unexpectedly lost power.\n\nRecovery efforts immediately prioritized restoration of core networking infrastructure including firewalls, switching, virtualization hosts, and storage systems.\n\n---\n\n### 4:00 PM\n\nPower began returning to affected equipment.\n\nAlthough systems were receiving electrical power again, expected network communication did not automatically recover. Engineering efforts shifted from electrical restoration toward infrastructure recovery.\n\n---\n\n### 5:30 PM\n\nEngineers isolated several networking conditions preventing infrastructure from communicating after power restoration.\n\nTo accelerate recovery while maintaining platform stability, portions of the redundant networking topology were temporarily simplified to establish known-good communication paths.\n\n---\n\n### 7:00 PM\n\nCritical infrastructure components including storage clusters, virtualization hosts, DNS services, and networking continued recovering as dependencies were restored.\n\nCustomer environments progressively returned online.\n\n---\n\n### 9:00 PM\n\nCore application services resumed normal operation as remaining infrastructure dependencies were restored.\n\nEngineering continued validating customer environments while monitoring for residual issues.\n\n---\n\n### 12:06 AM\n\nAll customer-facing BlueHive services had been restored.\n\nThe incident transitioned from recovery into monitoring, validation, and root cause investigation. \n\n---\n\n# Technical Summary\n\nThis incident began with an unexpected power disruption originating within our Phoenix colocation facility.\n\nAlthough electrical service was restored, the power event exposed several independent infrastructure dependencies that significantly extended overall recovery time.\n\nThese included:\n\n* Network redundancy behavior following simultaneous infrastructure power restoration\n* Network configuration inconsistencies identified during recovery\n* Service startup dependencies across DNS, storage, virtualization, and application layers\n* Operational complexity within portions of our redundant networking architecture\n\nNo single software defect or hardware failure was responsible for the duration of the outage.\n\nInstead, multiple independent infrastructure recovery conditions combined into a cascading event that required sequential restoration before customer workloads could safely resume. \n\n---\n\n# Power Infrastructure\n\nThe Phoenix production environment was intentionally designed with fully redundant power infrastructure.\n\nEach production rack is connected to independent **A-side** and **B-side** power distribution units (PDUs). These power paths are expected to remain electrically independent through separate UPS systems, generator systems, breakers, and facility power distribution. The architecture is specifically designed so that the loss of any single electrical path should **not** interrupt production services.\n\nDuring this incident, however, systems connected to **both** redundant power paths experienced an unexpected loss of power.\n\nBased on the architecture of the environment, this should not have occurred.\n\nBecause both redundant power paths were simultaneously affected, we have formally escalated the incident with our colocation provider. A joint engineering review is currently underway to validate the physical implementation of the facility's A/B power architecture, confirm complete electrical independence throughout the power distribution chain, and determine why the expected redundancy did not isolate this event.\n\nUntil that investigation is complete, we will not speculate on the precise facility-side failure mechanism. However, our expectation is clear: **production infrastructure should remain operational through the loss of any single power path**, and this event did not meet that expectation. \n\n---\n\n# Why Recovery Took Time\n\nDistributed healthcare platforms are composed of multiple infrastructure layers that depend on one another.\n\nRestoring electrical power represents only the first stage of recovery.\n\nThe BlueHive platform relies on coordinated operation of:\n\n* Power infrastructure\n* Network switching\n* Routing and firewalls\n* Storage clusters\n* DNS services\n* Virtualization hosts\n* Database clusters\n* Application services\n\nAlthough power returned early in the incident, each layer required validation before dependent services could safely restart.\n\nRather than rushing application startup, our engineering teams intentionally prioritized platform integrity and data consistency, restoring each layer in sequence before proceeding to the next.\n\nThis approach protected customer data while minimizing the risk of additional cascading failures.\n\n---\n\n# What Went Well\n\nSeveral aspects of our operational response performed exactly as intended.\n\n* Incident monitoring detected the outage immediately.\n* Engineering personnel responded within minutes.\n* On-site engineers were dispatched directly to the Phoenix facility.\n* Customer data remained fully intact throughout the incident.\n* Storage clusters recovered without data loss.\n* Cross-functional engineering teams worked continuously until all customer environments had been restored.\n* The incident surfaced several infrastructure improvements that are already being implemented. \n\n---\n\n# Opportunities for Improvement\n\nEvery production incident provides valuable engineering lessons.\n\nThis event highlighted several opportunities to improve the platform.\n\n* Simplify portions of our network redundancy architecture to reduce recovery complexity.\n* Expand monitoring to include infrastructure dependency validation rather than simple availability checks.\n* Improve automated recovery validation after power events.\n* Increase visibility into configuration drift across network infrastructure.\n* Provide more frequent customer status updates during major incidents.\n* Continue expanding disaster recovery testing under realistic failure scenarios. \n\n---\n\n# Corrective Actions\n\nSeveral engineering initiatives have already been started as a direct result of this incident.\n\n## Infrastructure\n\n* Complete audit of Phoenix power distribution architecture.\n* Verify true independence of all A/B power feeds.\n* Joint engineering review with the colocation provider.\n* Simplify selected network redundancy components where appropriate.\n\n## Monitoring\n\n* Expand infrastructure dependency monitoring.\n* Implement automated network configuration drift detection.\n* Improve topology validation and interface monitoring.\n* Increase visibility into startup dependencies following infrastructure failures.\n\n## Operations\n\n* Enhance disaster recovery validation procedures.\n* Improve deployment and operational documentation.\n* Standardize incident communications with scheduled customer updates.\n* Increase automation around infrastructure recovery validation.\n\nThese improvements are already underway and will continue over the coming weeks. \n\n---\n\n# Closing\n\nBlueHive is trusted to support critical occupational health workflows, and we recognize the responsibility that comes with that trust.\n\nWhile no production platform can eliminate every possible failure scenario, every incident should make the platform stronger than it was before.\n\nThis event challenged several assumptions about our infrastructure and recovery processes. The findings are already driving meaningful improvements across our power architecture, networking, monitoring, automation, and operational procedures.\n\nWe sincerely apologize for the disruption and appreciate the patience and professionalism our customers demonstrated throughout the incident. Our commitment remains unchanged: to deliver a resilient, secure, and highly available platform that healthcare providers and employers can depend on every day.","latest_update_status":"postmortem"}],"uptime":{"79d4a2d1-b06f-42da-8a12-1d28192ffcaa":[{"d":"2026-05-17","u":100},{"d":"2026-05-18","u":100},{"d":"2026-05-19","u":100},{"d":"2026-05-20","u":100},{"d":"2026-05-21","u":100},{"d":"2026-05-22","u":100},{"d":"2026-05-23","u":100},{"d":"2026-05-24","u":100},{"d":"2026-05-25","u":100},{"d":"2026-05-26","u":100},{"d":"2026-05-27","u":100},{"d":"2026-05-28","u":100},{"d":"2026-05-29","u":100},{"d":"2026-05-30","u":100},{"d":"2026-05-31","u":99.65277777777779},{"d":"2026-06-01","u":100},{"d":"2026-06-02","u":100},{"d":"2026-06-03","u":100},{"d":"2026-06-04","u":100},{"d":"2026-06-05","u":100},{"d":"2026-06-06","u":100},{"d":"2026-06-07","u":100},{"d":"2026-06-08","u":100},{"d":"2026-06-09","u":100},{"d":"2026-06-10","u":100},{"d":"2026-06-11","u":99.65277777777779},{"d":"2026-06-12","u":100},{"d":"2026-06-13","u":99.65277777777779},{"d":"2026-06-14","u":100},{"d":"2026-06-15","u":100},{"d":"2026-06-16","u":100},{"d":"2026-06-17","u":100},{"d":"2026-06-18","u":100},{"d":"2026-06-19","u":100},{"d":"2026-06-20","u":100},{"d":"2026-06-21","u":100},{"d":"2026-06-22","u":100},{"d":"2026-06-23","u":100},{"d":"2026-06-24","u":100},{"d":"2026-06-25","u":100},{"d":"2026-06-26","u":100},{"d":"2026-06-27","u":100},{"d":"2026-06-28","u":100},{"d":"2026-06-29","u":100},{"d":"2026-06-30","u":100},{"d":"2026-07-01","u":100},{"d":"2026-07-02","u":100},{"d":"2026-07-03","u":100},{"d":"2026-07-04","u":100},{"d":"2026-07-05","u":100},{"d":"2026-07-06","u":100},{"d":"2026-07-07","u":100},{"d":"2026-07-08","u":100},{"d":"2026-07-09","u":100},{"d":"2026-07-10","u":100},{"d":"2026-07-11","u":100},{"d":"2026-07-12","u":100},{"d":"2026-07-13","u":100},{"d":"2026-07-14","u":100},{"d":"2026-07-15","u":100},{"d":"2026-07-16","u":100},{"d":"2026-07-17","u":100},{"d":"2026-07-18","u":100},{"d":"2026-07-19","u":100},{"d":"2026-07-20","u":100},{"d":"2026-07-21","u":100},{"d":"2026-07-22","u":100},{"d":"2026-07-23","u":100},{"d":"2026-07-24","u":100},{"d":"2026-07-25","u":100},{"d":"2026-07-26","u":100},{"d":"2026-07-27","u":100},{"d":"2026-07-28","u":100},{"d":"2026-07-29","u":100},{"d":"2026-07-30","u":100},{"d":"2026-07-31","u":100},{"d":"2026-08-01","u":100},{"d":"2026-08-02","u":100},{"d":"2026-08-03","u":100},{"d":"2026-08-04","u":100},{"d":"2026-08-05","u":100},{"d":"2026-08-06","u":100},{"d":"2026-08-07","u":100},{"d":"2026-08-08","u":100},{"d":"2026-08-09","u":100},{"d":"2026-08-10","u":100},{"d":"2026-08-11","u":100},{"d":"2026-08-12","u":100},{"d":"2026-08-13","u":100},{"d":"2026-08-14","u":100}],"3241cbf2-bcff-45bf-a7c0-5e8849dccc37":[{"d":"2026-05-17","u":100},{"d":"2026-05-18","u":100},{"d":"2026-05-19","u":100},{"d":"2026-05-20","u":100},{"d":"2026-05-21","u":100},{"d":"2026-05-22","u":100},{"d":"2026-05-23","u":100},{"d":"2026-05-24","u":100},{"d":"2026-05-25","u":100},{"d":"2026-05-26","u":100},{"d":"2026-05-27","u":100},{"d":"2026-05-28","u":100},{"d":"2026-05-29","u":100},{"d":"2026-05-30","u":100},{"d":"2026-05-31","u":100},{"d":"2026-06-01","u":100},{"d":"2026-06-02","u":100},{"d":"2026-06-03","u":100},{"d":"2026-06-04","u":100},{"d":"2026-06-05","u":100},{"d":"2026-06-06","u":100},{"d":"2026-06-07","u":100},{"d":"2026-06-08","u":100},{"d":"2026-06-09","u":100},{"d":"2026-06-10","u":100},{"d":"2026-06-11","u":100},{"d":"2026-06-12","u":100},{"d":"2026-06-13","u":100},{"d":"2026-06-14","u":100},{"d":"2026-06-15","u":100},{"d":"2026-06-16","u":100},{"d":"2026-06-17","u":100},{"d":"2026-06-18","u":99.65277777777779},{"d":"2026-06-19","u":100},{"d":"2026-06-20","u":100},{"d":"2026-06-21","u":100},{"d":"2026-06-22","u":100},{"d":"2026-06-23","u":100},{"d":"2026-06-24","u":100},{"d":"2026-06-25","u":100},{"d":"2026-06-26","u":100},{"d":"2026-06-27","u":100},{"d":"2026-06-28","u":100},{"d":"2026-06-29","u":100},{"d":"2026-06-30","u":100},{"d":"2026-07-01","u":100},{"d":"2026-07-02","u":100},{"d":"2026-07-03","u":100},{"d":"2026-07-04","u":100},{"d":"2026-07-05","u":100},{"d":"2026-07-06","u":100},{"d":"2026-07-07","u":100},{"d":"2026-07-08","u":99.65277777777779},{"d":"2026-07-09","u":100},{"d":"2026-07-10","u":100},{"d":"2026-07-11","u":100},{"d":"2026-07-12","u":97.91666666666666},{"d":"2026-07-13","u":100},{"d":"2026-07-14","u":100},{"d":"2026-07-15","u":100},{"d":"2026-07-16","u":78.81944444444444},{"d":"2026-07-17","u":87.84722222222221},{"d":"2026-07-18","u":100},{"d":"2026-07-19","u":100},{"d":"2026-07-20","u":100},{"d":"2026-07-21","u":100},{"d":"2026-07-22","u":100},{"d":"2026-07-23","u":100},{"d":"2026-07-24","u":100},{"d":"2026-07-25","u":100},{"d":"2026-07-26","u":100},{"d":"2026-07-27","u":100},{"d":"2026-07-28","u":100},{"d":"2026-07-29","u":100},{"d":"2026-07-30","u":100},{"d":"2026-07-31","u":99.644128113879},{"d":"2026-08-01","u":100},{"d":"2026-08-02","u":100},{"d":"2026-08-03","u":100},{"d":"2026-08-04","u":100},{"d":"2026-08-05","u":100},{"d":"2026-08-06","u":100},{"d":"2026-08-07","u":100},{"d":"2026-08-08","u":100},{"d":"2026-08-09","u":98.26388888888889},{"d":"2026-08-10","u":100},{"d":"2026-08-11","u":100},{"d":"2026-08-12","u":100},{"d":"2026-08-13","u":94.44444444444444},{"d":"2026-08-14","u":88.23529411764706}],"4828404a-21ae-4dfe-861a-d66ad1978a2e":[{"d":"2026-05-17","u":100},{"d":"2026-05-18","u":100},{"d":"2026-05-19","u":100},{"d":"2026-05-20","u":100},{"d":"2026-05-21","u":100},{"d":"2026-05-22","u":100},{"d":"2026-05-23","u":100},{"d":"2026-05-24","u":100},{"d":"2026-05-25","u":100},{"d":"2026-05-26","u":100},{"d":"2026-05-27","u":100},{"d":"2026-05-28","u":100},{"d":"2026-05-29","u":100},{"d":"2026-05-30","u":100},{"d":"2026-05-31","u":100},{"d":"2026-06-01","u":100},{"d":"2026-06-02","u":100},{"d":"2026-06-03","u":100},{"d":"2026-06-04","u":100},{"d":"2026-06-05","u":100},{"d":"2026-06-06","u":100},{"d":"2026-06-07","u":100},{"d":"2026-06-08","u":100},{"d":"2026-06-09","u":100},{"d":"2026-06-10","u":100},{"d":"2026-06-11","u":100},{"d":"2026-06-12","u":100},{"d":"2026-06-13","u":100},{"d":"2026-06-14","u":100},{"d":"2026-06-15","u":100},{"d":"2026-06-16","u":100},{"d":"2026-06-17","u":100},{"d":"2026-06-18","u":99.65277777777779},{"d":"2026-06-19","u":100},{"d":"2026-06-20","u":100},{"d":"2026-06-21","u":100},{"d":"2026-06-22","u":100},{"d":"2026-06-23","u":100},{"d":"2026-06-24","u":100},{"d":"2026-06-25","u":100},{"d":"2026-06-26","u":100},{"d":"2026-06-27","u":100},{"d":"2026-06-28","u":100},{"d":"2026-06-29","u":100},{"d":"2026-06-30","u":100},{"d":"2026-07-01","u":100},{"d":"2026-07-02","u":100},{"d":"2026-07-03","u":100},{"d":"2026-07-04","u":100},{"d":"2026-07-05","u":100},{"d":"2026-07-06","u":100},{"d":"2026-07-07","u":100},{"d":"2026-07-08","u":100},{"d":"2026-07-09","u":100},{"d":"2026-07-10","u":100},{"d":"2026-07-11","u":100},{"d":"2026-07-12","u":98.25783972125436},{"d":"2026-07-13","u":100},{"d":"2026-07-14","u":100},{"d":"2026-07-15","u":100},{"d":"2026-07-16","u":78.81944444444444},{"d":"2026-07-17","u":87.84722222222221},{"d":"2026-07-18","u":100},{"d":"2026-07-19","u":100},{"d":"2026-07-20","u":100},{"d":"2026-07-21","u":100},{"d":"2026-07-22","u":100},{"d":"2026-07-23","u":99.2831541218638},{"d":"2026-07-24","u":100},{"d":"2026-07-25","u":100},{"d":"2026-07-26","u":100},{"d":"2026-07-27","u":100},{"d":"2026-07-28","u":100},{"d":"2026-07-29","u":100},{"d":"2026-07-30","u":100},{"d":"2026-07-31","u":100},{"d":"2026-08-01","u":100},{"d":"2026-08-02","u":100},{"d":"2026-08-03","u":100},{"d":"2026-08-04","u":100},{"d":"2026-08-05","u":100},{"d":"2026-08-06","u":100},{"d":"2026-08-07","u":100},{"d":"2026-08-08","u":100},{"d":"2026-08-09","u":98.26388888888889},{"d":"2026-08-10","u":100},{"d":"2026-08-11","u":100},{"d":"2026-08-12","u":100},{"d":"2026-08-13","u":91.28919860627178},{"d":"2026-08-14","u":88.23529411764706}]},"maintenance":{"active":[],"upcoming":[]},"generated_at":"2026-08-14T22:46:12.356Z"}}