Header Image
Active Incident

Updated a few seconds ago

Incident Status

Operational

Components

TherapyAppointment, TherapyAppointment API

Locations

Cloud Hosting



December 22, 2021 7:44AM EST
[Investigating] TherapyAppointment 2.0 is currently experiencing an issue connecting to database servers at Amazon Web Services. This can cause the dashboard, schedule, and other areas of the application to fail or appear empty. We are engaged with AWS technical support and are restarting services at this time.

December 22, 2021 7:46AM EST
[Investigating] We are restarting connections to database servers hosted at Amazon Web Services.

December 22, 2021 8:15AM EST
[Monitoring] Amazon Web Services (AWS) is currently experiencing a network outage in the region that serves TherapyAppointment customers and many other applications and web sites. TherapyAppointment is monitoring the issue and will provide updates as we learn more. For more technical information, please refer to https://status.aws.amazon.com/.

December 22, 2021 8:21AM EST
[Monitoring] Amazon Web Services (AWS) has confirmed a power outage within a data center hosting TherapyAppointment 2.0: "We can confirm a loss of power within a single data center within a single Availability Zone (USE1-AZ4) in the US-EAST-1 Region. This is affecting availability and connectivity to EC2 instances that are part of the affected data center within the affected Availability Zone. We are also experiencing elevated RunInstance API error rates for launches within the affected Availability Zone. Connectivity and power to other data centers within the affected Availability Zone, or other Availability Zones within the US-EAST-1 Region are not affected by this issue, but we would recommend failing away from the affected Availability Zone (USE1-AZ4) if you are able to do so. We continue to work to address the issue and restore power within the affected data center."

December 22, 2021 8:28AM EST
[Monitoring] Amazon Web Services (AWS) services are recovering and we are verifying service before restarting TherapyAppointment 2.0.

December 22, 2021 8:36AM EST
[Monitoring] TherapyAppointment 2.0 has been restarted. We are manually monitoring all services for the next hour before closing this incident.

December 22, 2021 8:56AM EST
[Monitoring] Amazon Web Services (AWS) has provided further information. TherapyAppointment is investigating why redundant database servers in separate physical facilities were not immediately utilized. "5:39 AM PST We have now restored power to all instances and network devices within the affected data center and are seeing recovery for the majority of EC2 instances and EBS volumes within the affected Availability Zone. Network connectivity within the affected Availability Zone has also returned to normal levels. While all services are starting to see meaningful recovery, services which were hosting endpoints within the affected data center - such as single-AZ RDS databases, ElastiCache, etc. - would have seen impact during the event, but are starting to see recovery now. Given the level of recovery, if you have not yet failed away from the affected Availability Zone, you should be starting to see recovery at this stage."

Website




Operational

TherapyAppointment Legacy




Operational

TherapyAppointment




Operational

TherapyAppointment API




Operational

TherapyAppointment Beta




Operational

External Services