System Status

ClawBotCloud runs entirely on Fly.io infrastructure. If Fly.io is experiencing issues, your bots may be affected.

All Systems Operational

Last updated about 4 hours ago

Components

Core Infrastructure

Machines APIOperational
DeploymentsOperational
DNSOperational
Persistent Storage (Volumes)Operational
Remote BuildsOperational
Fly Machine Image Registry 1Operational
SSL/TLS Certificate ProvisioningOperational
Customer ApplicationsOperational

Key Regions

AMS - Amsterdam, NetherlandsOperational
FRA - Frankfurt, GermanyOperational
LHR - London, United KingdomOperational
IAD - Ashburn, Virginia (US)Operational

Recent Resolved Incidents

Backend errors when trying to use Grafana to view logs
1 day agonone
resolved1 day ago

This incident is resolved, Grafana logs are now working properly.

monitoring1 day ago

We've deployed a fix and are monitoring the results. Logs are now be visible on Grafana.

identified1 day ago

Using the Logs panel in Grafana at https://fly-metrics.net/ will show a 502 error from the backend and won't show any logs. You can use `fly logs` or the live log viewer directly on https://fly.io/dashboard to view streaming logs for the time being.

investigating1 day ago

Using the Logs panel in Grafana at https://fly-metrics.net/ will show a 502 error from the backend and won't show any logs. You can use `fly logs` or the live log viewer directly on https://fly.io/dashboard to view streaming logs for the time being.

View on Fly.io
Machines failing to start in DFW
1 day agominor
resolved1 day ago

This incident has been resolved.

monitoring4 days ago

Machine start success rates in DFW have improved but we are continuing to monitor and make further adjustments. We will provide updates as the situation progresses.

monitoring4 days ago

In addition to freeing up existing capacity, the team has provisioned new capacity in DFW and we are monitoring the results.

monitoring5 days ago

We freed up some capacity on our workers to allow for successful Machine starts.

investigating5 days ago

The Machines start failure rate is elevated in DFW.

View on Fly.io
Metrics currently experiencing issues
5 days agocritical
resolved5 days ago

This incident has been resolved. We're unable to recover the lost metrics from that one hour.

monitoring6 days ago

We have implemented a fix. There has been approximately 1h of lost metrics from 06:07UTC. We're monitoring the cluster for further issues

investigating6 days ago

We are currently investigating an issue with our metrics cluster.

View on Fly.io
Machines failing to start in DFW
6 days agomajor
resolved6 days ago

This incident has been resolved. Machine creates in DFW continue to work normally.

monitoring6 days ago

A fix has been implemented and we are monitoring the results.

identified6 days ago

The team is currently rolling out additional capacity in DFW which should help ease Machine start failures across the region.

investigating6 days ago

We are investigating reports of machines failing to start in the DFW (Dallas) region with "insufficient memory" errors. This may cause deployment failures for applications running in DFW. Our team is actively working to restore full capacity in the region. If you are affected, deploying to an alternate region may serve as a temporary workaround. We will provide updates as the situation progresses.

View on Fly.io
IPv6 networking issues in SJC region
6 days agomajor
resolved6 days ago

This incident has been resolved.

monitoring6 days ago

A fix has been implemented and we are monitoring the results.

investigating6 days ago

We are investigating intermittent network issues in SJC region impacting outbound public IPv6 access from Machines. Connecting to IPv6 internet resources from apps hosted in SJC region may be slow or fail at this time. IPv4 access, as well as 6PN private networking, are unaffected.

View on Fly.io