Gadget - Notice history

All systems operational

Code editing - Operational

99.985% uptime
Sep 2025 · 100.00%Oct · 99.981%Nov · 99.976%

Previous page

Next page

Sep 2025
Oct 2025
Nov 2025

API writes - Operational

99.943% uptime
Sep 2025 · 99.978%Oct · 99.988%Nov · 99.862%

Previous page

Next page

Sep 2025
Oct 2025
Nov 2025

API reads - Operational

99.506% uptime
Sep 2025 · 98.647%Oct · 100.00%Nov · 99.870%

Previous page

Next page

Sep 2025
Oct 2025
Nov 2025

AI Assistant - Operational

99.977% uptime
Sep 2025 · 100.00%Oct · 100.00%Nov · 99.932%

Previous page

Next page

Sep 2025
Oct 2025
Nov 2025

Shopify Plugin - Operational

99.992% uptime
Sep 2025 · 100.00%Oct · 100.00%Nov · 99.976%

Previous page

Next page

Sep 2025
Oct 2025
Nov 2025

Notice history

View current status

Nov 2025

Delays in background action processing.
ResolvedPartial outage9 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • InvestigatingUTC
    We are currently investigating this incident.
Delays in background action processing
ResolvedDegraded performance9 hours 31 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC

    p95 start lag has recovered to normal values for all queues. We'll continue to monitor to ensure all is well. Please let us know in Discord if you are still seeing issues.

  • UpdateUTC

    Background action start latencies continue to improve, with the high, default, and low priority background action queues having fully recovered. Shopify webhook processing is still delayed for some applications.

  • IdentifiedUTC

    We are seeing improvements on queue latency for background jobs and are continuing to mitigate the issue.

  • InvestigatingUTC

    We are currently investigating issues with elevated background action queue processing times.

Elevated error rates for API reads and writes
ResolvedPartial outage21 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • InvestigatingUTC

    We are currently investigating this incident.

New app creation not succeeding.
ResolvedDegraded performance1 hour 5 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC

    Github has begun to recover and yarn installs are succeeding after retries. We'll continue to monitor.

  • IdentifiedUTC

    We are aware of an issue with new apps not successfully being created. This due to the current github outage. Existing applications are not impacted by this.

Major outage due to Cloudflare global network issues
ResolvedPartial outage6 hours 8 minutes
  • ResolvedUTC
    This incident has been resolved.
  • UpdateUTC

    We are continuing to monitor this and will do so until Cloudflare has marked their incident as resolved

  • UpdateUTC

    Services are recovering and we are monitoring closely

  • UpdateUTC

    Cloudflare rolling outages continue

  • MonitoringUTC

    Gadget services have recovered but we are monitoring for any further issues

  • InvestigatingUTC

    Cloudflare global network outages are causing Gadget apps to be unavailable: https://www.cloudflarestatus.com/

    We are investigating solutions

Oct 2025

Spike in API error rate
ResolvedPartial outage1 hour
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • IdentifiedUTC

    We have identified and issue causing an elevated number of Cannot read properties of undefined (reading 'SinceLastPersisted') errors.

API and Webhook degraded for some environments
ResolvedDegraded performance1 hour 55 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • IdentifiedUTC
    We are continuing to work on a fix for this incident.
Elevated background action execution wait times
ResolvedDegraded performance2 hours 15 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC

    We've implemented a fix and are working through the backlog as fast as possible. We'll update here when queues are fully caught up.

  • IdentifiedUTC

    Background actions are seeing elevated start lag. We are continuing to work on a fix for this incident.

Elevated error rates for API writes
ResolvedPartial outage1 hour 18 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • IdentifiedUTC

    API writes are occasionally failing with a Gadget framework issue like:


    Cannot read properties of null (reading 'SinceLastPersisted')



    We're reverting the offending change and will update when it has rolled out.

Elevated latencies for API reads and writes
ResolvedDegraded performance1 hour 54 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • IdentifiedUTC
    We are continuing to work on a fix for this incident.

Sep 2025

Out-of-date Search Indexes
ResolvedPartial outage31 hours 25 minutes
  • ResolvedUTC

    The issue that was causing search indexes to be out of date has been fixed.

    We are in the process of backfilling any changes our search indexes might have missed because of the incident.

  • MonitoringUTC

    We implemented a fix and are currently monitoring the result.

  • InvestigatingUTC

    A number of apps have out of date search indexes, causing search requests to return incomplete results.

    We are currently investigating this incident.

Automated incident detected, the team is investigating and will add more details here
ResolvedPartial outage
  • ResolvedUTC

    Automation: This incident has been resolved.

  • InvestigatingUTC

    We are currently investigating this incident.

High error rates
ResolvedPartial outage13 minutes
  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC
    We implemented a fix and are currently monitoring the result.
  • InvestigatingUTC

    We are currently investigating this incident.

Read/write outage for alpha apps
ResolvedPartial outage16 minutes
  • UpdateUTC

    This incident was a false alarm and was triggered by alpha infrastructure that is not used for customer workloads. We apologize for the noise.

  • ResolvedUTC

    Automation: This incident has been resolved.

  • IdentifiedUTC

    We have identified the issue and are deploying a fix.

  • InvestigatingUTC

    We are currently investigating this incident.

New app and environment creation failing due to upstream yarn package availability issues.
ResolvedDegraded performance1 hour 4 minutes
  • ResolvedUTC
    A fix has been deployed and this incident has been resolved.
  • IdentifiedUTC

    Node module debug v4.4.2 was compromised and removed from yarn packages. We are currently implementing a workaround for this issue. There will likely be more fallout from this issue as other compromised packages are pulled.

    We are continuing to monitor this incident and will provide workarounds if any other packages are removed. For further reading you can read this blog post

  • InvestigatingUTC

    Existing apps that have had a successful yarn installrun will continue to run as they have older dependencies cached in their yarn.lock file.

Previous

Sep 2025 to Nov 2025

Next