Gadget - We are investigating increased latency on some requests and GGT_DATABASE_OPERATION_TIMEOUTs – Incident details

All systems operational

We are investigating increased latency on some requests and GGT_DATABASE_OPERATION_TIMEOUTs

Resolved
Partial outage
Started 16 days agoLasted about 1 hour

Affected

API writes

Partial outage from 8:55 PM to 10:18 PM

API reads

Partial outage from 8:55 PM to 10:18 PM

AI Assistant

Partial outage from 8:55 PM to 10:18 PM

Shopify Plugin

Partial outage from 8:55 PM to 10:18 PM

Code editing

Partial outage from 8:55 PM to 10:18 PM

Updates
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Identified
    Identified

    This issue is now causing GGT_DATABASE_OPERATION_TIMEOUTs for some applications. We are continuing to work on a fix for this incident.

  • Monitoring
    Monitoring

    Our mitigations are lowering latencies and we are continuing to monitor the system.

  • Identified
    Identified

    We have identified the root cause and have put some mitigations in place and are monitoring their effectiveness.

  • Investigating
    Investigating
    We are currently investigating this incident.