Everything looks better now. We're going to close the incident while we continue to investigate the root cause.
Feb 12, 11:41 PST
We were still seeing errors, so we're turning off the optimizations again.
Feb 12, 11:24 PST
403 errors are back below 0.5%, but as predicted, latencies are up. We're going to slowly bring back some optimizations.
Feb 12, 08:43 PST
Seeing spikes up to 9% of requests, from a baseline of 0.5-1%. Rolling back to an earlier build, and disabling experimental optimizations. Bigger accounts may experience greater latencies.
Feb 12, 08:03 PST
Investigating reports of sporadic 403 errors for valid tokens, and possible slowness.
Feb 12, 07:55 PST