Engineering Notes

Notes from the build.

Write-ups on the systems I've been building — data pipelines, LLM infrastructure, and the performance work in between. Long-form where it earns it, with the numbers that made the decision.

Showing 1 note tagged #cloud-run · clear filters

Matching notes

Infrastructure

Cutting 200–400ms per request by putting Cloud Run behind a load balancer

Every API call minted a fresh identity token through a three-step OIDC exchange. Replacing it with an HTTPS load balancer and a serverless NEG removed the tokens, the latency, and the vendor coupling.

6 August 20266 min read

Working on something similar?

If any of this is close to a problem you're facing, I'm happy to talk it through.

Start a conversation