Design an API gateway handling 100K requests/sec across 500+ backend services with <5ms p99 latency overhead, supporting routing, auth, rate limiting, and request transformation.
## Problem
Design an API gateway that serves as the single entry point for a platform with 500+ backend microservices. The gateway must handle request routing, authentication, rate limiting, request/response transformation, and API versioning — all while adding less than 5ms of latency overhead at p99. Think of building the core infrastructure behind Kong, AWS API Gateway, or Apigee.
Sign up to access the full problem
Design canvas, rubric, hints, and model solutions.