Operators should be able to protect their coderd process (of which aibridged is a part) from overload due to excessive aibridge requests.
This can take the form of:
- rate-limits
- maximum concurrency
- circuit-breakers (i.e. if excessive requests result in upstream rate-limits)
- backpressure (sleep + HTTP 429)