Skip to content

feat: add overload protections to aibridged #1153

@dannykopping

Description

@dannykopping

Operators should be able to protect their coderd process (of which aibridged is a part) from overload due to excessive aibridge requests.

This can take the form of:

  • rate-limits
  • maximum concurrency
  • circuit-breakers (i.e. if excessive requests result in upstream rate-limits)
  • backpressure (sleep + HTTP 429)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions