PERF: reduce embedding concurrent generation #33781

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

SamSaffron merged 1 commit into main from improve_perf_embedding

Jul 23, 2025

+47 −28

Member

SamSaffron commented Jul 23, 2025

Reduce concurrent generation of embeddings
Correct error reporting
Use Discourse ThreadPool


          PERF: reduce concurrency on embedding thread pool

a07fc50

- Reduce concurrent embedding generation from 100 to 30 threads.
- Instead of using leaky CachedThreadPool, use the more predictable Scheduler::ThreadPool
- Report errors on embedding generation problems (once per 5 minutes)
- Correct error reporting for sentiment generation problems

github-actions bot added the discourse-ai label

tgxworld approved these changes

View reviewed changes

SamSaffron merged commit b36639f into main

16 checks passed

SamSaffron deleted the improve_perf_embedding branch

July 23, 2025 06:38

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels