-
Notifications
You must be signed in to change notification settings - Fork 743
Use get inference v1 API in UI #5072
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
tensorzero-core/tests/e2e/endpoints/stored_inferences/get_inferences.rs
Outdated
Show resolved
Hide resolved
shuyangli
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good change, thanks! Few minor things
|
/regen-fixtures |
|
/regen-fixtures |
|
/regen-fixtures |
|
/regen-fixtures |
|
/regen-fixtures |
|
🚀 Merge queue workflow triggered! View the run: https://github.com/tensorzero/tensorzero/actions/runs/20110107013 |
…viraj/fix-tool-handling-ui
|
/regen-fixtures |
|
/regen-fixtures |
shuyangli
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
blind
We were using an old handrolled inference query in the UI which was resulting in tool-related regressions.
This PR rips the old query and many of the related types in favor of the new API.
There were a few fields I needed to add. In particular:
I also had to extend the hacky file resolution logic for this case. This was unfortunate; let's add file resolution optionally to the inference API.
Important
This PR updates the UI to use the new inference v1 API, replacing the old query, and adds support for new fields and file resolution logic.
InferenceDetailContent.tsx,route.tsx, andinference.utils.tsx.inference_params,processing_time_ms, andttft_msto inference data.StoredInputinresolve.server.ts.getInferences()method toTensorZeroClientintensorzero.ts.listInferencesWithPagination()ininference.server.tsto use v1 API.editing-output.spec.tsandediting.spec.tsto reflect new API usage.inference.test.ts.This description was created by
for e5f35fc. You can customize this summary. It will automatically update as commits are pushed.