Skip to content

Conversation

@virajmehta
Copy link
Member

@virajmehta virajmehta commented Dec 9, 2025

We were using an old handrolled inference query in the UI which was resulting in tool-related regressions.

This PR rips the old query and many of the related types in favor of the new API.
There were a few fields I needed to add. In particular:

  • inference parameters
  • processing_time_ms, ttft_ms

I also had to extend the hacky file resolution logic for this case. This was unfortunate; let's add file resolution optionally to the inference API.


Important

This PR updates the UI to use the new inference v1 API, replacing the old query, and adds support for new fields and file resolution logic.

  • Behavior:
    • Replaces old inference query with new v1 API in InferenceDetailContent.tsx, route.tsx, and inference.utils.tsx.
    • Adds fields inference_params, processing_time_ms, and ttft_ms to inference data.
    • Extends file resolution logic for StoredInput in resolve.server.ts.
  • API Client:
    • Adds getInferences() method to TensorZeroClient in tensorzero.ts.
    • Updates listInferencesWithPagination() in inference.server.ts to use v1 API.
  • Tests:
    • Updates e2e tests in editing-output.spec.ts and editing.spec.ts to reflect new API usage.
    • Adds tests for new fields and API behavior in inference.test.ts.

This description was created by Ellipsis for e5f35fc. You can customize this summary. It will automatically update as commits are pushed.

Copy link
Member

@shuyangli shuyangli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good change, thanks! Few minor things

@shuyangli shuyangli assigned virajmehta and unassigned shuyangli Dec 9, 2025
github-actions bot pushed a commit that referenced this pull request Dec 9, 2025
@Aaron1011
Copy link
Member

/regen-fixtures

@Aaron1011
Copy link
Member

/regen-fixtures

@Aaron1011
Copy link
Member

/regen-fixtures

@Aaron1011
Copy link
Member

/regen-fixtures

@virajmehta
Copy link
Member Author

/regen-fixtures

@github-actions
Copy link
Contributor

🚀 Merge queue workflow triggered!

View the run: https://github.com/tensorzero/tensorzero/actions/runs/20110107013

@virajmehta
Copy link
Member Author

/regen-fixtures

@virajmehta
Copy link
Member Author

/regen-fixtures

Copy link
Member

@shuyangli shuyangli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

blind

@virajmehta virajmehta added this pull request to the merge queue Dec 10, 2025
Merged via the queue into main with commit fc0406e Dec 10, 2025
56 checks passed
@virajmehta virajmehta deleted the viraj/fix-tool-handling-ui branch December 10, 2025 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants