Skip to content

chore: allow workflow to trigger on push to main #411

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 29, 2025

Conversation

himanshusinghs
Copy link
Collaborator

@himanshusinghs himanshusinghs commented Jul 29, 2025

The workflow earlier was restricted to workflow_dispatch and pull requests with labels accuracy-tests because of the if check. This PR, expands the check itself to allow workflow to run on other valid conditions as well.

@Copilot Copilot AI review requested due to automatic review settings July 29, 2025 10:51
@himanshusinghs himanshusinghs requested a review from a team as a code owner July 29, 2025 10:51
@himanshusinghs himanshusinghs added the no-title-validation Add this label to disable the title check for this PR. label Jul 29, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR modifies the GitHub workflow trigger conditions to allow accuracy tests to run on pushes to the main branch, while maintaining the existing behavior for pull requests with the 'accuracy-tests' label.

  • Simplified the conditional logic for when the accuracy tests job should run
  • Changed from explicit inclusion of workflow_dispatch to exclusion-based logic that allows any event except unlabeled pull requests

@coveralls
Copy link
Collaborator

coveralls commented Jul 29, 2025

Pull Request Test Coverage Report for Build 16594214156

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.09%) to 80.344%

Totals Coverage Status
Change from base Build 16571425836: 0.09%
Covered Lines: 3104
Relevant Lines: 3827

💛 - Coveralls

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

📊 Accuracy Test Results

📈 Summary

Metric Value
Commit SHA 1d8786cc57f8e0500559fa562104dfc8b35bf89b
Run ID 7aec9bf4-3111-46d5-8325-fb928798bf57
Status done
Total Prompts Evaluated 51
Models Tested 1
Average Accuracy 98.5%
Responses with 0% Accuracy 0
Responses with 75% Accuracy 3
Responses with 100% Accuracy 48

📎 Download Full HTML Report - Look for the accuracy-test-summary artifact for detailed results.

Report generated on: 7/29/2025, 11:05:11 AM

@himanshusinghs himanshusinghs merged commit c94c58e into main Jul 29, 2025
19 checks passed
@himanshusinghs himanshusinghs deleted the chore/accuracy-test-workflow-update branch July 29, 2025 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
accuracy-tests no-title-validation Add this label to disable the title check for this PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants