Search results

Error when using hf.py with python 3.11

Status: Open.

#292 In evalplus/evalplus;

· egolf-cs opened on Nov 5, 2025

Cannot Run Evalplus on Single Humaneval Problems

Status: Open.

#291 In evalplus/evalplus;

· jasonzliang opened on Oct 29, 2025

🐛 [TestRemoval] - <HumanEval/0> <Wrong TC caused by floating point error>

bugSomething isn't workingSomething isn't working

Status: Open.

#289 In evalplus/evalplus;

· duncan020313 opened on Oct 16, 2025

🤗 [REQUEST] - FILL_THE_MODEL_NAME_HERE

model eval

Status: Open.

#287 In evalplus/evalplus;

· Rfcoder0 opened on Sep 21, 2025

🤗 [REQUEST] - Qwen3-Next

model eval

Status: Open.

#286 In evalplus/evalplus;

· BradKML opened on Sep 12, 2025

🤗 [REQUEST] - Kimi K2 (and Kimi-Dev)

model eval

Status: Open.

#279 In evalplus/evalplus;

· BradKML opened on Jul 16, 2025

[Improvement] HumanEval/111 canonical solution - ValueError on space-only input

Status: Open.

#278 In evalplus/evalplus;

· take0x opened on Jul 11, 2025

🐛 [TestRemoval] - HumanEval/0 , Asseration Oracle is Wrong

bugSomething isn't workingSomething isn't working

Status: Open.

#274 In evalplus/evalplus;

· Marvinmw opened on Jun 6, 2025

🐛 [TestRemoval] - <HumanEval/8> <Incorrect input type for plus_input[446] and plus_input[595]>

bugSomething isn't workingSomething isn't working

Status: Open.

#272 In evalplus/evalplus;

· mantine226 opened on May 27, 2025

🐛 [TestRemoval] - <HumanEval/132> 题意理解有误 The meaning of the question is wrong.

bugSomething isn't workingSomething isn't working

Status: Open.

#264 In evalplus/evalplus;

· Lorien1128 opened on Mar 4, 2025

🤗 [REQUEST] - DeepSeek R1 (and their Distills)

model eval

Status: Open.

#263 In evalplus/evalplus;

· BradKML opened on Feb 5, 2025

🤗 [REQUEST] Evaluate NovaSky-AI / Sky-T1-32B-Preview

model eval

Status: Open.

#261 In evalplus/evalplus;

· BLACKGAMER1221 opened on Jan 14, 2025