更新 docs/draft.md
This commit is contained in:
+2
-2
@@ -400,8 +400,8 @@ metrics.json(每次实验一份,写入 SQLite 汇总表)
|
|||||||
|
|
||||||
| 数据集 | 规模 | 用途 | 对应指标 |
|
| 数据集 | 规模 | 用途 | 对应指标 |
|
||||||
|--------|------|------|----------|
|
|--------|------|------|----------|
|
||||||
| HumanEval(OpenAI 2021) | 164 题 | 函数级代码生成,对标 SOTA | M2 pass@k |
|
| HumanEval(OpenAI 2021) | 164 题 | 函数级代码生成,对标 SOTA | M2 pass@k、M1 |
|
||||||
| MBPP(Google 2021) | 500 题(test split) | 每题 3 条单元测试,题量充足支撑 ablation | M2 pass@k、M11、M12 |
|
| MBPP(Google 2021) | 500 题(test split) | 每题 3 条单元测试,题量充足支撑 ablation | M2 pass@k、M1 |
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user