Commit 48a408e
Add initial support for Ada
Add pass@1 metric to pass_k.py
Update pass_k.py to load the results file from .gz or .json
Added basic support for Sets, enabling the translation of
mbpp_473_tuple_intersection.py
Co-authored-by: Rowan Walshe <[email protected]>
Co-authored-by: Fabien Chouteau <[email protected]>1 parent 6b2c39a commit 48a408e
File tree
17 files changed
+933
-3
lines changed- dataset_builder
- evaluation
- src
- safe_subprocess
17 files changed
+933
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
45 | 52 | | |
46 | 53 | | |
47 | 54 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
| 31 | + | |
30 | 32 | | |
31 | 33 | | |
32 | 34 | | |
| |||
0 commit comments