Issue by zphang
Friday Apr 10, 2020 at 21:37 GMT
Originally opened as nyu-mll/jiant#1059
Performance comparison on a set of representative tasks.
| Task |
albert-xxlarge-v2 (#990) |
roberta-large (#990) |
albert-xxlarge-v2 (v2.6.0) |
roberta-large (v2.6.0) |
| wsc |
0.76 |
0.692 |
0.769 |
0.692 |
| rte |
0.888 |
0.866 |
0.892 |
0.848 |
| wic |
0.74 |
0.724 |
0.741 |
0.721 |
| sst |
0.955 |
0.961 |
0.956 |
0.956 |
| cosmosqa |
0.847 |
0.814 |
0.846 |
0.822 |
| qa-srl |
0.641 |
0.664 |
0.641 |
0.666 |
zphang included the following code: https://github.com/nyu-mll/jiant/pull/1059/commits
Friday Apr 10, 2020 at 21:37 GMT
Originally opened as nyu-mll/jiant#1059
Performance comparison on a set of representative tasks.
zphang included the following code: https://github.com/nyu-mll/jiant/pull/1059/commits