diff --git a/datasets/adv_glue/README.md b/datasets/adv_glue/README.md index 52e7af90c09..8795031b6b4 100644 --- a/datasets/adv_glue/README.md +++ b/datasets/adv_glue/README.md @@ -6,7 +6,7 @@ language_creators: language: - en license: -- cc-by-4.0 +- cc-by-sa-4.0 multilinguality: - monolingual pretty_name: Adversarial GLUE @@ -65,6 +65,9 @@ configs: - **Paper:** [arXiv](https://arxiv.org/pdf/2111.02840.pdf) - **Leaderboard:** - **Point of Contact:** + +### Dataset Summary + Adversarial GLUE Benchmark (AdvGLUE) is a comprehensive robustness evaluation benchmark that focuses on the adversarial robustness evaluation of language models. It covers five natural language understanding tasks from the famous GLUE tasks and is an adversarial version of GLUE benchmark. AdvGLUE considers textual adversarial attacks from different perspectives and hierarchies, including word-level transformations, sentence-level manipulations, and human-written adversarial examples, which provide comprehensive coverage of various adversarial linguistic phenomena. @@ -143,10 +146,22 @@ Adversarial GLUE provides only a 'dev' split. ### Source Data +#### Initial Data Collection and Normalization + +[More Information Needed] + +#### Who are the source language producers? + [More Information Needed] ### Annotations +#### Annotation process + +[More Information Needed] + +#### Who are the annotators? + [More Information Needed] ### Personal and Sensitive Information @@ -169,6 +184,14 @@ Adversarial GLUE provides only a 'dev' split. ## Additional Information +### Dataset Curators + +[More Information Needed] + +### Licensing Information + +The dataset is distributed under the [CC BY-SA 4.0](http://creativecommons.org/licenses/by-sa/4.0/legalcode) license. + ### Citation Information ```bibtex