Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 24 additions & 1 deletion datasets/adv_glue/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ language_creators:
language:
- en
license:
- cc-by-4.0
- cc-by-sa-4.0
multilinguality:
- monolingual
pretty_name: Adversarial GLUE
Expand Down Expand Up @@ -65,6 +65,9 @@ configs:
- **Paper:** [arXiv](https://arxiv.org/pdf/2111.02840.pdf)
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary

Adversarial GLUE Benchmark (AdvGLUE) is a comprehensive robustness evaluation benchmark that focuses on the adversarial robustness evaluation of language models. It covers five natural language understanding tasks from the famous GLUE tasks and is an adversarial version of GLUE benchmark.

AdvGLUE considers textual adversarial attacks from different perspectives and hierarchies, including word-level transformations, sentence-level manipulations, and human-written adversarial examples, which provide comprehensive coverage of various adversarial linguistic phenomena.
Expand Down Expand Up @@ -143,10 +146,22 @@ Adversarial GLUE provides only a 'dev' split.

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information
Expand All @@ -169,6 +184,14 @@ Adversarial GLUE provides only a 'dev' split.

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

The dataset is distributed under the [CC BY-SA 4.0](http://creativecommons.org/licenses/by-sa/4.0/legalcode) license.

### Citation Information

```bibtex
Expand Down