Skip to content

Commit 0425346

Browse files
committed
re-upload bart
1 parent 516ae84 commit 0425346

4 files changed

Lines changed: 14 additions & 7 deletions

File tree

scripts/conversion_toolkits/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ The testing step mentioned above are controlled by the flag `--test`, in which t
1212
tolerance of 1e-3 between gluon model with converted weights and original tensorflow model.
1313
In addition, we can use GPU in all converting scripts by adding `--gpu 0`.
1414

15-
For RoBERTa XLM-R and BART model, please instal the [fairseq](https://github.com/pytorch/fairseq#requirements-and-installation) package locally before conversion.
15+
For RoBERTa XLM-R and BART model, please instal the [fairseq](https://github.com/pytorch/fairseq#requirements-and-installation) package locally as `pip install git+https://github.com/pytorch/fairseq.git@master`.
1616

1717
## BERT
1818
Convert model from [BERT LIST](https://tfhub.dev/google/collections/bert/1).
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
for model in base large
2+
do
3+
mkdir bart_${model}
4+
wget "https://dl.fbaipublicfiles.com/fairseq/models/bart.${model}.tar.gz"
5+
tar zxf bart.${model}.tar.gz --directory bart_${model}
6+
python convert_fairseq_bart.py --fairseq_model_path bart_${model}/bart.${model} --test
7+
done

src/gluonnlp/models/bart.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -127,14 +127,14 @@ def bart_large():
127127
'cfg': bart_base(),
128128
'merges': 'fairseq_bart_base/gpt2-396d4d8e.merges',
129129
'vocab': 'fairseq_bart_base/gpt2-f4dedacb.vocab',
130-
'params': 'fairseq_bart_base/model-6dea1e11.params',
130+
'params': 'fairseq_bart_base/model-8f4929b5.params',
131131
'lowercase': False,
132132
},
133133
'fairseq_bart_large': {
134134
'cfg': bart_large(),
135135
'merges': 'fairseq_bart_large/gpt2-396d4d8e.merges',
136136
'vocab': 'fairseq_bart_large/gpt2-f1335494.vocab',
137-
'params': 'fairseq_bart_large/model-38f35552.params',
137+
'params': 'fairseq_bart_large/model-862277b1.params',
138138
'lowercase': False,
139139
}
140140
}
Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
1-
fairseq_bart_base/model-6dea1e11.params 6dea1e11049f408cdd1088cd2c7e418434e1b03c 560560736
1+
fairseq_bart_base/model-8f4929b5.params 8f4929b54f2f77619885cea9f3bd7dba51a27f38 560560748
22
fairseq_bart_base/gpt2-396d4d8e.merges 396d4d8ec90cb02f4d56e049e0e4add868bcd943 456318
3-
fairseq_bart_base/model-3a06f8c8.yml 3a06f8c815fdda7c6efdb7859f7c7174895272b2 751
3+
fairseq_bart_base/model-251bf089.yml 251bf08944d18cc29b59a4a854bdbccf601dabb5 754
44
fairseq_bart_base/gpt2-f4dedacb.vocab f4dedacb076b1df441c9c7398ed9acd3c19865f3 575079
5-
fairseq_bart_large/model-38f35552.params 38f35552a8889593f8f200074244a3c8e6d52a0c 1625180950
5+
fairseq_bart_large/model-862277b1.params 862277b1489ed95140cb63279fbd0098ef2dea90 1625180962
66
fairseq_bart_large/gpt2-396d4d8e.merges 396d4d8ec90cb02f4d56e049e0e4add868bcd943 456318
7-
fairseq_bart_large/model-b52f8ac1.yml b52f8ac182573d63a18a5f14900f457531177f31 743
7+
fairseq_bart_large/model-a2932dea.yml a2932deaf9737d95891755841fae3e388f3d698a 746
88
fairseq_bart_large/gpt2-f1335494.vocab f1335494f47917829e3b1d08e579ff2c3fe4fd60 558231

0 commit comments

Comments
 (0)