Using the Flaubert for Translation

[kruthikakr]

Hi ..If i need to use the Falubert for French to English translation ? what is the approach.

[besacier]

hi, Flaubert is a Roberta-like model, so this is not necessarily well suited to pre-train a Fr-to-En MT system...even if you could try to pre-train the French encoder with FlauBERT for instance.... If your goal is NMT pre-training i'd rather advice you to use a pre-trained sequence-to-sequence model such as mT5 or mBART