ImportError: cannot import name 'AdamW' from 'transformers'

[tapoban123]

from ragatouille import RAGPretrainedModel
RAG = RAGPretrainedModel.from_pretrained("colbert-ir/colbertv2.0")

Getting the following error when trying to run the above code:

My versions:

Python v3.12.4
RAGatouille v0.0.9
transformers v4.50.0

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\ragatouille\__init__.py", line 2, in <module>
    from .RAGPretrainedModel import RAGPretrainedModel
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\ragatouille\RAGPretrainedModel.py", line 14, in <module>
    from ragatouille.models import ColBERT, LateInteractionModel
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\ragatouille\models\__init__.py", line 2, in <module>
    from .colbert import ColBERT
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\ragatouille\models\colbert.py", line 11, in <module>
    from colbert import Trainer
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\colbert\__init__.py", line 1, in <module>
    from .trainer import Trainer
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\colbert\trainer.py", line 5, in <module>
    from colbert.training.training import train
  File "E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\colbert\training\training.py", line 7, in <module>
    from transformers import AdamW, get_linear_schedule_with_warmup
ImportError: cannot import name 'AdamW' from 'transformers' (E:\My Documents\Mobile Apps\OneGo\back-end\venv\Lib\site-packages\transformers\__init__.py)

[Rocketknight1]

Hi @tapoban123, transformers.AdamW has been deprecated with a warning for some time and was removed in the last version. It was no longer necessary ever since an AdamW optimizer was added to torch. Please ping the owner of the ragatouille package and ask them to update their code!

[tapoban123]

I see.
Thank you for clarifying.

[qkeeey]

I am having the same issue. Do you know to which transformer version can I downgrade?

[Rocketknight1]

Hi @qkeeey, you can use 4.49 if you don't want to change legacy code. However, we recommend you stick with the latest version and use torch.optim.AdamW instead of transformers.AdamW.

[qkeeey]

Thanks!