Skip to content

Commit ff19f95

Browse files
authored
remove nmt collection (#14191)
* remove nmt collection Signed-off-by: dimapihtar <[email protected]> * remove exampleso Signed-off-by: dimapihtar <[email protected]> * fix imports Signed-off-by: dimapihtar <[email protected]> * Apply isort and black reformatting Signed-off-by: dimapihtar <[email protected]> --------- Signed-off-by: dimapihtar <[email protected]> Signed-off-by: dimapihtar <[email protected]> Co-authored-by: dimapihtar <[email protected]>
1 parent e04ee42 commit ff19f95

40 files changed

+14
-8669
lines changed

examples/nlp/language_modeling/megatron_ckpt_to_nemo.py

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,13 @@
4343
from nemo.collections.nlp.models.language_modeling.megatron_gpt_sft_model import MegatronGPTSFTModel
4444
from nemo.collections.nlp.models.language_modeling.megatron_retrieval_model import MegatronRetrievalModel
4545
from nemo.collections.nlp.models.language_modeling.megatron_t5_model import MegatronT5Model
46-
from nemo.collections.nlp.models.machine_translation.megatron_nmt_model import MegatronNMTModel
46+
47+
try:
48+
from nemo.collections.nlp.models.machine_translation.megatron_nmt_model import MegatronNMTModel
49+
except ModuleNotFoundError:
50+
from abc import ABC
51+
52+
MegatronNMTModel = ABC
4753
from nemo.collections.nlp.parts.nlp_overrides import (
4854
GradScaler,
4955
NLPDDPStrategy,

examples/nlp/language_modeling/megatron_export.py

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,13 @@
3636
from nemo.collections.nlp.models.language_modeling.megatron_gpt_model import MegatronGPTModel
3737
from nemo.collections.nlp.models.language_modeling.megatron_retrieval_model import MegatronRetrievalModel
3838
from nemo.collections.nlp.models.language_modeling.megatron_t5_model import MegatronT5Model
39-
from nemo.collections.nlp.models.machine_translation.megatron_nmt_model import MegatronNMTModel
39+
40+
try:
41+
from nemo.collections.nlp.models.machine_translation.megatron_nmt_model import MegatronNMTModel
42+
except ModuleNotFoundError:
43+
from abc import ABC
44+
45+
MegatronNMTModel = ABC
4046
from nemo.collections.nlp.modules.common.megatron.megatron_init import fake_initialize_model_parallel
4147
from nemo.collections.nlp.parts.nlp_overrides import NLPDDPStrategy, NLPSaveRestoreConnector
4248
from nemo.core import ModelPT

examples/nlp/machine_translation/conf/aayn_base.yaml

Lines changed: 0 additions & 157 deletions
This file was deleted.

examples/nlp/machine_translation/conf/aayn_base_megatron.yaml

Lines changed: 0 additions & 179 deletions
This file was deleted.

0 commit comments

Comments
 (0)