-
Notifications
You must be signed in to change notification settings - Fork 3.3k
Description
Traceback (most recent call last):
File "/root/llm.c/train_gpt2.py", line 663, in
model = GPT.from_pretrained(args.model)
File "/root/llm.c/train_gpt2.py", line 210, in from_pretrained
model = GPT(config)
File "/root/llm.c/train_gpt2.py", line 147, in init
self.apply(self.init_weights)
File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 897, in apply
module.apply(fn)
File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 897, in apply
module.apply(fn)
File "/root/miniconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 898, in apply
fn(self)
File "/root/llm.c/train_gpt2.py", line 160, in init_weights
torch.nn.init.normal(module.weight, mean=0.0, std=0.02, generator=self.init_rng)
TypeError: normal() got an unexpected keyword argument 'generator'
