Tensors must have same number of dimensions: got 3 and 4

[s1530129650]

Following the wiki to config the env and run the code

CUDA_VISIBLE_DEVICES=1 python server.py --share --listen --model llama-7b

[janmaltel]

Just ran into the exact same issue using the same setup that did work yesterday.

[janmaltel]

Seems to be an issue with a new commit on zphang's transformers PR: huggingface/transformers#21955 (comment) and thus independent of the text-generation-webui

[acatovic]

I have temp fixed it by updating my requirements.txt with zphang's transformers branch up to this commit: 68d640f7c368bcaaaecfc678f11908ebbd3d6176. So do the following:

1. pip uninstall transformers
2. Update the last line of requirements.txt so it looks as follows: git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
3. pip install -r requirements.txt

Works fine now.

[minlik]

I have temp fixed it by updating my requirements.txt with zphang's transformers branch up to this commit: 68d640f7c368bcaaaecfc678f11908ebbd3d6176. So do the following:

1. pip uninstall transformers
2. Update the last line of requirements.txt so it looks as follows: git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
3. pip install -r requirements.txt

Works fine now.

After updating transformers, i got the following log and the model generated nothing. Is it related to this issue?
Output generated in 0.25 seconds (0.00 tokens/s, 0 tokens)

[s1530129650]

I have temp fixed it by updating my requirements.txt with zphang's transformers branch up to this commit: 68d640f7c368bcaaaecfc678f11908ebbd3d6176. So do the following:

1. pip uninstall transformers
2. Update the last line of requirements.txt so it looks as follows: git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
3. pip install -r requirements.txt

Works fine now.

Thanks. It works after doing

pip uninstall transformers
pip install git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
```

[s1530129650]

I have temp fixed it by updating my requirements.txt with zphang's transformers branch up to this commit: 68d640f7c368bcaaaecfc678f11908ebbd3d6176. So do the following:

1. pip uninstall transformers
2. Update the last line of requirements.txt so it looks as follows: git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
3. pip install -r requirements.txt

Works fine now.

After updating transformers, i got the following log and the model generated nothing. Is it related to this issue? Output generated in 0.25 seconds (0.00 tokens/s, 0 tokens)

I ask it to "generate a quick sort code in python"
The terminal outputs:

Output generated in 19.47 seconds (10.22 tokens/s, 199 tokens)
Output generated in 18.69 seconds (10.65 tokens/s, 199 tokens)
Output generated in 14.55 seconds (6.25 tokens/s, 91 tokens)
Output generated in 2.09 seconds (9.11 tokens/s, 19 tokens)
Output generated in 12.20 seconds (10.73 tokens/s, 131 tokens)

[minlik]

I have temp fixed it by updating my requirements.txt with zphang's transformers branch up to this commit: 68d640f7c368bcaaaecfc678f11908ebbd3d6176. So do the following:

1. pip uninstall transformers
2. Update the last line of requirements.txt so it looks as follows: git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
3. pip install -r requirements.txt

Works fine now.

After updating transformers, i got the following log and the model generated nothing. Is it related to this issue? Output generated in 0.25 seconds (0.00 tokens/s, 0 tokens)

I ask it to "generate a quick sort code in python" The terminal outputs:

Output generated in 19.47 seconds (10.22 tokens/s, 199 tokens)
Output generated in 18.69 seconds (10.65 tokens/s, 199 tokens)
Output generated in 14.55 seconds (6.25 tokens/s, 91 tokens)
Output generated in 2.09 seconds (9.11 tokens/s, 19 tokens)
Output generated in 12.20 seconds (10.73 tokens/s, 131 tokens)

I re-install transformers and everything goes right. Thanks.