System Info / 系統信息
ubuntu 20.04
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
Version info / 版本信息
xinference main branch, then install from source
[with commits including Mineru ]
a8953fd
The command used to start Xinference / 用以启动 xinference 的命令
webui launch model ， here is a sample vllm config
Reproduction / 复现过程
after the model is running, we test with the official mineru procedures. here is a test input pdf.
demo1.pdf
mineru -p /home/vastai/MinerU2.5-2509-1.2B/mineru-test/demo1.pdf
-o ./output
-b vlm-http-client
-u http://192.168.30.161:9997
--http-timeout 1200
using both NV cards and VACC inference cards, the same error occurs.
Expected behavior / 期待表现
run successfully without error.
System Info / 系統信息
ubuntu 20.04
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
Version info / 版本信息
xinference main branch, then install from source
[with commits including Mineru ]
a8953fd
The command used to start Xinference / 用以启动 xinference 的命令
webui launch model ， here is a sample vllm config
Reproduction / 复现过程
after the model is running, we test with the official mineru procedures. here is a test input pdf.
demo1.pdf
mineru -p /home/vastai/MinerU2.5-2509-1.2B/mineru-test/demo1.pdf
-o ./output
-b vlm-http-client
-u http://192.168.30.161:9997
--http-timeout 1200
using both NV cards and VACC inference cards, the same error occurs.
Expected behavior / 期待表现
run successfully without error.