Skip to content

[Feature] Add docker files #67

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lvhan028 merged 18 commits into from
Jan 25, 2022
Merged

[Feature] Add docker files #67

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
c7ad68d
add gpu and cpu dockerfile
AllentDan Jan 12, 2022
206aa66
fix lint
AllentDan Jan 12, 2022
88b4d28
fix cpu docker and remove redundant
AllentDan Jan 13, 2022
17720c3
use pip instead
AllentDan Jan 13, 2022
924d902
add build arg and readme
AllentDan Jan 17, 2022
5d75ea3
fix grammar
AllentDan Jan 17, 2022
21f76bc
update readme
AllentDan Jan 18, 2022
a7e8705
add chinese doc for dockerfile and add docker build to build.md
AllentDan Jan 20, 2022
3d705f1
grammar
AllentDan Jan 20, 2022
aef6fb5
refine dockerfiles
AllentDan Jan 20, 2022
f79dc7b
add FAQs
AllentDan Jan 20, 2022
487030e
update Dpplcv_DIR for SDK building
AllentDan Jan 20, 2022
a3e4458
remove mmcls
AllentDan Jan 20, 2022
51afea0
add sdk demos
AllentDan Jan 21, 2022
010196a
Merge branch 'docker-new' into docker
AllentDan Jan 21, 2022
60f15eb
fix typo and lint
AllentDan Jan 21, 2022
8144262
update FAQs
AllentDan Jan 24, 2022
18e2899
resolve conflicts
AllentDan Jan 24, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
98 changes: 98 additions & 0 deletions docker/CPU/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
ARG OS_VERSION=18.04
FROM ubuntu:${OS_VERSION} as official
ARG PYTHON_VERSION=3.8
ARG TORCH_VERSION=1.8.0
ARG TORCHVISION_VERSION=0.9.0
ARG ONNXRUNTIME_VERSION=1.8.1
ENV DEBIAN_FRONTEND=noninteractive
RUN apt-get update && apt-get install -y --no-install-recommends \
ca-certificates \
build-essential \
libjpeg-dev \
libpng-dev \
ccache \
cmake \
gcc \
g++ \
git \
vim \
wget \
curl \
&& rm -rf /var/lib/apt/lists/*

RUN curl -fsSL -v -o ~/miniconda.sh -O https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh && \
chmod +x ~/miniconda.sh && \
~/miniconda.sh -b -p /opt/conda && \
rm ~/miniconda.sh && \
/opt/conda/bin/conda install -y python=${PYTHON_VERSION} conda-build pyyaml numpy ipython cython typing typing_extensions mkl mkl-include ninja && \
/opt/conda/bin/conda clean -ya

### pytorch
#RUN /opt/conda/bin/conda install pytorch==${TORCH_VERSION} torchvision==${TORCHVISION_VERSION} -c pytorch
RUN /opt/conda/bin/pip install torch==${TORCH_VERSION}+cpu torchvision==${TORCHVISION_VERSION}+cpu -f https://download.pytorch.org/whl/cpu/torch_stable.html
ENV PATH /opt/conda/bin:$PATH

### install open-mim
RUN /opt/conda/bin/pip install mmcv-full -f https://download.openmmlab.com/mmcv/dist/cpu/torch${TORCH_VERSION}/index.html

WORKDIR /root/workspace
RUN git clone https://github.com/open-mmlab/mmclassification


### get onnxruntime
RUN wget https://github.com/microsoft/onnxruntime/releases/download/v${ONNXRUNTIME_VERSION}/onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}.tgz \
&& tar -zxvf onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}.tgz

ENV ONNXRUNTIME_DIR=/root/workspace/onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}

### update cmake to 20
RUN apt-get update && apt-get install libssl-dev &&\
wget https://github.com/Kitware/CMake/releases/download/v3.20.0/cmake-3.20.0.tar.gz &&\
tar -zxvf cmake-3.20.0.tar.gz &&\
cd cmake-3.20.0 &&\
./bootstrap &&\
make &&\
make install &&\
rm -rf /var/lib/apt/lists/*

## install onnxruntme and openvino
RUN /opt/conda/bin/pip install onnxruntime==${ONNXRUNTIME_VERSION} openvino-dev

## build ncnn
RUN apt-get update && apt-get install libprotobuf-dev protobuf-compiler -y --no-install-recommends &&\
git clone https://github.com/Tencent/ncnn.git &&\
cd ncnn &&\
export NCNN_DIR=$(pwd) &&\
git submodule update --init &&\
mkdir -p build && cd build &&\
cmake -DNCNN_VULKAN=OFF -DNCNN_SYSTEM_GLSLANG=ON -DNCNN_BUILD_EXAMPLES=ON -DNCNN_PYTHON=ON -DNCNN_BUILD_TOOLS=ON -DNCNN_BUILD_BENCHMARK=ON -DNCNN_BUILD_TESTS=ON .. &&\
make install &&\
cd ${NCNN_DIR} # To NCNN root directory &&\
cd python &&\
pip install -e .

## build ppl.nn
WORKDIR /root/workspace
RUN git clone https://github.com/openppl-public/ppl.nn &&\
cd ppl.nn &&\
./build.sh -DPPLNN_ENABLE_PYTHON_API=ON -DHPCC_USE_X86_64=ON &&\
rm -rf /tmp/pyppl-package &&\
cp -r python/package /tmp/pyppl-package &&\
cp -r pplnn-build/install/lib/pyppl/* /tmp/pyppl-package/pyppl &&\
cd /tmp/pyppl-package &&\
pip3 install .

### install mmdeploy
WORKDIR /root/workspace
RUN git clone https://github.com/open-mmlab/mmdeploy &&\
git submodule update --init --recursive &&\
cd mmdeploy &&\
rm -rf build &&\
mkdir build &&\
cd build &&\
cmake -DMMDEPLOY_TARGET_BACKENDS=ncnn -Dncnn_DIR=/root/workspace/build/install/lib/cmake/ncnn .. &&\
make -j$(nproc) &&\
cmake -DMMDEPLOY_TARGET_BACKENDS=ort .. &&\
make -j$(nproc) &&\
cd .. &&\
pip install -e .
108 changes: 108 additions & 0 deletions docker/GPU/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,108 @@
FROM nvcr.io/nvidia/tensorrt:21.04-py3

ARG CUDA=10.2
ARG PYTHON_VERSION=3.8
ARG TORCH_VERSION=1.8.0
ARG TORCHVISION_VERSION=0.9.0
ARG ONNXRUNTIME_VERSION=1.8.1
ENV FORCE_CUDA="1"

ENV DEBIAN_FRONTEND=noninteractive

### update apt and install libs
RUN apt-get update &&\
apt-get install -y vim cmake libsm6 libxext6 libxrender-dev libgl1-mesa-glx git wget

RUN curl -fsSL -v -o ~/miniconda.sh -O https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh && \
chmod +x ~/miniconda.sh && \
~/miniconda.sh -b -p /opt/conda && \
rm ~/miniconda.sh && \
/opt/conda/bin/conda install -y python=${PYTHON_VERSION} conda-build pyyaml numpy ipython cython typing typing_extensions mkl mkl-include ninja && \
/opt/conda/bin/conda clean -ya

### pytorch
RUN /opt/conda/bin/conda install pytorch==${TORCH_VERSION} torchvision==${TORCHVISION_VERSION} cudatoolkit=${CUDA} -c pytorch
ENV PATH /opt/conda/bin:$PATH
#RUN pip3 install torch==${TORCH_VERSION} torchvision==${TORCHVISION_VERSION}

RUN ls /opt/conda/bin/
### install open-mim
RUN /opt/conda/bin/pip install mmcv-full -f https://download.openmmlab.com/mmcv/dist/cu${CUDA//./}/torch${TORCH_VERSION}/index.html

### git mmdetection
RUN git clone --depth=1 https://github.com/open-mmlab/mmdetection.git /root/space/mmdetection

### install mmdetection
RUN cd /root/space/mmdetection &&\
pip3 install -r requirements.txt &&\
python3 setup.py develop

WORKDIR /root/workspace
RUN git clone https://github.com/open-mmlab/mmclassification


### get onnxruntime
RUN wget https://github.com/microsoft/onnxruntime/releases/download/v${ONNXRUNTIME_VERSION}/onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}.tgz \
&& tar -zxvf onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}.tgz &&\
pip install onnxruntime-gpu

ENV PATH_TO_ONNXRUNTIME=/root/workspace/onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}
ENV PATH_TO_TENSORRT=/workspace/tensorrt

### cp trt from pip to conda
RUN cp -r /usr/local/lib/python3.8/dist-packages/tensorrt* /opt/conda/lib/python3.8/site-packages/

### update cmake to 20
RUN apt-get install -y libssl-dev &&\
wget https://github.com/Kitware/CMake/releases/download/v3.20.0/cmake-3.20.0.tar.gz &&\
tar -zxvf cmake-3.20.0.tar.gz &&\
cd cmake-3.20.0 &&\
./bootstrap &&\
make &&\
make install

### build ppl.nn
WORKDIR /root/workspace
RUN git clone https://github.com/openppl-public/ppl.nn &&\
cd ppl.nn &&\
./build.sh -DPPLNN_ENABLE_PYTHON_API=ON -DHPCC_USE_X86_64=ON -DHPCC_USE_CUDA=ON &&\
rm -rf /tmp/pyppl-package &&\
cp -r python/package /tmp/pyppl-package &&\
cp -r pplnn-build/install/lib/pyppl/* /tmp/pyppl-package/pyppl &&\
cd /tmp/pyppl-package &&\
pip3 install .

### install mmdeploy
WORKDIR /root/workspace
ENV ONNXRUNTIME_DIR=/root/workspace/onnxruntime-linux-x64-${ONNXRUNTIME_VERSION}
ENV TENSORRT_DIR=/workspace/tensorrt
RUN git clone https://github.com/open-mmlab/mmdeploy &&\
cd mmdeploy &&\
git submodule update --init --recursive &&\
rm -rf build &&\
mkdir build &&\
cd build &&\
cmake -DMMDEPLOY_TARGET_BACKENDS=ort .. &&\
make -j$(nproc) &&\
cmake -DMMDEPLOY_TARGET_BACKENDS=trt .. &&\
make -j$(nproc) &&\
cd .. &&\
pip install -e .

### build sdk
RUN apt-get update && apt-get install libopencv-dev libspdlog-dev -y --no-install-recommends &&\
rm -rf /var/lib/apt/lists/*
RUN git clone https://github.com/openppl-public/ppl.cv.git &&\
cd ppl.cv &&\
./build.sh cuda
RUN cd /root/workspace/mmdeploy &&\
mkdir -p sdk-build && cd sdk-build &&\
cmake .. \
-DMMDEPLOY_BUILD_SDK=ON \
-DCMAKE_CXX_COMPILER=g++ \
-Dpplcv_DIR=/root/workspace/ppl.cv/cuda-build/install/lib/cmake/ppl \
-DTENSORRT_DIR=${TENSORRT_DIR} \
-DMMDEPLOY_TARGET_DEVICES="cuda;cpu" \
-DMMDEPLOY_TARGET_BACKENDS=trt \
-DMMDEPLOY_CODEBASES=all &&\
cmake --build . -- -j$(nproc) && cmake --install .