Deploy on a local server with docker-compose

Hardware requirements

Deepomatic can run using the following minimum requirements:

• A processor supporting the x86-64 instruction set.

• 4GB of free RAM.

• 10GB of storage.

The recommended requirements are however:

• A quad core processor supporting the x86-64 instruction set.

• 8GB of free RAM.

• 40GB of storage.

Deep learning models require lot of computation and it is recommended to use a specific hardware accelerator to make computation tractable. See below for a list of supported accelerators:

Compatible deep learning accelerators (recommended):

• NVIDIA GPU accelerators, of the family Tesla, Quadro, RTX or GTX, with CUDA compute capability 3.0 or more.

• Intel Movidius accelerators, see for example Aaeon's manufactured modules.

• Intel GPU: Iris Pro Graphics and Intel HD Graphics, on Intel Core from 6th to 10th generation or Intel Xeon (excluding the e5 family)

• Intel CPU: Intel Core from 6th to 10th generation or Intel Xeon (excluding the e5 family)

Software requirement

Operating system

Deepomatic relies on Docker to distribute its software and the operating system does not matter much as long as you manager to install the drivers for your deep learning accelerator. That said, we recommend a Linux distribution, and more specifically Ubuntu 18.04.

Core requirements

Deepomatic relies on Docker to distribute its software. You will thus need to install the following softwares on a compatible OS (we recommend Ubuntu 18.04):

• Docker 19.03+
• Docker-Compose

Accelerator related requirements

Additionally, you will need to install additional software depending on the deep learning you may have chosen.

Nvidia GPU

You need to install Nvidia drivers 410.48+ and Nvidia Docker.

On Ubuntu 18.04+, you can install the drivers with:

• sudo apt update

• sudo apt install --no-install-recommends nvidia-driver-418

Intel Movidius

You will need to install the HDDL driver on your host to take advantage of the Movidius chips. See the OpenVino manual.

Intel GPU

You will need to install the NEO OpenCL driver on your host to take advantage of the GPU chips. See the OpenVino manual.

Intel CPU

You do not need to install additional software.

Set up

To deploy on a local server, you need to get a manifest for your application using a Deepomatic CLI command.

The manifest you get is specific to a hardware equipped with a Nvidia GPU. It can easily be adapted to deploy your application on hardware equipped with Intel Movidius, Intel GPU or Intel CPU. Contact your Customer Success Manager if you need to deploy your application on such hardware.