Site commands

Site commands enable you to interact directly with the deployed Deepomatic sites from your terminal. Here is the list of actions that you can do:

• create / delete

• manifest

• install / uninstall

• show

• current (start, stop, logs, status)

• list / save / load

• update / upgrade / rollback

• intervention

• model (infer, draw, blur)

Create / Delete

To create a site, you need to use the following command and to specify a name and the application version that you want to deploy on your site. You can then change this application version.

Create a site

deepo site create -n my-super-site -v app_version_id

To delete a site, you need to use the following command and to specify the Site Id that you want to delete.

Delete a site

deepo site delete -s site_id

Manifest

To obtain the manifest necessary for the installation of your site, you must use the following command, specifying the Site Id and the type of manifest that you want to fit with your deployment.

Get manifest for a site

deepo site manifest -i site_id -t gke

The target manifest are:

• gke: Google Kubernetes Engine

• docker-compose

Install / Uninstall

Run locally the following command. The site will be installed using the latest docker-compose / kubernetes manifest downloaded from the API.

Install a site

deepo site install site_id

Uninstalling a site removes all versions and files from a site.

Uninstall a site

deepo site uninstall site_id

Show

The show command displays the currently deployed site's id, and the id of the currently installed application.

Display current site id and installed application

deepo site show

Current

The current command lets you use the following submenu for the currently deployed site:

Start current site

deepo site current start

Stop current site

deepo site current stop

Get logs from current site

deepo site current logs

Get status of current site

deepo site current status

List / Save / Load

The list command returns the ids of the sites that have been installed.

List installed sites

deepo site list

The save command creates an archive that contains the given site, which can been installed on another server (e.g. offline)

Save a site

deepo site save -s site_id -a achive_path

The load command loads a site from an archive generated by a save command.

Load a site

deepo site load -a achive_path

Upgrade / Rollback

The upgrade command install a new version of the site (using the latest docker-compose/kubernetes manifest from the api)

Upgrade a site

deepo site upgrade -s site_id -a app_version_id

The rollback command reloads the nth previous version (upgrade followed by rollback 1 does nothing)

Rollback a site

deepo site rollback -s site_id -n rollback_index

Intervention

The intervention command lets you interact with the customer API. There must then be a customer-api service in your application to work. You can then use the create / delete / infer / status commands.

Create an intervention

deepo site intervention create

Delete an intervention

deepo site intervention delete

Add an image to an intervention

deepo site intervention infer

Get intervention status

depeo site intervention status

Model

When you deploy an application version on a site, it is possible to run inferences on the model version included in the application version.

Get your Model Version ID and your Routing Key

To retrieve the MODEL_VERSION_ID of the model version that you want to use within your application and the corresponding Routing Key, you need to go on the Apps tab in the Deployment section and click on the app version that is deployed on your site.

The MODEL_VERSION_ID is specified with the -r or --recognition_id argument.

The ROUTING_KEY corresponds to the rabbitMQ queue identifier.

You will need to provide one additional parameters to run model actions: the AMPQ_URL. It corresponds to the rabbitMQ address. You will find this address in your server deployment files. It should look like amqp://user:pwd@ip:port/vhost

This parameter will be defined during the GPU server setup. Besides, you don't need to specify any credentials.

Sample commands

Running an inference with on-premises Server

deepo site model infer -i img.jpg -o pred.json -r 123 -k queue -u amqp://user:pwd@ip:port/vho

Model actions

There are four different model actions:

• infer: Compute predictions only.

• draw: Display the prediction result, whether tags or the bounding boxes.

• blur: Blur the bounding boxes.

• noop: Benchmark input and output processing capabilities.

They follow the same recipe:

1. Retrieve one or several inputs.

2. Compute predictions using the trained neural network

3. Output the result in different formats: image, video, JSON, stream, etc.

Generic command

deepo site model infer -i myinput -o myoutput1 myoutput2 ...

Input

Input types

The Deepomatic CLI supports different types of input:

• Image: Supported formats include bmp, jpeg, jpg , jpe,png, tif and tiff.

• Video: Supported formats include avi, mp4, webm and mjpg.

• Studio JSON: Deepomatic Studio JSON format, used to specify several images or videos.

Sample input JSON format

{
  "images": [
  	{
  		"location": "/path/to/img.jpg"
  	},
  	{
  		"location": "/path/to/video.mp4"
  	},
  ]
}

• Directory: Analyse all images and videos found in the directory.

• Digit: Retrieve the stream from the corresponding device. For instance, 0 for the installed webcam.

• Network stream: Supported network streams include rtsp, http and https.

Specify input

Inputs are specified using the -i for input option. Below an example with each type of inputs.

Sample input commands

deepo site model infer -i /path/to/my_img.bmp ...        # Image
deepo site model infer -i /path/to/my_vid.mp4 ...        # Video
deepo site model infer -i /path/to/my_studio.json ...    # Studio JSON
deepo site model infer -i /path/to/my_dir ...            # Directory
deepo site model infer -i 0 ...                          # Device number
deepo site model infer -i rtsp://ip:port/channel ...     # RTSP stream

Output

Output types

The Deepomatic CLI supports different types of output:

• Image: Supported formats include bmp, jpeg, jpg , jpe,png, tif and tiff.

• Video: Supported formats include avi and mp4.

• Run JSON: Deepomatic Run JSON format for raw predictions.

• Studio JSON: Deepomatic Studio JSON format for Studio-like prediction scores. This is specified using the -s or --studio_format option.

• Integer wildcard JSON: A standard Run/Studio JSON, except that the name contains the frame number. For instance -o frame %03d.json will output frame001.json, frame002.json, ...

• String wildcard JSON: Same as the integer wildcard except this time the frame name is used. For instance -o pred_%s.jpg will output pred_img1_123.json, pred_img2_123.json, ...

• Standard output: On rare cases you might want to output the model results directly to the process standard output using the stdout option. For instance this allows you to stream directly to vlc.

• Display output: Opens a window and displays the result. Quit with q.

Specify output

Output are specified using the -o for output option. Below an example with each type of inputs.

Please note that in order to avoid duplicate computations, it is possible to specify several outputs at the same time, for instance to blur an image and store the predictions.

Sample output commands

deepo site model draw -i img.jpg -o img_drawn.jpg ...         # Image
deepo site model draw -i vid.mp4 -o img_drawn_%04d.jpg ...    # Wildcard images
deepo site model draw -i vid.mp4 -o vid_drawn.mp4 ...         # Video
deepo site model draw -i img.jpg -o pred.json ...             # Run JSON
deepo site model draw -i img.jpg -o pred.json -s  ...         # Studio JSON
deepo site model draw -i vid.mp4 -o pred_%s.json ...          # String wildcard JSON
deepo site model draw -i vid.mp4 -o pred_%04d.json ...        # Integer wildcard JSON
deepo site model draw -i vid.mp4 -o stdout ...                # Standard output
deepo site model draw -i vid.mp4 -o window ...                # Display output
deepo site model draw -i vid.mp4 -o vid_drawn.mp4 pred_%04d.json  ...  # Multiple outputs

Options

Commands have additional options that you can use with a flag. There is a short flag -f and a long flag --flag. Note that one use a simple - while the other uses two --. Also some options need an additional argument. Find below the option table. When indicated, all means that all four commands infer, draw , blur and noop are concerned.

Short	Long	Commands	Description
i	input	all	Input consummed.
	input_fps	all	Input FPS used for video extraction.
	skip_frame	all	Number of frames to skip inbetween two frames.
R	recursive	all	Recursive directory search.
o	output	all	Outputs produced.
	output_fps	all	Output FPS used for video reconstruction.
s	studio_format	infer draw blur	Convert from Run to Studio format.
F	fullscren	draw blur noop	Fullscreen if window output.
	from_file	draw blur	Use prediction from precomputed JSON.
r	recognition_id	infer draw blur	Neural network recognition version ID.
t	threshold	infer draw blur	Threshold for predictions.
u	ampq_url	infer draw blur	AMQP url for on-premises deployments.
k	routing_key	infer draw blur	Recognition routing key for on-premises deployments.
S	draw_score	draw	Overlay prediction score.
	no_draw_scores	draw	Do not overlay prediction score.
L	draw_labels	draw	Overlay the prediction label.
	no_draw_labels	draw	Do not overlay the prediction label.
M	blur_method	blur	Blur method,pixel, gaussian or black.
B	blur_strengh	blur	Blur strength.
	verbose	all	Increase output verbosity.