Upload images via a text (JSON) file

Search…
Import file format
Uploading images with a text file is the recommended solution if you need to add a large number of images.
In order to import images using a text file, those images need to be reachable via a public URL. If this is not the case, you need to find ways to upload images to a remote server or you can use the command Deepomatic command line interface. 
Upload to remote server
Platform commands
If all the images are publicly reachable, we need to tell Deepomatic Studio where to find the images, as well as adding any useful information associated with images. In what follows, we will consider the following image.
File structure
The text file contains a set of JSON objects:
 the first object is a header allowing you to define the tree structure of the views composing your project
the other objects correspond to all the images you wish to import, one per image.
This structure allows the upload of very large quantities of data by streaming. 
Header
The header is a JSON object that allows you to define your views and the concepts attached to each of them. It is also in the header that you indicate the tree structure of your views, and how the child and parent views are linked together.
Header json
1
{
2
  "name": "Bulk items",
3
  "splits": [
4
    "train",
5
    "val"
6
  ],
7
  "views": [
8
    {
9
      "concepts": [
10
        {
11
            "name": "With Item"
12
        },
13
        {
14
            "name": "Without Item"
15
        }
16
      ],
17
      "type": "classification",
18
      "name": "Item or not",
19
      "conditions": []
20
    },
21
    {
22
      "concepts": [
23
        {
24
            "name": "Item"
25
        }
26
      ],
27
      "type": "detection",
28
      "name": "Item Detector",
29
      "conditions": [
30
        [
31
          {
32
              "name": "With Item"
33
          }
34
        ]
35
      ]
36
    },
37
    {
38
      "concepts": [
39
        {
40
            "name": "Glass"
41
        },
42
        {
43
            "name": "Metal"
44
        },
45
        {
46
            "name": "Wood"
47
        }
48
      ],
49
      "type": "classification",
50
      "name": "Item material",
51
      "conditions": [
52
        [
53
          {
54
              "name": "Item"
55
          }
56
        ]
57
      ]
58
    }
59
  ]
60
}
61
​
Copied!
Here are the fields you need to specify:
name : the name of your project
splits : a list which only supports train and val for now.
views : each entry in the views list defines a view and contains the following fields:
name : the name of your view
type : the type of your view among classification, tagging or detection (see the creation of views to know more) 
concepts : each entry in the concepts list defines a concept and contains the following field:
name: the name of your concept.
conditions : a list of lists of concepts to specify AND and OR conditions. A list of concepts specifies a AND condition and the list of lists specifies OR conditions. 
Concepts must be unique within a project. It is not possible to have several concepts with the same name in separate views.
The header in your file should be on a single line and will allow the platform to build all the views and all the concepts that you have specified, based on the conditions you have indicated.
Images
Each image you want to add to your project is a JSON object that must be written on a single line of your file.
Image
1
{
2
  "id": null,
3
  "data": [
4
    {
5
      "url": "https://upload.wikimedia.org/wikipedia/commons/thumb/b/b1/VAN_CAT.png/1920px-VAN_CAT.png"
6
    }
7
  ],
8
  "metadata": "{}",
9
  "annotations": [
10
    {
11
      "concepts": [
12
        {
13
          "name": "Glass",
14
          "bool": true
15
        },
16
        {
17
          "name": "Item",
18
          "bool": true
19
        }
20
      ],
21
      "region": {
22
        "bbox": {
23
          "xmin": 0.14237532448083068,
24
          "ymin": 0.2097216707202064,
25
          "xmax": 0.7449424670527156,
26
          "ymax": 0.9198461929815852
27
        }
28
      }
29
    },
30
    {
31
      "concepts": [
32
        {
33
          "name": "With Item",
34
          "bool": true
35
        }
36
      ],
37
      "region": {
38
        "bbox": {
39
          "xmin": 0.0,
40
          "ymin": 0.0,
41
          "xmax": 1.0,
42
          "ymax": 1.0
43
        }
44
      }
45
    }
46
  ],
47
  "splits": [
48
    "train"
49
  ]
50
}
Copied!
Here are the fields you need to specify:
id : null
data : each entry in the data list is an object that contains the field url that you need to specify. You should for now add only one image per line of your text file. ⚠️If your images are stored locally use the field file instead of url and specify the path to the image.
metadata : a string of characters via which you can add metadata to your image as a dictionary. The metadata are displayed in the information popup on Studio.
Some data are automatically added to the platform: File name, Created, Creator and Last annotator are set automatically.
annotations: each entry in the annotations list corresponds to a region, with all the information attached to it:
concepts: the list of concepts attached to the region. You should not create an annotation for each view, but instead you need to combine the concepts from all the views required in a single annotation.
region: the actual region, described as a bounding box bbox, and the coordinates of this bounding box, xmin, ymin, xmax and ymax. 
splits: a list of splits to which the image belongs. You should choose between train and val for now.
The difference between classification and tagging views is that for classification views, the annotation can only have one of the concept with bool field at True.
Upload & Progress Report
After dropping your text file and after it has been uploaded to the platform, a spinning wheel is displayed and you can see the number of images that has been added to the platform, giving you the progress of your upload.
After clicking on Start upload, you need to wait for the spinning wheel to start to leave or reload the page.
Drag & drop images
Upload to remote server
Last modified 1mo ago
Copy link
Contents
Upload & Progress Report