Three lines

Uber

Developers

Annotation

Each Labeling result is the combination of Annotation and AttributeResult. Annotation is a structure used to annotate a image/video/audio/text.

All annotation consist of few common fields

Name Type Description
annotation_label object The label of the annotation.
annotation_type string The type of the annotation.
annotation_data object This block provide the data of the annotation.This block depends on the worktype.

Sample annotation data:

  "annotation_label" : {
    "title" : "bus"
  },
  "annotation_type" : "ANNOTATION_TYPE_SEGMENTATION",
  "annotation_data" : {
    ...
  }

Annotation Types:

  1. ANNOTATION_TYPE_RECTANGLE
  2. ANNOTATION_TYPE_POLYLINE
  3. ANNOTATION_TYPE_KEY_POINT
  4. ANNOTATION_TYPE_POLYGON
  5. ANNOTATION_TYPE_CUBOID
  6. ANNOTATION_TYPE_ELLIPSE
  7. ANNOTATION_TYPE_REGION
  8. ANNOTATION_TYPE_SEGMENTATION
  9. ANNOTATION_TYPE_TEXT_SPAN

ANNOTATION_TYPE_RECTANGLE

Rectangle Annotation is represented with x,y coordinate of top left corner, height and width of the rectangle.

Name Type Description
rectangle_annotation_data object This provide all the information about the rectangle and it location.
top_left_coordinate object This block provide coordinate of top left corner of the rectangle.
height number height of the rectangle
width number width of the rectangle
  "rectangle_annotation_data" : {
    "top_left_coordinate" : {
      "x" : 515.9318181818181,
      "y" : 400.1280991735537
    },
    "height" : 472.58677685950414,
    "width" : 780.2541322314049
  }

ANNOTATION_TYPE_POLYLINE

A polyline is a continuous line that is composed of one or more connected straight line segments, which, together, make up a shape.Polyline will be represented with list of x,y coordinate of the polyline.

Name Type Description
polyline_annotation_data object This block provide all the information about the polyline and it location.
coordinate array This block provide all the coordinate of the polyline.
  "polyline_annotation_data" : {
    "coordinate" : [ {
      "x" : 2012.2469008264463,
      "y" : 1232.3181818181818
    },
    {
      "x" : 2092.2469008264463,
      "y" : 1222.3181818181818
    }
     ]
  }

ANNOTATION_TYPE_KEY_POINT

Keypoint is a spatial locations, or points in the image Key Point will be represented with a single x,y coordinate of the key point.

Name Type Description
keypoint_annotation_data object This block provide all the information about the keypoint and it location.
coordinate object This block provide all the coordinate of the keypoint.
  "keypoint_annotation_data" : {
    "coordinate" : {
      "x" : 2514.3595041322315,
      "y" : 2378.336776859504
    }
  }

ANNOTATION_TYPE_POLYGON

A Polygon is a closed figure made up of line segments (not curves) in a two-dimensional plane.It will be represented with list of x,y coordinate of the polygon.

Name Type Description
polygon_annotation_data object This block provide all the information about the polygon and it location.
coordinate array This block provide all the coordinate of the polygon.
  "polygon_annotation_data" : {
  "coordinate": [
    {
      "x": 663.2789256198347,
      "y": 1334.888429752066
    },
    {
      "x": 603.2789256198347,
      "y": 1220.0227272727273
    },
    {
      "x": 613.2789256198347,
      "y": 1670.0227272727273
    }
  ]
  }

ANNOTATION_TYPE_CUBOID

A cuboid is a 3D shape that has six faces, top ,bottom , front ,back,left side ,right side.In the output we are listing 8 co-ordinates first 4 to determine the back frame and 4 co-ordinates to determine the front frame.Cuboid will be represented with 8 x,y coordinate of the cuboid.

Name Type Description
cuboid_annotation_data object This block provide all the information about the cuboid and it location.
coordinate array This block provide all the coordinate of the cuboid.
  "cuboid_annotation_data" : {
    "coordinate" : [ {
      "x" : 146.97830578512398,
      "y" : 2049.1921487603304
    }, {
      "x" : 900.6136363636364,
      "y" : 2049.1921487603304
    }
    //... More 6 coordinates
    ]
  }

ANNOTATION_TYPE_ELLIPSE

Ellipse is a regular oval like a circle that has been pressed in from two sides. Ellipse will be represented with centre coordinate and radius of the ellipse from x and y axis.

Name Type Description
ellipse_annotation_data object This block provide all the information about the ellipse and it location.
centre object This block provide the centre of the ellipse.
radius_x number This block provide the radius of the ellipse in x direction.
radius_y number This block provide the radius of the ellipse in y direction.
 "ellipse_annotation_data" : {
    "centre" : {
      "x" : 1996.2040289256197,
      "y" : 1166.8233471074382
    },
    "radius_x" : 302.90547520661164,
    "radius_y" : 533.8946280991736
  }

ANNOTATION_TYPE_REGION

Region is a time frame in a video/audio.Region will be represented with start and end time of the region.

Name Type Description
region_annotation_data object This block provide all the information about the region and it location.
start_time number This block provide the start time of the region.
end_time number This block provide the end time of the region.
  "region_annotation_data" : {
    "start_time" : "207.98372140762464",
    "end_time" : "361.05974036363637"
  }

ANNOTATION_TYPE_SEGMENTATION

Image segmentation is a computer vision technique that partitions a digital image into discrete groups of pixels—image segments—to inform object detection and related tasks. Segmentation will be represented with encoded image of the segmentation.

Name Type Description
segmentation_annotation_data object This block provide all the information about the segmentation and it location.
encodedAnnotationImage string This block provide the encoded image of the segmentation.
 "segmentation_annotation_data" : {
    "encodedAnnotationImage" : "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAC9AAAA/vbvuumZ46q5qVizo7shICBNIFkt9DZnJ6emvvL7m3/DtT7exZXU2BhJngvVozW6+sqlv+ZO2VqvoNAQLvCPiA/h091xIgQIAAAQIEPgh0O3A+lu7QKcIECIwKdJx5I3s1J0fUXENgrUDKPDJv1ubG0wgQqCvQba7Pnt/d9l83SftWNjsT+3biyQQInCaQ+g4yl09Lcq39pvbVR2U9VitzVlNbIGEm6PnaGftpdd0yKG8/VdT/ToDAuwI+oH9X0PUECBAgQIAAgV+/fnU7bD6L5tApvgQIjAh0nXlX92pGXhXzewJ7BBJmknmzJzueSoBATYFuc/2OGd7NoGaS9qzqjjzs2YmnEiBwmkDqu8dcPi3Jtfab2lcflfVYrcxZTW2BhJmg52tn7KfVdcygzP1UVf87AQLvCviA/l1B1xMgQIAAAQIEmn5A78ApugQIjAh0/APbyD7NyBE11xBYL5Ayk8yc9dnxRAIEagp0m+t3z+9uHjVTtWZVd2dhzS48hQCBUwWS3zfm86mp3r/v5L566uqv/Tmzgl4CCXNB3/fK3N+r7ZZBeeudN6sn0EXAB"
  }

ANNOTATION_TYPE_TEXT_SPAN

Text span is the part of a text string.Text Span will be represented with text, start index and end index of the text.

Name Type Description
text_span_annotation_data object This block provide all the information about the text span and it location.
text string This block provide the text of the text span.
start_index number This block provide the start index of the text span.
end_index number This block provide the end index of the text span.
"named_entity_recognition_annotation_data" : {
    "text" : "patients for all",
    "start_index" : 15,
    "end_index" : 30
  }

Uber

Developers
© 2026 Uber Technologies Inc.