Getting Started:
Keyframe Annotation

Automated Annotation

When you launch an automated pipeline as your annotation type, you’ll work on two types of tasks: keyframe annotation tasks and re-annotation tasks.

Keyframe annotation

Keyframes: These are the first tasks you’ll handle. Keyframes are automatically selected for their valuable content, which might include relevant objects and interactions. Annotating these frames reduces the overall effort of annotating and enhances the efficiency of our automatic processes like mask propagation.

Keyframes don’t have any masks or categories, but they might have suggestions pointing to important or relevant objects. You choose what to annotate in each frame. Mask propagation will generate masks for the objects you annotate in the rest of the frames.

Note: If you don’t annotate an object in a keyframe, no masks will be created during mask propagation.

How to create a mask

Using the AI Selection tool, mask previews will appear when you hover over areas of the frame.

Left-clicking will create a mask that can be refined. This mask includes the left and right hands, but we only want the left hand.

After the initial click, which included both hands, Right-clicking on the incorrect part of the mask removes it.

Missing areas of a mask can be added by Left-clicking over the areas until the object mask is complete and accurate.

How to add a category

After creating a new mask for an object, the object still needs a category. An annotated object is made up of 2 parts, the mask and category.

Clicking on the label “unknown” opens the category selection dialog. Type in the field and receive a list of possible categories to choose from.

A category can also be assigned from the Suggested Categories list. Clicking on an item from this list will assign the mask that category.

How to complete keyframe tasks

When all necessary objects in a keyframe are annotated, click Submit to complete the annotation task.

After submitting an annotation task, you will be automatically taken to the next keyframe to be annotated (repeat previous steps).

When all keyframe annotation tasks are completed you will be returned to the Project.

Back in the Project, you will see that further steps are in progress on the annotation, such as annotation review or mask propagation.