You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/guide/labeling.md
+27-31Lines changed: 27 additions & 31 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,6 +16,7 @@ Label and annotate your data with the open source data labeling tool, Label Stud
16
16
17
17
You can also [collaborate with other annotators](#Label-with-collaborators) to improve the quality of your labeled data.
18
18
19
+
19
20
## Start labeling
20
21
21
22
Some labeling tasks can be complicated to perform, for example, labeling that includes text, image, and audio data objects as part of one dataset and labeling task, or creating relations between annotations on a labeling task. This section includes guidance on how to perform more complex labeling tasks, such as labeling with relations, overlapping regions, selected tasks, or changing labels.
@@ -46,7 +47,6 @@ When you label with bounding boxes and other image segmentation tasks, or when y
46
47
7. Click **Submit** to submit the completed annotation and move on to the next task.
47
48
48
49
### Select multiple regions
49
-
50
50
You can select multiple regions while labeling to make changes to them together.
51
51
52
52
1. After creating multiple regions, press `ctrl` and click each region that you want to select. You can select regions on the object that you're labeling or in the **Regions** sidebar. Select a range of regions in the **Regions** sidebar by clicking the first region in the list that you want to select and holding `Shift` while you click the last region in the list that you want to select.
@@ -79,25 +79,24 @@ After labeling a task, you can delete the annotation by clicking the trash can b
79
79
You can also delete all annotations on a task from the project page. See [Delete tasks or annotations](manage_data.html#Delete_tasks_or_annotations).
80
80
81
81
### Add relations between annotations
82
-
83
82
You can create relations between two results with both directions and labels. To add labels to directions, you must set up a labeling config with the relations tag. See more about [relations with labels](/tags/relations.html) in the Tags documentation.
84
83
85
84
1. Select the region for the annotation that you want to relate to another annotation. If you're creating a direction-based relation, select the first one first.
86
85
2. In the **Regions** section of the **Results** sidebar, click the **Create Relation** button that looks like a hyperlink icon.
87
86
3. Select the second region for the annotation to complete the relation.
<i>Figure 1: Add relations between annotations </i>
92
91
93
92
After you relate two annotation regions, you can modify the relation in the **Relations** section of the **Results** sidebar.
94
93
- To change the direction of the relation, click the direction button between the two related regions.
95
94
- To add labels to the direction arrow indicating the relation between two annotations, click the vertical ellipsis button next to the two related regions to add your predefined labels. You must have a [label configuration that includes relations](/tags/relations.html) to do this.
96
95
97
96
### Skipping a task
98
-
99
97
When annotators skip a task, the task no longer appears in the labeling queue for that annotator. Other annotators still see the task in their labeling queue.
100
98
99
+
101
100
## Label with collaborators
102
101
103
102
In both Label Studio and Label Studio Enterprise, you can label tasks with collaborators. Tasks are locked while someone performs annotations so that you don't accidentally overwrite the annotations of another annotator. After the other annotator finishes with the task, it can appear in your queue for labeling if the minimum annotations per task is set to more than one. By default, tasks only need to be annotated by one annotator.
@@ -115,14 +114,17 @@ To label tasks multiple times while the minimum annotations required is set to o
115
114
4. Click **Submit** to save your annotation.
116
115
5. Click the next task in the data manager to open the quick labeling view for that task and repeat steps 2-4.
117
116
117
+
118
118
## Perform ML-assisted labeling with interactive preannotations
119
119
120
120
If you have a machine learning backend set up to [get interactive preannotations](ml.html#Get-interactive-preannotations), you can choose whether to use those predictions while you label.
121
121
122
122
1. After you start labeling, you can enable **Auto-Annotation** to see and use the smart option to assign a label to draw a shape, mask, or assign a keypoint. After using the smart option to draw on an image, or labeling a text or HTML span, the ML backend returns predictions.
123
-
2. For image labeling, you can choose whether to **Auto accept annotation suggestions** after you enable auto-annotation. If you automatically accept annotation suggestions, regions show up automatically and are immediately created. If you don't automatically accept suggestions, the regions appear but you can reject or approve them manually, either individually or all at once. Predicted text regions are automatically accepted.
123
+
2. For image labeling, you can choose whether to **Auto accept annotation suggestions** after you enable auto-annotation. If you automatically accept annotation suggestions, regions show up automatically and are immediately created. If you don't automatically accept suggestions, the regions appear, but you can reject or approve them manually, either individually or all at once. Predicted text regions are automatically accepted.
124
+
124
125
125
126
## Use keyboard shortcuts to label regions faster
127
+
126
128
Use keyboard shortcuts, or hotkeys, to improve your labeling performance. When performing a labeling task, click the gear icon to see more details about hotkeys or to enable or disable hotkeys.
127
129
128
130
This table describes the hotkeys for a standard keyboard. For a Mac keyboard, use return instead of enter, delete instead of backspace, and option instead of alt.
@@ -135,7 +137,7 @@ This table describes the hotkeys for a standard keyboard. For a Mac keyboard, us
135
137
|`escape`| Exit relation mode or unselect a selected region. |
136
138
|`backspace`| Delete a selected region. |
137
139
|`alt` + `r`| Create a relation between regions, when a region is selected. |
138
-
|`alt` + `.`| Cycle through all regions in the order listed on the regions sidebar. |
140
+
|`alt` + `.`| Cycle through all regions in the order listed on the regions' sidebar. |
139
141
|`alt` + `h`| Hide a selected region. |
140
142
|`ctrl` + `d` OR `cmd` + `d`| Duplicate a selected region. |
141
143
|`u`| Unselect a selected region. |
@@ -147,7 +149,6 @@ This table describes the hotkeys for a standard keyboard. For a Mac keyboard, us
147
149
Other annotation types have labeling-specific shortcuts, such as numbers to select specific labels for named entity recognition tasks.
148
150
149
151
### Image-specific hotkeys
150
-
151
152
When labeling image data types with the `Rectangle`, `BrushLabels`, `Ellipse`, `Polygon`, or `KeyPoints` tags, you can use specific hotkeys to take image labeling-specific actions.
152
153
153
154
| Key | Description |
@@ -165,15 +166,13 @@ When labeling image data types with the `Rectangle`, `BrushLabels`, `Ellipse`, `
165
166
|`]`| When the brush or eraser option is selected, increase the size of the brush or eraser. |
166
167
167
168
### Audio-specific hotkeys
168
-
169
169
When labeling audio data types with the `Audio` or `AudioPlus` tags, you can use specific hotkeys to take audio-specific actions.
When labeling timeseries data with the `TimeSeries` tag, you can use specific hotkeys to take actions on a selected region on the time series data.
178
177
179
178
| Key | Description |
@@ -188,7 +187,6 @@ When labeling timeseries data with the `TimeSeries` tag, you can use specific ho
188
187
|`shift` + `alt` + `right arrow`| Decrease the region area by a larger amount on the right. |
189
188
190
189
### Video-specific hotkeys
191
-
192
190
When labeling video data with the `Video` tag, you can use specific hotkeys to take video-specific actions.
193
191
194
192
| Key | Description |
@@ -210,25 +208,26 @@ Refer to the full list of customizable hotkeys in the [`keymap.json` file of the
210
208
211
209
You cannot use this environment variable to remove an existing or add a new keyboard shortcut.
212
210
211
+
213
212
## Customize the labeling interface
214
213
215
214
Click the settings icon when labeling to configure the labeling interface to suit your labeling use case.
216
215
217
216
For example, keep a label selected after creating a region, display labels on bounding boxes, polygons and other regions while labeling, and show line numbers for text labeling.
<i>Figure 2: Customize the labeling interface </i>
223
222
224
223
You can also modify the layout of the screen, hide or show predictions, annotations, or the results panel, and hide or show various controls and buttons.
225
224
225
+
226
226
## Advanced image labeling
227
227
228
228
If you want to perform advanced image labeling, follow these examples and guidance for assistance.
229
229
230
230
### Add multiple types of regions to image annotations
231
-
232
231
You can add multiple types of regions to image annotations. You can add any of the following:
233
232
- Rectangles
234
233
- Ellipses
@@ -261,13 +260,11 @@ Create a custom template for your labeling interface using the following example
261
260
This example makes rectangles, ellipses, polygons, keypoints, and brush masks available to the annotator, along with image classification choices of yes and no, and region labels of building and vehicle.
262
261
263
262
### Faster image labeling
264
-
265
263
You can add a rectangle or an ellipse to your image with just two clicks, or double click to create a polygon, rectangle, or ellipse.
266
264
267
265
If you accidentally select a point on an image while creating a polygon, just double click to remove the erroneous point and continue creating the region. There must be at least three points on the polygon to be able to remove a point.
268
266
269
267
### Create regions without labels
270
-
271
268
When you're annotating images, you can create regions without applying labels.
272
269
273
270
1. Create a region by double-clicking or clicking and dragging to create a bounding box, or click the points necessary to construct a polygon.
@@ -280,7 +277,6 @@ This can be helpful for two-step labeling, where you want one annotator to creat
280
277
By default, regions without labels appear gray.
281
278
282
279
### Erase brush mask labels
283
-
284
280
If you make a mistake when labeling with the brush mask, you can erase it. You must select a brush region in the sidebar before you can erase any part of it.
285
281
286
282
If you want to completely remove a region and start over, delete the region instead of erasing it. Erasing a region does not delete it.
@@ -295,7 +291,7 @@ The **Outliner** is a replacement for the existing interface with a multiple-pan
295
291
Outliner is the area where you can see all the details about annotation, regions, and labeling history. It is split into two panels, named **Outliner** and **Details**. Figure 3 shows the appearance of the **Outliner** panel on the left of the image and **Details** panel on the right of the image.
<i>Figure 3: View of Outliner and Details panels view </i>
300
296
301
297
**Panel actions**
@@ -305,54 +301,54 @@ There are two panels which is the outliner for the regions list. These panels ca
305
301
The **Outliner** and **Details** panels are collapsible and detachable, so you can arrange them the way you want. Figure 4 shows the **Collapse details** button which allows you to collapse the **Details** panel and use the remaining portion of the screen.
<i>Figure 11: Details panel in floating dock view</i>
349
345
350
346
**Region editor**
351
347
352
348
You can edit regions with a focus on labeling. You can zoom in and precise control over the numbers and dimensions of each region attribute. The image region details like height, rotation, and so on can be changed using the inputs in the **Details** panel. Now, you can collapse all panels and get the maximum working area. This feature design makes some actions clear in the product user interface.
"message": "fix: DEV-3550: Check if objects are ready to enable the update button (#893)\n\n* fix: dev-3550: check if objects are ready to enable the update button\r\n\r\n* Fix test to wait for Submit to be enabled\r\n\r\n* Helper for check annotation is submitted\r\n\r\n* Fix helper access to Playwright\r\n\r\n* Fix locator usage\r\n\r\n* Properly leverage Playwright api\r\n\r\n* Cleanup\r\n\r\n* account for undefined objects\r\n\r\nCo-authored-by: Travis1282 <[email protected]>\r\nCo-authored-by: Nick Skriabin <[email protected]>",
"message": "fix: DEV-2049: Removing interpolation hides the label, but not label selection box (#905)\n\n* fix: DEV-2049: Bounding box resize still showing after remove interpolation\r\n\r\n* fix: DEV-2049: Removing interpolation hides the label but not the selection box",
0 commit comments