Skip to content

Commit df5db23

Browse files
Merge remote-tracking branch 'origin/develop' into fb-dev-3329
2 parents 0e02b63 + 57dd0c5 commit df5db23

File tree

4 files changed

+32
-36
lines changed

4 files changed

+32
-36
lines changed

docs/source/guide/labeling.md

Lines changed: 27 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ Label and annotate your data with the open source data labeling tool, Label Stud
1616

1717
You can also [collaborate with other annotators](#Label-with-collaborators) to improve the quality of your labeled data.
1818

19+
1920
## Start labeling
2021

2122
Some labeling tasks can be complicated to perform, for example, labeling that includes text, image, and audio data objects as part of one dataset and labeling task, or creating relations between annotations on a labeling task. This section includes guidance on how to perform more complex labeling tasks, such as labeling with relations, overlapping regions, selected tasks, or changing labels.
@@ -46,7 +47,6 @@ When you label with bounding boxes and other image segmentation tasks, or when y
4647
7. Click **Submit** to submit the completed annotation and move on to the next task.
4748

4849
### Select multiple regions
49-
5050
You can select multiple regions while labeling to make changes to them together.
5151

5252
1. After creating multiple regions, press `ctrl` and click each region that you want to select. You can select regions on the object that you're labeling or in the **Regions** sidebar. Select a range of regions in the **Regions** sidebar by clicking the first region in the list that you want to select and holding `Shift` while you click the last region in the list that you want to select.
@@ -79,25 +79,24 @@ After labeling a task, you can delete the annotation by clicking the trash can b
7979
You can also delete all annotations on a task from the project page. See [Delete tasks or annotations](manage_data.html#Delete_tasks_or_annotations).
8080

8181
### Add relations between annotations
82-
8382
You can create relations between two results with both directions and labels. To add labels to directions, you must set up a labeling config with the relations tag. See more about [relations with labels](/tags/relations.html) in the Tags documentation.
8483

8584
1. Select the region for the annotation that you want to relate to another annotation. If you're creating a direction-based relation, select the first one first.
8685
2. In the **Regions** section of the **Results** sidebar, click the **Create Relation** button that looks like a hyperlink icon.
8786
3. Select the second region for the annotation to complete the relation.
8887

8988
<br>
90-
<img src="../images/relation.png">
89+
<img src="../images/relation.png" class="gif-border">
9190
<i>Figure 1: Add relations between annotations </i>
9291

9392
After you relate two annotation regions, you can modify the relation in the **Relations** section of the **Results** sidebar.
9493
- To change the direction of the relation, click the direction button between the two related regions.
9594
- To add labels to the direction arrow indicating the relation between two annotations, click the vertical ellipsis button next to the two related regions to add your predefined labels. You must have a [label configuration that includes relations](/tags/relations.html) to do this.
9695

9796
### Skipping a task
98-
9997
When annotators skip a task, the task no longer appears in the labeling queue for that annotator. Other annotators still see the task in their labeling queue.
10098

99+
101100
## Label with collaborators
102101

103102
In both Label Studio and Label Studio Enterprise, you can label tasks with collaborators. Tasks are locked while someone performs annotations so that you don't accidentally overwrite the annotations of another annotator. After the other annotator finishes with the task, it can appear in your queue for labeling if the minimum annotations per task is set to more than one. By default, tasks only need to be annotated by one annotator.
@@ -115,14 +114,17 @@ To label tasks multiple times while the minimum annotations required is set to o
115114
4. Click **Submit** to save your annotation.
116115
5. Click the next task in the data manager to open the quick labeling view for that task and repeat steps 2-4.
117116

117+
118118
## Perform ML-assisted labeling with interactive preannotations
119119

120120
If you have a machine learning backend set up to [get interactive preannotations](ml.html#Get-interactive-preannotations), you can choose whether to use those predictions while you label.
121121

122122
1. After you start labeling, you can enable **Auto-Annotation** to see and use the smart option to assign a label to draw a shape, mask, or assign a keypoint. After using the smart option to draw on an image, or labeling a text or HTML span, the ML backend returns predictions.
123-
2. For image labeling, you can choose whether to **Auto accept annotation suggestions** after you enable auto-annotation. If you automatically accept annotation suggestions, regions show up automatically and are immediately created. If you don't automatically accept suggestions, the regions appear but you can reject or approve them manually, either individually or all at once. Predicted text regions are automatically accepted.
123+
2. For image labeling, you can choose whether to **Auto accept annotation suggestions** after you enable auto-annotation. If you automatically accept annotation suggestions, regions show up automatically and are immediately created. If you don't automatically accept suggestions, the regions appear, but you can reject or approve them manually, either individually or all at once. Predicted text regions are automatically accepted.
124+
124125

125126
## Use keyboard shortcuts to label regions faster
127+
126128
Use keyboard shortcuts, or hotkeys, to improve your labeling performance. When performing a labeling task, click the gear icon to see more details about hotkeys or to enable or disable hotkeys.
127129

128130
This table describes the hotkeys for a standard keyboard. For a Mac keyboard, use return instead of enter, delete instead of backspace, and option instead of alt.
@@ -135,7 +137,7 @@ This table describes the hotkeys for a standard keyboard. For a Mac keyboard, us
135137
| `escape` | Exit relation mode or unselect a selected region. |
136138
| `backspace` | Delete a selected region. |
137139
| `alt` + `r` | Create a relation between regions, when a region is selected. |
138-
| `alt` + `.` | Cycle through all regions in the order listed on the regions sidebar. |
140+
| `alt` + `.` | Cycle through all regions in the order listed on the regions' sidebar. |
139141
| `alt` + `h` | Hide a selected region. |
140142
| `ctrl` + `d` OR `cmd` + `d` | Duplicate a selected region. |
141143
| `u` | Unselect a selected region. |
@@ -147,7 +149,6 @@ This table describes the hotkeys for a standard keyboard. For a Mac keyboard, us
147149
Other annotation types have labeling-specific shortcuts, such as numbers to select specific labels for named entity recognition tasks.
148150

149151
### Image-specific hotkeys
150-
151152
When labeling image data types with the `Rectangle`, `BrushLabels`, `Ellipse`, `Polygon`, or `KeyPoints` tags, you can use specific hotkeys to take image labeling-specific actions.
152153

153154
| Key | Description |
@@ -165,15 +166,13 @@ When labeling image data types with the `Rectangle`, `BrushLabels`, `Ellipse`, `
165166
| `]` | When the brush or eraser option is selected, increase the size of the brush or eraser. |
166167

167168
### Audio-specific hotkeys
168-
169169
When labeling audio data types with the `Audio` or `AudioPlus` tags, you can use specific hotkeys to take audio-specific actions.
170170

171171
| Key | Description |
172172
| --- | --- |
173173
| `ctrl` + `b` OR `cmd` + `b` | Rewind audio 1 second. |
174174

175175
### Time series-specific hotkeys
176-
177176
When labeling timeseries data with the `TimeSeries` tag, you can use specific hotkeys to take actions on a selected region on the time series data.
178177

179178
| Key | Description |
@@ -188,7 +187,6 @@ When labeling timeseries data with the `TimeSeries` tag, you can use specific ho
188187
| `shift` + `alt` + `right arrow` | Decrease the region area by a larger amount on the right. |
189188

190189
### Video-specific hotkeys
191-
192190
When labeling video data with the `Video` tag, you can use specific hotkeys to take video-specific actions.
193191

194192
| Key | Description |
@@ -210,25 +208,26 @@ Refer to the full list of customizable hotkeys in the [`keymap.json` file of the
210208

211209
You cannot use this environment variable to remove an existing or add a new keyboard shortcut.
212210

211+
213212
## Customize the labeling interface
214213

215214
Click the settings icon when labeling to configure the labeling interface to suit your labeling use case.
216215

217216
For example, keep a label selected after creating a region, display labels on bounding boxes, polygons and other regions while labeling, and show line numbers for text labeling.
218217

219218
<center>
220-
<img src='../images/lsf-settings.png'>
219+
<img src='../images/lsf-settings.png' class="gif-border">
221220
</center>
222221
<i>Figure 2: Customize the labeling interface </i>
223222

224223
You can also modify the layout of the screen, hide or show predictions, annotations, or the results panel, and hide or show various controls and buttons.
225224

225+
226226
## Advanced image labeling
227227

228228
If you want to perform advanced image labeling, follow these examples and guidance for assistance.
229229

230230
### Add multiple types of regions to image annotations
231-
232231
You can add multiple types of regions to image annotations. You can add any of the following:
233232
- Rectangles
234233
- Ellipses
@@ -261,13 +260,11 @@ Create a custom template for your labeling interface using the following example
261260
This example makes rectangles, ellipses, polygons, keypoints, and brush masks available to the annotator, along with image classification choices of yes and no, and region labels of building and vehicle.
262261

263262
### Faster image labeling
264-
265263
You can add a rectangle or an ellipse to your image with just two clicks, or double click to create a polygon, rectangle, or ellipse.
266264

267265
If you accidentally select a point on an image while creating a polygon, just double click to remove the erroneous point and continue creating the region. There must be at least three points on the polygon to be able to remove a point.
268266

269267
### Create regions without labels
270-
271268
When you're annotating images, you can create regions without applying labels.
272269

273270
1. Create a region by double-clicking or clicking and dragging to create a bounding box, or click the points necessary to construct a polygon.
@@ -280,7 +277,6 @@ This can be helpful for two-step labeling, where you want one annotator to creat
280277
By default, regions without labels appear gray.
281278

282279
### Erase brush mask labels
283-
284280
If you make a mistake when labeling with the brush mask, you can erase it. You must select a brush region in the sidebar before you can erase any part of it.
285281

286282
If you want to completely remove a region and start over, delete the region instead of erasing it. Erasing a region does not delete it.
@@ -295,7 +291,7 @@ The **Outliner** is a replacement for the existing interface with a multiple-pan
295291
Outliner is the area where you can see all the details about annotation, regions, and labeling history. It is split into two panels, named **Outliner** and **Details**. Figure 3 shows the appearance of the **Outliner** panel on the left of the image and **Details** panel on the right of the image.
296292

297293
<br>
298-
<div style="margin:auto; text-align:center;"><img src="/images/outliner-details-panels-view.png" style="opacity: 0.8"/></div>
294+
<div style="margin:auto; text-align:center;"><img src="/images/outliner-details-panels-view.png" style="opacity: 0.8" class="gif-border"/></div>
299295
<i>Figure 3: View of Outliner and Details panels view </i>
300296

301297
**Panel actions**
@@ -305,54 +301,54 @@ There are two panels which is the outliner for the regions list. These panels ca
305301
The **Outliner** and **Details** panels are collapsible and detachable, so you can arrange them the way you want. Figure 4 shows the **Collapse details** button which allows you to collapse the **Details** panel and use the remaining portion of the screen.
306302

307303
<br>
308-
<div style="margin:auto; text-align:center;"><img src="/images/collapse-details-button.png" style="opacity: 0.8"/></div>
304+
<div style="margin:auto; text-align:center;"><img src="/images/collapse-details-button.png" style="opacity: 0.8" class="gif-border"/></div>
309305
<i>Figure 4: Collapsed details button</i>
310306

311307
Now, the **Details** panel is collapsed, and you can expand it by clicking the **Expand Details** icon.
312308
<br>
313-
<div style="margin:auto; text-align:center;"><img src="/images/details-collapsed-button-view.png" style="opacity: 0.8"/></div>
309+
<div style="margin:auto; text-align:center;"><img src="/images/details-collapsed-button-view.png" style="opacity: 0.8" class="gif-border"/></div>
314310
<i>Figure 5: Details panel in collapsed view</i>
315311

316312
The details panel is displayed in expanded view to explore the feature.
317313

318314
<br>
319-
<div style="margin:auto; text-align:center;"><img src="/images/details-panel-expanded-view.png" style="opacity: 0.8"/></div>
315+
<div style="margin:auto; text-align:center;"><img src="/images/details-panel-expanded-view.png" style="opacity: 0.8" class="gif-border"/></div>
320316
<i>Figure 6: Details panel in expanded view</i>
321317

322318
To collapse the **Outliner** panel, click on the **Collapse outliner** icon.
323319

324320
<br>
325-
<div style="margin:auto; text-align:center;"><img src="/images/collapse-outliner-button.png" style="opacity: 0.8"/></div>
321+
<div style="margin:auto; text-align:center;"><img src="/images/collapse-outliner-button.png" style="opacity: 0.8" class="gif-border"/></div>
326322
<i>Figure 7: Collapse outliner button</i>
327323

328324
Now, the **Outliner** panel is collapsed, and you can expand it by clicking the **Expand Details** icon.
329325
<br>
330-
<div style="margin:auto; text-align:center;"><img src="/images/outliner-collapsed-view.png" style="opacity: 0.8"/></div>
326+
<div style="margin:auto; text-align:center;"><img src="/images/outliner-collapsed-view.png" style="opacity: 0.8" class="gif-border"/></div>
331327
<i>Figure 8: Outliner panel in collapsed view</i>
332328

333329
The **Expand Details** icon expands the **Outliner** panel for further actions.
334330

335331
<br>
336-
<div style="margin:auto; text-align:center;"><img src="/images/expand-outliner-button.png" style="opacity: 0.8"/></div>
332+
<div style="margin:auto; text-align:center;"><img src="/images/expand-outliner-button.png" style="opacity: 0.8" class="gif-border"/></div>
337333
<i>Figure 9: Outliner panel with expand outliner icon</i>
338334

339335
The Outliner panel is displayed in expanded view to explore the feature.
340336
<br>
341-
<div style="margin:auto; text-align:center;"><img src="/images/outliner-expanded-view.png" style="opacity: 0.8"/></div>
337+
<div style="margin:auto; text-align:center;"><img src="/images/outliner-expanded-view.png" style="opacity: 0.8" class="gif-border"/></div>
342338
<i>Figure 10: Outliner panel in expanded view</i>
343339

344340
These panels are detachable, so you can place them wherever you want on the screen, and you can resize them.
345341

346342
<br>
347-
<div style="margin:auto; text-align:center;"><img src="/images/details-floating-dock.png" style="opacity: 0.8"/></div>
343+
<div style="margin:auto; text-align:center;"><img src="/images/details-floating-dock.png" style="opacity: 0.8" class="gif-border"/></div>
348344
<i>Figure 11: Details panel in floating dock view</i>
349345

350346
**Region editor**
351347

352348
You can edit regions with a focus on labeling. You can zoom in and precise control over the numbers and dimensions of each region attribute. The image region details like height, rotation, and so on can be changed using the inputs in the **Details** panel. Now, you can collapse all panels and get the maximum working area. This feature design makes some actions clear in the product user interface.
353349

354350
<br>
355-
<div style="margin:auto; text-align:center;"><img src="/images/region-editor.png" style="opacity: 0.8"/></div>
351+
<div style="margin:auto; text-align:center;"><img src="/images/region-editor.png" style="opacity: 0.8" class="gif-border"/></div>
356352
<i>Figure 12: Edit regions using different attributes</i>
357353

358354

@@ -363,7 +359,7 @@ You can edit regions with a focus on labeling. You can zoom in and precise contr
363359
<i class='ent'></i>The Comments box is available inside the outliner.
364360

365361
<br>
366-
<div style="margin:auto; text-align:center;"><img src="/images/comments-box.png" style="opacity: 0.8"/></div>
362+
<div style="margin:auto; text-align:center;"><img src="/images/comments-box.png" style="opacity: 0.8" class="gif-border"/></div>
367363
<i>Figure 13: Comments box </i>
368364

369365
!!! info
@@ -379,7 +375,7 @@ To add a region in the OCR transcription templates, draw a rectangle, and you ca
379375
- Hide or show a selected region.
380376

381377
<br>
382-
<div style="margin:auto; text-align:center;"><img src="/images/text-inside-outliner.png" style="opacity: 0.8"/></div>
378+
<div style="margin:auto; text-align:center;"><img src="/images/text-inside-outliner.png" style="opacity: 0.8" class="gif-border"/></div>
383379
<i>Figure 13: Text inside outliner</i>
384380

385381
**Regions grouping or sorting**
@@ -396,19 +392,19 @@ You can group or sort regions using the following functionality from the drop-do
396392
You can also order your regions by **Order by Score** or **Order by Time** options.
397393

398394
<br>
399-
<div style="margin:auto; text-align:center;"><img src="/images/group-by-label-sorted-by-score-expanded-dog-icon.png" style="opacity: 0.8"/></div>
395+
<div style="margin:auto; text-align:center;"><img src="/images/group-by-label-sorted-by-score-expanded-dog-icon.png" style="opacity: 0.8" class="gif-border"/></div>
400396
<i>Figure 14: Group by label using sorted by score</i>
401397

402398
<br>
403-
<div style="margin:auto; text-align:center;"><img src="/images/group-by-tool-sorted-by-score.png" style="opacity: 0.8"/></div>
399+
<div style="margin:auto; text-align:center;"><img src="/images/group-by-tool-sorted-by-score.png" style="opacity: 0.8" class="gif-border"/></div>
404400
<i>Figure 15: Group by tool using sorted by score</i>
405401

406402
<br>
407-
<div style="margin:auto; text-align:center;"><img src="/images/group-by-label-sorted-by-score.png" style="opacity: 0.8"/></div>
403+
<div style="margin:auto; text-align:center;"><img src="/images/group-by-label-sorted-by-score.png" style="opacity: 0.8" class="gif-border"/></div>
408404
<i>Figure 16: Group by label using sorted by score</i>
409405

410406
<br>
411-
<div style="margin:auto; text-align:center;"><img src="/images/manual-grouping.png" style="opacity: 0.8"/></div>
407+
<div style="margin:auto; text-align:center;"><img src="/images/manual-grouping.png" style="opacity: 0.8" class="gif-border"/></div>
412408
<i>Figure 17: Manual grouping</i>
413409

414410
**Prediction indication of the region**

label_studio/frontend/dist/lsf/js/main.js

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

label_studio/frontend/dist/lsf/js/main.js.map

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
2-
"message": "fix: DEV-3550: Check if objects are ready to enable the update button (#893)\n\n* fix: dev-3550: check if objects are ready to enable the update button\r\n\r\n* Fix test to wait for Submit to be enabled\r\n\r\n* Helper for check annotation is submitted\r\n\r\n* Fix helper access to Playwright\r\n\r\n* Fix locator usage\r\n\r\n* Properly leverage Playwright api\r\n\r\n* Cleanup\r\n\r\n* account for undefined objects\r\n\r\nCo-authored-by: Travis1282 <[email protected]>\r\nCo-authored-by: Nick Skriabin <[email protected]>",
3-
"commit": "f0657e6100337889402905b752116ca000a666d3",
2+
"message": "fix: DEV-2049: Removing interpolation hides the label, but not label selection box (#905)\n\n* fix: DEV-2049: Bounding box resize still showing after remove interpolation\r\n\r\n* fix: DEV-2049: Removing interpolation hides the label but not the selection box",
3+
"commit": "bf1ec312a6dd504b8d597deba089b573b2239461",
44
"branch": "master",
5-
"date": "2022-10-11T12:38:24Z"
5+
"date": "2022-10-11T13:29:32Z"
66
}

0 commit comments

Comments
 (0)