Skip to content

[doc] fix anchors #18591

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Aug 12, 2022
Merged

[doc] fix anchors #18591

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 6 additions & 7 deletions docs/source/en/glossary.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ specific language governing permissions and limitations under the License.
Every model is different yet bears similarities with the others. Therefore most models use the same inputs, which are
detailed here alongside usage examples.

<a id='input-ids'></a>


### Input IDs

Expand Down Expand Up @@ -113,7 +113,7 @@ we will see

because this is the way a [`BertModel`] is going to expect its inputs.

<a id='attention-mask'></a>


### Attention mask

Expand Down Expand Up @@ -171,7 +171,7 @@ in the dictionary returned by the tokenizer under the key "attention_mask":
[[1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]]
```

<a id='token-type-ids'></a>


### Token Type IDs

Expand Down Expand Up @@ -224,7 +224,7 @@ second sequence, corresponding to the "question", has all its tokens represented

Some models, like [`XLNetModel`] use an additional token represented by a `2`.

<a id='position-ids'></a>


### Position IDs

Expand All @@ -238,7 +238,7 @@ absolute positional embeddings.
Absolute positional embeddings are selected in the range `[0, config.max_position_embeddings - 1]`. Some models use
other types of positional embeddings, such as sinusoidal position embeddings or relative position embeddings.

<a id='labels'></a>


### Labels

Expand Down Expand Up @@ -266,7 +266,7 @@ These labels are different according to the model head, for example:
The base models (e.g., [`BertModel`]) do not accept labels, as these are the base transformer
models, simply outputting features.

<a id='decoder-input-ids'></a>


### Decoder input IDs

Expand All @@ -279,7 +279,6 @@ such models, passing the `labels` is the preferred way to handle training.

Please check each model's docs to see how they handle these input IDs for sequence to sequence training.

<a id='feed-forward-chunking'></a>

### Feed Forward Chunking

Expand Down