Skip to content

Commit 7e03eb2

Browse files
authored
docs: add token embedding description to README (#69)
* docs: add token embedding description to README * docs: add token embedding description to README
1 parent 070fed5 commit 7e03eb2

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,9 @@ model = StaticModel.from_pretrained(model_name)
7070

7171
# Make embeddings
7272
embeddings = model.encode(["It's dangerous to go alone!", "It's a secret to everybody."])
73+
74+
# Make sequences of token embeddings
75+
token_embeddings = model.encode_as_sequence(["It's dangerous to go alone!", "It's a secret to everybody."])
7376
```
7477

7578
And that's it. You can use the model to classify texts, to cluster, or to build a RAG system.
@@ -195,6 +198,9 @@ model = StaticModel.from_pretrained(model_name, token=None)
195198

196199
# Make embeddings
197200
embeddings = model.encode(["It's dangerous to go alone!", "It's a secret to everybody."])
201+
202+
# Make sequences of token embeddings
203+
token_embeddings = model.encode_as_sequence(["It's dangerous to go alone!", "It's a secret to everybody."])
198204
```
199205

200206
### Evaluating a Model2Vec model

0 commit comments

Comments
 (0)