Skip to content

Commit ae98cc8

Browse files
committed
fix json code style.
1 parent ab288ff commit ae98cc8

File tree

7 files changed

+100573
-7
lines changed

7 files changed

+100573
-7
lines changed
Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,5 @@
1-
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}
1+
{
2+
"bos_token": "<|endoftext|>",
3+
"eos_token": "<|endoftext|>",
4+
"unk_token": "<|endoftext|>"
5+
}
Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,10 @@
1-
{"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2", "tokenizer_class": "GPT2Tokenizer"}
1+
{
2+
"unk_token": "<|endoftext|>",
3+
"bos_token": "<|endoftext|>",
4+
"eos_token": "<|endoftext|>",
5+
"add_prefix_space": false,
6+
"model_max_length": 1024,
7+
"special_tokens_map_file": null,
8+
"name_or_path": "gpt2",
9+
"tokenizer_class": "GPT2Tokenizer"
10+
}

paddlespeech/s2t/models/whisper/assets/gpt2/vocab.json

Lines changed: 50259 additions & 1 deletion
Large diffs are not rendered by default.
Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,3 @@
1-
{"<|endoftext|>": 50257}
1+
{
2+
"<|endoftext|>": 50257
3+
}
Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,5 @@
1-
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}
1+
{
2+
"bos_token": "<|endoftext|>",
3+
"eos_token": "<|endoftext|>",
4+
"unk_token": "<|endoftext|>"
5+
}
Lines changed: 32 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,32 @@
1-
{"unk_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "bos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "eos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "multilingual", "errors": "replace", "tokenizer_class": "GPT2Tokenizer"}
1+
{
2+
"unk_token": {
3+
"content": "<|endoftext|>",
4+
"single_word": false,
5+
"lstrip": false,
6+
"rstrip": false,
7+
"normalized": true,
8+
"__type": "AddedToken"
9+
},
10+
"bos_token": {
11+
"content": "<|endoftext|>",
12+
"single_word": false,
13+
"lstrip": false,
14+
"rstrip": false,
15+
"normalized": true,
16+
"__type": "AddedToken"
17+
},
18+
"eos_token": {
19+
"content": "<|endoftext|>",
20+
"single_word": false,
21+
"lstrip": false,
22+
"rstrip": false,
23+
"normalized": true,
24+
"__type": "AddedToken"
25+
},
26+
"add_prefix_space": false,
27+
"model_max_length": 1024,
28+
"special_tokens_map_file": null,
29+
"name_or_path": "multilingual",
30+
"errors": "replace",
31+
"tokenizer_class": "GPT2Tokenizer"
32+
}

paddlespeech/s2t/models/whisper/assets/multilingual/vocab.json

Lines changed: 50259 additions & 1 deletion
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)