You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/features/models/index.md
-5Lines changed: 0 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,11 +8,6 @@ title: Models
8
8
9
9
Outlines models are objects that wrap an inference client or engine. Models provide a standardized interface to generate structured text.
10
10
11
-
!!! Warning
12
-
13
-
The model loading functions have been modified in v1. While they used to be called `<name_inference_library>`, they are now called `from_<name_inference_library>`. The model classes' names and `__init__` methods are left unchanged.
14
-
15
-
16
11
All Outlines model classes have an associated loader function to facilitate initializing a model instance. The name of this function is `from_` plus the name of the model in lower-case letters. For instance, Outlines has a `Transformers` model and an associated `from_transformers` loader function. The parameters to load a model are specific to each provider, please consult the documentation of the model you want to use for more information.
17
12
18
13
After having created a model instance, you can either directly call it to generate text or first create a reusable generator that you would then call.
Copy file name to clipboardExpand all lines: llm.txt
+2-6Lines changed: 2 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ Outlines is a library for structured generation for type-safe LLMs. It ensures o
6
6
7
7
**Core insight**: Instead of generating text and hoping it matches a format, Outlines makes it impossible for the model to generate invalid outputs by masking invalid tokens during generation.
8
8
9
-
**Note**: The codebase has undergone significant refactoring. Core FSM functionality has been extracted to the `outlines-core` package, and legacy implementations are preserved in `v0_legacy/` for backward compatibility.
9
+
**Note**: The codebase has undergone significant refactoring. Core FSM functionality has been extracted to the `outlines-core` package.
10
10
11
11
## Usage Examples
12
12
@@ -73,10 +73,9 @@ Key files:
73
73
- `tgi.py`: Integration with text-generation-inferece servers
74
74
- `sglang.py`: Integration with SGLang servers
75
75
76
-
### Generation (`outlines/generator.py` and `outlines/v0_legacy/generate/`)
76
+
### Generation (`outlines/generator.py`)
77
77
Handles the generation process:
78
78
- `generator.py`: Main `Generator` class implementations (root level)
79
-
- `v0_legacy/generate/api.py`: Legacy generation API (backward compatibility)
80
79
- Stream functionality is now integrated into generator classes
81
80
82
81
Base classes and implementations for different model providers:
0 commit comments