Skip to content

Commit 6dc9c9a

Browse files
committed
add inference graph image
Signed-off-by: Dan Sun <[email protected]>
1 parent ce63003 commit 6dc9c9a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

docs/blog/articles/2022-07-21-KServe-0.9-release.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ KServe has the unique strength to build the distributed inference graph with its
1616
**InferenceGraph** is made up of a list of routing nodes with each node consisting of a set of routing steps. Each step can either route to an InferenceService or another node defined on the graph which makes the InferenceGraph highly composable.
1717
The graph router is deployed behind an HTTP endpoint and can be scaled dynamically based on request volume. The InferenceGraph supports four different types of routing nodes: **Sequence**, **Switch**, **Ensemble**, **Splitter**.
1818

19+
![InferenceGraph](../../modelserving/inference_graph/inference_graph.png)
1920

2021
- **Sequence Node**: It allows users to define multiple `Steps` with `InferenceServices` or `Nodes` as routing targets in a sequence. The `Steps` are executed in sequence and the request/response from the previous step and be passed to the next step as input based on configuration.
2122
- **Switch Node**: It allows users to define routing conditions and select a `Step` to execute if it matches the condition. The response is returned as soon as it finds the first step that matches the condition. If no condition is matched, the graph returns the original request.

0 commit comments

Comments
 (0)