You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: ansible/README.md
-3Lines changed: 0 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -236,7 +236,4 @@ You may want to also remove cache resources used for the installation with
236
236
rm -rf ~/.cache/seldon/
237
237
```
238
238
239
-
```{note}
240
239
If you used Ansible to install Seldon Core 2 and its ecosystem into K8s cluster other than Kind you need to manually remove all the components.
241
-
Notes on how to remove Seldon Core 2 Helm installation itself you can find [here](https://docs.seldon.io/projects/seldon-core/en/v2/contents/getting-started/kubernetes-installation/helm.html#uninstall).
Copy file name to clipboardExpand all lines: docs-gb/getting-started/kubernetes-installation/ansible.md
+1-2Lines changed: 1 addition & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
{% hint style="warning" %}
4
4
**Warning**: The Ansible installation of a Seldon Core and associated ecosystem is meant for **dev/testing** purposes.
5
-
For production use cases follow [Helm installation](https://docs.seldon.io/projects/seldon-core/en/v2/contents/getting-started/kubernetes-installation/helm.html).
5
+
For production use cases follow [Helm installation](https://docs.seldon.ai/seldon-core-2/installation/production-environment).
6
6
{% endhint %}
7
7
8
8
## Installing Ansible
@@ -241,5 +241,4 @@ rm -rf ~/.cache/seldon/
241
241
242
242
{% hint style="info" %}
243
243
If you used Ansible to install Seldon Core 2 and its ecosystem into K8s cluster other than Kind you need to manually remove all the components.
244
-
Notes on how to remove Seldon Core 2 Helm installation itself you can find [here](https://docs.seldon.io/projects/seldon-core/en/v2/contents/getting-started/kubernetes-installation/helm.html#uninstall).
Copy file name to clipboardExpand all lines: samples/examples/k8s-pvc/k8s-pvc.ipynb
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -96,7 +96,7 @@
96
96
"id": "32da65b2",
97
97
"metadata": {},
98
98
"source": [
99
-
"[**Now you should finish the Seldon install following the docs.**](https://docs.seldon.io/projects/seldon-core/en/v2/contents/getting-started/index.html)"
99
+
"[**Now you should finish the Seldon install following the docs.**](https://docs.seldon.ai/seldon-core-2/installation/production-environment)"
MESH_IP=!kubectl get svc seldon-mesh -n ${NAMESPACE} -o jsonpath='{.status.loadBalancer.ingress[0].ip}'
12
-
MESH_IP=MESH_IP[0]
13
-
import os
14
-
os.environ['MESH_IP'] =MESH_IP
15
-
MESH_IP
16
-
```
17
-
18
-
19
-
20
-
21
-
'172.19.255.1'
22
-
23
-
24
-
25
-
### Kind cluster setup
26
-
27
-
To run this example in Kind we need to start Kind with access to a local folder where are models are location. In this example we will use a folder in `/tmp` and associate that with a path in the container.
28
-
29
-
30
-
```python
31
-
!cat kind-config.yaml
32
-
```
33
-
1
+
## Kubernetes PVC Example
2
+
3
+
4
+
```python
5
+
import os
6
+
os.environ["NAMESPACE"] ="seldon-mesh"
7
+
```
8
+
9
+
10
+
```python
11
+
MESH_IP=!kubectl get svc seldon-mesh -n ${NAMESPACE} -o jsonpath='{.status.loadBalancer.ingress[0].ip}'
12
+
MESH_IP=MESH_IP[0]
13
+
import os
14
+
os.environ['MESH_IP'] =MESH_IP
15
+
MESH_IP
16
+
```
17
+
18
+
19
+
20
+
21
+
'172.19.255.1'
22
+
23
+
24
+
25
+
### Kind cluster setup
26
+
27
+
To run this example in Kind we need to start Kind with access to a local folder where are models are location. In this example we will use a folder in `/tmp` and associate that with a path in the container.
28
+
29
+
30
+
```python
31
+
!cat kind-config.yaml
32
+
```
33
+
34
34
apiVersion: kind.x-k8s.io/v1alpha4
35
35
kind: Cluster
36
36
nodes:
@@ -39,33 +39,33 @@ To run this example in Kind we need to start Kind with access to a local folder
39
39
- hostPath: /tmp/models
40
40
containerPath: /models
41
41
42
-
43
-
44
-
To start a Kind cluster with these settings using our ansible script you can run from the project root folder
[**Now you should finish the Seldon install following the docs.**](https://docs.seldon.io/projects/seldon-core/en/v2/contents/getting-started/index.html)
51
-
52
-
Create the local folder we will use for our models and copy an example iris sklearn model to it.
Here we create a storage class and associated persistent colume referencing the `/models` folder where our models are stored.
63
+
64
+
65
+
```python
66
+
!cat pvc.yaml
67
+
```
68
+
69
69
apiVersion: storage.k8s.io/v1
70
70
kind: StorageClass
71
71
metadata:
@@ -107,17 +107,17 @@ Here we create a storage class and associated persistent colume referencing the
107
107
selector:
108
108
matchLabels:
109
109
type: local
110
-
111
-
112
-
Now we create a new Server based on the provided MLServer configuration but extend it with our PVC by adding this to the rclone container which will allow rclone to move models from this PVC onto the server.
113
-
114
-
We also add a new capability `pvc` to allow us to schedule models to this server that has the PVC.
115
-
116
-
117
-
```python
118
-
!cat server.yaml
119
-
```
120
-
110
+
111
+
112
+
Now we create a new Server based on the provided MLServer configuration but extend it with our PVC by adding this to the rclone container which will allow rclone to move models from this PVC onto the server.
113
+
114
+
We also add a new capability `pvc` to allow us to schedule models to this server that has the PVC.
115
+
116
+
117
+
```python
118
+
!cat server.yaml
119
+
```
120
+
121
121
apiVersion: mlops.seldon.io/v1alpha1
122
122
kind: Server
123
123
metadata:
@@ -136,17 +136,17 @@ We also add a new capability `pvc` to allow us to schedule models to this server
136
136
volumeMounts:
137
137
- name: models-pvc
138
138
mountPath: /var/models
139
-
140
-
141
-
### SKLearn Model
142
-
143
-
We use a simple sklearn iris classification model with the added `pvc` requirement so our MLServer with the PVC will be targeted during scheduling.
144
-
145
-
146
-
```python
147
-
!cat ./iris.yaml
148
-
```
149
-
139
+
140
+
141
+
### SKLearn Model
142
+
143
+
We use a simple sklearn iris classification model with the added `pvc` requirement so our MLServer with the PVC will be targeted during scheduling.
144
+
145
+
146
+
```python
147
+
!cat ./iris.yaml
148
+
```
149
+
150
150
apiVersion: mlops.seldon.io/v1alpha1
151
151
kind: Model
152
152
metadata:
@@ -156,29 +156,29 @@ We use a simple sklearn iris classification model with the added `pvc` requireme
156
156
requirements:
157
157
- sklearn
158
158
- pvc
159
-
160
-
161
-
162
-
```python
163
-
!kubectl create -f iris.yaml -n ${NAMESPACE}
164
-
```
165
-
159
+
160
+
161
+
162
+
```python
163
+
!kubectl create -f iris.yaml -n ${NAMESPACE}
164
+
```
165
+
166
166
model.mlops.seldon.io/iris created
167
-
168
-
169
-
170
-
```python
171
-
!kubectl wait --for condition=ready --timeout=300s model --all-n ${NAMESPACE}
172
-
```
173
-
167
+
168
+
169
+
170
+
```python
171
+
!kubectl wait --for condition=ready --timeout=300s model --all-n ${NAMESPACE}
172
+
```
173
+
174
174
model.mlops.seldon.io/iris condition met
175
-
176
-
177
-
178
-
```python
179
-
!kubectl get model iris -n ${NAMESPACE} -o jsonpath='{.status}'| jq -M .
180
-
```
181
-
175
+
176
+
177
+
178
+
```python
179
+
!kubectl get model iris -n ${NAMESPACE} -o jsonpath='{.status}'| jq -M .
180
+
```
181
+
182
182
{
183
183
"conditions": [
184
184
{
@@ -194,14 +194,14 @@ We use a simple sklearn iris classification model with the added `pvc` requireme
194
194
],
195
195
"replicas": 1
196
196
}
197
-
198
-
199
-
200
-
```python
201
-
!seldon model infer iris --inference-host ${MESH_IP}:80 \
0 commit comments