This Go project replaces the Seldon Java Engine. It is presently in development.
The focus is to provide a smaller more efficient graph orchestror.
- REST and gRPC for Seldon and Tensorflow protocols. Easily extendable to other protocols.
- Logging of request and or response payloads to arbitrary URLs with CloudEvents
- Tracing for REST and gRPC
- Prometheus metrics for REST and gRPC
Changes to existing service orchestrator
- All components must be REST or gRPC in agraph. No mixing.
- Not meta data additions to payloads are carried out by the executor.
You can choose to use this executor by adding the annotation seldon.io/executor: "true". This annotation will be active until this project progresses from incubating status.
An example is shown below:
apiVersion: machinelearning.seldon.io/v1alpha2
kind: SeldonDeployment
metadata:
labels:
app: seldon
name: seldon-model
spec:
annotations:
seldon.io/executor: "true"
name: test-deployment
predictors:
- componentSpecs:
- spec:
containers:
- image: seldonio/mock_classifier_rest:1.3
name: classifier
graph:
children: []
endpoint:
type: REST
name: classifier
type: MODEL
labels:
version: v1
name: example
replicas: 1
We assume:
- Go 1.13