LeaderWorkSet
Official Documentation:
Note: This document is for reference only.
Installation Instructions
CSGHub uses lws to deploy inference services on multiple machines and multiple cards.
Steps
Installing core components
$ kubectl apply --server-side -f https://raw.githubusercontent.com/OpenCSGs/csghub-charts/refs/heads/main/deploy/lws/manifests.yaml
Verify Services
$ kubectl get all -n lws-system
NAME READY STATUS RESTARTS AGE
pod/lws-controller-manager-6cd4b7dc75-24znc 1/1 Running 0 15h
pod/lws-controller-manager-6cd4b7dc75-kk9q2 1/1 Running 0 15h
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/lws-controller-manager-metrics-service ClusterIP 10.100.3.7 <none> 8443/TCP 15h
service/lws-webhook-service ClusterIP 10.100.178.191 <none> 443/TCP 15h
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/lws-controller-manager 2/2 2 2 15h
NAME DESIRED CURRENT READY AGE
replicaset.apps/lws-controller-manager-6cd4b7dc75 2 2 2 15h
Confirm that all services are running normally.