Skip to main content

LeaderWorkSet

Official Documentation:

Note: This document is for reference only.

Installation Instructions

CSGHub uses lws to deploy inference services on multiple machines and multiple cards.

Steps

Installing core components

$ kubectl apply --server-side -f https://raw.githubusercontent.com/OpenCSGs/csghub-charts/refs/heads/main/deploy/lws/manifests.yaml

Verify Services

$ kubectl get all -n lws-system
NAME READY STATUS RESTARTS AGE
pod/lws-controller-manager-6cd4b7dc75-24znc 1/1 Running 0 15h
pod/lws-controller-manager-6cd4b7dc75-kk9q2 1/1 Running 0 15h

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/lws-controller-manager-metrics-service ClusterIP 10.100.3.7 <none> 8443/TCP 15h
service/lws-webhook-service ClusterIP 10.100.178.191 <none> 443/TCP 15h

NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/lws-controller-manager 2/2 2 2 15h

NAME DESIRED CURRENT READY AGE
replicaset.apps/lws-controller-manager-6cd4b7dc75 2 2 2 15h

Confirm that all services are running normally.