Skip to main content

One-Click Inference

What is One-Click Inference?​

OpenCSG Community provides a One-Click Inference feature that helps users quickly allocate computing resources and launch inference services directly from supported model pages, without complex environment configurations.

Core Advantages​

  • Ready to Use: Eliminates tedious configurations. Automatically pulls containers with complete dependencies.
  • Rich Framework Support: Supports mainstream inference frameworks such as vLLM, llama.cpp, SGLang, and TGI.
  • Flexible Invocation: Provides an intuitive Web interface for chat testing, while simultaneously generating standard API endpoints for integration with your business code.

Demonstration​

Check out the video tutorial below to understand the workflow of the One-Click Inference feature: