I will deploy open source llm on ubuntu with cuda optimization


About this gig
Supported Domestic Open-Source LLMs (Hugging Face)
⭐ Top Recommended (Mature Ecosystem, Commercial-Friendly Licenses) Qwen Series (Alibaba): Qwen2.5, Qwen3.5 (0.5B~72B parameters), Apache 2.0 license, industry-leading Chinese capability, complete deployment toolchain DeepSeek Series: DeepSeek-V3.2, DeepSeek-R1 Reasoning MoE, Apache 2.0 license, top-tier math reasoning & code generation performance GLM Series (Zhipu AI): GLM-4, GLM-5.1 (6B~34B parameters), optimized Chinese dialogue, 128K long context window support Yi Series (01.AI): Yi-1.5, Yi-34B, Apache 2.0 license, excellent long-text processing capability
General & Specialized Models Dialogue: Moonshot K2.5 (200K ultra-long context), Baichuan 4, StepFun Step 2 (strong agent scheduling ability) Code: DeepSeek-Coder V3, Qwen-Coder Series, CodeGeeX 4 (lightweight code assistant) Multi-modal: Qwen2.5-VL / Qwen3.5-VL, GLM-4.6V, Yi-VL (high-precision image understanding & OCR) Lightweight (4GB+ VRAM): Qwen2.5 0.5B/1.5B/7B, GLM-4 6B/9B, DeepSeek-7B Base Vertical Domain: DeepSeek-Math, Qwen-Medical, Chinese LawGPT, Qwen-Finance
Important Notice: All models listed above are publicly downloadable via official Hugging Fa
Get to know Wayne Hu.
AI developer and Private AI System Ops
- FromChina
- Member sinceJun 2026
- Avg. response time1 hour
Languages
Chinese, English

