I will deploy open source llm on ubuntu with cuda optimization

S
superhuwe
S
superhuwe
Wayne Hu.

About this gig

Supported Domestic Open-Source LLMs (Hugging Face)

⭐ Top Recommended (Mature Ecosystem, Commercial-Friendly Licenses) Qwen Series (Alibaba): Qwen2.5, Qwen3.5 (0.5B~72B parameters), Apache 2.0 license, industry-leading Chinese capability, complete deployment toolchain DeepSeek Series: DeepSeek-V3.2, DeepSeek-R1 Reasoning MoE, Apache 2.0 license, top-tier math reasoning & code generation performance GLM Series (Zhipu AI): GLM-4, GLM-5.1 (6B~34B parameters), optimized Chinese dialogue, 128K long context window support Yi Series (01.AI): Yi-1.5, Yi-34B, Apache 2.0 license, excellent long-text processing capability

General & Specialized Models Dialogue: Moonshot K2.5 (200K ultra-long context), Baichuan 4, StepFun Step 2 (strong agent scheduling ability) Code: DeepSeek-Coder V3, Qwen-Coder Series, CodeGeeX 4 (lightweight code assistant) Multi-modal: Qwen2.5-VL / Qwen3.5-VL, GLM-4.6V, Yi-VL (high-precision image understanding & OCR) Lightweight (4GB+ VRAM): Qwen2.5 0.5B/1.5B/7B, GLM-4 6B/9B, DeepSeek-7B Base Vertical Domain: DeepSeek-Math, Qwen-Medical, Chinese LawGPT, Qwen-Finance

Important Notice: All models listed above are publicly downloadable via official Hugging Fa

Get to know Wayne Hu.

Wayne Hu.

AI developer and Private AI System Ops

  • FromChina
  • Member sinceJun 2026
  • Avg. response time1 hour
  • Languages

    Chinese, English
AI Architect & Senior Software Engineer with 15+ years of software development experience and 6+ years in AI. Former R&D Team Leader, Software Architect, Senior Backend Engineer, and DevOps Leader. Specialized in LLM integration, RAG, AI Agents, open-source model fine-tuning, deployment, and optimization. Extensive experience with healthcare, education, automotive, and chatbot solutions. Skilled in Python, C#, Java, SQL/NoSQL, Redis, Elasticsearch, microservices, distributed systems, GPU optimization, ASR/TTS, and production-scale AI infrastructure.