I will deploy open source llms or slms with vllm and ollama on your server

P
pasindu_bathiya
P
pasindu_bathiya
Pasindu Bathiya

About this gig

Turn your server into a private AI powerhouse! I will deploy and set up open-source LLMs/SLMs using vLLM and Ollama on your server, cloud, or VPS, complete with an intuitive Open WebUI interface.


What You Get


  • Full Installation & Setup: Deploy any open-source model (Llama, Qwen, Mistral, etc.) directly on your infrastructure.
  • ChatGPT-Like Interface: Clean, user-friendly WebUI setup for easy everyday access.
  • Optimized Performance: GPU/CPU tuning and model quantization (GGUF/AWQ) for maximum speed and efficiency.
  • 100% Privacy & Security: Your data stays entirely on your server with zero external API calls.
  • API Integration: Ready-to-use endpoints to connect your AI models to your apps.


Why Choose Me?


  • 3+ years of hands-on ML/DL(TensorFlow and PyTorch) experience, scaling from simple model training to advanced inference pipelines.
  • Clear communication with zero confusing technical jargon.
  • Tailored setup matched precisely to your hardware and goals.


Ready to launch? Message me before ordering so we can discuss your server specs and select the best model for your use case!

Get to know Pasindu Bathiya

Pasindu Bathiya

Transforming Ideas into Scalable, Secure Applications

  • FromSri Lanka
  • Member sinceAug 2023
  • Avg. response time1 hour
  • Languages

    English
I’m a Senior Software Engineer with over 5 years of experience and a passion for creating scalable and high-performance backend applications. Specializing in Spring Boot, Java, and RESTful API development, I’m dedicated to delivering quality solutions tailored to your needs. Let’s work together to bring your project to life!

My Portfolio