Browse categories
Explore
Fiverr Pro
English
$
USD
I will deploy local llms, setup ai agents, and fix API issues
Full Stack Developer, Linux SysAdmin, Automation Expert
I am a Full stack web developer undergraduate at the University of Moratuwa, specializing in Linux Server Administration. Unlike standard VAs, I manage real cloud infrastructure on DigitalOcean and AW...
About this Gig
Need a private AI Dashboard or struggling with Local LLM API issues?
I will set it up securely and fix the bugs!
I specialize in deploying Local LLMs and AI Agent platforms (like Hermes and Open WebUI) on Linux/GPU servers or Locally on your PC. I ensure your AI models run smoothly with production-ready API endpoints.
What I Do:
- Local LLM Setup: Deploy Ollama, vLLM, or LM Studio on your Linux VPS/PC or GPU server.
- AI Dashboards: Setup Open WebUI, AnythingLLM, or Hermes Agent.
- Custom Models: Configure Modelfiles (Llama 3, Qwen, Mistral, GLM) for your specific use case.
- API Security: Generate secure API keys for your developers to use instantly.
Troubleshooting & Bug Fixing:
- Fix API connection errors, CORS issues, and endpoint timeouts.
- Resolve GPU Out of Memory (OOM) errors and CUDA crashes.
- Fix Docker container & Nginx reverse proxy bugs causing AI failures.
Why me?
As a Linux SysAdmin & Full-Stack Developer, I handle the complex infrastructure so you can focus on building your AI apps.
Note: I provide working server infrastructure and APIs. I do not code the AI integration into your app.
Message me your server details before ordering!
Tools:
Docker
Frameworks:
Npm
•
Terraform
•
Ansible
•
Other
Programming language:
Bash
•
JavaScript
•
PHP
•
Python
Expertise:
Installation
•
Migration
•
Configuration
My Portfolio
FAQ
Do you provide the server or GPU hosting?
No, you must provide your own VPS, Cloud Server (AWS, DigitalOcean, RunPod), or local Linux machine. I will handle the software setup and deployment.
What are the server requirements to run a Local LLM?
For basic 8B models (like Llama 3), you need at least 8GB-16GB RAM. However, a server with a dedicated NVIDIA GPU is highly recommended for acceptable generation speeds.
I already have an AI setup, but it keeps crashing. Can you fix it?
Yes! I specialize in fixing Docker container issues, GPU OOM (Out of Memory) crashes, and API timeout errors. Just message me the error logs!
Is my data private and secure with this setup?
100% Yes. Everything is deployed locally on your server. Your prompts and sensitive data are never sent to OpenAI or any third-party APIs.
