I will set up a private, serverless llm deployment on google cloud run

Thomas Weyrath

France

I speak German, English, French

Senior Software Engineer and AI Engineer

I combine many years of software engineering experience (including for BMW and Airbus) with modern AI technologies to help companies implement scalable and production-ready AI solutions. As a German ...
Read More
About this Gig

Do you want full control over your AI data without paying thousands for dedicated servers? I will set up a private, open-source LLM (e.g., Gemma 4, Llama 3, Mistral) in your own Google Cloud (GCP) environment.


Why this setup?

  • 100% Data Sovereignty: Your prompts never leave your cloud. No dependence on third-party APIs. Perfect for sensitive corporate data.
  • Limitless Scalability: Unlike rigid hosting or local servers, this architecture scales automatically. It clones instances during traffic spikes and scales to zero during idle times (Pay-per-Use).
  • High Performance: The model runs on powerful NVIDIA L4 GPUs.


What you will receive:

  • Detailed Manual (English): Step-by-step guide for GCP infrastructure, IAM permissions, and requesting GPU quotas.
  • Automation Script 1: An intelligent Bash script that automatically downloads and prepares your desired model.
  • Automation Script 2: A deployment script for the entire cloud stack (Cloud Run & Storage Bucket).
  • Support: Short guidance during your initial setup to ensure everything works perfectly.
Read More
set up a private, serverless llm deployment on google cloud run
Full Screen
set up a private, serverless llm deployment on google cloud run
Full Screen
View Presentation
set up a private, serverless llm deployment on google cloud runset up a private, serverless llm deployment on google cloud runset up a private, serverless llm deployment on google cloud run

Cloud Provider:

Google Cloud Platform

Expertise:

Deployment

Frameworks:

Other

Related tags