I will develop edge ai hardware and deploy local llm using phi 3 or ollama

Pakistan

I speak English

211 orders completed

PCB Designer

Only PCB designer with over 13 years of experience on fiver . I have experience to route up to 16 layers PCB.I have experience to do FPGA PCB's ,RF PCB's, Power Electronics PCB's. IoT PCB's and Embedd...

Level 1

Has met certain performance criteria and shows strong potential in the marketplace.

About this Gig

Headline: Bring Intelligence to Your Hardware with Edge AI

Are you looking to build a smart device that doesn't rely on expensive cloud APIs? I specialize in deploying Local LLMs (Phi-3, Llama 3, Mistral) onto Edge Hardware like the Raspberry Pi 5 and Compute Module 4/5.

What I Offer:

  • On-Device LLM Deployment: Expert setup of Ollama and Phi-3 (3B to 7B parameters) optimized for limited RAM.
  • Voice Interface Integration: Building "Push-to-Talk" systems with high-accuracy Speech-to-Text (STT) and natural Text-to-Speech (TTS).
  • Advanced AI Logic: I can program models to summarize long inputs, store them locally with timestamps, and reconstruct them upon voice command.
  • Hardware Design: Prototyping with RPi 5 while keeping the final CM5/Industrial product in mind (Power management, Type-C charging, and Bluetooth).
  • WiFi Deployment: Setting up systems that allow model updates and loading via WiFi rather than SD cards.

My Tech Stack:

  • Hardware: Raspberry Pi 5, CM4/5, ESP32, Mic/Speaker I2S/USB.
  • AI Models: Phi-3, Ollama, Whisper (STT), Piper/Coqui (TTS).
  • Languages: Python, C++, Bash.

Why choose me?

I dont just write code; I understand the transition from a "clunky" RPi 5 prototype to a compact

Platform:

Raspberry Pi

Sensors:

Microphone

Sound & vibration

Camera

Expertise:

Firmware development

Testing

Image processing

AI

Other

My Portfolio

Other Electronics Engineering Services I Offer