I will build esp32 openai voice assistant led dht low power
About this Gig
Build a low-power ESP32-S3 voice assistant with the official OpenAI stack: Whisper for speech-to-text, GPT with function calling for intent, and OpenAI TTS for the voice reply.
How it works:
On-device wake word (WakeNet) audio stays local until triggered
Whisper STT transcribes your speech via I2S INMP441 microphone
GPT function calling maps intent to set_led(), get_temp(), get_humidity()
DHT22 / SHT40 sampled periodically; readings returned as tool results
OpenAI TTS streams the spoken reply through I2S MAX98357A amplifier
Secure API keys in NVS flash; auto WiFi reconnect; FreeRTOS tasks
Low-power design:
Deep sleep / light sleep between commands
Mic duty cycling and dynamic frequency scaling
WiFi disconnected in standby, connected only after wake
~10-15 mA standby weeks of battery life
Custom startup voice:
I flash a personalized greeting (your name, language, tone) that plays every time the device wakes fully customizable.
Deliverables: ESP-IDF source code, wiring diagram, wake-word model, power consumption report, demo video.
9+ years embedded experience. Message your board model before ordering.
My Portfolio
FAQ
What ESP32 board and mic do you recommend?
I recommend ESP32-S3 (built-in I2S). For the mic, INMP441 works best. For audio output, MAX98357A amplifier. I will provide a full wiring diagram.
Do I need my own OpenAI API key?
Yes, you need your own OpenAI API key. The firmware uses secure NVS flash to store it. WiFi and mic enter deep sleep to save power.
Can I customize the startup voice greeting?
Yes! The Premium package includes a custom startup greeting. I generate it via OpenAI TTS and flash it to the device.
Does it support temperature sensors and LED control?
Yes. I use GPT function calling to control LEDs and read DHT22/SHT40 sensors in real-time.

