I will build an async task queue system with redis and fastapi


About this gig
I build task queue systems that let your API accept a request instantly and process the heavy work in
the background.
Architecture:
- FastAPI REST interface: enqueue, check status, list tasks, cancel
- Redis LPUSH/BRPOP for fast and reliable task delivery
- Worker processes that scale horizontally
- SQLite persistence for task history and status tracking
- Strategy pattern for task handlers easy to add new task types
- Docker Compose for local dev and cloud deployment
Run docker compose up --scale worker=3 to process tasks in parallel without touching the API.
If Redis goes down the API stays up and logs errors. When Redis comes back workers reconnect
automatically.
Tell me your use case and I will reply within 1 hour.
Get to know Federico M
Backend Engineer
- FromArgentina
- Member sinceOct 2022
- Avg. response time23 hours
Languages
English, Spanish
FAQ
Is this like Celery?
Similar concept but much simpler. This system uses Redis directly (LPUSH/BRPOP) without the Celery overhead. Great for most use cases. If you specifically need Celery I can build that too.
Can workers scale independently of the API?
Yes, workers are separate processes. With Docker Compose you run docker compose up --scale worker=3 to process tasks in parallel without touching the API.
What happens if Redis goes down?
The API stays up and logs errors gracefully. When Redis comes back workers reconnect automatically and resume processing.

