Browse categories
Explore
Fiverr Pro
English
$
USD
I will build scalable data pipelines with opensearch for lightning fast search
Asadullah
5.0
5.0
About this gig
I build OpenSearch data pipelines that handle production workloads from schema design to AWS deployment.
What I Deliver
Data Ingestion: Async ETL pipelines using Python (asyncio, aiohttp). Batch and real-time processing modes. Multi-source support: APIs, databases, files, streams.
OpenSearch Configuration: Index mappings optimized for your query patterns. Custom analyzers and tokenizers. Relevance tuning and aggregation queries.
AWS Integration: Lambda functions for event-driven ingestion. S3 for raw data staging. SQS/SNS for queue-based processing. Amazon OpenSearch Service deployment.
Tech Stack:
- Search: OpenSearch
- Languages: Python
- AWS: Lambda, S3, SQS, SNS, OpenSearch, CloudWatch
Background:
- Built async crawler engine ingesting 100K+ documents into OpenSearch
- Published research on distributed search systems (ICOCI 2023)
- Designed ETL pipelines for time-series systems
- Experience with multi-tenant architectures and data quality monitoring
Use Cases:
- E-commerce product search
- Log analytics and monitoring
- Document/content search
- Real-time dashboards
Before You Order:
- Message me with your requirements. I'll review your use case and confirm the right package.
Get to know Asadullah
Asadullah
Python Backend Developer, AWS, Data Engineering
- FromBangladesh
- Member sinceOct 2023
- Avg. response time3 days
- Last delivery10 months
Languages
Bengali, English
I build backend APIs and data systems that scale.
5+ years building production systems: FastAPI/Django backends, AWS serverless platforms (10K+ users), async data pipelines, OpenSearch integrations (100K+ docs), web scrapers, and InfluxDB time-series systems with Grafana dashboards.
I deliver clean, documented, production-ready code — APIs with proper validation, ETL pipelines with error handling, and infrastructure that doesn't break at 3 AM.
Published researcher (Springer, IEEE) on distributed systems.
Message me with your requirements — I'll give you an honest assessment.
My Portfolio
Other Software Development Services I Offer
FAQ
I want to integrate a custom search engine to my web application.
Great. I can use OpenSearch to store indexed documents for your items and then provide APIs to handle complex queries as per the user requirements. I can also generate statistics on your data and provide APIs to power a dashboard.
I have an application that stores document files on S3. How can I index those documents?
I can set up Amazon OpenSearch for you to store indexed documents. I can use a batch processor to bulk-index the documents or trigger a Lambda to handle individual files separately.
I need to provide searching functionalities based on textual data. Can you help me with that?
Sure. I can create a pipeline that ingests data, both from the primary database as well as database streams, and then efficiently stores these large textual data into OpenSearch. I can create complex queries to run on OpenSearch clusters and provide ranked results based on relevancy.
Reviews
2 reviews for this Gig
| (2) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
Most relevant
B 
bigfour98
Singapore
Quick to respond, polite, and display above-average understanding of opensearch
$50-$100
Price
2 days
Duration
Helpful?C coghan
United States
Very professional. Great work
$100-$200
Price
5 days
Duration
Helpful?
Reviews
2 reviews for this Gig
| (2) | ||
| (0) | ||
| (0) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
Most relevant
B bigfour98
Singapore
Quick to respond, polite, and display above-average understanding of opensearch
$50-$100
Price
2 days
Duration
Helpful?C coghan
United States
Very professional. Great work
$100-$200
Price
5 days
Duration
Helpful?
