Browse categories
Explore
Fiverr Pro
English
$
USD
I will build AWS data, etl pipelines using glue, pyspark, s3 and redshift
Senior AWS Data Engineer building scalable and AI ready data platforms
I am a Senior AWS Data Engineer with 8+ years of experience building reliable, production-ready data platforms. I help teams design, audit, and optimize AWS ETL/ELT pipelines, data lakes, warehouses, ...
About this Gig
I will build reliable AWS data pipelines for analytics, reporting, dashboards and data warehouse use cases.
This gig is suitable if you have data coming from files, databases, APIs, applications, S3, or existing databases and want to process it using AWS services such as Amazon S3, AWS Glue, EMR/PySpark, Redshift, Athena, Lambda, DMS, Airflow/MWAA or related tools.
I can help with:
- AWS ETL/ELT pipeline design and implementation
- Data ingestion from files, APIs, databases or cloud storage
- S3 data lake structure
- Glue, EMR, PySpark, Redshift, and Athena workflows
- Data cleaning, transformation, and loading
- Data quality checks and validation
- Logging, audit points and basic monitoring
- Pipeline fixes and improvements
- Cost, performance and scalability recommendations
- Documentation and handover notes
Common use cases:
- Build a new AWS data pipeline
- Migrate from On-Prem to AWS
- Move data into S3 or Redshift
- Prepare data for BI/reporting
- Improve an existing ETL process
- Create analytics-ready datasets
- Review pipeline quality, cost or scalability
Please message before ordering so we can confirm your data source, AWS setup, expected output, access requirements, and the right package.
Destination Platform:
Amazon Redshift
•
PostgreSQL
•
Amazon S3
•
Other
Tools & Platforms:
AWS Glue DataBrew
•
Other
My Portfolio
Other Data Engineering Services I Offer
FAQ
What AWS services do you work with?
I work with Amazon S3, AWS Glue, EMR/PySpark, Redshift, Athena, Lambda, DMS, Airflow/MWAA, IAM, CloudWatch and related AWS data services.
Can you build a complete AWS ETL pipeline?
Yes. I can build AWS ETL/ELT pipelines for files, APIs, databases, or cloud storage and prepare data for analytics, reporting, Athena, Redshift, or dashboards.
Do I need to provide AWS access?
For implementation work, limited AWS access may be required. If you prefer, we can first review requirements, screenshots, sample data or architecture before access is shared.
Can you improve an existing AWS pipeline?
Yes. I can review, fix, improve, or optimize existing AWS pipelines, including ETL logic, Spark jobs, S3 structure, Redshift/Athena usage, quality checks and performance issues.
Can you migrate data from on-prem databases or sources to AWS?
Yes. I can help migrate data from on-prem databases, files, or other sources to AWS using services such as S3, AWS Glue, DMS, EMR/PySpark, Redshift, and Athena depending on your source, volume, and target use case.
Do you provide data quality checks?
Yes. Standard and Premium packages can include basic data quality checks, validation rules, duplicate checks, schema checks and logging points.
Can you work with large datasets?
Yes. I can design scalable pipelines using S3, Glue, EMR/PySpark, partitioning, Parquet, Athena, and Redshift depending on data volume and processing needs. I had experience working with Peta/tera bytes of data.
Will you provide documentation?
Yes. Delivery includes documentation or handover notes based on the selected package, including pipeline flow, setup steps, assumptions and usage instructions.
Should I message before placing an order?
Yes, please message before ordering so we can confirm your data source, AWS setup, expected output, access requirements, timeline and the best package.
