I will build scalable etl pipelines using AWS services
Data and Machine Learning Engineer
About this Gig
Need a robust and scalable ETL pipeline to automate your data workflows? You're in the right place! I'm a Data & ML Engineer with 2 years of experience designing and deploying efficient, fault-tolerant data pipelines using AWS.
What I Offer:
End-to-end ETL pipeline setup using:
- AWS Glue (Jobs, Crawlers, Triggers)
- AWS Lambda
- Amazon S3
- Amazon Redshift / RDS
- Step Functions
- CloudWatch for monitoring
Custom transformations using Python/PySpark
Optimized performance & cost-effective data flow
Incremental data processing and job scheduling
️Best practices for security and reliability
Destination Platform:
Amazon Redshift
•
Amazon S3
Tools & Platforms:
AWS Glue DataBrew
FAQ
What do I need to get started?
I’ll need access to your AWS environment (temporary IAM user or roles), details about your data sources, transformation requirements, and target destinations. If you're not sure, I can guide you through it.
Can you work with existing infrastructure or only build from scratch?
I can do both! Whether you need a pipeline built from scratch or improvements to an existing setup, I’ll tailor the solution accordingly.
Which AWS services do you use for ETL pipelines?
I commonly use AWS Glue, Lambda, S3, Redshift, Step Functions, and CloudWatch. The stack depends on your specific requirements.
