Browse categories
Explore
Fiverr Pro
English
$
USD
I will data engineering and big data
Data Engineer
Computer Systems Engineer with experience in data engineering and analytics. I design ETL/ELT pipelines using Python, Pandas, and SQL; perform distributed processing with PySpark; and work with Google...
About this Gig
I will build a custom ETL/ELT data pipeline using Python and SQL to extract, transform, validate, and load your data into databases or cloud data warehouses such as BigQuery. The pipeline will include basic data quality checks, unit tests, and clear documentation.
Tools & Platforms:
Google Cloud Dataflow
FAQ
What information do you need to start the project?
I need access to the data source or a sample dataset, the desired destination, and a brief description of the expected transformations or business requirements. Please do not share sensitive credentials directly in the Fiverr chat.
What data sources and destinations do you support?
I can work with databases and cloud services such as PostgreSQL, MySQL, BigQuery, and Google Cloud Storage. I can also work with structured files such as CSV and JSON.
Do you provide ETL and ELT pipelines?
Yes. I can design either ETL or ELT workflows depending on your data architecture, requirements, and target platform.
Does the pipeline include data quality checks?
Yes. The Basic package includes basic validation such as null-value checks, duplicate detection, data type validation, and basic schema or value validation.
Will the pipeline include tests and documentation?
Yes. The pipeline includes basic unit tests and documentation explaining the setup, dependencies, configuration, and execution process.
Can you connect the pipeline to my existing database or cloud environment?
Yes, provided that the required access and connection information are available. The exact implementation depends on the source, destination, and project requirements.
