I will build bigquery data pipelines with airflow on google cloud

Pakistan

I speak English, Urdu

3 orders completed

Data Engineer for BigQuery, Airflow and AI agent tooling

I’m a data engineer who builds production pipelines on Google Cloud. I run 12 Airflow DAGs on Cloud Composer that ingest daily data from 9+ marketing and CRM platforms into BigQuery, and I build BigQu...
About this Gig

Need reliable, automated data pipelines on Google Cloud? I design and deploy production-grade ETL/ELT pipelines that load your data into BigQuery on a schedule, without manual work.


What you get:

  • Apache Airflow DAGs on Cloud Composer
  • Python Cloud Functions (Gen2) for API extraction
  • Strict BigQuery schema enforcement and data validation
  • Credentials secured in Secret Manager
  • Retry handling and clear error logging
  • Optional CI/CD that deploys only changed DAGs
  • Documentation so your team can own it


Why me: I currently run production Airflow with 12 DAGs ingesting from 9+ platforms using one reusable pipeline pattern, so you get a proven structure, not an experiment.

Send me your data sources and destination before ordering and I will confirm scope and fit.

Destination Platform:

Google BigQuery

Tools & Platforms:

Google Cloud Dataflow