I will write, optimize and debug pyspark and databricks etl pipelines

Spain

I speak English, Spanish

Data Engineer

I am a passionate computer engineer and Big Data developer specializing in Back-End development and data processing with Spark and Cloud technologies. I have extensive experience designing scalable ET...
About this Gig

Are you facing slow queries in BigQuery, broken dbt models, or unoptimized Spark jobs? 


I am a Senior Data Engineer (Databricks Associate Certified) with 5+ years of experience building and optimizing scalable cloud data architectures (GCP, Databricks, BigQuery). I specialize in turning complex, slow, and expensive data pipelines into fast, efficient, and cost-effective workflows.


What I can do for you:

- dbt & Data Warehousing: Build and refactor dbt models following Medallion Architecture (Bronze, Silver, Gold), optimize SQL queries, and set up Cloud Run / Control-M / Airflow executions.

- PySpark & Databricks: Debug, refactor, and speed up batch ETL pipelines with Spark (Scala/Python).

- GCP Cloud Architecture: Set up scalable pipelines with BigQuery, Cloud Run, and Airflow/Composer.

- Database & Query Optimization: Reduce BigQuery/Snowflake processing costs and execution times.


Why work with me?

- Certified Expertise: Databricks Certified Data Engineer & Azure Certified.

- High-Quality Code: Clean, modular, and maintainable data engineering practices.

- Clear & Direct Communication: English and Spanish available.


NOTE: Contact me with your requirements before placing

Destination Platform:

Google BigQuery

•

Azure Synapse Analytics

Tools & Platforms:

Google Cloud Dataflow

•

Apache NiFi

•

Other

Related tags