I will build and optimize etl pipelines using azure data factory and databricks

Carlos R

Portugal

I speak English, Portuguese
Developed ADF pipelines to streamline data processing. Transformed data using Databricks/Snowflake with SQL & Python. Ensured Power BI data integrity and performed thorough data cleaning. Automated ta...
Read More
About this Gig

Description:

I will design and implement a basic ETL pipeline to extract, transform, and load data using Azure Data Factory or Databricks. This includes connecting to one data source, performing simple transformations, and loading the data into a target destination (e.g., SQL database, CSV, or Snowflake).

Whats Included:

  • Setup of one ETL pipeline
  • Source-to-target mapping
  • Basic data transformation (filtering, column renaming, etc.)
  • Load to one destination
  • Documentation of the process


I'm assuming that you already have an Azure/Databricks infrastructure in place.

Read More
build and optimize etl pipelines using azure data factory and databricks
Full Screen
build and optimize etl pipelines using azure data factory and databricks

Langugae:

English

•

Portuguese

Technical expertise:

Databricks

•

Snowflake

+3 more

Expertise:

Data Pipelines

•

ETL Development

•

Data Warehousing

+1 more

Industry:

Other

Related tags