I will develop etl pipeline using azure data factory and databricks

5.0
5.0

India

I speak Hindi, English

40 orders completed

Certified Azure Data Engineer Associate

Hi, my name is Sunil. I am certified azure data engineer and have been working as an Azure Data Engineer for the last 8 years and have hands-on developing highly complex ETL pipelines. Skills: Azure...

Level 1

Has met certain performance criteria and shows strong potential in the marketplace.

About this Gig

Professional Azure Data Engineer with 1 year of experience and hands-on developing highly complex ETL pipelines.

  • Data Ingestion, Transformation, and Orchestration of pipelines.
  • Experienced in migration of data from legacy systems (On-premise) to Azure Data Lake, performing some transformations on data using DataBricks (Python or Apache Spark), moving them to Azure SQL Database (SSMS), and writing SQL Stored Procedures that can transform the data and perform some calculations on it based on some business logic.
  • I am also skilled in developing and maintaining delta live table architectures using Databricks and leveraging ADLS to store the underlying data.
  • ETL will be done using Azure Data Factory.
  • Customized dashboard to visualize the data using PowerBI.


Expertise:

API integration

Data extraction

Data manipulation

ETL

Technology:

Apache Kafka

Apache Spark

Azure data factory

Python

Reviews

7 reviews for this Gig
5.0

(7)
(0)
(0)
(0)
(0)
Rating Breakdown
  • Seller communication level
    5
  • Recommend to a friend
    5
  • Service as described
    5
Sort By
Most relevant
  • C

    chipper144

    NZ

    New Zealand

    5

    Good communication, availability and ADF knowledge. We worked together in a live session to create a viable solution to handling conflicts in competing pipelines.

    Up to $50

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • V

    vihariwork

    US

    United States

    5

    Great work

    Up to $50

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • B

    brianfreeman732

    Repeat Client

    US

    United States

    5

    thank you for your help

    $50-$100

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • L
    image-docs

    leizhang22

    Repeat Client

    US

    United States

    5

    Got exactly what I needed, he listens well and don't mind my interrupting him and is very helpful

    Helpful?
    Yes
    No
  • B

    brianfreeman732

    Repeat Client

    US

    United States

    5

    awesome. Very good speaker

    Helpful?
    Yes
    No
Reviews

7 reviews for this Gig
5.0

(7)
(0)
(0)
(0)
(0)
Rating Breakdown
  • Seller communication level
    5
  • Recommend to a friend
    5
  • Service as described
    5
Sort By
Most relevant
  • C

    chipper144

    NZ

    New Zealand

    5

    Good communication, availability and ADF knowledge. We worked together in a live session to create a viable solution to handling conflicts in competing pipelines.

    Up to $50

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • V

    vihariwork

    US

    United States

    5

    Great work

    Up to $50

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • B

    brianfreeman732

    Repeat Client

    US

    United States

    5

    thank you for your help

    $50-$100

    Price

    1 day

    Duration

    Helpful?
    Yes
    No
  • L
    image-docs

    leizhang22

    Repeat Client

    US

    United States

    5

    Got exactly what I needed, he listens well and don't mind my interrupting him and is very helpful

    Helpful?
    Yes
    No
  • B

    brianfreeman732

    Repeat Client

    US

    United States

    5

    awesome. Very good speaker

    Helpful?
    Yes
    No

Related tags