I will extract the data and create dashboard

India

I speak English, Dutch

Senior Data Engineer

I am a Data Engineer with over 14 years of experience in sustainable data warehouse and ETL practices. I am highly skilled in Azure Data Factory, Azure Databricks, python, Azure DevOps, and Informatic...
About this Gig

·        Data Engineer over 14 years of work experience in sustainable data warehouse and ETL practices.

·        Highly skilled in Azure Data Factory, Azure Databricks, python, Azure DevOps, Azure CI/CD, Informatica power centre, DataStage, Oracle, SQL, Teradata, UNIX scripting, Data Vault, working with Jira.

·        Extensive experience strategizing, designing, and managing multiple Enterprise Data Warehouse projects in roles such as ETL Developer, Data Analyst, Solution Architect, Project Lead, and Data Engineer.

·        Proficient in using Azure DevOps for managing Git repositories, version control and implementing CI/CD pipelines to enable automated deployments and testing workflows.

·        Hands-on experience with Infrastructure as Code (IaC) using Bicep to provision and manage Azure resources efficiently.

·        Strong background in building complex data pipelines, optimizing data processing workloads and ensuring data quality with software engineering best practices.

·        Designed and implemented end-to-end data transformation and modelling pipelines using dbt, with integration into CI/CD workflows.

·        Experience with unit and integration testing and implem

Destination Platform:

Snowflake

Databricks Lakehouse

Tools & Platforms:

IBM DataStage

Microsoft SSIS