I will extract the data and create dashboard
Senior Data Engineer
About this Gig
· Data Engineer over 14 years of work experience in sustainable data warehouse and ETL practices.
· Highly skilled in Azure Data Factory, Azure Databricks, python, Azure DevOps, Azure CI/CD, Informatica power centre, DataStage, Oracle, SQL, Teradata, UNIX scripting, Data Vault, working with Jira.
· Extensive experience strategizing, designing, and managing multiple Enterprise Data Warehouse projects in roles such as ETL Developer, Data Analyst, Solution Architect, Project Lead, and Data Engineer.
· Proficient in using Azure DevOps for managing Git repositories, version control and implementing CI/CD pipelines to enable automated deployments and testing workflows.
· Hands-on experience with Infrastructure as Code (IaC) using Bicep to provision and manage Azure resources efficiently.
· Strong background in building complex data pipelines, optimizing data processing workloads and ensuring data quality with software engineering best practices.
· Designed and implemented end-to-end data transformation and modelling pipelines using dbt, with integration into CI/CD workflows.
· Experience with unit and integration testing and implem
