Lead Data Engineer – Azure Data Platform
Location: Vaughan, ON (Hybrid)
Job Summary
We are seeking a highly experienced Lead Data Engineer to lead the design, development, and implementation of scalable, cloud-native data solutions on Microsoft Azure.
The ideal candidate will possess deep expertise in Azure Data Engineering services, modern data architecture, analytics platforms, and enterprise data warehousing solutions.
This role requires strong hands-on technical capabilities, leadership experience, and the ability to collaborate with business stakeholders, architects, and engineering teams to deliver high-quality data platforms supporting analytics, reporting, and operational workloads.
Key Responsibilities
Lead the design and implementation of enterprise-scale data platforms leveraging Microsoft Azure services.
Architect and develop scalable data solutions using Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage Gen2, Azure SQL Database, Azure Databricks, and related Azure services.
Design and develop robust ETL/ELT pipelines for batch and real-time data processing.
Build and maintain enterprise data warehouses, data lakes, and analytical data platforms.
Collaborate with business stakeholders to gather data, reporting, and integration requirements.
Define and implement data architecture standards, governance controls, security, and best practices.
Lead data modernization initiatives, including migration of legacy on-premises data platforms to Azure
Integrate data from ERP systems, operational applications, IoT platforms, APIs, and third-party data sources.
Optimize data pipelines, storage, and query performance to support large-scale analytics workloads.
Ensure platform reliability, scalability, security, and operational excellence.
Mentor and guide Data Engineers through architecture reviews, code reviews, and technical best practices.
Work closely with Cloud, DevOps, Infrastructure, Security, and Analytics teams to deliver end-to-end solutions.
Participate in solution architecture reviews, governance processes, and technical leadership forums.
Required Skills
10+ years of experience as a Data Engineer with strong expertise in Microsoft Azure Data Platform
Hands-on experience with Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Azure SQL, Databricks
Strong experience in Data Engineering, Data Warehousing, ETL / ELT development
Strong programming skills in SQL, Python, Spark, or PySpark
Experience with cloud architecture and distributed data processing pipelines
Experience leading or mentoring data engineering teams
Experience working with large-scale enterprise data platforms
Experience with Power BI, Fabric Analytics, or other data visualization tools
Experience with CI/CD, DevOps, Terraform, or Infrastructure as Code
Experience working with real-time / streaming / IoT data pipelines
Experience with Databricks, Spark, Delta Lake, or Lakehouse architecture
