Must haves: Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.
Skills
Experience and Skill Set Requirements
- Participate in review of project artefacts including use cases and system requirement
- Design and deliver system design documents aligned to Ministry standards
- Design, develop and optimize data and database CI CD pipelines
- Develop Azure CI CD release pipelines for DACPAC promotion
- Promote database changes across development, QA, UAT and production environments
- Design and implement data loading, conversion and migration solutions
- Perform large-scale data transformation across OLTP and OLAP environments
- Design and implement data warehouse, data lake and data lakehouse architectures
- Develop fact and dimension models and data mapping solutions
- Provision and manage data in cloud environments
- Administer and tune performance of Oracle, Azure SQL and Synapse databases
- Support data replication across heterogeneous cloud and enterprise systems
- Develop and optimize PL SQL programs and SQL Server stored procedures
- Monitor incidents, troubleshoot issues and provide resolution
- Develop database automation, backup and recovery scripts
- Perform database administration including patching, upgrades, monitoring and capacity planning
25%
Data Warehouse
ETL tools (such as Azure Data Factory, AWS Glue) as well as cloud agnostic tools such as Informatica IDMC.
Data modeling & architecture: relational and dimensional modeling.
Data reporting/visualization.
25%
Description / Responsibilities / Skills
Responsibilities:
Design, develop, test, implement, and troubleshoot:
data pipelines using various tools such as Databricks, Azure Data Factory, AWS Glue
complex data transformation procedures
data models for data warehouses and lakehouses
Pay: $150,000.00-$160,000.00 per year
Experience:
- Data Lakehouse: 8 years (required)
- Azure: 10 years (required)
- DAPAC: 8 years (required)
Work Location: Hybrid remote in Toronto, ON M2M 4J3