2 meilleures offres (stack develope, columbus) (à pourvoir)

25-199 - Data Engineer - Azure Databricks - 11 month contract - Oshawa - Hybrid remote
CorGTA —Oshawa, ON
- De 72 $ à 90 $ de l’heure
- Contrat
- Travail hybride
- Informatique
- Azure
- Informatique
Senior AWS Lambda (Java) Developer
Play Hockey —Canada
- À partir de 80 000 $ par an
- Temps plein
- Télétravail
- Informatique
- DevOps
- Java
- Assurance Invalidité
- Assurance Dentaire
Postuler rapidement

More jobs to discover

Find similar jobs that you might be interested in.

Senior Software Developer (Data & Backend Development)
Autodesk —Toronto, ON
Identifier les goulots d'étranglement en termes de performances et améliorer le code et les bases de données. Développer des pipelines de données pour extraire,…
De 107 000 $ à 157 300 $ par an

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Real Estate Agent
Michael St. Jean Realty —St. Catharines, ON
Must have and maintain a valid driver's license. The only thing you're responsible for is maintaining your real estate license.*.
À partir de 100 000 $ par an
Postuler rapidement
Principal AI Engineer
Tangerine Bank —Toronto, ON
Proven experience in automated testing and the ability to develop test strategies and design automation frameworks, including evaluation and red-teaming for AI…

Show more jobs in cities nearby

Je souhaite recevoir la dernière alerte emploi pour les postes de ce type : stack develope (columbus)

En vous connectant à votre compte, vous acceptez les conditions d'utilisation, la politique relative aux fichiers témoins et la politique de confidentialité de Workopolis.

25-199 - Data Engineer - Azure Databricks - 11 month contract - Oshawa - Hybrid remote

CorGTA
Oshawa, ON

Postuler dès maintenant

Détails du poste

Contrat | Contrat à durée déterminée

Compétences

Informatique
Power BI
Azure
Informatique
XML
Kanban
DevOps
Ingénierie
Structure de données
Spark
SQL
Apprentissage automatique
Gestion des mises en production
REST
APIs
JSON
Métadonnée
Compétences en communication
Python
Analytique

Description complète du poste

Position: Data Engineer - Azure Databricks
Location: Oshawa, ON (Hybrid - 3 days remote)
Structure: Contract 12 months
Pay: $72.00 - $90.00 p/h inc.

We have a great new opportunity to support one of our Energy Sector clients in a contract capacity!

Please see below for more information on the position and if interested, apply with an updated resume aligned to the needs of the role.

Job Overview

As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.
Will be working as part of a cross-discipline agile team who help each other solve problems across all business areas.
Will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.
Will employ best practice in development, security, and accessibility and design to achieve the highest quality of service for our customers.
Build and productionize modular and scalable data ELT/ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization.
Build curated common data models designed by the Data Modelers that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect.
Work closely with infrastructure, and cyber teams and Senior Data Developers to ensure data is secure in transit and at rest.
Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle.
Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods.
Troubleshoot issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity.
Collaborate with Business Analysts, data scientists, Senior Data Engineers, data Data Analysts and, solution Architects and Data Modelers to develop data pipelines to feed our data marketplace.
Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.
Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets.
Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use.
Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats.
Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base.
Implement orchestration of data pipeline execution designed by Senior Data Engineers to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use.
Create tooling in collaboration with senior data engineers and data architects to help with day to day tasks, and reduce toil via automation wherever possible.
Work with Continuous Integration/Continuous Delivery and DevOps pipelines to assist in automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning.
Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis.
Implement and manage appropriate access to data products via role-based access control based on guidance from senior data engineers.
Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases based on guidance from Data Architects.
Participate in peer code review sessions.

Qualifications

Completion of a four-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.
Experience as a Data Engineer designing and building data pipelines.
Fluent in creating data processing frameworks using Python, PySpark, SparkSOL and SOLExperience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
Experience building data pipelines for Data Lakehouses and Data Warehouses
Good understanding of data structures and data processing frameworks
Knowledge of data governance and data quality principles
Effective communication skills to translate technical details to non-technical stakeholders

-
CorGTA is an equal opportunity employer, please apply with an updated resume and ensure the required skills you are able to speak to for this position are included.

At times, CorGTA or its client partners may utilize AI tools to assist with the hiring processes.

For more roles like this please go to www.corgta.com/find-a-job/

Postuler dès maintenant

Affinez votre recherche

stack develope emplois - columbus

25-199 - Data Engineer - Azure Databricks - 11 month contract - Oshawa - Hybrid remote

Senior AWS Lambda (Java) Developer

More jobs to discover

Explore jobs in cities nearby

Je souhaite recevoir la dernière alerte emploi pour les postes de ce type : stack develope (columbus)

Related Searches

Outils pour les chercheurs d'emploi

Outils Employeurs

Parcourir

Garder le contact