7 meilleures offres (junior developer with python, pyspark and sql, toronto, on) (à pourvoir)

Technology Lead - Spark Scala Developer
Infosys —Mississauga, ON
- De 92 740 $ à 123 375 $ par an
- SQL
- AWS
- Baccalauréat
Postuler rapidement
Director - Market Risk Technology
Royal Bank of Canada —Toronto, ON
- Temps plein
- Azure
- Doctorat
- Informatique
Palantir Sr Data Engineer
Recutify Inc. —Toronto, ON
- Temps plein
- Travail hybride
- SQL
- APIs
Postuler rapidement
Lead AI Engineer
Royal Bank of Canada —Toronto, ON
- Temps plein
- Informatique
- Ingénierie
- Conception de systèmes
il y a 8 jours
Lead Data Engineer, (Global Security)
Royal Bank of Canada —Toronto, ON
- Temps plein
- Azure
- DevOps
- SQL
il y a 8 jours
Infrastructure DevOps Lead Analyst – Vice President
Citi —Mississauga, ON
- De 120 800 $ à 170 800 $ par an
- Temps plein
- Travail hybride
- DevOps
- Maîtrise
- Bases de données
Senior Manager, Engineering & Build
Royal Bank of Canada —Toronto, ON
- Temps plein
- Java
- SQL
- AWS

More jobs to discover

Find similar jobs that you might be interested in.

Executive Director
MasterAire —Richmond Hill, ON
Bachelor's degree in mechanical engineering or electrical engineering (required). Drive research and development initiatives to improve existing products and…
De 60 000 $ à 120 000 $ par an
Postuler rapidement
10 h
Director - Market Risk Technology
Royal Bank of Canada —Toronto, ON
Bachelor's degree in computer science, Engineering, or a related field; Master's or PhD preferred. Excellent communication skills—able to clearly explain…

Show more similar jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Technology Lead - Spark Scala Developer
Infosys —Mississauga, ON
Infosys is seeking an experienced Spark Scala Developer to design, develop, and optimize scalable bigdata solutions. Proficiency in SQL and data modeling.
De 92 740 $ à 123 375 $ par an
Postuler rapidement
Director - Market Risk Technology
Royal Bank of Canada —Toronto, ON
Bachelor's degree in computer science, Engineering, or a related field; Master's or PhD preferred. Excellent communication skills—able to clearly explain…

Show more jobs in cities nearby

Je souhaite recevoir la dernière alerte emploi pour les postes de ce type : junior developer with python, pyspark and sql (toronto, on)

En vous connectant à votre compte, vous acceptez les conditions d'utilisation, la politique relative aux fichiers témoins et la politique de confidentialité de Workopolis.

Technology Lead - Spark Scala Developer

Infosys
Mississauga, ON

Postuler rapidement

Détails du poste

Compétences

Modélisation de données
HDFS
Big data
Spark
NoSQL
Google Cloud Platform
Apache Hive
MongoDB
SQL
AWS
Baccalauréat
HBase
Apprentissage automatique
Systèmes distribués
Scala
Scrum
APIs
Agile
Technologies de l'information
JSON
Kafka
Exigences d'affaires
Compétences en communication
Entrepôt de données
Analytique
SDLC
Hadoop

Description complète du poste

Infosys is seeking an experienced Spark Scala Developer to design, develop, and optimize scalable bigdata solutions. The candidate will work on building high-performance batch and real-time data pipelines leveraging the Hadoop ecosystem and distributed computing frameworks(Spark). The role involves working closely with data engineers, architects, and business stakeholders to deliver robust, scalable, and efficient data processing systems.

Required Qualifications:

Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.
Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 4 years of Information Technology experience
4+ years of experience in Big Data technologies.
Strong expertise in:
- Apache Spark (Core, SQL, DataFrames, RDDs)
- Scala programming
- PySpark
Hands-on experience with:
- Kafka (real-time streaming)
- Hadoop ecosystem (HDFS, Hive, Impala)
- NoSQL Databases (HBase, MongoDB, Couchbase)
Strong understanding of distributed computing concepts and data processing frameworks.
Experience in building ETL/data pipelines for large-scale datasets.
Proficiency in SQL and data modeling.

Preferred Qualifications:

Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture.
Strong understanding and practical exposure to Agile software development methodologies (Scrum) and SDLC practices.
Proven experience in Banking domain, supporting use cases such as fraud detection, risk analytics, regulatory reporting, and customer insights.
Excellent analytical, problem-solving, and communication skills, with the ability to translate business requirements into scalable technical solutions.
Demonstrated ability to work effectively in cross-functional, multi-stakeholder environments, collaborating with Business, Data Engineering, and Architecture teams.
Experience with real-time data streaming frameworks such as Kafka and Spark Streaming for low-latency processing.
Understanding data modeling concepts (dimensional modeling, snowflake schemas) to support analytics workloads.
Experience and desire to work in a global delivery environment.

Key Responsibilities:

Design and develop large-scale data processing pipelines using Apache Spark (Scala & PySpark)
Build and optimize batch and real-time data processing workflows using Spark, Kafka, and Hadoop ecosystem
Develop Spark applications using RDDs, DataFrames, and Spark SQL for complex transformations
Develop and optimize PySpark applications leveraging joins, Spark DAG execution flow, stage optimization, transformation techniques, and streaming with dynamic allocation and failover handling.
Implement streaming pipelines using Kafka and Spark Streaming / Structured Streaming
Develop and maintain HDFS, Hive, NoSql and Impala-based data lake solutions
Convert existing SQL/Hive workloads into optimized Spark jobs for improved performance
Work with ETL pipelines to ingest, cleanse, transform, and process large datasets
Optimize performance through partitioning, caching, serialization, and tuning techniques
Handle data formats such as Parquet, ORC, Avro, JSON
Integrate multiple data sources including streaming systems, flat files RDBMS, and APIs
Collaborate with cross-functional teams to understand business requirements and translate them into scalable technical solutions
Ensure data quality, reliability, and performance monitoring across pipelines
Participate in code reviews, design discussions, and best practices implementation

Key Skills:

Distributed Data Processing.
Spark Optimization & Performance Tuning.
Real-time Data Streaming.
Data Modeling & ETL Design.
Problem-solving and Analytical Thinking.
Strong Communication & Stakeholder Management.

Nice to Have:

Exposure to Machine Learning pipelines or MLOps workflows.
Experience with Databricks platform.
Experience with AWS/GCP.

Summary:
This role requires a highly skilled Spark Scala Developer with strong expertise in big data engineering, streaming systems, and distributed computation, capable of building scalable, high-performance data platforms supporting enterprise analytics.

Estimated annual compensation range for the candidate based in the below location will be:
Ontario: $ 92740 to $ 123375

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements

Postuler rapidement

Affinez votre recherche

junior developer with python, pyspark and sql emplois - toronto, on

Technology Lead - Spark Scala Developer

Director - Market Risk Technology

Palantir Sr Data Engineer

Lead AI Engineer

Lead Data Engineer, (Global Security)

Infrastructure DevOps Lead Analyst – Vice President

Senior Manager, Engineering & Build

More jobs to discover

Explore jobs in cities nearby

Je souhaite recevoir la dernière alerte emploi pour les postes de ce type : junior developer with python, pyspark and sql (toronto, on)

Related Searches

Outils pour les chercheurs d'emploi

Outils Employeurs

Parcourir

Garder le contact