Senior Spark & Scala Engineer - Data Pipelines
LTM
LTM in Mississauga, Ontario is seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver robust data processing applications.Responsibilities include leading development of big data solutions, optimizing Spark jobs for production,
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Senior Spark & Scala Engineer - Data Pipelines in Winnipeg, MB vacancy
- Build Apache Spark data processing applications with Scala and Java in this senior developer role focused on data engineering skills.This Senior Spark Scala Developer position requires six to eight years of experience. You will develop Spark applications, write maintainable...Senior
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation... .... You will design scalable pipelines and tooling, collaborating with... ..., Python production code, Spark or Flink, and SQL. The role offers...Pipeline- ...Tata Consultancy Services Canada Inc. is seeking a Big Data Engineer to design and maintain robust data pipelines using Apache Spark, Scala, and Java for enterprise analytics. You will ingest, transform, and optimize large datasets, focusing on performance and cost efficiency...Pipeline
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...PipelineRemote work
- ...Samsara Inc. in Canada is seeking a Data Engineer to join our Data team. You will design and maintain data pipelines using SparkSQL and PySpark in our central data lake, transforming data from IoT devices into our core data model for analytics and dashboards. This remote role...PipelineRemote workFlexible hours
- Spark Scala Developer – Apache Spark, Scala, Hadoop & Data EngineeringExperience Required: 6–8 YearsRequired Skill Sets Skilled Spark Scala Developer with experience developing data processing applications using Apache Spark and Scala Design and develop Spark applications...Senior
- ...Developer to build and support large-scale data processing solutions. The ideal... ...have strong hands-on expertise in Hadoop, Spark, and Scala, as well as domain knowledge in Liquidity... ...Hadoop-based solutions, developing data pipelines, and collaborating with cross-functional...Pipeline
- Wipro Limited in Mississauga, Canada is seeking an experienced data engineer to design and implement large-scale data pipelines using Python, PySpark and SQL. You will work with Spark, Hive and Hadoop in a Big Data ecosystem to optimize data quality, profiling and ETL/ELT processes...PipelineSenior
- Sensor Tower is seeking a Senior Data Engineer to build and own end-to-end data products. You will work with a global team of engineers and collaborate with product managers and data scientists to deliver impactful data solutions. You will develop PySpark-based data programs...Senior
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a... ...on role focuses on enterprise-grade pipelines and large-scale datasets.The Databricks... ...expertise to enterprise data engineering for a financial client. #J-18808-...PipelineContract work
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...PipelineSenior
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...PipelineContract work
- ...Architect to build and optimize ETL pipelines on AWS or Azure. The ideal... ...have strong expertise in Databricks, Spark, SQL, and Python. Responsibilities... ...implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance...Pipeline
- ...Overview We are seeking an experienced Data Engineer with strong expertise in Big Data... ...hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and... ...Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache...PipelineWork at office3 days per week
- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...PipelineSenior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...PipelineSenior
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...PipelineSenior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...PipelineSeniorWork at office
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...PipelineSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...PipelineSenior
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and automate CI/CD pipelines, optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your...PipelineRemote work
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...PipelineSenior
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...PipelineSeniorFull time
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...PipelineSeniorRemote work
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipelineSenior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...PipelineSeniorFull time
- A leading engineering consultancy in Canada is looking for a Senior Software Engineer specialized in Java and Spark. In this role, you will work on a large social media platform processing petabytes of data. The position involves optimizing data systems, designing solutions,...Senior
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline. Sitting at the intersection of data engineering, data curation, and machine learning, you will own the end-to-end pipeline that...PipelineSeniorInternship
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...PipelineRemote work
- Concevez des plateformes Java et Scala pour améliorer le cycle logiciel chez Morgan Stanley, en mode hybride à Montréal, Québec. Travaillez sur des systèmes distribués et l’automatisation.Ce poste d’ingénierie logicielle principal, de niveau directeur, soutient l’équipe Optimus...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Spark & Scala Engineer - Data Pipelines. Be the first to apply!
Related searches
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB
- senior marketing Winnipeg, MB
- senior manager investigations Winnipeg, MB

