Senior Spark & Scala Engineer - Data Pipelines
LTM
LTM in Mississauga, Ontario is seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver robust data processing applications.Responsibilities include leading development of big data solutions, optimizing Spark jobs for production,
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 58 minutes ago
Similar jobs that could be interesting for youBased on the Senior Spark & Scala Engineer - Data Pipelines in Winnipeg, MB vacancy
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation... .... You will design scalable pipelines and tooling, collaborating with... ..., Python production code, Spark or Flink, and SQL. The role offers...Pipeline- Join LTIMindtree as a Big Data Specialist, focusing on Hadoop, Spark, and Scala. Utilize your expertise in data application development to create scalable solutions... ...Hadoop and Spark, will help shape efficient data pipelines. Collaborating with cross-functional teams, you will...Pipeline
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval... ...develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence...PipelineWork at office
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...PipelineRemote work
- ...Tata Consultancy Services Canada Inc. is seeking a Big Data Engineer to design and maintain robust data pipelines using Apache Spark, Scala, and Java for enterprise analytics. You will ingest, transform, and optimize large datasets, focusing on performance and cost efficiency...Pipeline
- ...Samsara Inc. in Canada is seeking a Data Engineer to join our Data team. You will design and maintain data pipelines using SparkSQL and PySpark in our central data lake, transforming data from IoT devices into our core data model for analytics and dashboards. This remote role...PipelineRemote workFlexible hours
- Wipro Limited in Mississauga, Canada is seeking an experienced data engineer to design and implement large-scale data pipelines using Python, PySpark and SQL. You will work with Spark, Hive and Hadoop in a Big Data ecosystem to optimize data quality, profiling and ETL/ELT processes...PipelineSenior
- Use Python, Spark, and Airflow to create scalable pipelines for Robinhood’s data lake. Work in Toronto on foundational financial datasets.This Senior Data Engineer role focuses on reliable data infrastructure supporting Robinhood’s metrics and products. You will develop application...PipelineSenior
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a... ...on role focuses on enterprise-grade pipelines and large-scale datasets.The Databricks... ...expertise to enterprise data engineering for a financial client. #J-18808-...PipelineContract work
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...PipelineSenior
- ...Architect to build and optimize ETL pipelines on AWS or Azure. The ideal... ...have strong expertise in Databricks, Spark, SQL, and Python. Responsibilities... ...implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance...Pipeline
- ...Developer to build and support large-scale data processing solutions. The ideal... ...have strong hands-on expertise in Hadoop, Spark, and Scala, as well as domain knowledge in Liquidity... ...Hadoop-based solutions, developing data pipelines, and collaborating with cross-functional...Pipeline
- Sensor Tower is seeking a Senior Data Engineer to build and own end-to-end data products. You will work with a global team of engineers and collaborate with product managers and data scientists to deliver impactful data solutions. You will develop PySpark-based data programs...Senior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...PipelineSenior
- Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic...PipelineSenior
- Build AWS data pipelines as a Senior Data Developer Engineer at Intact, using Python or Java, SQL, and production-grade engineering practices.You will help establish Contact Distributor, Intact’s platform for trusted broker and distributor master data. As a senior data engineer...PipelineSenior
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...PipelineSenior
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and automate CI/CD pipelines, optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your...PipelineRemote work
- Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba... ...locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own... ...experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing...PipelineFull time
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...PipelineSeniorRemote work
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...PipelineSenior
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...PipelineSeniorFull time
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...PipelineSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...PipelineSenior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...PipelineSeniorFull time
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipelineSenior
- Build enterprise data pipelines with advanced SQL and Python at Air Canada Vacations, working from Montréal or Mississauga in a hybrid model.... ...environmentsAdvanced SQL and Python PySpark knowledgeExperience with Delta Lake, Spark, and ParquetApply advanced SQL, Python, and pipeline expertise...PipelineSeniorPermanent employmentFull time
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...PipelineSenior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...PipelineSenior
- Concevez des plateformes Java et Scala pour améliorer le cycle logiciel chez Morgan Stanley, en mode hybride à Montréal, Québec. Travaillez sur des systèmes distribués et l’automatisation.Ce poste d’ingénierie logicielle principal, de niveau directeur, soutient l’équipe Optimus...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Spark & Scala Engineer - Data Pipelines. Be the first to apply!
Related searches
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB
- senior marketing Winnipeg, MB
- senior manager investigations Winnipeg, MB

