Specialist - Data Engineering
LTM
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Vacancy posted 52 minutes ago
Similar jobs that could be interesting for youBased on the Specialist - Data Engineering in Winnipeg, MB vacancy
- ...Café offers free Tea and Coffee. Role Summary The ERP Data Specialist is the bridge between manufacturing operations and the ERP system... ...through cross-functional collaboration with Manufacturing, Engineering, Supply Chain, Finance, Quality, Operations, and IT. Key...DataWork at office
$84k - $115k per year
...Job Description As a Data Engineering Specialist reporting to the Senior Director of Data Engineering, you'll play a critical role in designing, building, and scaling the data infrastructure that powers one of the world's largest data marketplaces — serving hundreds of...DataLong term contractTemporary work$118k - $145k per year
...alongside people who think big and act bold - project managers, engineers, technologists, and strategists who blend real-world experience with... ...& Capital ProjectsAbout the Role We are seeking a Data Engineer to support large-scale capital infrastructure programs,...DataFull timeFor contractorsInternshipWork at officeLocal area$17 per hour
...function role, you will be the operational engine behind daily donor engagement and database... ...speed and accuracy in high-volume data entry. Excellent command of spoken and... ...recruitment team! Customer Support and Data Entry Specialist - Winnipeg Contact / Applications: or...DataWeekly payLong term contractPermanent employmentFull timeContract workWork at officeImmediate startMonday to friday- Seize the opportunity at Circle as a Data Engineering Specialist focused on blockchain technology. This remote role emphasizes creating and optimizing ETL/ELT pipelines for advanced data analysis. As a Data Engineering Blockchain member, you’ll manage the data warehouses...DataRemote work
- Engineer analytics data solutions at CGIC using SQL, Python, and Azure technologies in a hybrid model with two office days weekly.As a Senior Data Integration Specialist, you will autonomously build and maintain back-end data solutions throughout the software development lifecycle...DataWork at office
- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...DataLong term contractPermanent employmentFull timeContract workWork at office
- Build enterprise data solutions with SQL and Python as a Senior Data Integration Specialist at CGIC, working hybrid with two office days weekly.Within Business Intelligence, you will engineer backend solutions across source ingestion, ETL, and data stores through the software...DataWork at office
- Engineer AWS data solutions using Python, PySpark, Terraform, and SQL at Tata Consultancy Services. Work hands-on across cloud services, infrastructure... ..., APIs, and data pipelines.This AWS Data Engineering Specialist role centers on practical platform engineering and...Data
- Build scalable cloud and on-premises data infrastructure with Python, Spark, and Databricks... ...& Operations, this Data Transformation Specialist supports Manitoba Public Insurance’s... ...disciplineFive years in data management, engineering, and analyticsThree years in architecture...Data
- Build scalable data infrastructure at Nasdaq using Python, cloud platforms, and distributed pipelines. Support a global data marketplace... ...serving hundreds of thousands of professionals.As a Data Engineering Specialist, reporting to the Senior Director of Data Engineering, you...Data
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...DataPermanent employment- ...convenient Price Café offers free Tea and Coffee. Manufacturing Engineering Specialist - Finishing The successful candidate's responsibilities... ...analytical and problem-solving abilities, with a focus on data-driven decisions. • Strong technical and mechanical aptitude...DataFor contractorsWork at officeRelocation
- Elevate data governance at scale as a Senior Data Governance Engineer focusing on Azure technologies. Your expertise will enhance data quality, pipeline automation, and governance frameworks in a collaborative setting. This role is geared towards engineers passionate about...Data
- Join Tecsys as a Data Engineer focused on cloud and DevOps in a hybrid setup. Bring your expertise in Databricks and AWS to enhance analytics capabilities across healthcare systems. As part of the TecsysIQ Data & AI team, you will manage infrastructure-as-code while collaborating...Data
- Build enterprise data solutions at Central 1 with Azure, SQL, PySpark, dbt, Spark Notebooks, and Microsoft Fabric technologies across Canada.Central 1 is seeking a highly experienced Senior Data Engineer specializing in Microsoft Fabric and Azure data engineering. You will translate...Data
- Build modern financial data solutions at Central 1 with Microsoft Fabric, PySpark, dbt, dimensional modeling, and enterprise data engineering expertise.Central 1 is seeking a Senior Data Engineer and Microsoft Fabric Subject Matter Expert for enterprise-scale platform delivery...Data
- ...Mariner, we're continuously building our network of talented Data Engineering professionals for upcoming client engagements across various... ...opportunities. WHAT YOU’LL BE DOING IN THE ROLE:As a Data Engineering Specialist, you may be responsible for: Designing, building, and...DataWork from homeWorldwide
- Seeking a Data Engineer specializing in backend API development in Toronto, ON. This contract role focuses on the creation of internal APIs... ...and reliability Enhance your career by driving data integration initiatives as a Backend API Specialist in Toronto. #J-18808-LjbffrDataContract work
- ...testing in the field, and writing comprehensive Instructions to Service document. Reports directly to Controls Supervisor, Service Engineering. WHAT YOU WILL DO: Lead the execution of commissioning activities, both onsite and/or remote. Troubleshoot and resolve hardware...Full timeSummer holidayRemote work
- ...Price Café offers free Tea and Coffee. Senior Manufacturing Engineering Specialist - Critical Environments Reporting To: Manufacturing... ...floor layouts, production line configurations, machine capacity data, and labor cost standards. • Ensure drawing packages comply...Data
- UV Assurance à Drummondville recherche un(e) programmeur(euse)-analyste, base de données, pour concevoir et faire évoluer des solutions de données, et assurer leur intégration et transformation tout en garantissant leur qualité et sécurité. Le rôle s’inscrit dans un cadre DevOps...DataRemote work
- Johnson Controls, Silent-Aire division is seeking an Electrical Engineering Specialist to provide advanced technical support, guide R&D and product development, and drive design standards across the Electrical Engineering team. The role emphasizes hands-on problem solving, mentorship...Data
- Capco in Toronto is hiring an experienced Data Engineer to design, develop and optimize data pipelines powering financial services. You will work with Informatica IDMC, ETL/ELT processes and cross-functional teams to deliver scalable data integration solutions. The role emphasizes...Data
$170.63k - $243.75k per year
Senior Specialist Sales Engineer, Data Security Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss...DataLong term contractFull timeInternshipWork at officeLocal areaRemote work- ...passion, and you’re invited to be a part of that. Manufacturing Engineering Specialist The Manufacturing Engineering Specialist will support... ...the floor. • Solid documentation skills and comfort using data (Excel or similar) to drive decisions. • Practical, hands-...DataContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...DataPermanent employmentFull time
- OverviewReporting to the Manager, Data Science & Operations, the Data Transformation Specialist will help build, scale, and maintain MPI’s business intelligence and... ...data. ResponsibilitiesData Transformation and Engineering Contributes to data pipelines by implementing a...DataLong term contractTemporary workFlexible hours
- ...solution provider and an outstanding employer. PositionJoin our Data team to ensure the scalability, resilience, and efficiency of... ...Airflow). Education And Experience Degree in computer science/engineering or equivalent experience. Minimum 3+ years of experience in...DataLong term contractWork at office
- ...company based in Vancouver and a subsidiary of Pacific Energy Corporation Limited. PositionThe Operations Data Specialist is part of Woodfibre LNG's Engineering Support team and is responsible for implementing and maintaining the Engineering Data Warehouse (EDW). The role...DataLong term contractFor contractorsWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Specialist - Data Engineering. Be the first to apply!
Related searches
- policy specialist Winnipeg, MB
- emergency management specialist Winnipeg, MB
- diversity and inclusion specialist Winnipeg, MB
- member engagement specialist Winnipeg, MB
- fire specialist Winnipeg, MB
- drug safety specialist Winnipeg, MB
- optimization specialist Winnipeg, MB
- career transition specialist Winnipeg, MB
- workforce specialist Winnipeg, MB
- career specialist Winnipeg, MB

