Specialist - Data Engineering
LTM
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Specialist - Data Engineering in Winnipeg, MB vacancy
$84k - $115k per year
...Job Description As a Data Engineering Specialist reporting to the Senior Director of Data Engineering, you'll play a critical role in designing, building, and scaling the data infrastructure that powers one of the world's largest data marketplaces — serving hundreds of...DataLong term contractTemporary work$118k - $145k per year
...alongside people who think big and act bold - project managers, engineers, technologists, and strategists who blend real-world experience with... ...& Capital ProjectsAbout the Role We are seeking a Data Engineer to support large-scale capital infrastructure programs,...DataFull timeFor contractorsInternshipWork at officeLocal area$17 per hour
...function role, you will be the operational engine behind daily donor engagement and database... ...speed and accuracy in high-volume data entry. Excellent command of spoken and... ...recruitment team! Customer Support and Data Entry Specialist - Winnipeg Contact / Applications: or...DataWeekly payLong term contractPermanent employmentFull timeContract workWork at officeImmediate startMonday to friday$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...DataPermanent employment- Build scalable data infrastructure at Nasdaq using Python, cloud platforms, and distributed pipelines. Support a global data marketplace... ...serving hundreds of thousands of professionals.As a Data Engineering Specialist, reporting to the Senior Director of Data Engineering, you...Data
- Build enterprise data solutions with SQL and Python as a Senior Data Integration Specialist at CGIC, working hybrid with two office days weekly.Within Business Intelligence, you will engineer backend solutions across source ingestion, ETL, and data stores through the software...DataWork at office
- Build scalable cloud and on-premises data infrastructure with Python, Spark, and Databricks... ...& Operations, this Data Transformation Specialist supports Manitoba Public Insurance’s... ...disciplineFive years in data management, engineering, and analyticsThree years in architecture...Data
- Engineer analytics data solutions at CGIC using SQL, Python, and Azure technologies in a hybrid model with two office days weekly.As a Senior Data Integration Specialist, you will autonomously build and maintain back-end data solutions throughout the software development lifecycle...DataWork at office
- Seize the opportunity at Circle as a Data Engineering Specialist focused on blockchain technology. This remote role emphasizes creating and optimizing ETL/ELT pipelines for advanced data analysis. As a Data Engineering Blockchain member, you’ll manage the data warehouses...DataRemote work
- Engineer AWS data solutions using Python, PySpark, Terraform, and SQL at Tata Consultancy Services. Work hands-on across cloud services, infrastructure... ..., APIs, and data pipelines.This AWS Data Engineering Specialist role centers on practical platform engineering and...Data
- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...DataLong term contractPermanent employmentFull timeContract workWork at office
- ...convenient Price Café offers free Tea and Coffee. Manufacturing Engineering Specialist - Finishing The successful candidate's responsibilities... ...analytical and problem-solving abilities, with a focus on data-driven decisions. • Strong technical and mechanical aptitude...DataFor contractorsWork at officeRelocation
- ...Mariner, we're continuously building our network of talented Data Engineering professionals for upcoming client engagements across various... ...opportunities. WHAT YOU’LL BE DOING IN THE ROLE:As a Data Engineering Specialist, you may be responsible for: Designing, building, and...DataWork from homeWorldwide
- Build enterprise data solutions at Central 1 with Azure, SQL, PySpark, dbt, Spark Notebooks, and Microsoft Fabric technologies across Canada.Central 1 is seeking a highly experienced Senior Data Engineer specializing in Microsoft Fabric and Azure data engineering. You will translate...Data
- Elevate data governance at scale as a Senior Data Governance Engineer focusing on Azure technologies. Your expertise will enhance data quality, pipeline automation, and governance frameworks in a collaborative setting. This role is geared towards engineers passionate about...Data
- Join Tecsys as a Data Engineer focused on cloud and DevOps in a hybrid setup. Bring your expertise in Databricks and AWS to enhance analytics capabilities across healthcare systems. As part of the TecsysIQ Data & AI team, you will manage infrastructure-as-code while collaborating...Data
- Seeking a Data Engineer specializing in backend API development in Toronto, ON. This contract role focuses on the creation of internal APIs... ...and reliability Enhance your career by driving data integration initiatives as a Backend API Specialist in Toronto. #J-18808-LjbffrDataContract work
- Build modern financial data solutions at Central 1 with Microsoft Fabric, PySpark, dbt, dimensional modeling, and enterprise data engineering expertise.Central 1 is seeking a Senior Data Engineer and Microsoft Fabric Subject Matter Expert for enterprise-scale platform delivery...Data
- ...testing in the field, and writing comprehensive Instructions to Service document. Reports directly to Controls Supervisor, Service Engineering. WHAT YOU WILL DO: Lead the execution of commissioning activities, both onsite and/or remote. Troubleshoot and resolve hardware...Full timeSummer holidayRemote work
- ...Price Café offers free Tea and Coffee. Senior Manufacturing Engineering Specialist - Critical Environments Reporting To: Manufacturing... ...floor layouts, production line configurations, machine capacity data, and labor cost standards. • Ensure drawing packages comply...Data
- UV Assurance à Drummondville recherche un(e) programmeur(euse)-analyste, base de données, pour concevoir et faire évoluer des solutions de données, et assurer leur intégration et transformation tout en garantissant leur qualité et sécurité. Le rôle s’inscrit dans un cadre DevOps...DataRemote work
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...DataPermanent employmentFull time
$170.63k - $243.75k per year
Senior Specialist Sales Engineer, Data Security Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss...DataLong term contractFull timeInternshipWork at officeLocal areaRemote work- Johnson Controls, Silent-Aire division is seeking an Electrical Engineering Specialist to provide advanced technical support, guide R&D and product development, and drive design standards across the Electrical Engineering team. The role emphasizes hands-on problem solving, mentorship...Data
- ...passion, and you’re invited to be a part of that. Manufacturing Engineering Specialist The Manufacturing Engineering Specialist will support... ...the floor. • Solid documentation skills and comfort using data (Excel or similar) to drive decisions. • Practical, hands-...DataContract workWork at office
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Data
$114k - $136.8k per year
...technology teams.About This Role We are looking for an IT Data Specialist for our Financial Crime & Risk Management systems (Oracle - Transaction... ...Azure Data Lake Storage (ADLS) using distributed query engines such as Azure Synapse Serverless SQL, Databricks SQL etc.Hands...DataImmediate startWork from home- ...collaborative team. We are looking for a thinker / doer to fill our ETF Data Specialist role. Reporting into the Head of Digital Product, this role... ...Strategic Partnerships: Collaborate closely with Product, Engineering, and Marketing to ensure the right market data reaches the...Data
- ...with technical and business stakeholders About the OpportunityWere hiring a PLM Data Migration Specialist to support a major enterprise technology transformation within a complex engineering environment. Youll play a hands-on role in migrating critical product and...Data
- ...seeking an Integration Developer / Solution Engineer to design and deliver a secure, scalable,... ...CSV download capability by consuming data virtualization service outputs (JSON/XML)... ...to set job alerts for “Data Integration Specialist” roles. Data Analyst : A/B-tests and customer...DataRemplacementRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Specialist - Data Engineering. Be the first to apply!
Related searches
- delivery specialist Winnipeg, MB
- asset management specialist Winnipeg, MB
- configuration management specialist Winnipeg, MB
- credit specialist Winnipeg, MB
- building performance specialist Winnipeg, MB
- fire specialist Winnipeg, MB
- spécialiste en amélioration continue Winnipeg, MB
- deployment specialist Winnipeg, MB
- solution specialist Winnipeg, MB
- spécialiste talent Winnipeg, MB

