Specialist - Data Engineering
LTM
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Role DescriptionJob role : Spark and scala developer
Location : Mississauga ,Ontario
Job SummarySeeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem
Job DescriptionDesign develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing
Roles and Responsibilities
Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL
Collaborate with stakeholders to gather requirements and deliver effective data solutions
Optimize Spark jobs for performance and scalability in production environments
Mentor junior team members and provide technical guidance on best practices
Conduct code reviews to ensure adherence to coding standards and promote continuous improvement
Monitor system performance proactively and address bottlenecks or failures
Participate in sprint planning estimation and agile ceremonies to deliver highquality software
Ensure compliance with data governance and security policies
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Specialist - Data Engineering in Winnipeg, MB vacancy
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...DataPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...DataLong term contractPermanent employmentFull timeContract workWork at office
$17 per hour
...function role, you will be the operational engine behind daily donor engagement and database... ...speed and accuracy in high-volume data entry. Excellent command of spoken and... ...recruitment team! Customer Support and Data Entry Specialist - Winnipeg Contact / Applications: or...DataWeekly payLong term contractPermanent employmentFull timeContract workWork at officeImmediate startMonday to friday- Engineer AWS data solutions using Python, PySpark, Terraform, and SQL at Tata Consultancy Services. Work hands-on across cloud services, infrastructure... ..., APIs, and data pipelines.This AWS Data Engineering Specialist role centers on practical platform engineering and...Data
- ...convenient Price Café offers free Tea and Coffee. Manufacturing Engineering Specialist - Finishing The successful candidate's responsibilities... ...analytical and problem-solving abilities, with a focus on data-driven decisions. • Strong technical and mechanical aptitude...DataFor contractorsWork at officeRelocation
- Join Tecsys as a Data Engineer focused on cloud and DevOps in a hybrid setup. Bring your expertise in Databricks and AWS to enhance analytics capabilities across healthcare systems. As part of the TecsysIQ Data & AI team, you will manage infrastructure-as-code while collaborating...Data
- Build enterprise data solutions at Central 1 with Azure, SQL, PySpark, dbt, Spark Notebooks, and Microsoft Fabric technologies across Canada.Central 1 is seeking a highly experienced Senior Data Engineer specializing in Microsoft Fabric and Azure data engineering. You will translate...Data
- Elevate data governance at scale as a Senior Data Governance Engineer focusing on Azure technologies. Your expertise will enhance data quality, pipeline automation, and governance frameworks in a collaborative setting. This role is geared towards engineers passionate about...Data
- ...Price Café offers free Tea and Coffee. Senior Manufacturing Engineering Specialist - Critical Environments Reporting To: Manufacturing... ...floor layouts, production line configurations, machine capacity data, and labor cost standards. • Ensure drawing packages comply...Data
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...DataPermanent employmentFull time
- ...passion, and you’re invited to be a part of that. Manufacturing Engineering Specialist The Manufacturing Engineering Specialist will support... ...the floor. • Solid documentation skills and comfort using data (Excel or similar) to drive decisions. • Practical, hands-...DataContract workWork at office
- Johnson Controls, Silent-Aire division is seeking an Electrical Engineering Specialist to provide advanced technical support, guide R&D and product development, and drive design standards across the Electrical Engineering team. The role emphasizes hands-on problem solving, mentorship...Data
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Data
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...DataFull time- ..., dbt for transformation, and AWS-native services (S3, Glue, Athena, Bedrock) for storage, compute, and AI enablement. The Data Engineering Specialist works inside this stack, embedded in the Data Platform team.What we're looking for. A hands-on data engineer fluent in SQL...DataCasual work
- ...organization with a highly engaged membership, is seeking a Data & Analytics Specialist for a newly created, strategic role that is central to... ....This position sits at the intersection of data engineering, analytics, and governance, responsible for turning organizational...DataWork at officeShift work
$90.77k per year
...interested in an opportunity to grow professionally within a positive and progressive culture? Northern Health is seeking an experienced Data Specialist to join our Information Management Information Technology department In accordance with the established vision and values of...DataFull timePart timeCasual work- ...Centre North Position Overview As a Research & Development Engineering Specialist, you will support the planning and execution of laboratory... ..., develop new testing methods, and provide engineering data to support design decisions. This position combines hands-on...DataManual labor
- ...applications and next steps. Our partner is looking for a Data & Systems Specialist based in Canada. This is an opportunity to support the effective... ...& Professional Experience Degree in Computer Science, Engineering, Information Systems, Data Analytics, or a related field...DataLong term contractFull timeFor contractorsRemote workWorldwide
$75.4k - $125.4k per year
We Are: Accenture AI & Data, the people who love using data to tell a story. We’re also... ...Are As a Data Migration/ Modernization Specialist, you will stand up the data services and... ...and data modelling.Experience as a data engineer in solutioning and building scalable data...DataFull timeWork at officeLocal area- ...solution provider and an outstanding employer.Position Join our Data team to ensure the scalability, resilience, and efficiency of... ...Airflow).Education and experience Degree in computer science/engineering or equivalent experience.Minimum 3+ years of experience in database...DataLong term contract
- ...with technical and business stakeholders About the OpportunityWere hiring a PLM Data Migration Specialist to support a major enterprise technology transformation within a complex engineering environment. Youll play a hands-on role in migrating critical product and...Data
- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...DataWork at officeFlexible hours
$112k per year
...and enduring.The Opportunity We are currently seeking a Specialist, Data Developer (Microsoft) to join our Data Platforms &... ...Education 8–10 years of experience in data development, data engineering, or related rolesProven experience building data pipelines, ETL...DataWork at office- A career as a Senior Developer in Data Engineering on the Financial crime and regulatory projects team at National Bank means serving as a Data Analytics Specialist. This position allows you to have a positive impact on our organisation thanks to your expertise in engineering...DataFlexible hours
- ..., in an inclusive and high-performing culture. The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team... ...and scripts for quality standards. Guide a team of QA specialist and work hands on in developing framework and mapping specs using...DataFlexible hours
- ...focused on strengthening the security of Client data. Sun Life's Information Security organization is enhancing its data engineering, platform, analytics, and insights... ...mandate, the role requires an experienced data specialist with 5+ years of expertise in data management...DataWork at officeWork from home
$126.9k - $169.2k per year
...leaders, and technology stakeholders to define data architecture vision and roadmap* Drive innovation in data engineering practices, emerging technologies, and platform... ...team of Data Engineering Directors, and technical specialists* Collaborate cross-functionally with Operations...DataLong term contract- ...business with the backing of a global organization. As the Senior Data Engineer, you will help design, build, and evolve CloudBlue’s data and... ...About us: Managed.com is the company behind a family of specialist brands spanning business technology, infrastructure, and...DataInternshipRemote work
- ...applications and next steps. Our partner is looking for a GCP Data Engineer based in Canada. This role offers the opportunity to design... ...technologies. Collaborative environment with experienced technical specialists and strategic partners. Opportunities to work on innovative...DataRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Specialist - Data Engineering. Be the first to apply!
Related searches
- delivery specialist Winnipeg, MB
- asset management specialist Winnipeg, MB
- configuration management specialist Winnipeg, MB
- credit specialist Winnipeg, MB
- building performance specialist Winnipeg, MB
- fire specialist Winnipeg, MB
- spécialiste en amélioration continue Winnipeg, MB
- deployment specialist Winnipeg, MB
- solution specialist Winnipeg, MB
- spécialiste talent Winnipeg, MB

