Senior Big Data Pipeline Engineer
Techblocks
Engineer enterprise-scale data pipelines with Python, Apache Spark, and Apache Beam for modern cloud-based data platforms. Apply strong SQL and platform expertise.This Senior Data Engineer role at TechBlocks centers on building and expanding enterprise data capabilities. You will develop cloud-native pipelines with Apache Airflow, process data reliably, and integrate machine learning models. Collaboration with data scientists, engineers, and stakeholders supports scalable solutions within agile development environments.Key Responsibilities:
Use current technologies to build scalable data pipelinesIntegrate machine learning models into data solutionsBuild and expand the company data platformDevelop applications using cloud-based infrastructureCollaborate across technical and cross-functional teamsRequirements:
8+ years of Big Data and Data Engineering experienceCloud-native pipeline development using PythonApache Airflow, Apache Spark, and Apache Beam experienceWorking knowledge of SQL and data warehousing conceptsExperience with agile processes and multi-functional teamsUse pipeline engineering, big data, and collaboration skills to expand TechBlocks' scalable enterprise data platform.
#J-18808-Ljbffr
Use current technologies to build scalable data pipelinesIntegrate machine learning models into data solutionsBuild and expand the company data platformDevelop applications using cloud-based infrastructureCollaborate across technical and cross-functional teamsRequirements:
8+ years of Big Data and Data Engineering experienceCloud-native pipeline development using PythonApache Airflow, Apache Spark, and Apache Beam experienceWorking knowledge of SQL and data warehousing conceptsExperience with agile processes and multi-functional teamsUse pipeline engineering, big data, and collaboration skills to expand TechBlocks' scalable enterprise data platform.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Big Data Pipeline Engineer in Winnipeg, MB vacancy
- ...Our client, a major financial services institution based in Kimberley, is seeking a highly experienced Senior Data Engineer to build and manage their sophisticated big data infrastructure. This is a critical, office-based role within our Kimberley headquarters, requiring close...SeniorBig dataWork at office
- Senior Software Engineer specializing in Core Java, Apache Spark, and Python develops scalable server-side applications and analytical data systems.This senior engineering role focuses on high-performance applications and large-scale data processing. You will use Core Java,...SeniorBig data
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Senior
- Elevate your career as a Senior Data Engineer with Samsung Research in Vancouver. This hybrid position empowers you to process vast amounts of... ...solutions while collaborating closely with teams to enhance data pipelines. Your leadership will not only improve operational efficiency...SeniorBig data
- Wipro Limited in Mississauga, Canada is seeking an experienced data engineer to design and implement large-scale data pipelines using Python, PySpark and SQL. You will work with Spark, Hive and Hadoop in a Big Data ecosystem to optimize data quality, profiling and ETL/ELT processes...SeniorBig data
$111k - $160k per year
Title and Summary Senior AI Engineer, Big Data & AI Solutions Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support...SeniorBig dataWorldwide- ...la fibre entrepreneuriale et la passion de la data pour nous rejoindre. Aujourd'hui, nous recherchons un Développeur Big Data Snowflake pour pour combler une opportunité... ...; Concevoir, développer et maintenir des pipelines d'intégration de données en utilisant AWS Glue...Big dataPermanent employmentWork at officeRemote workFlexible hours
- Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities...SeniorRemote work
- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...Senior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
$136k - $170k per year
...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production... ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services...SeniorHourly payWork at officeFlexible hours3 days per week- Build AWS data pipelines as a Senior Data Engineer at Clio, using streaming, batch processing, and production software development skills. Work remotely across Canada or hybrid in Toronto.Clio seeks a Senior Data Engineer for its growing engineering team. You will create data...SeniorRemote work
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...SeniorBig data
$136k - $170k per year
...Space LLC in Toronto is seeking an experienced Infrastructure Engineer to own Production Infrastructure, monitor system health and automate... ...at scale. You will build platforms and services for data pipelines, partnering with cross-functional teams to anticipate customer...SeniorWork at office3 days per week- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Senior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses...Senior
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates...Senior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...SeniorWork at office
- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...Senior
- ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data... ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using...SeniorFull timeInternshipWork at officeWork from homeFlexible hours
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...Senior
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...Senior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...SeniorBig data
$110k - $165k per year
...efficiency of our development/deployment pipeline to deliver solutions faster to our customers... ...requirements into updated designs. Big Data: Build and maintain highly scalable, performant... ...junior and intermediate Software Engineers and provide them with professional development...SeniorBig dataFor subcontractorWork at office- ...professionally and personally. Overview As a Big Data Architect, you are passionate about data... ...clients including data ingestion/data pipeline design and implementation, data warehouse... ..., data architects, ETL developers & engineers, data scientists, and information...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

