Python Pyspark Data Engineer
LanceSoft, Inc.
Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets through distributed processing. Apply deep SQL expertise to reliable engineering work.This Data Engineer role focuses on Python programming, PySpark transformations, and Snowflake development. You will create ETL and ELT solutions, integrate data, and support migration and orchestration. The work also involves data warehousing, schema design, validation, and error handling.Key Responsibilities:
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Python Pyspark Data Engineer in Winnipeg, MB vacancy
- ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support...Python
- A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in...PythonRemote work
- ...Luxoft in Toronto is seeking a senior data engineer to support the Analytical Work Bench integration, including AWS-based data pipelines and... ...quality with standard testing practices. Join a team that leverages PySpark, PyTest, and Pylint, while integrating with CI/CD tooling such...Python
- ...We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions. The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration...PythonFull time
- # Forward Deployed Engineer (Python/Pyspark Developer)Apptoza Inc. · Toronto, Ontario, CABack to resultsForward Deployed Engineer (Python/Pyspark Developer... ...Engineer who combines production-grade software engineering, data engineering, AI application development, and client-facing...Python
- Apply your advanced skills in a role as an Expert Python/PySpark Developer, dedicated to enhancing data-driven solutions. This position offers flexible modes of teamwork and application development. We are in search of an experienced Python/PySpark Developer, enriched with...PythonFlexible hours
- Build analytical data solutions with Python, PySpark, and AWS in downtown Toronto, working onsite four days weekly on a hybrid contract.This senior development assignment supports a global IT services firm serving a leading investment and wealth management services firm. You...PythonContract workWork at office
- Advanced Python and PySpark expertise define this onsite opportunity with Altimetrik in Mississauga, Ontario, supporting large-scale data processing solutions.The Python Developer will build and optimize scalable data engineering solutions. The work emphasizes Big Data Processing...Python
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...Engineer or similar role. · Proficiency in Python, PySpark, data modeling, ETL processes and data...PythonPermanent employment$75 - $100 per hour
Senior Python Developer with PySpark and AWSThis is with a global IT services firm for a leading investment/wealth management services firm.... ...100hr on B2B Project descriptionThe project involves the data engineering organization’s Analytical Work Bench, which is an integrated...PythonContract workWork at office- Use Python, Spark, and Airflow to create scalable pipelines for Robinhood’s data lake. Work in Toronto on foundational financial datasets.This Senior Data Engineer role focuses on reliable data infrastructure supporting Robinhood’s metrics and products. You will develop application...Python
- Python data engineering leads this intermediate position in Toronto, with backend services, analytics, and hybrid work two days onsite weekly.Randstad Canada presents an intermediate Software Engineer opportunity with a leading SaaS company. The work centers on backend development...PythonWork at office
- Build trusted data foundations at Foresight using Python and advanced SQL. Work from New York, San Francisco, or Montreal, with occasional travel.As a Senior Data Engineer, you will develop production pipelines for complex project data. Your work supports predictions, AI recommendations...Python
- Build Python systems for data lineage, code parsing, and metadata analysis with I8IS INC. in Mississauga... ..., Ontario. Develop accurate, scalable engineering solutions.This full-time developer... ...transformation.Key Responsibilities: Design engines parsing programming and query...PythonFull time
- ...professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise AI...PythonFull timeInternshipRemote workRelocation
- Build Python tooling and APIs as a Data Platform Engineer at BRP, improving platform efficiency through automation, CI/CD, and scalable operations.Working in BRP’s Data Solutions group, you will extend data platform capabilities and improve efficiency. You will develop custom...Python
- Build reliable data systems remotely at Intrinsic Development using Python, SQL, and modern ETL pipelines. Daily AI use shapes this engineering work.As a Data and AI Engineer, you will build and operate data platforms in a product-led environment. The work includes ETL and ELT...PythonRemote work
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval or Montréal.The Data Engineering Expert develops and operates modern Databricks Lakehouse pipelines supporting...PythonWork at office
- Software Engineer, Data Systems (Python)Remote - Canada About NorthbeamNorthbeam is building the world's most advanced marketing intelligence platform, providing top eCommerce brands a unified view of their business data through powerful attribution modeling and customizable...PythonRemote workWork from homeFlexible hours
- ...Northbeam, a data-first marketing intelligence platform, seeks a Software Engineer focused on Data Systems (Python) to own reliable data pipelines and APIs. Remote-friendly with offices in SF/LA, this role emphasizes scalable ETL, real-time and batch processing, and multi-...PythonRemote work
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...Python
- Build scalable data solutions in Markham, ON, using advanced SQL and Python with Pandas in a hybrid, three-days-on-site schedule.This Senior Data Engineer, Senior BI, or Analytics Engineering Lead designs reliable solutions for business intelligence, reporting, and advanced...Python
- ...leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing... ...years of experience in Data testing, proficient in GCP Big Query, Python, and SQL, and possess excellent communication skills. The position...PythonFull time
- Step into a senior Data Engineer role focusing on developing data pipelines with Python and SQL. This position is ideal for experts in cloud technologies. You'll be responsible... ...• Develop scalable data solutions using Python, PySpark, and SQL • Optimize Snowflake database for...Python
- ...Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division... ...Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site)... ...build repeatable checks in Excel, SQL or Python; and create exception reports and quality...PythonLong term contractPermanent employmentFull timeContract workWork at office
- US Tech Solutions is seeking an Application Developer - Sr Python Engineer for a project-based vendor integration initiative in Toronto. The role... ...and APIs, wiring systems via REST/gRPC, and modernizing data platforms across Azure Databricks, Delta Lake, ADLS, Azure Data...Python
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Python
- Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT concepts...Work at office
- Citi in Mississauga, Ontario, is seeking a Java Developer or Python Developer specializing in Data Lineage and Metadata Management. The role focuses on building backend services, parsing large codebases, and enabling AI-powered data lineage capabilities. You will design scalable...Python
- ...We are looking for a senior Forward Deployed Engineer who combines production-grade software engineering, data engineering, AI application development, and client... .... Profile unfamiliar data using Python, pandas, PySpark, and SQL to assess coverage, quality, volumes,...Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Pyspark Data Engineer. Be the first to apply!
Related searches
- développeur python Winnipeg, MB
- python developer Winnipeg, MB
- python data engineer Winnipeg, MB
- python developer remote Winnipeg, MB
- python developer no experience Winnipeg, MB
- junior python developer Winnipeg, MB
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB

