Databricks Developer
$75 - $77 per hourBeachHead
Are you a hands-on Databricks Developer ready to build scalable data solutions?
Working with one of our top financial clients, this role calls for a Databricks Developer to design, develop, and optimise enterprise-grade data pipelines using Databricks and Apache Spark. This six-month contract offers the opportunity to work with large-scale datasets, contribute to solution design, collaborate with business and technology stakeholders, and apply advanced data engineering practices in a fast-paced environment. Banking or financial services experience is highly preferred.
Pay rate range (CAD): $75.00/hr – $77.00/hr
Responsibilities
Design, develop, and optimise data pipelines using Databricks and Apache Spark.
Build scalable ETL pipelines supporting batch processing, Auto Loader, and Spark Structured Streaming.
Develop and maintain end-to-end data environments, including catalogs, schemas, tables, materialised views, functions, and volumes.
Implement slowly changing dimensions using SCD 1 and SCD 2 methodologies.
Build and support change data capture pipelines.
Use Unity Catalog to manage data governance and access across data environments.
Develop Lakehouse Federation solutions and create foreign catalogs for external data sources.
Apply Databricks partitioning and liquid clustering techniques to improve performance.
Work with large-scale datasets in distributed computing environments.
Collaborate with cross-functional teams and business stakeholders to understand requirements and deliver effective solutions.
Contribute to solution design discussions and provide practical technical recommendations.
Ensure data quality, performance, scalability, and reliability across delivered solutions.
Communicate technical concepts clearly to stakeholders at varying levels of technical expertise.
Desired Skill-Set
Strong hands-on experience developing solutions with Databricks and Apache Spark.
Experience with Azure Databricks or Delta Lake.
Proven experience building batch and streaming ETL pipelines using Auto Loader and Spark Structured Streaming.
Strong hands-on experience with Unity Catalog.
Experience creating catalogs, schemas, tables, materialised views, functions, and volumes.
Experience implementing SCD 1 and SCD 2 solutions for dimension tables.
Experience developing change data capture pipelines.
Strong experience with Lakehouse Federation and foreign catalogs.
Strong understanding of Databricks partitioning and liquid clustering.
Experience working in enterprise environments;
banking or financial services experience is preferred.
Strong communication and stakeholder management skills.
Ability to work independently and effectively in a fast-paced environment.
Nice to Have
Experience with Kafka.
Experience with Python.
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.
Privacy Policy
#J-18808-Ljbffr
Working with one of our top financial clients, this role calls for a Databricks Developer to design, develop, and optimise enterprise-grade data pipelines using Databricks and Apache Spark. This six-month contract offers the opportunity to work with large-scale datasets, contribute to solution design, collaborate with business and technology stakeholders, and apply advanced data engineering practices in a fast-paced environment. Banking or financial services experience is highly preferred.
Pay rate range (CAD): $75.00/hr – $77.00/hr
Responsibilities
Design, develop, and optimise data pipelines using Databricks and Apache Spark.
Build scalable ETL pipelines supporting batch processing, Auto Loader, and Spark Structured Streaming.
Develop and maintain end-to-end data environments, including catalogs, schemas, tables, materialised views, functions, and volumes.
Implement slowly changing dimensions using SCD 1 and SCD 2 methodologies.
Build and support change data capture pipelines.
Use Unity Catalog to manage data governance and access across data environments.
Develop Lakehouse Federation solutions and create foreign catalogs for external data sources.
Apply Databricks partitioning and liquid clustering techniques to improve performance.
Work with large-scale datasets in distributed computing environments.
Collaborate with cross-functional teams and business stakeholders to understand requirements and deliver effective solutions.
Contribute to solution design discussions and provide practical technical recommendations.
Ensure data quality, performance, scalability, and reliability across delivered solutions.
Communicate technical concepts clearly to stakeholders at varying levels of technical expertise.
Desired Skill-Set
Strong hands-on experience developing solutions with Databricks and Apache Spark.
Experience with Azure Databricks or Delta Lake.
Proven experience building batch and streaming ETL pipelines using Auto Loader and Spark Structured Streaming.
Strong hands-on experience with Unity Catalog.
Experience creating catalogs, schemas, tables, materialised views, functions, and volumes.
Experience implementing SCD 1 and SCD 2 solutions for dimension tables.
Experience developing change data capture pipelines.
Strong experience with Lakehouse Federation and foreign catalogs.
Strong understanding of Databricks partitioning and liquid clustering.
Experience working in enterprise environments;
banking or financial services experience is preferred.
Strong communication and stakeholder management skills.
Ability to work independently and effectively in a fast-paced environment.
Nice to Have
Experience with Kafka.
Experience with Python.
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.
Privacy Policy
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Databricks Developer in Winnipeg, MB vacancy
- Join to apply for the Databricks Developer role at Apex SystemsJoin to apply for the Databricks Developer role at Apex SystemsGet AI-powered advice on this job and more exclusive features.Job#: 2076192 Job Description: Databricks Developer Client:...DatabricksPermanent employmentContract workWork at office
$75 - $95 per hour
Databricks DeveloperLocation: Toronto, ON Onsite Flexibility: Hybrid Contract Details Position Type: Contract Contract... ...support scalable data pipelines using Azure Databricks . Develop and maintain ETL/ELT solutions using PySpark, Spark SQL and...DatabricksContract workFor contractors- Job DescriptionLocation: Toronto or Vancouver, Canada (Onsite) Job Type: 12+ Months Contract Required Skills Strong hands‑on experience in Java, Spring Boot, and Microservices. Understanding of Microservices architecture. Experience designing and building RESTful...DatabricksContract work
- ...We are seeking a seasoned MDM Sr. Developer with strong expertise in Databricks and cloud-based data platforms. This role involves designing and maintaining Master Data Management (MDM) solutions, building scalable data pipelines, and ensuring data quality and governance...Databricks
- Databricks and Power BI integration anchor this Software Developer opportunity for Toronto professionals available on-site five days each week.As an intermediate developer, you will connect Power BI with Databricks SQL Warehouses and Lakehouse data sources. You will also build...Databricks
$80k - $120k per year
...outcomes. About the RoleWe are looking for both permeant and contract for this role. We're looking for a developer to help build and maintain data pipelines on Databricks for a financial services / wealth management data platform. The platform ingests data from multiple...DatabricksContract work- Accelerate your impact in data management as a Databricks MDM Senior Developer. Utilize your expertise in cloud-based solutions to ensure data integrity and governance across the organization. In this senior developer role, you will design Master Data Management solutions while...Databricks
- Certification: Databricks Certification preferredJob Summary We are seeking an experienced Databricks Architect to design and implement... ...implement enterprise-scale data architectures using Databricks.Develop scalable data pipelines using SQL, PySpark, and Python.Implement...Databricks
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services. This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering. The engineer will...Databricks
- ...Responsibilities Design, implement, and manage security policies and controls within the Databricks environment.Monitor and audit user access and activities to ensure compliance with security policies.Develop and maintain data encryption strategies.Manage roles, permissions, and access...Databricks
- Industrialize classic, generative and agentic AI solutions on Azure and Databricks for a major public energy player in Quebec.MLflowPython /... ...partner. In this context, we are looking for an MLOps developer to industrialize and operate classic, generative and agentic AI...Databricks
- Shape the future of data solutions with Databricks as a Solutions Architect. Engage in designing scalable data architectures, driving technical... ...platform across assigned accounts. Key Responsibilities: • Develop account strategies to increase platform usage • Establish Databricks...Databricks
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data... ...Support, maintain, and enhance existing data pipelines Develop and optimize data ingestion processes from operational source systems...DatabricksContract work$148k - $175k per year
...data and analytics platforms, real time intelligence and reporting solutions using Python, SQL, Microsoft Azure Data Services, Fabric, Databricks, and Snowflake.Stay abreast of the latest advancements in Data and AI technologies and incorporate relevant innovations into our...DatabricksFull timeManual laborWork at officeLocal areaRemote work$115k - $165k per year
...and professional growth.Your Opportunity We’re looking for a Databricks Solutions Architect who can bridge the worlds of technology, clients... ...Databricks ecosystem. Collaborate with sales and marketing to develop solution offerings, proposals, and pursuits that align with...DatabricksWork at officeFlexible hours- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks... ...data from multiple source systems, and developing Bronze/Silver/Gold layers within a... ...environments.**Responsibilities:*** Design, develop, enhance, and maintain data pipelines...DatabricksHourly payContract workManual labor
- ...scientists, data engineers, data analysts and solution architects to develop data pipelines to feed our data marketplaceIdentify, design, and... ..., Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within the agile SCRUM work...DatabricksLong term contract
$130k - $135k per year
...Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain... ...highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design,...DatabricksLong term contractFull timeContract workFlexible hours- We are seeking an experienced Databricks Engineer to join our delivery team on a contract basis in Calgary to design, build, and optimize... ...as Delta Lake, Unity Catalog, and MLflow.Strong experience developing data pipelines using PySpark and SQL.Proven experience leading...DatabricksContract work
- ...Design and architect enterprise-scale data platforms using Databricks Lakehouse architecture. Lead data modernization initiatives including migration from legacy data warehouses to cloud-based platforms. Define best practices for data ingestion, transformation, storage...Databricks
- We are looking for a Databricks Architect with strong experience in building and optimizing ETL pipelines on cloud platforms like AWS or Azure. This role involves working on large scale data processing real time pipelines and leading data engineering initiatives. Build and...Databricks
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes... ...and product roadmaps. Key Responsibilities: • Lead and develop a high-performing engineering team • Oversee consistent recruitment...DatabricksLong term contract
- ...consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the... ...partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create real business impact...DatabricksRemote workFlexible hours
- ...Interest Group Company ITL Canada Requisition ID 153517BR Infosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong expertise in Azure data...DatabricksRelocation
- As a Product Specialist at Ubisoft Montréal, you will help clients make full use of the Databricks data and artificial intelligence platform. Reporting to the Product Manager for Databricks, you will serve as a product resource, helping clients understand its features and supporting...Databricks
- Shape the future of data and AI as a Fullstack Engineer at Databricks in Vancouver. We are looking for innovative minds ready to tackle technical... ...the company's innovation agenda. Key Responsibilities: • Develop full stack solutions for data-driven applications • Collaborate...Databricks
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work... ...Delta Tables, and dbt or similar frameworks. Strong experience developing and optimizing large-scale data pipelines using: Experience...Databricks
$131.7k - $278.1k per year
...challenges.You Are A Senior AI Native Lead who builds, leads, and scales world-class AI/ML professional services on the Databricks Intelligence Platform. You develop executive relationships with VP+, CIO, and CDO stakeholders as a trusted advisor on complex AI transformations,...DatabricksFull timeWork at officeLocal area3 days per week- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- ...’exploitation et à l’évolution de l’entrepôt de données; - Programmer et maintenir des traitements ETL à l’aide de SQL, Python et Databricks; - Collaborer aux déploiements applicatifs en utilisant les pratiques DevOps et CI/CD; - Développer des interfaces entre différents...DatabricksWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Developer. Be the first to apply!
Related searches
- report developer Winnipeg, MB
- information developer Winnipeg, MB
- designer developer Winnipeg, MB
- junior developer Winnipeg, MB
- programmeur Winnipeg, MB
- interactive developer Winnipeg, MB
- java spring boot developer Winnipeg, MB
- remote developer Winnipeg, MB
- informatica developer Winnipeg, MB
- senior developer Winnipeg, MB

