Senior Databricks Engineer - Revenue Cycle Management
Aarista Technologies
We are seeking a
Senior Databricks Engineer
to design, build, and optimize large-scale data pipelines powering our healthcare
Revenue Cycle Management
platform. You will own end-to-end data engineering across EDI claim processing (837, 835, 277, 999), remittance workflows, AI-driven medical coding, and real-time operational data delivery using the
Medallion architecture on Azure Databricks.
Key Responsibilities:
Design & maintain production data pipelines using PySpark and Scala on Azure Databricks, processing healthcare EDI transactions (837 Claims, 835 Remittances, 277/999 Acknowledgments)
Implement and optimize Delta Lake tables with ACID transactions, Z-ordering, partitioning strategies, and data versioning (time travel) for petabyte-scale healthcare data
Build MongoDB sync pipelines to deliver Gold-layer data into operational MongoDB collections for real-time application access
Develop/Maintain Scala-based reporting and workflow orchestration engines, including dynamic report generation, AP analysis, and notification triggers
Integrate with Azure ecosystem: Azure Blob Storage, Azure Data Lake, Azure AD, Azure DevOps CI/CD pipelines, and Databricks Unity Catalog
Manage multi-tenant data architectures with per-client configurations, secrets management (Databricks secrets scopes), and feature flag-driven rollouts
Build and maintain SQL Server integrations via JDBC for workflow metadata, feature flags, report configurations, and state management
Implement data quality frameworks with validation layers at each pipeline stage (patient info, diagnosis codes, CPT codes, facility mappings, rendering providers)
Write ad-hoc data correction, migration, and backfill scripts for production data reconciliation
Participate in code reviews, PR validation pipelines, and engineering best practices (commit/lint, conventional commits)
Required Skills & Qualifications:
Core:
6–7 years of data engineering experience with 3+ years on Databricks/Spark
Languages:
Proficient in PySpark (primary) and Scala/Spark;
Python 3.11+
Data Lake:
Deep expertise in Delta Lake — medallion architecture, ACID transactions, schema evolution, Z-ordering, partition pruning
Databases:
Production experience with MongoDB (aggregation pipelines, indexing, bulk sync) and SQL Server (JDBC, stored procedures)
EDI/Healthcare:
Familiarity with HIPAA EDI standards (X12 837, 835, 277, 999) or willingness to learn quickly
DevOps:
Azure Pipelines (YAML), CI/CD for Databricks artifacts, PR validation
Data Quality:
Experience implementing validation frameworks, data reconciliation, and error tracking
Preferred Qualifications:
Experience in healthcare/RCM domain — claims lifecycle, payer/provider workflows, CPT/ICD-10 coding would be a plus
Hands-on with Databricks Unity Catalog for data governance
Exposure to AI/ML integration in data pipelines — LLM orchestration, model observability (Langfuse or similar)
Experience with feature flag systems for gradual data pipeline rollouts
Performance tuning Spark jobs at scale (shuffle optimization, broadcast joins, adaptive query execution)
What You'll Impact:
Process thousands of healthcare claims daily across multiple clients
Reduce claim processing time through pipeline optimization
Enable AI-powered medical coding that improves coder productivity
Deliver real-time operational dashboards for revenue cycle teams
Ensure HIPAA-compliant data processing at every layer
#J-18808-Ljbffr
Senior Databricks Engineer
to design, build, and optimize large-scale data pipelines powering our healthcare
Revenue Cycle Management
platform. You will own end-to-end data engineering across EDI claim processing (837, 835, 277, 999), remittance workflows, AI-driven medical coding, and real-time operational data delivery using the
Medallion architecture on Azure Databricks.
Key Responsibilities:
Design & maintain production data pipelines using PySpark and Scala on Azure Databricks, processing healthcare EDI transactions (837 Claims, 835 Remittances, 277/999 Acknowledgments)
Implement and optimize Delta Lake tables with ACID transactions, Z-ordering, partitioning strategies, and data versioning (time travel) for petabyte-scale healthcare data
Build MongoDB sync pipelines to deliver Gold-layer data into operational MongoDB collections for real-time application access
Develop/Maintain Scala-based reporting and workflow orchestration engines, including dynamic report generation, AP analysis, and notification triggers
Integrate with Azure ecosystem: Azure Blob Storage, Azure Data Lake, Azure AD, Azure DevOps CI/CD pipelines, and Databricks Unity Catalog
Manage multi-tenant data architectures with per-client configurations, secrets management (Databricks secrets scopes), and feature flag-driven rollouts
Build and maintain SQL Server integrations via JDBC for workflow metadata, feature flags, report configurations, and state management
Implement data quality frameworks with validation layers at each pipeline stage (patient info, diagnosis codes, CPT codes, facility mappings, rendering providers)
Write ad-hoc data correction, migration, and backfill scripts for production data reconciliation
Participate in code reviews, PR validation pipelines, and engineering best practices (commit/lint, conventional commits)
Required Skills & Qualifications:
Core:
6–7 years of data engineering experience with 3+ years on Databricks/Spark
Languages:
Proficient in PySpark (primary) and Scala/Spark;
Python 3.11+
Data Lake:
Deep expertise in Delta Lake — medallion architecture, ACID transactions, schema evolution, Z-ordering, partition pruning
Databases:
Production experience with MongoDB (aggregation pipelines, indexing, bulk sync) and SQL Server (JDBC, stored procedures)
EDI/Healthcare:
Familiarity with HIPAA EDI standards (X12 837, 835, 277, 999) or willingness to learn quickly
DevOps:
Azure Pipelines (YAML), CI/CD for Databricks artifacts, PR validation
Data Quality:
Experience implementing validation frameworks, data reconciliation, and error tracking
Preferred Qualifications:
Experience in healthcare/RCM domain — claims lifecycle, payer/provider workflows, CPT/ICD-10 coding would be a plus
Hands-on with Databricks Unity Catalog for data governance
Exposure to AI/ML integration in data pipelines — LLM orchestration, model observability (Langfuse or similar)
Experience with feature flag systems for gradual data pipeline rollouts
Performance tuning Spark jobs at scale (shuffle optimization, broadcast joins, adaptive query execution)
What You'll Impact:
Process thousands of healthcare claims daily across multiple clients
Reduce claim processing time through pipeline optimization
Enable AI-powered medical coding that improves coder productivity
Deliver real-time operational dashboards for revenue cycle teams
Ensure HIPAA-compliant data processing at every layer
#J-18808-Ljbffr
Vacancy posted 56 minutes ago
Similar jobs that could be interesting for youBased on the Senior Databricks Engineer - Revenue Cycle Management in Winnipeg, MB vacancy
- ...industry veterans. About this Role Vogo is seeking a Senior Manager, Pricing & Revenue Optimizatio n to build and own our hotel pricing and... ...expert for wholesale pricing and work closely with Engineering, Data Science, Product, Partnerships, and Finance to turn...SeniorFull timeRemote workWorldwide
- ...Description Role OverviewWe are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to... ...patterns (e. g., ADLS Gen2, AWS S3). Governance & Access Management: Proven track record designing and managing Databricks...DatabricksSenior
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes recruitment... ...development, and process efficiency. As an Engineering Manager, you will oversee a full stack engineering team and ensure...DatabricksLong term contract
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length... ...enterprise coding, security, architecture and release-management standards. Use Git-based repositories and established CI...DatabricksSeniorContract workWork at office2 days per week
- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksSeniorContract work
- ...to accept payments, grow their revenue, and accelerate new business... ...product areas and helps businesses manage and scale their revenue... ...builds the foundational execution engines, background job processing... ...from global recurring billing cycles to complex time-dependent execution...Long term contractWorldwide
- Montreal-based Senior Databricks Platform Engineer specializing in Lakehouse automation, Unity Catalog governance, and reliable remote platform operations.This contract role owns enterprise Databricks environments across development, test, and production. You will build reusable...DatabricksSeniorContract workRemote work
- Databricks expertise meets customer intelligence at Xplore Inc. in this hands-on technical lead role, focused on gold-layer data and AI-ready analytics foundations.As Senior Intelligence Analytics Engineer, you will design curated datasets, validate pipelines, and build production...DatabricksSenior
- Work with Databricks, Azure, and Claude at BCI, delivering AI-powered solutions for Private Equity in Victoria or Vancouver.In this Senior Software Engineer role, you will replace manual processes with agentic workflows and internal applications. You will build LLM-powered tools...DatabricksSenior
$84k - $128k per year
...Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services... ...Consulting experience and excellent communication and client management skills. The expected range of compensation for this role...DatabricksSeniorManual laborWork at officeLocal areaFlexible hours- ...collaborative and inclusive culture, well positioned for its next phase of growth.The Opportunity: Reporting to the Director of Revenue Management, you will drive pricing and trade spend optimization to accelerate gross margin, net sales and market share. Using data and...SeniorLong term contractImmediate start
$131k - $163.75k per year
...Lead the Future of Snacking. Make It With Pride.As a Category Revenue Growth Manager, you will own the end-to-end RGM agenda for your assigned... ...; apply learnings to continuously improve future planning cycles.Approve promotional activity in line with guidelines and conduct...SeniorWork at officeLocal areaRemote workRelocation packageMonday to fridayFlexible hoursShift work- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office... ...weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale... ...PlatformEnterprise leadership and stakeholder management experienceBring Databricks, Spark,...DatabricksSeniorWork at office
$130k - $140k per year
...purpose-built platform is the growth engine for heavy equipment dealerships and rental... ...CRM, Equipment-Aware Service Management, and Intelligent Rental Management - extended... ...Learn more at Role We're hiring a Senior Manager, Revenue Operations to lead & own the systems,...SeniorLong term contractRemote work- Lead revenue accounting with ASC 606 expertise at Greenhouse, working remotely... ...complex technical accounting.As Senior Revenue and Technical Accounting Manager, you will own end-to-end revenue accounting... ...with Product, Legal, Sales Engineering, FP&A, and RevOps. The role begins...SeniorContract workRemote work
- ...emails, Slack, and CRM notes to give reps and managers the context and signals they need at each... ...role. RevOps, Sales Ops, GTM Engineering, BizOps, strategy consulting, data or analytics... ...spend your time on the work that moves revenue.Builder mindset. You’d rather have a working...SeniorRemote work
- Build finance data platforms with Databricks, PySpark, and advanced SQL in a hybrid role requiring four days weekly onsite in downtown... ...data into trusted reporting foundations.Jarvis is hiring a Senior Data Engineer for a financial services client. You will own finance data...DatabricksSenior
- Build reliable machine learning systems as a Senior MLOps Engineer in Canada, using Databricks, AWS, Python, and automated pipelines. Shape production model operations.Fluent Media seeks a Senior MLOps Engineer for its data and machine learning team. You will co-own MLOps practices...DatabricksSenior
- Build AI-enabled Databricks operations remotely from Canada with Mosaic AI, Model Serving, Vector Search, and platform engineering expertise.Mindtris seeks a Senior Databricks Data Platform Engineer for a one-year contract with possible extension. This platform engineering...DatabricksSeniorContract workRemote work
- Azure and Databricks expertise define this Site Reliability Engineer IV contract in Toronto. Work four days onsite and one day remotely each week.This senior engineering assignment supports a brand-new enterprise initiative. You will architect Azure infrastructure, administer...DatabricksSeniorContract workRemote work1 day per week
- Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms....DatabricksSenior
- ...Fluent, LLC in Canada is seeking a Senior MLOps Engineer to co-own MLOps practices, establishing standards for deployment, serving, scaling and cost-efficient infrastructure. You will work with ML scientists, Data Engineering and Product to ensure reliable production systems...DatabricksSenior
- Shape client data initiatives at BDO through Databricks architecture, stakeholder communication, and hands-on cloud data engineering.BDO Digital seeks a Senior Data Engineer who can lead client engagements while delivering robust analytics and machine learning data solutions...DatabricksSenior
- Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto... ...office. Shape cloud solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production deployment...DatabricksSeniorWork at office
- Turn sales, pricing, and market data into decisions as Metergy’s senior revenue operations leader across Canada and the United States.This Senior Manager owns forecasting, pipeline governance, performance reporting, and sales systems requirements. The role partners with Sales...Senior
- Drive pricing and trade spend optimization as a Senior Revenue Manager in Canada’s leading branded food category. Use predictive analytics and price elasticity to shape growth.Reporting to the Director of Revenue Management, you will develop pricing, promotion, and trade investment...Senior
- Elevate your career at Saputo as a Senior Director of Revenue Management for North America. Drive sustainable growth by managing revenue strategies across diverse customers and markets. At Saputo, you will lead the revenue management agenda, focusing on pricing, trade, and...Senior
- Lead GTM and revenue finance at Cohere, using forecasting and financial modeling to guide enterprise AI growth. This is a remote-friendly opportunity.As Senior Manager, you will lead analysts within Strategic Finance and own the revenue line. You will support the CFO, CRO, and...SeniorRemote work
- Drive pricing strategy and revenue growth for Asahi Canada as Senior Manager, Commercial Finance & Revenue Growth, applying advanced analytics across Canada.This senior finance leader owns Commercial Revenue Growth Management for Asahi Canada. The work connects pricing, trade...SeniorLong term contract
$173.69k - $227.96k per year
...foster an inclusive, growth-driven work environment. Ready to bring your best? Overview of the role:Saputo is seeking a Senior Director, Revenue Management – North America. The Senior Director, Revenue Management leads Saputo North America’s revenue management agenda across...SeniorWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Databricks Engineer - Revenue Cycle Management. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

