Senior Data Platform Engineer Ai
LawZero
Architect petabyte-scale data platforms for frontier models at LawZero, combining distributed systems expertise with reliable, traceable processing. Based in Montreal, this work supports research-driven AI development.As a Senior Data Platform Engineer, you will build and maintain the data engine powering next-generation frontier models. You will treat the platform as an internal product for researchers, while evolving its technical environment with Research and Product teams. Your work spans automated pipelines, resource efficiency, and reproducibility.Key Responsibilities:
Scale and automate petabyte-scale data processing operationsDesign execution layers for varied pipeline stagesOptimize compute resources, including GPU accessBuild recovery, restartability, and pipeline observabilityVersion datasets and document complete transformation lineageRequirements:
Bachelor's degree in computer science or related field5+ years managing distributed data processing systemsRecent experience with Ray, Spark, or workflow orchestratorsExperience optimizing throughput and cost across workloadsExperience with dataset versioning and reproducibility toolingBring distributed data engineering, GPU optimization, and lineage expertise to LawZero's frontier-model research platform.
#J-18808-Ljbffr
Scale and automate petabyte-scale data processing operationsDesign execution layers for varied pipeline stagesOptimize compute resources, including GPU accessBuild recovery, restartability, and pipeline observabilityVersion datasets and document complete transformation lineageRequirements:
Bachelor's degree in computer science or related field5+ years managing distributed data processing systemsRecent experience with Ray, Spark, or workflow orchestratorsExperience optimizing throughput and cost across workloadsExperience with dataset versioning and reproducibility toolingBring distributed data engineering, GPU optimization, and lineage expertise to LawZero's frontier-model research platform.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Platform Engineer Ai. Be the first to apply!
Related searches
- junior data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
