Tooling Engineer
Part-time
Turing
Create complex prompts to assess and improve LLM performance.
About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
About the Role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Key Responsibilities
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence-based feedback to improve model performance.
Minimum Qualifications
- Master’s degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical-thinking abilities.
- Exceptional attention to detail.
Preferred Qualifications
- Experience working with LLMs or Generative AI.
- Familiarity with prompt engineering, AI evaluation, or model testing.
- Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.
Ideal Candidate
The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.
Skills: Business Analysis
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Tooling Engineer in Remote vacancy
- ...and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster... ...fit right in. About the Role We are looking for a Systems Engineer to help build and manage tools that help engineers deploy and operate...SuggestedFull timeInternshipLocal areaFlexible hours
- ...schematic capture through PCB layout to manufacturing outputs in your tool. Run design-rule checks, verification and troubleshooting for... ...). Background as an electronics, hardware or PCB layout engineer. Experience with multi-layer boards and manufacturing packages...SuggestedHourly payContract workFor contractorsRemote work
- ...The role You will build and improve the WebCompat team’s internal tooling, the dashboards and the broken-site-report screenshot pipeline the team relies on to triage and prioritize site breakage. This is a focused tooling role that makes the WebCompat program faster and more...SuggestedFull timeContract work
- ...get up and running quickly to major corporations with tens of thousands of users. That’s why people love us . We bring data tools with the elegance and simplicity of consumer products to the crufty world of enterprise business intelligence. We provide an...SuggestedFull time
- ...investors, and is now valued at $6,5 billion. We’re looking for a Staff Engineer to work on high-impact projects in a high-growth environment,... ...Core Backend, building shared services, libraries, and developer tools used by engineering teams across Tabby. Identify common...SuggestedFull timeContract workTemporary workRemote workRelocation packageFlexible hours
- ...applications and next steps. Our partner is looking for an Integration Engineer based in Canada . In this fully remote role, you will help e-... ...onboarding materials, and integration workflows. - Use debugging tools, browser developer tools, API clients, and logs to investigate...Full timeRemote workWorldwide
- ...applications and next steps. Our partner is looking for a Director, Engineering based in Canada. The Director, Engineering will lead a multi-... ..., product and process engineering, manufacturing engineering, tooling, automation, and technical support. This strategic leadership...Full time
- ...applications and next steps. Our partner is looking for a Platform Engineer based in Canada . Role Overview Join a fast-growing technology... ...designing, building, and maintaining the cloud infrastructure, internal tools, and systems that enable engineering teams to deliver reliable...Long term contractFull timeRemote workWorldwide
- ...specialists are leveling up. Now we’re looking for talented DevOps Engineer ready to grow with us. Your impact: Manage and... ...resource utilization. Generate ideas to explore new technologies, tools that can enhance the efficiency of team. Improve CI/CD...Full timeWork at officeRemote workFlexible hours
- ...applications and next steps. Our partner is looking for an Onboarding Engineer based in Canada. We are seeking an Onboarding Engineer to lead... ...to detail. - Familiarity with CRM integrations, particularly Salesforce or HubSpot, or comparable enterprise tools, is an advantage....Long term contractFull time
- ...defining observability and raising expectations of what developer tools can do! We’re working with well known companies like HelloFresh,... ...itself. Honeycomb created this category, and we want our next engineering leader to help us lead its reinvention. The role You’ll join the...Full timeRemote workShift work
- ...infrastructure. Learn more at: We are currently hiring Staff Engineers for two TuxCare products: KernelCare and SecureChain .... ..., and changing requirements. Research relevant technologies, tools, market approaches, and competitor solutions when needed. Contribute...
- ...Responsibilities Support internal business units by building shared engineering services, tools, and processes. Own infrastructure projects end to end while collaborating with stakeholders and internal customer-facing teams. Improve observability through metrics,...Remote workFlexible hours
$114.5k - $148k per year
...to reverse metabolic disease in one billion people. As a Backend Engineer, you’ll build reliable systems, improve data accuracy across... ...to find someone who brings an AI-augmented mindset, using modern tools and techniques to enhance development workflows and spot opportunities...Long term contractFull timeWork at officeRemote work$108.4k - $126.5k per year
...The Role, Integrations Engineer I - this role is based for applicants located in Canada SiteDocs, a GoCanvas company, is a leading provider... ...at scale. Test, debug, and validate integrations using tools such as Postman to ensure solutions perform reliably before deployment...Long term contractFull timeRemote work$40 - $125 per hour
...Overview DataAnnotation is looking for an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and... ...become the signal that shapes the next generation of engineering tools. What you’ll actually do Design challenging, realistic engineering...Weekly payFull timeContract workFor contractorsInternshipRemote workFlexible hours- ...company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google... ...You will be expected to work a large spectrum of technology and tools, including public cloud platforms, AI and LLMs, Kubernetes, data...Full timeContract workTemporary workRemote work
$40 - $150 per hour
...3am. Reasoning about the whole system is the job. As a DevOps Engineer you'll evaluate how models handle CI/CD, infrastructure-as-code,... ...-as-code, or cloud operations. Comfort with a major cloud and tools like Terraform, Kubernetes, or Docker. Clear written English:...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$40 - $125 per hour
...Weekly Overview We’re looking for an experienced Validation Engineer to help train AI models. You’ll write hard, verifiable... ...aerospace, HVAC, robotics, energy, or related fields. ~ Fluency in the tools of your specialty, such as CAD (SolidWorks, Fusion 360, Onshape,...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$65 per hour
...Pay: up to $65/hour As a C++ Engineer, you will work remotely on an hourly paid basis to review AI-generated C++ code, systems designs... ...systems, compilers, linkers, debuggers, and profiling or analysis tools. ~ Minimum C1 English proficiency (written and spoken), with the...Hourly payContract workFor contractorsImmediate startRemote workWorldwide$60 per hour
...Pay: up to $60/hour As a Senior Python Engineer, you will work remotely on an hourly paid basis to review AI-generated Python solutions... ...library, and common ecosystems such as web frameworks, data tooling, or backend services. ~ Strong understanding of algorithms, data...Hourly payContract workFor contractorsManual laborRemote work$100 per hour
...Pay: up to $100/hour If you are an electrical engineer who thrives on technical precision, applied problem-solving, and rigorous reasoning... ...technical content is a strong plus. ~ Familiarity with tools/artifacts such as schematics, SPICE simulation, MATLAB/Simulink,...Contract workManual labor$55 per hour
...Pay: up to $55/hour As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code... ...required. ~ Highly preferred: experience with frameworks and tools such as Ruby on Rails, Sinatra, and RSpec in real projects. ~ Preferred...Hourly payContract workImmediate startRemote work$60 per hour
...Pay: up to $60/hour As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations... ...experience in at least one of backend services, command-line tools, or systems programming using Rust. ~ Ability to evaluate safe,...Hourly payContract workImmediate startRemote work$60 per hour
...Pay: up to $60/hour As an hourly paid, fully remote Go Engineer for AI Data Training, you will review AI-generated Go code and explanations... ...exposure, and familiarity with Go performance profiling tools and techniques. Skills: profiling, concurrency, English, Golang...Hourly payContract workImmediate startRemote work$65 per hour
...you will review AI-generated responses and/or generate C#/.NET engineering content, evaluating reasoning quality and step-by-step problem-... ...Dapper). ~ Experience with modern engineering practices and tooling (Git, CI/CD, Docker). ~ Strong advantage: experience solving...Hourly payContract workFor contractorsImmediate startRemote work$100 per hour
...Pay: up to $100/hour If you are a chemical engineer who thrives on technical precision, applied problem-solving, and real-world process... ...generated technical content is a strong plus. ~ Familiarity with tools and artifacts such as PFDs/P&IDs, Aspen Plus/HYSYS, CHEMCAD,...Contract workManual labor- ...Build Python backend applications that replicate existing SaaS tools. Urgent hire: ASAP start, 4 week contract. Applications reviewed... ...through high-quality training data, evaluations, and engineering talent. We are staffing a frontier AI data initiative building the...Contract workPart timeFor contractorsImmediate start
- ...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work.... ...experience. Experience with test automation, CI/CD or developer tooling. Prior LLM evaluation or data annotation experience....Hourly payFor contractorsRemote work
- ...pay Required Skills CFD engineering Aerodynamics fluid-dynamics About micro1 micro1 is the leading AI data lab for training... ...fluid flow, heat-transfer, and multiphysics problems using CFD tools, cross-referencing with experimental or analytical data. Familiarity...Part timeFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tooling Engineer. Be the first to apply!
