Data Analytics Experts: Benchmark Evaluation Project
Terac
What You'll Do
Design benchmark evaluations based on real-world data analytics scenarios. Format complex data problems for systematic testing and review. Commit 20 or more hours per week to continuous project work.
Who Should Apply
Professional experience in data analytics or data science Familiarity with building evaluation metrics or benchmarks Ability to work remotely for 20 or more hours per week Comfortable working independently on complex data tasks
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $100
$1 350 per unit
...States | Canada + 23 more Help evaluate how AI systems approach... ...on Develop Linux-terminal benchmarking tasks grounded in your field,... ...interpreting evidence, analyzing data or testing a scientific workflow... ...Compensation and commitment The project pays $1,350 per task, with an...ProjectContract workInternship$1 350 per unit
...United States | Canada + 23 more Help benchmark AI systems by designing realistic tasks grounded... .... Compensation and commitment The project pays $1,350 per task, with an expected... ...Company: Senior Finance & Operations Experts - AI Benchmarking Location: Any time...ProjectContract work$80 per hour
...about your career, then matches you to projects like Analytics Manager. Keep your CV open and cover these... ...at least one BI/visualization tool Expert-level document, spreadsheet, and slide... ...dashboards, reporting pipelines, and data-driven business narratives to create, evaluate...ProjectHourly payWeekly payContract workImmediate startRemote workFlexible hours- ...a migration that silently drops rows, a data loader that leaks the test split, a stripped... ...Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography... .... - You can draw on your own research, projects, code, or files as the source material for...ProjectShift work
$1 350 per unit
...What you’ll work on Create practical benchmarks using workflows from your specialty, such... ...publication. Compensation and commitment The project pays $1,350 per task, with an expected... ...: Senior Media, Audio & Linguistics Experts - AI Benchmarking Location: Any time...ProjectContract work- ...in LLM Training, you will engage in qualitative and structured evaluations to enhance AI performance. Your key activities will include:... ...Duration Continuous / Fast-Moving New to LLM Training?These are projects where you use your technical expertise to help improve AI...ProjectContract workFreelanceFlexible hours
- ...Halluminate is hiring Data Analytics experts to design hard, real-world tasks and grading rubrics that train and evaluate frontier AI models on finance work. Pay $100–$200/hr, fully remote, 20+ hours per week, plus training milestones and performance bonuses. Paid as...Contract workFor contractorsRemote work
$75 - $90 per hour
...using a fictional insurer’s rules. Include the information an expert would need to make a decision. Work through each file... ...-on work is a plus. Experience writing or reviewing AI evaluation cases or training data is a plus. Contract details Remote freelance...Contract workFreelanceManual laborRemote work- ...an Entertainment & Pop Culture Evaluator, you will help refine AI... ...relevance. Content & Response Evaluation: Assessing AI-generated summaries... ..., outdated entertainment data, or halluncinated details, providing... ...New to LLM Training?These are projects where you use your technical...ProjectContract workFreelanceFlexible hours
$151k - $189k per year
...in 2014 by a team of financial experts and technology entrepreneurs,... ...role This role turns people data into the decisions that shape... ...Reporting to the Director, People Analytics, you will own that work end to... .... ~ Experience building and evaluating predictive models on messy...Long term contractFull time$80 per hour
...about your career, then matches you to projects like Data Engineer. Keep your CV open and cover these... ..., data engineer Direct experience evaluating model outputs or system readiness and... ...and documenting technical tradeoffs Expert-level document, spreadsheet, and slide...ProjectHourly payWeekly payContract workImmediate startRemote workFlexible hours- ...Our partner is looking for a Senior Data Scientist, People Analytics based in Canada . As a Senior Data Scientist... ...scalable data products. You will own projects end to end, from identifying business... ...methods and causal inference to evaluate talent density, performance...Project
- ...Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and... ...clarity and domain alignment. Response Evaluation: Assessing AI-generated fitness advice, workout... ...-Moving New to LLM Training?These are projects where you use your technical expertise to...ProjectContract workFreelanceFlexible hours
$80 per hour
...about your career, then matches you to projects like Director of Data Engineering. Keep your CV open and... ..., data engineer Direct experience evaluating model outputs or system readiness and... ...and documenting technical tradeoffs Expert-level document, spreadsheet, and...ProjectHourly payWeekly payContract workImmediate startRemote workFlexible hours$75 - $100 per hour
...60% Within 3 months ~80% Data Scientist Interview Prep... ...outperform simpler methods. I'd benchmark both against a holdout period... ...this role This Data Scientist Expert role pays $75â$100/hr for your... ...of invoice submission after a project closes. That net-30 schedule...ProjectHourly payContract workManual laborRemote work- ...license. Claim based on GitLab data. Fortune 100 refers to the top... ...at GitLab on the Enterprise Analytics team, you’ll be a trusted analytical... ...production - Design, run, and evaluate growth experiments (A/B tests... ...and pipeline automation, with evaluation and monitoring that keep agent...Long term contractFull time
- ...study guides, and educational scenarios to evaluate clarity, target audience alignment, and... ...instructional relevance. Response & Content Evaluation: Assessing AI-generated explanations,... ...-Moving New to LLM Training?These are projects where you use your technical expertise to...ProjectContract workFreelanceFlexible hours
usd168.3k - usd217.8k per year
...improvements. We help homeowners know which projects to do, when to do them and who to hire... ...ll build together. About the Business Analytics Team The Business Analytics team unlocks... ...strategy and team execution, and we use data to tell Thumbtack’s story to our team,...ProjectFull timeSeasonal workLocal area- ...This is a remote, project-based role for data scientists and product analysts with 3+ years of full time experience on a product team. You will author realistic product analytics problems drawn from the decisions you make at work, covering experiments, metrics, retention and...ProjectWeekly payOngoing contractFull timeContract workFor contractorsRemote work10 hours per week
- ...Evaluate AI responses for compliance with U.S. privacy laws and regulations. About... ...accelerating frontier research with high-quality data, advanced training pipelines, plus top... ...Privacy and Data Protection Law experts to join projects that fine-tune AI models like ChatGPT....ProjectPart timeFixed term contractFreelanceRemote workFlexible hours
$100 per hour
...Ethos's AI interviewer asks about your career, then matches you to projects like Special Projects Associate. Keep your CV open and walk... ...delivery from kick-off to sign-off Review and quality-control expert outputs daily before they reach the client Brief, onboard and...ProjectFull timeContract workFreelance- ...Design and execute evaluations for Large Language Models and agentic... ...frontier research with high-quality data, advanced training pipelines,... ..., researchers, and domain experts to measure model capabilities... ...AI systems are trained and benchmarked. This is a hands-on, research...ProjectContract workPart timeFor contractorsFreelanceRemote work
$55 - $85 per hour
...60% Within 3 months ~80% Data Analyst Interview Prep... ...55â$85/hr for a Data Analyst Expert because getting Software Engineering... ...Do I need to keep applying for projects on Ethos? No. Once your... ...draw on real domain judgment (evaluating outputs, correcting errors, or...ProjectHourly payContract workManual laborRemote work- ...Research and build benchmark tasks to expose AI model weaknesses.... ...frontier research with high-quality data, advanced training pipelines,... ...We are seeking an analytical researcher and red-teaming specialist... ...work will directly shape AI evaluation frameworks, ensuring next-generation...ProjectPart timeFor contractorsLocal area
$125 per hour
...Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering... ...& Robotics Expert Related jobs Data Science Consultant Expert ethos ⢠Software... ...Do I need to keep applying for projects on Ethos? No. Once your profile is live...ProjectHourly payContract workRemote work- ...This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes... ...and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning...ProjectHourly payContract workFor contractorsRemote workFlexible hours
- ...AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring data scientists as contractors to author and solve the analysis problems those evaluations run on, drawn from the work you do every day: experiments, metrics...Contract workFor contractorsRemote work
$50 - $100 per hour
...assessment operational planning analytical methodologies critical... ...scenario development evaluating ai-generated content handling... ...About micro1 micro1 is a data lab that helps AI labs & Enterprises... ...agent sources and vets domain experts for our data platform that...ProjectPart timeFor contractorsRemote work$22 - $28 per hour
...Canada + 23 more AI Model Benchmarking Intern (Remote, Iowa-Based)... ...cases. Create representative evaluation datasets, test cases, scoring... ...APIs through coursework or projects. Logical, evidence-based thinking... ...working with structured data and evaluation criteria....ProjectContract workTemporary workPart timeInternshipRemote workFlexible hours$100 per hour
...asks about your career, then matches you to projects like Consulting Engagement Manager /... ...(e.g. McKinsey, BCG, or Bain) to create, evaluate, and refine AI-generated presentations and... ...-controlling full client deliverables Expert-level PowerPoint and slide craftsmanship,...ProjectHourly payWeekly payContract workImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analytics Experts: Benchmark Evaluation Project. Be the first to apply!
