GenAI Security Evaluation Engineer (Up to $150/hr)
$150 per hourPart-time
Turing
Evaluate security tools for vulnerabilities in GenAI applications.
About Turing
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Offer Details
- Required commitment: At least 4 hours per day, minimum 20 hours per week, with 4 hours of overlap with Pacific Time.
- Engagement type: Contractor
- Engagement length: Up to 2 weeks
- Pay up to $150/hr depending on internal evaluation and location.
About the Role
We’re looking for experienced security engineers to evaluate how effectively static analysis tools detect vulnerabilities in GenAI applications.
You’ll build small, runnable agent and RAG codebases containing realistic examples of Sensitive Information Disclosure and Excessive Agency, along with fixed and near-miss versions. You’ll then trace, annotate, test, and explain each finding.
What You’ll Do
- Build runnable agent/RAG repositories with code-reachable Sensitive Information Disclosure or Excessive Agency vulnerabilities across tool calling, memory, and MCP.
- Create vulnerable, fixed, and hard-negative variants with minimal security-relevant differences.
- Trace and annotate assets, data/action paths, controls, root causes, severity, and residual risk.
- Define authorization contexts and write deterministic tests validating vulnerable, fixed, and negative behavior.
- Recommend security controls and participate in calibration and peer review.
What We’re Looking For
- 5+ years in application/product security or security-focused software engineering, including secure code review.
- Experience with source-to-sink analysis, taint analysis, SAST, CodeQL, or Semgrep.
- Hands-on experience building LLM agents or RAG systems using frameworks such as LangChain, LlamaIndex, OpenAI/Anthropic SDKs, or MCP.
- Strong authorization knowledge, including actors, trust boundaries, tenants, OAuth, IAM, identity, permitted data/actions, purposes, recipients, and document-level access control.
- Production coding experience in Python and/or TypeScript, with strong judgment in distinguishing genuine SID/EA findings from non-findings.
Experience with OWASP LLM security risks, MCP, threat modeling, or security evaluation is a plus.
Evaluation Process
- AI interview (~25 minutes)
- Resume and overall application review
- Offer
Skills: Cyber Security, LLM, Code Reviews, Code Analysis
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the GenAI Security Evaluation Engineer (Up to $150/hr) in Remote vacancy
$150 per hour
...total 40 hours spread across 4 weeks. Engagement type: Contractor Engagement length: 4 weeks Pay up to $150/hr depending on internal evaluation and location. About the Role Turing invites Finance and Accounting Experts to join projects that fine-tune AI...SuggestedPart timeFor contractors$75 - $90 per hour
...Rate: $75 – $90/hr Hours: 20 hours / week Experience: 5 - 10 years Location... ...Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security...SuggestedLong term contractContract workRemote work$40 - $125 per hour
...whole system, and that someone is you. As an Application Security Engineer you'll evaluate how models reason about secure design and vulnerabilities,... ...where you learned it. Compensation Up to $40 – $125+/hr depending on task difficulty and specialization. Many contributors...SuggestedWeekly payFull timeContract workFor contractorsRemote workFlexible hours- ...Lead teams to create and evaluate realistic LLM conversational data. About Turing... ...Role Overview We are looking for an Engineering Manager to lead teams creating high-quality... ...teams to deliver reliable training and evaluation datasets. What You’ll Do ~Lead and...SuggestedContract workPart timeFreelanceRemote work
- ...Join Zeely as a Security Engineer and help us protect our products, infrastructure, and data as we scale. This is a hands-on role: you’ll find and fix vulnerabilities, close security tickets yourself, and help us defend against attacks. You’ll work closely with Secutity Officer...SuggestedFull timeRemote workWorldwide
- ...: benign, dual-use, and adversarial. Evaluate the responses that come back against a defined... ...licensee Physical protection system engineering — sensors, barriers, delay, response... ...reliability programme work Nuclear security policy, training or international assistance...Part time
- ...will fit in here. Job Description: As a Senior Generative AI Engineer, you will lead the design and deployment of advanced AI... ...applications. Ensure that LLM deployments are scalable, efficient, and secure. Monitor and optimize model performance in production...Contract workRemote work
- ...optimization pentesting Security audit cybersecurity... ...training frontier models and evaluating AI agents. Experts contribute... ...as finance, healthcare, STEM engineering, and more. micro1 transforms... ...high-quality training data, evaluations, and feedback loops that improve...Part timeFor contractorsRemote workFlexible hours
- ...optimization pentesting Security audit About micro1... ...training frontier models and evaluating AI agents. Experts contribute... ...as finance, healthcare, STEM engineering, and more. micro1 transforms... ...high-quality training data, evaluations, and feedback loops that improve...Part timeFor contractorsInternshipRemote workFlexible hours
- ...Evaluate and refine AI-generated code for efficiency and reliability... ...Overview As a Software Engineering evaluator, you will create cutting... ...skills for clear, structured evaluation rationales. Offer Details... ...engagement, minimum 10 hrs/week, up to 40 hrs/week (partial...Full timePart timeFor contractorsFlexible hours
$175k - $230k per year
...applications and next steps. Our partner is looking for an Application Security Engineer based in Canada. Join a security-focused engineering team working to protect payment infrastructure and enable secure, scalable digital commerce. In this role, you will shape application...Full timeRemote workusd15 per hour
...to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people. Using your search expertise, you will work through a variety of...Weekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours- ...products. Build and evolve authorization platforms that enforce secure access to product capabilities and customer data. Develop... ...patterns and controls and provide repeatable security guidance to engineering teams. Partner with product and engineering teams to...Long term contractFull timeTemporary workWork at office
- ...applications and next steps. Our partner is looking for a Software Engineer, Securities Finance based in Canada . We are looking for a backend-... ...modes. - Ability to design clear, effective RESTful APIs and evaluate existing API designs critically. - Experience taking software...Long term contractFull time
- ...collaborative workflows. The Role Pantheon's Security Engineering team is responsible for safeguarding,... ...design and build high-performing, secure applications by mitigating security issues... ...DLP & Secrets: Define DLP policies and evaluate tooling; execute credential and secrets...Full time
- ...people who want to help us build something truly special. About the security team Security at Shakepay is a company-wide responsibility,... ..., and emerging areas such as AI security. We work closely with Engineering, Platform, Risk, Compliance, and Product to build pragmatic...Long term contractFull time
- ...a research cohort of senior domain experts in security — spanning cryptanalysis and reverse engineering — to help evaluate how frontier AI models reason about hard, real... ...world expert-level problems. This is research-and-evaluation work, not production engineering: you'll be...Contract work
- ...About the Role We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up... ...source GitHub projects. Prepare repositories for evaluation, including containerisation and environment...Hourly payFor contractorsRemote work
- ...We are hiring skilled software engineers with strong full-stack experience. The ideal candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation...Contract work
- ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world... ...into high-quality training data, evaluations, and feedback loops that improve how AI...Part timeFor contractorsRemote work
$176k - $226k per year
...level individual contributor role and the technical lead for the Security Engineering team behind Coalition Control, the platform that helps our... ...identification before an offer is accepted through our secure systems. If you believe you’ve been a victim of fraudulent recruiting...Full timeFixed term contractWork at officeRemote workHome officeFlexible hours- ...Back to jobs New Senior Security Engineer Remote, Canada Apply At Shakepay, we’re on a mission to usher in the Bitcoin golden age. We’re reimagining financial services to give every Canadian their fair shake. Our culture is built around doing work that matters, winning as...Long term contractFull timeRemote work
- ...improve AI-generated code for quality and security. About Turing: Turing is one of... ...through high-quality training data, evaluations, and engineering talent. About the Role We are... ...generated code, ensuring that it is correct, secure, maintainable, scalable, and aligned...Contract workPart timeFor contractors
- ...Responsibilities Own and deliver application security work within defined projects or domains. Identify, prioritize, and help remediate application security risks with engineering teams. Apply secure-by-default patterns and approved architectures in system design and...Full time
$158k - $237k per year
...Menlo Security is the leader in Browser Security for human and agentic workforces. Our mission... ...looking for a forward-thinking Security Engineer to join our security team, focused on... ...SameSite cookies, Subresource Integrity), secure authentication/authorization patterns (OAuth...Full timeLocal areaImmediate start- ...together. The Role: Monarch is seeking a Senior Application Security Engineer to join our Security Engineering team during a period of rapid... ...role is critical in ensuring our application layer remains secure and resilient as we handle increasingly sensitive financial...Full timeInternshipWork at officeImmediate startRemote workWork from homeWeekend work
$160.32k - $200.4k per year
...That said, every hiring decision is made by real Twilions! . See yourself at Twilio Join the team as Twilio’s next Staff Engineer, Security Engineering Partners. About the job We are actively recruiting for this role to fill an existing vacancy. This position is...Full timeLocal areaRemote workWorldwide- ..., improve operational efficiency, reduce security and compliance risk, and accelerate digital... ...100* trust GitLab to ship better, more secure software faster. The same principles built... ...findings. As a Senior Security Risk Engineer, you'll take ownership of risk identification...Full time
- ...surrounded by people who challenge, support, and inspire you to be the best version of yourself. The Role We're hiring a Senior Product Security Engineer to build and operate the modern security tooling pipeline that underpins everything our Product Security team does. You'll...Full time
$60 - $100 per hour
...$100/hour Commitment: Hourly, ~20 h/week Field: Other Engineering About the Role Mercor is partnering with a leading AI lab... ...Graphics, or a related field Prior AI training, benchmark, or evaluation work, or heavy daily use of AI coding agents Role Highlights...Hourly payContract workFreelanceImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GenAI Security Evaluation Engineer (Up to $150/hr). Be the first to apply!
