Remote Data Labeling Jobs in Ottawa

About Rex.zone

Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.

What You Will Do

• Label and review text, image, audio, or video data using project-specific annotation tools and taxonomies.
• Follow annotation guidelines compliance requirements and document edge cases for consistent decision-making.
• Complete RLHF tasks such as preference ranking, pairwise comparisons, and rubric-based scoring for LLM outputs.
• Perform prompt evaluation and response grading for helpfulness, correctness, and safety.
• Execute QA evaluation by auditing samples, measuring inter-annotator agreement, and escalating ambiguity.
• Apply named entity recognition (NER) labels and structured extraction schemas for NLP datasets.
• Support computer vision annotation (bounding boxes, segmentation masks, keypoints) when assigned.
• Contribute to content safety labeling for policy categories (hate, harassment, self-harm, sexual content) as required.
• Provide feedback to improve guidelines, reduce ambiguity, and increase throughput without sacrificing quality.

Required Qualifications

• Mid-Senior experience with data labeling or data annotation in AI/ML production settings.
• Experience with LLM evaluation workflows (RLHF, prompt evaluation, or QA evaluation).
• Strong written communication and structured reasoning for labeling rationale and dispute resolution.
• Comfort working remotely with asynchronous collaboration, quality targets, and audit-driven processes.

Compensation

$30–$50/hr (USD) .