Senior Data Labeling Specialist (Montreal)

Senior Data Labeling Jobs in Montreal (Remote) — Rex.zone Rex.zone is hiring a Senior Data Labeling Specialist to improve training data quality for modern AI systems. This full-time, remote role supports LLM training pipelines through expert labeling, RLHF evaluation, prompt evaluation, and QA evaluation. What You Will Do Label and review complex datasets for NLP and computer vision annotation, including content safety labeling Perform RLHF-style tasks: preference ranking, pairwise judgments, and rubric-based scoring Run QA evaluation to audit agreement, catch systematic errors, and enforce annotation guidelines compliance Complete NLP tasks such as named entity recognition, intent/sentiment classification, and span annotation Support CV workflows: bounding boxes, polygons, keypoints, segmentation masks, and video frame review Document edge cases, propose guideline updates, and improve labeling operations over time Required Qualifications Experience in data labeling / data annotation operations with strong quality ownership Ability to apply detailed rubrics and follow versioned guidelines consistently Comfort evaluating LLM outputs for helpfulness, harmlessness, and policy adherence Strong judgment, clear documentation, and ability to meet throughput and accuracy targets in a remote setting Preferred Qualifications Experience with large language model evaluation, RLHF, and prompt evaluation Exposure to content policy interpretation and escalation workflows Experience reviewing others’ work and improving QA evaluation processes Pay Competitive hourly rate: $30–$50 per hour (USD).

The specialist will label and review complex NLP and computer vision datasets to improve AI training data quality. Responsibilities include performing RLHF tasks, running QA evaluations, and documenting edge cases to refine annotation guidelines.

Candidates must have experience in data labeling operations with a strong focus on quality and the ability to apply detailed rubrics. Proficiency in evaluating LLM outputs for helpfulness and policy adherence is required.

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Data Labeling
• RLHF
• NLP
• Computer Vision
• Prompt Evaluation
• QA Evaluation
• Named Entity Recognition
• Sentiment Classification
• Content Safety Labeling
• Annotation Guidelines
• Preference Ranking
• Pairwise Judgments

• Data & Analytics
• Technology
• Software
• Science & Research
• Engineering

Expérience minimale

2+ ans

Postuler avant le

29 août 2026

Langue de l’offre

anglais

Heures de travail

40 heures par semaine

Exigences de lieu

Country, Montreal, Quebec, Canada

Niveau d’expérience

Mid-Senior level