Arabic Data Annotator – Remote, $11/hr

About the role

We are looking for an Arabic‑speaking Data Annotator to support the quality evaluation of large‑language‑model (LLM) personalization. This short‑term contract role is fully remote and offers a rate of $11 per hour.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI‑generated responses for relevance, grounding, and helpfulness.
• Identify correct and incorrect use of personal data in model outputs.
• Perform side‑by‑side (SxS) ranking of AI responses.
• Detect grounding errors, weak inferences, and forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations.

Required profile

• Fluent Arabic reading and writing skills.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Ability to evaluate nuanced and ambiguous AI responses.
• Comfortable using a personal Google account with enabled data sources.
• BS/BA degree or equivalent analytical experience.
• Excellent written communication and structured feedback abilities.
• Self‑motivated, independent remote worker with reliable internet.

Required skills

What we offer

• Short‑term (2‑month) contract with immediate start.
• Fully remote work with flexible schedule, requiring 30‑40 hours per week and a 4‑hour overlap with Pacific Standard Time.
• Competitive hourly rate of $11.