Location: Mountain View, CA
Schedule: Hybrid. Must be onsite at least 3 days per week (Tuesday through Thursday).
Duration: 12 months
Job Description
Our HALO team is looking for an AI Linguist to help improve the quality of AI models powering content understanding, recommendations, and member experiences. This role partners closely with AI Engineers to build high quality human evaluation and annotation workflows that directly impact Generative AI model performance.
Responsibilities
- Design and execute AI quality, evaluation, and annotation solutions
- Develop scalable human judgment workflows using Generative AI prompting and human evaluation
- Analyze linguistic data and provide insights that improve AI model development
- Build and improve annotation and evaluation pipelines
- Create annotation guidelines, documentation, and standard operating procedures
- Research new methodologies to improve annotation quality and process efficiency
- Help standardize workflows that improve productivity, consistency, and quality
Qualifications
Required
- Bachelor's degree in Computational Linguistics, Linguistics, Language Technologies, Speech Science, or a related field
- 1+ year of industry experience supporting AI model training, evaluation, or annotation
- Experience building or supporting end to end human judgment or annotation workflows
- Ability to translate linguistic requirements into clear annotation guidelines and instructions
- Experience with Python or another scripting language
Preferred
- Master's or PhD in Computational Linguistics, Linguistics, Language Technologies, or related discipline
- Experience with large scale AI annotation and evaluation projects
- Experience working with Generative AI workflows
- Strong written English communication skills
- Comfortable learning new technical tools and AI technologies
- Strong analytical thinking and problem solving skills
Pay Rate
Requisition ID:17085
