Job Title: Chinese/English Bilingual Expert
Location: Remote
Role Overview
We are seeking a highly skilled
AI Localization & Evaluation Specialist with expertise in
Simplified Chinese to support the development and improvement of advanced AI systems. In this fully remote, hourly contractor role, you will evaluate AI-generated content, assess reasoning quality, and provide expert linguistic and analytical feedback to ensure outputs are accurate, culturally appropriate, and logically sound.
You will play a critical role in enhancing AI model performance by reviewing responses, identifying errors, and producing high-quality, well-reasoned solutions. Your work will directly contribute to improving leading AI models used globally.
Key Responsibilities
- Evaluate AI Outputs: Review and assess AI-generated responses for accuracy, clarity, logical reasoning, and adherence to prompts.
- Content Creation: Develop high-quality prompts and model responses across diverse subject areas to guide AI training.
- Error Analysis: Identify issues in reasoning, methodology, or conceptual understanding, and provide actionable feedback.
- Localization Quality Assurance: Apply advanced Simplified Chinese localization expertise to ensure correct terminology, tone, and cultural nuance.
- Quality Framework Application: Use MQM/LQA methodologies to categorize errors, assign severity, and maintain consistency in evaluations.
- Fact-Checking: Validate content accuracy, including names, units, dates, and references, using reliable sources.
- Comparative Evaluation: Rate and compare multiple AI responses based on correctness, fluency, and reasoning quality.
- Model Integrity Testing: Detect biases, inconsistencies, and inaccuracies to improve overall AI reliability.
- Documentation & Reporting: Maintain clear, structured documentation of evaluations and decisions.
Required Qualifications
- Bachelor’s degree or higher in Translation, Linguistics, Localization, Communications, or a related field.
- Native or near-native proficiency in Simplified Chinese, with deep understanding of China locale conventions.
- Minimum C1 level English proficiency (reading and writing).
- 5+ years of professional localization/translation experience (multilingual experience preferred).
- Strong knowledge of MQM/LQA frameworks, including error classification and root-cause analysis.
- Proficiency with CAT tools, translation memory systems, termbases, and QA workflows.
- Excellent editorial and linguistic judgment, including tone, register, and cultural sensitivity.
- Exceptional attention to detail and strong analytical skills.
- Proven ability to fact-check and validate localized content rigorously.
- Ability to work independently in a remote, contractor-based environment with consistent output and responsiveness.
Preferred Qualifications
- Experience in AI training, data annotation, or model evaluation.
- Familiarity with AI/ML concepts and large language models.
- Experience working with structured guidelines and scalable quality processes.
