Japanese - Voice AI Evaluator

Alignerr

$12–40/hr United States Flexible hours

Native Japanese speakers role-play patients on calls with an AI healthcare receptionist and grade its responses and function calls. Suits clear speakers with a natural voice and a strong grasp of polite speech in service settings.

Japanese Voice AI Evaluator (Healthcare Front Desk Conversations)
About the Role
What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Japanese speakers to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.
You'll role-play as a patient (using fictional personas we provide), record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural.

  • Organization : Alignerr
  • Type : Contract (task-based)
  • Location : Remote

- Commitment : Flexible, work at your own pace

  • Commitment : Flexible, work at your own pace
  • Hold 4 to 5 minute spoken conversations in Japanese with an AI front desk assistant, playing a fictional patient
  • Say natural "trigger phrases" to test whether the AI makes the correct function calls (for example, checking a patient record, booking an appointment, or checking insurance)
  • Review transcripts and classify how accurately the AI understood you and responded
  • Flag issues such as mispronunciations (including kanji readings and pitch accent), cutoffs, interruptions, delays, and incorrect function calls, including timestamps
  • Test how the AI handles background noise, short replies ("はい," "いいえ," "大丈夫です"), long numbers, emotional moments, and sensitive or unsafe requests

- Follow detailed labeling guidelines consistently and submit high-quality work

  • Follow detailed labeling guidelines consistently and submit high-quality work
  • Native or near-native Japanese speaker with a clear, natural speaking voice
  • Detail-oriented, with the patience to review recordings and transcripts closely
  • Comfortable role-playing a patient and sounding authentic
  • Able to follow multi-step instructions and apply them consistently
  • Reliable and self-directed when working independently
  • Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise

- Comfortable using web-based tools

  • Comfortable using web-based tools
  • Experience in voice AI evaluation, data annotation, or QA testing
  • Background in healthcare administration, customer service, or call center work
  • Strong command of polite and honorific speech (敬語) as used in service conversations
  • Linguistics or language-focused studies

- Familiarity with medical terminology in Japanese

  • Familiarity with medical terminology in Japanese
  • Work on cutting-edge AI projects alongside leading research labs
  • Fully remote and flexible
  • Task-based work with real autonomy
  • Directly help make voice AI more accurate, natural, and safe in healthcare settings

- Potential for ongoing work as new projects launch

  • Potential for ongoing work as new projects launch

Listing from Alignerr's job board. Details can change; the platform's page is the final word.

Similar roles