Field-test voice AI on real local tasks
Voice AI still stumbles on local names, accents, and code-switching. Run a structured 10-task field test of a voice assistant and report like a QA engineer.
Posted by The AI Internships
The work brief
- 01Pick a voice AI you can use (Gemini Live, Google Assistant, Siri, Alexa) and design 10 spoken tasks.
- 02Include the hard stuff: place and people’s names from your region, accented or code-switched speech, a local query ("nearest public service office"), and background noise.
- 03Run all 10, twice each. Log verbatim what it heard vs. what you said, and whether the action succeeded.
- 04Score the results and write your findings: what should a first-time user in your family expect?
What you’ll produce
Submission standard
Submit your 10-task design, the full run log (both rounds), a screenshot of one notable transcription, and your findings. Add a link to a short recording of at least one task so the verbatim heard-vs-said log is verifiable.
The assistant tested and your 10 tasks (mark the deliberately hard ones)
Written responseRequiredFull log: what you said, what the AI heard, did the action succeed — 10 tasks × 2 rounds
Written responseRequiredScreenshot of one notable success or failure (the transcription visible)
Screenshot must show the assistant's own transcription on your device with the app interface visible.
Image uploadRequiredFindings: success rate, failure patterns, and advice for a first-time user
Written responseRequired
You’ll complete these inside your private workspace.
What you must submit as proof
This brief requires evidence an AI can’t fabricate.
Link to a short recording of at least one voice task
An unlisted screen/audio recording (Google Drive/YouTube) of at least one task, showing what you said vs. what it heard.
Public linkRequired
Submissions without this evidence cannot be submitted.
Protect other people in your proof. Blur faces, names, phone numbers and email addresses before you upload, and refer to anyone you worked with by role or number ("Listener 1", "the stall owner"). Your proof is only ever used to check your work — it is never published, never appears on your certificate, and is never shown in your public portfolio.
How your work is evaluated
The passing benchmark is 70/100.
Test design
14%The 10 tasks systematically probe real weak spots (names, code-switching, noise).
Real execution
29%The log shows verbatim heard-vs-said detail only real runs produce.
Findings
29%Patterns and advice follow from the log.
Voice runs really happened
29%Auto-fail if there is no working recording, or it doesn't correspond to a logged task (invented heard-vs-said log).
How we grade your AI usage
Using AI is the point — it’s the skill this certificate proves. You’ll answer three short questions about how you used it: what you asked, what was wrong with its first answer, and what you changed. Specific, honest answers score high. “I pasted the brief and submitted the answer” scores near zero.