Home | About | Account | Author | Audio

Voice-controlled Interactive Audio Narratives for Training

VIANT is a collection of interactive audio narratives that are experienced entirely via audio: players listen to audio clips describing situtations, and make decisions using their voice.

It was developed at the University of Southern California's Institute for Creative Technologies to explore new approaches to skills training in the US Army.

Training Scenarios

  • Submerged Vehicle Escape
    Civilian scenario for escaping a car that has fallen into water.
  • Vehicle on Fire (coming soon)
    Civilian scenario for extingishing an engine fire.
  • Stalker Survival
    Civilian scenario for avoid and surviving an abduction attempt.
  • Active Shooter Survival (coming soon)
    Civilan scenario for surviving a shooting on a school campus.

Instructions

  1. Browser: You must use the desktop version of Google Chrome as your browser for these experiments. Only Google Chrome currently supports open-vocabulary web-based speech recognition. If you are currently using Safari, Firefox, Opera, or something on your mobile phone, then return to this site after you have launched the desktop version of Google Chrome.
  2. Speakers/Headphones: Make sure the volume is turned up on your computer and your speakers are on. Even better, wear good headphones.
  3. Enable your browser's microphone: After you read and understand these instructions, click on one of the links to our experiments below. When the page is loaded properly, you will see a white page with the title of the story. You may be prompted to allow your browser to use your microphone. Make sure your microphone is enabled. This is how you will interact with the story and say what you want to happen next.
  4. Listen: Listen to the audio story, which contains a fictional situation where you are the hero of the story. You will continue to tell the story, from your perspective, and speak your response.
  5. Speak: When you hear the bell sound, it is your time to speak. Say what you would do in the same situation, as if you were the narrator. Speak clearly so that the computer can understand your words.
  6. Play: After each input you provide, an outcome will occur. Keep playing until you reach the end. You’ve reached the end when you hear the narrator say "The End."
  7. Feedback: We need your feedback! If you have some constructive criticism or encouragement, please an email directly to Andrew Gordon (gordon@ict.usc.edu).

Early Experiments

Dungeon Master : by Diego Gonzalez (dgonzalez) (comments)
Bridging diagetic levels with dragons.

Traveler : by Paola Mardo (paola) (comments)
A busy friday afternoon at LAX.

Driving Home : by Melissa Roemmele (roemmele) (comments)
An experimental piece for imaginal exposure therapy for obsesive-compulsive disorder.

The Screen : by Paola Mardo (paola) (comments)
Our first attempt at voice-controlled interactive audio.

Authors Welcome

Would you like to create your own voice-controlled interactive audio narrative? Please do! First create your story using the text-based DINE authoring tool. Second, you should produce separate audio clips (.mp3) for each setup and each outcome. Third, send an email to Andrew Gordon (gordon@ict.usc.edu) to see about uploading your audio to the DINE site and publishing your creation here on this page.

 


Questions or bug reports? Email Andrew S. Gordon at gordon@ict.usc.edu