Skip to guide
StreamTranslate

Expressive caption guide

Captions can describe more than spoken words

A caption that says only “yes” can miss the difference between a quiet answer and an excited shout. Sound labels and expressive styling help communicate parts of the audio that a plain transcript may leave out. They are separate from translating the meaning of a sentence into another language.

By StreamTranslate · Updated

Android’s Expressive Captions adds selected tone and sound information to local captions on supported devices. StreamTranslate focuses on recognized speech and translation; its language and styling controls should not be treated as automatic emotion recognition or a complete sound-description system.

Separate words, sound events and translation

Three different caption tasks
TaskExampleWhat to review
Speech transcriptionThe words a person saysMeaning, names and missing words
Sound descriptionA meaningful laugh or alarmWhether the label identifies the relevant sound
TranslationThe sentence in another languageWhether the intended meaning survives

Changing a font or adding a second language does not automatically complete all three tasks. Decide which information a sound-off viewer needs for this particular scene.

Try expressive captions where supported

Google describes Expressive Captions as a way to add emphasis and selected non-speech sound cues. Its availability depends on Android version, language and device support. Use the current Android instructions to check the options in Live Caption rather than assuming every phone has the same controls.

Try a short piece of material containing both speech and a meaningful sound, then inspect the output. Ask whether the added cues make the scene clearer. A feature demonstration is not a guarantee that every unusual sound, joke or emotional tone will be labeled correctly in your own video.

Review context instead of decorating every word

For a gameplay clip, a distant alarm may explain why a player suddenly turns around. A laugh may explain why a sentence is not meant literally. Those details can matter more than animating each spoken word. Identify the few sounds that change what the audience understands.

Do not add an emotion label merely because a voice sounds unfamiliar to you. If you are editing recorded captions, check the surrounding scene and speaker intent. Keep labels short and useful, and distinguish a description of a sound from the words a person actually said.

Use StreamTranslate for the speech-language layer

For a live broadcast, connect the intended microphone or OBS audio source and select the spoken and translated languages in Control. Check the source preview before the translation. Choose the Twitch extension for independent viewer language selection, or a Browser Source for text included in the video.

Those outputs help viewers follow speech across languages. They do not certify comprehensive non-speech captions. If a sound cue is essential to a recorded segment, review it in the editing stage using an appropriate caption workflow rather than assuming live translation will supply it.

Run a sound-off audience check

  1. Watch a short scene without audio and write down what is unclear.
  2. Replay with audio to identify the missing information.
  3. Check whether the captions distinguish speech from relevant sounds.
  4. Review text size, contrast and placement on a normal phone screen.
  5. Ask a reader whether the finished caption sequence explains the scene without becoming distracting.

For live use, rehearse representative material rather than trying to infer quality from one clean sentence. Readable captions involve source quality, wording and display as well as the underlying recognition model.

Quick answers

Are expressive captions the same as translation?

No. Expressive captions can describe emphasis or selected sounds. Translation changes the language of the spoken meaning; either can exist without the other.

Does StreamTranslate automatically label every sound?

No comprehensive sound-labeling capability is claimed here. StreamTranslate’s documented live workflow focuses on speech captions and translation.

Should I use animated text for accessibility?

Animation is a design choice, not proof of useful caption coverage. Check whether readers can follow the words and relevant sound information at normal playback speed.

Continue with your setup

Sources and further reading

Reviewed October 28, 2026. Follow the linked provider instructions for current availability and setup requirements.