Introduction to Enabling Videos with Multiple Audio Streams

This topic provides the basic instructions for setting up a customer to enable assets to have multiple audio tracks (multi-audio). Typically, this is used for videos with audio tracks in different languages and/or audio tracks with additional information such as audio descriptions (for viewers with visual impairments), and audio commentary, such as from the director. The multiple audio tracks include the available codecs, channels and bitrates. The combination of these parameters define the unique audio track in the media files.

Major differences to consider with Multi-Audio

The following areas are unique to videos with multiple audio tracks:
  • Source Files: The source content must contain all the audio files to be used with the streaming. Ooyala does not currently support late binding of additional audio tracks. Therefore, if a customer has three languages in a stream and later wants to add a fourth, the asset must be reprocessed for a given stream packaging type.
  • Ingestion
  • Processing Profile (and/or Access):
    • For HLS, the assets must use an HLS protocol version 4 manifest. Not all devices support HLS V4 manifests.
    • For MPEG-DASH
    • For Smooth
  • Player: The Ooyala Player will automatically recognize that the stream has multiple audio tracks, and include the ability to switch between the different audio tracks in a new menu. The player must consider all available factors (channels, language, bitrates, CODECs, etc when switching tracks.
  • Analytics: IQ does not currently record which audio track is selected, so reporting on what languages are selected requires custom reporting.

Support Environments for Multi-Audio

Supported App Environments Supporting Multi-Audio

  • Android: Requires ExoPlayer 2.x+
  • iOS: Requires devices supporting HLS V4
  • TVoS: Requires devices supporting HLS V4
  • Amazon Fire TV: Requires ExoPlayer 2.x
  • Chromecast

Supported Features/Combinations for Multi-Audio

We currently support the following with Multi-Audio:
  • Multiple AAC audio streams in HLS and DASH stream packaging, Stereo Only
  • Multiple audio streams in the following packaging types:
    • HLS, eHLS
    • HLS + FairPlay DRM (h264 codec) - supported for Azure, not Elemental
    • MPEG-DASH, MPEG-DASH + Widevine/PR
    • Up to six audio tracks

Unsupported Features/Formats with Multi-Audio

We currently do not support the following with Multi-Audio

  • Multi-Audio Streams with HEVC Codec
  • Multiple bitrate renditions for the same audio track (i.e. with the same language track)
  • Multi-Audio with SSAI
  • Late Audio Binding (adding an audio track after a stream has been fully processed)
  • AC3 or e-AC3 (Dolby) Audio tracks

Was this article helpful?