Ameba Audio & Multimedia Solutions: Engineered for Exceptional Sound
Integrated native audio and media framework, a one-stop high-performance sound experience
Overview
On smart devices, a stable and versatile sound experience is a decisive product differentiator. Ameba delivers a native, high-performance audio and multimedia framework built on two tightly cooperating engines:
- Media Framework: decodes compressed audio from local files or network streams back into raw PCM.
- Audio Core Framework: takes the PCM, performs multi-stream mixing, device routing, volume and effects processing, then outputs to speakers, headphones, A2DP, USB Audio and other peripherals through the hardware abstraction layer.
The two engines have clearly divided roles, with data flowing one way from top to bottom: the Media Framework first parses and decodes the source into PCM, then passes it to the Audio Core Framework for mixing, routing and device management, and finally out to the hardware peripherals. The Media Framework focuses on format parsing and transport protocols, while the Audio Core Framework handles audio processing and centrally manages all low-level hardware access. The complexity of demuxing, decoding, mixing and routing is fully encapsulated within the framework, so a handful of high-level API calls are all it takes to implement common features such as playing streaming music, recording voice, or mixing audio with EQ.
Audio Core Framework
Facing the application, it delivers an integrated capability set — multi-stream playback and capture, device routing, mixing and effects, recording and equalization — supporting concurrent system tones, voice calls, background music and prompts. Facing the hardware, it takes full charge of low-level access to codec, I2S and DMA, using the hardware abstraction layer to shield the application from platform differences. The same application code runs unchanged across different ICs and peripheral combinations, so product iterations and hardware upgrades never require rewriting business logic.
Multi-Stream Playback
- Multiple PCM streams play in parallel — music, prompts, tones and calls never interfere with one another
- Sample rate, bit depth, channels and volume are set independently per stream
- Mixer and passthrough dual modes balance multi-stream mixing against low power
Multi-Stream Recording
- Multiple PCM streams captured in parallel, enabling reference signals, loopback and A/V sync
- Flexible AMIC / DMIC / I2S In combinations, from a single mic to a mic array
- Built-in capture EQ and high-pass filtering deliver clean data for speech recognition and calls
Smart Device Routing
- Detects runtime events such as Bluetooth / USB connection
- Automatically picks the target output based on audio usage and device priority
- Seamless switching across Speaker / Headphone / A2DP / USB / I2S, transparent to the application
Volume, Effects & EQ
- Hardware volume, amplifier enable, independent left/right channel volume
- Multi-band parametric EQ with runtime control of filter type, center frequency, gain and Q
- Rich digital signal processing including time scaling, arbitrary-rate resampling and PLL clock fine-tuning
Media Framework
Internally it is a four-stage pipeline — source abstraction, container demuxing, multi-format decoding and render synchronization. It ingests local files, network streams and custom data sources alike, recognizes mainstream container formats, and invokes the matching decoder to restore compressed audio to PCM before handing it to the Audio Core Framework. The entire flow is encapsulated within the framework, so simply pointing it at a data source gives you a complete path from fetching the stream to producing sound.
One-Call Playback
- Three steps — set source, prepare, play — and the sound comes out
- Pause, seek, time scaling and looping controllable at any time
- State and error events pushed via callbacks — no polling required
Multi-Format Decoding
- WAV · MP3 · AAC · M4A · OGG · FLAC · AMR
- Optional G.711 / GSM narrowband for voice
- Selectable in menuconfig — only the decoders you use are linked in
Multi-Protocol Streaming
- Local files (SD / eMMC filesystem paths)
- HTTP / HTTPS (certificate verification, resumable long streams)
- Direct in-memory buffers
Custom Data Source
- Plug in any proprietary protocol
- Self-managed buffering and encrypted streams
- Your app just supplies the data — everything else stays inside the framework
Advantages
By bringing the two engines together, the solution centers on three key differentiators — giving you a truly deployable, full-stack audio and multimedia offering.
- Decode-to-render in one flow: the Media Framework handles demuxing and decoding, the Audio Core Framework takes over mixing, routing and rendering; PCM flows one way, and you get a pipeline that is ready to play out of the box
- Two-way playback and capture: one framework covers both playback and recording, enabling reference signals, loopback and A/V sync — a natural fit for calls, conferencing and voice interaction
- Unified hardware access: all codec / I2S / DMA access is managed by the Audio Core Framework, keeping the application and Media Framework hardware-agnostic; switching platforms or peripherals means localized, controllable changes
- Clean layering, easy maintenance: the Media Framework owns formats and protocols, the Audio Core Framework owns mixing and devices; clear boundaries make the stack easy to tailor and cheaper to maintain over time
- Decodes every mainstream format: full coverage of WAV / MP3 / AAC / M4A / OGG / FLAC / AMR and more — from high compression to lossless, from music to narrowband voice — and trims down to save firmware
- Streams over any protocol: local files, HTTP / HTTPS, and in-memory buffers are handled by a unified source abstraction; long streams resume after interruptions, and custom sources plug in any proprietary protocol
- Wide range of I/O peripherals: outputs span Speaker / Headphone / I2S Codec / Bluetooth A2DP / USB Audio, inputs span AMIC / DMIC / I2S In — all the mainstream form factors are covered
- Flexible sampling parameters: each stream independently configures sample rate (8–192 kHz), bit depth (8–32 bit and float) and channel count to match different audio-quality and bandwidth needs
- Concurrent streams without interference: multiple playback and capture streams coexist; music, prompts, tones and calls each control their own volume and parameters, layering without crosstalk
- Smart policy routing: based on runtime events like Bluetooth / USB connection together with audio usage, the target device is selected and switched seamlessly — fully transparent to the application
- Mixer / passthrough dual modes: the framework automatically chooses between mixing and low-power passthrough per scenario, serving both multi-stream layering and battery life
- Rich audio effects and signal processing: built-in multi-band EQ, time scaling, resampling, capture high-pass filtering and PLL clock fine-tuning cover everyday tuning and A/V sync needs
Applications
The same multimedia stack scales across product forms from ultra-low-power IoT nodes to multi-stream AR/VR headsets. Switch tabs to explore the representative products and key capabilities in each segment.
- Smart Speaker
- TV Soundbar
- Smart Doorbell
- Home Gateway
Smart Speaker
Music, stories, voice assistant
TV Soundbar
Home theater sound
Smart Doorbell
Two-way intercom and prompts
Home Gateway
Voice prompts and status announcements
- Smartwatch
- AR Glasses
- Headphones
Smartwatch
Voice recording and interaction
AR Glasses
Calls and voice assistant
Headphones
Hi-fi audio with full-duplex calls
- Story Player
- Smart Toy
- Robot
Story Player
Content library playback · variable-speed loop
Smart Toy
Voice interaction · push-to-record
Robot
Voice interaction mixing
Development Resources
| Icon | Resource | Link |
|---|---|---|
 |
SDK Download | View |
 |
Audio Development Guide | View |
|
Media Development Guide | View |
 |
Contact Us | View |
Recommended ICs
| Features | Filter | RTL8720F | RTL8721F | RTL8721Dx | RTL8720E | RTL8710E | RTL8726E | RTL8713E | RTL8730E | RTL872xD | RTL8735B |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Application Processor |
Cortex-M | Cortex-M | Cortex-M | Cortex-M | Cortex-M | Cortex-M | Cortex-M | Cortex-A | Cortex-M | Cortex-M | |
| DSP | N | N | N | N | N | Y | Y | N | N | N | |
| ISP | N | N | N | N | N | N | N | N | N | Y | |
| Arm TrustZone | Y | Y | Y | Y | N | Y | N | Y | Y | Y | |
| Dual Band | N | Y | Y | N | N | N | N | Y | Y | Y | |
| Wi-Fi 6 | Y | Y | N | Y | Y | Y | Y | Y | N | N | |
| R-MESH | Y | Y | Y | N | N | N | N | N | N | N | |
| Ultra-low Power | Y | Y | Y | N | N | N | N | N | Y | Y | |
| Ethernet | N | Y | N | N | N | N | N | N | N | N | |
| BT Dual Mode | N | N | N | N | N | Y | Y | Y | N | N | |
| HMI | N | Y | Y | Y | N | Y | Y | Y | N | N | |
| Audio ADC | N | N | N | N | N | Y | Y | Y | Y | Y | |
| Audio DAC | N | N | N | N | N | Y | Y | Y | Y | Y | |
| SDIO Host | N | Y | N | N | N | N | N | N | N | N | |
| SD/EMMC Host | N | Y | N | N | N | N | N | Y | Y | Y | |
| USB | N | Y | Y | N | N | N | N | Y | Y | Y | |
|
BT Dedicated Antenna |
N | N | N | N | N | N | N | Y | N | N | |
| CAN | N | Y | N | N | N | N | N | N | N | N |
