Apple Watch Beta Launches Features That Transcribe and Summarize Ambient Audio

Apple is testing new Audio Intelligence features in the watchOS 27.3 developer beta that allow Siri to actively listen to conversations via the Apple Watch microphone. The update introduces two distinct tools: Live Rewind and Siri Recap. Live Rewind provides a text transcript of the previous 15 seconds of audio, while Siri Recap generates a high-level summary of a conversation for later review. These features are available immediately to developers testing the new beta version released on November 3, 2026.

The rollout follows a period of development where Apple integrated these capabilities into its operating system. The new watchOS beta pairs these audio tools with a redesigned Health app in the iOS 27.3 developer beta. The Health app update adds an Insights tab that displays summaries for heart, sleep, and fitness data, alongside a For You section for personalized recommendations. Apple also expanded language support for these features to include global English, Chinese, French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese.

Live Rewind functions as a quick retrieval tool for recent speech. Users can double-press the Digital Crown on their watch to display a text snippet of the last 15 seconds of detected audio. This feature is designed to help users recall specific details they may have missed during a conversation. Users can ask Siri about the content of this text or save it to the Siri app for future reference.

Siri Recap operates differently by using ambient listening to create broader summaries. When enabled, Apple Intelligence automatically generates a title and key points for conversations within the new Siri app. The system aims to allow users to remain present in the moment without needing to manually note down details. The summaries are available for review after the conversation concludes.

Apple addressed privacy concerns in a document titled Privacy Overview, which outlines how the company handles data from the always-listening microphone. The company states that raw audio is processed within dedicated hardware and is not saved as a file. Apple claims the audio is not accessible to the operating system, apps, or Apple itself. If a user saves a Siri Recap summary or Live Rewind snippet, it syncs across devices end-to-end encrypted in the Siri app, provided the user has two-factor authentication and a device passcode enabled.

The developer beta is rolling out now for both watchOS 27.3 and iOS 27.3. The Audio Intelligence features require the watch to be in a state where it can detect ambient sound. The new Siri app serves as the central hub for viewing these transcripts and summaries. Apple’s documentation indicates that the technology relies on on-device processing for the initial capture and transcription steps.