Apple’s AI-powered “Audio Intelligence” technology for the Apple Watch is now rolling out into beta testing, arriving initially for developers in the iOS 27.3 update after being announced at September’s Surprise and Shine hardware event.
The technology includes a set of four opt-in AI features for Apple Watch Series 12 wearers: detecting important sounds, identifying songs, catching up on conversations, and taking notes. The sound recognition feature will help deaf and hard-of-hearing users identify important sounds like sirens, alarms, or doorbells from their watch, while the song recognition feature taps into Apple’s Shazam app to identify background music.
But the features drawing the most attention are the two that listen to human conversations: Live Rewind and Siri Recaps.
Apple Watch Audio Intelligence Beta: How Live Rewind and Siri Recaps Work
Live Rewind lets you go back in time to see what someone just said if you missed it. Say someone was giving you verbal directions or reading a long list of restaurant specials — you can double-press the Watch’s digital crown to see what was said in the last 15 seconds as a text snippet on the watch face.
You can view the snippet and do nothing, and it will disappear permanently — or save it to the standalone Siri app that shipped with iOS 27 for later access, handy for remembering a name or jotting a note from a fast-paced presentation. An “Ask Siri” option below the snippet answers questions about what was said, like an unfamiliar technical term or sauce option. Snippets are deleted automatically after 30 seconds if you don’t save them.
Siri Recaps go further, taking high-level notes of conversations. Importantly, Apple says it is not identifying speakers, saving raw audio, or providing word-for-word transcriptions. Instead, the feature summarizes a conversation with a short sentence and bullet points highlighting key points — important dates or deadlines, pricing or payment plan information, and other factual details. Apple suggested it for work meetings, parent-teacher conferences, and personal training sessions, mimicking the ability to jot down notes without adding emotion or tone. The recaps won’t run while you’re listening to music with headphones or using noise cancellation.
Given the backlash to AI recording devices like Meta’s AI glasses, Apple is trying to carve out a privacy-conscious space. When you double-press the digital crown, an audible chime sounds and an animation displays on the watch — meant to signal to people nearby that something they said was captured.
Also Read: Top 10 Early Black Friday Deals: Apple Watch Ultra 4, Pixel Watch 5, Alexa Tablet at All-Time Lows
Philips Already Retired One Hue Bridge — And It Tells You How the Next One Ends
Source: TechCrunch AI — read the full story there.
