Apple Watch Series 12 and Ultra 4 Get Controversial AI Features That Listen In

Apple's most debated Apple Watch features are finally switching on. Live Rewind and Siri Recap, two microphone-based tools Apple groups under the name Audio Intelligence, are arriving with the first watchOS 27.3 developer beta — and they do something no Apple Watch has done before: they listen to the world around you.

Apple first showed off the Series 12 and Ultra 4 back in September, along with the full Audio Intelligence set. Two of those features, Sound Recognition and Music Recognition with Shazam, were available from day one. The other two, the ones that sparked the arguments, had to wait for this beta.

Live Rewind: the last 15 seconds, on demand

Live Rewind is the simpler of the pair. Double-press the Digital Crown and your watch shows what was said in the last 15 seconds as a short text snippet. Missed the waiter's rundown of the specials, or the directions someone just gave you? That is the moment it is built for.

From there you can ask Siri about the snippet, or save it to the Siri app. Do neither and it vanishes about 30 seconds after the display dims. Apple has also built in a visible tell: triggering it plays an audible chime even in silent mode or with headphones connected, and shows a full-screen animation and a microphone indicator, so anyone nearby can see the watch is listening.

Siri Recap: notes on your whole day

Siri Recap goes much further. It quietly takes notes on your conversations through the day, then turns them into a title, a short summary and a list of key points in the Siri app's Recaps tab.

Apple stresses what it is not: it is not a transcript, and it does not pin anything to a particular speaker. The company says the feature is designed to leave out sensitive details such as financial data and government-assigned identifiers. Recaps are deleted after seven days unless you save them, and you can export them to Notes or Journal. You can also schedule them by time and place — only at work, never at night, for example — and switch them on or off at any time from Control Center.

What Apple says about privacy

The obvious question is what happens to the audio. Apple says it never creates any audio recordings. Raw audio goes into a hardware-isolated Secure Exclave on the watch's S11 chip and on the paired iPhone, where the operating system, apps, the user and even Apple cannot reach it. Live Rewind is processed entirely on the device. Siri Recap sends a condensed version of the conversation transcript to Private Cloud Compute, which produces the summary.

Both features are opt-in. They need a Series 12 or Ultra 4 paired with an iPhone 16 or newer — the iPhone 16e is excluded — with Apple Intelligence and Siri AI switched on. For now they only work in English, with more languages to follow, and they are off-limits to users under 13. They will not be available in the EU at first, because Siri AI is not available there yet.

When everyone else gets them

For now these features live in the developer beta only. A public beta should follow, and then a wider rollout. Until then, the most controversial Apple Watch features Apple has ever shipped remain a testers-only experiment — one that will be watched closely, in every sense.

Sources

• GSMArena — Apple Watch Series 12 and Ultra 4's controversial AI features are going live