Apple adds Apple Watch features that can transcribe recent speech

In short: Apple introduced new Apple Watch features that can listen for short periods, turn speech into text, and summarize conversations.

What happened

Apple announced new Apple Watch features that process live sound, including tools called Audio Intelligence, Live Rewind, and Siri Recap.

Audio Intelligence is aimed at accessibility. It can alert the wearer to sounds like sirens, alarms, doorbells, or a baby crying. Apple says this uses on-device AI, meaning the watch does the work itself instead of sending the sound to a server (like doing a calculation on your own calculator instead of asking someone else to do it).

The other two features focus more on conversations. Live Rewind lets a user press the watch’s digital crown to go back 15 seconds and create a text transcript of what was just said. Siri Recap can create “high-level notes” from conversations, including a title, summary, and key points, and the notes can be viewed later in Apple’s Siri app.

Apple says these features are designed with privacy protections. The company says it does not create or store audio recordings, and that raw audio is not accessible, even to Apple. Apple also says it does not label who said what, and it uses end-to-end encryption (a lock where only the sender and receiver have the key) to protect saved transcripts and recaps.

Why it matters

Tools that turn nearby speech into text can be helpful, especially for people who are deaf or hard of hearing. But they can also change how comfortable people feel in everyday conversations, since someone could capture what you said with a small, quick action on a watch. The features also raise questions about consent and how text-only transcripts might be used later, including in disputes or legal settings.

Source: TechCrunch AI