Apple to Introduce Advanced AI Capabilities in iOS 18 with Project Greymatter
Apple is expected to unveil a number of AI capabilities with iOS 18 under the internal codename “Project Greymatter.” A fresh report from AppleInsider provides further details on the AI features for Notes, Photos, and Siri.
Greymatter Catch Up, the new notification summary feature, was formerly known as “smart recaps.” Apart from online pages, notes, documents, and summaries of missed notifications, it is expected that users will be able to ask Siri to enumerate their recent alerts. This functionality is new.
Speaking of Siri, the digital assistant from Apple is receiving a general makeover with a new smart answer structure in addition to Apple’s on-device LLM capabilities. With a greater integration of contacts, businesses, calendar events, and places in replies, this should produce more intelligent and natural-sounding Siri responses. It is also believed that Apple is working on cross-device media controls with Siri, which would enable consumers to, for example, manage video playback on their Apple TV from their Apple Watch.
It’s also anticipated that text summarization and audio-to-text transcription would be integrated into Notes and Siri.
Additionally, Apple is supporting generative AI features in iOS 18, iPadOS 18, and macOS 15 through its Photos app. Similar to Google’s Magic Eraser, the Clean Up function will let users erase undesired things from their images. The most intriguing feature, called Generative Playground, would enable users to create and alter images within the Photos app and through an iMessage app extension.
Notes will also have in-app audio recordings in addition to capabilities like summaries and transcripts. In a single note, users can include text, audio, and photos.
Another significant productivity boost to the Notes app is called Math Notes, which will enable mathematical notation, detect text expressed as mathematical equations, and offer problem-solving capabilities.
