WWDC 2024 recap: How Siri controls apps on Apple Intelligence supported devices

With the help of Apple's latest SDKs, developers can also embed this AI facility into their own iOS-based software

Tech Desk - Jun 11, 2024

An undated image displaying Apple Intelligence. — Apple

There's nothing new about virtual assistants controlling machines or smartphones or any other sophisticated gadgets. But making an exceptional case and infusing an exemplary ability in a virtual assistant is what Apple just attained.

During the opening session of its Worldwide Developers Conference (WWDC 2024), the iPhone maker revealed Apple Intelligence, its in-house suite of all the AI features.

Not only is this a user-centric artificial intelligence (AI) offering, but with the help of Apple's latest SDKs (software development kits), developers can also embed this AI facility into their own iOS-based softwares.

Apple’s SDKs (software development kits) has recently been updated with countless new APIs and frameworks designed to let developers do wonders like incorporating Image Playground — or GenAI image creation — in their apps with just a few lines of code.

Apple Intelligence compatibility

Moreover, the tech giant seems to have worked enormously to make its Apple Intelligence let Siri control apps.

Apple Intelligence supports iPhone, iPad, Mac, Apple Watch, Apple TV, HomePod, and AirPods. These devices leverage AI for features like Siri, Face ID, advanced camera functions, health tracking, content recommendations, and smart home integration.

Newer models with A-series and M-series chips enhance AI capabilities with the Neural Engine, providing sophisticated on-device machine learning and user personalisation.

At its developers keynote, Apple said that developers having employed SiriKit can enhance for many of Siri’s new features without any extra hassle. Areas they can improve include Lists, Notes, Media, Messaging, Payments, Restaurant reservations, VoIP calling and Workouts.

The iPhone maker said that two new features have been integrated into Siri to facilitate developers. One would make Siri able to invoke any item from an app’s menus, meaning that a user say something like like “I need to see my speaker notes.” Whereas, the second would make Siri able to gain access to any text appearing on the page using Apple’s standard text systems.

These enhancements enable users to reference and act on on-screen text. For example, if you had a reminder or note to wish someone a happy birthday, they could just say “FaceTime him” to take action on that note.