WWDC and ‘Apple Intelligence’ — what to expect

WWDC 2024 may yet define Apple’s next decade, so most in tech are tuning in to see what the company says. Here is a brief rundown of what we are hearing now:

Apple Intelligence

The channel making the most noise this year is the one broadcasting that Apple will unleash its take on artificial intelligence (AI) and generative AI (genAI) across its products. We’ve written a lot about these claims, but in brief expect:

Improvements to Siri, including much improved contextual intelligence.

An alliance of some kind with OpenAI and perhaps other genAI providers, though we do not yet know what form this takes.

Apple’s own on-device genAI tools, likely including on-device transcription, powerful Xcode code-completion tools, automated replies and categorization in Messages and Mail, and more.

Bloomberg’s Mark Gurman predicts an add-on AI service called “Apple Intelligence,” which will likely beef up service revenues. (Morgan Stanley analyst, Erik Woodring earlier predicted a fee-based service of this kind could bring around $8 billion to Apple’s service revenues.)

Spatial computing

Apple will also apply AI to visionOS. To do so, it will lean into its existing technologies in machine vision intelligence, augmenting these with LLM-based contextual understanding and new AI-based user interface developments.

Apple gave a glimpse of some of these before the event, when it explained how it will become possible to control its devices using just a glance. A new Reader Mode on the iPhone will make it possible to have documents read to you, which also makes sense as a visionOS feature — think Geordi La Forge. (A new Live Captions feature that puts real-time captions in your view will also feature here.) Developers also expect new visionOS APIs and development tools to extend the versatility of their apps.

And Apple will also introduce more of its own fully native apps, perhaps with AI-generated fully immersive environments, which will be a game changer down the lane.

Vision Pro goes international

Apple apparently doesn’t plan to introduce any hardware at the show, but I’m not confident of that; I distinctly remember hearing that before, only to be surprised by a new Mac. What I do think is coming is an expansion into international availability for Vision Pro, which is something developers hoping to work on the platform need. At present, developers cannot get hold of these devices outside the US. 

Software updates

Apple will introduce updated versions of all its operating systems, iOS, macOS, iPadOS and everyone else. These will include simplified Settings/System Preferences apps and more customization options on the Home screen, while most of Apple’s existing apps will be augmented with AI features. Photos could get AI-based editing tools, similar to Smart Eraser on the Pixel. This could also extend to the Health app, which may get better at making active recommendations to Fitness+ subscribers.

And maybe, just maybe, Siri on the HomePod will get a little better at telling the difference between Neubaten and Parton. 

A Passwords app

One interesting claim sees Apple break out its own Passwords app for Macs, iPads, and iPhones. Based on iCloud Keychain, this would let users import passwords from rival services such as 1Password and LastPass. It might be best to see this as an improved UI for a service Apple already provides via its Passwords function in Settings. It is expected the Passwords app will also work on Windows and visionOS — but will Apple also introduce the app for Android? 

A new Calculator?

My favorite Calculator tip may become historical as there may be plans to overhaul Apple’s Calculator app. Improvements could include Notes app integration, improved unit conversions, and a sidebar where you can track or fix errors or go back to earlier in the sum. 

Under the wire

One snippet of news that’s not picked up too much attention is the discovery of Thread radios inside Apple’s most recent iPads and Macs. We don’t yet know why this support is here, but as Thread is the primary wireless protocol for unified smart home standard, Matter, I’ll hazard a guess this forms the foundations for improved smart home functionality. 

What about partnerships?

A partnership with genAI company OpenAI is one thing, but as Apple battles regulators everywhere, might the company intend on opening up a little more? If it does, it could benefit from offering some products and services across multiple platforms. The expected announcement of RCS support in Messages could be the thin end of a wedge that also includes Apple TV+ for Android. Is it significant that this will be the first year Apple makes all its WWDC videos available on YouTube?

WWDC 2024 takes place June 10 beginning with a keynote speech at 10 am PT/i pm ET. The Keynote address will be available to stream on apple.com, the Apple Developer app, the Apple TV app, and the Apple YouTube channel. 

Please follow me on Mastodon, or join me in the AppleHolic’s bar & grill and Apple Discussions groups on MeWe.

​WWDC 2024 may yet define Apple’s next decade, so most in tech are tuning in to see what the company says. Here is a brief rundown of what we are hearing now:

Apple Intelligence

The channel making the most noise this year is the one broadcasting that Apple will unleash its take on artificial intelligence (AI) and generative AI (genAI) across its products. We’ve written a lot about these claims, but in brief expect:

Improvements to Siri, including much improved contextual intelligence.

An alliance of some kind with OpenAI and perhaps other genAI providers, though we do not yet know what form this takes.

Apple’s own on-device genAI tools, likely including on-device transcription, powerful Xcode code-completion tools, automated replies and categorization in Messages and Mail, and more.

Bloomberg’s Mark Gurman predicts an add-on AI service called “Apple Intelligence,” which will likely beef up service revenues. (Morgan Stanley analyst, Erik Woodring earlier predicted a fee-based service of this kind could bring around $8 billion to Apple’s service revenues.)

Spatial computing

Apple will also apply AI to visionOS. To do so, it will lean into its existing technologies in machine vision intelligence, augmenting these with LLM-based contextual understanding and new AI-based user interface developments.

Apple gave a glimpse of some of these before the event, when it explained how it will become possible to control its devices using just a glance. A new Reader Mode on the iPhone will make it possible to have documents read to you, which also makes sense as a visionOS feature — think Geordi La Forge. (A new Live Captions feature that puts real-time captions in your view will also feature here.) Developers also expect new visionOS APIs and development tools to extend the versatility of their apps.

And Apple will also introduce more of its own fully native apps, perhaps with AI-generated fully immersive environments, which will be a game changer down the lane.

Vision Pro goes international

Apple apparently doesn’t plan to introduce any hardware at the show, but I’m not confident of that; I distinctly remember hearing that before, only to be surprised by a new Mac. What I do think is coming is an expansion into international availability for Vision Pro, which is something developers hoping to work on the platform need. At present, developers cannot get hold of these devices outside the US. 

Software updates

Apple will introduce updated versions of all its operating systems, iOS, macOS, iPadOS and everyone else. These will include simplified Settings/System Preferences apps and more customization options on the Home screen, while most of Apple’s existing apps will be augmented with AI features. Photos could get AI-based editing tools, similar to Smart Eraser on the Pixel. This could also extend to the Health app, which may get better at making active recommendations to Fitness+ subscribers.

And maybe, just maybe, Siri on the HomePod will get a little better at telling the difference between Neubaten and Parton. 

A Passwords app

One interesting claim sees Apple break out its own Passwords app for Macs, iPads, and iPhones. Based on iCloud Keychain, this would let users import passwords from rival services such as 1Password and LastPass. It might be best to see this as an improved UI for a service Apple already provides via its Passwords function in Settings. It is expected the Passwords app will also work on Windows and visionOS — but will Apple also introduce the app for Android? 

A new Calculator?

My favorite Calculator tip may become historical as there may be plans to overhaul Apple’s Calculator app. Improvements could include Notes app integration, improved unit conversions, and a sidebar where you can track or fix errors or go back to earlier in the sum. 

Under the wire

One snippet of news that’s not picked up too much attention is the discovery of Thread radios inside Apple’s most recent iPads and Macs. We don’t yet know why this support is here, but as Thread is the primary wireless protocol for unified smart home standard, Matter, I’ll hazard a guess this forms the foundations for improved smart home functionality. 

What about partnerships?

A partnership with genAI company OpenAI is one thing, but as Apple battles regulators everywhere, might the company intend on opening up a little more? If it does, it could benefit from offering some products and services across multiple platforms. The expected announcement of RCS support in Messages could be the thin end of a wedge that also includes Apple TV+ for Android. Is it significant that this will be the first year Apple makes all its WWDC videos available on YouTube?

WWDC 2024 takes place June 10 beginning with a keynote speech at 10 am PT/i pm ET. The Keynote address will be available to stream on apple.com, the Apple Developer app, the Apple TV app, and the Apple YouTube channel. 

Please follow me on Mastodon, or join me in the AppleHolic’s bar & grill and Apple Discussions groups on MeWe. Read More