Today’s release of iOS 18.4, iPadOS 18.4, and macOS Sequoia 15.4 brings new features to Apple Intelligence on iPhone, iPad, and Mac.
Today, Apple Intelligence—the personal intelligence system that provides useful and relevant solutions while protecting users’ privacy—reaches more people worldwide with features available in eight new languages. With the launch of iOS 18.4, iPadOS 18.4, and macOS Sequoia 15.4, Apple Intelligence is now available in Spanish, French, German, Italian, Brazilian Portuguese, Japanese, Korean, Simplified Chinese, and English (India, Singapore).
Now, users can rewrite, review, and summarize text with Writing Tools, or reply with a simple tap thanks to Smart Replies. And for those who communicate in multiple languages supported by Apple Intelligence, these features adapt to the language they are writing in.
Users can now also use Clean Up to remove distracting elements from photos, explore new and creative ways of visual expression with Image Playground, and create the perfect emoji for every moment with Genmoji. Thanks to Apple Intelligence, Visual Intelligence helps iPhone users discover a world of information about their surroundings.¹
And now, with ChatGPT integrated into Siri and Writing Tools, they can also access this AI’s knowledge without switching apps, allowing them to complete tasks faster and more easily than ever before.
Apple Intelligence takes an extraordinary step for AI privacy. It all starts with on-device processing, meaning that many of the models powering Apple Intelligence run entirely on the device. To handle requests that require access to larger models, Private Cloud Compute extends iPhone’s privacy and security to the cloud, enabling even greater intelligence.
Review, Rewrite, and Summarize Text with Writing Tools
Thanks to the seamlessly integrated Writing Tools in iOS, iPadOS, and macOS, users can rewrite, review, and summarize their texts almost anywhere they write, including Mail, Messages, Notes, Pages, and third-party apps.
With the Rewrite feature, Apple Intelligence allows users to choose from different versions of their text and adjust it to have a professional, concise, or friendly tone, depending on their audience or purpose. The Review functionality can correct grammar, word choice, and sentence structure, while also suggesting edits with explanations that can be reviewed or accepted quickly. Users can also select text and request a concise summary in the form of a paragraph, bullet points, a table, or a list.
With Writing Tools, users can improve their writing almost anywhere they enter text, with options like Rewrite, Review, and Summarize.
In addition to the options to rewrite, review, and summarize text with Writing Tools, users can specify the changes they want to make using the “Describe Your Change” option. This feature gives users even more flexibility and control when they want their writing to sound more expressive—whether by adding more dynamic verbs to their résumé or rewriting a dinner invitation as a poem, among other possibilities.
Enhance Photos and Relive Moments with a Smarter Photos App
The Photos app is now even smarter with its new capabilities. Natural language searches in the Photos app allow users to find virtually anything just by describing it—for example: “Maya dancing in a red dress.” This also works for videos, enabling users to locate specific moments within a video and jump straight to them. Additionally, users receive smart suggestions to quickly complete their searches.
And when an unwanted person or object appears in a photo, the Eraser tool lets them remove intrusive elements without compromising the integrity of the image they wanted to capture.
In the Photos app, Eraser helps users edit a photo to remove any distracting elements in the background without altering the image’s fidelity.
The Memories feature now allows users to create the videos they want to see just by typing a description. Using language and image understanding, Apple Intelligence will select the best photos and videos based on the description, create a story with chapters based on the themes identified in the photos, and arrange them into a movie with its own narrative arc.
Users can create a memory video in Photos to relive the story they want, leveraging Apple Intelligence to select and organize photos and recordings, and include them in a video with their own narrative arc, based on a description.
Design Original and Fun Images with Image Playground
The Image Playground experience allows users to easily create unique and entertaining images with various concepts, including themes, clothing, accessories, and locations. They can add their own text descriptions and even generate images resembling their loved ones using photos from their photo library.
Image Playground generates images in a variety of styles, such as:
- Animation: Provides a modern 3D look.
- Illustration: Features simple shapes, defined lines, and vibrant colors.
- Drawing: An academic and highly detailed style that uses a bright color palette combined with technical lines to create realistic drawings.
With Image Playground, it’s very easy to create unique and fun images with different concepts such as themes, clothing, accessories, and locations.
The experience is integrated directly into Messages, making it easier than ever to create images for conversations, as well as in apps like Freeform, Keynote, and many others. Image Playground is also available as a standalone app.
Image Playground integrates directly into Messages, making it easier than ever to create images for conversations.
Create Genmojis for Every Occasion
With the power of Apple Intelligence, emojis reach a new level with Genmoji, making conversations with loved ones more fun and offering new ways to communicate.
Simply type a description in the emoji keyboard, and a Genmoji will appear, along with several versions to choose from. Using images from their photo library, users can take Genmojis even further by creating one inspired by a loved one. Personalized Genmojis can be customized with accessories like hats or sunglasses and adapted to represent themes or activities, making them even more personal and unique.
Just like emojis, Genmojis can be added while typing a message or shared as a sticker or reaction in a Tapback.
Users can create their own unique emojis with Genmoji, making conversations with their loved ones more fun.
Notes Reach a New Level with Magic Image
The Notes app introduces new tools to make note-taking more visual and dynamic. With Magic Image in the tool palette, users can quickly create images in their notes using the written or visual context already captured in them.
Magic Image transforms a sketch into a perfect image simply by circling it. Users can even draw a circle in an empty space within a note, and Magic Image will gather the surrounding context (using on-device generative models to analyze handwritten or typed text) to create a relevant image that enhances the note and makes it more visual. Images can be generated in Animation, Illustration, and Drawing styles.
With Magic Image in the toolbox, users can quickly create images in their notes using the written or visual context already captured in them.
Prioritize and Stay Focused
Priority Messages, a new section that appears at the top of the inbox in Mail, highlights the most urgent emails, such as a lunch invitation for today or a boarding pass. In the inbox, users can see message summaries without opening them, and with just a tap or click on Summarize, they can view all the details of a long thread. Additionally, the Smart Replies feature suggests quick responses and detects questions within an email to ensure nothing goes unanswered.
On an iPhone 16, a Priority Messages screen displays a list of important emails.
On an iPhone 16, a Smart Replies screen shows a message asking whether the user’s partner will join and whether the user will drive or take an Uber.
Priority Messages in Mail places the user’s most urgent emails in a new section that appears at the top of the inbox.
Apple Intelligence also helps users set priorities and stay focused with notification summaries that quickly display key information from long or stacked notifications on the lock screen, such as when a group chat is particularly active. Priority Notifications help users keep up with the most urgent communications by prioritizing notifications that require their immediate attention.
A new Focus mode, Fewer Interruptions, only shows notifications that might require immediate attention.
Priority Notifications help users stay up to date with urgent information.
In the Notes app, users can record, transcribe, and summarize audio.
Siri: More Natural and Conversational Than Ever
Powered by Apple Intelligence, Siri is now more natural, flexible, and seamlessly integrated across the system.² It features a new design with a sleek light strip that glows around the edge of the screen when active on iPhone, iPad, or CarPlay. On Mac, users can place Siri anywhere on the desktop for easy assistance while working. They can also type to Siri at any time on iPhone, iPad, and Mac, effortlessly switching between text and voice to speed up everyday tasks.
With its advanced language understanding capabilities, Siri can recognize when users stumble while speaking and maintain context from one request to the next.
Users can type to Siri at any time on iPhone, iPad, and Mac, seamlessly switching between text and voice.
More Information About Your Surroundings in a Single Click with Visual Intelligence
A new Visual Intelligence experience leverages Apple Intelligence to help users discover a world of information about their surroundings. Visual Intelligence can summarize and copy text, translate text between languages, detect phone numbers or email addresses with the option to add them to contacts, and much more.
To use Visual Intelligence, users can press and hold the Camera Control on the iPhone 16 and iPhone 16 Pro or customize the Control Center, Lock Screen controls, or the Action Button on the iPhone 15 Pro and iPhone 16e.1. Users can also use Visual Intelligence to search Google for where to buy an item or take advantage of ChatGPT’s capabilities to get an explanation of a complex diagram, such as class notes. Users control when to use third-party apps and what information they share.
Use ChatGPT with Siri and Writing Tools
Apple enables access to ChatGPT in Siri and Writing Tools across iOS, iPadOS, and macOS, allowing users to tap into its full knowledge base, as well as its image and document understanding capabilities, without switching between apps. With ChatGPT integration, Siri can suggest accessing ChatGPT for certain requests, and the assistant can provide responses directly.
With the “Rewrite” feature, users can ask ChatGPT to generate content for anything they are writing within the system-wide Writing Tools. They can also leverage ChatGPT’s image generation capabilities to add visuals to their written content.
Users can choose to enable ChatGPT integration and control when to use it and what information to share with AI.3 By default, a ChatGPT account is not required to use this integration. When using ChatGPT without an account, OpenAI will not store requests or use data to train models. Additionally, users’ IP addresses are hidden to prevent session linking. OpenAI’s data usage policies apply to those who choose to connect their accounts.
Writing with ChatGPT helps users generate content for anything they are writing about.
A Breakthrough for Privacy in AI
Designed to protect user privacy at all times, a fundamental element of Apple Intelligence is on-device processing. Many of the models that power Apple Intelligence run entirely on the device. For requests that require larger models, Private Cloud Compute enables Apple Intelligence to scale its computational capacity by leveraging server-based models to handle more complex requests—without compromising user privacy. These models run on servers powered by Apple chips, ensuring that information is never stored or exposed.
For the first time in the industry, independent experts can inspect the code running on servers with Apple chips to verify that we uphold this privacy commitment. Apple Intelligence with Private Cloud Compute takes an extraordinary step forward for privacy in AI, enabling intelligence that users can truly trust.
