Apple today announced a new generation of Apple Intelligence, which uses a new architecture to deeply integrate the latest Apple Foundation Models into the systems and applications of iPhone, iPad, Mac, Apple Watch, AirPods and Apple Vision Pro, while taking privacy protection as the core design principle. These updates make the apps you use every day more personal and useful, including more powerful photo editing tools, Safari smart features to customize your browsing experience, more secure password management, and a new “Image Playground” image generation tool. Many operations can be accomplished simply by describing requirements in natural language. Developers can begin testing today, and the feature will be rolled out to users this fall.
Apple Intelligence brings more powerful AI capabilities to everyday experiences
Siri AI: A new generation of assistant that’s more natural and powerful
The next generation of Apple Intelligence also powers the new Siri AI. Siri AI is a more personalized and feature-complete version, with more natural conversational capabilities, exclusive applications, cross-platform writing tools, and visual intelligence features. Siri can help you search for information, organize emails and photos, and perform actions in apps. Developers can test it starting today, and it will be made available to users in beta form later.
More Powerful Photo Editing: From Composition to Cleanup, All in One Step
The Photos App provides more detailed editing capabilities through a more advanced image model while retaining the original image. All photos adjusted with Apple Intelligence include a hidden SynthID watermark to indicate AI edits.
- spatial reconstruction
Based on the spatial model of Apple Vision Pro, users can re-adjust the perspective of the photo after taking it, and preview different angles by simply dragging it, just like moving the camera again. The system only generates new content in necessary areas to ensure that the picture is consistent with the original scene. - Extension tools
Users can expand the image canvas, such as correcting the horizon or adjusting the scale, and the system will automatically fill in missing areas. - Upgraded cleaning tool
Cleanup tools more accurately remove distractions, producing more natural fill effects even in complex scenes.
Safari and Password Management: Smarter, More Secure
Safari introduces a number of new tools powered by Apple Intelligence and is designed to protect your privacy so your browsing data will not be leaked.
- Automatic theme organization
Safari automatically groups tabs into topics, such as travel planning, shopping, or research, and updates them continuously as you browse. - “Notify me”
Users can have Safari monitor web pages for changes, such as restocks, price drops, or content updates, and receive notifications when changes occur. - Automatic password repair
The Passwords app can now fix weak or leaked passwords with one click, and automatically complete login and password upgrades through Safari. - Describe the extension
Users simply describe their needs, and Safari can generate custom extensions, such as a button to quickly save recipes.
Image Playground: A cross-platform image generation tool
The new Image Playground allows users to generate high-quality images in a variety of styles, including photorealistic styles. All generated images will be added with a SynthID watermark. Users can adjust objects in the image by describing, clicking or circling. They can also freely set the aspect ratio and generate images for lock screens, contact posters, etc.
Smarter communication and schedule management
Apple Intelligence has also improved the suggestion capabilities of Messages and Mail, providing one-click actions based on conversation content, such as creating reminders, searching for specific photos, or organizing emails. The smart response function also adjusts the tone according to the user’s writing style.
- call context
When users call the merchant, the system will automatically display relevant information, such as a reservation number or confirmation code. All processing is done on the device and no data is shared with any third parties. - calendar natural language
Users only need to describe the event content, and the calendar will automatically identify the location, contact person and generate the event.
Easier to create shortcuts
“Describe Shortcut Commands” allows users to simply describe the process in natural language, and the system will automatically generate shortcut commands, which can be adjusted with voice or text as needed.
Home app: Smarter notifications and search
The Home app combines relevant notifications into an activity and provides a system-generated description of the video so users can follow the content without watching the video. It’s also easier to search for camera footage, such as footage of a package being delivered quickly.
Comprehensive upgrade of auxiliary functions
Apple Intelligence has also enhanced several auxiliary tools:
- VoiceOver: Provides richer image description and real-time environment recognition
- Magnifying glass: Add exploration function to high-contrast interface
- Voice control: Use natural language to describe on-screen buttons without having to remember labels
- Accessible Reader: Supports more complex text, summaries and translations
Other enhancements at the operating system level
- Automatic proofreading provides more accurate spelling and grammar suggestions
- Files and folders can receive smart naming suggestions based on their content
- Workout Buddy supports Spanish and integrates more fitness data
- Genmoji quality improved and description more accurate
The new generation of Apple Foundation Models was developed in collaboration with Google Gemini and is deeply integrated into Apple Intelligence. Models can be executed on the device or in private cloud computing. Private cloud computing continues the privacy and security design of iPhone. Personal data will not be stored when processing requests, nor will it be accessed by Apple or other organizations. External experts can verify its privacy commitments at any time.
Source: KOCPC Chinese