Apple released its highly anticipated mobile and desktop operating system updates on Wednesday, along with a range of new Apple Intelligence features, including integration of Siri with ChatGPT, personalized Genmoji, and Visual Intelligence.

Apple Intelligence is a personal intelligence system developed by Apple that 'provides users with practical and personally relevant intelligent features while also making significant progress in AI privacy protection.' The Apple Intelligence feature introduced in the updates for iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2 is applicable to iPhone 15 Pro and newer models, iPads with A17 Pro or M1 and later chips, and Macs with M1 and later chips.

Image Playground

The new 'Image Playground' feature allows users to create images directly in the 'Messages' app using generative AI technology, enabling them to apply these images in conversations. These images can be generated based on photos in the user's photo library and offer a variety of themes to produce uniquely styled images, including 'animation' and 'illustration.'

Apple stated that the 'Image Playground' feature will also be built into various apps such as 'Notes', Keynote, and will be released as a standalone app.

Source: Apple Genmoji

Users can now create their own 'Genmoji'—emojis generated from text descriptions or photos. Unlike traditional emojis, personalized Genmoji can be customized with accessories such as hats, glasses, and various themes. Genmoji can also be shared as stickers or used as 'tap responses.'

Source: Apple Siri integrates ChatGPT

Apple has integrated OpenAI's popular chatbot ChatGPT into the Siri and 'Writing Tool' experience on iOS, iPadOS, and macOS, allowing users to use it without creating a ChatGPT account. Apple states that Siri can suggest users utilize ChatGPT for certain commands, and Siri can provide responses directly.

In addition to text responses, Siri integrated with ChatGPT also allows users to generate images without switching to the ChatGPT app. For example, when using the 'Writing Tool,' users can request ChatGPT to generate content based on the topics they are writing about and include images in their documents.

It is worth noting that to comply with its privacy stance, Apple has stated that requests sent to the chatbot will not be stored or used to train OpenAI's models.

Apple stated: 'Users can choose whether to enable the ChatGPT integration and have full control over when to use it and what information to share with ChatGPT. By default, no ChatGPT account is required to use this integration. When using ChatGPT without an account, OpenAI will not store instructions or use this data for model training. Additionally, users' IP addresses will be hidden to prevent their sessions from being linked together. Users who choose to link their accounts must comply with OpenAI's data usage terms.'

Source: Apple Visual Intelligence

Through Apple Intelligence, the camera control features of the iPhone 16 have also been upgraded to instantly recognize objects and text. With 'Visual Intelligence', users can use the new camera control button to summarize, copy, and translate text, identify phone numbers and email addresses, and other contact information.

The new 'Camera Control' also allows users to perform Google searches to find out where they can purchase the products they see, and even use ChatGPT to provide explanations, such as interpreting class notes.

Other new features include the 'Image Wand' in the 'Notes' app and the description modification feature in the 'Writing Tool.' According to the press release, Apple Intelligence is now offered as part of the software updates for iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2 without additional fees, but the first countries to support this application do not include Taiwan. Users need to set their device and Siri language to Australian, Canadian, Irish, New Zealand, South African, UK, or US English to access it.

Source: Apple, Decrypt

Source