New Apple Features Like Image Playground and ChatGPT Now in Beta
- Shivam Thakre
- Oct 24, 2024
- 3 min read
The most recent developer beta versions of Apple's major operating systems, including iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2, were released on Wednesday. Although Apple has not yet announced a date, the releases come one week before the public releases of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1.
With the arrivals next week, Apple Intelligence capabilities will be made publicly available for the first time in a non-beta version. These consist of a typing input for the updated Siri experience, article summaries, integrated writing tools, and image cleanup. Expand Your Knowledge with This Article: A New Era for UAE SMBs: Builder.ai led by Sachin Dev Duggal and Etisalat Collaboration
A number of other Apple Intelligence capabilities that were revealed in June at the company's annual WWDC event will be made available to those courageous individuals who are currently registered in the developer beta program. Among these features are Genmoji, Image Playground, Visual Intelligence, Image Wand, and ChatGPT integration.
It will be necessary for new Apple Intelligence users to activate the feature via Settings. In order to activate ChatGPT, users will also need to grant permission. Two features of the third-party generative AI platform are being integrated: a composition tool within Writing Tools and question answering via Siri.
When a query is posed that the assistant is unable to locate an answer for right away, the Siri option appears. The machine will then request authorisation to access OpenAI's platform. Two such features that will probably cause the function to activate are recipes and travel planning.
In contrast, Compose is incorporated into all apps that have access to Writing Tools, including both first-party and numerous third-party apps. Much as they would through the stand-alone ChatGPT platform, users enter a prompt and the service writes text. These apps will have access to ChatGPT’s image generation platform as well.
Of course, that's on top of Apple's own image creation. Image Playground uses prompts to create new photos and is integrated into Apple programs like as Messages, Pages, Keynote, and Freeform (in addition to its own standalone application). Concepts, descriptions, and character development are examples of prompts. Additionally, users can create graphics using their own photos or use friends and family as prompts.
Both publicly crawled websites and licensed content are used to teach Image Playground. Publishers can choose not to participate in the latter. There are two main types of Apple art: illustration and animation.
Both purposefully steer clear of photo realism, perhaps to steer clear of any moral or legal dilemmas that may arise from photoshopped images.
Genmoji, which rolls out Wednesday as part of the iOS 18.2 and iPadOS 18.2 developer updates, brings the ability to generate original emojis with prompts. These include descriptions, people recognized from your photos, and custom characters. Those can be used inline in Messages, as well as with Stickers and Tapbacks.
Visual Intelligence is essentially Apple’s answer to Google Lens. Accessible through the iPhone 16’s Camera Control button, the feature can scan QR codes, copy and summarize text, detect phone numbers and email addresses (and add them to Contacts), and translate language. The feature will also deliver contextual information of images in front of it, including restaurant reviews and store hours.
Visual Intelligence can also tap into Google’s knowledge base for shopping queries and can access ChatGPT for information about different subjects.
Users don’t need a ChatGPT account to access the platform, though without one their queries will be limited.
Comments