Tech & Science

Apple Releases visionOS 27 With Siri AI and New Spatial Experiences

Apple today released visionOS 27, the newest version of the visionOS operating system that runs on the Apple Vision Pro . It is a free update available on both versions of the Vision Pro headset. visionOS 27 can be downloaded by opening the Settings app, selecting the General section, and choosing Software Update. Installing the update requires the headset to be removed, and a progress bar appears EyeSight display. visionOS 27 adds support for Siri AI, a smarter version of ‌Siri‌ that can access your personal information and do more in and between apps. ‌Siri‌ supports Visual Intelligence for asking questions about objects on your screen or in your physical environment. The update adds a new spatial scene feature for panoramic photos, a Thórsmörk Environment, and immersive Safari environments on supported websites. Apple's release notes for visionOS 27 are below. Siri AI (Apple Vision Pro with M2 and later) - A more capable and conversational version of Siri is rolling out to users. It helps you find what you need and get more done, drawing on capabilities like personal context understanding, app actions, onscreen awareness, and access to broad world knowledge - Place Siri anywhere in your space and it stays pinned there, ready to help - Look and speak to Siri without saying "Hey Siri". Just look at Siri and start speaking - Dedicated Siri app provides an easy way to revisit an existing conversation or kick off a new one, and privately syncs conversations across your Apple products with iCloud - Visual Intelligence lets you ask Siri about physical objects in your room or content on your screen, just by looking at them - Write with Siri enables you to generate a draft from scratch, edit what you've written, or get feedback from Siri virtually anywhere you type - New voice experience offers more expressive voices, and lets you customize expressivity and pace to make Siri more personal to you using powerful on-device models on Apple Vision Pro (M5) Apple Intelligence across apps (Apple Vision Pro with M2 and later) Safari - Organize by Topic uses Apple Intelligence to automatically group your Bookmarks and Reading List by topic, so related pages are easier to find Image Playground - All-new Image Playground uses a new generative model to create high-quality images in virtually any style, including photorealistic, and lets you modify images using natural language Home - Summarized activity notifications combine related alerts across accessories into a single notification - Video descriptions for HomeKit Secure Video recordings summarize what's happening in a clip for eligible iCloud+ subscribers - Camera clip search lets you find specific moments from your HomeKit Secure Video cameras by searching in the Home app Spatial Experiences - Spatial scene panoramas transforms your panoramas into spatial scenes with depth and dimension - Personal Environments allows you to choose a panorama special to you and set it as your own Environment - Windows with curvature help you view content more comfortably in apps including Safari, Freeform, and Apple TV using Multiview - Spatial Preview with supported macOS apps lets you pull 3D models directly from Mac Virtual Display into your space to preview and edit at true scale, with changes reflected in real time - Quick Look enhancements let you visualize changes to 3D models in your space. Change materials, choose wireframes or UV maps, or add annotations - New Environment: Thórsmörk transforms your space into Iceland with two variations: a serene daytime river view and a dramatic night scene with aurora - Freeform spatial groups let you pull multiple items off your board and arrange them in your space, view objects together as a group, and organize boards into collaborative folders - Web environments in Safari render fully immersive 360° backgrounds that surround your physical space System Improvements - Faster Wi-Fi connection enables Apple Vision Pro to connect to Wi-Fi up to 3x faster after powering on - Look to see notifications lets you glance at a notification to expand it, and tap and hold to take action like replying to a message without opening the app - Improved Control Center shows notifications, playback controls, and Environments controls organized into three distinct areas for easier access - High quality recording gives you the ability to capture your unfoveated view in 4K, with full edge-to-edge sharpness for up to 3 minutes - Mirror in high resolution lets you check what you're actively recording on a different device or monitor in 4K - Messages syncing more quickly and reliably updates unread counts and notifications across your devices - New extra small widgets let you customize your space with your favorite apps - Mac Virtual Display widget connects to your Mac with a tap and can be placed anywhere in your space Accessibility - Look to Drive enables you to control a compatible powered wheelchair with your eyes by sending a movement command from Apple Vision Pro to a connected wheelchair accessory - Updated Dwell Control offers a new way to make selections using just your eyes by glancing at a selection marker above the dwell pointer to confirm instantly, instead of waiting for timer The customizable ‌Siri‌ voice requires the M5 Vision Pro, but all other features are available on both models. More information on visionOS 27 is available in our Vision Pro roundup . Related Roundup: Apple Vision Pro Tag: Siri Buyer's Guide: Vision Pro (Neutral) Related Forum: Apple Vision Pro This article, " Apple Releases visionOS 27 With Siri AI and New Spatial Experiences " first appeared on MacRumors.com Discuss this article in our forums