How to use Visual Intelligence on iPhone to compile, search and ask ChatGPT

Visual Intelligence on iPhone can help you identify many things on the screen. Here it is How to use iPhone’s Visual Intelligence.

Apple first introduced the Visual Intelligence feature in iOS 18.2, allowing it to identify what the iPhone camera sees in real time. With iOS 27, Apple has taken this feature one step further. Now, Visual Intelligence is tightly integrated with Siri AI, helping iPhone understand much better what’s in front of the camera as well as what’s displayed on the screen.

What is Visual Intelligence?

Visual Intelligence is a feature operated by Apple Intelligence, combining on-device AI processing and real-time image understanding. This feature launched with the iPhone 16 series and requires the device to have at least the A17 Pro chip and advanced Neural Engine to ensure fast processing speed and security.

With this feature, iPhone can recognize and extract information displayed on the camera and screen — from recognizing a plant, translating a menu, searching for products online to receiving instant support from ChatGPT and Siri AI.

On iOS 27, Visual Intelligence is more deeply integrated with Siri. This feature can:

• Recognize objects and places
• Ask questions about the object displayed in front of the camera
• Search for similar images on the web
• Identify plants and animals
• Read, summarize and translate text
• Look up information about businesses
• Analyze dishes and provide nutritional information
• Interact with restaurant receipts
• Extract information from documents and tags
• Convert information from flyers into calendar events
• Perform tasks based on recorded camera images

Apple also allows Visual Intelligence to work with screenshots, so you don’t need to point the camera directly at the object if that information is already available on the iPhone.

iPhone models that support Visual Intelligence

• iPhone 15 Pro and iPhone 15 Pro Max
• iPhone 16, 16 Plus, 16e, 16 Pro, 16 Pro Max
• iPhone 17, 17 Pro, 17 Pro Max
• iPhone Air
• iPhone 18 Pro, 18 Pro Max
• iPhone Duo

Apple Intelligence support may vary depending on device, language, and region.

How to access Visual Intelligence on iPhone

You have many ways to do this, specifically as follows:

Use Siri mode in the Camera app

If you have Siri AI enabled, this is the most direct way to use Visual Intelligence.

1. Open the Camera app.
2. Swipe through the shooting modes until you see Siri.
3. Point the iPhone camera at the object you want to learn about.
4. Tap the Siri button to see information about what’s showing in the frame.

Use the Camera Control button

If your iPhone has a Camera Control button, press and hold it to let Visual Intelligence analyze the scene, then choose one of the suggested actions or ask a question.

First you need to set this up:

1. Open Settings on iPhone.
2. Select Camera and touch Camera Control.
3. Scroll down and enable the option Press and Hold in section Launch Visual Intelligence (Launch Visual Intelligence).

This remains one of the fastest ways to access Visual Intelligence on supported iPhone models.

Use the Action Button

If your iPhone doesn’t have a Camera Control button, you can assign the Visual Intelligence feature to the Action Button on supported models.

1. Open Settings.
2. Touch Action Button.
3. Swipe through the available options.
4. Select Visual Intelligence.
5. Press and hold the button Action Button whenever you want to use this feature.

How to use Visual Intelligence on iPhone

You have many ways to use this feature, below are just a few suggestions:

Ask Siri about anything in front of the camera

Instead of simply identifying an object, users can ask questions about it. For example, I might point the camera at a cricket ball and ask: “How to play cricket?”

Siri’s AI can recognize objects and continue the conversation with additional responses.

To experience this feature:

1. Open the Camera app.
2. Switch to Siri mode.
3. Point the camera at an object.
4. Click the “Ask” button on the left side.
5. Type or read your question.
6. Wait for a response from Siri.

Identify plants and animals

Visual Intelligence can identify plants and animals through cameras. Usage:

1. Open the Camera app.
2. Siri mode or activate Visual Intelligence with your chosen keyboard shortcut.
3. Point the camera towards the tree or animal.
4. Tap on the suggested recognition result or press the Siri button to know what object you’re looking at.

Identify locations and businesses

Visual Intelligence is also very useful when you are walking in a new area. Point the camera at a business or location and Visual Intelligence will provide relevant information (depending on data available in your area).

For supported properties, you can see details such as:

• Business establishment information
• Opening hours
• Website
• Contact information
• Menu or ordering options