You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/quickstarts/multimodal-vision.md
+4-8Lines changed: 4 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -120,16 +120,12 @@ In this chat session, you'll be instructing the assistant to aid in understandin
120
120
1. Sign in to [Azure AI Studio](https://ai.azure.com).
121
121
1. Select **Build** from the top menu and then select **Playground** from the collapsible left menu.
122
122
1. In the **Configuration** pane on the right side of the chat experience, turn on the option for **Vision** under **Enhancements**.
123
-
1. In the **Vision enhancements settings** dialog, select an Azure AI Vision resource and then select **Save**.
124
123
125
-
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-car-accident-enhanced-settings.png" alt-text="Screenshot of the vision enhancement settings for video analysis in the chat playground." lightbox="../media/quickstarts/multimodal-vision/chat-car-accident-enhanced-settings.png":::
126
-
127
-
> [!NOTE]
128
-
> You might need to select **Vision** enhancement button again to apply the changes.
124
+
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-video-turn-on-enhancement.png" alt-text="Screenshot of the vision enhancement settings for video analysis in the chat playground." lightbox="../media/quickstarts/multimodal-vision/chat-video-turn-on-enhancement.png":::
129
125
130
126
1. Make sure that **Chat** is selected from the **Mode** dropdown. Select your deployed GPT-4 Turbo with Vision model from the **Deployment** dropdown. Under the chat session text box, you should now see the option to select a file.
131
127
132
-
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-multi-modal-video-select.png" alt-text="Screenshot of the chat playground with mode and deployment and upload video button highlighted." lightbox="../media/quickstarts/multimodal-vision/chat-multi-modal-video-select.png":::
128
+
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-video-upload-video.png" alt-text="Screenshot of the chat playground with mode and deployment and upload video button highlighted." lightbox="../media/quickstarts/multimodal-vision/chat-video-upload-video.png":::
133
129
134
130
1. In the **System message** text box on the **Assistant setup** pane, provide this prompt to guide the assistant: "You're a car insurance and accident expert. Extract detailed information about the car's make, model, damage extent, license plate, airbag deployment status, mileage, and any other observations" You can tailor the prompt for the video or scenario.
135
131
1. Select **Apply changes** to save your changes, and when prompted to see if you want to update the system message, select **Continue**.
@@ -141,7 +137,7 @@ In this chat session, you'll be instructing the assistant to aid in understandin
141
137
142
138
1. The square icon replaces the right arrow icon. If you select the square icon, the assistant stops processing your request. For this quickstart, let the assistant finish its reply. Don't select the square icon.
143
139
144
-
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-car-accident-prompt-stop.png" alt-text="Screenshot of the chat playground with the stop button highlighted." lightbox="../media/quickstarts/multimodal-vision/chat-car-accident-prompt-stop.png":::
140
+
:::image type="content" source="../media/quickstarts/multimodal-vision/check-box.png" alt-text="Screenshot of the chat playground with the stop button highlighted." lightbox="../media/quickstarts/multimodal-vision/check-box.png":::
145
141
146
142
1. The assistant should reply with a description of the video.
147
143
@@ -152,7 +148,7 @@ In this chat session, you'll be instructing the assistant to aid in understandin
152
148
153
149
1. You should receive a relevant response similar to what's shown here:
154
150
155
-
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-car-video-reply-insurance.png" alt-text="Screenshot of the chat playground with the assistant's follow-up reply for video analysis." lightbox="../media/quickstarts/multimodal-vision/chat-car-video-reply-insurance.png":::
151
+
:::image type="content" source="../media/quickstarts/multimodal-vision/chat-video-output.png" alt-text="Screenshot of the chat playground with the assistant's follow-up reply for video analysis." lightbox="../media/quickstarts/multimodal-vision/chat-video-output.png":::
156
152
157
153
Below are the known limitations of the video prompt enhancements.
0 commit comments