Skip to content

Commit b4658f2

Browse files
v-regandownerv-regandowner
authored
Merge pull request #262665 from eric-urban/eur/gpt4v
gpt4v prerequisites and edits
2 parents 1b1a21f + 22e6bc9 commit b4658f2

11 files changed

Lines changed: 66 additions & 59 deletions

‎articles/ai-studio/how-to/prompt-flow-tools/azure-open-ai-gpt-4v-tool.md‎

Lines changed: 26 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -2,27 +2,34 @@
22
title: Azure OpenAI GPT-4 Turbo with Vision tool in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Azure OpenAI GPT-4 Turbo with Vision tool for flows in Azure AI Studio.
5+
manager: nitinme
56
ms.service: azure-ai-studio
6-
ms.topic: reference
7-
author: likebupt
8-
ms.author: keli19
9-
ms.reviewer: eur
10-
ms.date: 01/02/2024
7+
ms.topic: how-to
8+
ms.date: 1/8/2024
9+
author: lgayhardt
10+
ms.author: lagayhar
11+
ms.reviewer: keli19
12+
ms.custom: references_regions
1113
---
1214

13-
# Azure OpenAI GPT-4 Turbo with Vision tool (preview) in Azure AI studio
15+
# Azure OpenAI GPT-4 Turbo with Vision tool in Azure AI Studio
1416

15-
Azure OpenAI GPT-4 Turbo with Vision tool enables you to leverage your AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.
17+
[!INCLUDE [Azure AI Studio preview](../../includes/preview-ai-studio.md)]
18+
19+
The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use your Azure OpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.
1620

1721
## Prerequisites
1822

19-
- Create a GPT-4 Turbo with Vision deployment
23+
- An Azure subscription - <a href="https://azure.microsoft.com/free/cognitive-services" target="_blank">Create one for free</a>.
24+
- Access granted to Azure OpenAI in the desired Azure subscription.
25+
26+
Currently, access to this service is granted only by application. You can apply for access to Azure OpenAI by completing the form at <a href="https://aka.ms/oai/access" target="_blank">https://aka.ms/oai/access</a>. Open an issue on this repo to contact us if you have an issue.
2027

21-
In AI studio, select **Deployments** from the left navigation pane and create a deployment by selecting model name: `gpt-4v`.
28+
- An [Azure AI resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in one of the regions that support GPT-4 Turbo with Vision: Australia East, Switzerland North, Sweden Central, and West US. When you deploy from your project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
2229

2330
## Connection
2431

25-
Setup connections to provisioned resources in prompt flow.
32+
Set up connections to provisioned resources in prompt flow.
2633

2734
| Type | Name | API KEY | API Type | API Version |
2835
|-------------|----------|----------|----------|-------------|
@@ -32,15 +39,15 @@ Setup connections to provisioned resources in prompt flow.
3239

3340
| Name | Type | Description | Required |
3441
|------------------------|-------------|------------------------------------------------------------------------------------------------|----------|
35-
| connection | AzureOpenAI | the AzureOpenAI connection to be used in the tool | Yes |
36-
| deployment\_name | string | the language model to use | Yes |
37-
| prompt | string | The text prompt that the language model will use to generate its response. | Yes |
38-
| max\_tokens | integer | the maximum number of tokens to generate in the response. Default is 512. | No |
39-
| temperature | float | the randomness of the generated text. Default is 1. | No |
40-
| stop | list | the stopping sequence for the generated text. Default is null. | No |
41-
| top_p | float | the probability of using the top choice from the generated tokens. Default is 1. | No |
42-
| presence\_penalty | float | value that controls the model's behavior with regard to repeating phrases. Default is 0. | No |
43-
| frequency\_penalty | float | value that controls the model's behavior with regard to generating rare phrases. Default is 0. | No |
42+
| connection | AzureOpenAI | The Azure OpenAI connection to be used in the tool. | Yes |
43+
| deployment\_name | string | The language model to use. | Yes |
44+
| prompt | string | Text prompt that the language model uses to generate its response. | Yes |
45+
| max\_tokens | integer | Maximum number of tokens to generate in the response. Default is 512. | No |
46+
| temperature | float | Randomness of the generated text. Default is 1. | No |
47+
| stop | list | Stopping sequence for the generated text. Default is null. | No |
48+
| top_p | float | Probability of using the top choice from the generated tokens. Default is 1. | No |
49+
| presence\_penalty | float | Value that controls the model's behavior regarding repeating phrases. Default is 0. | No |
50+
| frequency\_penalty | float | Value that controls the model's behavior regarding generating rare phrases. Default is 0. | No |
4451

4552
## Outputs
4653

‎articles/ai-studio/how-to/prompt-flow-tools/content-safety-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Content Safety tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Content Safety tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Content safety tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/embedding-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Embedding tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Embedding tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Embedding tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/faiss-index-lookup-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Faiss Index Lookup tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Faiss Index Lookup tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Faiss Index Lookup tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/llm-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: LLM tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the LLM tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# LLM tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/prompt-flow-tools-overview.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,13 +2,13 @@
22
title: Overview of prompt flow tools in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: Learn about prompt flow tools that are available in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.topic: overview
98
ms.date: 12/6/2023
10-
ms.reviewer: eur
11-
ms.author: eur
9+
author: lgayhardt
10+
ms.author: lagayhar
11+
ms.reviewer: keli19
1212
---
1313

1414
# Overview of prompt flow tools in Azure AI Studio
@@ -22,7 +22,7 @@ The following table provides an index of tools in prompt flow. If existing tools
2222
| [LLM](./llm-tool.md) | Use Azure Open AI large language models (LLM) for tasks such as text completion or chat. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
2323
| [Prompt](./prompt-tool.md) | Craft a prompt by using Jinja as the templating language. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
2424
| [Python](./python-tool.md) | Run Python code. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
25-
| [Azure OpenAI GPT-4 Turbo with Vision (preview)](./azure-open-ai-gpt-4v-tool.md) | Use AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
25+
| [Azure OpenAI GPT-4 Turbo with Vision](./azure-open-ai-gpt-4v-tool.md) | Use AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
2626
| [Vector Index Lookup](./vector-index-lookup-tool.md) | Search text or a vector-based query from a vector index. | Default | [promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/) |
2727
| [Content Safety (Text)](./content-safety-tool.md) | Use Azure AI Content Safety to detect harmful content. | Default | [promptflow-tools](https://pypi.org/project/promptflow-tools/) |
2828
| [Faiss Index Lookup](./faiss-index-lookup-tool.md) | Search a vector-based query from the Faiss index file. | Default | [promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/) |

‎articles/ai-studio/how-to/prompt-flow-tools/prompt-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Prompt tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Prompt tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Prompt tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/python-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,14 +2,14 @@
22
title: Python tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Python tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom: ignite-2023, devx-track-python
9-
ms.topic: conceptual
8+
ms.topic: how-to
109
ms.date: 11/15/2023
11-
ms.reviewer: eur
12-
ms.author: eur
10+
author: lgayhardt
11+
ms.author: lagayhar
12+
ms.reviewer: keli19
1313
---
1414

1515
# Python tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/serp-api-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Serp API tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Serp API tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Serp API tool for flows in Azure AI Studio

‎articles/ai-studio/how-to/prompt-flow-tools/vector-db-lookup-tool.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
title: Vector DB Lookup tool for flows in Azure AI Studio
33
titleSuffix: Azure AI Studio
44
description: This article introduces the Vector DB Lookup tool for flows in Azure AI Studio.
5-
author: eric-urban
65
manager: nitinme
76
ms.service: azure-ai-studio
87
ms.custom:
98
- ignite-2023
10-
ms.topic: conceptual
9+
ms.topic: how-to
1110
ms.date: 11/15/2023
12-
ms.reviewer: eur
13-
ms.author: eur
11+
author: lgayhardt
12+
ms.author: lagayhar
13+
ms.reviewer: keli19
1414
---
1515

1616
# Vector DB Lookup tool for flows in Azure AI Studio

0 commit comments

Comments
 (0)