532 questions
0
votes
1
answer
44
views
Azure Agent Retrieval (Azure AI Search) returns JSON references instead of LLM-generated answer
I’m testing Azure Agent Retrieval with Azure AI Search and Azure OpenAI integration.
However, instead of getting a natural language LLM-generated answer, the response only returns raw JSON with ...
- 73
0
votes
1
answer
54
views
'metadata_storage_name' always null: Missing or empty value '/document/blob_name'
Using Azure's AI Search Service to chunk and read textfiles, the target field values are always NULL.
I tried using a simplified example, just for the fields metadata_blob_name / title and ...
- 2,107
0
votes
1
answer
81
views
How can I update the capacity of a finetuned GPT model on Azure using Python?
I want to update the capacity of a finetuned GPT model on Azure. How can I do so in Python?
The following code used to work a few months ago (it used to take a few seconds to update the capacity) but ...
- 84.7k
0
votes
0
answers
138
views
Configuring MCP with Microsoft.Extensions.AI
Using the following Microsoft template as my base:
https://devblogs.microsoft.com/dotnet/announcing-dotnet-ai-template-preview1/
I want to be able to add my local stdio MCP server as a tool but can't ...
- 756
0
votes
0
answers
59
views
Correct input for OpenAI embeddings API?
I'm using the OpenAi text-embedding-3-small model to create embeddings for each product category in a file. In total it's about 6000 product categories and they look like this:
Vehicles & Parts &...
- 3,873
0
votes
0
answers
19
views
Feedback button not showing after updating cdn path in aoai webapp
After I Updated the cdn path so that the icons work, the other icons are showing but the ThumbsUp & ThumbsDown buttons are not showing now. What has to be done for that and why this is happening ...
0
votes
1
answer
134
views
Why is pylance not able to statically determine Literal Union type in dictionary value
When writing a to_ChatCompletionMessageParam() instance method, I have the following implementation:
def to_ChatCompletionMessageParam(self) -> ChatCompletionMessageParam:
author: Literal["...
- 537
2
votes
1
answer
69
views
Why can't (langchain) AzureOpenAI find a model that AzureChatOpenAI can?
Invoking a request using AzureChatOpenAI returns response as expected:
import os
from dotenv import load_dotenv
from langchain_openai import AzureChatOpenAI
load_dotenv()
llm = AzureChatOpenAI(
...
- 460
1
vote
1
answer
306
views
Azure OpenAI / Foundry: Vector Store File Attributes (Metadata) Problem
I'm encountering an issue when trying to add attributes (metadata) to files in an Azure OpenAI Vector Store.
My setup:
Azure OpenAI API (version 2025-04-01-preview)
Python SDK for file uploads
Goal: ...
- 385
0
votes
0
answers
99
views
How to loop through text chunks created using AzureOpenAI `client.vector_stores.create`
I checked Azure's documentation on this topic here but I do not see anything related to this. My goal is to create a question and answer dataset for my RAG solution based on each chunk for a good ...
- 3,629
2
votes
2
answers
393
views
Azure OpenAI: DeploymentNotFound: The API deployment for this resource does not exist
I am using AzureOpenAI Service, and I just encountered an issue openai.NotFoundError: Error code: 404 - {'error': {'code': 'DeploymentNotFound', 'message': 'The API deployment for this resource does ...
- 21
0
votes
1
answer
71
views
Automating using Autogen AI to fetch azure migrate resport and generate PPT
Im new to autogen ai currently using autogen version 0.7 Automating using Autogen AI to fetch azure migrate assessment report and generating PPT using autogen agents group chat agent but some times ...
- 79
0
votes
0
answers
113
views
OpenAI Azure chat.completions.create stalling without throwing exception
I have a fastapi endpoint which streams a response from Azure OpenAI:
@router.post("/message", dependencies=[Depends(validate_auth)])
def message(sessionID: str = Form(...), messages: str = ...
1
vote
1
answer
239
views
How to properly use OpenAI.RealtimeConversation.RealtimeConversationClient to start multiple RealtimeConversationSession(s)?
The Azure OpenAI SDK appears to follow a one-client-per-session model, but I want to be sure. Since it is still in beta, it is not clear if a single instance of the client returned by ...
- 21
0
votes
1
answer
164
views
How can I deploy a fine-tuned GPT model in Azure via Python without using a token (e.g., using an endpoint key instead)?
I follow Azure's tutorial on fine-tuning GPT. Here is the code for the deployment phase:
# Deploy fine-tuned model
import json
import requests
token = '[redacted]'
subscription = '[redacted]'
...
- 84.7k
0
votes
1
answer
878
views
Azure OpenAI Embedding SDK (C#) – Official example uses outdated types and alternatives return 404
I have successfully deployed a model (text-embedding-3-large) using the Azure OpenAI portal, and I'm now trying to integrate it using the OpenAI .NET SDK.
The Azure portal itself provides the ...
- 110
0
votes
1
answer
166
views
How to call AzureOpenAI API with PyRIT?
Im triying to do a basic PyRIT project but im not able to use the AzureOpenAI with PyRIT.
I have this code woking, but not with PyRIT:
from openai import AzureOpenAI
client = AzureOpenAI(
api_key=&...
1
vote
1
answer
969
views
Connecting AzureOpenAI via LiteLLM - returning Authentication Error 401
I am using DSPy framework (v2.6.4) which uses liteLLM (v1.63.7) to connect to LLMs.
While connecting Azure OpenAI via liteLLM (v1.63.7) using the below method (Azure AD Token Refresh - ...
- 35
0
votes
1
answer
288
views
Additional headers are not being sent to the Azure OpenAI through Weaviate SDK
I am using the Python SDK to connect to Weaviate. Additionally, I am create collection that is able to send requests to Azure OpenAI, using text2vec-azure-openai module. To use that, I am sending X-...
0
votes
2
answers
246
views
How can I resolve the 403 Forbidden error when deploying a fine-tuned GPT model in Azure via Python?
I follow Azure's tutorial on fine-tuning GPT. I'm stuck at the deployment phase.
Code:
# Deploy fine-tuned model
import json
import requests
token = '[redacted]'
subscription = '[redacted]'
...
- 84.7k
3
votes
1
answer
530
views
Azure AI Search - Tag Scoring profile on azureopenai extra_body
I created an index on Azure AI Search and connected it to Azure OpenAI using the extra_body. It works perfectly. However, I created a default scoring profile for my index, which boosts documents ...
- 809
2
votes
1
answer
290
views
Is there a way to disable content filteration in Azure OpenAi or to process the prompt before using it [closed]
I’m working on a report generation using some rubric’s and a conversation string containing questions and answers for the questions from the user which is captured through openai real-time api. But ...
- 21
-1
votes
1
answer
84
views
I am not able to create the embeddings of my fields titleVector and contentVector
I used AzureOpenAI Vectorizer to create embeddings in my search index but it is not created in search index why while uploadind documents i only uploaded id,content,title and titleVector and ...
0
votes
2
answers
574
views
How to use Azure AI OpenAI to generate responses from a model using a set of data inputs?
I’m trying to use Azure AI OpenAI to generate responses from a trained model based on a set of data I’ll provide as part of the prompt. My goal is to pass a set of data (e.g., metrics, statistics, or ...
- 470
0
votes
1
answer
268
views
Azure Devops Pull Request Review Integration with AzureOpenAI instance
We are using Azure Devops Server 2022 on-premise and we have a private Azure OpenAI instance enabled with a private endpoint. In VSTS marketplace, we were able to find many extensions:
https://...
- 1,551