Portal returns updated results while the API returns outdated ones

Question

I have created a GPT4 model in Azure OpenAI Service, and I want to add data source which is Azure AI Search (Cognitive Search Service).
The problem is at the time of deployment i cannot see any data source adding option, it is deployed first and then data source is added in the portal but when we do that .NET api return old data only portal gives us updated data with source. How do i fix this problem?

Answer 1

hi, you can try to add extra_body section in the GPT4 API call in your client side. see below example

import os
from openai import AzureOpenAI  
from azure.identity import DefaultAzureCredential, get_bearer_token_provider  
  
endpoint = os.getenv("ENDPOINT_URL", "https://xxxxx.openai.azure.com/")
deployment = os.getenv("DEPLOYMENT_NAME", "xxxx")
  
# Initialize Azure OpenAI client with Entra ID authentication  
cognitiveServicesResource = os.getenv('AZURE_COGNITIVE_SERVICES_RESOURCE', 'YOUR_COGNITIVE_SERVICES_RESOURCE')  
token_provider = get_bearer_token_provider(  
    DefaultAzureCredential(),  
    f'{cognitiveServicesResource}.default'  
)  
        
client = AzureOpenAI(  
    azure_endpoint=endpoint,  
    azure_ad_token_provider=token_provider,  
    api_version='2024-05-01-preview',  
)  
       
completion = client.chat.completions.create(  
    model=deployment,  
    messages=[
    {
        "role": "system",
        "content": "You are an AI assistant that helps people find information."
    },
    {
        "role": "user",
        "content": "hi"
    }
],  
    past_messages=10,
    max_tokens=800,  
    temperature=0.7,  
    top_p=0.95,  
    frequency_penalty=0,  
    presence_penalty=0,  
    stop=None,  
    extra_body={  
        "data_sources": [  
            {  
                "type": "azure_search",  
                "parameters": {  
                    "endpoint": os.environ["AZURE_AI_SEARCH_ENDPOINT"],  
                    "index_name": os.environ["AZURE_AI_SEARCH_INDEX"],  
                    "authentication": {  
                        "type": "system_assigned_managed_identity"  
                    }  
                }  
            }  
        ]  
    }  
)
print(completion.model_dump_json(indent=2))