Proxy Error when try to use open AI API

GUO Ranfei (RBCC/BDO1) 20

User's image

After setting environment variable successfully, I still got this error.

navba-MSFT 27,360 Reputation points Microsoft Employee

2024-01-17T03:06:54.7766667+00:00

@GUO Ranfei (RBCC/BDO1) Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
Could you please share the sample code here so that I can test it at my end ?
Also please share the detailed error message in Text format instead of screenshot ?
.
Awaiting your reply.

GUO Ranfei (RBCC/BDO1) 20

Thanks. Following is the code and error.

import os
from openai import AzureOpenAI
    
client = AzureOpenAI(
    api_key=os.getenv("AZURE_OPENAI_KEY"),  
    api_version="2023-12-01-preview",
    azure_endpoint = os.getenv("AZURE_OPENAI_ENDPOINT")
    )
    
deployment_name='gpt-35-turbo' #This will correspond to the custom name you chose for your deployment when you deployed a model. Use a gpt-35-turbo-instruct deployment. 
    
# Send a completion call to generate an answer
print('Sending a test completion job')
start_phrase = 'Write a tagline for an ice cream shop. '
response = client.completions.create(model=deployment_name, prompt=start_phrase, max_tokens=10)
print(start_phrase+response.choices[0].text)

Sending a test completion job
---------------------------------------------------------------------------
ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:67, in map_httpcore_exceptions()
     66 try:
---> 67     yield
     68 except Exception as exc:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:268, in ConnectionPool.handle_request(self, request)
    267         self.response_closed(status)
--> 268     raise exc
    269 else:

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:251, in ConnectionPool.handle_request(self, request)
    250 try:
--> 251     response = connection.handle_request(request)
    252 except ConnectionNotAvailable:
    253     # The ConnectionNotAvailable exception is a special case, that
    254     # indicates we need to retry the request on a new connection.
   (...)
    258     # might end up as an HTTP/2 connection, but which actually ends
    259     # up as HTTP/1.1.

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\http_proxy.py:298, in TunnelHTTPConnection.handle_request(self, request)
    297     self._connection.close()
--> 298     raise ProxyError(msg)
    300 stream = connect_response.extensions["network_stream"]

ProxyError: 407 Proxy Authentication Required

The above exception was the direct cause of the following exception:

ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:880, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    879 try:
--> 880     response = self._client.send(
    881         request,
    882         stream=stream or self._should_stream_response_body(request=request),
    883         **kwargs,
    884     )
    885 except httpx.TimeoutException as err:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:915, in Client.send(self, request, stream, auth, follow_redirects)
    913 auth = self._build_request_auth(request, auth)
--> 915 response = self._send_handling_auth(
    916     request,
    917     auth=auth,
    918     follow_redirects=follow_redirects,
    919     history=[],
    920 )
    921 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:943, in Client._send_handling_auth(self, request, auth, follow_redirects, history)
    942 while True:
--> 943     response = self._send_handling_redirects(
    944         request,
    945         follow_redirects=follow_redirects,
    946         history=history,
    947     )
    948     try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:980, in Client._send_handling_redirects(self, request, follow_redirects, history)
    978     hook(request)
--> 980 response = self._send_single_request(request)
    981 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:1016, in Client._send_single_request(self, request)
   1015 with request_context(request=request):
-> 1016     response = transport.handle_request(request)
   1018 assert isinstance(response.stream, SyncByteStream)

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\contextlib.py:131, in _GeneratorContextManager.__exit__(self, type, value, traceback)
    130 try:
--> 131     self.gen.throw(type, value, traceback)
    132 except StopIteration as exc:
    133     # Suppress StopIteration *unless* it's the same exception that
    134     # was passed to throw().  This prevents a StopIteration
    135     # raised inside the "with" statement from being suppressed.

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:84, in map_httpcore_exceptions()
     83 message = str(exc)
---> 84 raise mapped_exc(message) from exc

ProxyError: 407 Proxy Authentication Required

During handling of the above exception, another exception occurred:

ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:67, in map_httpcore_exceptions()
     66 try:
---> 67     yield
     68 except Exception as exc:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:268, in ConnectionPool.handle_request(self, request)
    267         self.response_closed(status)
--> 268     raise exc
    269 else:

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:251, in ConnectionPool.handle_request(self, request)
    250 try:
--> 251     response = connection.handle_request(request)
    252 except ConnectionNotAvailable:
    253     # The ConnectionNotAvailable exception is a special case, that
    254     # indicates we need to retry the request on a new connection.
   (...)
    258     # might end up as an HTTP/2 connection, but which actually ends
    259     # up as HTTP/1.1.

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\http_proxy.py:298, in TunnelHTTPConnection.handle_request(self, request)
    297     self._connection.close()
--> 298     raise ProxyError(msg)
    300 stream = connect_response.extensions["network_stream"]

ProxyError: 407 Proxy Authentication Required

The above exception was the direct cause of the following exception:

ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:880, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    879 try:
--> 880     response = self._client.send(
    881         request,
    882         stream=stream or self._should_stream_response_body(request=request),
    883         **kwargs,
    884     )
    885 except httpx.TimeoutException as err:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:915, in Client.send(self, request, stream, auth, follow_redirects)
    913 auth = self._build_request_auth(request, auth)
--> 915 response = self._send_handling_auth(
    916     request,
    917     auth=auth,
    918     follow_redirects=follow_redirects,
    919     history=[],
    920 )
    921 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:943, in Client._send_handling_auth(self, request, auth, follow_redirects, history)
    942 while True:
--> 943     response = self._send_handling_redirects(
    944         request,
    945         follow_redirects=follow_redirects,
    946         history=history,
    947     )
    948     try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:980, in Client._send_handling_redirects(self, request, follow_redirects, history)
    978     hook(request)
--> 980 response = self._send_single_request(request)
    981 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:1016, in Client._send_single_request(self, request)
   1015 with request_context(request=request):
-> 1016     response = transport.handle_request(request)
   1018 assert isinstance(response.stream, SyncByteStream)

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\contextlib.py:131, in _GeneratorContextManager.__exit__(self, type, value, traceback)
    130 try:
--> 131     self.gen.throw(type, value, traceback)
    132 except StopIteration as exc:
    133     # Suppress StopIteration *unless* it's the same exception that
    134     # was passed to throw().  This prevents a StopIteration
    135     # raised inside the "with" statement from being suppressed.

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:84, in map_httpcore_exceptions()
     83 message = str(exc)
---> 84 raise mapped_exc(message) from exc

ProxyError: 407 Proxy Authentication Required

During handling of the above exception, another exception occurred:

ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:67, in map_httpcore_exceptions()
     66 try:
---> 67     yield
     68 except Exception as exc:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:268, in ConnectionPool.handle_request(self, request)
    267         self.response_closed(status)
--> 268     raise exc
    269 else:

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\connection_pool.py:251, in ConnectionPool.handle_request(self, request)
    250 try:
--> 251     response = connection.handle_request(request)
    252 except ConnectionNotAvailable:
    253     # The ConnectionNotAvailable exception is a special case, that
    254     # indicates we need to retry the request on a new connection.
   (...)
    258     # might end up as an HTTP/2 connection, but which actually ends
    259     # up as HTTP/1.1.

File ~\.conda\envs\pytorch\lib\site-packages\httpcore\_sync\http_proxy.py:298, in TunnelHTTPConnection.handle_request(self, request)
    297     self._connection.close()
--> 298     raise ProxyError(msg)
    300 stream = connect_response.extensions["network_stream"]

ProxyError: 407 Proxy Authentication Required

The above exception was the direct cause of the following exception:

ProxyError                                Traceback (most recent call last)
File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:880, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    879 try:
--> 880     response = self._client.send(
    881         request,
    882         stream=stream or self._should_stream_response_body(request=request),
    883         **kwargs,
    884     )
    885 except httpx.TimeoutException as err:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:915, in Client.send(self, request, stream, auth, follow_redirects)
    913 auth = self._build_request_auth(request, auth)
--> 915 response = self._send_handling_auth(
    916     request,
    917     auth=auth,
    918     follow_redirects=follow_redirects,
    919     history=[],
    920 )
    921 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:943, in Client._send_handling_auth(self, request, auth, follow_redirects, history)
    942 while True:
--> 943     response = self._send_handling_redirects(
    944         request,
    945         follow_redirects=follow_redirects,
    946         history=history,
    947     )
    948     try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:980, in Client._send_handling_redirects(self, request, follow_redirects, history)
    978     hook(request)
--> 980 response = self._send_single_request(request)
    981 try:

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_client.py:1016, in Client._send_single_request(self, request)
   1015 with request_context(request=request):
-> 1016     response = transport.handle_request(request)
   1018 assert isinstance(response.stream, SyncByteStream)

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:231, in HTTPTransport.handle_request(self, request)
    230 with map_httpcore_exceptions():
--> 231     resp = self._pool.handle_request(req)
    233 assert isinstance(resp.stream, typing.Iterable)

File ~\.conda\envs\pytorch\lib\contextlib.py:131, in _GeneratorContextManager.__exit__(self, type, value, traceback)
    130 try:
--> 131     self.gen.throw(type, value, traceback)
    132 except StopIteration as exc:
    133     # Suppress StopIteration *unless* it's the same exception that
    134     # was passed to throw().  This prevents a StopIteration
    135     # raised inside the "with" statement from being suppressed.

File ~\.conda\envs\pytorch\lib\site-packages\httpx\_transports\default.py:84, in map_httpcore_exceptions()
     83 message = str(exc)
---> 84 raise mapped_exc(message) from exc

ProxyError: 407 Proxy Authentication Required

The above exception was the direct cause of the following exception:

APIConnectionError                        Traceback (most recent call last)
Cell In[1], line 16
     14 print('Sending a test completion job')
     15 start_phrase = 'Write a tagline for an ice cream shop. '
---> 16 response = client.completions.create(model=deployment_name, prompt=start_phrase, max_tokens=10)
     17 print(start_phrase+response.choices[0].text)

File ~\.conda\envs\pytorch\lib\site-packages\openai\_utils\_utils.py:271, in required_args.<locals>.inner.<locals>.wrapper(*args, **kwargs)
    269             msg = f"Missing required argument: {quote(missing[0])}"
    270     raise TypeError(msg)
--> 271 return func(*args, **kwargs)

File ~\.conda\envs\pytorch\lib\site-packages\openai\resources\completions.py:560, in Completions.create(self, model, prompt, best_of, echo, frequency_penalty, logit_bias, logprobs, max_tokens, n, presence_penalty, seed, stop, stream, suffix, temperature, top_p, user, extra_headers, extra_query, extra_body, timeout)
    518 @required_args(["model", "prompt"], ["model", "prompt", "stream"])
    519 def create(
    520     self,
   (...)
    558     timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
    559 ) -> Completion | Stream[Completion]:
--> 560     return self._post(
    561         "/completions",
    562         body=maybe_transform(
    563             {
    564                 "model": model,
    565                 "prompt": prompt,
    566                 "best_of": best_of,
    567                 "echo": echo,
    568                 "frequency_penalty": frequency_penalty,
    569                 "logit_bias": logit_bias,
    570                 "logprobs": logprobs,
    571                 "max_tokens": max_tokens,
    572                 "n": n,
    573                 "presence_penalty": presence_penalty,
    574                 "seed": seed,
    575                 "stop": stop,
    576                 "stream": stream,
    577                 "suffix": suffix,
    578                 "temperature": temperature,
    579                 "top_p": top_p,
    580                 "user": user,
    581             },
    582             completion_create_params.CompletionCreateParams,
    583         ),
    584         options=make_request_options(
    585             extra_headers=extra_headers, extra_query=extra_query, extra_body=extra_body, timeout=timeout
    586         ),
    587         cast_to=Completion,
    588         stream=stream or False,
    589         stream_cls=Stream[Completion],
    590     )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:1091, in SyncAPIClient.post(self, path, cast_to, body, options, files, stream, stream_cls)
   1077 def post(
   1078     self,
   1079     path: str,
   (...)
   1086     stream_cls: type[_StreamT] | None = None,
   1087 ) -> ResponseT | _StreamT:
   1088     opts = FinalRequestOptions.construct(
   1089         method="post", url=path, json_data=body, files=to_httpx_files(files), **options
   1090     )
-> 1091     return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:852, in SyncAPIClient.request(self, cast_to, options, remaining_retries, stream, stream_cls)
    843 def request(
    844     self,
    845     cast_to: Type[ResponseT],
   (...)
    850     stream_cls: type[_StreamT] | None = None,
    851 ) -> ResponseT | _StreamT:
--> 852     return self._request(
    853         cast_to=cast_to,
    854         options=options,
    855         stream=stream,
    856         stream_cls=stream_cls,
    857         remaining_retries=remaining_retries,
    858     )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:899, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    897 except Exception as err:
    898     if retries > 0:
--> 899         return self._retry_request(
    900             options,
    901             cast_to,
    902             retries,
    903             stream=stream,
    904             stream_cls=stream_cls,
    905             response_headers=None,
    906         )
    908     raise APIConnectionError(request=request) from err
    910 log.debug(
    911     'HTTP Request: %s %s "%i %s"', request.method, request.url, response.status_code, response.reason_phrase
    912 )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:961, in SyncAPIClient._retry_request(self, options, cast_to, remaining_retries, response_headers, stream, stream_cls)
    957 # In a synchronous context we are blocking the entire thread. Up to the library user to run the client in a
    958 # different thread if necessary.
    959 time.sleep(timeout)
--> 961 return self._request(
    962     options=options,
    963     cast_to=cast_to,
    964     remaining_retries=remaining,
    965     stream=stream,
    966     stream_cls=stream_cls,
    967 )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:899, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    897 except Exception as err:
    898     if retries > 0:
--> 899         return self._retry_request(
    900             options,
    901             cast_to,
    902             retries,
    903             stream=stream,
    904             stream_cls=stream_cls,
    905             response_headers=None,
    906         )
    908     raise APIConnectionError(request=request) from err
    910 log.debug(
    911     'HTTP Request: %s %s "%i %s"', request.method, request.url, response.status_code, response.reason_phrase
    912 )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:961, in SyncAPIClient._retry_request(self, options, cast_to, remaining_retries, response_headers, stream, stream_cls)
    957 # In a synchronous context we are blocking the entire thread. Up to the library user to run the client in a
    958 # different thread if necessary.
    959 time.sleep(timeout)
--> 961 return self._request(
    962     options=options,
    963     cast_to=cast_to,
    964     remaining_retries=remaining,
    965     stream=stream,
    966     stream_cls=stream_cls,
    967 )

File ~\.conda\envs\pytorch\lib\site-packages\openai\_base_client.py:908, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
    898     if retries > 0:
    899         return self._retry_request(
    900             options,
    901             cast_to,
   (...)
    905             response_headers=None,
    906         )
--> 908     raise APIConnectionError(request=request) from err
    910 log.debug(
    911     'HTTP Request: %s %s "%i %s"', request.method, request.url, response.status_code, response.reason_phrase
    912 )
    914 try:

APIConnectionError: Connection error.

navba-MSFT 27,360 Reputation points Microsoft Employee

2024-01-17T09:02:26.1333333+00:00

@GUO Ranfei (RBCC/BDO1) Thanks for getting back. The same above sample works fine at my end. Could you please confirm if you have a proxy / firewall within your network ? Does it work fine if you bypass this proxy ?
Awaiting your reply.
navba-MSFT 27,360 Reputation points Microsoft Employee

2024-01-19T04:41:07.51+00:00

@GUO Ranfei (RBCC/BDO1) This is a quick follow-up to check if you had a chance to look at my above comment. Awaiting your reply.
GUO Ranfei (RBCC/BDO1) 20 Reputation points

2024-01-22T07:05:30.5566667+00:00

@navba-MSFT Thanks for replying. It is the issue of proxy. I did some settings and now it works.
Uma 0 Reputation points

2025-01-31T15:43:55.3133333+00:00

Here is the setting in python that worked

os.environ['NO_PROXY'] = 'azure openai endpoint'

2 answers

navba-MSFT 27,360 Reputation points Microsoft Employee

2024-01-22T07:14:56.49+00:00

@GUO Ranfei (RBCC/BDO1) I'm glad to see you were able to resolve your issue. Thanks for posting your solution so that others experiencing the same thing can easily reference this. Since the Microsoft Q&A community has a policy that the question author cannot accept their own answer, they can only accept answers by others, I'll repost your solution in case you'd like to Accept the answer. .
Issue:
You are getting the below proxy error while using the Azure OpenAI service. ProxyError: 407 Proxy Authentication Required

. Resolution: You found that the issue was related to the proxy and post changing its settings it is working fine now.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Uma 0 Reputation points

2025-01-31T15:58:33.31+00:00

Here is the setting in python that worked

os.environ['NO_PROXY'] = 'azure openai endpoint'
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Proxy Error when try to use open AI API

2 answers

Your answer