Proxy connection with Python

Question

I have been attempting to connect to URLs from python. I have tried: urllib2, urlib3, and requests. It is the same issue that i run up against in all cases. Once I get the answer I imagine all three of them would work fine.

The issue is connecting via proxy. I have entered our proxy information but am not getting any joy. I am getting 407 codes and error messages like: HTTP Error 407: Proxy Authentication Required ( Forefront TMG requires authorization to fulfill the request. Access to the Web Proxy filter is denied. )

However, I can connect using another of other applications that go through the proxy, git for example. When I run git config --get htpp.proxy it returns the same values and format that I am entering in Python namely

http://username:password@proxy:8080

An example of code in requests is

import requests
proxy = {"http": "http://username:password@proxy:8080"}
url = 'http://example.org'
r = requests.get(url,  proxies=proxy)
print r.status_code

Thanks for your time

avmohan · Accepted Answer · 2013-08-19 13:19:06Z

3

In the requests module, proxy authentication is performed as shown:

import requests
proxies = {'http':'http://x.x.x.x', 'https':'https://x.x.x.x'}
auth = requests.auth.HTTPProxyAuth('username', 'password')
r = requests.get('http://www.example.com', proxies = proxies, auth = auth)
print r.status_code, r.reason

answered Aug 19, 2013 at 13:19

avmohan

2,0403 gold badges25 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

bevanj · Accepted Answer · 2013-07-15 00:13:13Z

1

I have solved my issue by installing CNTLM. Once this is setup and configured I set the HTTP_PROXY etc.

answered Jul 15, 2013 at 0:13

bevanj

2541 gold badge3 silver badges12 bronze badges

Comments

Vikram · Accepted Answer · 2013-05-23 01:09:44Z

0

You can use the HTTP_PROXY in python in order to connect to your proxy server. You can find more detailed information on this link provided.

http://www.wkoorts.com/wkblog/2008/10/27/python-proxy-client-connections-requiring-authentication-using-urllib2-proxyhandler/

The above link is showed the example using urllib2. Actually I have used this some time back to connect to two servers simultaneously. Hope this will help you

answered May 23, 2013 at 1:09

Vikram

7,58318 gold badges87 silver badges131 bronze badges

1 Comment

bevanj Over a year ago

Thank you for the quick reply. Unfortunately the code at the link does not work for me. It gives an error of 'urllib2.HTTPError: HTTP Error 407: Proxy Authentication Required ( Forefront TMG requires authorization to fulfill the request. Access to the Web Proxy filter is denied. )'.

Ali Zain · Accepted Answer · 2020-10-11 20:53:08Z

0

import requests
proxies = {'https':'https://username:[email protected]:8080'}
r = requests.get('http://www.example.com', proxies = proxies)
print r.status_code, r.reason

A working Solution! Tested on my server

answered Oct 11, 2020 at 20:53

Ali Zain

6308 silver badges24 bronze badges

Collectives™ on Stack Overflow

Proxy connection with Python

4 Answers 4

Comments

Comments

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related