How to Handle requests.exceptions.InvalidURL: Failed to parse in python?

Question

I'm a new user of python. I don't know why but requests always throws an InvalidURL exception:

>>> import requests
>>> r = requests.get('https://www.google.es/')

The output:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 380, in prepare_url
    scheme, auth, host, port, path, query, fragment = parse_url(url)
  File "/usr/lib/python3/dist-packages/urllib3/util/url.py", line 392, in parse_url
    return six.raise_from(LocationParseError(source_url), None)
  File "<string>", line 3, in raise_from
urllib3.exceptions.LocationParseError: Failed to parse: https://www.google.es/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.7/dist-packages/requests/api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/requests/sessions.py", line 516, in request
    prep = self.prepare_request(req)
  File "/usr/local/lib/python3.7/dist-packages/requests/sessions.py", line 459, in prepare_request
    hooks=merge_hooks(request.hooks, self.hooks),
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 314, in prepare
    self.prepare_url(url, params)
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 382, in prepare_url
    raise InvalidURL(*e.args)
requests.exceptions.InvalidURL: Failed to parse: https://www.google.es/

This error is independent of the url I give. How do I handle this?

The version of Python is 3.7.7 and 2.23.0 for requests.

Best regards.

@InfinityTM, I tried with 'GET' as first parameter but the exception was: requests.exceptions.InvalidURL: Failed to parse: GET — Dikus Extrange
– Dikus Extrange, Commented Apr 7, 2020 at 9:10
Works for me. Please post a proper minimal reproducible example. NB: you may want to make sure that at this point of your code requests is really what you expect (just add a print(requests) before the call and check your have). — bruno desthuilliers
– bruno desthuilliers, Commented Apr 7, 2020 at 9:12

Joshua Varghese · Accepted Answer · 2020-04-07 09:47:07Z

11

You faced Error due to the New version of urllib3 (some users tends to face this issue).

The error is not due to requests but issue is rather in urllib3 (new ver) that gets installed when installing requests 2.21.0+.
To avoid this either try updating urllib3:

python -m pip install --upgrade urllib3

or install the requests v2.21.0:

pip uninstall requests # to remove current version
pip install requests==2.21.0

Just downgrade it to v2.21.0 version

answered Apr 7, 2020 at 9:47

Joshua Varghese

5,2121 gold badge18 silver badges38 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Tomer Cohen · Accepted Answer · 2021-02-09 15:05:22Z

1

See if you have a hidden character in your URL.

I've wasted tons of time and that was the problem.. this can happen when you copy-paste the URL from somewhere.

answered Feb 9, 2021 at 15:05

Tomer Cohen

3521 silver badge6 bronze badges

2 Comments

Dikus Extrange Over a year ago

Thank you @tomer-cohen but it was a problem with the version of urllib3 for me as it was noticed in the previous comment.

Tomer Cohen Over a year ago

sure, just added this because this was my problem, and I didn't find any solution

Adi Epshtain · Accepted Answer · 2021-04-21 06:45:09Z

0

it's happen sometimes when the URL is not the valid one. I have this error and after hours found that I have a small spaces between each / on the URL... so I suggest to write the URL again on requests.get for no get this mistake..

answered Apr 21, 2021 at 6:45

Adi Epshtain

8451 gold badge9 silver badges25 bronze badges

Collectives™ on Stack Overflow

How to Handle requests.exceptions.InvalidURL: Failed to parse in python?

3 Answers 3

Comments

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related