I've implemented a scraper that uses HTTPS protocol. To avoid captchas and HTTP 429 error I'm using proxies. That doesn't however guarantee no captchas, so sometimes I need to unblock a proxy entering the captcha manually. I'm using Windows, so I'm changing LAN settings from the Internet Properties > Connection tab, opening the site in the browser, and entering the captcha. This procedure is a little time consuming as I need to open menus, click mouse many times, copy/paste IP:port, etc. I wish to develop a script that does part of this job automatically: it should set the proxy IP/port, leaving me just the trouble of entering captcha.
As I have found already, this setting is located in the registry: HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Internet Settings\ProxyServer, and changing a registry value is not a problem. This change however doesn't take effect immediately, and I still have to open the dialog to apply the changes.
My first question is how to apply the changes automatically (something that I can do from the Python/C++/bash, etc.) The wider question is whether there is a more reliable method to solve the problem: not to touch registry explicitly but to use a tool that makes changes/applies the settings, etc?