psf / requests-html Public
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make pyppeteer use proxies #266
Comments
This would be a good item to get fixed, currently when rendering I have to stop using proxy servers. |
I will take on this |
cool thanks, I was going to take a look later but I'm not up on the whole async thing yet :) |
I am in a very restrictive Coorporate Network and expiriencing many issues with Python and Proxies since the beginning of using requests-html. 1st (solved manually)
2nd (solved manually) Now I am starting chromium with Start chrome.exe with the --proxy-pac-url="http://XXX/XXX.pac argument, enter your credentials and install the Proxy Auto Auth addon. Restart chrome.exe with the arguemts and check if you can use it without any proxy auth. 3rd (not solved yet)
I would be very happy if this can be solved ... |
+1 On this being an amazing thing to get resolved. |
Are there any news about this issue? Scraping behind corporate proxies is impossible right now... Any planned progress on this? Thank you |
Is there any news on this ? According to me, the best solution would be to be able to use proxies in the same way as requests do (from env or dict). |
How is this going? I would like to know how I can use socks5 proxies with requests-html... and the .render() function. |
bump? any updates? |
bump |
If you're using proxies with
requests-html
and renderingJS
sites is all good. Once you render a website pyppeteer don't know about this proxies and will expose your IP. This is an undesired behavior when scraping with proxies.The idea is that whenever someone passes in proxies to the
session
object or anymethod call
, make pyppeteer also use these proxies. #265The text was updated successfully, but these errors were encountered: