The Wayback Machine - https://web.archive.org/web/20200907100304/https://github.com/topics/beautifulsoup
Skip to content
#

beautifulsoup

Star

Here are 1,592 public repositories matching this topic...

Language: All
Filter by language
All 1,592 Python 1,184 Jupyter Notebook 272 HTML 67 JavaScript 26 CSS 4 Go 4 PHP 4 Java 2 TeX 2 Dart 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

psf / requests-html

Star
Open

Make pyppeteer use proxies

8
oldani
oldani commented Feb 18, 2019

If you're using proxies with requests-html and rendering JS sites is all good. Once you render a website pyppeteer don't know about this proxies and will expose your IP. This is an undesired behavior when scraping with proxies.

The idea is that whenever someone passes in proxies to the session object or any method call, make pyppeteer also use these proxies. #265

Read more
enhancement good first issue

Improve this page

Add a description, image, and links to the beautifulsoup topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the beautifulsoup topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.