scraping

The overwrite feed option has a different default value depending on the storage backend used, and we currently cover its default value for all backeds except for Google Cloud Storage (GCS). We should address that.

Also, since `overw

If you're using proxies with requests-html and rendering JS sites is all good. Once you render a website pyppeteer don't know about this proxies and will expose your IP. This is an undesired behavior when scraping with proxies.

The idea is that whenever someone passes in proxies to the session object or any method call, make pyppeteer also use these proxies. #265

Unless I missed something, the documentation doesn't explain how to query document metadata (searching "site:montferret.dev metadata" through Google returned nothing, neither did grepping the source code).

As an example, I tried to query the og:url metadata.
I tried variations of //meta[property='og:url']::attr(content), with or without the leading //, and with or without the `attr(conte

It could be called Apify.utils.puppeteer.extractMicrodata and look something like this: https://kb.apify.com/tips-and-tricks/scraping-data-from-websites-using-schemaorg-microdata

but ideally, it wouldn't use jQuery.

Is your feature request related to a problem? Please describe.
A new contributor will feel overwhelmed when they will try to contribute to this project.

Describe the solution you'd like
Add a architecture.md as described in this blog post

Describe alternatives you've considered
Not having architecture.md.

**Add

My project have routing based on hosts. But web driver make request to http://127.0.0.1:9080.
How can i change host?