Referer should be configurable
Puppeteer's page.goto options are currently hardcoded:
await page[isHTMLContent ? 'setContent' : 'goto'](input, {
timeout: timeoutInSeconds,
waitUntil: 'networkidle2'
});But certain pages, such as news articles from ft.com, display different content depending on the user request' referer header.
I'd suggest exposing page.goto options as a configurable object.
sindresorhus / capture-website
Capture screenshots of websites
1.9k
How does funding with Polar work?
1
Pay now to fund the work behind this issue.
2
Get updates on progress being made.
3
Maintainer is rewarded once the issue is completed.
FAQ
Backer
You're funding impactful open source efforts
Contributor
You want to contribute to this effort
Maintainer
You want to get funding like this too