The scalable web crawling and scraping library for JavaScript. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. - ...

docs/architecture.md describes the design in full: the decisions behind it, the invariants, every package and platform module, the data model, the cost model, tenancy, the Nexus forecast and the ...