@adncorp/apify

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Usage no npm install needed!

<script type="module">
  import adncorpApify from 'https://cdn.skypack.dev/@adncorp/apify';
</script>

README

APIFY SDK

cloned from apify github repository

RoadMap

  • add database(Mongo) adapter for datasets, metadata, keyValueStore and requestQueue
  • add multitenancy support with MongoDb adapter
  • add multitenancy support for datasets local storage
  • add database interface adapter to add more type of database
  • implement an Agent interface Adapter
  • add puppeteer extra to benefit from extra plugins
  • implement log interface interface