sitescrapr

Simple website crawler and scraper

Usage no npm install needed!

<script type="module">
  import sitescrapr from 'https://cdn.skypack.dev/sitescrapr';
</script>

README

sitescrapr

Simple website crawler and content scraper.

Author

Steve Veerman

About

The purpose of sitescrapr is to provide a framework to scrape content from a particular website.

Most sitescrapr projects will follow this pattern:

  1. Get "search results/listings"
  2. Parse "search results/listings" and save "item links"
  3. Get all "items" from "item links"
  4. Parse all "items"
  5. Save all "items"

Usage

Please see sitescrapr-example for more documentation and working example.

$ npm install sitescrapr

History

0.0.1

  • Initial sitescrapr implementation.

License

(The MIT License)