poor_crawler

simple program to fetch urls

Usage no npm install needed!

<script type="module">
  import poorCrawler from 'https://cdn.skypack.dev/poor_crawler';
</script>

README

poor_crawler - simple crawler

How to use :

var Crawler = require('./crawler.js');

var myCrawler = new Crawler();
myCrawler.extractFromUrl("http://myPage.com");

where "http://myPage.com" is the startup point. You can try it by typing :

node test.js

The result are not stored anywhere but in the console, and the program will brake when the array stocking the visited adress is full.