nodecrawlercnwallstreet

A node crawler using cheerio & nightmare to scrape the news & the article of news from wallstreetcn, and save the data to json file.

Usage no npm install needed!

<script type="module">
  import nodecrawlercnwallstreet from 'https://cdn.skypack.dev/nodecrawlercnwallstreet';
</script>

README

node-crawler-cn-Wallstreet

A node crawler using cheerio & nightmare to scrape the news & the article of news from wallstreetcn, and save the data to json file.

wallstreetcn

Installation

npm install node-crawler-cn-wallstreet

Usage

node index.js

Specify:
newstype: [global,shares,bonds,commodities,forex,enterprise,economy,charts,china,us,europe,japan]
numOfRecord: 5

node index.js forex 10

Dev mode to show the log .

DEBUG=nightmare node index.js forex 10

Then it will save json file to /output.