tomcat-bit/4chan-crawler provides and easy to use crawler for the live site, which I wanted to rework for crawling the archive and collecting text as well as media. Archive.4plebs.org DDos protection blocks requests from
python-requests, but not from Node's
https, so I built a JS version.
npm i 4chan-crawler
Update Desired boards and output directory in