node-minhash

Command Line tool that compares two text files using minhash

Usage no npm install needed!

<script type="module">
  import nodeMinhash from 'https://cdn.skypack.dev/node-minhash';
</script>

README

node-minhash

A simple command line tool for comparing text files using the minhash algorithm and contrasting with the jaccard index.

Build Status

References

Installation

If you have just clone this like then run the following

npm install
npm link

Or if you would like to install globally

npm install https://github.com/sjhorn/node-minhash -g

Command line tool usage

Using node

minhash file1.txt file2.txt

minhash https://file.com/page1.html https://file.com/page2.html

Using lib

var minhash = require('node-minhash');

minhash.summary(string1, string2);

Methods

.summary(file1, file2)

Compare two text strings using both minhash and jaccard index and print a summary

.compare(file1, file2)

Compare two text strings using both minhash and jaccard index

.shingles(string, words_per_single=2)

Convert string to set of shingles using the default of 2 words per shingle and tokenise using the natural libraries default tokeniser.

.jaccardIndex(string1, string2)

Compare two strings by tokenising and then compare the intersection of shingles to the union of shingles.

.shingleHashList(set)

Convert a set of shingles to a set of crc-32 hashes.