Refine by Language

Refine by Category

Tokenizers Projects


yzhang / rseg

A Chinese Word Segmentation(中文分词) routine in pure Ruby

Ruby     102   %d years ago


arbox / tokenizer

A simple tokenizer in Ruby for NLP tasks.

Ruby     35   5 months ago


veer66 / thailang4r

Thai language utility for Ruby

Ruby     21   %d years ago


markburns / mecab

MeCab ruby binding with gemspec

Ruby     19   %d years ago


parhamr / nlp-pure

Natural language processing algorithms implemented in pure Ruby with minimal dependencies

Ruby     17   4 months ago


6 / tiny_segmenter

Ruby port of TinySegmenter.js for tokenizing Japanese text

Ruby     10   %d years ago


mimosa / jieba-jruby

jieba-analysis(结巴分词) for jRuby

Ruby     4   %d years ago