Class SingleTokenizer

单字切分模块此模組不包含模組列表內需要手動指定

author: 老雷leizongmin@gmail.com

Hierarchy

any
- SingleTokenizer

Index

Methods

Methods

split

split(words: IWord[]): IWord[]

- Defined in lib/submod/SingleTokenizer.ts:22
对未识别的单词进行分词

Parameters
- words: IWord[]
  
  单词数组
Returns IWord[]

splitSingle

splitSingle(text: any, cur?: number): IWord[]

- Defined in lib/submod/SingleTokenizer.ts:49
单字切分

Parameters
- text: any
  
  要切分的文本
- Optional cur: number
  
  开始位置
Returns IWord[]

Generated using TypeDoc