Class WildcardTokenizer

Hierarchy

any
- WildcardTokenizer

Index

Properties

Methods

Properties

Protected _TABLE

_TABLE: IDICT<IWord>

Protected _TABLE2

_TABLE2: IDICT2<IWord>

name

name: string = "WildcardTokenizer"

Methods

_cache

_cache(): void

- Defined in lib/submod/WildcardTokenizer.ts:23
Returns void

createWildcardToken

createWildcardToken(word: IWord, lasttype?: number, attr?: IWordDebugInfo): any

- Defined in lib/submod/WildcardTokenizer.ts:42
Parameters
- word: IWord
- Optional lasttype: number
- Optional attr: IWordDebugInfo
Returns any

matchWord

matchWord(text: string, cur?: number): IWord[]

- Defined in lib/submod/WildcardTokenizer.ts:100
匹配单词，返回相关信息

Parameters
- text: string
  
  文本
- Optional cur: number
  
  开始位置
Returns IWord[]

返回格式 {w: '单词', c: 开始位置}

split

split(words: IWord[]): IWord[]

- Defined in lib/submod/WildcardTokenizer.ts:36
对未识别的单词进行分词

Parameters
- words: IWord[]
  
  单词数组
Returns IWord[]

splitWildcard

splitWildcard(text: string, cur?: number): IWord[]

- Defined in lib/submod/WildcardTokenizer.ts:49
Parameters
- text: string
- Optional cur: number
Returns IWord[]

Generated using TypeDoc