# Critical tokenization and its properties

**Type:** Papers  
**Canonical URL:** https://scholariq.org/papers/critical-tokenization-and-its-properties/

## Facts

| Field | Value |
| --- | --- |
| Author Names | Jin Guo |
| Citations | 56 |
| Fields | Arts and Humanities,Computer Science |
| Open Access | false |
| OA Status | closed |
| OpenAlex ID | https://openalex.org/W1847536016 |
| Type | article |
| Year | 1997 |

## Paper authors

- [Jin Guo](https://scholariq.org/researchers/jin-guo/)

## Paper primary topic

- [Natural Language Processing Techniques](https://scholariq.org/topics/natural-language-processing-techniques/)

## Paper topics

- [Natural Language Processing Techniques](https://scholariq.org/topics/natural-language-processing-techniques/)
- [semigroups and automata theory](https://scholariq.org/topics/semigroups-and-automata-theory/)
- [Syntax, Semantics, Linguistic Variation](https://scholariq.org/topics/syntax-semantics-linguistic-variation/)

---
Source: ScholarIQ — public research metadata, principally OpenAlex. See https://scholariq.org/sources/ for provenance and https://scholariq.org/methodology/ for what these figures mean.
