# PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

**Type:** Papers  
**Canonical URL:** https://scholariq.org/papers/pangu-large-scale-autoregressive-pretrained-chinese-language-models-with-auto/

## Facts

| Field | Value |
| --- | --- |
| Author Names | Wei Zeng,Xiaozhe Ren,Teng Su,Hui Wang,Yi Liao,Zhiwei Wang,Xin Jiang,ZhenZhang Yang,Kaisheng Wang,Xiaoda Zhang,Chen Li,Ziyan Gong,Yifan Yao,Xinjing Huang,Jun Wang,Jianfeng Yu,Qi Guo,Yue Yu,Yan Zhang,Jin Wang,Hengtao Tao,Dasen Yan,Zexuan Yi,Fang Peng,Fangqing Jiang,Han Zhang,Lingfeng Deng,Yehong Zhang,Zhe Lin,Chao Zhang,Shaojie Zhang,Mingyue Guo,Shanzhi Gu,Gaojun Fan,Yaowei Wang,Xuefeng Jin,Liu, Qun,Yonghong Tian |
| Citations | 94 |
| DOI | 10.48550/arxiv.2104.12369 |
| Fields | Computer Science |
| Open Access | true |
| OA Status | green |
| OA URL | https://arxiv.org/pdf/2104.12369 |
| OpenAlex ID | https://openalex.org/W3158631574 |
| Type | preprint |
| Year | 2021 |

## Paper authors

- [Jun Wang](https://scholariq.org/researchers/jun-wang-2/)

## Paper journal

- [arXiv (Cornell University)](https://scholariq.org/journals/arxiv-cornell-university/)

## Paper primary topic

- [Topic Modeling](https://scholariq.org/topics/topic-modeling/)

## Paper topics

- [Topic Modeling](https://scholariq.org/topics/topic-modeling/)
- [Natural Language Processing Techniques](https://scholariq.org/topics/natural-language-processing-techniques/)
- [Multimodal Machine Learning Applications](https://scholariq.org/topics/multimodal-machine-learning-applications/)

---
Source: ScholarIQ — public research metadata, principally OpenAlex. See https://scholariq.org/sources/ for provenance and https://scholariq.org/methodology/ for what these figures mean.