分类: 预训练语言模型 | LonePatient'Blog

分类 - 预训练语言模型

2021

高质量中文预训练模型集合

2021-01-20

高质量中文预训练模型集合

2020

StructBERT-Incorporating Languages structures into pre-training for deep language understading

2020-10-20

StructBERT-Incorporating Languages structures into pre-training for deep language understading

MobileBERT-a Compact Task-Agnostic BERT for Resource-Limited Devices

2020-07-24

MobileBERT-a Compact Task-Agnostic BERT for Resource-Limited Devices

NEZHA-Neural Contextualized Representation for Chinese Language Understanding

2020-01-20

NEZHA-Neural Contextualized Representation for Chinese Language Understanding

2019

ALBERT-A Lite BERT For Self-Supervised Learning Of Language Representations

2019-10-20

ALBERT-A Lite BERT For Self-Supervised Learning Of Language Representations

RoBERTa-A Robustly Optimized BERT Pretraining Approach

2019-08-27

RoBERTa-A Robustly Optimized BERT Pretraining Approach

MASS-Masked Sequence to Sequence Pre-training for Language Generation

2019-08-11

MASS-Masked Sequence to Sequence Pre-training for Language Generation

2018

BERT-Pre-training of Deep Bidirectional Transformers for Language Understanding

2018-12-20

BERT-Pre-training of Deep Bidirectional Transformers for Language Understanding