CreoleVal: Multilingual Multitask Benchmarks for Creoles
arxiv(2023)
摘要
Creoles represent an under-explored and marginalized group of languages, with
few available resources for NLP research.While the genealogical ties between
Creoles and a number of highly-resourced languages imply a significant
potential for transfer learning, this potential is hampered due to this lack of
annotated data. In this work we present CreoleVal, a collection of benchmark
datasets spanning 8 different NLP tasks, covering up to 28 Creole languages; it
is an aggregate of novel development datasets for reading comprehension,
relation classification, and machine translation for Creoles, in addition to a
practical gateway to a handful of preexisting benchmarks. For each benchmark,
we conduct baseline experiments in a zero-shot setting in order to further
ascertain the capabilities and limitations of transfer learning for Creoles.
Ultimately, we see CreoleVal as an opportunity to empower research on Creoles
in NLP and computational linguistics, and in general, a step towards more
equitable language technology around the globe.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要