AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages..
Project description
AfroLID, a neural LID toolkit for 517 African languages and varieties. AfroLID exploits a multi-domain web dataset manually curated from across 14 language families utilizing five orthographic systems
GitHub link: https://github.com/UBC-NLP/afrolid
Online demo link: https://demos.dlnlp.ai/afrolid
Getting Started
The full documentation contains instructions for getting started, translation using diffrent methods, intergrate AfroLID with your code, and provides more examples.
License
afrolid(-py) is Apache-2.0 licensed. The license applies to the pre-trained models as well.
Citation
If you use AfroLID toolkit or the pre-trained models for your scientific publication, or if you find the resources in this repository useful, please cite our paper as follows:
useful, please cite our paper as follows:
@article{adebara2022afrolid, title={AfroLID: A Neural Language Identification Tool for African Languages}, author={Adebara, Ife and Elmadany, AbdelRahim and Abdul-Mageed, Muhammad and Inciarte, Alcides Alcoba}, booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP)", month = December, year = "2022", }
Acknowledgments
We gratefully acknowledge support from the Natural Sciences and Engineering Research Council of Canada (NSERC; RGPIN-2018-04267), the Social Sciences and Humanities Research Council of Canada (SSHRC; 435-2018-0576; 895-2020-1004; 895-2021-1008), The Digital Research Alliance of Canada (the Alliance) and UBC ARC-Sockeye and Advanced Micro Devices, Inc. (AMD). Any opinions, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NSERC, SSHRC, CFI, CC, AMD, or UBC ARC-Sockeye.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file afrolid-0.1.0.tar.gz
.
File metadata
- Download URL: afrolid-0.1.0.tar.gz
- Upload date:
- Size: 24.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 66011ca52ee8c2020868f9771612137eb1583cee3cd32f885ed5578a90fc8bf3 |
|
MD5 | 523f4ff9050d87d6d99a0299148401bd |
|
BLAKE2b-256 | 7859eda0466f29e773bb7e732de88d06556f7d6673c0c1ae4104c83f189e9e41 |