Mahsa Yarmohammadi

MegaWika: Millions of reports and their sources across 50 diverse languages

2023 · arXiv (Cornell University)

To foster the development of new models for collaborative AI-assisted report generation, we introduce MegaWika, consisting of 13 million Wikipedia articles in 50 diverse languages, along with their 71 million referenced source materials. We process …

The Effect of Alignment Correction on Cross-Lingual Annotation Projection

2023

Cross-lingual annotation projection is a practical method for improving performance on low resource structured prediction tasks. An important step in annotation projection is obtaining alignments between the source and target texts, which enables the mapping …