Radityo Eko Prasojo
3 papers in the PaperMetrix corpus
Papers by this author
-
Investigating Text Shortening Strategy in BERT: Truncation vs Summarization
2021
The parallelism of Transformer-based models comes at the cost of their input max-length. Some studies proposed methods to overcome this limitation, but none of them reported the effectiveness of summarization as an alternative. In this …
-
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
2022 · arXiv (Cornell University)
NLP research is impeded by a lack of resources and awareness of the challenges presented by underrepresented languages and dialects. Focusing on the languages spoken in Indonesia, the second most linguistically diverse and the fourth …
-
Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models
2022 · arXiv (Cornell University)
We perform knowledge distillation (KD) benchmark from task-specific BERT-base teacher models to various student models: BiLSTM, CNN, BERT-Tiny, BERT-Mini, and BERT-Small. Our experiment involves 12 datasets grouped in two tasks: text classification and sequence labeling …