Toshihiko Yanase

Neural Attention Model for Classification of Sentences that Support Promoting/Suppressing Relationship

2016

Evidences that support a claim “a subject phrase promotes or suppresses a value” help in making a rational decision. We aim to construct a model that can classify if a particular evidence supports a claim …

PLaMo-100B: A Ground-Up Language Model Designed for Japanese Proficiency

2024 · arXiv (Cornell University)

We introduce PLaMo-100B, a large-scale language model designed for Japanese proficiency. The model was trained from scratch using 2 trillion tokens, with architecture such as QK Normalization and Z-Loss to ensure training stability during the …