Shotaro Sano

Interactive Hyperparameter Optimization with Paintable Timelines

2021

We propose a method to integrate more interactivity into automatic hyperparameter optimization systems to leverage the user’s prior knowledge on parameter distribution. In our method, the user continuously observes automatic optimization’s progress and dynamically specifies …

PLaMo-100B: A Ground-Up Language Model Designed for Japanese Proficiency

2024 · arXiv (Cornell University)

We introduce PLaMo-100B, a large-scale language model designed for Japanese proficiency. The model was trained from scratch using 2 trillion tokens, with architecture such as QK Normalization and Z-Loss to ensure training stability during the …