Hiroki Sakaji

Mixture of Experts Approach for Domain Adaptation in Finance

2026 · Journal of Advanced Computational Intelligence and Intelligent Informatics

Pre-trained language models (PLMs) have demonstrated high performance across various tasks and domains. Among these PLMs, Mixture of Experts (MoE) models also exhibit high performance with fewer active parameters. In domain adaptation, generally, continual pre-training …