Jiajun Liu

Fast Second-Order Online Kernel Learning Through Incremental Matrix Sketching and Decomposition

2024

Second-order Online Kernel Learning (OKL) has attracted considerable research interest due to its promising predictive performance in streaming environments. However, existing second-order OKL approaches suffer from at least quadratic time complexity with respect to the …

On learning denoisable student logits

2026 · Pattern Recognition

Knowledge Distillation (KD) aims to train a student model to mimic the behavior of a more powerful teacher model. In this paper, we reveal that through the lens of diffusion processes, student logits can be …