Yudong Wang

Exploring Activation Patterns of Parameters in Language Models

2024 · arXiv (Cornell University)

Most work treats large language models as black boxes without in-depth understanding of their internal working mechanism. In order to explain the internal representations of LLMs, we propose a gradient-based metric to assess the activation …

From Mathematical Reasoning to Code: Generalization of Process Reward Models in Test-Time Scaling

2025 · arXiv (Cornell University)

Recent advancements in improving the reasoning capabilities of Large Language Models have underscored the efficacy of Process Reward Models (PRMs) in addressing intermediate errors through structured feedback mechanisms. This study analyzes PRMs from multiple perspectives, …