Sergey A. Saltykov

Knowledge Trees: Gradient Boosting Decision Trees on Knowledge Neurons as Probing Classifier

2023 · arXiv (Cornell University)

To understand how well a large language model captures certain semantic or syntactic features, researchers typically apply probing classifiers. However, the accuracy of these classifiers is critical for the correct interpretation of the results. If …