Jianing Wang

TransPrompt v2: Transferable Prompt-based Fine-tuning for Few-shot Text Classification

2022 · Research Square

Abstract Recent studies have shown that prompt-based fine-tuning improves the performance of large Pre-trained Language Models (PLMs) for few-shot text classification. Specifically, this type of method transforms the text classification task into the inherent Masked …

Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding

2022 · arXiv (Cornell University)

Knowledge-enhanced Pre-trained Language Model (PLM) has recently received significant attention, which aims to incorporate factual knowledge into PLMs. However, most existing methods modify the internal structures of fixed types of PLMs by stacking complicated modules, …

Rethinking the Role of Structural Information: How It Enhances Code Representation Learning?

2024

Code pre-trained models (CodePTMs) have recently exhibited remarkable accomplishments in the realm of software engineering. However, there are still limited advancements in understanding the inner mechanism of these models, as well as their sensitivity to …