Gabriel Murray

Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation

2022

The multi-head self-attention mechanism of the transformer model has been thoroughly investigated recently. In one vein of study, researchers are interested in understanding why and how transformers work. In another vein, researchers propose new attention …