Sanjay Chatterji

AcKnowledge: Acquired Knowledge Representation by Small Language Model Without Pre-training

2024

Large language models (LLMs) are pre-trained on enormous amounts of text data and show acclaimed success in knowledge representation.However, there are two bottlenecks with this approach.(1) Pre-training data cannot be regularly updated once the models …