Gaojian Xiong

LLMGuard : Safeguarding Real-Time Inference for Large Language Models on Edge Devices

2026 · ACM Transactions on Software Engineering and Methodology

TEE-shielded secure inference offers an efficient solution to protect valuable edge-deployed models from potential thefts. Nevertheless, existing methods are lack of theoretical security analysis, failing to achieve the optimal security. Furthermore, while feasible for small …