Risk Detection through Firearm Recognition Using Deep Learning-Based Object-Human Heterogeneous Graph Extraction

Effective border security is crucial in managing and mitigating firearm-related threats. While prior research has focused on firearm detection, it lacks contextual analysis. This paper advances firearm-related incident assessment by integrating pose estimation to improve gun violence detection. Our novel approach extracts body and firearm pose graphs and employs Graph Attention Networks(GAT) for graph analysis to accurately identify gun violence incidents. By recognizing associated actions, our system provides greater situational awareness beyond mere firearm detection. Utilizing Graph-LSTM, we capture spatial and temporal information. As a result, our proposed algorithm is lighter and more accurate than the CNN-LSTM model used as a baseline, achieving test F1-scores of 82.04 % on our collected data.