School of Artificial Intelligence, Anhui University of Science and Technology
Gubei Coal Mine, Huaizhe Coal Power Co., Ltd.

应用人工智能技术对矿井提升机司机等煤矿关键岗位人员的行为进行实时识别，防止发生设备误操作等危险情况，对保障煤矿安全生产具有重要意义。针对基于图像特征的人员行为识别方法存在的抗背景干扰能力差与实时性不足问题，提出了一种基于改进YOLOv7和ByteTrack的煤矿关键岗位人员不安全行为识别方法。首先，基于MobileOne和C3对YOLOv7目标检测模型骨干与头部网络进行轻量化改进，提高模型推理速度；其次，融合ByteTrack跟踪算法，实现工作人员跟踪锁定，提高抗背景干扰能力；然后，采用MobileNetV2优化OpenPose的网络结构，提高对骨架特征的提取效率；最后，通过时空图卷积网络（ST−GCN）分析人体骨架关键点在时间序列上的空间结构和动态变化，实现对不安全行为的分析识别。实验结果表明：MobileOneC3−YOLO模型的精确率达93.7%，推理速度较YOLOv7模型提高了52%；融合ByteTrack的人员锁定模型锁定成功率达97.1%；改进OpenPose模型内存需求减少了170.3 MiB，在CPU与GPU上的推理速度分别提升了74.7%和54.9%；不安全行为识别模型对疲劳睡岗、离岗、侧身交谈和玩手机4种不安全行为的识别精确率达93.5%，推理速度达18.6 帧/s。

The application of artificial intelligence technology can real-time recognize the behavior of key position personnel in coal mines, such as mine hoist drivers, to prevent dangerous situations such as equipment misoperation. It is of great significance for ensuring coal mine safety production. The personnel behavior recognition method based on image features has problems of poor resistance to background interference and insufficient real-time performance. In order to solve the above problems, a coal mine key position personnel unsafe behavior recognition method based on improved YOLOv7 and ByteTrack is proposed. Firstly, based on MobileOne and C3, lightweight improvements are made to the backbone and head network of the YOLOv7 object detection model to improve the inference speed of the model. Secondly, integrating ByteTrack tracking algorithm, to achieve the tracking and locking of personnel is achieved, and the capability to resist background interference is improved. Thirdly, MobileNetV2 is used to optimize the network structure of OpenPose and improve the efficiency of skeleton feature extraction. Finally, the spatial temporal graph convolutional networks (ST−GCN) is used to analyze the spatial structure and dynamic changes of the key points of the human skeleton in the time series, achieving the analysis and recognition of unsafe behaviors. The experimental results show that the precision of the MobileOneC3−YOLO model reaches 93.7%, and the inference speed is improved by 52% compared to the YOLOv7 model. The success rate of personnel locking model integrating ByteTrack reaches 97.1%. The improved OpenPose model reduces memory requirements by 170.3 MiB. The inference speed on CPU and GPU is improved by 74.7% and 54.9%, respectively; The recognition precision of the unsafe behavior recognition model for four types of unsafe behaviors, including fatigue sleeping on duty, leaving work, side talking, and playing with mobile phones, reaches 93.5%, and the inference speed reaches 18.6 frames per second.

国家自然科学基金资助项目（52374154）；安徽理工大学研究生创新基金资助项目（2022CX1008）。

韩康，李敬兆，陶荣颖. 基于改进YOLOv7和ByteTrack的煤矿关键岗位人员不安全行为识别[J]. 工矿自动化，2024，50（3）：82-91.

HAN Kang, LI Jingzhao, TAO Rongying. Recognition of unsafe behaviors of key position personnel in coal mines based on improved YOLOv7 and ByteTrack[J]. Journal of Mine Automation，2024，50（3）：82-91.