SmartHSE: Comprehensive AI-Based Safety Monitoring Solution for Work-Sites

Abstract Monitoring HSE violations while focusing on Operations is one of the main targets of every industry. Unfortunately, Humans can be prone to put the focus mainly on operations rather than safety. Therefore, assisting them with an HSE co-pilot in the form of an AI solution alarming them when they tend to compromise on safety, is of huge value. While many attempts have been made in the literature in terms of Personnel Protective Equipment (PPE), there is no available solution that uses modern deep-learning based video analytics to comprehensively detect multiple type of HSE use-cases. In this paper, we describe our SmartHSE AI solution which leverages Computer-Vision and CCTV cameras to monitor different kind of HSE violations comprehensively and continuously, in real-world scenarios. Here we focus on a use-case of vessels. Our solution, called SmartVessel, can (i) watch people - detect their location and estimate their postures; (ii) detect incidents - person falling on the ground, or more dramatically a man-overboard; (iii) detect hazardous situations - person in a restricted area; and (iv) detect PPEs - person wearing helmet, uniform and lifejacket or not. All these events are automatically and simultaneously detected by our AI. The whole system workflow along is extensively described throughout the article. Also, extensive experiments were conducted, and both quantitative and qualitative results are presented.