RU2796646C1 - Integrated safety in water bodies - Google Patents

Abstract

FIELD: safety equipment.

SUBSTANCE: systems for ensuring integrated safety at water bodies. The system for ensuring integrated safety at water bodies includes functional blocks consisting of software and hardware components configured to receive-transmit and/or analyze information about events at a water body and issue appropriate scenarios to prevent hazardous situations, and includes an automated rescuer workstation with access to the user interface of the analytical unit; a meteorological monitoring unit, a video monitoring unit, which is a panoramic camera for monitoring the beach and swimming areas, and PTZ cameras for monitoring the swimming and water areas; a hydromonitoring unit, which is a device in the form of a buoy equipped with a horizontal sonar and a water temperature measurement sensor, a current notification unit, an analytical unit, implemented on the basis of server hardware and software using artificial intelligence techniques and designed for the operation of a video analytics system, a hydroanalytics system, external device management systems, notification management systems.

EFFECT: providing integrated monitoring of swimmers not only on the water surface, but also under water.

1 cl, 3 dwg

Description

Technical field

The invention relates to the field of safety at water bodies, and in particular to systems for ensuring integrated safety at water bodies.

State of the art

Around 320,000 people die from drowning every year worldwide. It is the third leading cause of death, accounting for about 7% of injury-related deaths. The proximity of settlements to water bodies and increased access of people to water is a significant risk factor for death from drowning for a significant part of the population. To prevent drowning, such organizational measures as the establishment of special signs and fences around swimming areas, teaching children to swim, conducting life-saving trainings, informing about the depth of the reservoir and ice thickness, timely warning of a storm or flood (voice and SMS) are mainly used. alert). However, these measures are not enough to improve safety at water bodies. Safety monitoring at water bodies is completely entrusted to rescuers (only the “human factor”), while rescue posts and stations are not equipped with special technical monitoring systems that make it possible to record violations of the rules for the operation of water bodies and, as a result, timely prevent a threat to human life.

It should be recognized that the general trend towards equipping public areas with monitoring tools is justified. Thus, the use of video surveillance systems in parks and squares can reduce the number of offenses committed and increase their detection, and the development of photo and video recording systems aimed at preventing traffic violations has reduced the number of deaths in road accidents in Russia by 26% over five years. Statistics show that the number of deaths on water bodies in specific comparison is an order of magnitude higher than on roads. This gives reason to believe that with the widespread introduction and equipment of water areas with special technical means of monitoring and the development of a culture of responsible attitude to the rules for the operation of water bodies among the population, there is a significant potential to reduce the number of drownings.

It is widely known from the prior art to provide swimmers with sensors that transmit predetermined threshold values to an operator console or an alarm triggering system. For example, a safety system for swimming pools and similar water bodies is known from the prior art (see [1] US5195060A, IPC G08B 21/08, publ. 03/16/1993), including a transmitter for generating an electrical signal with a frequency continuously changing between the upper and lower limits, at least one pair of transducers located in the reservoir, including a transmitting transducer connected to receive a swept signal to launch an acoustic wave beam in response to a swept frequency signal in the reservoir and a receiving transducer located opposite the transmitting transducer to receive acoustic waves and for converting the received acoustic waves into a received electrical signal, and a receiver connected to the receiving transducer for generating a detected signal in response to the received signal, for generating a threshold signal in response to the detected signal, and for triggering an alarm when the detected signal falls below the threshold. for at least a predetermined length of time.

Also known from the prior art is a system for monitoring and warning about the safety of the water area (see [2] CN108806193A, IPC G08B 21/08, publ. 11/13/2018), including a wearable entry device, an underwater hydroacoustic antenna subsystem and a lifeguard receiving subsystem. In this analogue, in addition to the sensor on the swimmer, sonar is introduced into the system, which helps to display the swimmer's place in order to allow rescuers to arrive on time and ensure the safety of the swimmer in an unsafe situation for health. At the same time, this analog is suitable for use in pools and open water areas.

There are quite a lot of similar analogues, which include supplying a swimmer or a visitor of the water area with sensors (tags) for transmitting the specified parameters to the operator and / or issuing sound signals about danger (see also, for example, [3] EP2176845A2, IPC G08B 21/08, publ. 21.04 .2010; [4] EP1915747A1, IPC G08B 21/08, published 04/30/2008; [5] US2004095248A1, IPC G08B 21/08, published 05/20/2004). The common disadvantages of the above analogs are the difficulty in supplying wearable sensors (tags) to all users of water bodies, firstly, due to the fact that it is necessary to have the right number of such sensors, which cannot be predicted, for example, on public beaches, and secondly, the high cost such a system, due to the need to purchase and maintain such sensors, thirdly, not all water bodies can implement such systems. At the same time, the need to equip all users of the water body with special devices provides for the organization of protection of the perimeter of the water body and the availability of a sufficient number of special devices, control over their accounting and operating conditions, which imposes significant economic and organizational restrictions on the use of technology.

The prior art safety systems for artificial water objects, such as swimming pools, water parks, etc., include nets, including inflatable ones, installed at the bottom of a water body and bracelets for swimmers, equipped with cardiac arrest sensors, pulse rate measurements, an alarm button, etc. which transmit an alarm signal to the control unit, which initiates the raising of the net from the bottom of the water area to the surface, thereby saving the swimmer from drowning (see, for example, [6] US2014165281A1, IPC E04H 4/06, pub. 06/19/2014; [7] EP1570447A1 , IPC E04H 4/06, G08B 21/08, published 09/07/2005). The disadvantages of these systems are also the presence of bracelets, as well as the impossibility of using such systems on open water bodies (such as rivers, lakes, seas, oceans, etc.), which significantly limits their widespread use.

From the prior art there is a method for monitoring the water safety of one or more persons in a reservoir (see [8] WO2012145800A1, IPC G08B 21/08, publ. 01.11.2012). The method includes constant monitoring of each person in the water by repeatedly detecting thermal infrared radiation emitted by a part of the person above the water surface within the detection zone. The thermal signature of a person allows this technology to identify each person in the detection zone and his position in the detection zone and register a danger signal when a person is submerged under water for a specified period of time and issue an alarm that turns on in response to a relayed danger signal. The disadvantage of such solutions is the loss of control over the swimmer when he dives under water and the likelihood of human recognition errors in warm water, due to the permissible measurement errors by thermal infrared radiation devices.

A device and a method for controlling the induction of a sound wave and positioning are known from the prior art (see [9] CN 102230966 A, G01S 15/06; G08B 21/08, publ. 02.11.2011), including the placement of sonars that capture the characteristic change of signals in the water , interpreted as warnings about the potential danger of drowning and the transfer of this information to the security system to take the necessary measures to prevent a dangerous situation. The disadvantage of using sonar systems as separate devices is the lack of event visualization capabilities, which can lead to a significant number of false events.

To ensure safety at water bodies, it is not enough only solutions existing on the market and it is necessary to develop special algorithms and computer vision technologies. But there is another good reason for such developments - this is the trend of digitalization of the beach tourism industry. The development of the tourism industry and competition are constantly increasing the requirements for the comfort and safety of vacationers in Russia and the world. The concept of "smart beach" is gaining more and more popularity, which has already begun to be implemented in Phuket, Dubai and Haifa. This includes providing visitors with wi-fi, left-luggage offices, automatic garbage collection, a developed information and security system. Modern world trends have also begun to be supported in some Russian cities, for example, in Moscow, Sochi and Irkutsk. Municipal authorities have begun installing "smart cameras", metal detectors and other means on the beaches to ensure the safety of people on the beach. "Smart Beach" is a zone of unprecedented comfort and comprehensive security. Tracking people, combined with data on weather conditions received from a weather station or from open sources, opens up access to measuring the duration of a person's stay in the water and in the sun. In addition to data on water temperature, air temperature, atmospheric air pressure and solar activity, the system can provide both general and individual recommendations (for example, in the form of voice alerts) for beach visitors to avoid the risk of hypothermia, overheating or exacerbation of heart disease. A high level of attention to beach visitors is a whole complex of organizational and technical measures, in which there are no trifles. A young child or adult left unattended near the water, whose gait betrays a painful condition, should be detected by a computer vision system that will notify the rescuer or play a voice alert according to a certain scenario. It is concern for the safety and comfort of people that drives development today, regardless of where we are: on land, air or sea. Therefore, the creation and implementation of automated systems for ensuring integrated security is an urgent task.

The closest analogue, taken as a prototype, is the water area control system (see [10] US9443207B2, G08B 21/08; G05D 1/00; G06Q 10/00; G08B 21/02, publ. 09/13/2016), including a control system , configured to receive information about events in the water area from a group of autonomous vehicles, analyze information to identify events in which a person needs help, and coordinate a group of autonomous vehicles to take the necessary measures to ensure human safety.

The disadvantages of the prototype are the lack of sonar monitoring in the system, which does not allow for comprehensive monitoring of swimmers when they dive under water, as well as the lack of voice and visual informing people on the beach, swimmers and ship owners about detected violations of the rules for operating a water body, which does not provides effective preventive water rescue measures.

The essence of the invention

The technical challenge facing the invention is to create a system for ensuring integrated security at water bodies using predictive incident detection algorithms and appropriate preventive warning measures, which will significantly reduce the number of incidents at water bodies at an early stage.

The technical result of the claimed invention is to increase the integrated safety of people at water bodies, while increasing the accuracy of detecting incidents at water bodies due to the integrated monitoring of swimmers not only on the water surface, but also under water, and reducing the number of incidents through the use of preventive warning and information measures. in voice and visual-text format about the modes and rules of operation of a water body, and the speed of the response of rescuers is increased due to their notification of incidents to any, incl. wearable and compatible web devices.

The technical problem is solved, and the technical result is achieved through the use of an integrated security system for water bodies, including functional blocks consisting of software and hardware components, made with the possibility of receiving, transmitting and / or analyzing information about events in a water body and issuing appropriate scenarios to prevent dangerous situations, characterized in that the water body consists of three monitoring zones: the beach zone, the bathing zone, the water area, while the software and hardware components include:

a) the rescuer workstation, which is a personal computer and/or a wearable electronic device with a web-compatible interface, to provide access to the user interface of the analytical unit,

b) meteorological monitoring unit, which is a meteorological station for measuring air temperature, wind force, insolation level, atmospheric pressure values,

c) video monitoring unit, which is panoramic cameras for monitoring the beach and swimming areas, and PTZ cameras for monitoring swimming areas and water area,

d) a hydromonitoring unit, which is a device in the form of a buoy equipped with a horizontal scanning sonar and a water temperature measurement sensor, which additionally acts as a signal buoy that limits the bathing area,

e) notification block, which is electronic information boards for displaying information about the modes of operation of a water body and / or loudspeakers for voice notification and informing people on the beach, swimmers in the water and persons operating ships in the water area,

f) an analytical unit implemented on the basis of server hardware and software using artificial intelligence technologies and designed to function:

• video analytics systems,

• hydroanalytical systems,

• control systems for external devices,

• notification management systems,

being an integral part of the software of the analytical unit.

The technical result is also achieved due to the fact that the video analytics system, which is part of the analytical unit software, contains an object detection module; face identification module; border crossing module; exclusion zone module; object collision fixation module; object tracking module.

Brief description of the drawings

On FIG. 1 - Scheme of the water body.

On FIG. 2 - Block diagram of the mechanical part of the hydromonitoring unit.

On FIG. 3 - Block diagram of the video analytics system.

The following positions are indicated on the figures: 1 - workstation (AWS) of the rescuer; 2 - meteorological monitoring unit; 3 - video monitoring block; 4 - hydromonitoring unit; 5 - notification block; 6 - analytical unit, including the server; 7 - beach area; 8 - bathing area; 9 - water area zone.

Implementation of the invention

To ensure the safety of people at water bodies, an integrated monitoring and notification system is used. The system for ensuring integrated safety at water bodies is designed to detect potentially dangerous situations on the surface and underwater part of a water body and issue appropriate alert scenarios for swimmers, ship owners and rescuers for timely response by preventing incidents using a set of notifications or direct actions of rescuers.

The water body (Fig. 1) consists of three monitoring zones:

1) Beach area (7) - a sloping section of the coast 25-50 meters wide;

2) Bathing area (8) - equipped water area from the beach area to the water area (signal buoys) with a width of 25-50 meters;

3) Water area (9) - a water area located outside the signal buoys (bathing area), which is limited by the perimeter of the reservoir.

The bathing area (8) is separated from the water area (9) by signal buoys.

The system for ensuring integrated safety at water bodies includes functional blocks consisting of software and hardware components configured to receive, transmit and/or analyze information about events at a water body and issue appropriate scenarios to prevent dangerous situations.

Hardware and software components of the system include:

a) Automated workstation (AWS) of the rescuer (1), which is a personal computer and/or wearable electronic device with a web-compatible interface, to provide access to the user interface of the analytical unit. A personal computer can be a personal computer placed in the rescuer's premises (a point of observation and response to the detection of events and incidents), and a wearable tablet computer or smartphone can act as an electronic device when the rescuer is outside the rescuer's premises (stationary workplace).

b) Meteorological monitoring unit (2), which is a meteorological station for measuring air temperature, wind force, insolation level, atmospheric pressure values.

c) Video monitoring unit (3), which consists of panoramic cameras for monitoring the beach (7) and swimming (8) areas, and PTZ cameras for monitoring the swimming (8) and water area (9) areas.

d) Hydromonitoring unit (4), which is a device in the form of a buoy equipped with a horizontal scan sonar and a water temperature measurement sensor, additionally acting as a signal buoy that limits the swimming area, and is capable of transmitting sonar data about swimmers and watercraft within a radius of up to 200 meters of water area.

e) Notification block (5), which is electronic information boards placed in the beach area to display information about the operating modes of the water body and / or loudspeakers to provide voice notification and inform people on the beach, swimmers in the water and persons operating ships in water areas.

f) Analytical unit (6), implemented on the basis of server hardware and software using artificial intelligence technologies and designed for the operation of video analytics, hydroanalytics, external device and notification control systems. Video analytics, hydroanalytics, device management and notification systems are an integral part of the analytical unit software. The analytical unit can be installed in the rescuer's workstation or can be placed remotely (cloud option). For stable operation, it is necessary to ensure sufficient channel bandwidth - at least 4 Mbps for each device in the network.

Video monitoring and notification blocks are a system of IP-compatible devices that are placed, for example, on metal supports or ends of buildings or structures, etc. The distance to the coastline should be from 25 to 50 meters.

The video analytics system included in the software of the analytical unit (6) contains the following software modules (detectors):

1) object detection module;

2) face identification module;

3) border crossing module;

4) exclusion zone module;

5) a module for fixing the collision of objects;

6) object tracking module.

The hydromonitoring unit (4) may include the following mechanical parts (Fig. 2):

1) The shape of the body of the device is a signal buoy made of impact-resistant material with a degree of protection of the body that meets the IP67 standard;

2) The power supply system and communication unit are located in the buoy body;

3) The power supply of the device and data transmission to it is carried out via a cable placed along the bottom of the water area and the coastal zone. The connection is made to the distribution part of the video monitoring and notification device (the distribution part should be understood as switching devices to which video cameras, information boards, loudspeakers are connected, which are IP-compatible devices);

4) The sonar antenna is placed under the body of the buoy at a depth of 1.5 meters from the water level and is connected by a control cable to the sonar control unit;

5) The water temperature sensor is placed under the bottom of the buoy body and transmits data to the control unit;

6) The sonar control unit transmits and receives signals from the antenna and the temperature sensor and transmits data on the location of water monitoring objects to the analytical unit (6), while the sonar control unit is a module configured to interpret the signals received from the antenna and the sensor , as well as made with the possibility of setting the hydromonitoring unit.

The functions of the hydromonitoring unit (4) are:

1) Determining the location of water monitoring objects under water;

2) Determining the size and contours of water monitoring objects;

3) Temperature measurement in the upper layer of water (at a depth of 1 meter).

The data received by the sonar is transmitted via a communication cable for processing to the analytical unit. The hydroanalytics system software operating on the analytical unit implements the following functions:

1) Recognition of water monitoring objects (swimmers, ships, marine animals) according to sonar acoustic oscillograms using neural networks;

2) Synchronization of hydroacoustic and video data on water monitoring objects (to ensure continuous tracking of the swimmer);

3) Detection of potential signs of a swimmer's risk of drowning.

The video analytics system included in the software of the analytical unit works as follows (Fig. 3):

1) capturing frames from a video stream;

2) preprocessing of these frames;

3) analysis using machine vision algorithms;

4) analysis using neural networks;

5) drawing graphics;

6) receiving information about any events;

7) formation of packages with data;

8) sending all the necessary data to the event processing service.

At the same time, the video analytics system allows not only to analyze events, but also to manage the security system.

The video analytics and hydroanalytics system software provides recording of the following potentially dangerous events:

1) A swimmer's swim outside the area allowed for swimming;

2) Swimming of the vessel into the bathing area;

3) Collision of a ship with another ship or a swimmer;

4) Finding a child in the water unaccompanied by an adult;

5) Disappearance of a person under water above a given time interval;

6) The swimmer gives a signal for help;

7) The fall of a person from the embankment, pier, ship.

The notification block allows you to voice inform people who are on the water body about the violations of the rules for the operation of the water area committed by them. In the event of an incident, the notification block turns on the alarm signal of the siren, warning rescuers and eyewitnesses about the incident (one of the possible scenarios).

The block of meteorological sensors allows to measure the parameters necessary to assess the acceptable mode of operation of the beach and notify people about changes in weather conditions (one of the possible scenarios).

The solution provides continuous tracking of objects, which makes it possible to provide individual recommendations to beach visitors, such as: hypothermia from prolonged exposure to the water, overheating from prolonged exposure to the sun, swimming under deteriorating weather conditions (one of the possible scenarios).

The claimed solution provides continuous tracking of a person when moving between two physical environments: the beach (land, air, etc.) and the water area (water), which is achieved by sharing and synchronizing the claimed devices and technologies designed to monitor objects in different physical environments. In the proposed solution, video cameras and computer vision technologies are used to ensure continuous tracking of people in the beach area, and sonar data is used to continuously track people in the water (in the bathing area and water area). Warning people about potential danger is carried out using information boards and loudspeakers. The complexity of the solution of the problem is ensured by synchronization of the video camera and sonar data by identifying monitoring objects by geo-coordinate mark and additional characteristics (size, nature and speed of the object movement), processed by the neural network and allowing to identify the unique monitoring object with a high degree of accuracy.

Continuous tracking of people, combined with weather data from a weather station, allows you to monitor according to the following criteria:

1) Long stay of a person in water (depending on temperature);

2) Prolonged stay of a person in the sun (depending on solar activity);

3) The potential danger of a person being in a water body (during a storm and other natural phenomena that threaten life and health).

Continuous tracking of a person in the monitoring area allows to ensure the highest possible level of his safety, especially during activities related to diving and swimming under water. In particular, it becomes available not only to detect the fact of a fall (jump) of a person from a pontoon, bridge, embankment or pier, but also to control the fact of emerging from the water.

Claims (7)

A system for ensuring integrated safety at water bodies, including functional blocks consisting of software and hardware components configured to receive-transmit and / or analyze information about events at a water body and issue appropriate scenarios to prevent dangerous situations, characterized in that the water body consists of three monitoring zones: a beach zone, a bathing zone, a water area, while the software and hardware components include: a) the rescuer workstation, which is a personal computer and/or a wearable electronic device with a web-compatible interface, to provide access to the user interface of the analytical unit, b) meteorological monitoring unit, which is a meteorological station for measuring air temperature, wind force, insolation level, atmospheric pressure values, c) a video monitoring unit, which is a panoramic camera for monitoring the beach and swimming areas, and PTZ cameras for monitoring the swimming areas and the water area, d) hydromonitoring unit, which is a device in the form of a buoy. equipped with a horizontal sonar and a water temperature measurement sensor, additionally acting as a signal buoy that limits the bathing area, e) notification block, which is electronic information boards for displaying information about the operating modes of a water body and / or loudspeakers for voice notification and informing people on the beach, swimmers in the water and persons operating ships in the water area, f) an analytical unit implemented on the basis of server hardware and software using artificial intelligence technologies and designed for the operation of a video analytics system containing software modules for performing such functions as object detection, face identification, border crossing, forbidden zone crossing, object collision detection , tracking objects, receiving information about any events, analyzing the received data, sending data to the server, managing the security system; hydroanalytics system, the software of which implements the following functions: recognition of water monitoring objects based on sonar data, synchronization of hydroacoustic and video data on water monitoring objects, detection of potential signs of the risk of swimmer drowning; at the same time, the modules of video analytics and hydroanalytics systems as part of the analytical unit perform such joint functions as continuous tracking of a person when moving between two physical environments and fixing potentially dangerous events, including a swimmer's swim outside the area allowed for swimming, a ship's swim into the people's bathing area, a collision a ship with another ship or a swimmer, a child being in the water without an adult, a person disappearing under water above a specified time interval, a swimmer giving a signal for help, a person falling from an embankment, a pier, a ship; external device control systems, notification control systems, which are an integral part of the analytical unit software.

Images