CN113658394A

CN113658394A - River channel monitoring method and device

Info

Publication number: CN113658394A
Application number: CN202110933092.9A
Authority: CN
Inventors: 李杨旭; 周婧荣; 朱宴恒
Original assignee: Ceristar Electric Co ltd; MCC Capital Engineering and Research Incorporation Ltd
Current assignee: Ceristar Electric Co ltd; MCC Capital Engineering and Research Incorporation Ltd
Priority date: 2021-08-12
Filing date: 2021-08-12
Publication date: 2021-11-16
Anticipated expiration: 2041-08-12
Also published as: CN113658394B

Abstract

The application provides a river channel monitoring method and a river channel monitoring device, wherein the method comprises the following steps: acquiring a video image of an intrusion object in a target river channel sub-area, wherein the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, weather information and river channel position information in the target river channel area; determining the type and the invasion direction of an invasion object according to the video image; and alarming the intrusion object according to the type and the intrusion direction of the intrusion object and the target river channel subregion. This application can improve the reliability of river course control on the basis of the flexibility and the efficiency of guaranteeing river course control, and then can avoid river course and peripheral personnel's potential safety hazard.

Description

River channel monitoring method and device

Technical Field

The application relates to the technical field of video monitoring, in particular to a river channel monitoring method and device.

Background

In some dangerous river channel areas, people often play in water, swim, catch and other activities, and drowning occurs sometimes; the existing river channel monitoring method mainly comprises the steps that video monitoring systems are arranged along urban river channels and key detection positions, and video signals of the two sides of the river channels and the river channels are collected and uploaded to a monitoring center to be displayed.

In the prior art, a common river channel monitoring method combines radar and video monitoring technologies to realize face recognition, video tracking and video snapshot of river channel intruders, so as to achieve the purposes of real-time monitoring and evidence collection.

The conventional river channel monitoring method is lack of subsequent specific monitoring means after confirming the invasion of personnel, has simple river channel region invasion detection rules, cannot perform differential response on people and objects entering different regions of a river channel and people with different behaviors, does not form an effective hierarchical and regional river channel monitoring mode, and influences the reliability of a river channel monitoring result.

Disclosure of Invention

Aiming at least one problem in the prior art, the application provides a river channel monitoring method and device, which can improve the reliability of river channel monitoring on the basis of ensuring the flexibility and efficiency of river channel monitoring, and further can avoid the potential safety hazard of the river channel and surrounding personnel.

In order to solve the technical problem, the present application provides the following technical solutions:

in a first aspect, the present application provides a river monitoring method, including:

acquiring a video image of an intrusion object in a target river channel sub-area, wherein the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, weather information and river channel position information in the target river channel area;

determining the type and the invasion direction of an invasion object according to the video image;

and alarming the intrusion object according to the type and the intrusion direction of the intrusion object and the target river channel subregion.

Further, before the acquiring the video image of the intrusion object in the target river sub-area, the method further includes:

and dividing the target river channel region according to the river channel scale, the weather information and the position information in the target river channel region to obtain a plurality of river channel sub-regions.

Further, the alarming the invading object according to the type, the invading direction and the target river sub-area of the invading object comprises:

if the intrusion object is a minor adult and the target river sub-area is a small river channel pre-alarm area, triggering a loudspeaker to broadcast and alarm;

if the invading object is a minor adult and the target river sub-area is a small river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the invading object;

if the invasion object is a minor, the target river sub-area is a large and medium river pre-alarm area, and the invasion direction is from a large and medium river attention area adjacent to the large and medium river pre-alarm area, triggering a loudspeaker to broadcast and alarm;

and if the intrusion object is a minor, the target river sub-area is a large and medium river high-risk alarm area, and the intrusion direction enters from a large and medium river pre-alarm area adjacent to the large and medium river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

Further, after the acquiring the video image of the intrusion object in the target river sub-area, the method further includes:

determining the type, the invasion direction and the motion track of an invaded object according to the video image;

and alarming the intrusion object according to the type, the intrusion direction, the motion track and the region type of the target river channel subregion.

Further, the alarming the intrusion object according to the type, the intrusion direction, the motion track of the intrusion object and the area type of the target river channel subregion comprises:

judging whether the time of the intrusion object in a static state in the target river sub-area is greater than a static time threshold value or not according to the motion track, if so, triggering a loudspeaker to broadcast and alarm, if the intrusion object is an adult, the target river sub-area is a large and medium river pre-alarm area, and the intrusion direction is from a large and medium river attention area adjacent to the large and medium river pre-alarm area;

judging whether the invasion object does not stay in the target river channel sub-area and moves to a high-risk alarm area of a large and medium river channel or not according to the motion track, and if the invasion object is an adult, the target river channel sub-area is a large and medium river channel pre-alarm area and the invasion direction enters from a large and medium river channel attention area adjacent to the large and medium river channel pre-alarm area, triggering a loudspeaker to broadcast and alarm;

and if the intrusion object is an adult and the target river sub-area is a small river high-risk alarm area or a large and medium river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

Further, when the triggering speaker broadcasts an alarm or outputs alarm information corresponding to the intrusion object, the method further includes:

and tracking, recording and storing the intrusion object.

Further, after determining the type and the intrusion direction of the intrusion object according to the video image, the method further includes:

and if the intrusion object is an article and the region type of the target river channel subregion is one of a small river channel attention region, a small river channel pre-alarm region, a large and medium river channel attention region and a large and medium river channel pre-alarm region, recording for a preset time after the intrusion object stops running, and storing.

Further, the acquiring a video image of the intrusion object in the target river sub-area includes:

and acquiring a video image of the invading object in the target river sub-area by using a thermal imaging gun-ball linkage camera.

Further, the river channel monitoring method further includes:

and outputting and displaying a complete video image of the target river channel area by using a thermal imaging gun-ball linkage camera.

In a second aspect, the present application provides a river monitoring device, including:

the acquisition module is used for acquiring a video image of the intrusion object in a target river channel sub-area, and the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, weather information and river channel position information in the target river channel area;

the first image processing module is used for determining the type and the invasion direction of an invasion object according to the video image;

and the alarm module is used for alarming the intrusion object according to the type and the intrusion direction of the intrusion object and the target river channel subregion.

Further, river monitoring device, still include:

and the dividing module is used for dividing the target river channel region according to the river channel scale, the weather information and the position information in the target river channel region to obtain a plurality of river channel sub-regions.

Further, the alarm module is configured to perform the following:

Further, river monitoring device, still include:

the second image processing module is used for determining the type, the invasion direction and the motion track of an invaded object according to the video image;

and the output module is used for alarming the intrusion object according to the type, the intrusion direction, the motion track and the region type of the target river channel subregion.

Further, the output module includes:

the first judging unit is used for judging whether the time of the invasion object in a static state in the target river channel sub-area is greater than a static time threshold value or not according to the motion track, if so, the invasion object is an adult, the target river channel sub-area is a large and medium river channel pre-alarm area, and the invasion direction is entered from a large and medium river channel attention area adjacent to the large and medium river channel pre-alarm area, and then triggering a loudspeaker to broadcast and alarm;

the second judging unit is used for judging whether the invasion object does not stay in the target river channel sub-area and moves to a large and medium river channel high-risk alarm area or not according to the motion track, and if the invasion object is an adult, the target river channel sub-area is a large and medium river channel pre-alarm area and the invasion direction enters from a large and medium river channel attention area adjacent to the large and medium river channel pre-alarm area, triggering a loudspeaker to broadcast and alarm;

and the output unit is used for triggering a loudspeaker to broadcast and alarm and outputting alarm information corresponding to the invasion object if the invasion object is an adult and the target river sub-area is a small river high-risk alarm area or a large and medium river high-risk alarm area.

In a third aspect, the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the river monitoring method when executing the computer program.

In a fourth aspect, the present application provides a computer-readable storage medium, on which computer instructions are stored, and when executed, the instructions implement the river monitoring method.

According to the technical scheme, the river channel monitoring method and the river channel monitoring device are provided. Wherein, the method comprises the following steps: acquiring a video image of an intrusion object in a target river channel sub-area, wherein the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, weather information and river channel position information in the target river channel area; determining the type and the invasion direction of an invasion object according to the video image; according to the type and the invasion direction of the invasion object and the target river channel subregion, the invasion object is alarmed, so that the reliability of river channel monitoring can be improved on the basis of ensuring the flexibility and the efficiency of river channel monitoring, and further, the potential safety hazard of the river channel and surrounding personnel can be avoided; the concrete advantages include: 1) the system can quickly respond to various events of the river channel, and can reach millisecond-level alarm triggering response time; 2) an early warning mechanism is formed for the accident conditions on the two sides of the river channel: different alarm mechanisms are formed for adults and minors, the alarm condition is processed for a high-risk alarm area and a pre-alarm area according to different mechanisms, various devices are reasonably utilized, and the field processing efficiency can be improved; 3) the monitoring can be more effectively carried out, the alarm information can be responded in time, and the security operator only needs to pay attention to the relevant information, so that the working efficiency of the security operator can be improved; 4) has powerful data retrieval and analysis functions: can provide quick response time and investigation time; 5) the bandwidth and the storage resource can be saved; 6) the position data in the alarm information is clear, so that the subsequent rescue efficiency can be improved; 7) the closed-loop safety management process (alarming, recording and filing) can be realized, and the safety of the life and property of people can be ensured to the maximum extent.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic first flowchart of a river monitoring method in an embodiment of the present application;

fig. 2 is a second flow chart of the river monitoring method in the embodiment of the present application;

fig. 3 is a third flow chart of the river monitoring method in the embodiment of the present application;

fig. 4 is a fourth flowchart illustrating a river monitoring method in an embodiment of the present application;

fig. 5 is a schematic flow chart of a river monitoring method in an application example of the present application;

fig. 6 is a schematic structural diagram of a river monitoring device in an embodiment of the present application;

fig. 7 is a schematic flow chart of a river monitoring system in an application example of the present application;

fig. 8 is a schematic block diagram of a system configuration of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the prior art, the river monitoring method also has the following problems:

the river course edge sets up the surveillance camera machine and generally adopts the rifle bolt combination that sets up ball machine alone or ball machine cooperation key control, and in above two kinds of schemes, the ball machine that sets up alone can lose the panorama picture at the in-process that tracks the target, and rifle bolt and ball machine set up respectively, and the panorama picture does not have the relevance with the picture of tracking.

The camera and the background monitor are usually configured according to a 'many-to-one' proportion, and the picture of a single camera cannot form the observation of the state of the whole river channel; the images corresponding to the cameras are usually displayed on the display screen in a blocking mode, and for the liquid crystal splicing screen, the attention of people is difficult to monitor the liquid crystal splicing screen in a concentrated mode all the time and suspicious behaviors are found out in advance.

Network Video Recorder (NVR) is generally used for recording and only performing after-the-fact investigation when needed, but NVR generally records and stores the whole monitoring process, and the storage pressure is high.

The alarm mode is single, and the influence of different areas and different intrusion objects on the alarm result is not considered.

On the basis, in order to improve the reliability of river channel monitoring and further avoid potential safety hazards of the river channel and surrounding personnel on the basis of ensuring the flexibility and efficiency of river channel monitoring, the application provides a river channel monitoring method and a river channel monitoring device, wherein a video image of an intrusion object in a target river channel sub-area is obtained, and the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, weather information and river channel position information in the target river channel area; determining the type and the invasion direction of an invasion object according to the video image; according to the type and the invasion direction of the invasion object and the target river channel subregion, alarming the invasion object; specifically, 1) the river channel area can be divided (for example, the handrail and the river bank are one area, and the surface of the river channel is one area), and different processing schemes can be adopted according to the behavior states of the intrusion object in different areas; 2) a camera arranged in the river channel adopts a thermal imaging gun-ball linkage camera; firstly, the accuracy of identification can be improved through thermal imaging detection, and the accuracy of a subsequent processing scheme can be improved; secondly, when an invading object entering the area is tracked, gun and ball linkage is carried out, so that not only can a moving detail picture of the invading object be displayed, but also an overall picture of the area can be displayed; 3) the video images of the front-end cameras are spliced, so that an integral video image can be formed along the bank of a longer river channel, the setting position of the camera is embodied in an electronic map, the alarm position can be displayed in the video image and the electronic map after the video analysis alarm, and the alarm image is popped up for display; 4) after the alarm, the NVR can independently store the camera picture of the alarm position, the stored video can label the alarm content and the alarm time, and the stored alarm information can be set to be incapable of being stored and covered except for manual operation of an operator; 5) after the alarm, the river monitoring device can be linked with the broadcasting system server according to different alarm information, and the field broadcast sends out different sounds or voice broadcasts according to different alarm contents. Under the condition of great personal safety, an alarm call can be automatically dialed to request the support of national security departments.

In order to improve the reliability of river channel monitoring and further avoid the potential safety hazard of the river channel and surrounding personnel on the basis of ensuring the flexibility and efficiency of river channel monitoring, the embodiment of the application provides a river channel monitoring device, which can be a server or client equipment, and the client equipment can comprise a smart phone, a tablet electronic device, a network set top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), vehicle-mounted equipment, intelligent wearable equipment and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch and intelligent bracelet etc..

In practical applications, the river monitoring part may be executed on the server side as described above, or all operations may be completed in the client device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. The client device may further include a processor if all operations are performed in the client device.

The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the task scheduling center side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the task scheduling center server. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed apparatus.

The server and the client device may communicate using any suitable network protocol, including network protocols not yet developed at the filing date of this application. The network protocol may include, for example, a TCP/IP protocol, a UDP/IP protocol, an HTTP protocol, an HTTPS protocol, or the like. Of course, the network Protocol may also include, for example, an RPC Protocol (Remote Procedure Call Protocol), a REST Protocol (Representational State Transfer Protocol), and the like used above the above Protocol.

The following examples are intended to illustrate the details.

In order to improve the reliability of river channel monitoring and further avoid the potential safety hazard of the river channel and surrounding personnel on the basis of ensuring the flexibility and efficiency of river channel monitoring, the embodiment provides a river channel monitoring method with an execution main body of a river channel monitoring device, the river channel monitoring device includes but is not limited to a server, as shown in fig. 1, the method specifically includes the following contents:

step 101: and acquiring a video image of the intrusion object in a target river channel sub-area, wherein the target river channel sub-area is obtained by dividing the target river channel area according to the river channel scale, the weather information and the river channel position information in the target river channel area.

In particular, the intrusion object may be a person or an item; the shape of the river channel subregion is not limited by the application; the river scale may be: one of a small river, a medium river and a large river; the weather information may be: in sunny days, the daily rainfall exceeds the rainfall threshold value and the daily rainfall is less than or equal to the rainfall threshold value; the river channel position information may be: one of the river surface, the outer side of the river rail and the part from the river rail to the river surface; the river channel sub-area can be dynamically adjusted in real time or at regular time according to weather information, so that the accuracy of target river channel area division is improved, and the accuracy of alarming can be improved.

Step 102: and determining the type and the invasion direction of the invasion object according to the video image.

Specifically, the intrusion object may be identified by using a Video Content Analysis (VCA), and the type and the intrusion direction of the intrusion object may be determined.

Step 103: and alarming the intrusion object according to the type and the intrusion direction of the intrusion object and the target river channel subregion.

In order to realize dynamic adjustment of the river channel partition and further improve the reliability of river channel monitoring, in an embodiment of the present application, before step 101, the method further includes:

Specifically, the target river channel subregion may be a river channel subregion into which the invading object enters; can be according to the river course position that the invasion object is located probably can the emergence condition divide into little river course concern area, little river course warning district in advance, little river course high-risk warning district, big and middle river course concern area, big and middle river course warning district in advance and big and middle river course high-risk warning district with the target river course region, divide the principle as follows: dividing the small river channel into a small river channel attention area, a small river channel pre-alarm area and a small river channel high-risk alarm area according to weather information; dividing the large and medium river into a large and medium river attention area, a large and medium river pre-alarm area and a large and medium river high-risk alarm area according to the position information; the dynamic division of river channel sub-areas can be realized, so that the accuracy of the partitioned river channel monitoring is improved.

In an example, as shown in table 1, a target river channel region may be divided according to conditions 1 and 2, and meanwhile, a response means may be determined according to the type of an intruder, an intrusion direction, and a river channel subregion:

TABLE 1

For large and medium river channels, the standard invasion direction can be the direction from the previous river channel subregion to the current river channel subregion; the front stage river sub-area of the high-risk alarm area is a pre-alarm area, and the front stage river sub-area of the pre-alarm area is an attention area.

To further improve the accuracy of river channel monitoring, referring to fig. 2, in an embodiment of the present application, step 103 includes:

step 201: and if the intrusion object is a minor adult and the target river sub-area is a small river channel pre-alarm area, triggering a loudspeaker to broadcast and alarm.

Specifically, speakers can be arranged at a plurality of positions in the target river channel area according to actual needs, and the speakers can be in communication connection with the river channel monitoring device; the loudspeaker closest to the invading object can be triggered to broadcast an alarm.

Step 202: and if the intrusion object is a minor adult and the target river sub-area is a small river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

Specifically, the alarm information may include: person gender, age, and location information, etc.; the alarm information corresponding to the intrusion object can be output to a safety management platform of a monitoring center and terminal equipment of field management personnel, the safety management platform and the terminal equipment of the field management personnel pop up alarm pictures and highlight the alarm pictures to inform the field management personnel to carry out rescue on the river channel field, and the like, and the terminal equipment of the field management personnel can be a tablet personal computer or a mobile phone and the like.

Step 203: and if the invasion object is a minor, the target river sub-area is a large and medium river pre-alarm area, and the invasion direction is entered from a large and medium river attention area adjacent to the large and medium river pre-alarm area, triggering a loudspeaker to broadcast and alarm.

Step 204: and if the intrusion object is a minor, the target river sub-area is a large and medium river high-risk alarm area, and the intrusion direction enters from a large and medium river pre-alarm area adjacent to the large and medium river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

Specifically, once the minor enters the high-risk alarm area from the early warning area of the large and medium river channel, the minor can be judged to fall into the water, the safety management platform and the terminal equipment of the field management personnel pop up an alarm picture and highlight the alarm picture, and the field maintenance personnel are informed to drive to the field to process the alarm situation.

Further, the alarm information may further include: alarm content; the behavior state of the invading object can be identified according to the video image, and different behavior states can correspond to different alarm contents, such as personnel intrusion, stay, fishing, swimming, falling into water and the like; different broadcast alarm voices can be output according to the alarm content.

In order to further improve the accuracy of river channel monitoring, referring to fig. 3, in an embodiment of the present application, after step 101, the method further includes:

step 301: and determining the type, the intrusion direction and the motion track of the intrusion object according to the video image.

Specifically, the operation trajectory may include: position information of the intrusion object and a corresponding time point thereof; the intrusion object can be identified by using a Video Content Analysis (VCA) technology, and the type, the intrusion direction, the motion track and the like of the intrusion object can be determined.

Step 302: and alarming the intrusion object according to the type, the intrusion direction, the motion track and the region type of the target river channel subregion.

Step 302 may specifically include:

1) and judging whether the time of the intrusion object in the static state in the target river sub-area is greater than a static time threshold value or not according to the motion track, if so, triggering a loudspeaker to broadcast and alarm if the intrusion object is an adult, the target river sub-area is a large and medium river pre-alarm area, and the intrusion direction is entered from a large and medium river attention area adjacent to the large and medium river pre-alarm area.

For example, if an adult enters a large and medium river channel pre-alarm area from a large and medium river channel attention area adjacent to the large and medium river channel pre-alarm area and is in a static state for a time greater than a static time threshold value, the adult can be judged to be in a detention and/or fishing state, and a loudspeaker can be triggered to broadcast an alarm.

Further, if the determination of the intrusion object according to the video image includes: people and articles can determine the behavior state of the intruder according to the articles, and further can output different alarm information according to the behavior state of the intruder, so that the accuracy of behavior judgment results of the intruder can be improved, and the accuracy of river monitoring can be improved; for example, intruding items include: a fishing rod, a bucket and the like, and the time that the intruder is in the stationary state is greater than the stationary time threshold, the intruder can be determined to be in the fishing state.

2) And judging whether the intrusion object does not stop in the target river sub-area and moves to a high-risk alarm area of a large and medium river or not according to the motion track, if so, triggering a loudspeaker to broadcast and alarm, if the intrusion object is an adult, the target river sub-area is a large and medium river pre-alarm area, and the intrusion direction is entered from a large and medium river attention area adjacent to the large and medium river pre-alarm area.

Specifically, whether the invading object stays in the target river sub-area can be judged by judging whether the time of the invading object in the static state in the target river sub-area is greater than a static time threshold value, and if the time of the invading object in the static state in the target river sub-area is less than or equal to the static time threshold value, it is determined that the invading object does not stay in the target river sub-area.

3) And if the intrusion object is an adult and the target river sub-area is a small river high-risk alarm area or a large and medium river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

Specifically, for large and medium river channels, adults do not perform alarming and video tracking when moving in a region of interest, and only record personnel characteristic information for adults in the region of interest; after entering the pre-alarm area from the attention area, the adults are subjected to full-network unique coding, video tracking of the moving adults in the pre-alarm area is started, and the movement track of the adults in the pre-alarm area is recorded; judging the behavior state of static personnel in a pre-alarm area, alarming according to the behavior state (detention or fishing and the like) of stay beside a river channel, and triggering a field broadcast loudspeaker to drive away; the method comprises the steps that an adult does not stay in a pre-alarm area and moves to a high-risk alarm area, an alarm is started immediately, a field broadcast loudspeaker is triggered to drive away, the adult enters the high-risk alarm area from the pre-alarm area and is judged to fall into water, a video monitoring platform pops up an alarm picture and displays the alarm picture in a highlighting mode, and field maintenance personnel are informed to drive to the field to process the alarm situation. For small river channels, adults do not give an alarm and track when moving in a concerned area, and only store personnel characteristic information for the adults in the concerned area; after entering the pre-alarm area, the adults are subjected to full-network unique coding, video tracking of the moving adults in the pre-alarm area is started, and the movement track of the adults in the pre-alarm area is recorded; judging the behavior state of static personnel in a pre-alarm area, alarming according to the behavior state (detention or fishing and the like) of stay beside a river channel, and triggering a field broadcast loudspeaker to drive away; when an adult enters a high-risk alarm area, the adult can judge that the adult falls into water, and the management client pops up an alarm picture and highlights the alarm picture to inform field management personnel to drive to the field to process the alarm situation.

In order to further improve the river monitoring efficiency, the invasive object identification can be carried out when the invasive object enters a small river channel attention area, a small river channel pre-alarm area, a small river channel high-risk alarm area and a large and medium river channel attention area, the type of the invasive object is determined, and if the invasive object is a human, the gender and the age of the invasive object can be identified and determined; it can be understood that if the invasion object enters the large and medium river channel pre-alarm area or the large and medium river channel high-risk alarm area, the large and medium river channel attention area corresponding to a certain way is formed in advance, and therefore, in order to avoid repeated identification of the invasion object, the invasion object can be identified in the large and medium river channel pre-alarm area or the large and medium river channel high-risk alarm area again.

In the prior art, the whole monitoring process is usually recorded and stored, and the storage pressure is high, in an embodiment of the present application, when the speaker is triggered to broadcast an alarm or the alarm information corresponding to the intrusion object is output, the method further includes: and tracking, recording and storing the intrusion object.

Specifically, the intrusion object is tracked and recorded only when a loudspeaker is triggered to broadcast an alarm or the alarm information corresponding to the intrusion object is output, so that the storage pressure and the transmission pressure can be reduced, and the retrieval efficiency is improved. The river monitoring is planned in combination with the alarm subareas, meanwhile, the planning is also performed in combination with the activity content of personnel, the alarm processing can be better performed, the alarm information, the alarm processing flow and the processing result (personnel or property loss and the like) are filed and managed, and important information is reported to an upper administrative department; for important safety events of the urban river, the system can be linked with a higher level administrative department and is matched with the higher level administrative department for managing emergency events; in one example, as shown in table 2, the alarm processing flow may be determined according to the river sub-area and the human activities (behavior state) or events.

TABLE 2

Specifically, the current event is determined to be flood according to flood public opinion information such as news and weather forecast, and the number of people around the river and the area where the people are located are determined through video image identification; and in case of heavy rain or torrential flood, field management personnel are informed to drive away or rescue.

In order to reduce the storage pressure and the transmission pressure and improve the retrieval efficiency, referring to fig. 4, in an embodiment of the present application, after step 102, the method further includes:

step 401: and if the intrusion object is an article and the region type of the target river channel subregion is one of a small river channel attention region, a small river channel pre-alarm region, a large and medium river channel attention region and a large and medium river channel pre-alarm region, recording for a preset time after the intrusion object stops running, and storing.

Specifically, the preset duration may be set according to actual needs, which is not limited in this application; through carrying out the video recording of predetermineeing length after stopping the operation to the invasion object, can be convenient for to losing the location of article, improve the efficiency of losing the article location.

In order to realize the association between the panoramic picture and the tracking picture, in an embodiment of the present application, the step 100 includes:

Specifically, the thermal imaging gun-ball linkage camera can be arranged at a plurality of positions in a target river channel area according to actual conditions; triggering a speaker broadcast alarm may include: determining a loudspeaker corresponding to the thermal imaging gun-ball linkage camera and triggering the loudspeaker to alarm according to the corresponding relation between the thermal imaging gun-ball linkage camera and the preset camera and loudspeaker which acquire the video image of the invading object in the target river sub-area, wherein the corresponding relation between the preset camera and the loudspeaker can be set according to the actual situation; the loudspeaker closest to the invading object can be triggered to broadcast and alarm; or the loudspeaker closest to the thermal imaging gun-ball linkage camera can be triggered to broadcast and alarm.

In order to further improve the convenience degree of monitoring the river channel area, the river channel monitoring method further comprises the following steps: and outputting and displaying a complete video image of the target river channel area by using a thermal imaging gun-ball linkage camera.

For further explanation of the present solution, referring to fig. 5, the present application provides an application example of a river monitoring method, which specifically includes:

s1: detecting an invading object; s2: tracking an invaded object; s3: classifying the intrusion object; s4: behavior recognition; s5: judging a rule; s6: an alarm is issued.

To further illustrate the present solution, the present application provides an example of a river monitoring method, which is specifically described as follows:

a middle-aged man holds a fishing gear to reach a river channel of a certain city by a bike, rides to enter a river channel monitoring area, carries out person and object identification on the middle-aged man and a bicycle entering the monitoring area through a thermal imaging gun-ball linkage camera, and an identification result contains sex and age information of the man and tracks the advancing direction of the man.

After the middle-aged man parks, the hand-held fishing gear (fishing rod, bucket and the like) enters a pre-alarm area, the tracking picture is aligned with the middle-aged man, the middle-aged man is numbered based on the identification result, the geographical position of the middle-aged man is marked, and the picture tracking is started at the same time.

After the middle-aged man stops moving in the pre-alarm area, the state of the middle-aged man is judged, the man holds the article with hands, the article is placed at a position short of the middle-aged man after a certain time, the man keeps still after the article is placed and keeps for more than 5 minutes, the man is judged to be a fisherman, an alarm mechanism is started, and ion driving is carried out.

The middle-aged man enters the pre-alarming area, after the movement is stopped, the camera recognizes that the objects are placed, the middle-aged man moves back and forth between the pre-alarming area and the high-risk alarming area for a plurality of times, then the man is judged to be catching fish in a net-opening mode, an alarming mechanism is started, and the man is driven to leave.

And (4) the middle-aged man enters the pre-alarm area, does not stay, moves to the high-risk alarm area, judges that the man tends to throw a river, starts an alarm mechanism and drives away.

From the software aspect, in order to improve the reliability of river monitoring and further avoid the potential safety hazard of the river and surrounding personnel on the basis of ensuring the flexibility and efficiency of river monitoring, the application provides an embodiment of a river monitoring device for realizing all or part of the contents in the river monitoring method, see fig. 6, the river monitoring device specifically includes the following contents:

the acquisition module 10 is configured to acquire a video image of the intrusion object in a target river sub-area, where the target river sub-area is obtained by dividing the target river area according to river scale, weather information, and river position information in the target river area.

And the first image processing module 20 is configured to determine a type and an intrusion direction of the intrusion object according to the video image.

And the alarm module 30 is used for alarming the intrusion object according to the type and the intrusion direction of the intrusion object and the target river channel subregion.

In an embodiment of the present application, the river monitoring device further includes:

In one embodiment of the present application, the alarm module is configured to perform the following:

and if the intrusion object is a minor adult and the target river sub-area is a small river channel pre-alarm area, triggering a loudspeaker to broadcast and alarm.

And if the intrusion object is a minor adult and the target river sub-area is a small river high-risk alarm area, triggering a loudspeaker to broadcast an alarm and outputting alarm information corresponding to the intrusion object.

And if the invasion object is a minor, the target river sub-area is a large and medium river pre-alarm area, and the invasion direction is entered from a large and medium river attention area adjacent to the large and medium river pre-alarm area, triggering a loudspeaker to broadcast and alarm.

and the second image processing module is used for determining the type, the invasion direction and the motion track of the invasion object according to the video image.

In one embodiment of the present application, the output module includes:

and the first judgment unit is used for judging whether the time of the intrusion object in a static state in the target river sub-area is greater than a static time threshold value or not according to the motion track, if so, the intrusion object is an adult, the target river sub-area is a large and medium river pre-alarm area, and the intrusion direction is entered from a large and medium river attention area adjacent to the large and medium river pre-alarm area, so that a loudspeaker is triggered to broadcast and alarm.

And the second judgment unit is used for judging whether the invasion object does not stop in the target river sub-area and moves to a high-risk alarm area of a large and medium river or not according to the motion track, and if the invasion object is an adult, the target river sub-area is a large and medium river pre-alarm area and the invasion direction enters from a large and medium river attention area adjacent to the large and medium river pre-alarm area, triggering a loudspeaker to broadcast and alarm.

The embodiment of the river channel monitoring device provided in this specification may be specifically configured to execute the processing procedure of the embodiment of the river channel monitoring method, and its functions are not described herein again, and reference may be made to the detailed description of the embodiment of the river channel monitoring method.

In order to improve the reliability of river course control on the basis of the flexibility and the efficiency of guaranteeing river course control, and then avoid river course and peripheral personnel's potential safety hazard, as shown in fig. 7, this application provides a river course monitored control system's application example, specifically includes:

the system comprises a thermal imaging gun-ball linkage camera, a storage video server, a video diagnosis server, a database server, a network audio server, a field broadcast speaker and a management client;

the thermal imaging gun-ball linkage camera, the storage video server, the video diagnosis server and the database server can be in communication connection through a switch; the network audio server is respectively in communication connection with the live broadcast loudspeaker and the video diagnosis server; the video diagnosis server is in communication connection with the management client.

The thermal imaging gun-ball linkage cameras can be multiple and can be arranged at multiple positions in a target river channel area according to actual needs; the number of the on-site broadcasting loudspeakers can be multiple, and the loudspeakers can be arranged at multiple positions in a target river channel area according to actual needs; the functions realized by the video diagnosis server can be equivalent to the functions realized by the river channel monitoring device, and the functions realized by combining the video diagnosis server, the storage video server, the database server and the network audio server can be equivalent to the functions realized by the river channel monitoring device. The river monitoring system may further include: the network video recorder is in communication connection with a server, and the server is in communication connection with the switch; the video diagnostic server may be communicatively coupled to a video surveillance platform, which may be a display screen.

The river channel monitoring system is specifically described as follows:

1) the on-site river monitoring camera is a thermal imaging gun-ball linkage camera; can set whole river course to different river course subregion, the subregion setting should satisfy following requirement:

a. a plurality of defense areas (namely the river channel sub-areas) in any shapes are supported in the same scene, and each river channel sub-area can be independently monitored.

b. Different parameters such as sensitivity, invasion object types, invasion object sizes and invasion object speeds can be set for all the river channel sub-areas, and invasion objects entering the river channel sub-areas can be identified according to the parameters of all the river channel sub-areas.

c. For large and medium river channels, a standard intrusion direction can be specified for a river channel sub-area, and an alarm can be triggered only when the intrusion direction of an intrusion object is the standard intrusion direction.

d. Monitoring, tracking and alarm triggering of a plurality of intrusion objects (generally 20 at present) can be supported in the same scene.

e. The motion situation of a single object or a plurality of objects, including the motion direction, the motion characteristics and the like, can be accurately detected and identified in a complex weather environment (such as snow, rain and fog).

2) The method comprises the steps of adding an icon corresponding to a camera arranged in a field river channel into a GIS map of a video monitoring platform, and clicking the camera icon in the map on the video monitoring platform to display a monitoring picture of the camera.

3) The video monitoring platform can integrate and splice the front-end river channel pictures into a picture through the video diagnosis server so as to display the whole river channel, and the spliced screen can also intercept and display the whole river channel in sections.

4) The video diagnosis server can judge and alarm people and objects in the entering area according to set rules.

5) And the storage video server can store the tracking picture and the whole picture of the alarm camera after receiving the alarm signal.

6) The network audio server can divide the area of the on-site broadcast speaker, stores alarm voice information corresponding to different alarm scenes and can send the alarm voice information to the on-site broadcast speaker; the video diagnosis server is in communication connection with the network audio server.

The video diagnosis server, the network audio server, the storage video server and the video monitoring platform can be arranged in a monitoring center.

As can be seen from the above description, the river monitoring method and apparatus provided by the application can use the video analysis technology to divide the alarm areas for different areas and conditions of the river, so as to implement hierarchical management of the alarm areas; the method comprises the following steps of utilizing various conditions to realize the division of a river alarm processing flow and an alarm rule; river monitoring can be realized by combining a thermal imaging gun-ball linkage camera, a video splicing picture, a GIS map and a broadcast alarm mode; the reliability of river channel monitoring can be improved on the basis of ensuring the flexibility and efficiency of river channel monitoring, and further the potential safety hazards of the river channel and surrounding personnel can be avoided; the concrete advantages include: 1) the system can quickly respond to various events of the river channel, and can reach millisecond-level alarm triggering response time; 2) an early warning mechanism is formed for the accident conditions on the two sides of the river channel: different alarm mechanisms are formed for adults and minors, the alarm condition is processed for a high-risk alarm area and a pre-alarm area according to different mechanisms, various devices are reasonably utilized, and the field processing efficiency can be improved; 3) the monitoring can be more effectively carried out, the alarm information can be responded in time, and the security operator only needs to pay attention to the relevant information, so that the working efficiency of the security operator can be improved; 4) has powerful data retrieval and analysis functions: can provide quick response time and investigation time; 5) the bandwidth and the storage resource can be saved, and the Video Content Analysis (VCA) can be utilized for alarming, transmitting Video data and recording; 6) the position data in the alarm information is clear, so that the subsequent rescue efficiency can be improved; 7) the closed-loop safety management process (alarming, recording and filing) can be realized, and the safety of the life and property of people can be ensured to the maximum extent.

From the hardware aspect, in order to improve the reliability of river monitoring on the basis of guaranteeing the flexibility and efficiency of river monitoring, and then avoid river and peripheral personnel's potential safety hazard, this application provides an embodiment of an electronic equipment for realizing whole or partial content in the river monitoring method electronic equipment specifically includes following content:

a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between the river channel monitoring device, the user terminal and other related equipment; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the embodiment for implementing the river channel monitoring method and the embodiment for implementing the river channel monitoring apparatus in the embodiments, and the contents thereof are incorporated herein, and repeated descriptions are omitted here.

Fig. 8 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 8, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this FIG. 8 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.

In one or more embodiments of the present application, the river monitoring function may be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:

According to the above description, the electronic device provided by the embodiment of the application can improve the reliability of river channel monitoring on the basis of ensuring the flexibility and efficiency of river channel monitoring, and further avoid potential safety hazards of river channels and surrounding personnel.

In another embodiment, the river channel monitoring device may be configured separately from the central processor 9100, for example, the river channel monitoring device may be configured as a chip connected to the central processor 9100, and the river channel monitoring function is realized by the control of the central processor.

As shown in fig. 8, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 8; further, the electronic device 9600 may further include components not shown in fig. 8, which may be referred to in the art.

As shown in fig. 8, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.

The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.

The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.

The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.

The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).

The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.

Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.

An embodiment of the present application further provides a computer-readable storage medium capable of implementing all the steps in the river channel monitoring method in the foregoing embodiment, where the computer-readable storage medium stores a computer program, and the computer program implements all the steps of the river channel monitoring method in the foregoing embodiment when executed by a processor, for example, the processor implements the following steps when executing the computer program:

In the present application, each embodiment of the method is described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. Reference is made to the description of the method embodiments.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The principle and the implementation mode of the present application are explained by applying specific embodiments in the present application, and the description of the above embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method of river monitoring, comprising:

2. The river channel monitoring method according to claim 1, further comprising, before the acquiring the video image of the invading object in the target river channel sub-area:

3. The river channel monitoring method according to claim 1, wherein the alarming the intrusion object according to the type of the intrusion object, the intrusion direction and the target river channel sub-area comprises:

4. The river channel monitoring method according to claim 1, further comprising, after the acquiring the video image of the invading object in the target river channel subregion:

5. The river channel monitoring method according to claim 4, wherein the alarming the invading object according to the type, the invading direction, the motion track of the invading object and the area type of the target river channel sub-area comprises:

6. The river channel monitoring method according to claim 3 or 5, wherein when the speaker is triggered to broadcast an alarm or an alarm message corresponding to the invading object is output, the method further comprises:

and tracking, recording and storing the intrusion object.

7. The river monitoring method according to claim 1, after determining the type and the intrusion direction of the intrusion object according to the video image, further comprising:

8. The river channel monitoring method according to claim 1, wherein the acquiring a video image of the intrusion object in the target river channel sub-area comprises:

9. The river monitoring method of claim 1, further comprising:

10. A river monitoring device, comprising:

11. The river monitoring device of claim 10, further comprising:

12. The river monitoring device of claim 10, wherein the alarm module is configured to perform the following:

13. The river monitoring device of claim 10, further comprising:

14. The river monitoring device of claim 13, wherein the output module comprises:

15. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the river monitoring method according to any one of claims 1 to 9 when executing the program.

16. A computer-readable storage medium having computer instructions stored thereon, wherein the instructions, when executed, implement the river monitoring method according to any one of claims 1 to 9.