CN108964963B

CN108964963B - Alarm system based on video network and method for realizing alarm

Info

Publication number: CN108964963B
Application number: CN201710853953.6A
Authority: CN
Inventors: 王艳辉; 刘小勇; 李云鹏; 李阔
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2017-09-20
Filing date: 2017-09-20
Publication date: 2021-09-28
Anticipated expiration: 2037-09-20
Also published as: CN108964963A

Abstract

The invention provides an alarm system based on a video network and a method for realizing alarm, which are applied to the video network, wherein the alarm system comprises a server, a client, a first video network terminal and a second video network terminal; the server is used for acquiring target image data, generating corresponding alarm information when detecting that the target image data accords with a preset alarm rule, and sending the target image data and/or the alarm information to the client; the client is used for displaying the target image data and/or the corresponding warning information and sending the target image data and/or the corresponding warning information to the first video network terminal; the first video network terminal is used for publishing the target image data and/or corresponding warning information to one or more subscribed second video network terminals; and the second video network terminal is used for watching the target image data and/or the corresponding warning information. The invention can strengthen the early warning and processing capability of the video network to the event.

Description

Alarm system based on video network and method for realizing alarm

Technical Field

The invention relates to the technical field of video networking, in particular to an alarm system based on the video networking and a method for realizing alarm.

Background

With the great push to video surveillance system construction in various regions, public safety video faces the demands of networking, sharing and deep application. Based on the coverage and the fusion capability of the video networking, the video monitoring image resources of the multi-source heterogeneous video monitoring equipment and system can be uniformly managed, how to effectively share the image application of the video monitoring resources and deeply mine the information of the image can be better served for the application of social security and the efficient processing of emergency, an efficient linkage event early warning and linkage mechanism is formed, and the method is an important subject faced by the video networking technology.

Disclosure of Invention

In view of the above, embodiments of the present invention are proposed to provide a video network based alerting system and a corresponding method of implementing an alert that overcome or at least partially address the above problems.

In order to solve the above problems, the embodiment of the present invention discloses an alarm system based on a video network, wherein the alarm system comprises a server, a client, a first video network terminal and a second video network terminal; wherein the content of the first and second substances,

the server is used for acquiring target image data, generating corresponding alarm information when detecting that the target image data accords with a preset alarm rule, and sending the target image data and/or the alarm information to the client;

the client is used for displaying the target image data and/or the corresponding warning information and sending the target image data and/or the corresponding warning information to a first video network terminal;

the first video network terminal is used for publishing the target image data and/or corresponding warning information to one or more subscribed second video network terminals;

and the second video network terminal is used for watching the target image data and/or the corresponding alarm information.

Preferably, the alarm system further comprises:

the first coordination gateway device is used for receiving image data transmitted by one or more data source devices and converting the image data into data in a video networking protocol form.

Preferably, the alarm system further comprises:

and the scheduling platform is used for determining target data source equipment, a server which needs to perform alarm analysis and one or more second video network terminals.

Preferably, the scheduling platform comprises:

the target data source equipment determining module is used for displaying a data source equipment list and determining the data source equipment selected by a user from the data source equipment list as target data source equipment;

the server determining module is used for displaying various service processing types and determining a server corresponding to the service processing type selected by the user;

and the subscription module is used for receiving the subscription request and taking the video network terminal corresponding to the subscription request as a second video network terminal.

Preferably, the alarm system further comprises:

and the second coordination gateway equipment is used for receiving a data acquisition request sent by the server, acquiring corresponding target image data from the first coordination gateway equipment based on the data acquisition request, converting the target image data into an internet protocol form and sending the converted target image data to the server.

Preferably, the server includes:

the data acquisition module is used for sending a data acquisition request to second coordination gateway equipment and receiving target image data returned by the second coordination gateway equipment based on the data acquisition request;

the analysis module is used for carrying out alarm analysis on the target image data based on the selected service processing type and generating alarm information based on the analysis result;

and the sending module is used for sending the target image data and/or the alarm information to the client.

Preferably, the first video network terminal is connected to the client through a high-definition multimedia interface HDMI.

The embodiment of the invention also discloses a method for realizing the alarm, which is applied to the video network and comprises the following steps:

a first video network terminal receives target image data and/or alarm information sent by a client, wherein the alarm information is corresponding information generated when a server corresponding to the client detects that the target image data accords with a preset alarm rule;

and publishing the target image data and/or the corresponding warning information to one or more subscribed second video network terminals.

Preferably, the step of publishing the target image data and/or the corresponding warning information to one or more subscribed second video network terminals includes:

and issuing the target image data and/or the corresponding alarm information to one or more subscribed second video network terminals by adopting a video network protocol.

The embodiment of the invention has the following advantages:

in the embodiment of the present invention, after the server 10 obtains the target image data, an alarm analysis may be performed on the target image data to detect whether the target image data meets a preset alarm rule, if yes, corresponding alarm information may be generated, and the target image data and/or the corresponding alarm information may be sent to the client 20 for display, and meanwhile, if the client 20 detects the connection of the first video network terminal 30, the target image data and/or the corresponding alarm information may be sent to the first video network terminal 30, and the first video network terminal 30 pushes the target image data and/or the corresponding alarm information to one or more subscribed second video network terminals 40, so that the second video network terminal may view the target image data and/or the corresponding alarm information.

By the mode, intelligent alarm analysis of image data is realized, the timeliness of alarm is improved, an alarm pushing function is formed, linkage of event early warning and a video network terminal is enhanced, early warning and processing capacity of the video network to events is enhanced, positive effects are played in aspects of crime fighting, public security and precaution, social management, civil service and the like, and an important technical support means is provided for stability, stability and order of social security and public security.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5 is a block diagram of a video network-based alarm system according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of an alarm system based on a video network according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a network architecture of an alarm system according to an embodiment of the present invention;

FIG. 8 is a flow chart of steps of an embodiment of a method of implementing an alert.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the above characteristics of the video network, the core concept of the embodiment of the invention is provided: with the rapid promotion of video monitoring system construction in various regions, public security videos face the requirements of networking, sharing and deep application, and based on the coverage and fusion capability of the video networking, the video monitoring image resources of multi-source heterogeneous video monitoring equipment and systems can be uniformly managed. Meanwhile, on the basis of unified convergence management, the intelligent analysis processing capacity of the video network can realize image identification and behavior judgment based on video images, alarm information is generated, expanding application is carried out based on the alarm information, linkage between the alarm video image information and the video network terminal is realized, early warning can be timely carried out on users, and therefore the intelligent video network terminal plays an active role in crime fighting, public security and precaution, social management, civil life service and the like.

The warning system based on the video networking is a system based on a V2V video networking technology, takes a fusion communication technology as a bridge, realizes interconnection and intercommunication of various heterogeneous networks through fusion of the video networking and various networks, supports interaction of various information media such as voice, video, images, data and the like, realizes access, centralized management, unified calling and intelligent linkage of information resources by taking video fusion application as a means, truly integrates and releases the maximum efficacy of each part, and meets the application requirements of emergency command on information resource sharing, efficient cooperation, peacetime and war combination and command order and power.

Referring to fig. 5, a block diagram of an alerting system based on a video network according to an embodiment of the present invention is shown, and the alerting system may include a server 10, a client 20, a first video network terminal 30, a second video network terminal 40, and the like. Wherein the content of the first and second substances,

the server 10 is configured to obtain target image data, generate corresponding warning information when it is detected that the target image data conforms to a preset warning rule, and send the target image data and/or the warning information to the client 20;

the client 20 is configured to display the target image data and/or the corresponding warning information, and send the target image data and/or the corresponding warning information to the first video network terminal 30;

the first video network terminal 30 is configured to publish the target image data and/or corresponding warning information to one or more subscribed second video network terminals 40;

and the second video network terminal 40 is configured to view the target image data and/or the corresponding warning information.

Referring to fig. 6, a schematic structural diagram of an alerting system based on a video network according to an embodiment of the present invention is shown, where the alerting system may include a first coordination gateway device 50, a second coordination gateway device 60, a server 10, a client 20, a first video network terminal 30, a second video network terminal 40, and a scheduling platform 70.

Specifically, the first cooperative gateway device 50 is configured to receive image data transmitted by one or more data source devices 80 and convert the image data into data in the form of a video networking protocol.

In an implementation, the data source device 80 may be a heterogeneous device, which may include but is not limited to: the system comprises a Network camera, a DVR (digital Video Recorder)/NVR (Network Video Recorder), an existing Video monitoring system, an individual-soldier wireless monitoring system, a mobile emergency monitoring system (such as a mobile command vehicle), an unmanned aerial vehicle, a smart phone and the like.

As an example, the data source device 80 may support internet protocols such as the national standard GB28181 protocol, ONVIF protocol, vendor SDK, or other custom approaches.

After the data source device 80 acquires the image data, the image data may be sent to the first cooperative gateway device 50 in the form of an internet protocol, where the first cooperative gateway device 50 is a device responsible for accessing the image data to the video network, and the first cooperative gateway device 50 may interface with a protocol, such as a GB/T28181 protocol, of the video network V2V protocol, so as to implement convergence access of image resources.

It should be noted that the image data sent by the data source device 80 to the first coordination gateway device 50 may be a video frame, and a video stream is sent by the data source device 80 to the first coordination gateway device 50 in a period of time.

After the first collaboration gateway device 50 accesses the picture data, the picture data may be converted into a video networking protocol recognizable by the server 10 for storage.

In the embodiment of the present invention, the scheduling platform 70 is configured to determine a target data source device, a server that needs to perform alarm analysis, and determine one or more second video network terminals.

In particular implementations, the scheduling platform 70 functions to prepare data for subsequent alarm analysis and data push.

In a preferred embodiment of the present invention, the scheduling platform 70 may include the following modules:

a target data source device determining module 7001, configured to display a data source device list, and determine a data source device selected by a user from the data source device list as a target data source device;

in a specific implementation, a data source device list may be displayed in a client interface corresponding to the scheduling platform 70, where the data source device list may include identification information of one or more data source devices, the identification information of the one or more data source devices may be provided as an option to a user, and the user may select one or more identification information, and then the target data source device determining module 7001 may determine the data source device corresponding to the identification information selected by the user as the target data source device.

It should be noted that the embodiment of the present invention is not limited to the above-mentioned manner for determining the target data source device, and those skilled in the art may set the target data source device in other manners, for example, directly input device information of the target data source device, such as a device identifier, a device location, and the like, in the scheduling platform 70.

A server determination module 7002, configured to display multiple service processing types, and determine a server 10 corresponding to a service processing type selected by a user;

as a preferred example of the embodiment of the present invention, the service processing types may include, but are not limited to: a business object identification type, a region monitoring type, etc.

The service object identification type may refer to identifying a service object in video data or picture data, for example, license plate identification, face identification, and the like. The area monitoring type is to monitor whether a specified event occurs in a specified area, for example, whether a business object enters the specified area is monitored.

In one embodiment, the server corresponding to each service processing type may be preset, that is, a binding relationship between each service processing type and the corresponding server is generated. In implementation, a plurality of service processing types may be displayed in a client interface corresponding to the scheduling platform 70, the plurality of service processing types may be displayed in a form of an option, the user may select at least one service processing type, and when a selected operation of the user on one or more service processing types is detected, the service processing type selected by the user may be searched from the binding relationship, so as to determine a corresponding server from the matched binding relationship.

And the subscription module 7003 is configured to receive the subscription request, and use the terminal of the video network corresponding to the subscription request as the second terminal 40 of the video network.

In this embodiment of the present invention, the scheduling platform 70 further has a subscription function, and the terminal determined by the subscription function may be a subscription terminal, and the subscription terminal may view corresponding video or image information in real time according to the subscribed item.

In the video network, the subscribing terminal may be a video network terminal, i.e., the second video network terminal 40. The terminal of the video network may complete the subscription by sending a subscription request to the scheduling platform 70, and after receiving the subscription request, the scheduling platform 70 may perform identity verification on the terminal of the video network, for example, verify whether the terminal of the video network is a registered terminal, and after the verification is passed, use the terminal of the video network corresponding to the subscription request as the second terminal 40 of the video network.

In an implementation, the subscription request may be a request generated by a user performing a subscription operation in the terminal of the video network, and the subscription operation may include, but is not limited to: operations such as attention, friend adding, subscription and the like.

In the scheduling platform 70, the internet-of-view number of the second internet-of-view terminal 40 may be stored in a subscription database.

Further, in order to implement more accurate push, different subscription terminals may be set for the specified data source device, that is, the subscription request is a request sent by the specified data source device, in this case, the device identifier corresponding to the data source device may be stored in the subscription database, and the association relationship between the device identifier and the corresponding video network number of the second video network terminal 40 is stored.

The embodiment of the invention completes the management and scheduling of resources through the scheduling platform 70, performs data preparation for subsequent alarm analysis, and provides a data basis.

In this embodiment of the present invention, the second cooperative gateway device 60 is configured to receive a data obtaining request sent by the server 10, obtain corresponding target image data from the first cooperative gateway device 50 based on the data obtaining request, convert the target image data into an internet protocol, and send the internet protocol to the server 10.

Specifically, the second cooperative gateway device 60 may obtain the corresponding target image data from the first cooperative gateway device 50 according to the requirement of the server 10, and convert the target image data into the form of the internet protocol that can be recognized by the server 10.

In implementation, the server 10 may send a data obtaining request to the second cooperative gateway device 60, where the data obtaining request may include information such as an identifier of a target data source device, and then the second cooperative gateway device 60 sends the data obtaining request to the first cooperative gateway device 50, and the first cooperative gateway device 50 searches for corresponding target image data according to the identifier of the target data source device carried in the data obtaining request, and sends the target image data to the second cooperative gateway device 60.

The second cooperative gateway device 60 receives the target image data sent by the first cooperative gateway device 50, and the second cooperative gateway device 60 converts the target image data into data in the form of internet and sends the data to the server 10.

It should be noted that the target image data sent by the first cooperative gateway device 50 may be a single image data, or may be a video frame in a video stream, and the target image data sent within a period of time may form a video stream, which is not limited in this embodiment of the present invention.

The server 10 is configured to obtain target image data, generate corresponding warning information when it is detected that the target image data conforms to a preset warning rule, and send the target image data and/or the warning information to the client 20.

The server 10 in the embodiment of the present invention may be an alarm analysis server. After the server 10 receives the target image data sent by the second coordination gateway device, alarm analysis may be performed on the target image data to generate alarm information, and the target image data and/or the corresponding alarm information may be sent to the client 20 corresponding to the server.

In a preferred embodiment of the present invention, the server 10 may include the following modules:

a data obtaining module 1001, configured to send a data obtaining request to a second coordination gateway device, and receive target image data returned by the second coordination gateway device based on the data obtaining request;

in a specific implementation, the server 10 may determine a target data source device from the scheduling platform through the data obtaining module 1001, and generate a data obtaining request based on device information of the target data source device to request to obtain image data corresponding to the target data source device.

After the server 10 generates the data acquisition request, it may send the data acquisition request to the second cooperative gateway device 60 and receive target image data returned by the second cooperative gateway device based on the data acquisition request.

An analysis module 1002, configured to perform alarm analysis on the target image data based on the selected service processing type, and generate alarm information based on a result of the analysis;

in a specific implementation, the current server 10 has a corresponding service processing type, and after the server 10 receives the target image data, the analysis module 1002 may perform alarm analysis on the target image data, and generate alarm information based on a result of the analysis.

As an example of the embodiment of the present invention, the alarm information may include, but is not limited to, the following information: the alarm time when the alarm occurs, the service processing type when the alarm occurs, the device information of the data source device where the alarm occurs, and the like.

In a specific implementation, the server 10 may implement alarm analysis processing on the target image data through technologies such as visual computation, image processing, and pattern recognition, but it should be noted that, for different service processing types, the alarm analysis manners of the server may be different, and the corresponding alarm rules are also different.

For example, if the service processing type is a service object identification type, the server may extract service data of a service object to be identified, such as face data, a license plate number, and the like, in target image data (such as each frame of video frame in a video stream), match the service data of the service object to be identified with service data in a preset blacklist database and/or a whitelist database, and if the matching is successful, may determine that the current target image data conforms to a preset alarm rule, and generate alarm information based on the successfully matched service data in the database, alarm time, the service processing type, and a corresponding data source device. If the matching is unsuccessful, the current target image data can be judged not to conform to the preset alarm rule, and at the moment, the alarm information can not be generated.

In one embodiment, one way of matching is as follows: and respectively calculating the matching degree between the service data of the service object to be identified and the service data in the database, and if the service data with the matching degree larger than a preset matching degree threshold exists, judging that the matching is successful, and under the condition, generating alarm information based on each successfully matched service data in the database, the corresponding matching degree, the alarm time, the service processing type and the equipment information of the corresponding data source equipment. Otherwise, if the service data with the matching degree larger than the preset matching degree threshold value does not exist, the matching is judged to be unsuccessful.

It should be noted that the embodiment of the present invention is not limited to the calculation method of the matching degree, and those skilled in the art may adopt any existing calculation method of the matching degree or the similarity degree according to actual needs, for example, the calculation method of the cosine similarity degree.

For example, a blacklist library of evading personnel is arranged in the alarm system, the target image data acquired by the data source equipment is analyzed and compared with the face image in the blacklist library, and if the similarity is found to be higher than a set parameter value (for example, eighty percent), alarm information is generated to alarm.

For another example, if the service processing type is the area monitoring type, the server may obtain a position range of an area to be monitored, capture a real-time position of a service object appearing in the image resource in real time, determine that the current target image data conforms to a preset alarm rule when it is monitored that the real-time position is within the position range, and generate alarm information based on the real-time position of the service object, the position range, alarm time, the service processing type, and device information of the corresponding data source device.

A sending module 1003, configured to send the target image data and/or the warning information to the client 20.

In particular implementations, server 10 and client 20 may communicate over an IP network.

After the server 10 generates the warning information, the warning information and the corresponding target image data may be transmitted to the client 20 through the transmitting module 1003.

Accordingly, if the server 10 does not generate the warning information, the target image data may be transmitted to the client 20 through the transmission module 1003.

The client 20 is configured to display the target image data and/or the corresponding warning information, and send the target image data and/or the corresponding warning information to the first video network terminal.

In the embodiment of the present invention, the client 20 may be an alarm analysis client corresponding to the alarm analysis server 10, and one server 10 may correspond to one or more clients 10.

When the client 20 receives the target image data and the corresponding warning information, the target image data and the corresponding warning information may be displayed at the same time, for example, the target image data is displayed at the central position of the display interface of the client 20, and the warning information is displayed at the left side, the right side, or the upper side and the lower side of the display interface.

If the client 20 does not receive the warning information, the target image data may be directly displayed in the interface.

In the embodiment of the present invention, the client 20 may further send the target image data and/or the corresponding warning information displayed in real time to the first video network terminal 30.

In a specific implementation, the first video network terminal 30 may be connected to the client 20 through an HDMI (High Definition Multimedia Interface). When the client 20 detects that the first video network terminal 30 is connected, the real-time display content may be sent to the first video network terminal 30.

The first video network terminal 30 is configured to publish the target image data and/or the corresponding warning information to one or more subscribed second video network terminals 40.

Specifically, after receiving the data transmitted by the client 20, the first video network terminal 30 may encode the data by using a video network protocol, and display or play the encoded data.

Meanwhile, the first video network terminal 30 may also determine, through the scheduling platform, the video network number of the second video network terminal 40 that completes the subscription, and push data of the video network protocol to the video network number of the second video network terminal 40.

The second video network terminal 40 is configured to view the target image data and/or the corresponding warning information.

In a specific implementation, the second video network terminal 40 may view the target image data and/or the corresponding warning information, so as to perform a warning response in time.

On the basis of fig. 6, the embodiment of the present invention further discloses a network architecture diagram of the alarm system shown in fig. 7, where the architecture of the alarm system may include, but is not limited to: a data source layer, an access layer, a transport layer, a platform service layer, an application layer, etc. Wherein the content of the first and second substances,

the data source layer is a source layer of video monitoring image resources (namely image data), supports the access of resources such as private network environment resources, non-private network environment resources, social environment resources and industry resources, and supports heterogeneous data source devices such as a network camera, a DVR/NVR, an existing video monitoring system, an individual soldier monitoring system, a mobile emergency monitoring system, an unmanned aerial vehicle and a smart phone.

The access layer is used for realizing access to heterogeneous devices and supports GB28181, ONVIF, vendor SDK and other customized modes.

The transmission layer utilizes the advanced video data transmission capability of the video network to efficiently and safely transmit the video monitoring images.

The platform service layer is a service layer supported by the intelligent analysis alarm pushing application and can comprise a scheduling platform (namely a monitoring networking scheduling management platform), an intelligent analysis service platform, a video networking scheduling command service platform and the like. The monitoring networking scheduling management platform realizes the functions of monitoring resource management, resource grouping management, access equipment management, role authority management and the like, and provides an international gateway service interface for the outside; the intelligent analysis service platform provides functions of visual calculation, mode recognition, behavior analysis, image processing and the like, and provides an intelligent analysis linkage alarm event interface for the outside; the video networking dispatching and commanding service platform provides dispatching and dispatching services such as video telephones, mobile commands, video conferences, image dispatching and the like.

The application layer provides a pushing application function for video intelligent analysis, and the pushing application function comprises face recognition application, behavior analysis application, license plate recognition application, community face grade and the like. In the embodiment of the invention, the target data source equipment, the server for specifying the service processing type and the second video network terminal for executing the subscription operation can be set through the scheduling platform so as to complete the management and scheduling of resources. The intelligent analysis is carried out on the video image resources received in real time through the server, the obtained alarm information is sent to the first video network terminal through the HDMI for live broadcast through the client, and then the first video network terminal is pushed to the second video network terminal subscribed through the video network.

The embodiment of the invention also provides a method for realizing the alarm, which can comprise two stages: the generation phase of the intelligent analysis result and the application phase of the intelligent analysis result. In the intelligent analysis result generation stage, the method mainly comprises the steps of selecting an analysis object (namely, determining target data source equipment), determining an intelligent analysis server, determining an algorithm rule (determining the algorithm rule corresponding to the service processing type) and generating an intelligent analysis result; the intelligent analysis result application stage comprises live broadcast of intelligent analysis results through a video networking technology, subscription setting is carried out on video networking terminals paying attention to the intelligent analysis results through a monitoring networking scheduling platform, the intelligent analysis results are scheduled and pushed according to subscription equipment, and the video networking terminals subscribing the intelligent analysis results can be connected with a high-definition television and a large screen to be displayed so that a user can carry out processing decision analysis.

Referring to fig. 8, a flowchart of steps of an embodiment of a method for implementing an alarm according to an embodiment of the present invention is shown, where the embodiment may be applied to a video network terminal performing push, that is, a first video network terminal, and the embodiment of the present invention may include the following steps:

step 801, a first video network terminal receives target image data and/or the alarm information sent by a client;

the warning information is generated when a server corresponding to the client detects that the target image data accords with a preset warning rule;

step 802, publishing the target image data and/or the corresponding warning information to one or more subscribed second video network terminals.

In a preferred embodiment of the present invention, the first video network terminal is connected to the client through a high definition multimedia interface HDMI.

In a preferred embodiment of the present invention, step 802 may further be:

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

In addition, the embodiment of the invention also discloses an alarm device, which comprises a memory, a processor, a computer program which is stored on the memory and can run on the processor, and the computer program which runs on the processor, wherein the steps of the method of the embodiment are realized when the processor executes the program.

In addition, the embodiment of the invention also discloses a computer readable storage medium, on which a computer program is stored, and the program is executed by a processor to realize the steps of the method of the embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The above detailed description is made on the warning system and the warning method based on the video network, and the specific examples are applied in the description to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. The warning system based on the video network is characterized by comprising a server, a client, a first video network terminal and a second video network terminal; the first video network terminal is connected with the client through a high-definition multimedia interface (HDMI); wherein the content of the first and second substances,

the server is used for acquiring target image data, generating corresponding alarm information when detecting that the target image data accords with a preset alarm rule, and sending the alarm information or the alarm information and the target image data to the client;

the client is used for displaying the alarm information or the alarm information and the target image data and sending the alarm information or the alarm information and the target image data to a first video network terminal;

the first video network terminal is used for issuing the alarm information to one or more subscribed second video network terminals, or the alarm information and the target image data;

2. The alert system according to claim 1, wherein the alert system further comprises:

the first protocol gateway equipment is used for receiving image data transmitted by one or more data source equipment and converting the image data into data in a video networking protocol form;

3. The warning system of claim 2 further comprising:

4. The alarm system of claim 3, wherein the dispatch platform comprises:

5. The warning system of claim 4 wherein the server comprises:

and the sending module is used for sending the alarm information or the alarm information and the target image data to the client.

6. A method for realizing alarm is applied to video network, and is characterized in that the method comprises the following steps:

a first video network terminal receives alarm information sent by a client side, or the alarm information and target image data, wherein the alarm information is information which is generated by a server and corresponds to an alarm rule when the server corresponding to the client side detects that the target image data accords with the preset alarm rule;

the first video network terminal issues the alarm information or the alarm information and the target image data to one or more subscribed second video network terminals;

and the first video network terminal is connected with the client through a high-definition multimedia interface (HDMI).

7. The method of claim 6, wherein the step of publishing the alert information, or the alert information and the target image data, to one or more subscribed second video network terminals comprises: