CN116684223A - Monitoring video conversion gateway - Google Patents

Abstract

The present disclosure relates to a surveillance video conversion gateway. The monitoring video conversion gateway comprises an equipment access management module, an interconnection management module, a unified processing module and an image leakage tracing module, wherein the equipment access management module is used for accessing security monitoring equipment or a security monitoring system adopting different types of protocols; the interconnection and intercommunication management module is used for registering with other monitoring video conversion gateways; the unified processing module is used for encoding or transcoding the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format; and the image leakage tracing module is used for embedding invisible and unique watermark information into the local picture of the audio and video data and outputting the picture embedded with the watermark information to a display screen.

Description

Monitoring video conversion gateway

Technical Field

The present disclosure relates to the field of communications, and in particular, to a surveillance video conversion gateway.

Background

With the expansion of enterprise interlocking and branch institutions and the appearance of large-scale monitoring scene demands of industrial Internet of things, the monitoring use scene is developing to large scale and dense, and the monitored network architecture is also becoming huge and complex, which brings great challenges to remote access and management of cross-regional monitoring.

At present, the construction mode of regional on-demand is followed in the construction process of the security monitoring system, so that security monitoring systems or security monitoring equipment of different manufacturers can be adopted in different areas, unified planning is lacking, and the differences among the different security monitoring systems or security monitoring equipment can cause a plurality of technical barriers or problems in cross-regional monitoring remote access and management. If the registration connection protocol is not uniform, the difficulty is high when integrating a plurality of different security monitoring systems or security monitoring devices; for another example, the security monitoring system only supports the cascade mode, so that the requirement that audio and video contents in other areas can be watched or used at any point cannot be met; for another example, the code streams output by different security monitoring systems or security monitoring devices have larger differences, so that the cross-system transmission and use of the audio and video between the different security monitoring systems or the security monitoring devices are greatly hindered; for another example, if there is sensitive content in the audio and video that cannot be freely diffused, such as related to personal privacy, the problem that the sensitive content is freely photographed and leaked cannot be avoided.

Disclosure of Invention

The present disclosure provides a surveillance video conversion gateway to at least solve a number of technical obstacles or problems in the related art that occur when remote access and management are monitored across areas.

According to a first aspect of an embodiment of the present disclosure, a surveillance video conversion gateway is provided, where the surveillance video conversion gateway includes an equipment access management module, an interconnection management module, a unified processing module, and an image leakage tracing module, where the equipment access management module is configured to access security monitoring equipment or a security monitoring system that adopts different types of protocols, so that the surveillance video conversion gateway receives audio and video data of the security monitoring equipment or the security monitoring system; the interconnection and intercommunication management module is used for registering with other monitoring video conversion gateways so as to mutually call audio and video data of the other party between the monitoring video conversion gateway and the other monitoring video conversion gateways; the unified processing module is used for encoding or transcoding the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format so that other monitoring video conversion gateways can call the audio and video data of the monitoring video conversion gateway; and the image leakage tracing module is used for embedding invisible and unique watermark information into the local picture of the audio and video data and outputting the picture embedded with the watermark information to a display screen.

Optionally, the device access management module is further configured to receive a registration request of the first security monitoring device or the first security monitoring system that adopts the standard protocol, and register the first security monitoring device or the first security monitoring system to the local based on the registration request; the device access management module is further configured to set base information of a second security monitoring device or a second security monitoring system that adopts an open protocol or a private protocol locally, initiate a connection request to the second security monitoring device or the second security monitoring system based on the base information, and establish connection with the second security monitoring device or the second security monitoring system.

Optionally, the device access management module is further configured to obtain an audio and video resource directory of the first security monitoring device, the first security monitoring system, the second security monitoring device, or the second security monitoring system and store the audio and video resource directory in a local database when the first security monitoring device or the first security monitoring system is registered locally and a connection is established with the second security monitoring device or the second security monitoring system, where the audio and video resource directory includes an audio and video source address, a security monitoring device identifier, and an online state of the security monitoring device.

Optionally, the device access management module is further configured to receive a first notification message that an audio and video resource directory of the first security monitoring device or the first security monitoring system changes, and obtain the changed audio and video resource directory and update the local database based on the first notification message; the device access management module is further configured to periodically obtain an audio/video resource directory of the second security monitoring device or the second security monitoring system, and update the local database if the obtained audio/video resource directory is inconsistent with a corresponding audio/video resource directory in the local database.

Optionally, the interconnection and interworking management module is further configured to locally set gateway information of other monitoring video conversion gateways to be registered, and send a registration request to the other monitoring video conversion gateways based on the gateway information, so that the other monitoring video conversion gateways call required audio and video data from the monitoring video conversion gateways under the condition of successfully registering to the other monitoring video conversion gateways; and the interconnection and interworking management module is also used for receiving registration requests sent by other monitoring video conversion gateways, and registering the other monitoring video conversion gateways to the local based on the registration requests so that the monitoring video conversion gateway can call the required audio and video data from the other monitoring video conversion gateways.

Optionally, the interconnection management module sends a local audio and video resource catalog to the other monitoring video conversion gateway under the condition of successfully registering to the other monitoring video conversion gateway, so that when the monitoring video conversion gateway receives an acquisition request of the other monitoring video conversion gateway, the monitoring video conversion gateway sends audio and video data corresponding to an audio and video source address in the acquisition request to the other monitoring video conversion gateway; and the interconnection and intercommunication management module acquires the audio and video resource catalogues of the other monitoring video conversion gateways and stores the audio and video resource catalogues into the local database under the condition that the other monitoring video conversion gateways are registered locally, so that when the monitoring video conversion gateway sends an acquisition request to the other monitoring video conversion gateways, the audio and video data corresponding to the audio and video source address in the acquisition request are acquired from the other monitoring video conversion gateways.

Optionally, under the condition that the local audio and video resource catalogue is changed, the interconnection and interworking management module is further used for sending a second notification message to other monitoring video conversion gateways, and under the condition that the acquisition request of the other monitoring video conversion gateways is received, sending the local changed audio and video resource catalogue to the other monitoring video conversion gateways; and the interconnection and interworking management module is also used for receiving second notification messages of other monitoring video conversion gateways, acquiring audio and video resource catalogs after the other monitoring video conversion gateways change based on the second notification messages, and updating a local database.

Optionally, the unified processing module is further configured to transcode the audio/video data acquired through network transmission according to the specified parameters to obtain audio/video data in a unified format; and the unified processing module is also used for encoding the audio and video data acquired through the hardware interface according to the specified parameters to obtain audio and video data in a unified format.

Optionally, the unified processing module is further configured to obtain an audio/video source address from the local database, obtain required audio/video data in real time from an audio/video source corresponding to the audio/video source address, and perform real-time transcoding according to specified parameters to obtain audio/video data in a unified format; and the unified processing module is also used for acquiring the audio and video data of the hardware interface in real time, and carrying out real-time coding according to the designated parameters to obtain the audio and video data in a unified format.

Optionally, the monitoring video conversion gateway further comprises a multi-picture splicing module, a media service module and a video recording service module, wherein the multi-picture splicing module is used for splicing pictures of multiple paths of audio and video data to obtain spliced pictures, transmitting the spliced pictures to the image leakage tracing module, or encoding the spliced pictures according to specified parameters and transmitting the encoded spliced pictures to the media service module and/or the video recording service module, wherein the multiple paths of audio and video data are audio and video data with preset paths in the audio and video data of the security monitoring equipment or the security monitoring system; the image leakage tracing module is also used for embedding invisible and unique watermark information into the spliced picture and outputting the spliced picture embedded with the watermark information to a display screen.

Optionally, the watermark information includes a local gateway number and time information.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the monitoring video conversion gateway can be connected to security monitoring equipment or security monitoring systems adopting different types of protocols, so that the difficulty in integrating a plurality of different security monitoring systems or security monitoring equipment is reduced; the gateway can also register with other monitoring video conversion gateways, so that the gateway can conveniently mutually call the audio and video data of the other party with the other monitoring video conversion gateways, and the requirement that the video and audio contents of other areas can be watched or used at any point is met; the gateway can also encode or transcode the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format, so that other monitoring video conversion gateways can conveniently call the audio and video data of the gateway; the gateway can also embed invisible and unique watermark information for the local picture of the audio and video data, so that the problem that sensitive content is randomly shot and leaked can be avoided. Accordingly, the present disclosure addresses a number of technical obstacles or problems that arise in the related art when monitoring remote access and management across areas.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.

FIG. 1 is a block diagram of a surveillance video conversion gateway, shown in accordance with an exemplary embodiment;

fig. 2 is a schematic structural diagram of a surveillance video conversion gateway according to an exemplary embodiment.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The embodiments described in the examples below are not representative of all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It should be noted that, in this disclosure, "at least one of the items" refers to a case where three types of juxtaposition including "any one of the items", "a combination of any of the items", "an entirety of the items" are included. For example, "including at least one of a and B" includes three cases side by side as follows: (1) comprises A; (2) comprising B; (3) includes A and B. For example, "at least one of the first and second steps is executed", that is, three cases are juxtaposed as follows: (1) performing step one; (2) executing the second step; (3) executing the first step and the second step.

At present, the construction mode of regional on-demand is followed in the construction process of the security monitoring system, so that security monitoring systems or security monitoring equipment of different manufacturers can be adopted in different areas, unified planning is lacking, and the differences among the different security monitoring systems or security monitoring equipment can cause a plurality of technical barriers or problems in cross-regional monitoring remote access and management. Such as:

1) Registration connection protocol non-unification

In the security monitoring field, although related institutions have formulated technical requirements for information transmission, exchange and control of public security video monitoring networking systems, namely the GB/T-28181 protocol (hereinafter referred to as GB/T-28181), most security monitoring systems or security monitoring devices are basically interconnected by adopting a private protocol under the consideration of service flexibility or product market policy, so that the security monitoring systems or security monitoring devices integrating a plurality of different protocols are difficult.

2) Supporting only cascading modes

At present, most security monitoring systems are connected in a cascading manner, namely, the lower security monitoring system registers with the upper security monitoring system in a single direction, after the registration is successful and connection is completed, the upper security monitoring system can acquire service information of the lower security monitoring system, such as an audio and video resource catalog, and retrieve audio and video data of the lower security monitoring system according to authorization, but the lower security monitoring system cannot acquire any service information of the upper security monitoring system and retrieve audio and video data. The method is safer and more effective in a strict administrative system, the lower security monitoring system does not acquire the business requirement of the audio and video data of the upper security monitoring system, and the use safety of the audio and video data is indirectly ensured. However, in civil or other fields, such as different fields, the need to acquire scenes of audio and video data from each other, the need of watching or using audio and video contents of other areas at any point cannot be satisfied.

3) Code stream format is various

At present, some special marks are added to the audio and video code streams output by the security monitoring system or the security monitoring equipment on the basis of standard coding encapsulation, so that the processing efficiency of the security monitoring system or the security monitoring equipment is improved, the display time delay is reduced, storage and playback are convenient, and the use experience of a user is greatly improved, therefore, the code streams output by different security monitoring systems or the security monitoring equipment have large differences, the audio and video code streams output by one security monitoring system or the security monitoring equipment can not be normally played, stored or played back in the other security monitoring system or the security monitoring equipment, and after the different security monitoring systems or the security monitoring equipment are interconnected, great barriers exist when audio and video data are used in a cross-system transmission mode.

4) Security of audio-video data

In general, in order to facilitate the on-duty staff to watch the monitoring video content in real time, a large-screen display module is arranged in the security monitoring system, and the security monitoring system can display a plurality of image contents on the large-screen display module in a fixed or carousel mode. The problem of random shooting and random diffusion of image contents by operators on duty is particularly important if sensitive contents which relate to personal privacy and the like and cannot be randomly diffused exist in video contents. Especially, under the condition that a plurality of security monitoring systems are interconnected, the same video or a group of videos can appear on a plurality of large-screen display modules in different areas, and in the era that smart phones supporting shooting functions are so popular, corresponding technical means are urgently needed to solve the problem that sensitive contents are randomly shot and leaked.

In view of the above problems, the present disclosure provides a surveillance video conversion gateway, where the surveillance video conversion gateway may access security monitoring devices or security monitoring systems that use different types of protocols through a device access management module, so that the surveillance video conversion gateway receives audio and video data of the security monitoring devices or security monitoring systems; the interconnection and intercommunication management module and other monitoring video conversion gateways can register with each other, so that the monitoring video conversion gateway and other monitoring video conversion gateways can mutually call audio and video data of the other party; the unified processing module can also encode or transcode the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format, so that other monitoring video conversion gateways can call the audio and video data of the monitoring video conversion gateway; the invisible and unique watermark information can be embedded into the local picture of the audio and video data through the image leakage tracing module, and the picture embedded with the watermark information is output to the display screen, so that a plurality of technical barriers or problems generated during cross-regional monitoring remote access and management in the related art can be solved.

Hereinafter, a surveillance video conversion gateway according to an exemplary embodiment of the present disclosure will be described in detail with reference to the accompanying drawings.

Fig. 1 is a block diagram of a surveillance video conversion gateway according to an exemplary embodiment, where the surveillance video conversion gateway, as shown in fig. 1, includes a device access management module 10, an interconnection and interworking management module 12, a unified processing module 14, and an image leakage tracing module 16, where the device access management module 10 is configured to access security monitoring devices or security monitoring systems that use different types of protocols, so that the surveillance video conversion gateway receives audio and video data of the security monitoring devices or the security monitoring systems; the interconnection and interworking management module 12 is configured to register between the surveillance video conversion gateway and other surveillance video conversion gateways, so that audio and video data of the other party are called between the surveillance video conversion gateway and the other surveillance video conversion gateways; the unified processing module 14 is configured to encode or transcode audio/video data received from the security monitoring device or the security monitoring system according to the specified parameters to obtain audio/video data in a unified format, so that other monitoring video conversion gateways call the audio/video data of the monitoring video conversion gateway; the image leakage tracing module 16 is configured to embed invisible and unique watermark information into a local frame of audio and video data, and output the frame embedded with the watermark information to a display screen.

According to the embodiment, the gateway can be connected to security monitoring equipment or security monitoring systems adopting different types of protocols, so that the difficulty in integrating a plurality of different security monitoring systems or security monitoring equipment is reduced; the gateway can also register with other monitoring video conversion gateways, so that the gateway can conveniently mutually call the audio and video data of the other party with the other monitoring video conversion gateways, and the requirement that the video and audio contents of other areas can be watched or used at any point is met; the gateway can also encode or transcode the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format, so that other monitoring video conversion gateways can conveniently call the audio and video data of the conversion gateway; the gateway can also embed invisible and unique watermark information for the local picture of the audio and video data, so that the problem that sensitive content is randomly shot and leaked can be avoided.

According to an exemplary embodiment of the present disclosure, the device access management module is further configured to receive a registration request of a first security monitoring device or a first security monitoring system that adopts a standard protocol, and register the first security monitoring device or the first security monitoring system to a local area based on the registration request; the device access management module is further configured to set base information of a second security monitoring device or a second security monitoring system that adopts an open protocol or a private protocol locally, initiate a connection request to the second security monitoring device or the second security monitoring system based on the base information, and establish connection with the second security monitoring device or the second security monitoring system. According to the embodiment, for the security monitoring equipment or the security monitoring system adopting the standard protocol, the gateway can be registered so as to be accessed to the gateway, and for the security monitoring equipment or the security monitoring system adopting the open protocol or the private protocol, the basic information of the security monitoring equipment or the security monitoring system can be locally set in the gateway, and the gateway is accessed in a mode of initiating a connection request and establishing connection to the gateway, so that the gateway can conveniently and rapidly access the security monitoring equipment or the security monitoring system adopting different types of protocols, and the difficulty in integrating a plurality of different security monitoring systems or security monitoring equipment is reduced.

The standard protocol is a GB/T28181 standard protocol, and the disclosure is not limited to this; the open protocol may be a protocol created by an open network video interface forum (Open Network Video Interface Forum, abbreviated as ONVIF), which is not limited in this disclosure; the private protocol may be a protocol unique to any vendor, and the disclosure is not limited in this respect.

As an example, the above device access management module supports the security monitoring device or the security monitoring system to access to the present monitoring video conversion gateway in the GB/T28181 standard protocol, and after successful access, the present monitoring video conversion gateway may retrieve the audio/video data of the security monitoring device or the security monitoring system through the standard interface. Specifically, the security monitoring equipment or the security monitoring system conforming to the GB/T28181 protocol initiates a registration request to the equipment access management module, the equipment access management module performs authorization verification on the registration request, and when the verification result is legal, the security monitoring equipment or the security monitoring system conforming to the GB/T28181 protocol is registered in the monitoring video conversion gateway; when the verification result is illegal, the monitoring video conversion gateway refuses to register the security monitoring equipment or the security monitoring system which accords with the GB/T28181 protocol. After the registration is successful, the monitoring video conversion gateway can retrieve the audio and video data of the security monitoring equipment or the security monitoring system through the standard interface.

As an example, the above-mentioned device access management module supports the access of the security monitoring device or the security monitoring system to the present monitoring video conversion gateway by the ONVIF protocol, and after successful access, the present monitoring video conversion gateway can retrieve the audio/video data of the security monitoring device or the security monitoring system through the corresponding interface of the ONVIF protocol. Specifically, basic information of security monitoring equipment or security monitoring system conforming to ONVIF protocol can be set on a page of the monitoring video conversion gateway system, the basic information can include but is not limited to equipment IP, a communication port, an access user name, an access password and the like, after the basic information is set, the equipment access management module can initiate a connection request to the corresponding security monitoring equipment or security monitoring system based on the basic information, and the monitoring video conversion gateway establishes connection with the corresponding security monitoring equipment or security monitoring system under the condition that the corresponding security monitoring equipment or security monitoring system agrees to connect. After successful connection, the monitoring video conversion gateway can retrieve audio and video data of the security monitoring equipment or the security monitoring system through the corresponding interface.

As an example, the above-mentioned device access management module supports the security monitoring device or the security monitoring system to access to the present surveillance video conversion gateway in a private protocol, and after successful access, the present surveillance video conversion gateway may retrieve the audio/video data of the security monitoring device or the security monitoring system through the corresponding interface of the private protocol. Specifically, basic information of security monitoring equipment or security monitoring system conforming to private protocol can be set on a page of the monitoring video conversion gateway system, the basic information can include but is not limited to equipment IP, a communication port, an access user name, an access password and the like, after the basic information is set, the equipment access management module can initiate a connection request to the corresponding security monitoring equipment or security monitoring system based on the basic information, and the monitoring video conversion gateway establishes connection with the corresponding security monitoring equipment or security monitoring system under the condition that the corresponding security monitoring equipment or security monitoring system agrees to connect. After successful connection, the monitoring video conversion gateway can retrieve audio and video data of the security monitoring equipment or the security monitoring system through the corresponding interface.

It should be noted that, the above device access management module may also establish a connection with the security monitoring device or the security monitoring system through a private interface provided by a manufacturer and a software development kit (Software Development Kit, abbreviated as SDK), which is not limited in this disclosure.

According to an exemplary embodiment of the present disclosure, the device access management module is further configured to obtain an audio and video resource directory of the first security monitoring device, the first security monitoring system, the second security monitoring device, or the second security monitoring system and store the audio and video resource directory in a local database when the first security monitoring device or the first security monitoring system is registered locally and a connection is established with the second security monitoring device or the second security monitoring system, where the audio and video resource directory includes an audio and video source address, a security monitoring device identifier, and an online state of the security monitoring device. According to the embodiment, after the security monitoring device or the security monitoring system is accessed to the gateway, the audio/video resource catalog of the security monitoring device or the security monitoring system can be acquired, so that corresponding audio/video data can be acquired based on the audio/video resource catalog.

The audio and video resource catalog not only comprises an audio and video source address, a security monitoring device identifier and the on-line state of the security monitoring device, but also can comprise other related information of audio and video data, and the disclosure is not limited to the above.

As an example, for a security monitoring device or a security monitoring system accessed through a GB/T28181 standard protocol, the present monitoring video conversion gateway may obtain an audio/video resource directory of the security monitoring device or the security monitoring system through a standard interface, and store the audio/video resource directory into a local database, so as to complete aggregation of the audio/video resource directory.

As an example, for a security monitoring device or a security monitoring system accessed through an open protocol, the present monitoring video conversion gateway obtains an audio/video resource directory of the security monitoring device or the security monitoring system through a corresponding protocol interface, and stores the audio/video resource directory into a local database, thereby completing aggregation of the audio/video resource directory.

It should be noted that, if the device access management module cannot establish connection with the security monitoring device or the security monitoring system, information such as an audio and video resource catalog of the security monitoring device or the security monitoring system can also be manually input, so that corresponding audio and video data of the security monitoring device or the security monitoring system can be conveniently acquired subsequently.

According to an exemplary embodiment of the present disclosure, the device access management module is further configured to receive a first notification message that an audio and video resource directory of a first security monitoring device or a first security monitoring system changes, obtain the changed audio and video resource directory based on the first notification message, and update a local database; the device access management module is further configured to periodically obtain an audio/video resource directory of the second security monitoring device or the second security monitoring system, and update the local database if the obtained audio/video resource directory is inconsistent with a corresponding audio/video resource directory in the local database. According to the embodiment, when the audio and video resource catalogue is changed, security monitoring equipment or a security monitoring system adopting a standard protocol can autonomously inform the gateway to remind the gateway of acquiring the changed audio and video resource catalogue and updating a local database; and security monitoring equipment or a security monitoring system adopting an open protocol or a private protocol is needed to periodically check whether the audio and video resource catalogue on the security monitoring equipment or the security monitoring system changes, if the audio and video resource catalogue on the security monitoring equipment or the security monitoring system is found to change, the changed audio and video resource catalogue can be obtained and the local database is updated.

As an example, for the security monitoring device or the security monitoring system accessed through the GB/T28181 standard protocol, when the audio/video resource directory of the security monitoring device or the security monitoring system changes, the device access management module may actively notify the monitoring video conversion gateway, after receiving the notification information, the monitoring video conversion gateway may reacquire the audio/video resource directory of the security monitoring device or the security monitoring system, and update the local database according to the newly acquired audio/video resource directory, so as to ensure consistency with the audio/video resource directory of the security monitoring device or the security monitoring system.

As an example, for the security monitoring device or the security monitoring system accessed through the open protocol, the monitoring video conversion gateway can periodically obtain the audio/video resource directory of the security monitoring device or the security monitoring system through the protocol interface, compare the audio/video resource directory with the historical audio/video resource directory in the local database, and if the comparison result is inconsistent, indicate that the audio/video resource directory of the security monitoring device or the security monitoring system changes, update the local database based on the latest obtained audio/video resource directory, so as to ensure consistency with the audio/video resource directory of the security monitoring device or the security monitoring system.

According to an exemplary embodiment of the present disclosure, the interconnection management module is further configured to locally set gateway information of other monitoring video conversion gateways to be registered, and send a registration request to the other monitoring video conversion gateways based on the gateway information, so that the other monitoring video conversion gateways call required audio and video data from the monitoring video conversion gateway when the other monitoring video conversion gateways are successfully registered; the interconnection management module is further configured to receive a registration request sent by another monitoring video conversion gateway, register the other monitoring video conversion gateway to a local area based on the registration request, so that the monitoring video conversion gateway calls the required audio/video data from the other monitoring video conversion gateway. According to the embodiment, the gateway can send registration requests to other monitoring video conversion gateways, the other monitoring video conversion gateways can also send registration requests to the gateway, after the registration of the monitoring video conversion gateways is successful, the own audio and video data can be shared, so that the monitoring video conversion gateways are mutually registered without clear upper and lower relationships, and thus after the monitoring video conversion gateways are mutually connected, a user can check the audio and video data of any other area at any service node, and the security monitoring video management efficiency is improved.

As an example, the present surveillance video conversion gateway may be used as a lower level, set gateway information such as service IP, service port, service ID, authentication ID, registration password, etc. of other surveillance video conversion gateways on its own management page, and actively initiate a registration request to other surveillance video conversion gateways (upper level) based on the gateway information, and after receiving the registration request, the other surveillance video conversion gateways perform authorization verification on the registration request, if the verification result is legal, the other surveillance video conversion gateways may perform registration operation on the present surveillance video conversion gateway, and if the verification result is illegal, the other surveillance video conversion gateways may refuse to register the present surveillance video conversion gateway. After the monitoring video conversion gateway successfully registers with other monitoring video conversion gateways, the other monitoring video conversion gateways can call the audio and video data of the monitoring video conversion gateway through corresponding interfaces, specifically, the other monitoring video conversion gateways can call the required audio and video data from the media service of the monitoring video conversion gateway through own media service, and the monitoring video conversion gateway is not limited in this disclosure. The service IP is an IP that performs interconnection registration with other monitoring video conversion gateways, the service ID is an ID of the other monitoring video conversion gateways, and the authentication ID is a security authentication string between the gateways.

As an example, the present surveillance video conversion gateway may also be used as an upper stage, receive a registration request initiated by another surveillance video conversion gateway (lower stage), and perform authorization verification on the registration request after the present surveillance video conversion gateway receives the registration request, if the verification result is legal, the present surveillance video conversion gateway may perform registration operation on another surveillance video conversion gateway, and if the verification result is illegal, the present surveillance video conversion gateway may refuse to register another surveillance video conversion gateway. After other monitoring video conversion gateways are successfully registered to the monitoring video conversion gateway, the monitoring video conversion gateway can call audio and video data of the other monitoring video conversion gateways through corresponding interfaces, specifically, the monitoring video conversion gateway can call required audio and video data from media services of the other monitoring video conversion gateways through own media services, and the monitoring video conversion gateway is not limited in this disclosure. It should be noted that, other monitoring video conversion gateways may set gateway information such as service IP, service port, service ID, authentication ID, and registration password of the monitoring video conversion gateway on their own management page, and actively initiate a registration request to the monitoring video conversion gateway based on the gateway information.

According to an exemplary embodiment of the present disclosure, the interconnection management module sends a local audio and video resource directory to other monitoring video conversion gateways under the condition of successful registration to the other monitoring video conversion gateways, so that when the present monitoring video conversion gateway receives an acquisition request of the other monitoring video conversion gateway, audio and video data corresponding to an audio and video source address in the acquisition request is sent to the other monitoring video conversion gateway; the interconnection management module acquires the audio and video resource catalogs of other monitoring video conversion gateways and stores the audio and video resource catalogs into a local database under the condition that the other monitoring video conversion gateways are registered locally, so that when the monitoring video conversion gateway sends an acquisition request to the other monitoring video conversion gateways, audio and video data corresponding to an audio and video source address in the acquisition request are acquired from the other monitoring video conversion gateways. According to the embodiment, after the monitoring video conversion gateway is interconnected with other monitoring video conversion gateways, audio and video resource directories of each other can be obtained, so that corresponding audio and video data can be obtained based on the audio and video resource directories.

As an example, after the present surveillance video conversion gateway successfully registers with other surveillance video conversion gateways, local audio and video resource directories may be sent to other surveillance video conversion gateways, where the other surveillance video conversion gateways may store the audio and video resource directories of the present surveillance video conversion gateway to their own local databases, so as to complete aggregation of the audio and video resource directories. At this time, when other monitoring video conversion gateways need to acquire part of the audio and video data of the monitoring video conversion gateway, an acquisition request can be sent to the monitoring video conversion gateway, so that the monitoring video conversion gateway can send corresponding audio and video data to other monitoring video conversion gateways according to the audio and video source address in the acquisition request.

As an example, after the other monitoring video conversion gateways are successfully registered in the monitoring video conversion gateway, the audio and video resource catalogs sent by the other monitoring video conversion gateways can be received, and the audio and video resource catalogs are stored in the local database of the monitoring video conversion gateway, so that the convergence of the audio and video resource catalogs is completed. At this time, when the monitoring video conversion gateway needs to acquire part of the audio/video data of other monitoring video conversion gateways, an acquisition request can be sent to the other monitoring video conversion gateways, so that the other monitoring video conversion gateways can send corresponding audio/video data to the monitoring video conversion gateway according to the audio/video source address in the acquisition request.

It should be noted that, the above-mentioned obtaining request may further include a security monitoring device identifier, an online state of the security monitoring device, etc. to facilitate obtaining corresponding audio and video data, which is not limited in this disclosure. And the upper monitoring video conversion gateway can also send a subscription message to the lower monitoring video conversion gateway, and after successful subscription, the lower monitoring video conversion gateway can actively push the audio and video resource catalogue to the upper monitoring video conversion gateway, which is not limited in this disclosure. In addition, the above-mentioned superior surveillance video conversion gateway may also control controllable devices in the inferior surveillance video conversion gateway according to needs, such as a control device cradle head, a set device parameter, etc., which is not limited in this disclosure.

According to an exemplary embodiment of the present disclosure, in a case where a local audio/video resource directory is changed, the interconnection management module is further configured to send a second notification message to another monitoring video conversion gateway, and in a case where an acquisition request of the other monitoring video conversion gateway is received, send the local changed audio/video resource directory to the other monitoring video conversion gateway; the interconnection management module is further configured to receive a second notification message of the other monitoring video conversion gateway, and obtain an audio/video resource directory after the change of the other monitoring video conversion gateway and update the local database based on the second notification message. According to the embodiment, when the audio and video resource catalogs are changed, the audio and video resource catalogs can be independently notified, and the audio and video resource catalogs after the change are reminded of being acquired and the local databases of the audio and video resource catalogs are updated.

As an example, under the condition that the local audio/video resource directory is changed, the monitoring video conversion gateway may send a second notification message to other monitoring video conversion gateways, and after receiving the second notification message, the other monitoring video conversion gateways may send an acquisition request to the monitoring video conversion gateway, where the monitoring video conversion gateway may send the local changed audio/video resource directory to the other monitoring video conversion gateways, and the other monitoring video conversion gateways update the local database based on the latest acquired audio/video resource directory to ensure that the audio/video resource directory is consistent with the audio/video resource directory of the monitoring video conversion gateway.

As an example, under the condition that the audio/video resource catalogue of the other monitoring video conversion gateway sends a change, the second notification message of the monitoring video conversion gateway can be also sent to the other monitoring video conversion gateway, after the monitoring video conversion gateway receives the second notification message, the acquisition request can be sent to the other monitoring video conversion gateway based on the second notification message, at this time, the other monitoring video conversion gateway can send the changed audio/video resource catalogue to the monitoring video conversion gateway, and the monitoring video conversion gateway updates the local database based on the latest acquired audio/video resource catalogue to ensure to be consistent with the audio/video resource catalogue of the other monitoring video conversion gateway.

According to an exemplary embodiment of the present disclosure, the above unified processing module is further configured to transcode audio and video data obtained through network transmission according to specified parameters to obtain audio and video data in a unified format; the unified processing module is also used for encoding the audio and video data acquired through the hardware interface according to the specified parameters to obtain audio and video data in a unified format. According to the embodiment, for the audio and video acquired through network transmission, the gateway can transcode according to the specified parameters, and for the audio and video data acquired by the hardware interface, the gateway can encode according to the specified parameters, so that all acquired audio and video can be converted into a unified format, and other monitoring video conversion gateways can conveniently call local audio and video data.

The above specified parameters may be set as needed, and the disclosure is not limited thereto; the unified format may be set as needed, and the present disclosure is not limited thereto.

According to an exemplary embodiment of the present disclosure, the above unified processing module is further configured to obtain an audio/video source address from a local database, obtain required audio/video data in real time from an audio/video source corresponding to the audio/video source address, and perform real-time transcoding according to specified parameters, so as to obtain audio/video data in a unified format; the unified processing module is also used for collecting the audio and video data of the hardware interface in real time and carrying out real-time coding according to the appointed parameters to obtain the audio and video data in a unified format. According to the embodiment, the unified processing module can acquire the required audio and video data in real time according to the audio and video source address and the hardware interface, and the audio and video data is encoded or transcoded in real time, so that the processing efficiency can be improved, and the audio and video data in a unified format can be obtained quickly.

As an example, according to service requirements, the monitoring video conversion gateway may transmit an audio/video source address of the local database to the unified processing module, and when the audio/video data is required to be used, the unified processing module sends an audio/video acquisition request to an audio/video source corresponding to the audio/video source address of the required audio/video data, acquires the required audio/video data in real time, and transcodes the acquired audio/video data in real time according to the transcoding configuration parameters (i.e. the specified parameters), so as to obtain audio/video data in a unified format.

As an example, the unified processing module may also collect audio and video data of a hardware interface (such as HDMI, SDI, etc.) in real time according to service requirements, and encode the collected audio and video data in real time according to an encoding configuration parameter (i.e. the above specified parameter), so as to obtain audio and video data in a unified format. The HDMI, i.e., the high-definition multimedia interface (High Definition Multimedia Interface); SDI, digital component serial interface (serial digital interface).

After transcoding or encoding, the unified processing module can forward the transcoded or encoded audio and video data to the media service module, so that when the client needs to watch in real time, the real-time checking module sends an audio and video acquisition request to the media service module according to the need, and acquires the audio and video data in a unified format in real time for checking; the unified processing module can also forward the transcoded or encoded audio and video data to the recording service module, so that when the client needs to review video, the video review module sends an audio and video acquisition request to the video service module according to the need, and acquires audio and video data in a unified format to review video. It should be noted that, the media service module is a streaming media service, which is an independent service, supports the input and output of audio and video streams with different protocols and different formats, and completes the functions of audio and video protocol conversion.

According to an exemplary embodiment of the present disclosure, the monitoring video conversion gateway further includes a multi-picture splicing module, where the multi-picture splicing module is configured to splice pictures of multiple paths of audio and video data to obtain a spliced picture, and transmit the spliced picture to the image leakage tracing module, or encode the spliced picture according to specified parameters and transmit the encoded spliced picture to the media service module or the video service module, where the multiple paths of audio and video data are audio and video data of a predetermined number of paths in the audio and video data of the security monitoring device or the security monitoring system; the image leakage tracing module is also used for embedding invisible and unique watermark information into the spliced picture and outputting the spliced picture embedded with the watermark information to a display screen. According to the embodiment, the gateway can decode the received multiple image code streams and splice the received multiple image code streams into the same picture, the pictures can be combined randomly and reasonably, the user can conveniently check the pictures and remotely transmit the coded pictures to other sites, and the inter-domain network bandwidth resource occupation can be reduced while a group of relevance service images are transmitted to a far end at one time.

As an example, according to service requirements, the monitoring video conversion gateway may transmit an audio/video source address of the local database to the multi-picture splicing module, and when audio/video data is required to be used, the multi-picture splicing module sends an audio/video acquisition request to an audio/video source corresponding to the audio/video source address of the required audio/video data, acquires multiple paths of audio/video data in real time, decodes the acquired picture data of the multiple paths of audio/video data in real time at the same time, and splices multiple pictures as required, where the audio data of one path of audio/video data may be selected to be decoded as required. Then, the multi-picture splicing module can send the spliced new picture to the image leakage tracing module, the image leakage tracing module embeds watermark information into the new picture, outputs the new picture embedded with the watermark information to a display screen through interfaces such as SDI, HDMI and the like, and outputs decoded audio data through a Ka-Nongkou and a 3.5mm audio interface.

As an example, the multi-picture splicing module may further perform secondary encoding on the spliced new picture and the decoded audio data according to the specified parameters, and transmit the encoded audio and video data to the media service module or the video service module, so that other monitoring video conversion gateways, real-time viewing modules, video review modules and the like acquire audio and video data in a unified format to perform real-time viewing or review as required.

According to an exemplary embodiment of the present disclosure, the watermark information may include a local gateway number and time information. According to the embodiment, the purpose of unique identification can be conveniently realized through the local gateway number and the time information.

The watermark information may be a digital watermark or other watermarks, and the present disclosure is not limited thereto. The watermark information may include the local gateway number and time information, or may include other information capable of uniquely identifying the gateway, which is not limited to this disclosure.

As an example, after the multi-picture splicing module sends the spliced new picture to the image leakage tracing module, the image leakage tracing module combines the data such as the equipment number and the time information in real time, embeds the data into the new picture, and outputs the new picture embedded with watermark information to a display screen through interfaces such as the SDI and the HDMI, so that after a video viewer illicitly shoots a screen video, the video viewer extracts the watermark from the leaked pirated video, and obtains the equipment number and the time information so as to trace the leakage place (namely, which gateway audio and video data is leaked) and time of the image data.

For convenience of understanding the disclosure, in the following description with reference to the system of fig. 2, fig. 2 is a schematic structural diagram of a surveillance video conversion gateway according to an exemplary embodiment, and as shown in fig. 2, the surveillance video conversion gateway may adopt a Browser/Server (abbreviated as B/S) structure and may be divided into a front-end application and a back-end service, where a front-end application layer may include main modules such as real-time monitoring, video review, system management, and the like; the back-end service layer can comprise a main module such as a device access management module, interconnection and intercommunication management, unified coding/transcoding service (i.e. unified processing module), multi-picture splicing service (i.e. multi-picture splicing module), image leakage tracing, media service, video task scheduling, system log management and the like. It should be noted that, the modules included in the surveillance video conversion gateway may be added or subtracted as needed, which is not limited in this disclosure.

The following describes a core module in the surveillance video conversion gateway:

1) Equipment access management module

And the GB/T28181 protocol, the ONVIF protocol and the manufacturer private protocol are supported to be accessed into security monitoring equipment or a security monitoring system. Specifically, supporting the security monitoring equipment or the security monitoring system to actively register to the monitoring video conversion gateway according to a GB/T28181 standard protocol, obtaining an audio and video resource catalog (such as information of a network video recorder (Network Video Recorder, abbreviated as NVR)) of the security monitoring equipment or the security monitoring system through resource authorization and a standard interface, and retrieving audio and video data of the security monitoring equipment or the security monitoring system; the security monitoring equipment or the security monitoring system is supported to be connected to the monitoring video conversion network in a mode of non-GB/T28181 standard protocol, such as ONVIF protocol, private protocol, interface or SDK provided by manufacturers, and the like. Acquiring an audio and video resource catalog of the security monitoring equipment or the security monitoring system according to a private protocol, an interface, an SDK or the like, and retrieving audio and video data of the security monitoring equipment or the security monitoring system; the method supports the conversion of a non-GB/T28181 standard protocol adopted by security monitoring equipment or a security monitoring system into a GB/T28181 standard protocol. The audio and video resource catalog may include, but is not limited to: a security monitoring device identification list, an audio and video source address, a security monitoring device running state and the like.

2) Interconnection and intercommunication management module

The plurality of gateways are supported to register with each other so as to be interconnected, and the interconnected gateways have no clear upper-lower relationship. After the gateways are interconnected, a user can check video and audio contents of any other area at any service node, and the security monitoring video management efficiency is improved.

3) Unified coding/transcoding service module (i.e. unified processing module)

And supports various types of audio and video code stream transmission protocols, including but not limited to security national standard stream, real-time stream transmission protocol (Real Time Streaming Protocol, abbreviated as RTSP), hypertext transmission protocol (Hypertext Transfer Protocol, abbreviated as HTTP) and other protocol code streams, so as to complete the convergence of the audio and video code streams of a plurality of security monitoring systems or security monitoring devices. In the convergence process, the monitoring video conversion gateway supports unified transcoding of real-time code streams, namely normalization of different types of audio and video code streams is completed according to user configuration parameters.

The method comprises the steps of supporting the encoding of original audio and video signals output by terminal equipment (including but not limited to video conference terminals, video matrixes, personal Computers (PCs) and the like) according to specified parameters, namely supporting the real-time acquisition of the original audio and video signals output by hardware interfaces and encoding according to the specified parameters.

4) Multi-picture splicing service module (i.e. multi-picture splicing module)

And supporting the splicing of a plurality of input image code streams into the same picture after decoding, obtaining a spliced picture, and outputting the spliced picture outside the physical screen through interfaces such as SDI, HDMI and the like. It should be noted that, a plurality of pictures can be combined arbitrarily and reasonably and support the subtitle superimposition function.

The method supports secondary coding of the spliced picture and outputs the spliced picture in a network flow mode, a user can directly watch the spliced picture in real time through a client, and the coded spliced picture can be remotely transmitted to other sites, so that a group of relevance service images are transmitted to a far end at one time and the occupation of network bandwidth resources among domains is reduced.

5) Image leakage tracing service

The invisible and uniquely identified digital watermark information is embedded in the spliced picture, and the subjective vision of the image picture is invisible after the watermark information is embedded. The watermark information may be recorded in the leaked video and have a certain robustness when illegal recording occurs.

It should be noted that, the monitoring video conversion gateway of the present disclosure may also support a system management function, so that users can efficiently, conveniently and visually complete the necessary management functions of checking audio and video data, adding management of a security monitoring system or security monitoring device of a non-standard protocol, registering and authorizing management of an upper cloud platform or a service system, and the like. For example, the system management module can support functions of user roles, image equipment, video tasks, real-time image viewing, video inquiry and review, system logs, system operation and maintenance and the like, and local autonomy of security and protection service is realized.

The logical relationship of the modules in the audio and video processing service in the surveillance video conversion gateway shown in fig. 2 may be as follows: the audio and video data in the security monitoring equipment and the security monitoring system can be transcoded through the unified transcoding module to obtain audio and video data in a unified format, and the audio and video data of the real-time acquisition hardware interface can be encoded through the unified encoding module to obtain the audio and video data in the unified format. After the coding and transcoding are completed, the audio and video data in a unified format can be forwarded to a recording service module or a media service module, so that the client can watch in real time or look back the video. The pictures of the audio and video data in the security monitoring equipment and the security monitoring system can be spliced by the multi-picture splicing module, and after secondary encoding, the audio and video data in a unified format can be obtained, and the audio and video data in the unified format can be forwarded to the recording service module or the media service module so that the client can watch in real time or look back through video, and the spliced pictures can be directly output to the display screen for clients to watch without encoding. If different gateways are required to be interconnected, the audio and video data of each other can be mutually called, and the audio and video data of the other party can be mutually called through the respective media service modules. It should be noted that the above logical relationship is only an example, and the disclosure is not limited thereto.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (11)

1. The monitoring video conversion gateway is characterized by comprising a device access management module, an interconnection management module, a unified processing module and an image leakage tracing module, wherein,

the equipment access management module is used for accessing security monitoring equipment or a security monitoring system adopting different types of protocols so that the monitoring video conversion gateway receives audio and video data of the security monitoring equipment or the security monitoring system;

The interconnection management module is used for registering with other monitoring video conversion gateways so that the monitoring video conversion gateway and the other monitoring video conversion gateways call audio and video data of the other party with each other;

the unified processing module is used for encoding or transcoding the audio and video data received from the security monitoring equipment or the security monitoring system according to the appointed parameters to obtain audio and video data in a unified format so that the other monitoring video conversion gateways can call the audio and video data of the monitoring video conversion gateway;

the image leakage tracing module is used for embedding invisible and unique watermark information into a picture of local audio and video data and outputting the picture embedded with the watermark information to a display screen.

2. The surveillance video conversion gateway of claim 1,

the device access management module is further configured to receive a registration request of a first security monitoring device or a first security monitoring system that adopts a standard protocol, and register the first security monitoring device or the first security monitoring system to a local area based on the registration request;

the device access management module is further configured to set base information of a second security monitoring device or a second security monitoring system that adopts an open protocol or a private protocol locally, initiate a connection request to the second security monitoring device or the second security monitoring system based on the base information, and establish a connection with the second security monitoring device or the second security monitoring system.

3. The surveillance video conversion gateway of claim 2,

the device access management module is further configured to obtain an audio and video resource directory of the first security monitoring device, the first security monitoring system, the second security monitoring device or the second security monitoring system and store the audio and video resource directory in a local database when the first security monitoring device or the first security monitoring system is registered locally and a connection is established with the second security monitoring device or the second security monitoring system, where the audio and video resource directory includes an audio and video source address, a security monitoring device identifier and an online state of the security monitoring device.

4. The surveillance video conversion gateway of claim 3,

the device access management module is further configured to receive a first notification message that the audio and video resource catalog of the first security monitoring device or the first security monitoring system changes, obtain the changed audio and video resource catalog based on the first notification message, and update the local database;

the device access management module is further configured to periodically obtain an audio/video resource directory of the second security monitoring device or the second security monitoring system, and update the local database if the obtained audio/video resource directory is inconsistent with a corresponding audio/video resource directory in the local database.

5. The surveillance video conversion gateway of claim 1,

the interconnection management module is further configured to locally set gateway information of other monitoring video conversion gateways to be registered, and send a registration request to the other monitoring video conversion gateways based on the gateway information, so that the other monitoring video conversion gateways call required audio and video data from the monitoring video conversion gateways under the condition of successfully registering to the other monitoring video conversion gateways;

the interconnection management module is further configured to receive a registration request sent by the other surveillance video conversion gateway, and register the other surveillance video conversion gateway to a local location based on the registration request, so that the surveillance video conversion gateway invokes the required audio/video data from the other surveillance video conversion gateway.

6. The surveillance video conversion gateway of claim 5,

the interconnection management module sends a local audio and video resource catalog to the other monitoring video conversion gateway under the condition of successfully registering the other monitoring video conversion gateway, so that when the monitoring video conversion gateway receives an acquisition request of the other monitoring video conversion gateway, the monitoring video conversion gateway sends audio and video data corresponding to an audio and video source address in the acquisition request to the other monitoring video conversion gateway;

And the interconnection management module acquires the audio and video resource catalogs of the other monitoring video conversion gateways and stores the audio and video resource catalogs into a local database under the condition that the other monitoring video conversion gateways are registered locally, so that when the monitoring video conversion gateway sends an acquisition request to the other monitoring video conversion gateways, the audio and video data corresponding to the audio and video source address in the acquisition request are acquired from the other monitoring video conversion gateways.

7. The surveillance video conversion gateway of claim 6,

the interconnection management module is further configured to send a second notification message to the other monitoring video conversion gateway when the local audio/video resource directory is changed, and send the local changed audio/video resource directory to the other monitoring video conversion gateway when the acquisition request of the other monitoring video conversion gateway is received;

the interconnection management module is further configured to receive a second notification message of the other monitoring video conversion gateway, and obtain an audio and video resource directory after the change of the other monitoring video conversion gateway and update the local database based on the second notification message.

8. The surveillance video conversion gateway of claim 1,

the unified processing module is also used for transcoding the audio and video data acquired through network transmission according to the specified parameters to obtain audio and video data in a unified format;

and the unified processing module is also used for encoding the audio and video data acquired through the hardware interface according to the specified parameters to obtain audio and video data in a unified format.

9. The surveillance video conversion gateway of claim 8,

the unified processing module is also used for acquiring an audio and video source address from a local database, acquiring required audio and video data from an audio and video source corresponding to the audio and video source address in real time, and performing real-time transcoding according to the specified parameters to obtain audio and video data in a unified format;

the unified processing module is also used for collecting the audio and video data of the hardware interface in real time and carrying out real-time coding according to the appointed parameters to obtain the audio and video data in a unified format.

10. The surveillance video conversion gateway of claim 1 further comprising a multi-picture stitching module, a media service module and a video service module wherein,

The multi-picture splicing module is used for splicing pictures of multiple paths of audio and video data to obtain spliced pictures, transmitting the spliced pictures to the image leakage tracing module, or encoding the spliced pictures according to the appointed parameters and transmitting the encoded pictures to the media service module and/or the video service module, wherein the multiple paths of audio and video data are audio and video data of a preset number of paths in the audio and video data of the security monitoring equipment or the security monitoring system;

the image leakage tracing module is further used for embedding invisible and unique watermark information into the spliced picture and outputting the spliced picture embedded with the watermark information to a display screen.

11. The surveillance video conversion gateway according to any of claims 1 to 10, wherein the watermark information comprises local gateway number and time information.