WO2014056171A1

WO2014056171A1 - Method, apparatus and system for implementing video occlusion

Info

Publication number: WO2014056171A1
Application number: PCT/CN2012/082784
Authority: WO
Inventors: 宋端陵; 王峰
Original assignee: 华为技术有限公司
Priority date: 2012-10-11
Filing date: 2012-10-11
Publication date: 2014-04-17
Also published as: EP2741237A1; EP2741237A4; EP2741237B1; CN103890783A; CN103890783B

Abstract

Disclosed are a method, an apparatus and a system for implementing video occlusion. The method comprises: a monitoring platform receiving video requests from monitoring terminals, and determining permission of users of the monitoring terminals; according to a determination result, sending only non-occluded video data to monitoring terminals of users without permission to obtain occluded video data; and sending the occluded video data and the non-occluded video data to monitoring terminals of users with permission to obtain part of or all the occluded video data so that the occluded video data and the non-occluded video data are played in a combined way, or sending video data that combines the occluded video data and the non-occluded video data, solving a security risk problem in prior art caused by sending image data of an occluded part to terminals of users with different permission.

Description

Method, device and system for realizing video occlusion

Embodiments of the present invention relate to the field of video surveillance, and more particularly, to a method, apparatus, and system for implementing video occlusion.

Background technique

In the field of video surveillance, there is a need to protect personal privacy. The video image of a part of the area captured by the camera needs to be occluded, so that the video picture seen by the ordinary user does not include the image of the occlusion part, and the image of the occlusion part can only be used by the advanced authority user. View.

In the prior art, the image data of the occlusion portion of the video is encrypted, and the processed video is sent to the monitoring terminal, and the authorized user can decrypt the image data of the occlusion portion of the received video to see To the full video, the unprivileged user cannot see the image of the occluded part. However, in this prior art, the terminal of the unprivileged user can also obtain the image data of the occlusion part if the abnormality is used. When some data is decrypted, the image data of the occlusion portion can be seen, thereby causing a security risk.

SUMMARY OF THE INVENTION The embodiments of the present invention provide a method, an apparatus, and a system for implementing video occlusion, which are used to solve the security problem caused by transmitting image data of an occlusion portion to terminals of users with different rights in the prior art.

In a first aspect, a method for implementing video occlusion is provided, the method comprising:

The monitoring platform receives the video request sent by the first monitoring terminal, where the video request includes the device identifier, and the video data of the monitoring front-end device identified by the device identifier includes the non-occlusion video data corresponding to the non-occlusion area and the occlusion video of the corresponding occlusion area. Data

The monitoring platform determines whether the user of the first monitoring terminal has the right to obtain the first occlusion video data in the occlusion video data, where the first occlusion video data corresponds to the first occlusion region, and the first occlusion region Include some or all of the occlusion regions; If the determination result is yes, acquiring the first occlusion video data and the non-occlusion video data, sending the first occlusion video data and the non-occlusion video data to the first monitoring terminal, so that the first monitoring terminal merges the playback station Decoding the first occlusion video data and the non-occlusion video data; or combining the acquired first occlusion video data and the non-occlusion video data to obtain combined video data, and transmitting the combined video data Giving the first monitoring terminal;

If the judgment result is no, the non-occlusion video data is acquired and sent to the first monitoring terminal.

In a first possible implementation manner of the first aspect, the receiving, by the first monitoring terminal, the video request includes:

Receiving an occlusion area setting request sent by the second monitoring terminal, where the occlusion area setting request includes a device identifier of the monitoring front end device and description information of the occlusion area;

Transmitting the description information of the occlusion area to the monitoring front-end device, and receiving the non-occlusion video data and the occlusion video data generated by the monitoring front-end device according to the description information of the occlusion area; or The description information of the occlusion area is separated from the complete video data received from the monitoring front-end device by the occlusion video data and the non-occlusion video data.

In a second possible implementation manner of the first aspect, the obtaining, before the acquiring the first occlusion video data and the non-occlusion video data, includes:

Storing the occlusion video data into an occlusion video file, storing the non-occlusion video data into a non-occlusion video file, the occlusion video file including one or more video files, and establishing the occlusion video file and the Declaring the association relationship of non-occlusion video files;

The video request includes a viewing time;

The acquiring the non-occlusion video data specifically includes: acquiring video data corresponding to the viewing time in the non-occlusion video file;

The acquiring the first occlusion video data specifically includes: acquiring one or more video files corresponding to the first occlusion region associated with the non-occlusion video file according to the association relationship, and acquiring corresponding to the first occlusion region Video data corresponding to the viewing time in one or more video files.

In conjunction with the second possible implementation of the first aspect, in a third possible implementation, The establishing the association relationship between the occlusion video file and the non-occlusion video file includes: recording a non-occlusion recording index and an occlusion recording index, where the non-occlusion recording index includes a device identifier of the monitoring front end device, a video start and end time, The non-occlusion video data indication information and the identifier of the non-occlusion video file, the occlusion recording index includes an occlusion video data indication information and an identifier of the occlusion video file; and establishing the non-occlusion recording index and the occlusion recording index Relationship

The acquiring the non-occlusion video data includes: the device identifier of the monitoring front-end device included in the video request, the viewing time, and the non-occlusion video data indication information included in the non-occlusion recording index, and the monitoring front-end device And acquiring, by the identifier of the non-occlusion video file, the non-occlusion video file according to the identifier of the non-occlusion video file included in the non-occlusion recording index, and acquiring the corresponding information in the non-occlusion video file. Viewing time video data;

The acquiring the first occlusion video data specifically includes: acquiring an occlusion recording index associated with the non-occlusion recording index according to the association relationship, and acquiring, according to the identifier of the occlusion recording file included in the occlusion recording index, corresponding to the first Blocking one or more video files of the area; and acquiring video data corresponding to the viewing time in one or more video files corresponding to the first occlusion area.

In a fourth possible implementation manner of the first aspect, the acquiring the first occlusion video data and the non-occlusion video data, and sending the first occlusion video data and the non-occlusion video data to the first monitoring terminal, specifically:

Generating an acquisition address of the non-occlusion video data and an acquisition address of the first occlusion video data, and sending the acquisition address to the first monitoring terminal, the acquisition address of the occlusion video data or the acquisition address of the occlusion video data The message includes a data type, and is used to indicate that the video data corresponding to the acquired address is occlusion video data;

Receiving, by the first monitoring terminal, a request that includes the acquiring address of the non-occluded video data, establishing, according to the acquiring address of the non-occlusion video data, the first monitoring terminal, for sending the non-occlusion video data a media channel, acquiring the non-occlusion video data according to the acquired address of the non-occlusion video data, and transmitting the non-occlusion video data by using the media channel; Receiving, by the first monitoring terminal, a request that includes the acquiring address of the first occlusion video data, establishing, according to the acquiring address of the first occlusion video data, the first monitoring terminal, for sending the first occlusion a media channel of the video data, acquiring the first occlusion video data according to the acquired address of the first occlusion video data, and transmitting the first occlusion video data by using the media channel. In a second aspect, a method for implementing video occlusion is provided, the method comprising:

The monitoring terminal sends a video request to the monitoring platform, where the video request includes a device identifier, and the video data of the monitoring front-end device identified by the device identifier includes non-occlusion video data corresponding to the non-occlusion area and occlusion video data corresponding to the occlusion area;

Receiving, by the monitoring terminal, the first occlusion video data and the non-occlusion video sent by the monitoring platform when determining that the user of the monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data Data, and combining the first occlusion video data and the non-occlusion video data, where the first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes some or all regions in the occlusion region Or,

Receiving, by the monitoring terminal, the non-occlusion video data sent by the monitoring platform when determining that the user of the monitoring terminal does not have the right to acquire the first occlusion video data in the occlusion video data, and playing the Non-occlusion video data.

In a first possible implementation manner of the second aspect, before the combining the first occlusion video data and the non-occlusion video data, the method further includes: receiving, by the monitoring platform, the first occlusion region Description;

The combining the first occlusion video data and the non-occlusion video data includes: if the first occlusion video data includes one channel of video data, decoding the first occlusion video data to obtain an occlusion video data frame, Decoding the non-occluded video data to obtain a non-occlusion video data frame, extracting pixel data in the occlusion video data frame, and adding the extracted pixel data to the same as the occlusion video data frame according to the description information of the first occlusion region a pixel region corresponding to the first occlusion region in a time stamped non-occlusion video data frame to generate a complete video frame, and playing the complete Video frame; or,

If the first occlusion video data includes multiple video data, decoding each video data in the first occlusion video data to obtain an occlusion video data frame of each video data, and decoding the non-occlusion video data to obtain a non-occlusion video a data frame, extracting pixel data in an occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to a non-occlusion video data frame having the same time stamp as the occlusion video data frame The pixel area corresponding to the first occlusion area generates a complete video frame and plays the complete video frame. In a third aspect, a method for implementing video occlusion is provided, the method comprising:

The monitoring front-end device receives the description information of the occlusion area sent by the monitoring platform;

The monitoring front-end device encodes the captured video image into non-occlusion video data corresponding to the non-occlusion area and occlusion video data corresponding to the occlusion area according to the description information of the occlusion area; the monitoring front-end device to the monitoring platform Transmitting the non-occlusion video data and the occlusion video data, so that the monitoring platform sends the non-occlusion video data to the monitoring terminal when determining that the user of the monitoring terminal has the right to acquire the first occlusion video data The first occlusion video data, or the non-occlusion video data is sent to the monitoring terminal when the user of the monitoring terminal does not have the right to acquire the first occlusion video data, where the first occlusion video data corresponds to a first occlusion region, the first occlusion region including some or all of the occlusion regions.

In a first possible implementation manner of the third aspect, the description, according to the description of the occlusion region, encodes a video image corresponding to the occlusion region in a captured video image into a path when the occlusion region includes an area. Video data;

When the occlusion area includes a plurality of areas, the video picture corresponding to the plurality of areas included in the occlusion area in the captured video picture is encoded as one channel of video data, or the occlusion area included in the captured video picture is included The video pictures corresponding to the plurality of areas are respectively encoded as one channel of video data, or the corresponding areas of the occlusion area included in the captured video picture are corresponding to the same The video picture of the privileged area is encoded as one channel of video data.

In a second possible implementation of the third aspect,

The encoding the captured video picture into the occlusion video data corresponding to the occlusion area according to the description information of the occlusion area, specifically: encoding the video picture corresponding to the occlusion area in the captured video picture directly into the occlusion Video data; or, the video picture corresponding to the non-occlusion area in the captured video picture is padded with the set pixel value and encoded to generate the occlusion video data;

The encoding the captured video picture into the non-occlusion video data corresponding to the non-occlusion area according to the description information of the occlusion area, specifically: encoding the video picture corresponding to the non-occlusion area in the captured video picture directly into the non-occlusion The video data is occluded, or the video frame corresponding to the occlusion area in the captured video picture is padded with the set pixel value and encoded to generate the non-occlusion video data. In a fourth aspect, a monitoring platform is provided, where the monitoring platform includes: a video request receiving unit, a determining unit, an obtaining unit, and a video data sending unit;

The video request receiving unit is configured to receive a video request sent by the first monitoring terminal, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes non-occlusion video data corresponding to the non-occlusion region. And occlusion video data corresponding to the occlusion area;

The determining unit is configured to determine whether the user of the first monitoring terminal has the right to obtain the first occlusion video data in the occlusion video data, where the first occlusion video data corresponds to the first occlusion region, An occlusion region includes some or all of the occlusion regions;

The acquiring unit is configured to acquire non-occlusion video data, and configured to acquire first occlusion video data when the determination result of the determining unit is YES;

The video data sending unit is configured to: when the determining result of the determining unit is yes, send, to the first monitoring terminal, the first occlusion video data and the non-occlusion video data acquired by the acquiring unit, The first monitoring terminal merges and plays the first occlusion video data and the non-occlusion video data, or merges the first occlusion video data and the acquired by the acquiring unit. The non-occluded video data is obtained, and the combined video data is sent to the first monitoring terminal; and when the determining result of the determining unit is no, the first The monitoring terminal sends the non-occlusion video data acquired by the acquiring unit.

In a first possible implementation of the fourth aspect,

The monitoring platform further includes: a setting request receiving unit, a description information sending unit, and a first video data receiving unit; the setting request receiving unit is configured to receive an occlusion area setting request sent by the second monitoring terminal, where the occlusion area is set The request includes the device identifier of the monitoring front-end device and the description information of the occlusion area; the description information sending unit is configured to send, to the monitoring front-end device, description information of the occlusion area; the first video data receiving a unit, configured to receive the non-occlusion video data and the occlusion video data generated according to the description information of the occlusion area sent by the monitoring front-end device; or

The monitoring platform further includes: a setting request receiving unit, a second video data receiving unit, and a video data separating unit; the setting request receiving unit is configured to receive an occlusion area setting request sent by the second monitoring terminal, where the occlusion area is set The request includes the device identifier of the monitoring front-end device and the description information of the occlusion region; the second video data receiving unit is configured to receive the complete video data sent by the monitoring front-end device; the video data separating unit, And omitting the occlusion video data and the non-occlusion video data from the complete video data received by the second video data receiving unit.

In a second possible implementation manner of the fourth aspect, the monitoring platform further includes: a storage unit and an association establishing unit;

The storage unit is configured to store the occlusion video data into an occlusion video file, and store the non-occlusion video data into a non-occlusion video file, where the occlusion video file includes one or more video files;

The association relationship establishing unit is configured to establish an association relationship between the occlusion video file and the non-occlusion video file;

The video request receiving unit is specifically configured to receive a video request that is sent by the first monitoring terminal, including a viewing time; The acquiring unit is specifically configured to acquire video data corresponding to the viewing time in the non-occlusion video file, and is specifically used to establish, according to the association relationship establishing unit, when the determining result of the determining unit is yes Obtaining one or more video files corresponding to the first occlusion area associated with the non-occlusion video file, and acquiring a video corresponding to the viewing time in one or more video files corresponding to the first occlusion area data. A fifth aspect provides a monitoring terminal, where the monitoring terminal includes: a video request sending unit, a video data receiving unit, and a playing unit;

The video request sending unit is configured to send a video request to the monitoring platform, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes non-occlusion video data corresponding to the non-occlusion region and corresponding occlusion Occlusion video data of the area;

The video data receiving unit is configured to receive, by the monitoring platform, the first occlusion video data that is sent when the user of the monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data. The non-occlusion video data, the first occlusion video data corresponds to a first occlusion area, and the first occlusion area includes part or all of the occlusion area; The non-occlusion video data sent when the user of the monitoring terminal does not have the right to acquire the first occlusion video data in the occlusion video data; the playing unit is configured to perform the video data receiving unit to receive the video data. The first occlusion video data and the non-occlusion video data, or for playing the non-occlusion video data received by the video data receiving unit.

In a first possible implementation of the fifth aspect,

If the first occlusion video data includes one channel of video data, the playing unit is specifically configured to: decode the first occlusion video data to obtain an occlusion video data frame, and decode the non-occlusion video data to obtain a non-occlusion video data frame. Extracting pixel data in the occlusion video data frame, and adding the extracted pixel data to the first occlusion in the non-occlusion video data frame having the same time stamp as the occlusion video data frame according to the description information of the first occlusion region a pixel area corresponding to the area to generate a complete video frame, and play the complete video frame; or If the first occlusion video data includes multiple video data, the playing unit is specifically configured to: decode each video data in the first occlusion video data to obtain an occlusion video data frame of each video data, and decode the non-decoding video data frame. Blocking the video data to obtain a non-occlusion video data frame, extracting pixel data in the occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to the same time stamp as the occlusion video data frame The pixel region corresponding to the first occlusion region in the non-occluded video data frame generates a complete video frame and plays the complete video frame. A sixth aspect provides a monitoring front-end device, where the monitoring front-end device includes: a description information receiving unit, a video data encoding unit, and a video data sending unit;

The description information receiving unit is configured to receive description information of an occlusion area sent by the monitoring platform, where the video data encoding unit is configured to view video data according to the description information of the occlusion area;

The video data sending unit is configured to send the non-occlusion video data and the occlusion video data to the monitoring platform, so that the monitoring platform determines that the user of the monitoring terminal has the right to obtain the first occlusion video data. Transmitting the non-occlusion video data and the first occlusion video data to the monitoring terminal, or sending the location to the monitoring terminal when determining that the user of the monitoring terminal does not have the right to acquire the first occlusion video data For the non-occlusion video data, the first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes some or all of the occlusion regions.

In a first possible implementation of the sixth aspect,

The video data encoding unit is configured to: when the occlusion area includes an area, encode a video picture corresponding to the occlusion area in the captured video picture as one channel of video data according to the description information of the occlusion area; or When the occlusion area includes a plurality of areas, the video picture corresponding to the plurality of areas included in the occlusion area in the captured video picture is encoded as one channel of video data according to the description information of the occlusion area, or the video to be captured The video pictures corresponding to the plurality of areas included in the occlusion area in the picture are respectively encoded as one channel of video data, or The video picture of the area corresponding to the same privilege in the plurality of areas included in the occlusion area is encoded as one channel of video data; and is further configured to: occlude the captured video picture according to the description information of the occlusion area Video frame coding corresponding to the district city

A seventh aspect provides a video surveillance system, where the video surveillance system includes: a monitoring terminal and a monitoring platform;

The monitoring terminal is specifically the monitoring terminal according to the fifth aspect or the first possible implementation manner of the fifth aspect;

The monitoring platform is specifically the monitoring platform as described in the fourth aspect or the first or second possible implementation manner of the fourth aspect.

In a first possible implementation manner of the seventh aspect, the video monitoring system further includes a monitoring front end device, where the monitoring front end device is specifically the first possible implementation manner of the sixth aspect or the sixth aspect. The monitoring front-end device.

According to the embodiment of the present invention, after receiving the video request of the monitoring terminal, the monitoring platform determines the authority of the user of the monitoring terminal, and according to the result of the determination, sends only the non-occluded video data to the monitoring terminal of the user who does not have the right to obtain the occlusion video data. The monitoring terminal of the user who obtains part or all of the occlusion video data, transmits the occlusion video data and the non-occlusion video data to be combined and played, or transmits the video data combining the occlusion video data and the non-occlusion video data, thereby solving the existing In the technology, the terminal of the user with different rights is sent the security data caused by the occlusion part of the image data.

BRIEF DESCRIPTION OF THE DRAWINGS In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only the present drawings. Some embodiments of the invention may be obtained by those of ordinary skill in the art from the drawings without departing from the scope of the invention.

1 is a schematic structural diagram of a system according to an embodiment of the present invention;

2 is a schematic flow chart of a method provided by Embodiment 1 of the present invention; 3 is a schematic flowchart of a method according to an alternative embodiment of the present invention; FIG. 4 is a schematic diagram of a scenario of an exemplary embodiment 1 of Embodiment 1 of the present invention;

FIG. 5 is a schematic flowchart of a method according to an exemplary embodiment 1 of Embodiment 1 of the present invention; FIG.

6 is a schematic flowchart of a terminal processing according to an exemplary embodiment 1 of the present invention; FIG. 7 is a schematic diagram of a scenario of an exemplary embodiment 2 of Embodiment 1 of the present invention;

8 is a schematic flow chart of a method according to an exemplary embodiment 2 of Embodiment 1 of the present invention;

9 is a schematic diagram of a process flow of a platform according to an exemplary embodiment 2 of the present invention; FIG. 10 is a schematic diagram of a scenario of an exemplary embodiment 3 of Embodiment 1 of the present invention;

11 is a schematic flow chart of a method according to an exemplary embodiment 3 of Embodiment 1 of the present invention;

12 is a schematic structural diagram of a device for monitoring a monitoring platform according to Embodiment 2 of the present invention; FIG. 15 is a schematic structural diagram of a device for monitoring a terminal provided by Embodiment 3 of the present invention;

FIG. 16 is a schematic structural diagram of a device for monitoring a front-end device according to Embodiment 4 of the present invention; FIG. 17 is a schematic structural diagram of another device of a monitoring platform according to Embodiment 5 of the present invention; FIG. 19 is a schematic structural diagram of another apparatus provided by Embodiment 8 of the present invention; FIG. 20 is a schematic structural diagram of a system provided by Embodiment 8 of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without making creative labor are within the scope of the present invention.

FIG. 1 is a schematic structural diagram of a video surveillance system according to an embodiment of the present invention. The video surveillance system includes a monitoring front-end device (PU), a monitoring platform 120, and a monitoring terminal 130. The monitoring front-end device 110 and monitoring Terminals 130 each communicate with monitoring platform 120 via transport network 140.

The transmission network 140 may be one of the Internet, the local area network, the wide area network, the storage area network, or the like. The manner in which the monitoring platform 120 accesses the network may be a wired access mode. The manner in which the monitoring front-end device 110 and the monitoring terminal 130 access the network may be a wired access mode or a wireless access mode, where the wired access mode includes access mode through a network cable or access mode through an optical fiber, and wireless access The method includes WIFI (for example, IEEE 802. l la, IEEE 802. l ib, IEEE 802. l lg and/or IEEE 802. l ln ), GSM (EDGE), WCDMA, CDMA, TD-SCDMA, Bluetooth, LTE, etc. Into the way.

The monitoring front-end device 110 is configured to collect video data and send the collected video data to the monitoring platform through the transmission network. Preferably, the non-occlusion video data corresponding to the non-occlusion region may be generated according to the description information of the set occlusion region. The occlusion video data corresponding to the occlusion area is transmitted to the monitoring platform separately. The hardware configuration of the monitoring front-end device 110 can be any type of camera device, such as a network camera such as a ball machine, a gun machine, or a dome camera, and an analog camera and an encoder.

The monitoring platform 120 is configured to receive the occlusion video data and the non-occlusion video data sent by the monitoring front end device 110 or separate the complete video data received from the monitoring front end device 110 into occlusion video data and non-occlusion video data, and according to the monitoring terminal The user's right of 130 sends the corresponding video data to the monitoring terminal. For the user who has the right to obtain the occlusion video data, the occlusion video data and the non-occlusion video data can be sent to the monitoring terminal for combined play, and the occlusion video can also be occluded. The data and the non-occluded video data are combined and sent to the monitoring terminal for playback.

The monitoring terminal 130 is configured to receive video data sent by the monitoring platform. If the received video data includes non-occlusion video data and occlusion video data, the monitoring terminal 130 is further configured to combine the occlusion video data and the non-occlusion video data. FIG. 2 is a schematic flowchart of a method for implementing video occlusion according to Embodiment 1 of the present invention.

Step 210: Receive a video request sent by the first monitoring terminal, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes non-occlusion video data corresponding to the non-occlusion area and occlusion of the corresponding occlusion area. Video data;

The occlusion video data and the non-occlusion video data may be specifically encoded in the H.264 format. The device identifier is used to uniquely identify the monitoring front-end device, and specifically includes the monitoring The identifier of the camera of the front-end device may also include the identifier of the cloud mirror of the monitoring front-end device. Step 220: Determine whether the user of the first monitoring terminal has the right to obtain the first occlusion video data in the occlusion video data. The first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes some or all of the occlusion regions;

The occlusion area may specifically include one or more areas, and the area may specifically be a rectangle, a circle, a polygon, or the like. If an area is included, the occlusion video data corresponding to the occlusion area may specifically include one channel of video data; if multiple areas are included, the occlusion video data corresponding to the occlusion area may specifically include one channel of video data, and may also include multiple channels of video data, such as Each area included in the occlusion area corresponds to one channel of video data.

Specifically, the description information of the occlusion area may be used to describe the occlusion area, where the description information of the occlusion area specifically includes the coordinates of the occlusion area. For example, when the occlusion area includes a rectangle, the description information of the occlusion area may include at least three of the rectangles. The coordinates of the vertices may also include only the coordinates of a vertex of the rectangle and the width and height of the rectangle, such as (X, y, w, h), where χ is the top left vertex ordinate, y is the upper left vertex ordinate, w For width, h height.

Specifically, the occlusion video data may be subjected to overall authority control, that is, the authority to access the occlusion video data is divided into two privilege levels, and if the privileged access and the privileged access are available, the user may directly determine whether the user has the privilege to access the occlusion video. Data, in the implementation manner, the first occlusion video data is the occlusion video data, and the first occlusion region is the occlusion region (ie, the entire region including the occlusion region); specifically, It is also possible to perform area-based authority control on the occlusion video data, and set respective rights for different areas, that is, video data corresponding to different areas may correspond to different rights, for example, the occlusion area includes three areas, area 1 and area. 2 Corresponding to the authority A, the area 3 corresponds to the authority B. For example, the occlusion area includes three areas, the area 1 corresponds to the authority A, the area 2 corresponds to the authority B, and the area 3 corresponds to the authority C, and it is necessary to determine whether the user has the right to access the specific area. Corresponding occlusion video data.

Specifically, the authority determination may be performed according to the password, for example, if it is determined that the password used to acquire the first occlusion video data received from the first monitoring terminal is correct (ie, the user inputs the correct password) Code), then determine that the user has the right to obtain the first occlusion video data.

Specifically, the user may perform the permission determination according to the user identifier of the user of the first monitoring terminal. For example, the authorized user identifier may be pre-configured. If the user identifier matches the authorized user identifier, determining that the user has acquired the first occlusion video. The authority of the data may also be pre-configured. If the account type corresponding to the user identifier matches the authorized account type, it is determined that the user has the right to obtain the first occlusion video data. Optionally, the user identifier can be obtained by the user in the process of logging in through the monitoring terminal. In addition, the video request received by the step 210 can carry the user identifier, and the user identifier carried in the video request can be obtained.

If the result of the determination is yes, step 230 is performed; if the result of the determination is no, step 230 is performed. Step 230: Obtain first occlusion video data and non-occlusion video data, and send first occlusion video data and non-occlusion video data to the first monitoring terminal, so that the first monitoring terminal merges and plays the first occlusion video data and non- Blocking the video data; or, combining the first occlusion video data and the non-occlusion video data, and transmitting the combined video data to the first monitoring terminal;

Preferably, the data type of the occlusion video data may be sent to the first monitoring terminal, so that the first monitoring terminal identifies the occlusion video data from the received video data, which may be specifically sent to the first The data type is included in the acquisition address (such as a URL) of the monitoring terminal for acquiring the occlusion video data, and may be included in the message sent to the first monitoring terminal for carrying the acquired address. The data type may also be sent during the process of establishing a media channel between the first monitoring terminal and the monitoring platform for transmitting the occlusion video data.

Preferably, before the sending of the first occlusion video data, the method further includes: sending the description information of the first occlusion area to the first monitoring terminal, so that the first monitoring terminal is configured according to the first occlusion area The description information is combined with the first occlusion video data and the non-occlusion video data received in step 230, and may be included in an acquisition address (such as a URL) sent to the first monitoring terminal for acquiring the occlusion video data. The description information may be further included in the message for carrying the acquisition address sent to the first monitoring terminal, or may be sent in the process of establishing a media channel for transmitting occlusion video data. Description. Step 230B: Acquire the non-occlusion video data and send the data to the first monitoring terminal. Optionally, the specific implementation of step 23 OA and step 230B is as follows:

In the step 230A, the acquiring the first occlusion video data and the non-occlusion video data, and sending the first occlusion video data and the non-occlusion video data to the first monitoring terminal may include: generating the first occlusion video data. The address (such as a URL, which is hereinafter referred to as the acquisition address 1) and the acquisition address of the non-occlusion video data (such as a URL, which is hereinafter referred to as the acquisition address 2) are sent to the first monitoring terminal, and the received first address is sent by the first monitoring terminal. a request, the media channel for transmitting the non-occlusion video data is established with the first monitoring terminal according to the obtaining address 2, the non-occlusion video data is obtained according to the obtaining address 2, and the non-occlusion video data is sent by using the media channel. Receiving a request for acquiring the address 1 sent by the first monitoring terminal, and establishing, by the first monitoring terminal, a media channel for transmitting the first occlusion video data according to the obtaining address 1 according to the Obtaining the first occlusion video data by the first occlusion video data acquisition address and passing the medium The first occlusion video data is sent by the body channel. Specifically, if the first occlusion video data includes multiple video data, the acquisition address of the first occlusion video data includes an acquisition address of the multiplex video data, and is subsequently established. The media channel includes a plurality of media channels for transmitting the plurality of video data.

Preferably, the data type is carried in the acquiring address (such as a URL) sent to the first monitoring terminal, and the data type is used to indicate whether the video data that can be acquired according to the acquiring address is non-occlusion video data or occlusion video data. An example of a URL carrying a data type (Universal Resource Locator) is as follows:

Example of a URL for non-occlusion video data: rtsp: 〃192.7.90.55: 554/ipc00001?type= non-occlusion;

Example of a URL that occludes video data: rtsp: 〃192.7.90.55: 554/ipc00001?type=it Block.

Where rtsp refers to the real-time streaming protocol, which is called real time streaming. Protocol

Preferably, the description information of the occlusion area corresponding to the occlusion video data (such as the coordinates of the occlusion area) may be carried in the acquisition address of the occlusion video data. An example of a URL format that carries a description of the data type and occlusion area is as follows:

Example of occlusion of video data URL 1: rtsp: 〃192.7.90.55: 554/ipc00001?type= occlusion & occlusion coordinates 1 (xl, yl, wl, hl) & occlusion coordinates 2 (x2, y2, w2, h2), in In this example, the occlusion video data corresponds to two occlusion regions;

Example of occlusion of video data URL 2: rtsp: 〃192.7.90.55: 554/ipc00001?type= occlusion & occlusion coordinates 1 (xl, yl, wl, hi) , in this example, the occlusion video data corresponds to an occlusion area.

Optionally, the monitoring platform may further send the description information of the data type and/or the occlusion area to the first monitoring terminal by using a message interaction manner, for example, when returning the URL to the first monitoring terminal, by using the message carrying the URL. The message body of the XML structure includes description information of the data type and/or occlusion area, as follows:

<url> rtsp:〃192.7.90.55: 554/ipc00001?type=Occlusion </ur 1>

In addition, in the process of establishing a media channel between the first monitoring terminal and the monitoring platform, the description of the data type and/or the occlusion area is carried by the customized structure in the RTSP ANNOUNCE message, as follows:

S->C: ANNOUNCE rtsp: //192.7.90.55: 554/ipc00001 RTSP/1.0

CSeq: 312

Date: 23 Jan 1997 15: 35: 06 GMT

Session: 47112344 Ur l type: KeepOutUr l 〃 indicates that this media stream belongs to occlusion video data

Ur lcoordina te: xl=100, yl=100, wl=200, hl=200; x2=100, y2=100, w2=200, h2=200;

In step 230A, the acquiring the first occlusion video data and the non-occlusion video data, combining the first occlusion video data and the non-occlusion video data, and transmitting the combined video data to the first monitoring terminal, specifically: generating Obtaining an acquisition address (such as a URL) of the merged video data, and sending the result to the first monitoring terminal, receiving a request that is sent by the first monitoring terminal and including the acquiring address, and establishing, according to the acquiring address, the first monitoring terminal. a media channel for transmitting the merged video data, acquiring and combining the first occlusion video data and the non-occlusion video data, and transmitting, by using the media channel, the merged video data to the first monitoring terminal.

The step 230B may include: generating an acquisition address of the non-occlusion video data, and sending the acquisition address to the first monitoring terminal, receiving a request for the acquisition address sent by the first monitoring terminal, and establishing the usage with the first monitoring terminal according to the obtaining address. And sending, by the media channel, the non-occlusion video data according to the non-occlusion video data acquisition address, and transmitting the non-occlusion video data through the media channel.

An alternative embodiment of Embodiment 1 of the present invention will be described below with reference to FIG.

The CU (C ient Uni t, client unit) in this embodiment is a client software installed on the monitoring terminal, and provides real-time video monitoring, video query playback, cloud mirror operation and the like for the monitoring personnel.

The monitoring platform includes SCU (Service Contro l Uni t, Service Control Unit) and MU (Media Uni t, Media Unit). In practical applications, SCU and MU may be implemented in the same general server or dedicated server, or may be in separate Implemented in different general purpose servers or dedicated servers. Step 301: The CU sends a video request to the SCU of the monitoring platform, where the video request includes a device identifier, and is used to request to acquire video data of the monitoring front-end device identified by the device identifier, where the video data includes a non-occlusion region. Occlusion video data and occlusion video for corresponding occlusion areas Data.

Step 302: The SCU determines whether the user of the CU has the right to obtain the first occlusion video data in the occlusion video data, where the first occlusion video data corresponds to the first occlusion region, and the first occlusion region includes the Blocking some or all of the area in the area;

The specific implementation of step 302 is the same as step 220, and details are not described herein again.

If the determination result is yes, steps 303A-312A are performed. In this embodiment, it is assumed that the first occlusion video data includes one channel of video data;

If the result of the determination is no, steps 303B-308B are performed.

Steps 303A-306A: The SCU requests the URL of the first occlusion video data and the URL of the non-occlusion video data to the MU, where the MU generates the URL of the first occlusion video data and the non-occlusion video data. The URL is returned to the SCU.

Step 307A: The SCU returns a URL of the first occlusion video data and a URL of the non-occlusion video data to the CU.

Step 308A-309A: The CU requests the MU to acquire the first occlusion video data according to the URL of the first occlusion video data, and establishes, by the MU, a media channel for transmitting the first occlusion video data. Receiving, by the media channel, the first occlusion video data sent by the MU.

Steps 310A-311A: The CU requests the MU to acquire the non-occlusion video data according to the URL of the non-occlusion video data, and establish a media channel for transmitting the non-occlusion video data with the MU, and pass the The media channel receives the non-occlusion video data sent by the MU.

Step 312A: The CU merges and plays the first occlusion video data and the non-occlusion video data.

Step 303B-304B: The SCU requests a URL of the non-occlusion video data from the MU, and the MU generates a URL of the non-occlusion video data and returns the URL to the SCU.

Step 305B: The SCU returns a URL of the non-occlusion video data to the CU.

Step 306B-307B: The CU requests the MU to acquire the non-occlusion video data according to the URL of the non-occlusion video data, and establishes, with the MU, a medium for transmitting the non-occlusion video data. a body channel, and receiving, by the media channel, the non-occlusion video data sent by the MU. Step 308B: The CU plays the non-occlusion video data. According to the first embodiment of the present invention, after receiving the video request of the monitoring terminal, the monitoring platform determines the authority of the user of the monitoring terminal, and according to the result of the determination, only sends the non-occluded video data to the monitoring terminal of the user who does not have the right to obtain the occlusion video data. A monitoring terminal having permission to acquire part or all of the video data occluding the occlusion video data and the non-occlusion video data to be combined and played, or transmitting video data combining the occlusion video data and the non-occlusion video data, thereby solving the present In the technology, the terminals of users with different rights are all sent to the occlusion part of the image data to cause security risks.

In addition, according to the embodiment 1 of the present invention, the area-based authority control can also be implemented, that is, if the occlusion area includes multiple areas, the respective rights can be set for different areas, and then the user is sent according to the rights of the user to the monitoring terminal of the user. The occlusion video data corresponding to some or all areas that the user has permission to obtain, thereby achieving more precise authority control. It should be noted that the first embodiment of the present invention can be used for both real-time video surveillance scenarios and video viewing scenarios (such as video playback and video downloading). If the non-occlusion video data is obtained from the non-occlusion video file, the non-occlusion video data is read from the non-occlusion video file in step 230A, 230B, and the occlusion video data in step OA is specifically read from the occlusion video file. Take occlusion video data.

Accordingly, the following operations are performed before step 210:

Storing the occlusion video data into an occlusion video file, storing the non-occlusion video data into a non-occlusion video file, the occlusion video file including one or more video files, and establishing the occlusion video file and the The relationship of non-occlusion video files.

The establishing the association relationship between the occlusion video file and the non-occlusion video file includes: recording a non-occlusion recording index and an occlusion recording index, where the non-occlusion recording index includes a device identifier of the monitoring front end device, a video start and end time, Non-occlusion video data indication information and the non-occlusion The identifier of the video file (such as the storage address of the non-occlusion video file, specifically the absolute path of the non-occlusion video file), the non-occlusion video data indication information is used to indicate that the non-occlusion video index is unobstructed video The occlusion recording index includes an occlusion video data indication information and an identifier of the occlusion video file (such as a storage address of the occlusion video file, specifically an absolute path of the occlusion video file), the occlusion The video data indication information is used to indicate that the occlusion recording index is an index of the non-occlusion recording file; and establish an association relationship between the non-occlusion recording index and the occlusion recording index. Preferably, the non-occlusion index and the occlusion index may each include non-independent index indication information, where the non-independent index indication information is used to indicate that the index has an associated index, for example, a non-independent index indication of the non-occlusion recording index. The information is used to indicate that the non-occlusion recording index has an associated occlusion recording index; the non-occlusion recording index and/or the occlusion recording index may further include occlusion area description information or information for acquiring occlusion area description information (such as occlusion) The storage address of the area description information). The establishing the association relationship between the non-occlusion recording index and the occlusion recording index may include: recording the identifier of the occlusion recording index (such as an index number) into the non-occlusion recording index, and further comprising recording the non-occlusion video The identifier of the index (such as the index number) is recorded in the occlusion recording index, and may also be an association relationship between the identifier of the occlusion recording index and the identifier of the non-occlusion recording index. It should be noted that, if the occlusion video data includes multiple video data, an occlusion recording index may be separately established for each video data, and an association relationship between the non-occlusion recording index and each occlusion recording index is established, and the optimal relationship is established. The description information of the occlusion area corresponding to the video file or the information for obtaining the description information of the occlusion area corresponding to the video file is recorded in each occlusion recording index.

An example of a non-occlusion recording index and an occlusion recording index is shown in Table 1.

Table 1

Accordingly, if used to record a scene, the video request sent in step 210 may also include a viewing time. In the steps 230A and 230B, the acquiring the non-occlusion video data is specifically: acquiring the video data corresponding to the viewing time in the non-occlusion video file, which may include: according to the monitoring front end device identifier, the viewing time, and the non-occlusion video data. The instruction information acquires the non-occlusion video index, obtains the non-occlusion video file according to the identifier of the non-occlusion video file in the non-occlusion recording index, and obtains the non-occlusion video data corresponding to the viewing time from the non-occlusion video file; in step 23 OA And acquiring, by the occlusion video data, the one or more corresponding to the first occlusion area associated with the non-occlusion video file according to the association relationship between the occlusion video file and the non-occlusion video file. The video file, and the video data corresponding to the viewing time in the one or more video files corresponding to the first occlusion area, specifically: according to the association relationship between the non-occlusion recording index and the occlusion recording index ( For example, according to the occlusion video in the non-occlusion recording index Obtaining an occlusion recording index associated with the non-occlusion recording index, and acquiring one or more video files corresponding to the first occlusion area according to the identifier of the occlusion recording file included in the occlusion recording index; Corresponding to the video data corresponding to the viewing time in one or more video files of the first occlusion area. Preferably, before the occlusion recording index associated with the non-occlusion recording index is obtained according to the association relationship, the occlusion associated with the non-occlusion recording index may be determined according to the non-independent index indication information in the non-occlusion recording index. Video indexing, thereby improving the efficiency of the monitoring platform to retrieve the occlusion video index.

Specifically, after acquiring the non-occlusion video index, the acquiring address for acquiring non-occlusion video data may be generated according to the non-occlusion recording index and sent to the first monitoring terminal, and receiving a request for the non-occlusion video data acquisition address sent by the monitoring terminal, and establishing, by the non-occlusion video data acquisition address, a media channel for transmitting the non-occlusion video data according to the non-occlusion video data acquisition address, according to the Obtaining the non-occluded video data by the non-occlusion video data acquisition address, and sending the non-occlusion video data through the media channel, for example, as shown in FIG. 3, the SCU of the monitoring platform acquires the video request after receiving the video request a non-occlusion recording index, requesting, by the MU, a URL for acquiring the non-occlusion video data corresponding to the non-occlusion recording index according to the non-occlusion recording index, and sending the URL to the CU, where the MU receives the request for the URL sent by the CU, according to the request And the CU establishes a media channel for sending the non-occlusion video data, and reads non-occlusion video data in the video file according to the URL and sends the data to the CU through the media channel. The process of transmitting the occlusion video data after acquiring the occlusion recording index is similar to the process of sending the non-occlusion video data after acquiring the non-occlusion recording index, and will not be described again. Preferably, before sending the first occlusion video data, the method further includes: sending the description information of the first occlusion area to the first monitoring terminal, so that the first monitoring terminal is configured according to the first occlusion area And the occlusion area description information included in the occlusion recording index corresponding to the first occlusion video data is obtained by combining the first occlusion video data and the non-occlusion video data received in step 230A. Or obtaining the description information of the first occlusion area according to the non-occlusion recording index or the information for acquiring the first occlusion area description information included in the occlusion recording index, and sending the obtained description information of the first occlusion area Give the first monitoring terminal. Specifically, the description information of the first occlusion area may be carried in the message that is sent to the first monitoring terminal and that is the location of the first occlusion video data. Preferably, before step 2 30A, the method further includes: receiving an occlusion area setting request sent by the second monitoring terminal, where the occlusion area setting request includes the device identifier of the monitoring front-end device and description information of the occlusion area; After the occlusion area setting request, the description information of the occlusion area may be sent to the monitoring front-end device, and received by the monitoring front-end device according to the The non-occlusion video data generated by the description information of the occlusion region and the occlusion video data; and the occlusion may be separated from the complete video data received from the monitoring front-end device according to the description information of the occlusion region Video data and the non-occlusion video data. In addition, as described in step 230A, the occlusion video data and the non-occlusion video data may be sent to the first monitoring terminal for combined play by the first monitoring terminal, or the occlusion video data and the non-occlusion may be The video data is combined and sent to the first monitoring terminal.

It should be noted that the first monitoring terminal and the second monitoring terminal may be the same monitoring terminal. In summary, the entity that generates the non-occlusion video data and the occlusion video data may be a monitoring front-end device or a monitoring platform, and the entity that combines the non-occlusion video data and the occlusion video data may be a monitoring platform or a monitoring terminal ( That is, the first monitoring terminal of the first embodiment of the present invention, according to the difference between the entities performing the generating operation and the merging operation, three exemplary embodiments of the first embodiment of the present invention are respectively described below. Example Embodiment 1: As shown in FIG. 4, the monitoring front-end device generates non-occlusion video data and occlusion video data, and the monitoring platform uses non-occlusion video data and occlusion video data that the user has permission to acquire (such as the first occlusion video of this embodiment). The data is sent to the monitoring terminal (such as the first monitoring terminal in this embodiment), and the monitoring terminal combines the received video data.

The interaction flowchart of the exemplary embodiment 1 of Embodiment 1 of the present invention will be described below with reference to FIG. Step 401: The second monitoring terminal sends an occlusion area setting request to the monitoring platform, where the occlusion area setting request includes description information of the device identifier and the occlusion area.

The occlusion area may specifically include one or more areas, and the area may specifically be a rectangle, a circle, a polygon, or the like. Preferably, the description information of the occlusion area specifically includes coordinates of the occlusion area. For example, when the occlusion area includes a rectangle, the description information of the occlusion area may include coordinates of at least three vertices of the rectangle, or may only include one of the rectangles. The coordinates of the vertex and the width and height of the rectangle, such as (X, y, w, h), where X is the abscissa of the upper left vertex, y is the ordinate of the upper left vertex, w is the width, and h is the height. Step 402: The monitoring platform sends an occlusion area setting request to the monitoring front-end device identified by the device identifier, where the occlusion area setting request includes description information of the occlusion area.

Step 403: The monitoring front end device encodes the captured video picture to generate occlusion video data and non-occlusion video data.

Specifically, the monitoring front end device encodes the captured video picture into non-occlusion video data corresponding to the non-occlusion area and occlusion video data corresponding to the occlusion area.

If the occlusion area includes an area, the video picture corresponding to the occlusion area may be encoded into one channel of video data, that is, the occlusion video data includes one channel of video data.

If the occlusion area includes a plurality of areas, the video picture corresponding to the multiple areas included in the occlusion area may be encoded as one channel of video data, that is, the occlusion video data includes one channel of video data; Each of the video regions corresponding to the plurality of regions is encoded as one channel of video data, that is, the occlusion video data includes multiple video data and each region corresponds to one channel of video data; and the plurality of regions included in the occlusion region may also be included. The video picture corresponding to the same privilege is encoded as one video data, that is, the area corresponding to the same privilege corresponds to the same video data. For example, the occlusion area includes three areas, and area 1 and area 2 correspond to the same authority, and area 3 corresponds to another area. For a permission, the video picture corresponding to area 1 and area 1 is encoded as the same video data, and the video picture corresponding to area 3 is encoded as another video data.

Specifically, the video picture corresponding to the occlusion area may be directly encoded into the occlusion video pixel data; or the video picture corresponding to the non-occlusion area in the captured entire video picture may be padded with the set pixel value and then encoded. Generating the occlusion video data, that is, the non-occlusion video data.

The format of the encoding includes but is not limited to H.264, MPEG4, MJPEG, and the like.

Specifically, the video picture corresponding to the non-occlusion area may be directly encoded into the non-occlusion video. The set pixel value is padded and encoded to generate the non-occluded video data, and the set pixel value is preferably RGB (0, 0, 0).

At the time of encoding, the occlusion video data is completely coincident with the time stamp of the video frame corresponding to the same full video picture in the non-occlusion video data.

It should be noted that, in the first embodiment, the description information of the occlusion area is sent by the monitoring platform to the monitoring front-end device, and optionally, the description information of the occlusion area may also be at the monitoring front end. Pre-set on the device.

Step 404: Send the generated occlusion video data and non-occlusion video data to the monitoring platform. Preferably, the monitoring front-end device may further send a data type of the occlusion video data to the monitoring platform, so that the monitoring platform receives the data. The occlusion video data is identified in the obtained video data, and the data type may be included in an acquisition address (such as a URL) sent to the monitoring platform for acquiring the occlusion video data (the monitoring platform may utilize the acquisition) The obtaining the occlusion video data from the monitoring front-end device, or including the data type in the message sent to the monitoring platform for carrying the acquiring address, or establishing the monitoring platform and the monitoring front-end device The data type is sent during the process of transmitting a media channel that occludes video data.

Step 405: The first monitoring terminal sends a video request to the monitoring platform, where the video request includes a device identifier of the monitoring front-end device.

Step 406: Determine whether the user of the first monitoring terminal has the right to obtain the first occlusion video data in the occlusion video data, where the first occlusion video data corresponds to the first occlusion region, and the first occlusion region includes Part or all of the occlusion area;

If the result of the determination is yes, go to steps 407A-409A;

If the result of the determination is no, steps 407B-408B are performed.

Step 407A: The monitoring platform sends the description information of the first occlusion area to the first monitoring terminal. Step 408A: The monitoring platform sends the first occlusion video data and non-occlusion video data to the first monitoring terminal. Step 409A: The first monitoring terminal combines and plays the received first occlusion video data and non-occlusion video data.

Preferably, the received first occlusion video data and non-occlusion video data are combined and played according to the description information of the first occlusion region.

Specifically, if the first occlusion video data includes one channel of video data, decoding the first occlusion video data to obtain an occlusion video data frame, decoding the non-occlusion video data to obtain a non-occlusion video data frame, and extracting occlusion video data. Pixel data in the frame, and adding the extracted pixel data to the pixel region corresponding to the first occlusion region in the non-occlusion video data frame having the same time stamp as the occlusion video data frame according to the description information of the first occlusion region To generate a complete video frame and play the full video frame. If the video picture corresponding to the first occlusion area is directly encoded into the first occlusion video data, that is, the occlusion video data frame includes only pixel data of the video picture corresponding to the occlusion area, extracting The occlusion of the pixel data in the video data frame is specifically: extracting all the pixel data in the occlusion video data frame; if the video picture corresponding to the non-occlusion area in the entire video picture is filled with the set pixel value during encoding The pixel data of the occlusion frequency picture and the padded pixel data are encoded, and the pixel data of the pixel area corresponding to the first occlusion area in the occlusion video data frame is extracted according to the description information of the first occlusion area.

If the first occlusion video data includes multiple video data, decoding each video data in the first occlusion video data to obtain an occlusion video data frame of each video data, and decoding the non-occlusion video data to obtain a non-occlusion video a data frame, extracting pixel data in an occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to a non-occlusion video data frame having the same time stamp as the occlusion video data frame The pixel area corresponding to the first occlusion area generates a complete video frame and plays the complete video frame.

Specifically, as shown in FIG. 6, the non-occlusion video data and the first occlusion video data are transmitted to the first monitoring terminal by using an RTP protocol, and the first monitoring terminal receives the unoccluded video data stream encapsulated by the RTP protocol. And the first occlusion video data stream, respectively parsing the non-occlusion video data code Flowing and occluding the video data code stream to obtain non-occlusion video data and first occlusion video data and respectively buffering in the decoder buffer, synchronizing the frame data according to the synchronization time stamp, that is, extracting the non-occlusion video data and the first occlusion video data respectively Frame data having the same time stamp, respectively decoding the extracted frame data of the non-occluded video data having the same time stamp and the frame data of the first occlusion video data to generate corresponding YUV data, and then according to the description of the first occlusion region Information synthesis of the first occlusion video data

YUV data and YUV data of non-occluded video data, and the synthesized YUV data is rendered and played.

It should be noted that, if the occlusion video data and the non-occlusion video data sent by the monitoring front-end device are not started before step 404, a request for acquiring video data is sent to the monitoring front-end device after step 404. Specifically, the monitoring front-end device may be requested to obtain video data that the user of the first monitoring terminal has permission to obtain according to the determination result of step 406. For example, if the user only has the right to obtain non-occlusion video data, only the non-requesting non-request is performed. Blocking the video data, if the user has the right to obtain the non-occluded video data and the first occlusion video data, requesting to acquire the non-occlusion video data and the first occlusion video data, and the monitoring front-end device generates the requested video data after receiving the request. And return to the monitoring platform. The method for generating the non-occlusion video data and the first occlusion video data by the monitoring front-end device is the same as step 403, and details are not described herein.

Step 407B: The monitoring platform forwards the non-occluded video data to the first monitoring terminal;

Step 408B: The first monitoring terminal plays the received non-occluded video data. Example Embodiment 2: As shown in FIG. 7, the monitoring front-end device generates non-occlusion video data and occlusion video data, and the monitoring platform combines the non-occlusion video data and the occlusion video data (ie, the first occlusion video data) that the user has permission to acquire. Send to the monitoring terminal.

The interaction flowchart of the exemplary embodiment 2 of the embodiment 1 of the present invention will be described below with reference to FIG. Steps 501-506: Same as steps 401-406, no longer mentioned;

If the answer of step 506 is yes, step 507A-510A is performed;

If the answer of step 506 is no, steps 507B-508B are performed. Step 507A: Same as step 407A;

Step 508A: The monitoring platform merges the non-occlusion video data and the first occlusion video data. Preferably, the first occlusion video data and the non-occlusion video data are merged according to the description information of the occlusion region received in step 401.

Specifically, if the first occlusion video data includes one channel of video data, decoding the first occlusion video data to obtain an occlusion video data frame, decoding the non-occlusion video data to obtain a non-occlusion video data frame, and extracting the occlusion Pixel data in a video data frame, adding the extracted pixel data to a pixel region corresponding to the occlusion region in a non-occlusion video data frame having the same time stamp as the occlusion video data frame, generating a complete video frame, and encoding the Complete video frame to get the combined video data. If the video image corresponding to the occlusion area is directly encoded into the first occlusion video data, that is, the occlusion video data frame includes only the pixel data of the video picture corresponding to the occlusion area, the occlusion video is extracted. The pixel data in the data frame is specifically: extracting all the pixel data in the occlusion video data frame; if the video picture corresponding to the non-occlusion area in the entire video picture is filled with the set pixel value and then encoding and generating at the time of encoding The pixel data of the first occlusion video number and the padded pixel data extract pixel data of a pixel region corresponding to the first occlusion region in the occlusion video data frame.

If the first occlusion video data includes multiple video data, decoding each video data in the first occlusion video data to obtain an occlusion video data frame of each video data, and decoding the non-occlusion video data to obtain a non-occlusion video a data frame, extracting pixel data in an occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to a non-occlusion video data frame having the same time stamp as the occlusion video data frame The pixel area corresponding to the occlusion area generates a complete video frame, and encodes the complete video frame to obtain the combined video data.

Specifically, as shown in FIG. 9, the non-occlusion video data and the first occlusion video data are transmitted to the monitoring platform by using an RTP protocol, and the monitoring platform receives the non-occluded video data stream and the first occlusion encapsulated by the RTP protocol. The processing after the video data stream is connected to the first monitoring terminal in step 409A. The processing after receiving the stream is similar, except that the first monitoring terminal synthesizes the YUV data and then renders the playback, and the monitoring terminal synthesizes the YUV data to encode the synthesized YUV data to generate the combined video data.

Step 509A: Send the combined video data to the first monitoring terminal.

Step 510A: The first monitoring terminal directly decodes and plays the combined video data. Steps 507B-508B, the same steps 507B-508B _o Example Embodiment 3: As shown in FIG. 10, the monitoring front-end device generates complete video data, and the monitoring platform separates the occlusion video data from the complete video data received from the monitoring front-end device. The video data is occluded, and the non-occlusion video data and the occlusion video data that the user has permission to acquire are respectively sent to the monitoring terminal, and the monitoring terminal combines the received occlusion video data and the non-occlusion video data. The interaction flowchart of the exemplary embodiment 3 of the embodiment 1 of the present invention is described below with reference to FIG. Step 601: Same as step 401, no further description;

Step 602: The monitoring front-end device encodes the captured video picture to generate complete video data and sends the video data to the monitoring platform.

Step 603: The monitoring platform separates the occlusion video data corresponding to the occlusion area and the non-occlusion video data corresponding to the non-occlusion area from the complete video data according to the description information of the video occlusion area received in step 601;

If the occlusion area includes an area, the video picture corresponding to the occlusion area in the complete video data may be encoded into one channel of video data, that is, the occlusion video data includes one channel of video data.

If the occlusion video area includes a plurality of areas, the video picture corresponding to the multiple areas included in the occlusion area in the complete video data may be encoded as one channel of video data, that is, the occlusion video data includes one channel of video data; The video pictures corresponding to the plurality of areas included in the occlusion area in the complete video data may be separately encoded into one video data, that is, the occlusion The video data includes multiple video data, and each area corresponds to one video data. The video picture of the area corresponding to the same right in the multiple areas included in the occlusion area may be encoded into one video data, that is, an area corresponding to the same authority. For the same video data, for example, the occlusion area includes three areas, area 1 and area 2 correspond to the same authority, and area 3 corresponds to another authority, and the video pictures corresponding to area 1 and area 2 are encoded as the same video data, area. 3 The corresponding video picture is encoded as another video data.

Specifically, the video image corresponding to the occlusion area may be directly encoded into the occlusion video data, including: decoding the complete video data to obtain a complete video frame, and extracting a video corresponding to the occlusion area in the complete video frame. The video data of the occlusion video data is generated by the pixel data of the picture; the video picture corresponding to the non-occlusion area in the entire video picture may be padded with the set pixel value to generate the occlusion video data, including: decoding The complete video data is obtained as a complete video frame, and pixel data of the video picture corresponding to the pixel value range of the pixel corresponding to the pixel area of the non-occlusion area in the complete video frame and the filled pixel data.

The non-occlusion video data corresponding to the non-occlusion area is separated, and the video picture corresponding to the non-occlusion area is directly encoded into the non-occlusion video data, including: decoding the complete video data to obtain a complete video frame, and extracting the The video data of the video frame corresponding to the non-occlusion area in the complete video frame is used to generate the video frame of the non-occlusion video data. Specifically, the video image corresponding to the occlusion area in the entire video picture may be used. And encoding the non-occlusion video data after the predetermined pixel value is filled, including: decoding the complete video data to obtain a complete video frame, and setting a pixel value of a pixel of a pixel region corresponding to the occlusion region in the complete video frame to The determined pixel value; the set pixel value is preferably RGB (0, 0, 0).

Steps 604-605: the same steps 405-406; If the answer of step 605 is yes, perform steps 606A-608A;

If the answer of step 605 is no, steps 606B-607B are performed.

Steps 606A-608A: same steps 407A-409A;

Steps 606B-607B: Same as step 407B_408B. For the foregoing method embodiments, for the sake of brevity, they are all described as a series of combinations of actions, but those skilled in the art should understand that the present invention is not limited by the described order of actions, because according to the present invention, Some steps can be performed in other orders or at the same time. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention. According to Embodiment 1 of the present invention, Embodiment 2 of the present invention proposes a monitoring platform 500.

As shown in FIG. 12, the monitoring platform includes: a video request receiving unit 501, a determining unit 502, an obtaining unit 503, and a video data sending unit 504;

The video request receiving unit 501 is configured to receive a video request sent by the first monitoring terminal, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes a non-occlusion video corresponding to the non-occlusion area. The data and the occlusion video data corresponding to the occlusion area; the determining unit 502, configured to determine whether the user of the first monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data, the first occlusion The video data corresponds to the first occlusion area, and the first occlusion area includes part or all of the occlusion area; the acquiring unit 503 is configured to acquire non-occlusion video data, and is used for determining by the determining unit 502. The result is that the first occlusion video data is obtained when yes;

The video data sending unit 504 is configured to: when the determining result of the determining unit 502 is YES, send the first occlusion video data and the non-occlusion obtained by the acquiring unit 503 to the first monitoring terminal. Video data, such that the first monitoring terminal merges the first occlusion video data and the non-occlusion video data, or merges the first occlusion obtained by the acquiring unit 503 The video data and the non-occlusion video data are combined to obtain the combined video data, and the combined video data is sent to the first monitoring terminal; and when the determination result of the determining unit 502 is negative, Transmitting the non-occlusion video data acquired by the obtaining unit 503 to the first monitoring terminal.

Optionally, the monitoring platform further includes: a setting request receiving unit 505;

The setting request receiving unit 505 is configured to receive an occlusion area setting request sent by the second monitoring terminal, where the occlusion area setting request includes the device identifier of the monitoring front-end device and description information of the occlusion area;

As shown in FIG. 13, the monitoring platform further includes: a description information sending unit 506 and a first video data receiving unit 507; the description information sending unit 506, configured to send a description of the occlusion area to the monitoring front-end device The first video data receiving unit 507 is configured to receive the non-occlusion video data and the occlusion video data generated by the monitoring front-end device according to the description information of the occlusion region; or

As shown in FIG. 14, the monitoring platform further includes: a second video data receiving unit 508 and a video data separating unit 509; the second video data receiving unit 508 is configured to receive the complete video data sent by the monitoring front-end device. The video data separating unit 509 is configured to separate the occlusion video data and the non-occlusion video data from the complete video data received by the second video data receiving unit.

Preferably, the monitoring platform further includes: a storage unit and an association relationship establishing unit; the storage unit is configured to store the occlusion video data into an occlusion video file, and store the non-occlusion video data into the non-occlusion video recording In the file, the occlusion video file includes one or more video files;

The video request receiving unit 501 is specifically configured to receive a video request that includes a viewing time sent by the first monitoring terminal; The acquiring unit 503 is specifically configured to acquire video data corresponding to the viewing time in the non-occlusion video file, and is further used to establish a unit according to the association relationship when the determining result of the determining unit 502 is YES. Obtaining, by the established association relationship, the one or more video files corresponding to the first occlusion area associated with the non-occlusion video file, and acquiring the corresponding viewing time in one or more video files corresponding to the first occlusion area Video data.

Further, the association relationship establishing unit is specifically configured to: record a non-occlusion recording index and an occlusion recording index, where the non-occlusion recording index includes a device identifier of the monitoring front end device, a video start and end time, and an unoccluded video data indication information. The identifier of the non-occlusion recording file includes: an occlusion video data indication information and an identifier of the occlusion video file; and establishing an association relationship between the non-occlusion recording index and the occlusion recording index;

Correspondingly, the acquiring unit 503 is specifically configured to: according to the device identifier of the monitoring front-end device, the viewing time, and the non-occlusion video data indication information included in the non-occlusion recording index, the monitoring front end Obtaining the non-occlusion video file according to the identifier of the non-occlusion video file included in the non-occlusion recording index, and acquiring the non-occlusion video file. The video data corresponding to the viewing time is specifically used to obtain the occlusion recording index associated with the non-occlusion recording index according to the association relationship when the determination result of the determining unit 502 is YES, according to the occlusion recording Obtaining, by the index, the identifier of the occlusion video file, the one or more video files corresponding to the first occlusion area; and acquiring a video corresponding to the viewing time in one or more video files corresponding to the first occlusion area data.

The functional unit described in Embodiment 2 of the present invention can be used to implement the method described in Embodiment 1 above.

Preferably, the video request receiving unit 501, the determining unit 502, the setting request receiving unit 505, and the description information sending unit 506 are located in the SCU of the monitoring platform, the acquiring unit 503, the video data sending unit 504, and the first video data receiving unit. 507. The second video data receiving unit 508 and the video data separating unit 509 are located at the MU of the monitoring platform. According to Embodiment 2 of the present invention, after receiving the video request of the monitoring terminal, the monitoring platform determines the authority of the user of the monitoring terminal, and according to the result of the determination, sends only the non-occluded video data to the monitoring terminal of the user who does not have the right to obtain the occlusion video data. A monitoring terminal having permission to acquire part or all of the video data occluding the occlusion video data and the non-occlusion video data to be combined and played, or transmitting video data combining the occlusion video data and the non-occlusion video data, thereby solving the present In the technology, the terminals of users with different rights are all sent to the occlusion part of the image data to cause security risks.

In addition, according to the embodiment 2 of the present invention, the area-based authority control can also be implemented, that is, if the occlusion area includes multiple areas, the respective rights can be set for different areas, and then the user is sent according to the rights of the user to the monitoring terminal of the user. The occlusion video data corresponding to some or all areas that the user has permission to obtain, thereby achieving more precise authority control. According to Embodiment 1 of the present invention, Embodiment 3 of the present invention proposes a monitoring terminal 600.

As shown in FIG. 15, the monitoring terminal includes: a video request sending unit 601, a video data receiving unit 602, and a playing unit 603;

The video request sending unit 601 is configured to send a video request to the monitoring platform, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes non-occlusion video data corresponding to the non-occlusion region and corresponding Occlusion video data in the occlusion area;

The video data receiving unit 602 is configured to receive, by the monitoring platform, the first occlusion video data that is sent when the user of the monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data. And the non-occlusion video data, the first occlusion video data corresponds to a first occlusion area, and the first occlusion area includes part or all of the occlusion area; and is further configured to receive the monitoring platform to determine The non-occlusion video data sent when the user of the monitoring terminal does not have the right to acquire the first occlusion video data in the occlusion video data; the playing unit is configured to merge and play the video data receiving unit The first occlusion video data and the non-occlusion video data received by the 602, or used to play the video data receiving list The non-occluded video data received by element 602.

Preferably, if the first occlusion video data includes one channel of video data, the playing unit is specifically configured to: decode the first occlusion video data to obtain an occlusion video data frame, and decode the non-occlusion video data to obtain non-occlusion a video data frame, extracting pixel data in the occlusion video data frame, and adding the extracted pixel data to the non-occlusion video data frame having the same time stamp as the occlusion video data frame according to the description information of the first occlusion region a pixel area corresponding to the first occlusion area to generate a complete video frame, and play the complete video frame; or

Optionally, if the first occlusion video data includes multiple video data, the playing unit is specifically configured to: decode each video data in the first occlusion video data to obtain occlusion video data of each video data. a frame, decoding non-occlusion video data to obtain a non-occlusion video data frame, extracting pixel data in an occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to the occlusion video data frame A pixel region corresponding to the first occlusion region in the non-occluded video data frame having the same time stamp generates a complete video frame and plays the complete video frame.

The functional unit described in Embodiment 3 of the present invention can be used to implement the method described in Embodiment 1 above. According to Embodiment 1 of the present invention, Embodiment 4 of the present invention proposes a monitoring front end device 700. As shown in FIG. 16, the monitoring front-end device includes: a description information receiving unit 701, a video data encoding unit 702, and a video data transmitting unit 703;

The description information receiving unit 701 is configured to receive description information of an occlusion area sent by the monitoring platform;

The video data encoding unit 702 is configured to capture video data according to the description information of the occlusion area;

The video data sending unit 703 is configured to send the number of non-occlusion videos to the monitoring platform. And blocking the video data, so that the monitoring platform sends the non-occlusion video data and the first occlusion video to the monitoring terminal when determining that the user of the monitoring terminal has the right to acquire the first occlusion video data Data, or the non-occlusion video data is sent to the monitoring terminal when the user of the monitoring terminal does not have the right to obtain the first occlusion video data, where the first occlusion video data corresponds to the first occlusion area, The first occlusion region includes some or all of the occlusion regions.

Preferably, the video data encoding unit 702 is specifically configured to, when the occlusion area includes an area, encode a video picture corresponding to the occlusion area in the captured video picture as a video according to the description information of the occlusion area. Data; or, when the occlusion area includes a plurality of areas, encoding a video picture corresponding to the plurality of areas included in the occlusion area of the captured video picture as one channel of video data according to the description information of the occlusion area, or The video images corresponding to the plurality of regions included in the occlusion region in the captured video image are respectively encoded as one video data, or the regions corresponding to the same rights in the plurality of regions included in the occlusion region in the captured video image The video picture is encoded as one channel of video data; specifically, it is further configured to: according to the occlusion region frequency data.

The functional unit described in Embodiment 4 of the present invention can be used to implement the method described in Embodiment 1 above. As shown in FIG. 17, the fifth embodiment of the present invention provides a monitoring platform 1000, including: a processor 1010, a communication interface 1020, a memory 1030, and a bus 1040.

The processor 1010, the communication interface 1020, and the memory 1030 complete communication with each other through the bus 1040.

The communication interface 1020 is configured to communicate with the network element, such as the monitoring terminal and the monitoring front end device. The processor 1010 is configured to execute the program 1032. In particular, program 1032 can include program code, the program code including computer operating instructions.

The processor 1010 is a computer program for executing memory storage, and may be a central processing unit (CPU), which is a computer core unit.

The memory 1030 is configured to store the program 1032. Memory 1030 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

The program 1032 may specifically include: a video request receiving unit 1032-1, a determining unit 1032-2, an obtaining unit 1032-3, and a video data transmitting unit 1032-4;

The video request receiving unit 1032-1 is configured to receive a video request sent by the first monitoring terminal, where the video request includes a device identifier, where the video data of the monitoring front-end device identified by the device identifier includes a non-occlusion region Blocking video data and occlusion video data corresponding to the occlusion area; the determining unit 1032-2, configured to determine whether the user of the first monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data, The first occlusion video data corresponds to the first occlusion area, and the first occlusion area includes part or all of the occlusion area; the acquiring unit 1032-3 is configured to acquire non-occlusion video data, and is used for Obtaining the first occlusion video data when the determination result of the determining unit 1032-2 is YES;

The video data sending unit 1032-4 is configured to send, when the determining result of the determining unit 1032-2 is YES, the first occlusion video acquired by the acquiring unit 1032-3 to the first monitoring terminal. Data and the non-occlusion video data, so that the first monitoring terminal merges the first occlusion video data and the non-occlusion video data, or merges the first occlusion video acquired by the acquiring unit 1032-3 Data and the non-occlusion video data are combined to obtain the combined video data, and the combined video data is sent to the first monitoring terminal; and is further used when the determining result of the determining unit 1032-2 is negative. And sending, to the first monitoring terminal, the non-occlusion video data acquired by the acquiring unit 1032-3.

Optionally, the program further includes: a setting request receiving unit 1G32-5; The setting request receiving unit 1032-5 is configured to receive an occlusion area setting request sent by the second monitoring terminal, where the occlusion area setting request includes the device identifier of the monitoring front-end device and description information of the occlusion area;

The monitoring platform further includes: a description information sending unit 1032-6 and a first video data receiving unit 1032-7; the description information sending unit 1032-6, configured to send a description of the occlusion area to the monitoring front-end device The first video data receiving unit 1032-7 is configured to receive the non-occlusion video data and the occlusion video data generated by the monitoring front-end device according to the description information of the occlusion region; or

The monitoring platform further includes: a second video data receiving unit 1032-8 and a video data separating unit 1032-9; the second video data receiving unit 1032-8 is configured to receive the complete video data sent by the monitoring front end device The video data separating unit 1032-9 is configured to separate the occlusion video data and the non-occlusion video data from the complete video data received by the second video data receiving unit.

Preferably, the program further includes: a storage unit and an association establishing unit;

The video request receiving unit 1032-1 is specifically configured to receive a video request that includes a viewing time sent by the first monitoring terminal;

The obtaining unit 1032-3 is specifically configured to acquire video data corresponding to the viewing time in the non-occlusion video file, and is further used to: when the determining result of the determining unit 1032-2 is YES, according to the Obtaining, by the association relationship establishing unit, the one or more video files corresponding to the first occlusion area associated with the non-occlusion video file, and acquiring corresponding one or more video files corresponding to the first occlusion area The video data of the viewing time. Further, the association relationship establishing unit is specifically configured to: record a non-occlusion recording index and an occlusion recording index, where the non-occlusion recording index includes a device identifier of the monitoring front end device, a video start and end time, and an unoccluded video data indication information. The identifier of the non-occlusion recording file includes: an occlusion video data indication information and an identifier of the occlusion video file; and establishing an association relationship between the non-occlusion recording index and the occlusion recording index;

Correspondingly, the obtaining unit 1032-3 is specifically configured to: according to the device identifier of the monitoring front-end device, the viewing time, and the non-occlusion video data indication information included in the non-occlusion recording index, And monitoring the non-occlusion video file according to the identifier of the non-occlusion video file included in the non-occlusion recording index, and acquiring the non-occlusion video file, and acquiring the non-occlusion video file according to the identifier of the non-occlusion video file included in the non-occlusion recording index. The video data corresponding to the viewing time in the video file is specifically used to acquire the occlusion recording index associated with the non-occlusion recording index according to the association relationship when the determination result of the determining unit 1032-2 is YES, according to Acquiring the identifier of the occlusion video file included in the occlusion recording index to acquire one or more video files corresponding to the first occlusion region; and acquiring corresponding ones of the one or more video files corresponding to the first occlusion region View video data for time.

For a specific implementation of each unit in the program 1032, refer to the corresponding unit in Embodiment 1 of the present invention, and details are not described herein.

The functional unit described in Embodiment 5 of the present invention can be used to implement the method described in Embodiment 1 above. According to Embodiment 5 of the present invention, after receiving the video request of the monitoring terminal, the monitoring platform determines the authority of the user of the monitoring terminal, and according to the result of the determination, sends only the non-occluded video data to the monitoring terminal of the user who does not have the right to obtain the occlusion video data. A monitoring terminal having permission to acquire part or all of the video data occluding the occlusion video data and the non-occlusion video data to be combined and played, or transmitting video data combining the occlusion video data and the non-occlusion video data, thereby solving the present In the technology, the terminals of users with different rights are all sent to the occlusion part of the image data to cause security risks. In addition, according to the embodiment 5 of the present invention, the area-based authority control can also be implemented, that is, if the occlusion area includes multiple areas, the respective rights can be set for different areas, and then the user is sent according to the rights of the user to the monitoring terminal of the user. The occlusion video data corresponding to some or all areas that the user has permission to obtain, thereby achieving more precise authority control. As shown in FIG. 18, Embodiment 6 of the present invention provides a monitoring terminal 2000, including: a processor (proces sor) 2010, a communication interface (Communication) 2020, a memory 2030, and a bus 2040.

The processor 2010, the communication interface 2020, and the memory 2030 complete communication with each other through the bus 2040.

The communication interface 2020 is configured to communicate with the network element, such as communicating with the monitoring platform.

The processor 2010 is configured to execute the program 2032.

In particular, program 2032 can include program code, the program code including computer operating instructions.

The processor 2010 is a computer program for executing memory storage, and may be a central processing unit (CPU, centra l proces s ing uni t ), which is a computer core unit.

The memory 2030 is configured to store the program 2032. Memory 2030 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

The program 2032 may specifically include: a video request sending unit 2032-1, a video data receiving unit 2032-2, and a playing unit 2032-3;

The video data receiving unit 2032-2 is configured to receive, when the monitoring platform determines that the user of the monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data, Transmitting the first occlusion video data and the non-occlusion video data, where the first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes part or all of the occlusion region; Receiving, by the monitoring platform, the non-occlusion video data sent when the user of the monitoring terminal does not have the right to acquire the first occlusion video data in the occlusion video data;

The playing unit is configured to merge and play the first occlusion video data and the non-occlusion video data received by the video data receiving unit 2032-2, or is used to play the video data receiving unit 2032-2. The non-occlusion video data.

For a specific implementation of each unit in the program 2032, refer to the corresponding unit in Embodiment 3 of the present invention, and details are not described herein.

The functional unit described in Embodiment 6 of the present invention can be used to implement the method described in Embodiment 1 above. As shown in FIG. 19, Embodiment 7 of the present invention provides a monitoring front-end device 3000, including: a processor 3010, a communications interface 3020, a memory 3030, and a bus 3040.

The processor 3010, the communication interface 3020, and the memory 3030 complete communication with each other via the bus 3040.

The communication interface 3020 is configured to communicate with the network element, such as to communicate with the monitoring platform.

The processor 3010 is configured to execute the program 3032.

In particular, program 3032 can include program code, the program code including computer operating instructions.

The processor 3010 is a computer program for executing memory storage, and may be a central processing unit (CPU), which is a computer core unit.

The memory 3030 is configured to store the program 3032. Memory 3030 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

The program 3032 may specifically include: a description information receiving unit 3032-1, a video data encoding unit 3032-2, and a video data transmitting unit 3032-3;

The description information receiving unit 3032-1 is configured to receive description information of an occlusion area sent by the monitoring platform;

The video data encoding unit 3032-2 is configured to block video data according to the description information of the occlusion area;

The video data sending unit 3032-3 is configured to send the non-occlusion video data and the occlusion video data to the monitoring platform, so that the monitoring platform determines that the user of the monitoring terminal has acquired the first occlusion video. Sending the non-occlusion video data and the first occlusion video data to the monitoring terminal when the authority of the data, or to the monitoring when determining that the user of the monitoring terminal does not have the right to acquire the first occlusion video data Transmitting, by the terminal, the non-occlusion video data, The first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes some or all of the occlusion regions.

Preferably, the video data encoding unit 3032-2 is configured to: when the occlusion area includes an area, encode a video picture corresponding to the occlusion area in the captured video picture according to the description information of the occlusion area as a video data of one channel; or, when the occlusion region includes a plurality of regions, encoding, according to the description information of the occlusion region, a video image corresponding to multiple regions included in the occlusion region of the captured video image into one video data, Alternatively, the video images corresponding to the plurality of regions included in the occlusion region in the captured video image are respectively encoded as one-way video data, or the corresponding regions in the plurality of regions included in the occlusion region in the captured video image The video picture of the area is encoded as one channel of video data; and specifically for, according to the occlusion area frequency data.

For a specific implementation of each unit in the program 3032, refer to the corresponding unit in Embodiment 4 of the present invention, and details are not described herein.

The functional unit described in Embodiment 7 of the present invention can be used to implement the method described in Embodiment 1 above. According to Embodiments 1 to 7 of the present invention, Embodiment 8 of the present invention proposes a video monitoring system 4000. As shown in FIG. 20, the video monitoring system includes: a monitoring terminal 4010 and a monitoring platform 4020. The monitoring terminal 4010 is specifically a monitoring terminal as described in Embodiment 3 or 6.

The monitoring platform 4020 is specifically the monitoring platform as described in Embodiment 2 or 5.

As shown in FIG. 21, the video surveillance system may further include a monitoring front end device 4030, specifically a monitoring front end device as described in Embodiment 4 or 7.

The video surveillance system described in Embodiment 8 of the present invention can be used to implement the method described in Embodiment 1 above. According to Embodiment 8 of the present invention, the monitoring platform determines the monitoring end after receiving the video request of the monitoring terminal. According to the judgment result, only the non-occlusion video data is sent to the monitoring terminal of the user who does not have the authority to acquire the occlusion video data, and the occlusion video data is sent to the monitoring terminal of the user who has the authority to acquire part or all of the occlusion video data. The non-occlusion video data is combined to play, or the video data combining the occlusion video data and the non-occlusion video data is transmitted, thereby solving the problem that the image data of the occlusion portion is sent to the terminals of the users with different rights in the prior art. Security risks.

In addition, according to the embodiment 8 of the present invention, the area-based authority control can also be implemented, that is, if the occlusion area includes multiple areas, the respective rights can be set for different areas, and then the user is sent according to the rights of the user to the monitoring terminal of the user. The occlusion video data corresponding to some or all areas that the user has permission to obtain, thereby achieving more precise authority control. Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in a combination of electronic hardware or computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that the specific working process of the system, the device and the unit described above can be referred to the corresponding process in the foregoing method embodiments for the convenience and brevity of the description, and details are not described herein again.

In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form. The components displayed for the unit may or may not be physical units, ie may be located in one place, or may be distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM, Random Acces s Memory), a magnetic disk, or an optical disk, and the like, which can store program codes. medium.

The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

Claim

A method for implementing video occlusion, the method comprising:

The monitoring platform determines whether the user of the first monitoring terminal has the right to obtain the first occlusion video data in the occlusion video data, where the first occlusion video data corresponds to the first occlusion region, and the first occlusion region Include some or all of the occlusion regions;

If the determination result is yes, acquiring the first occlusion video data and the non-occlusion video data, sending the first occlusion video data and the non-occlusion video data to the first monitoring terminal, so that the first monitoring terminal merges the playback station Decoding the first occlusion video data and the non-occlusion video data; or combining the acquired first occlusion video data and the non-occlusion video data to obtain combined video data, and transmitting the combined video data Giving the first monitoring terminal;

2. The method of claim 1 wherein

Before receiving the video request sent by the first monitoring terminal, the method includes:

And receiving an occlusion area setting request sent by the second monitoring terminal, where the occlusion area setting request includes the device identifier of the monitoring front-end device and description information of the occlusion area;

3. The method of claim 1 wherein

Before the obtaining the first occlusion video data and the non-occlusion video data, the method includes:

Storing the occlusion video data into an occlusion video file, storing the non-occlusion video data into a non-occlusion video file, the occlusion video file including one or more video files, and establishing the occlusion video file and the Declaring the association relationship of non-occlusion video files; The video request includes a viewing time;

4. The method of claim 3, wherein

The establishing the association relationship between the occlusion video file and the non-occlusion video file includes: recording a non-occlusion recording index and an occlusion recording index, where the non-occlusion recording index includes a device identifier of the monitoring front end device, a video start and end time, Non-occlusion video data indication information and an identifier of the non-occlusion video file, the occlusion recording index includes an occlusion video data indication information and an identifier of the occlusion video file; and establishing the non-occlusion video cable and the occlusion The information about the non-occlusion video data includes: the device identifier of the monitoring front-end device included in the video request, the viewing time, and the non-occlusion video data indication information included in the non-occlusion recording index, Obtaining the non-occlusion video file according to the identifier of the non-occlusion video file included in the non-occlusion recording index, and acquiring the device identifier, the recording start and end time of the monitoring front end device, and the non-occlusion recording index. The corresponding view in the non-occlusion video file The obtaining of the first occlusion video data includes: acquiring the occlusion recording index associated with the non-occlusion recording index according to the association relationship, and acquiring according to the identifier of the occlusion recording file included in the occlusion recording index Corresponding to the one or more video files of the first occlusion area; and acquiring video data corresponding to the viewing time in one or more video files corresponding to the first occlusion area.

5. The method of claim 1 wherein:

And the first occlusion video data and the non-occlusion video data are sent to the first monitoring terminal, where the method includes: acquiring the first occlusion video data and the non-occlusion video data, specifically:

Generating an acquisition address of the non-occlusion video data and an acquisition address of the first occlusion video data, and sending the acquisition address to the first monitoring terminal, the acquisition address of the occlusion video data or the acquisition address of the occlusion video data The message includes a data type, and is used to indicate the view corresponding to the obtained address. The frequency data is occluded video data; and, according to the acquisition address of the non-occlusion video data, a media channel for transmitting the non-occlusion video data is established with the first monitoring terminal, according to the acquisition address of the non-occlusion video data. Obtaining the non-occlusion video data and transmitting the non-occlusion video data through the media channel;

Receiving, by the first monitoring terminal, a request that includes the acquiring address of the first occlusion video data, establishing, according to the acquiring address of the first occlusion video data, the first monitoring terminal, for sending the first occlusion a media channel of the video data, acquiring the first occlusion video data according to the acquired address of the first occlusion video data, and transmitting the first occlusion video data by using the media channel.

A method for implementing video occlusion, the method comprising:

7. The method of claim 6 wherein:

Before the combining the first occlusion video data and the non-occlusion video data, the method further includes: receiving description information of the first occlusion region sent by the monitoring platform;

The combining the first occlusion video data and the non-occlusion video data specifically includes: if the first occlusion video data includes one channel of video data, decoding the first occlusion video number Obtaining the occlusion video data frame, decoding the non-occlusion video data to obtain a non-occlusion video data frame, extracting pixel data in the occlusion video data frame, and adding the extracted pixel data to and according to the description information of the first occlusion region The occlusion video data frame has a pixel area corresponding to the first occlusion area in a non-occlusion video data frame of the same time stamp to generate a complete video frame, and plays the complete video frame; or

A method for implementing video occlusion, the method comprising:

The monitoring front-end device encodes the captured video picture into non-occlusion video data corresponding to the non-occlusion area and occlusion video data corresponding to the occlusion area according to the description information of the occlusion area;

The monitoring front-end device sends the non-occlusion video data and the occlusion video data to the monitoring platform, so that the monitoring platform determines, when determining that the user of the monitoring terminal has the right to acquire the first occlusion video data. The monitoring terminal sends the non-occlusion video data and the first occlusion video data, or sends the non-occlusion video to the monitoring terminal when it is determined that the user of the monitoring terminal does not have the right to acquire the first occlusion video data Data, the first occlusion video data corresponds to a first occlusion region, and the first occlusion region includes some or all of the occlusion regions.

9. The method of claim 8 wherein:

The encoding the captured video image into the occlusion video data corresponding to the occlusion region according to the description information of the occlusion region, specifically includes:

When the occlusion area includes an area, the video picture corresponding to the occlusion area in the captured video picture is encoded as one channel of video data; When the occlusion area includes a plurality of areas, the video picture corresponding to the plurality of areas included in the occlusion area in the captured video picture is encoded as one channel of video data, or the occlusion area included in the captured video picture is included The video pictures corresponding to the plurality of areas are respectively coded as one channel of video data, or the video pictures of the areas corresponding to the same rights among the plurality of areas included in the occlusion area in the captured video picture are encoded as one channel of video data.

10. The method of claim 8 wherein:

The encoding the captured video picture into the non-occlusion video data corresponding to the non-occlusion area according to the description information of the occlusion area, specifically: encoding the video picture corresponding to the non-occlusion area in the captured video picture directly into the non-occlusion The video data is occluded, or the video frame corresponding to the occlusion area in the captured video picture is padded with the set pixel value and encoded to generate the non-occlusion video data.

A monitoring platform, comprising: a video request receiving unit, a determining unit, an obtaining unit, and a video data sending unit;

The acquiring unit is configured to acquire non-occlusion video data, and is configured to acquire first occlusion video data when the determining result of the determining unit is YES;

The video data sending unit, configured to: when the determination result of the determining unit is yes, Transmitting, by the first monitoring terminal, the first occlusion video data and the non-occlusion video data acquired by the acquiring unit, so that the first monitoring terminal merges and plays the first occlusion video data and the non-occlusion video data, or Merging the first occlusion video data and the non-occlusion video data acquired by the acquiring unit to obtain the combined video data, and transmitting the combined video data to the first monitoring terminal; When the determination result of the determining unit is no, the non-occlusion video data acquired by the acquiring unit is sent to the first monitoring terminal.

12. The monitoring platform of claim 11 wherein:

The monitoring platform according to claim 11, wherein the monitoring platform further comprises: a storage unit and an association establishing unit;

The association relationship establishing unit is configured to establish the occlusion video file and the non-occlusion video file Relationship of pieces;

The video request receiving unit is specifically configured to receive a video request that is sent by the first monitoring terminal, including a viewing time;

The acquiring unit is specifically configured to acquire video data corresponding to the viewing time in the non-occlusion video file, and is specifically used to establish, according to the association relationship establishing unit, when the determining result of the determining unit is yes Obtaining one or more video files corresponding to the first occlusion area associated with the non-occlusion video file, and acquiring a video corresponding to the viewing time in one or more video files corresponding to the first occlusion area data.

A monitoring terminal, comprising: a video request sending unit, a video data receiving unit, and a playing unit;

The video data receiving unit is configured to receive, by the monitoring platform, the first occlusion video data that is sent when the user of the monitoring terminal has the right to acquire the first occlusion video data in the occlusion video data. The non-occlusion video data, the first occlusion video data corresponds to a first occlusion area, and the first occlusion area includes part or all of the occlusion area; The non-occlusion video data sent when the user of the monitoring terminal does not have the right to acquire the first occlusion video data in the occlusion video data;

The playing unit is configured to merge and play the first occlusion video data and the non-occlusion video data received by the video data receiving unit, or to play the non-occlusion video data received by the video data receiving unit. .

15. The monitoring terminal of claim 14, wherein

If the first occlusion video data includes one channel of video data, the playing unit is specifically configured to: decode the first occlusion video data to obtain an occlusion video data frame, and decode the non-occlusion video data to obtain a non-occlusion video data frame. Extracting pixel data in the occlusion video data frame according to the first occlusion region The description information of the domain adds the extracted pixel data to a pixel region corresponding to the first occlusion region in the non-occlusion video data frame having the same time stamp as the occlusion video data frame to generate a complete video frame, and plays the complete Video frame; or,

If the first occlusion video data includes multiple video data, the playing unit is specifically configured to: decode each video data in the first occlusion video data to obtain an occlusion video data frame of each video data, and decode the non-decoding video data frame. Blocking the video data to obtain a non-occlusion video data frame, extracting pixel data in the occlusion video data frame having the same time stamp of each video data, and adding the extracted pixel data to the same time stamp as the occlusion video data frame The pixel region corresponding to the first occlusion region in the non-occluded video data frame generates a complete video frame and plays the complete video frame.

A monitoring front-end device, wherein the monitoring front-end device comprises: a description information receiving unit, a video data encoding unit, and a video data transmitting unit;

The description information receiving unit is configured to receive description information of an occlusion area sent by the monitoring platform, where the video data encoding unit is configured to encode the captured video picture into a non-occlusion area according to the description information of the occlusion area. Occluding video data and occlusion video data corresponding to the occlusion area;

17. The monitoring front end device of claim 16 wherein:

The video data encoding unit is configured to: when the occlusion area includes an area, encode a video picture corresponding to the occlusion area in the captured video picture as one channel of video data according to the description information of the occlusion area; or When the occlusion area includes a plurality of areas, according to the occlusion area The description information of the domain encodes a video picture corresponding to the plurality of areas included in the occlusion area in the captured video picture as one video data, or a video corresponding to each of the multiple areas included in the occlusion area in the captured video picture The video image is encoded as one channel of video data, or the video image of the region corresponding to the same privilege in the plurality of regions included in the occlusion region of the captured video image is encoded as one channel of video data; specifically, according to the occlusion region The description information encodes the video picture corresponding to the non-occlusion area in the captured video picture as non-occlusion video data.

18. A video surveillance system, the video surveillance system comprising: a monitoring terminal and a monitoring platform;

The monitoring terminal is specifically the monitoring terminal according to claim 14 or 15;

The monitoring platform is specifically the monitoring platform according to any one of claims 1 to 13.

19. The video surveillance system of claim 18, wherein the video surveillance system further comprises a monitoring front end device;

The monitoring front-end device is specifically the monitoring front-end device according to claim 16 or 17.