WO2021115348A1

WO2021115348A1 - Cloud storage system providing preview function, and preview method and apparatus

Info

Publication number: WO2021115348A1
Application number: PCT/CN2020/135015
Authority: WO
Inventors: 李海燕; 梁明军
Original assignee: 杭州海康威视系统技术有限公司
Priority date: 2019-12-11
Filing date: 2020-12-09
Publication date: 2021-06-17
Also published as: CN111405237A

Abstract

A cloud storage system providing a preview function, and a preview method and apparatus. The method comprises: after a preview request is acquired from a target client, according to an identifier, in the preview request, of a monitoring device to be previewed, acquiring a target storage address of a cover picture of the monitoring device to be previewed that has a timestamp closest to the current moment, wherein the cover picture of the monitoring device to be previewed is generated on the basis of an I frame in video stream data of the monitoring device to be previewed that is received in real time; and sending the target storage address to the target client, so that the target client acquires and previews, according to the target storage address, the cover picture of the monitoring device to be previewed. A cover picture of a monitoring device is generated according to an I frame of the monitoring device, the cover picture of the monitoring device is sent to a client so that the client displays the cover picture of the monitoring device, and a user can visually determine the correlation between the monitoring device and a monitoring scenario according to the cover picture, thereby helping the user to visually understand the situation of a monitoring area.

Description

Cloud storage system providing preview function and preview method and device

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 11, 2019, with an application number of 201911267302.4 and the title of the invention "Cloud storage system with preview function and preview method", the entire content of which is incorporated herein by reference Applying.

Technical field

This application relates to the field of video storage technology, and in particular to a cloud storage system that provides a preview function, and a preview method and device.

Background technique

With the development of Internet technology and the improvement of people’s security awareness, surveillance equipment has gradually become popular, and more and more front-end surveillance devices are connected to the video cloud storage system, and more and more front-end points displayed on the interface of the video application platform . In the related video cloud storage technology, the video application platform generally distinguishes the monitoring equipment by the name of the point, that is, the name of each monitoring equipment is displayed on the display interface, and the user selects the video data of the specified monitoring equipment according to the name of the monitoring equipment To show.

However, using the above method to display the name of each monitoring device on the display interface, the user needs to memorize the corresponding relationship between the monitoring device and the monitoring scene, which is prone to errors when there are many front-end points, which is not conducive to the user's intuitive access to each monitoring device and monitoring scene The corresponding relationship is not conducive to the user's intuitive understanding of the monitoring area.

Summary of the invention

The purpose of the embodiments of the present application is to provide a cloud storage system that provides a preview function, and a preview method and device, so as to facilitate the user to intuitively understand the situation of the monitored area. The specific technical solutions are as follows:

In the first aspect, an embodiment of the present application provides a cloud storage system that provides a preview function, and the system includes:

Management node and multiple storage nodes;

The storage node is used to receive video stream data collected by a designated monitoring device in real time; extract I frames from the video stream data to generate a cover picture of the designated monitoring device; store the video stream data and the designated monitoring device The cover image of the device;

The management node is configured to obtain the storage address of the cover picture corresponding to the monitoring device to be previewed according to the identification of the monitoring device to be previewed in the preview request after receiving the preview request of the target client, as the target storage address , Wherein the cover picture is the cover picture whose time stamp is closest to the current moment, and the target storage address includes the address of the storage node that stores the cover picture of the monitoring device to be previewed;

The target storage address is sent to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.

In a possible implementation manner, the storage node is specifically configured to store the cover picture of the designated monitoring device in a system disk of the storage node.

In a possible implementation manner, the storage node is further configured to send the storage address of the cover picture of the designated monitoring device and the identification of the designated monitoring device to the management node;

The management node is further configured to receive the storage address of the cover picture of the designated monitoring device and the identifier of the designated monitoring device; and store the storage address of the cover picture of the designated monitoring device and the identifier of the designated monitoring device in association.

In a possible implementation manner, the storage node is specifically used for:

Judging whether the historical cover picture of the designated monitoring device is stored in the storage node;

If yes, delete the historical cover picture of the designated monitoring device, and store the currently generated cover picture of the designated monitoring device;

If not, store the currently generated cover picture of the designated monitoring device.

In a possible implementation manner, the management node is further configured to: upon receiving the display request of the target client for the video stream data of the target monitoring device, obtain the fetching of the video stream data of the target monitoring device. Streaming address; return the streaming address to the target client, so that the target client obtains the video stream data of the target monitoring device according to the streaming address, and displays the video of the target monitoring device Stream data.

In the second aspect, an embodiment of the present application provides a preview method, and the method includes:

After obtaining the preview request of the target client, according to the identification of the monitoring device to be previewed in the preview request, the target storage address of the cover image corresponding to the monitoring device to be previewed is obtained, where the cover image is a timestamp and The cover picture closest to the current moment, the target storage address includes the address of a storage node that stores the cover picture of the monitoring device to be previewed, and the cover picture of the monitoring device to be previewed is based on the monitoring device to be previewed received in real time Generated from the I frame in the video stream data;

In a possible implementation manner, the method further includes:

Receiving the video stream data collected by the monitoring device to be previewed in real time;

Extracting an I frame with a time stamp closest to the current time from the video data;

Based on the extracted I frame, generate the latest cover picture of the monitoring device to be previewed;

The cover picture of the monitoring device to be previewed is stored in the storage node.

In a possible implementation manner, the storing the cover picture of the monitoring device to be previewed in a storage node includes:

The cover picture of the monitoring device to be previewed is stored in the system disk of the storage node.

In a possible implementation manner, the extracting the I frame whose time stamp is closest to the current time from the video data includes:

According to the preset sampling period, when the designated sampling time is reached, the first I frame in the video stream data of the monitoring device to be previewed is extracted from the designated sampling time.

Determine whether the historical cover picture of the monitoring device to be previewed is stored in the storage node;

If yes, delete the historical cover picture of the monitoring device to be previewed, and store the currently generated cover picture of the monitoring device to be previewed;

If not, store the currently generated cover picture of the monitoring device to be previewed.

In a third aspect, an embodiment of the present application provides a preview device, which includes:

The storage address obtaining module is used to obtain the target of the cover image whose time stamp of the monitoring device to be previewed is closest to the current moment according to the identification of the monitoring device to be previewed in the preview request after obtaining the preview request of the target client A storage address, wherein the target storage address includes the address of a storage node that stores the cover picture of the monitoring device to be previewed, and the cover picture of the monitoring device to be previewed is based on the video stream of the monitoring device to be previewed received in real time Generated by the I frame in the data;

The storage address sending module is configured to send the target storage address to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.

In a possible implementation manner, the device further includes:

The video stream data receiving module is configured to receive the video stream data collected in real time by the monitoring device to be previewed;

The I frame extraction module is used to extract the I frame whose time stamp is closest to the current time from the video data;

A cover picture generating module, configured to generate the latest cover picture of the monitoring device to be previewed based on the extracted I frame;

The cover picture storage module is used to store the cover picture of the monitoring device to be previewed in the storage node.

In a possible implementation manner, the cover picture storage module is specifically configured to store the cover picture of the monitoring device to be previewed in the system disk of the storage node.

In a possible implementation manner, the I frame extraction module is specifically configured to: according to a preset sampling period, when the specified sampling time is reached, start to extract the video stream of the monitoring device to be previewed from the specified sampling time The first I frame in the data.

In a possible implementation manner, the cover picture storage module is specifically configured to: determine whether the historical cover picture of the monitoring device to be previewed is stored in the storage node; if so, delete the history of the monitoring device to be previewed Cover picture, and store the currently generated cover picture of the monitoring device to be previewed; if not, store the currently generated cover picture of the monitoring device to be previewed.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory;

The memory is used to store computer programs;

The processor is configured to implement any preview method described in this application when executing the program stored on the memory.

In the fifth aspect, an embodiment of the present application provides a computer-readable storage medium in which a computer program is stored, and when the computer program is executed by a processor, the preview described in any of the present applications is implemented. method.

In a sixth aspect, an embodiment of the present application provides a computer program product that, when executed by a processor, implements any preview method described in the present application.

The cloud storage system and preview method and device that provide preview functions provided by the embodiments of the application generate the cover picture of the monitoring device according to the I frame of the monitoring device, and send the cover picture of the monitoring device to be previewed to the client so that the client can display the waiting Preview the cover picture of the monitoring device, and the user can intuitively determine the corresponding relationship between the monitoring device and the monitoring scene based on the cover picture, which is helpful for the user to intuitively understand the situation of the monitoring area. Of course, implementing any product or method of the present application does not necessarily need to achieve all the advantages described above at the same time.

Description of the drawings

In order to explain the embodiments of the present application and the technical solutions of the prior art more clearly, the following briefly introduces the drawings that need to be used in the embodiments and the prior art. Obviously, the drawings in the following description are merely the present invention. For some of the embodiments of the application, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a first schematic diagram of a cloud storage system that provides a preview function according to an embodiment of the application;

FIG. 2 is a second schematic diagram of a cloud storage system that provides a preview function according to an embodiment of the application;

FIG. 3 is a schematic diagram of a method for generating a cover image according to an embodiment of the application;

FIG. 4 is a first schematic diagram of a preview method according to an embodiment of the application;

FIG. 5 is a second schematic diagram of a preview method according to an embodiment of the application;

FIG. 6 is a schematic diagram of a cover image storage method according to an embodiment of the application;

FIG. 7 is a schematic diagram of interaction between a client and a cloud storage system according to an embodiment of the application;

FIG. 8 is a first schematic diagram of a preview device according to an embodiment of the application;

FIG. 9 is a second schematic diagram of a preview device according to an embodiment of the application;

FIG. 10 is a schematic diagram of an electronic device according to an embodiment of the application.

Detailed ways

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

First, explain the technical terms in the embodiments of this application:

Video cloud storage: Based on a distributed storage architecture, a storage system used to store video data of various video front-end devices.

I frame: the key frame in the video stream.

Cover image: For a certain front-end monitoring device, a picture of the video collected at a certain moment.

Frame analysis: Analyze the video code stream generated by the front-end equipment to obtain the I frame, P frame and other related frame information in the code stream. The frame analysis process does not change the source data of the code stream.

In related technologies, the video application platform generally distinguishes surveillance equipment by point names, displays the name of each surveillance equipment on the display interface, and the user selects the video data of the designated surveillance equipment for display according to the name of the surveillance equipment. However, using the above method to display the name of each monitoring device on the display interface is not conducive to the user's intuitive acquisition of the corresponding relationship between each monitoring device and the monitoring scene, and it is not conducive to the user's intuitive understanding of the monitoring area.

In view of this, an embodiment of the present application provides a cloud storage system that provides a preview function. Referring to FIG. 1, the system includes:

Management node 11 and multiple storage nodes 12;

The storage node 12 is used to receive the video stream data collected by the designated monitoring device in real time; extract I frames from the video stream data to generate the cover picture of the designated monitoring device; store the video stream data and the cover picture of the designated monitoring device.

The management node 11 is used to obtain the storage address of the cover image whose time stamp of the monitoring device to be previewed is closest to the current time according to the identification of the monitoring device to be previewed in the preview request after receiving the preview request of the target client, as the target storage Address, where the target storage address includes the address of the storage node that stores the cover image of the monitoring device to be previewed; the target storage address is sent to the target client, so that the target client obtains and previews the cover of the monitoring device to be previewed according to the target storage address image.

In the cloud storage system, the storage node 12 is used to store the video stream data of the designated monitoring device. The storage node 12 receives the video stream data collected by the designated monitoring device in real time, extracts I frames from the video stream data, and generates a cover picture of the designated monitoring device according to the extracted I frames. The storage node 12 stores video stream data and cover pictures. The storage node 12 extracts the I frame to generate the cover picture, because the I frame decoded into an image consumes the lowest computing performance, which can save the computing resources of the storage node 12.

In order to ensure the immediacy of cover picture generation, a cover picture can be generated immediately after the monitoring device is connected to the storage node, that is, as soon as the storage node obtains the code stream (video stream data) of the monitoring device, it will immediately analyze it from the code stream The I frame is output, and the relevant algorithm is called to convert the I frame data into a picture format. After that, the cover picture of the monitoring device can be generated according to a preset sampling period (such as half an hour, etc.). In an implementation manner, the storage node may delete the previously generated cover picture of the monitoring device, and save the newly generated cover picture of the monitoring device. Therefore, for each monitoring device, only one cover picture of the monitoring device can be saved to save storage resources of the storage node.

When the user wants to preview the cover picture, the target client is used to send a preview request to the management node 11, and the preview request includes the identification of the monitoring device to be previewed (the preview monitoring device may be multiple). According to the identification of the monitoring device to be previewed, the management node obtains the storage address of the cover picture whose time stamp is closest to the current moment in the cover picture of the monitoring device to be previewed, as the target storage address. The time stamp of the cover picture may be the time stamp of the I frame in which the cover picture is generated, the time when the cover picture is generated, or the time when the cover image is stored, and so on. The target storage address includes the address of the storage node that stores the corresponding cover picture, and may also include the storage path of the corresponding cover picture in the storage node. The target client downloads the corresponding cover picture according to the target storage address and displays it.

In a possible implementation manner, in order to ensure information security, after the management node 11 receives a preview request of the target client for the cover image of the monitoring device to be previewed, the management node 11 may also verify whether the target client has a preview request for the monitoring device to be previewed. The use permission of the monitoring device, when the target client has the use permission for the monitoring device to be previewed, the cover image of the monitoring device to be previewed is sent to the target client; when the target client does not have the use permission for the monitoring device to be previewed, Return an error message to the client.

In the embodiment of the present application, when the storage node stores the video stream data of the monitoring device, it will also store the cover picture of the monitoring device generated by the I frame. Send the cover picture of the monitoring device to be previewed to the client so that the client can display the cover picture of the monitoring device to be previewed. The user can intuitively determine the corresponding relationship between the monitoring device and the monitoring scene based on the cover picture, which is conducive to the user's intuitive understanding of the monitoring area Happening. And the client shows the cover picture whose time stamp is closest to the current time, which can increase the real-time nature of the cover picture.

The cover picture can be stored in the system disk of the storage node. In a possible implementation manner, the aforementioned storage node 12 is specifically configured to store the cover picture of the designated monitoring device in the system disk of the storage node.

The cloud storage system may be a distributed storage system. In a possible implementation manner, the architecture of the cloud storage system may be specifically as shown in Figure 2. The management node is used to balance the load of each storage node and perform processing on each storage node. Management; the storage node is used to generate each cover picture, and is used to store the video stream data and the cover picture. Storage nodes include system disks and data disks. Because the cover image is mainly used to provide the platform client for extraction and display, and it is not certain when the platform client needs to extract the cover image for display, it is also necessary to store the cover image to provide it for different platform clients at any time Cover image display service.

The extraction of cover pictures is instantaneous, and there is a need to quickly display cover pictures of a large number of surveillance equipment. The inventor found in research that if the cover picture is stored in a data disk and stored together with the video stream data, frequent reading and writing of the cover picture will have an impact on the storage performance of the video stream data. In addition, since the video stream data storage in the data disk is generally used by virtualizing it into a resource pool, a special space is needed to store the cover image, which is cumbersome to implement. However, storing the cover picture in the system disk of the storage node is simple to implement and can reduce the impact on the storage of video stream data.

In a possible implementation manner, the above-mentioned storage node 12 is specifically used to: determine whether the historical cover picture of the designated monitoring device is stored in the storage node; if so, delete the historical cover picture of the designated monitoring device and store the currently generated The cover picture of the designated monitoring device; if not, the currently generated cover picture of the designated monitoring device is stored.

For each designated monitoring device connected to the storage node, the storage node detects whether the historical cover picture of the designated monitoring device is stored locally; if so, deletes the historical cover picture of the designated monitoring device, and stores the currently generated designated monitoring The cover picture of the device; if not, the currently generated cover picture of the specified monitoring device is stored. The above-mentioned deleting the historical cover picture of the designated monitoring device and storing the currently generated cover picture of the designated monitoring device can be equivalently replaced with: covering the historical cover picture of the designated monitoring device through the currently generated cover picture of the designated monitoring device.

In order to save storage space, only one latest cover picture can be saved for each monitoring device. Taking into account that the number of monitoring devices that each storage node is responsible for is limited, generally less than 500 channels, and each monitoring device only needs to store one cover image, calculated according to the cover image size of 2MB (megabytes), the total required The storage space is about 1GB (gigabytes). After the cover pictures of all connected monitoring devices are generated, the storage space occupied by the cover pictures will not continue to grow. Therefore, for each storage node, the cover image of each monitoring device connected to the storage node can be stored in the system disk of the storage node. For example, a new directory can be created in the system disk of the storage node to store the cover image .

In a possible implementation manner, the above-mentioned storage node 12 is also used to send the storage address of the cover picture of the designated monitoring device and the identification of the designated monitoring device to the management node.

The above-mentioned management node 11 is also used to receive the storage address of the cover picture of the designated monitoring device and the identification of the designated monitoring device; and store the storage address of the cover picture of the designated monitoring device and the identification of the designated monitoring device in association.

For example, as shown in Figure 3, the designated storage node obtains the cover picture of the designated monitoring device; writes the cover picture to the system disk of the designated storage node; the designated storage node will specify the identification of the monitoring device and the storage path of the designated monitoring device cover picture ( That is, the storage address) is reported to the management node; the management node associates and stores the identification of the designated monitoring device and the storage path of the cover picture of the designated monitoring device, for example, it can be stored in the database of the management node.

The associated storage methods here include but are not limited to labels, tables, pointers, and so on. The purpose of associative storage is to facilitate the subsequent quick acquisition of the cover picture of the monitoring device according to the identification of the monitoring device. In the embodiment of the present application, the management node 11 stores the storage address of the cover image of the designated monitoring device and the identification of the designated monitoring device in association, so that the management node 11 can subsequently query the storage address of the cover image of the designated monitoring device according to the identification of the designated monitoring device. .

In a possible implementation manner, the above-mentioned management node 11 is further configured to: upon receiving the display request of the target client for the video stream data of the target monitoring device, obtain the streaming address of the video stream data of the target monitoring device; The target client returns the fetching address, so that the target client obtains the video stream data of the target monitoring device according to the fetching address, and displays the video stream data of the target monitoring device.

The target monitoring device may be one or more of the monitoring devices to be previewed. The user can select the video stream data for display according to the cover picture. When receiving the display request of the target client for the video stream data of the target monitoring device, the management node 11 obtains the streaming address of the video stream data of the target monitoring device; The terminal returns the fetching address so that the target client can obtain and display the video stream data of the target monitoring device according to the fetching address.

The embodiment of the present application provides a preview method. Referring to FIG. 4, the method includes:

S401: After obtaining the preview request of the target client, according to the identification of the monitoring device to be previewed in the preview request, obtain the target storage address of the cover image whose timestamp of the monitoring device to be previewed is closest to the current moment, where the target storage address includes The address of the storage node that stores the cover picture of the monitoring device to be previewed. The cover picture of the monitoring device to be previewed is generated based on the I frame in the video stream data of the monitoring device to be previewed received in real time.

The monitoring device to be previewed can be any monitoring device, and the cloud storage system is responsible for storing the video stream data collected by each monitoring device. In the embodiment of this application, a monitoring device (that is, the monitoring device to be previewed) is taken as an example for description. Those skilled in the art can understand that each monitoring device connected to the cloud storage system can execute the preview method of the embodiment of this application. .

S402: Send the target storage address to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.

After receiving the preview request of the target client for the cover image of the monitoring device to be previewed, send the cover image of the monitoring device to be previewed to the target client

The preview method of the embodiment of the present application is applied to a cloud storage system, so it can be executed by the cloud storage system. Specifically, it can be executed by the management node and the storage node in the cloud storage system. For example, steps S401 and S402 can be implemented by the management node. The storage node is used to store the cover picture.

In the embodiment of this application, the cover picture of the monitoring device to be previewed is sent to the client so that the client can display the cover picture of the monitoring device to be previewed. The user can intuitively determine the correspondence between the monitoring device and the monitoring scene based on the cover picture, which is beneficial to The user intuitively understands the situation of the monitoring area. And the client shows the cover picture whose time stamp is closest to the current time, which can increase the real-time nature of the cover picture.

In a possible implementation manner, referring to FIG. 5, the above method further includes:

S501: Receive video stream data collected in real time by a monitoring device to be previewed.

S502: Extract the I frame whose time stamp is closest to the current time from the video data.

The storage node of the cloud storage system receives the video stream data collected in real time by the monitoring device to be previewed, and can identify the I frame in the video stream data through frame analysis technology, and extract the I frame with the time stamp closest to the current moment. In a possible implementation manner, the above-mentioned extracting the I frame whose time stamp is closest to the current time from the video data includes: according to a preset sampling period, when the specified sampling time is reached, extract the to-be-reviewed monitoring from the specified sampling time. The first I frame in the device's video stream data.

In order to ensure the immediacy of cover image generation, a cover image can be generated immediately after the monitoring device is connected to the cloud storage system, that is, as soon as the storage node of the cloud storage system obtains the code stream of the monitoring device, it will be analyzed from the code stream immediately The I frame is generated, and the relevant algorithm is called to convert the I frame data into a picture format. After that, the cover picture of the monitoring device can be generated according to a preset sampling period (such as half an hour, etc.). In an implementation manner, the previously generated historical cover picture of the monitoring device may be deleted, and the newly generated cover picture of the monitoring device may be saved. Therefore, for each monitoring device, only one cover picture of the monitoring device can be saved in the cloud storage system.

Those skilled in the art can understand that the I frame whose receiving time is closest to the designated sampling time can also be selected, or the I frame whose receiving time is before the designated sampling time and whose receiving time is closest to the designated sampling time can also be selected. However, according to the receiving time of each video frame in the video stream data, the first I frame in the video stream data is extracted from the current time. Compared with extracting the I frame before the specified sampling time, there is no need to go to the storage node to read the data. , Which can reduce the processing pressure of storage nodes and improve the generation efficiency of cover pictures.

S503: Generate the latest cover picture of the monitoring device to be previewed based on the extracted I frame.

The storage node of the cloud storage system processes the I frame through a related decoding method to obtain an image of the I frame, that is, the cover image of the monitoring device to be previewed.

S504: Store the cover picture of the monitoring device to be previewed in the storage node.

When the client needs to extract the cover picture for display is random, so the storage node of the cloud storage system also needs to store the cover picture to provide cover picture display services for different clients at any time. In a possible implementation manner, referring to FIG. 6, the foregoing storing the cover picture of the monitoring device to be previewed in the storage node includes:

S5041: Determine whether a historical cover picture of the monitoring device to be previewed is stored in the storage node.

S5042: If yes, delete the historical cover picture of the monitoring device to be previewed, and store the currently generated cover picture of the monitoring device to be previewed.

S5043: If not, store the currently generated cover picture of the monitoring device to be previewed.

In a possible implementation manner, the cover picture of the monitoring device to be previewed is stored in the system disk of the storage node.

The cloud storage system may be a distributed storage system. In a possible implementation, the architecture of the cloud storage system may be as shown in Figure 2. The management node is used to balance the load of each storage node and manage each storage node , The storage node is used to generate each cover picture, and is used to store the video stream data and the cover picture. Storage nodes include system disks and data disks. Because the cover image is mainly used to provide the platform client for extraction and display, and it is not certain when the client needs to extract the cover image for display, the cover image can also be stored to provide cover for different platform clients at any time Picture display service.

The extraction of cover pictures is instantaneous, and there is a need to quickly display cover pictures of a large number of surveillance equipment. The inventor found in research that if the cover picture is stored in a data disk and stored together with the video stream data, frequent reading and writing of the cover picture will have an impact on the storage performance of the video stream data. In addition, because the video stream data storage in the data disk is generally used by virtualizing it into a resource pool, a special space is needed to store the cover picture, which is cumbersome to implement. Taking into account that the number of monitoring devices that each storage node is responsible for is limited, generally less than 500 channels, and each monitoring device only needs to store one cover image, calculated according to the cover image size of 2MB (megabytes), the total required The storage space is about 1GB (gigabytes). After the cover pictures of all connected monitoring devices are generated, the storage space occupied by the cover pictures will not continue to grow. Therefore, for each storage node, the cover image of the monitoring device accessed by the storage node can be stored in the system disk of the storage node. For example, a new directory can be created in the system disk of the storage node to store the cover image.

The embodiment of the present application also provides a preview method, which is applied to the client, and the method includes:

Step A: Send a preview request for the cover picture of the monitoring device to be previewed to the cloud storage system.

The preview method of the embodiment of the present application is applied to the client, and therefore can be implemented by the client. Specifically, the client can be a personal computer or a smart phone and other devices.

The monitoring device to be previewed can be any monitoring device, and the cloud storage system is responsible for storing the video stream data collected by the monitoring device to be previewed. When the cover picture of the monitoring device to be previewed needs to be displayed, the client generates a preview request for the cover picture of the monitoring device to be previewed, and sends the preview request to the cloud storage system.

Step B: Receive the cover picture of the monitoring device to be previewed returned by the cloud storage system, where the cover picture of the monitoring device to be previewed is generated based on the I frame of the video stream data collected by the monitoring device to be previewed.

The client receives the cover picture of the monitoring device to be previewed returned by the cloud storage system. For the generation process of the cover picture of the monitoring device to be previewed, please refer to the generation process of the cover picture in the above preview method, which will not be repeated here.

Step C: At the preview position corresponding to the monitoring device to be previewed, the cover picture of the monitoring device to be previewed is displayed.

The client displays the cover picture of the monitoring device to be previewed in the preview position corresponding to the monitoring device to be previewed. Those skilled in the art can understand that different preview positions are set in advance for different monitoring devices in the client, and the client can send a preview request for the cover image of one or more monitoring devices. For each monitoring device, the cover picture of the monitoring device needs to be displayed at the corresponding preview position of the monitoring device.

In a possible implementation manner, the data interaction process between the cloud storage system and the client can be shown in FIG. 7, wherein the architecture of the cloud storage system is shown in FIG. 2. 1. The client sends a preview request for the cover image of the target monitoring device to the management node; 2. The management node queries the database for the storage path of the cover image of the target monitoring device according to the identification of the target monitoring device; 3. The management node obtains the database The storage path of the cover picture of the returned target monitoring device; 4. The management node returns the storage path of the cover picture of the target monitoring device to the client; 5. The client performs the storage path according to the storage path of the cover picture of the target monitoring device from the corresponding storage node Get the stream; 6. The client obtains the cover picture of the target monitoring device.

In the embodiment of this application, the cover picture of the target monitoring device in the cloud storage system is obtained. The cover picture is generated according to the I frame of the target monitoring device; and the cover picture of the target monitoring device is displayed in the display area corresponding to the target monitoring device. The corresponding relationship between the monitoring equipment and the monitoring scene can be determined intuitively based on the cover picture, which is conducive to the user's intuitive understanding of the monitoring area.

In a possible implementation manner, the user can play the video stream data through the cover picture. The preview method applied to the client in the embodiment of the present application further includes:

Step 1: When the user's trigger instruction for the cover image of the target monitoring device is obtained, the video stream data display instruction for the target monitoring device is generated.

The target monitoring device can be any monitoring device. The user's trigger instruction for the cover image of the target monitoring device can be generated after the user clicks the cover image or related buttons of the target monitoring device through the mouse, or generated after the user clicks the cover image or related buttons of the target monitoring device through the touch screen , Are all within the protection scope of this application.

Step 2: Send a video stream data display instruction for the target monitoring device, so that the cloud storage system returns the video stream data of the target monitoring device after receiving the video stream data display instruction for the target monitoring device.

The client sends a video stream data display instruction for the target monitoring device to the cloud storage system. After receiving the display instruction, the cloud storage system returns the video stream data of the target monitoring device to the client.

Step 3: Obtain the video stream data of the above-mentioned target monitoring device, and display the video stream data of the above-mentioned target monitoring device.

The client receives the video stream data of the target monitoring device, and displays the video stream data of the target monitoring device in a preset display window.

The embodiment of the present application also provides a preview system, which includes:

Cloud storage system and client;

The above cloud storage system is used to obtain the video stream data collected by the target monitoring device; extract the I frame in the above video stream data; generate the cover picture according to the above I frame;

The above client is configured to send a preview request for the cover picture of the target monitoring device to the cloud storage system;

The cloud storage system is further configured to send the cover picture of the target monitoring device to the client that sent the preview request after receiving the preview request for the cover picture of the target monitoring device;

The client is also used to receive the cover image of the target monitoring device returned by the cloud storage system; and display the cover image of the target monitoring device in the preview position corresponding to the target monitoring device.

In a possible implementation manner, the aforementioned cloud storage system may also implement any of the foregoing preview methods applied to the cloud storage system, and the foregoing client may also implement any of the foregoing preview methods applied to the client.

In a possible implementation manner, the preview system further includes: multiple monitoring devices;

The aforementioned monitoring equipment is used to collect video stream data in a designated monitoring area and send the collected video stream data to the aforementioned cloud storage system.

The embodiment of the present application also provides a preview device. Referring to FIG. 8, the device includes:

The storage address obtaining module 801 is configured to obtain the target storage of the cover image whose time stamp of the monitoring device to be previewed is closest to the current time according to the identification of the monitoring device to be previewed in the preview request after obtaining the preview request of the target client Address, wherein the target storage address includes the address of a storage node that stores the cover picture of the monitoring device to be previewed, and the cover picture of the monitoring device to be previewed is based on the I frame in the video stream data of the monitoring device to be previewed received in real time Generated;

The storage address sending module 802 is configured to send the target storage address to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.

In a possible implementation manner, the foregoing device further includes:

The video stream data receiving module is used to receive the video stream data collected by the monitoring device to be previewed in real time;

The I-frame extraction module is used to extract the I-frame whose time stamp is closest to the current time from the above-mentioned video data;

A cover picture generation module for generating the latest cover picture of the monitoring device to be previewed based on the extracted I frame;

In a possible implementation manner, the aforementioned I-frame extraction module is specifically configured to: according to a preset sampling period, when the specified sampling time is reached, start to extract the video stream data of the aforementioned monitoring device to be previewed from the specified sampling time. The first frame I frame.

In a possible implementation manner, the cover picture storage module is specifically configured to: determine whether the historical cover picture of the monitoring device to be previewed is stored in the storage node; if so, delete the historical cover picture of the monitoring device to be previewed, And store the currently generated cover picture of the aforementioned monitoring device to be previewed; if not, store the currently generated cover picture of the aforementioned monitoring device to be previewed.

The embodiment of the present application also provides a preview device. Referring to FIG. 9, it is applied to a client terminal, and the device includes:

The picture preview request module 901 is configured to send a preview request for the cover picture of the target monitoring device to the cloud storage system;

The cover picture receiving module 902 is configured to receive the cover picture of the target monitoring device returned by the cloud storage system, where the cover picture of the target monitoring device is generated based on the I frame of the video stream data collected by the target monitoring device of;

The cover picture display module 903 is configured to display the cover picture of the target monitoring device in the preview position corresponding to the target monitoring device.

Optionally, the preview device applied to the client in the embodiment of the present application further includes:

The video preview request module is configured to generate a video stream data display instruction for the target monitoring device when the user's triggering instruction for the cover image of the target monitoring device is obtained;

The video data receiving module is configured to send a video stream data display instruction for the target monitoring device, so that the cloud storage system returns to the target monitoring device after receiving the video stream data display instruction for the target monitoring device Video streaming data of the device;

The video data display module is used to obtain the video stream data of the target monitoring device and display the video stream data of the target monitoring device.

The embodiment of the present application also provides an electronic device, including: a processor and a memory;

The above-mentioned memory is used to store computer programs

When the processor is used to execute the computer program stored in the memory, the following steps are implemented:

Send a preview request for the cover image of the target monitoring device to the cloud storage system;

Receiving the cover picture of the target monitoring device returned by the cloud storage system, where the cover picture of the target monitoring device is generated based on the I frame of the video stream data collected by the target monitoring device;

At the preview position corresponding to the above-mentioned target monitoring device, the cover picture of the above-mentioned target monitoring device is displayed.

Optionally, referring to FIG. 10, in addition to the processor 1001 and the memory 1003, the electronic device of the embodiment of the present application further includes a communication interface 1002 and a communication bus 1004. The processor 1001, the communication interface 1002, and the memory 1003 pass through the communication bus 1004 Complete the communication between each other.

Optionally, when the above-mentioned processor is used to execute the computer program stored in the above-mentioned memory, it can also implement any one of the above-mentioned preview methods applied to the client.

The communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above-mentioned electronic device and other devices.

The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located far away from the foregoing processor.

The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), a dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

An embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any one of the above-mentioned preview methods applied to a cloud storage system is implemented.

An embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any one of the above-mentioned preview methods applied to the client is implemented.

The embodiment of the present application provides a computer program product, which, when the computer program product is executed by a processor, implements any one of the preview methods applied to a cloud storage system.

The embodiment of the present application provides a computer program product, which implements any one of the above-mentioned preview methods applied to the client when the computer program product is executed by a processor.

It should be noted that, in this article, the technical features in each optional solution can be combined to form a solution as long as there is no contradiction, and these solutions are all within the scope of the disclosure of the present application. Relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship between these entities or operations or order. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.

The various embodiments in this specification are described in a related manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.

The above descriptions are only preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in this application Within the scope of protection.

Claims

A cloud storage system providing preview function, characterized in that the system includes:

Management node and multiple storage nodes;

The storage node is used to receive video stream data collected by a designated monitoring device in real time; extract I frames from the video stream data to generate a cover picture of the designated monitoring device; store the video stream data and the designated monitoring device The cover image of the device;

The management node is configured to obtain the storage address of the cover picture corresponding to the monitoring device to be previewed according to the identification of the monitoring device to be previewed in the preview request after receiving the preview request of the target client, as the target storage address , Wherein the cover picture is the cover picture whose time stamp is closest to the current moment, and the target storage address includes the address of the storage node that stores the cover picture of the monitoring device to be previewed;

The target storage address is sent to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.
The cloud storage system according to claim 1, wherein the storage node is specifically configured to store the cover picture of the designated monitoring device in a system disk of the storage node.
The cloud storage system according to claim 1, wherein the storage node is further configured to send the storage address of the cover picture of the designated monitoring device and the identification of the designated monitoring device to the management node;

The management node is further configured to receive the storage address of the cover picture of the designated monitoring device and the identifier of the designated monitoring device; and store the storage address of the cover picture of the designated monitoring device and the identifier of the designated monitoring device in association.
The cloud storage system according to claim 1, wherein the storage node is specifically used for:

Judging whether the historical cover picture of the designated monitoring device is stored in the storage node;

If yes, delete the historical cover picture of the designated monitoring device, and store the currently generated cover picture of the designated monitoring device;

If not, store the currently generated cover picture of the designated monitoring device.
The cloud storage system according to claim 1, wherein the management node is further configured to: upon receiving the display request of the target client for the video stream data of the target monitoring device, obtain the target monitoring device The streaming address of the video stream data; the streaming address is returned to the target client, so that the target client obtains the video streaming data of the target monitoring device according to the streaming address, and displays all Describe the video stream data of the target monitoring device.
A preview method, characterized in that the method includes:

After obtaining the preview request of the target client, according to the identification of the monitoring device to be previewed in the preview request, the target storage address of the cover image corresponding to the monitoring device to be previewed is obtained, where the cover image is a timestamp and The cover picture closest to the current moment, the target storage address includes the address of a storage node that stores the cover picture of the monitoring device to be previewed, and the cover picture of the monitoring device to be previewed is based on the monitoring device to be previewed received in real time Generated from the I frame in the video stream data;

The target storage address is sent to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.
The method according to claim 6, wherein the method further comprises:

Receiving the video stream data collected by the monitoring device to be previewed in real time;

Extracting an I frame with a time stamp closest to the current time from the video data;

Based on the extracted I frame, generate the latest cover picture of the monitoring device to be previewed;

The cover picture of the monitoring device to be previewed is stored in the storage node.
The method according to claim 7, wherein the storing the cover picture of the monitoring device to be previewed in a storage node comprises:

The cover picture of the monitoring device to be previewed is stored in the system disk of the storage node.
8. The method according to claim 7, wherein the extracting the I frame whose time stamp is closest to the current time from the video data comprises:

According to the preset sampling period, when the designated sampling time is reached, the first I frame in the video stream data of the monitoring device to be previewed is extracted from the designated sampling time.
The method according to claim 7, wherein the storing the cover picture of the monitoring device to be previewed in a storage node comprises:

Determine whether the historical cover picture of the monitoring device to be previewed is stored in the storage node;

If yes, delete the historical cover picture of the monitoring device to be previewed, and store the currently generated cover picture of the monitoring device to be previewed;

If not, store the currently generated cover picture of the monitoring device to be previewed.
A preview device, characterized in that the device includes:

The storage address obtaining module is used to obtain the target of the cover image whose time stamp of the monitoring device to be previewed is closest to the current moment according to the identification of the monitoring device to be previewed in the preview request after obtaining the preview request of the target client A storage address, wherein the target storage address includes the address of a storage node that stores the cover picture of the monitoring device to be previewed, and the cover picture of the monitoring device to be previewed is based on the video stream of the monitoring device to be previewed received in real time Generated by the I frame in the data;

The storage address sending module is configured to send the target storage address to the target client, so that the target client obtains and previews the cover picture of the monitoring device to be previewed according to the target storage address.
The device according to claim 11, wherein the device further comprises:

The video stream data receiving module is configured to receive the video stream data collected in real time by the monitoring device to be previewed;

The I frame extraction module is used to extract the I frame whose time stamp is closest to the current time from the video data;

A cover picture generating module, configured to generate the latest cover picture of the monitoring device to be previewed based on the extracted I frame;

The cover picture storage module is used to store the cover picture of the monitoring device to be previewed in the storage node.
The apparatus according to claim 12, wherein the cover picture storage module is specifically configured to store the cover picture of the monitoring device to be previewed in a system disk of a storage node.
The device according to claim 12, wherein the I-frame extraction module is specifically configured to: according to a preset sampling period, when a specified sampling time is reached, extract the to-be-reviewed monitor from the specified sampling time. The first I frame in the device's video stream data.
The apparatus according to claim 12, wherein the cover image storage module is specifically configured to: determine whether the historical cover image of the monitoring device to be previewed is stored in the storage node; if so, delete the to be previewed The historical cover picture of the monitoring device is stored and the currently generated cover picture of the monitoring device to be previewed is stored; if not, the currently generated cover picture of the monitoring device to be previewed is stored.