CN117714799A - Data processing method, device, equipment, storage medium and system - Google Patents

Abstract

The application provides a data processing method, a device, equipment, a storage medium and a system, wherein the method comprises the following steps: receiving a video playing request aiming at a target monitoring point position and sent by a client; distributing the I-frame video data to the client under the condition that the I-frame video data of the target monitoring point position exists in the second buffer memory; and acquiring video data of the target monitoring point location and forwarding the video data to the client. The method can improve the first screen drawing speed of the video picture when the client plays the video.

Description

Data processing method, device, equipment, storage medium and system

Technical Field

The present disclosure relates to the field of video playing technologies, and in particular, to a data processing method, apparatus, device, storage medium, and system.

Background

With the development of video monitoring technology, video monitoring is becoming more and more popular, and the situation of a monitored area can be known through video data collected by the front end of video monitoring.

For example, a user may obtain video data collected by the video monitoring front end through the client and through the streaming media server.

When a user plays the acquired video data through the client, the first picture (i.e. the first screen picture) must have an I frame before playing, so that for the video data acquired from the video monitoring front end, the streaming media server needs to perform frame analysis on the video data first, and forward the I frame to the client under the condition that the I frame is analyzed, so as to ensure normal playing of the video.

In the video playing scheme, after the client requests to play the video data, the idle window period of video playing occurs before the streaming media server analyzes the I frame.

Disclosure of Invention

In view of the foregoing, the present application provides a data processing method, apparatus, device, storage medium, and system.

According to a first aspect of embodiments of the present application, there is provided a data processing method, including:

receiving a video playing request aiming at a target monitoring point position and sent by a client;

distributing the I-frame video data to the client under the condition that the I-frame video data of the target monitoring point position exists in the second buffer memory;

acquiring video data of the target monitoring point location and forwarding the video data to the client;

the I-frame video data in the second buffer memory is obtained by performing frame analysis on the video data buffered in the first buffer memory.

According to a second aspect of embodiments of the present application, there is provided a data processing apparatus comprising:

the receiving unit is configured to receive a video playing request aiming at a target monitoring point position and sent by the client;

a determining unit configured to determine whether I-frame video data of the target monitoring point exists in the second buffer;

a distribution unit configured to distribute the I-frame video data to the client in the case where the I-frame video data of the target monitoring point exists in the second buffer; the I-frame video data in the second buffer memory are obtained by carrying out frame analysis on the video data buffered in the first buffer memory;

an acquisition unit configured to acquire video data of the target monitoring point location;

and the forwarding unit is configured to forward the acquired video data of the target monitoring point position to the client.

According to a third aspect of embodiments of the present application, there is provided an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and a processor configured to implement the method provided in the first aspect when executing the program stored in the memory.

According to a fourth aspect of embodiments of the present application, there is provided a non-transitory computer readable storage medium having stored therein a computer program which when executed by a processor implements the method provided in the first aspect.

According to a fifth aspect of embodiments of the present application, there is provided a data processing system, including a client, and an electronic device provided in the third aspect; wherein:

the client is used for sending a video playing request aiming at the target monitoring point location and playing the video according to the received video data;

the electronic device is configured to perform data processing according to the method provided in the first aspect.

According to the data processing method, when a video playing request sent by a client for a target monitoring point is received and the condition that the I-frame video data of the target monitoring point exists in the second buffer memory is determined, the I-frame video data of the target monitoring point is distributed to the client, so that the client can realize the first screen picture of a video picture according to the I-frame video data of the target monitoring point, frame analysis is carried out on the video data cached in the first buffer memory through the setting of the double buffer memory structure, and the analyzed I-frame video data is cached in the second buffer memory, so that the cached I-frame video data can be distributed to the client when the client requests video playing, and the first screen picture speed of the video picture when the client video playing is improved.

Drawings

FIG. 1 is a schematic flow chart of a data processing method according to an embodiment of the present application;

fig. 2 is a schematic implementation flow chart of a streaming media dual-buffer-storage video frame first screen speed improving scheme provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;

FIG. 4 is a schematic diagram of another data processing apparatus according to an embodiment of the present application;

fig. 5 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.

The terminology used in the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

In order to better understand the technical solutions provided by the embodiments of the present application and make the above objects, features and advantages of the embodiments of the present application more obvious, the technical solutions in the embodiments of the present application are described in further detail below with reference to the accompanying drawings.

It should be noted that, the sequence number of each step in the embodiment of the present application does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.

Referring to fig. 1, a flowchart of a data processing method provided in an embodiment of the present application is shown, and the data processing method may be applied to a streaming media server, for example, as shown in fig. 1, and the data processing method may include the following steps:

step S100, receiving a video playing request aiming at a target monitoring point position, which is sent by a client.

Step S110, distributing I-frame video data to a client under the condition that the I-frame video data of the target monitoring point position exists in the second buffer memory; the I-frame video data in the second buffer memory is obtained by performing frame analysis on the video data buffered in the first buffer memory.

In the embodiment of the application, considering that the first screen picture of video playing can be successfully decoded, rendered and played only after the video I frame is received, and generally, certain time is required to be consumed for determining the I frame data in the video data through frame analysis, in order to reduce the influence of the frame analysis on the playing of the first screen picture of video playing, a double-buffer structure can be set, wherein the double-buffer structure comprises a first buffer and a second buffer, and the first buffer is used for buffering the video data acquired from the monitoring point; for the video data in the first buffer memory, frame analysis can be performed on the video data, and the video data with the frame analysis completed is buffered to the second buffer memory.

For example, in order to improve efficiency of video playing based on the video data in the second buffer, a first frame of the video data in the second buffer is I-frame data, so that, when the video data is distributed from the second buffer to the client, the I-frame data may be preferentially distributed to the client, and a first screen drawing speed of a video picture when the video of the client is played is improved.

Accordingly, in the embodiment of the present application, when receiving a video play request for a target monitoring point sent by a client, it may be determined whether I-frame video data of the target monitoring point exists in the second buffer.

And under the condition that the I-frame video data of the target monitoring point exists in the second buffer memory, the I-frame video data of the target monitoring point in the second buffer memory can be distributed to the client, so that when the client receives the I-frame video data of the target monitoring point, the I-frame video data of the target monitoring point can be decoded and played, and the first screen picture of the video picture is realized.

It should be noted that, in the embodiment of the present application, the target monitoring point location does not refer to a certain fixed monitoring point location, but may refer to any monitoring point location that may take a current by adopting the technical solution provided in the embodiment of the present application.

And step S120, obtaining video data of the target monitoring point location and forwarding the video data to the client.

In this embodiment of the present application, in the case where it is determined that the I-frame video data of the target monitoring point exists in the second buffer, on the one hand, the I-frame video data buffered in the second buffer and other video data that completes frame analysis may be distributed to the client; on the other hand, video data (real-time video data) can be continuously acquired from the target monitoring point location, and the acquired video data can be forwarded to the client.

It should be noted that, in the embodiment of the present application, for the video data obtained from the target monitoring point, on one hand, the video data may be forwarded to the client (the client that requests to play the video of the target monitoring point), and played by the client; on the other hand, the acquired video data can be cached to a first cache; the video data buffered in the first buffer memory can be subjected to frame analysis, and the video data with frame analysis completed is buffered in the second buffer memory.

It can be seen that, in the method flow shown in fig. 1, when a video playing request sent by a client for a target monitoring point is received and it is determined that the I-frame video data of the target monitoring point exists in the second buffer, the I-frame video data of the target monitoring point is distributed to the client, so that the client implements a first screen image of a video frame according to the I-frame video data of the target monitoring point, and performs frame analysis on the video data buffered in the first buffer and buffers the analyzed I-frame video data into the second buffer through setting a double buffer structure, thereby, when the client requests video playing, the buffered I-frame video data can be distributed to the client, and the first screen image speed of the video frame when the client video playing is improved.

In some embodiments, the data processing method provided in the embodiments of the present application may further include:

under the condition that the second buffer memory is determined to have no I frame video data of the target monitoring point, determining whether the first buffer memory has video data of the target monitoring point or not;

distributing the video data cached in the first cache to the client under the condition that the video data of the target monitoring point exists in the first cache;

and acquiring video data of the target monitoring point location and forwarding the video data to the client.

In an exemplary embodiment, when a video play request for a target monitoring point sent by a client is received, but I-frame video data of the target monitoring point exists in the second buffer, it may be determined whether video data of the target monitoring point exists in the first buffer.

On the one hand, under the condition that the video data of the target monitoring point position exist in the first cache, the video data of the target monitoring point position cached in the first cache can be distributed to the client; on the other hand, video data (real-time video data) can be obtained from the target monitoring point location, and the obtained video data of the target monitoring point location is forwarded to the client.

It should be noted that, in the embodiment of the present application, when the client receives the video data of the target monitoring point, the client may parse and play the received video data.

When the client plays the video, the client needs to ensure that the I frame data is decoded first, that is, the client cannot play the P frame data under the condition that the client does not decode the I frame data.

Therefore, the client needs to decode the I-frame data from the received video data, and realize the first screen picture of the video picture based on the I-frame data, thereby realizing video playing.

Because the efficiency of the client for decoding the I frame data from the video data is generally higher than the efficiency of the streaming media server for determining the I frame data in the video data in a frame analysis manner, the video data obtained from the monitoring point location can be forwarded to the client for decoding the I frame data and playing the video by the client when the streaming media server does not determine the I frame data in the frame analysis manner.

In some embodiments, the capturing the video data of the target monitoring point location and forwarding the video data to the client may include:

and under the condition that a plurality of clients acquire video data of the target monitoring point, copying the acquired video data of the target monitoring point according to the number of the clients to obtain video data with the number of the copies consistent with that of the clients, and forwarding the video data to each client.

For example, when a plurality of clients request to play video data of the same target monitoring point, the obtained video data of the target monitoring point can be copied according to the number of clients (the number of clients currently requesting to play video data of the target monitoring point), so that the video data with the same number of the clients is obtained and forwarded to each client, and therefore, under the condition that a plurality of clients request to play video data of the same target monitoring point, multiple code streams do not need to be taken from the target monitoring point, and the workload and hardware requirements of the target monitoring point are effectively reduced.

It should be noted that, when there are multiple clients requesting to play video data of the same target monitoring point, the video data distributed to the clients from the first buffer or the second buffer may also be copied according to the number of clients, so as to obtain video data with the number of copies consistent with the number of clients, and be distributed to each client respectively.

In some embodiments, the data processing method provided in the embodiments of the present application may further include:

under the condition that the second buffer memory is determined to have no I frame video data of the target monitoring point, determining whether the first buffer memory has video data of the target monitoring point or not;

under the condition that video data of a target monitoring point position does not exist in the first cache, acquiring the video data from the target monitoring point position, forwarding the acquired video data to the client, caching the acquired video data to the first cache, and carrying out frame analysis on the video data in the first cache;

and under the condition that the I frame data in the video data is analyzed, taking the I frame data as a first frame, and caching the video data with the frame analysis completed to a second cache.

In an exemplary embodiment, when a video play request for a target monitoring point sent by a client is received, but I-frame video data of the target monitoring point exists in the second buffer, it may be determined whether video data of the target monitoring point exists in the first buffer.

Under the condition that the video data of the target monitoring point position does not exist in the first buffer memory, the video data can be acquired from the target monitoring point position.

For example, for video data obtained from a target monitoring point, on one hand, it may be forwarded to a client; alternatively, it may be buffered in the first buffer and frame analysis performed on the video data in the first buffer.

Wherein, the video data completing the frame analysis may be buffered to the second buffer.

In one example, the data processing method provided in the embodiment of the present application may further include:

and under the condition that I frame data in the video data are analyzed, the video data which are cached in the first cache and are subjected to frame analysis are cleared.

For example, in order to save storage resources, in the case of analyzing I-frame data in video data, the video data buffered in the first buffer after completing frame analysis may be purged.

In one example, the data processing method provided in the embodiment of the present application may further include:

under the condition that video data exists in the second buffer memory and new I frame data is analyzed, the video data currently buffered in the second buffer memory is cleared, the newly analyzed I frame data is taken as a first frame, and the I frame and the video data after the I frame are buffered to the second buffer memory.

In an exemplary case, when the client plays the video data of the target monitoring point, the streaming media server continuously pulls the video data from the target monitoring point, performs frame analysis, and caches the video data with the frame analysis completed to the second cache.

In this process, if there is a new client requesting to play the video data of the target monitoring point, it is generally only required to ensure that the client can acquire the latest I frame data, and the client can be ensured to play the video normally.

If the video data stored in the second buffer is too much, the client side requesting to play the video data of the target monitoring point location will need to play too much non-real-time video data.

Accordingly, in order to avoid excessive video data cached in the second cache, save storage resources, and improve real-time performance of playing video data by the client, under the condition that video data exists in the second cache and new I frame data is analyzed, the video data cached in the second cache is cleared, the newly analyzed I frame data is used as a first frame, and the I frame and the video data after the I frame are cached in the second cache.

In this embodiment of the present application, when the client ends playing the video of the target monitoring point, and there is no client playing the video of the target monitoring point, the video data cached in the second cache may be cleared (if the video data still exists in the first cache, the video data in the first cache may also be cleared).

In order to enable those skilled in the art to better understand the technical solutions provided by the embodiments of the present application, the technical solutions provided by the embodiments of the present application are described below with reference to specific examples.

In the embodiment, considering that the first screen picture of video playing can be successfully decoded, rendered and played only after the video I frame is received, the double-buffer adaptive video stream forwarding and distributing scene is created, and under the video stream distributing scene, the first data frame to the client is ensured to be I frame data, so that the time consumption for analyzing other video non-I frame data is reduced; in a video stream forwarding scene, video analysis and playing are carried out on video data sent to a client at the first time, and the time consumption of a blank window period for the back-end frame analysis buffer I frame data to resend the I frame data is reduced.

As shown in fig. 2, the implementation flow of the streaming media double-buffer-storage video picture head screen speed improving scheme is as follows:

1. the user A uses the client to play the monitoring point position a and sends a play request;

2. when receiving a play request, the streaming media server acquires video data from the monitoring point position a, caches the video data into a cache 1 (namely the first cache), and performs frame analysis on the video data; in addition, forwarding video data to the client of the user A, and reducing the blank window time consumption of the buffer I frame data for back-end frame analysis and the retransmission of the I frame data;

3. the user B uses the client to play the monitoring point position a and sends a play request;

4. the streaming media server receives the play request, identifies the same point position request, does not analyze the I frame data, and distributes the video data in the cache 1 to the user B client side first, so that the user B client side can perform video first screen picture drawing according to the received video data, the time consumption of the back end frame for analyzing the cache I frame data and then sending the blank window of the I frame data is reduced, and the video first screen picture drawing speed is improved;

5. under the condition that a complete I frame is obtained through frame analysis, the I frame is put into a buffer 2 (namely the second buffer), and then the data of which the frame analysis is completed in the buffer 1 is released; ensuring that the video data in the buffer 1 can be distributed firstly when a play request is received during the incomplete frame analysis period;

6. the user C uses the client to play the monitoring point position a and sends a play request;

7. the streaming media server receives the play request, identifies the same point position request, and distributes the video data (the first frame is the I frame data) in the cache 2 to the client of the user C, so that the client of the user C can realize the picture drawing of the first screen picture of the video according to the I frame data, the picture drawing speed of the first screen picture of the video is improved, and the real-time video data is copied and forwarded to the client of the user C.

The methods provided herein are described above. The apparatus provided in this application is described below:

referring to fig. 3, a schematic structural diagram of a data processing apparatus according to an embodiment of the present application is shown in fig. 3, where the data processing apparatus may include:

a receiving unit 310, configured to receive a video playing request for a target monitoring point sent by a client;

a determining unit 320 configured to determine whether the I-frame video data of the target monitoring point exists in the second buffer;

a distribution unit 330 configured to distribute the I-frame video data to the client in the case where the I-frame video data of the target monitoring point exists in the second buffer; the I-frame video data in the second buffer memory are obtained by carrying out frame analysis on the video data buffered in the first buffer memory;

an acquisition unit 340 configured to acquire video data of a target monitoring point;

and the forwarding unit 350 is configured to forward the obtained video data of the target monitoring point location to the client.

In some embodiments, the determining unit 320 is further configured to determine whether the video data of the target monitoring point exists in the first buffer, in a case where it is determined that the I-frame video data of the target monitoring point does not exist in the second buffer;

the distributing unit 330 is further configured to distribute, in the case where the video data of the target monitoring point exists in the first cache, the video data cached in the first cache to the client;

an obtaining unit 340, configured to obtain video data of the target monitoring point location;

the forwarding unit 350 is further configured to forward the obtained video data of the target monitoring point location to the client.

In some embodiments, the forwarding unit 350 is specifically configured to, when there are a plurality of clients that acquire video data of the target monitoring point, copy the acquired video data of the target monitoring point according to the number of clients, obtain video data with the number of copies consistent with the number of clients, and forward the video data to each client.

In some embodiments, the determining unit 320 is further configured to determine whether the video data of the target monitoring point exists in the first buffer, in a case where it is determined that the I-frame video data of the target monitoring point does not exist in the second buffer;

the obtaining unit 340 is further configured to obtain video data from the target monitoring point location if the video data of the target monitoring point location does not exist in the first buffer;

a forwarding unit 350, configured to forward the acquired video data to a client;

as shown in fig. 4, the data processing apparatus may further include:

a buffer unit 360 configured to buffer the acquired video data to the first buffer;

a frame analysis unit 370 configured to perform frame analysis on the video data in the first buffer;

the buffer unit 360 is further configured to buffer the video data for which the frame analysis is completed to the second buffer, with the I frame data as the first frame, in the case where the frame analysis unit 370 analyzes the I frame data in the video data.

In some embodiments, the buffering unit 360 is further configured to clear the video data buffered in the first buffer after the frame analysis is completed, in case the frame analysis unit 370 analyzes the I-frame data in the video data.

In some embodiments, the buffer unit 360 is further configured to, when video data exists in the second buffer and the frame analysis unit 370 analyzes new I frame data, clear the video data currently buffered in the second buffer, and buffer the I frame and the video data after the I frame completing the frame analysis into the second buffer with the newly analyzed I frame data as a first frame.

Fig. 5 is a schematic hardware structure of an electronic device according to an embodiment of the present application. The electronic device may include a processor 501, a communication interface 502, a memory 503, and a communication bus 504. The processor 501, the communication interface 502, and the memory 503 perform communication with each other via a communication bus 504. Wherein the memory 503 has a computer program stored thereon; the processor 501 can execute the data processing method described above by executing a program stored on the memory 503.

The memory 503 referred to herein may be any electronic, magnetic, optical, or other physical storage device that may contain or store information, such as executable instructions, data, or the like. For example, the memory 503 may be: RAM (Radom Access Memory, random access memory), volatile memory, non-volatile memory, flash memory, a storage drive (e.g., hard drive), a solid state drive, any type of storage disk (e.g., optical disk, dvd, etc.), or a similar storage medium, or a combination thereof.

Embodiments of the present application also provide a non-transitory machine-readable storage medium, such as memory 503 in fig. 5, storing a computer program executable by processor 501 in the electronic device shown in fig. 5 to implement the data processing method described above.

Embodiments of the present application also provide a computer program stored on a non-transitory machine-readable storage medium, such as the memory 503 in fig. 5, and which when executed by a processor causes the processor 501 to perform the data processing method described above.

The embodiment of the application also provides a data processing system, which comprises a client and the electronic equipment shown in fig. 5; wherein:

the client is used for sending a video playing request aiming at the target monitoring point position and playing the video according to the received video data;

and the electronic device is used for carrying out data processing according to the data processing method described in the embodiment.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The foregoing description of the preferred embodiments of the present invention is not intended to limit the invention to the precise form disclosed, and any modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present invention are intended to be included within the scope of the present invention.

Claims (10)

1. A method of data processing, comprising:

receiving a video playing request aiming at a target monitoring point position and sent by a client;

distributing the I-frame video data to the client under the condition that the I-frame video data of the target monitoring point position exists in the second buffer memory;

acquiring video data of the target monitoring point location and forwarding the video data to the client;

the I-frame video data in the second buffer memory is obtained by performing frame analysis on the video data buffered in the first buffer memory.

2. The method according to claim 1, wherein the method further comprises:

determining whether the video data of the target monitoring point position exists in the first buffer memory under the condition that the I frame video data of the target monitoring point position does not exist in the second buffer memory;

distributing the video data cached in the first cache to the client under the condition that the video data of the target monitoring point position exists in the first cache;

and acquiring the video data of the target monitoring point location and forwarding the video data to a client.

3. The method according to claim 1 or 2, wherein the obtaining video data of the target monitoring point location and forwarding to a client side comprises:

and under the condition that a plurality of clients acquire video data of the target monitoring point, copying the acquired video data of the target monitoring point according to the number of the clients to obtain video data with the same number of the clients, and forwarding the video data to each client.

4. The method according to claim 1, wherein the method further comprises:

determining whether the video data of the target monitoring point position exists in the first buffer memory under the condition that the I frame video data of the target monitoring point position does not exist in the second buffer memory;

under the condition that the video data of the target monitoring point position does not exist in the first cache, acquiring the video data from the target monitoring point position, forwarding the acquired video data to the client, caching the acquired video data to the first cache, and carrying out frame analysis on the video data in the first cache;

and under the condition that the I frame data in the video data is analyzed, taking the I frame data as a first frame, and caching the video data with the frame analysis completed to the second cache.

5. The method according to claim 4, wherein the method further comprises:

and under the condition that I frame data in the video data are analyzed, the video data which are cached in the first cache and are subjected to frame analysis are cleared.

6. The method according to claim 4, wherein the method further comprises:

under the condition that video data exists in the second buffer memory and new I frame data is analyzed, the video data currently buffered in the second buffer memory is cleared, the newly analyzed I frame data is taken as a first frame, and the I frame and the video data after the I frame are buffered to the second buffer memory.

7. A data processing apparatus, comprising:

the receiving unit is configured to receive a video playing request aiming at a target monitoring point position and sent by the client;

a determining unit configured to determine whether I-frame video data of the target monitoring point exists in the second buffer;

a distribution unit configured to distribute the I-frame video data to the client in the case where the I-frame video data of the target monitoring point exists in the second buffer; the I-frame video data in the second buffer memory are obtained by carrying out frame analysis on the video data buffered in the first buffer memory;

an acquisition unit configured to acquire video data of the target monitoring point location;

and the forwarding unit is configured to forward the acquired video data of the target monitoring point position to the client.

8. An electronic device, comprising: the device comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

a memory for storing a computer program;

a processor for implementing the method of any one of claims 1 to 6 when executing a program stored on a memory.

9. A non-transitory computer readable storage medium, wherein a computer program is stored in the non-transitory computer readable storage medium, which when executed by a processor, implements the method of any one of claims 1 to 6.

10. A data processing system comprising a client and the electronic device of claim 8; wherein:

the client is used for sending a video playing request aiming at the target monitoring point location and playing the video according to the received video data;

the electronic device being adapted to perform data processing according to the method of any one of claims 1 to 6.