WO2017092343A1 - Video data detection method and device - Google Patents

Abstract

Provided are a video data detection method and device. The method comprises: receiving frame data of each image frame of a played video, wherein the frame data comprises watermark timing information; respectively extracting the watermark timing information from each piece of the frame data, and determining a display time of the image frame corresponding to each piece of the frame data; and detecting continuity of the image frame based on the display time of each image frame, and generating a detection result of the video. According to the embodiments of the present invention, by extracting watermark timing information contained in frame data, detecting continuity of an image frame, and generating a detection result of a video, accurate statistics of the probabilities of jam and pause occurrence and time points where jam and pause occur can be made, and the accuracy of detection is improved. Moreover, the problem of low detection progress caused by manually detecting jam and pause phenomenons during video displaying is avoided, and the workload of a test technician is reduced while the detection efficiency is improved.

Description

Method and device for detecting video data

The present application claims priority to Chinese Patent Application No. 201510889781.9, entitled "A Method and Apparatus for Detecting Video Data", filed on December 4, 2015, the entire contents of which is incorporated herein by reference. In the application.

Technical field

The present invention relates to the field of video technologies, and in particular, to a method for detecting video data and a device for detecting video data.

Background technique

During the playback of the video, it is prone to play jams or data loss (such as loss of video frames), resulting in the video not being played smoothly. In order to ensure smooth video playback and improve the user experience, it is necessary to detect the playback of the video and the loss of data.

The inventor found in the process of implementing the present invention that at present, the situation of video playback is mainly detected by a technician, and the situation in which the video is played and the data is lost is determined. Taking the online video as an example, during the playback process, the test engineer determines the playback of the video and the data loss by watching the video; or, through the feedback of the user, discovers that the online video is playing and the video data is lost. problem. However, by manual detection, it is difficult to record the time point at which the video is stuck during playback, and the detection progress is limited.

Obviously, by manually detecting the video playback phenomenon, the probability of the occurrence of the Carton phenomenon and the time of the stuck time cannot be accurately counted, and the detection efficiency is low.

Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to provide a method for detecting video data, which solves the problem that the video detection progress is limited due to manual detection, and improves the detection efficiency while improving the detection accuracy.

Correspondingly, an embodiment of the present invention further provides a video data detecting apparatus for ensuring implementation and application of the foregoing method.

In order to solve the above problem, an embodiment of the present invention discloses a method for detecting video data, including:

Receiving frame data of each image frame of the played video, the frame data including watermark timing information;

Extracting watermark timing information from each frame data respectively, and determining a display time of the image frame corresponding to each frame data;

The continuity of the image frame is detected based on the display time of each image frame, and the detection result of the video is generated.

Correspondingly, an embodiment of the present invention further discloses a video data checking apparatus, including:

a receiving module, configured to receive frame data of each image frame of the played video, where the frame data includes watermark timing information;

a display time determining module, configured to respectively extract watermark timing information from each frame data, and determine a display time of the image frame corresponding to each frame data;

And a detecting module, configured to detect continuity of the image frame based on a display time of each image frame, and generate a detection result of the video.

Embodiments of the present invention provide a computer program comprising computer readable code that, when executed on a server, causes the server to perform the above-described method of detecting video data.

Embodiments of the present invention provide a computer readable medium in which the above computer program is stored.

The embodiment of the invention provides a server, including:

One or more processors;

a memory for storing processor executable instructions;

Wherein the processor is configured to:

Receiving frame data of each image frame of the played video, the frame data including watermark timing information;

Extracting watermark timing information from each frame data respectively, and determining a display time of the image frame corresponding to each frame data;

The continuity of the image frame is detected based on the display time of each image frame, and the detection result of the video is generated.

Compared with the prior art, the embodiments of the invention include the following advantages:

After receiving the frame data of each image frame of the played video, the embodiment of the present invention may determine the display time of the image frame corresponding to each frame data by extracting the watermark timing information included in the frame data, based on the display of each image frame. Time detection of the continuity of the image frame, the detection result of the video is generated, that is, the probability of the occurrence of the Carton phenomenon and the time of the stuck time can be accurately counted, thereby improving the accuracy of the detection; at the same time, avoiding the video detection by manually detecting the video The phenomenon that the detection progress is slow, the detection efficiency is improved while reducing the workload of the test technician.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flow chart showing the steps of an embodiment of a method for detecting video data according to the present invention;

2 is a flow chart showing the steps of a preferred embodiment of a method for detecting video data according to the present invention;

3A is a structural block diagram of an embodiment of a device for detecting video data according to the present invention;

3B is a structural block diagram of a preferred embodiment of a video data detecting apparatus according to the present invention;

Figure 4 shows schematically a block diagram of a server for carrying out the method according to the invention;

Fig. 5 schematically shows a storage unit for holding or carrying program code implementing the method according to the invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

At present, the phenomenon of video playback jam and video data loss is detected by manual discovery. The following problems exist: 1. The human resources of the test engineer are wasted; 2. The automatic detection cannot be performed, that is, the idle time (such as evening) cannot be effectively utilized, resulting in The detection progress is limited and the detection efficiency is low. 3. The accuracy of the video playback and the stuck time can not be accurately counted, that is, the detection accuracy is low.

One of the core concepts of the embodiments of the present invention is that the watermark timing information is extracted from the frame data of each image frame, and the display time of the image frame corresponding to each frame data is determined according to the watermark timing information, and the display of each image frame is performed. The time is detected by the continuity of the video image frame, and the detection result of the video is generated, that is, the probability of occurrence of the Carton phenomenon and the time of the stuck time can be accurately counted, the accuracy of the detection is improved, and the detection efficiency is improved.

Referring to FIG. 1 , a flow chart of steps of a method for detecting video data according to the present invention is shown, which may specifically include the following steps:

Step 101: Receive frame data of each image frame of the played video.

The frame data includes watermark timing information. In fact, watermark timing information can be added to each image frame of the video during encoding. Specifically, in the process of video encoding, by using a watermarking technique, a watermark may be added to each image frame of the video, and the content of the watermark includes display timing information of each image frame of the video, such as a frame number and time of the image frame. The stamp or the like is such that the frame data of each image frame includes watermark timing information.

Preferably, a watermark may be added in a specified area of each image frame, that is, the watermark is embedded in a relatively unchanged area of the video, for example, based on a video mark (logo), the position in each image frame is substantially unchanged, and the video may be in the video. The logo adds fragile transparent watermark timing information. Specifically, the frame number or time stamp of each image frame of the video source is converted into a 32-bit binary number by quantization, such as a quantized display time stamp (PTS). At the time of encoding, the quantized PTS (equivalent to timing information) is embedded as a fragile transparent watermark into the P macroblock of the logo. Since the watermark is fragile and transparent, the watermark is invisible to the human eye when displayed, that is, it does not affect the display of the image frame, and the integrity of the image frame display of the video is ensured.

In practical applications, an intelligent terminal, such as a smart phone, plays a video, and can capture the frame data of each image frame after decoding, and forward it to the Carton Drop Frame Analysis Server (referred to as a server). Specifically, the smart terminal can obtain the frame data sent by the display screen by calling a screen capture interface, such as an interface provided by an interface device of the Android system (Surface Flinger); The frame data of each image frame can be acquired by directly driving data of a designated area (such as a logo area) of the display screen through a liquid crystal display (LCD). For example, the frame data may be data generated in accordance with the YUV format, that is, YUV data. Wherein "Y" indicates brightness (Luminance or Luma), and "U" and "V" indicate chromaticity (Chrominance or Chroma). After receiving the frame data of each image frame of the video, the server can automatically detect the frame data of each image frame of the video, and generate a detection result of the video. The specific detection process is described later.

It should be noted that the frame data between the intelligent terminal and the server can be transmitted through the network, such as through TCP_SOCKET; or can be transmitted by a universal serial bus (USB) serial port, such as the Android Debug Bridge (Android Debug Bridge, ADB) and the like, the embodiment of the present invention does not limit this.

Optionally, the foregoing step 101 may include the following substeps:

Sub-step 10101, the smart terminal where the player is located is connected by wireless or wired.

Sub-step 10103: Receive frame data extracted by the smart terminal from a designated area of each image frame.

The image frames are image frames played in the played video of the player.

Step 103: Extract watermark timing information from each frame data respectively, and determine a display time of the image frame corresponding to each frame data.

After receiving the frame data, the server may extract the watermark timing information from each frame data by inverse transform, and parse the watermark timing information to determine the display time of the image frame corresponding to each frame number. In the above example, watermark timing information is added in the logo area. After receiving the frame data, the server can determine the parity of the macroblock by traversing the macroblock of the logo area, thereby restoring the timing information embedded in the watermark during encoding, that is, determining each image. The display time of the frame. For example, the server can obtain the 32-bit binary number by traversing the parity of 32 macroblocks, mapping the odd number to 1, and mapping the even number to 0, and restoring the PTS embedded in the watermark, that is, determining each image frame. display time. For example, the display time of the image frame is represented by a hexadecimal number. If the display time of the first image frame of the video is 16 milliseconds (ms), the display time of the first image frame of the video can be determined by calculation. 0x00000010ms.

Of course, in order to maintain robustness, it is also possible to traverse two macroblocks and determine a one-bit binary coefficient (X, Y), that is, determine the implementation time of one image frame by traversing the parity of 64 macroblocks. Where X and Y can be 1 or 0. When X and Y are the same, such as when both X and Y are 1 or both are 0, the parity of the macroblock can be determined based on the value of X or Y. The embodiment of the invention restores watermark timing information The implementation of the display time of each image frame is not limited.

Optionally, the foregoing step 103 may include the following sub-steps:

Sub-step 10301, for each frame data, watermark timing information is extracted from the frame data.

Sub-step 10303, parsing the extracted watermark timing information to determine a display time of the image frame corresponding to the frame data.

Step 105: Detect continuity of the image frame based on display time of each image frame, and generate a detection result of the video.

In fact, when the video is normally played smoothly, the display time of each extracted image frame should be uniformly increased. By comparing the display time of each image frame with the synchronization time and determining whether the display time of each frame image is irregular, it is possible to determine the jamming situation during the video playback. Specifically, comparing the display time of each image frame with the server local NTP (Network Time Protocol) time, the time difference corresponding to each image frame can be obtained. When the time difference corresponding to an image frame is not within the preset playing time range, the image frame may be considered to be stuck, and the display time of the image frame is taken as the stuck time point, and recorded.

Optionally, detecting the continuity of the image frame based on the display time of each image frame, and generating the detection result of the video may include: calculating a difference between the display time of each image frame and the pre-generated synchronization time information, and generating each image. The time difference corresponding to the frame; determining whether the time difference corresponding to each image frame is within the playing time range; and when the time difference corresponding to the image frame is not within the playing time range, displaying the time point of the image frame As a stuck time point, a carton detection result of the video is generated.

In addition, by determining whether the display time of each image frame is uniformly incremented, it can be determined whether the video has a frame loss. Specifically, when the interval between the display time of two adjacent image frames is greater than the time difference between the frames corresponding to the video, it may be determined that there is a lost image frame between the two image frames, that is, in the two image frames. Data was lost. By recording the display time of the two image frames, the time point at which the video is dropped can be determined.

In a preferred embodiment of the present invention, detecting the continuity of the image frame based on the display time of each image frame, and generating the detection result of the video may further include: performing statistics on the display time of each image frame, and determining the The inter-frame time difference corresponding to the video, and the display time difference corresponding to each adjacent two image frames; determining whether the display time difference corresponding to the two image frames is greater than the inter-frame time difference; when the display time difference is greater than the When the time difference between frames is determined, the two image frames are determined The data is lost between the frames, and the frame loss detection result of the video is generated.

Based on the video frame loss situation and/or the stuck condition, the frame loss card analysis server can automatically generate video detection results, such as the Carton detection result and the frame loss detection result. The detection result may include a time point of video frame loss, a stuck time point, etc., so that the probability of occurrence of the stuck phenomenon and the time of the stuck time during video playback can be accurately counted, and the accuracy of the detection is improved.

In the embodiment of the present invention, the server can automatically detect the video playback jam and the video data loss by extracting the watermark timing information in the frame data of each image frame, and generate a video detection result, thereby reducing the workload of the test engineer. Saves human resources and reduces the cost of testing. In addition, the server can automatically detect, that is, the video can be detected by using idle time, which speeds up the detection process and improves the detection efficiency.

Referring to FIG. 2, a flow chart of steps of a method for detecting video data according to the present invention is shown. Specifically, the method may include the following steps:

Step 201: Connect the smart terminal where the player is located by wireless or wired.

In fact, in the Internet, such as a local area network, the server can connect to the smart terminal where the player is located by wireless or wired. Among them, the wireless method refers to a communication method in which wireless communication uses information that a radio wave signal can propagate in a free space. The wired method refers to a method of transmitting information by using a tangible medium such as a metal wire or an optical fiber.

Specifically, the video is usually played by the player of the terminal, such as playing through a player of the smart phone, or playing through a web player of the smart terminal. When the player is playing a video, the smart terminal where the player is located can connect to the server through a wireless connection, such as a WI-FI connection. Of course, the smart terminal can also connect to the server through a wired method such as a universal serial bus. The embodiment of the present invention does not limit the connection manner between the server and the smart terminal.

Step 203: Receive frame data extracted by the smart terminal from a designated area of each image frame.

Each image frame is an image frame played in a video that has been played by the player. Specifically, the player can realize video playback by continuously displaying image frames of the video. The display of each image frame is equivalent to displaying one picture.

The intelligent terminal can obtain the YUV data displayed on the display screen through the Surface Flinger service provided by the system itself; or directly capture the data in the designated area of the display screen through the LCD driver. When the player plays the video, the smart terminal can extract the frame data from the designated area of each image frame of the video, such as obtaining the YUV data from the area displayed by the logo. The frame data of each image frame contains the image The display time information of the frame, that is, the watermark timing information. After extracting the frame data from the designated area of each image frame, the intelligent terminal transmits the extracted number of frames to the server. The server can receive the frame data sent by the smart terminal through a network interface such as a TCP_SOCKET interface, a USB serial port, or the like.

Step 205: Extract watermark timing information from the frame data for each frame data.

After receiving the frame data, for each frame data, the server may extract the watermark timing information of the image frame corresponding to the frame data from the frame data by inverse transform, such as extracting the watermark timing information in the YUV data of the designated area. .

Step 207: Parse the extracted watermark timing information to determine a display time of the image frame corresponding to the frame data.

Specifically, the watermark timing information is embedded as a watermark in a macroblock of the designated area. The display time of each image frame can be determined by inversely transforming the macroblock in which the watermark timing information is located, that is, by traversing the macroblock of the designated area to determine the parity of the macroblock.

Then, the detection result of the video is detected based on the display time of each image frame, and the detection result of the video is generated. In this embodiment, the detection result of the video includes: a carton detection result and a frame loss detection result, as follows.

The method for generating the video of the video may include: step 209, step 211, and step 213; generating a frame loss detection result of the video may specifically include: step 215, step 217, and step 219.

First, the specific steps to generate a video of the Carton check results

Step 209: Calculate a difference between the display time of each image frame and the synchronization time information generated in advance, and generate a time difference corresponding to each image frame.

Based on the server's local NTP time, such as the current system time (System.currentTime), the time that each image frame is actually displayed during playback can be determined. During video playback, the time difference between the actual playback time of each image frame and the start time of the video may be generated, and synchronization time information corresponding to each image frame is generated.

As a specific example of the embodiment of the present invention, it is assumed that the System.currentTime is 3500 milliseconds, the start time of the video is 3500 milliseconds, the display time of the first image frame is 16 milliseconds, and the actual playback time is 3517 milliseconds. The synchronization time information corresponding to one image frame is 17 milliseconds; the display time of the second image frame is 48 milliseconds, and the actual playback time is 3555 milliseconds, and the synchronization time information corresponding to the second image frame is 55 milliseconds; The display time of 3 image frames is 80 milliseconds, the actual playback time is 3689 milliseconds, and the synchronization time information corresponding to the third image frame is 189 milliseconds.

By calculating the difference between the display time of each image frame and its corresponding synchronization time information, the time difference timegaps corresponding to each image frame can be generated. For example, for the first image frame, the difference between the display time of the image frame and the corresponding synchronization time information of 17 milliseconds is calculated, and the time difference timegaps corresponding to the first image frame can be generated to be 1 millisecond. Similarly, the time difference timegaps corresponding to the second image frame can be generated to be 7 milliseconds, and the time difference timegaps corresponding to the third image frame is 109 milliseconds.

Step 211: Determine whether the time difference corresponding to each image frame is within the playing time range.

For different definitions, online video can be delayed in playback in a good network transmission environment. It is said that if the image frame of the video can be played within the preset playing time range, the image frame is considered to be able to play smoothly. Assume that the video frame of the video is delayed to play within 40 milliseconds, and the image frame can be considered to be played smoothly, that is, the image frame is not played. When the image frame of the video is delayed for more than 40 milliseconds, the image is considered to be stuck. The server can determine whether the time difference timegaps corresponding to each image frame of the video is within the play time range (A, B), where A can be 0 milliseconds, and B can be 40 milliseconds. If the time difference corresponding to the time frame of the image frame is greater than A and less than B, the video frame can be considered to be smooth, otherwise the video frame is considered to be stuck. For example, in the above example, the time difference of the first image frame is timegaps 1 millisecond. Within the playback time range (0 milliseconds, 40 milliseconds), the first image frame of the video can be considered to be smooth; the third The time difference of the image frame corresponding to timegaps is 109 milliseconds. If it is not within the playback time range (0 milliseconds, 40 milliseconds), the third image frame of the video may be considered to be stuck, and then step 213 is performed.

Step 213: When the time difference corresponding to the image frame is not in the playing time range, the display time point of the image frame is used as the stuck time point, and the card detection result of the video is generated.

When the time timegaps difference corresponding to an image frame is not in the play time range, the display time point of the image frame is used as the stuck time point, and the card detection result of the video is generated. For example, in the above example, the time difference of the third image frame, timegaps, 109 milliseconds is not within the playback time range, and the display time of the third image frame is 80 milliseconds as the stuck time point to generate the jam detection of the video. result.

By judging whether the time difference of all the image frames of the video is within the playing time range, all the carding time points of the video can be recorded, and the jam detection result of the video is generated, and then the pair can be Accurate statistics are generated during the video playback, and the accuracy of the detection is improved.

Second, the specific steps to generate video frame loss detection results

Step 215: Perform statistics on the display time of each image frame, determine an inter-frame time difference corresponding to the video, and a display time difference corresponding to each adjacent two image frames.

As a specific example of the embodiment of the present invention, it is assumed that the display time of each image frame of a certain video is as shown in Table 1. Wherein, "1st frame" represents the first image frame; "0x" represents a hexadecimal number, such as 0x00000010.

Frame number of the image frame	display time
Frame 1	0x00000010ms
Frame 2	0x00000030ms
Frame 3:	0x00000050ms
Frame 4	0x00000090ms
Frame 5	0x000000b0ms
Frame 6	0x000000f0m
......	......

Table 1

By counting the display time of all image frames of the video, it can be determined that the interframe time difference of the video is 32 milliseconds, and the display time difference corresponding to each adjacent two image frames, such as the first image frame and the second image frame. The corresponding display time difference is 32 milliseconds, that is, the difference between the display time 0x00000030ms of the second image frame and the display time 0x00000010ms of the second image frame. Similarly, the display time difference corresponding to other adjacent two image frames can be calculated, for example, the display time difference corresponding to the second image frame and the third image frame is 32 milliseconds, and the third image frame and the fourth image frame are The corresponding display time difference is 64 milliseconds, the display time difference corresponding to the fourth image frame and the fifth image frame is 32 milliseconds, and the display time difference corresponding to the fifth image frame and the sixth image frame is 64 milliseconds...

Step 217: Determine whether a display time difference corresponding to the two image frames is greater than the inter-frame time difference.

For each two adjacent image frames, it is determined whether the display time difference corresponding to the two image frames is large The time difference corresponding to the video. If the display time difference corresponding to two adjacent image frames is not greater than the inter-frame time difference corresponding to the video, it is considered that there is no data loss between the two image frames, that is, no lost frame. If the display time difference corresponding to two adjacent image frames is greater than the inter-frame time difference corresponding to the video, it is considered that data is lost between the two image frames, that is, lost frames, such as the third image frame and the fourth image frame. The corresponding display time 64 milliseconds is greater than the inter-frame time difference corresponding to the video by 32 milliseconds, and then step 219 is performed.

Step 219: When the display time difference is greater than the inter-frame time difference, determine that data is lost between the two image frames, and generate a frame loss detection result of the video.

When the display time difference between two adjacent image frames is greater than the inter-frame time difference corresponding to the video, it may be determined that data is lost between the two image frames, such as losing frames between the third image frame and the fourth image frame. , the frame loss detection result of the video is generated. The frame loss detection result of the video can record which frames are lost between the image frames, such as recording the lost frame between the third image frame and the fourth image frame, and the fifth image frame and the sixth image frame. The frame is lost between them; or the frame may be lost between the display times, such as the lost frame between the display time 0x00000050ms and 0x00000090ms, the lost frame between the display time 0x000000b0ms and 0x000000f0ms, etc., which is not limited by the embodiment of the present invention. .

In the embodiment of the present invention, by determining whether the display time difference between two adjacent image frames is greater than the inter-frame time difference of the video, it may be determined whether a frame is lost between two adjacent image frames, and recording the lost frame of the video In this case, the frame loss detection result of the video is generated, so that the probability of the frame loss of the video and the time point of the frame loss can be accurately counted, and the accuracy of the detection is improved.

It should be noted that, for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the embodiments of the present invention are not limited by the described action sequence, because In accordance with embodiments of the invention, certain steps may be performed in other sequences or concurrently. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Referring to FIG. 3A, a structural block diagram of an embodiment of a device for detecting video data according to the present invention is shown, which may specifically include the following modules:

The receiving module 301 is configured to receive frame data of each image frame of the played video, where the frame data includes watermark timing information.

The display time determining module 303 is configured to separately extract watermark timing information from each frame data, and determine a display time of each frame data corresponding to the image frame.

The detecting module 305 is configured to detect continuity of the image frame based on display time of each image frame, and generate a detection result of the video.

On the basis of FIG. 3A, optionally, the receiving module 301 can include a connection sub-module 30101 and a data receiving sub-module 30103, with reference to FIG. 3B.

The connection submodule 30101 is configured to connect the smart terminal where the player is located by using a wireless or a wired manner. The data receiving sub-module 30103 is configured to receive frame data extracted by the smart terminal from a designated area of each image frame, where each image frame is an image frame played in a video that has been played by the player.

In a preferred embodiment of the invention, the display time determination module 303 can include the following sub-modules:

The extraction sub-module 30301 is configured to extract watermark timing information from the frame data for each frame data.

The parsing sub-module 30303 is configured to parse the extracted watermark timing information to determine a display time of the image data corresponding to the frame data.

In a preferred embodiment of the invention, the detection module 305 can include the following sub-modules:

The time difference generation sub-module 30501 is configured to calculate a difference between the display time of each image frame and the pre-generated synchronization time information, and generate a time difference corresponding to each image frame.

The cardon judgment sub-module 30503 is configured to determine whether the time difference corresponding to each image frame is within the play time range.

The Carton result generation sub-module 30505 is configured to generate a card detection result of the video when the time difference corresponding to the image frame is not in the playing time range, and the display time point of the image frame is used as a stuck time point. .

Optionally, the detecting module 305 may further include the following submodules:

The statistics sub-module 30507 is configured to perform statistics on the display time of each image frame, determine an inter-frame time difference corresponding to the video, and a display time difference corresponding to each adjacent two image frames.

The frame loss judging sub-module 30509 is configured to determine whether a display time difference corresponding to the two image frames is greater than the inter-frame time difference.

The frame loss result generation sub-module 30511 determines, when the display time difference is greater than the inter-frame time difference, that data is lost between the two image frames, and generates a frame loss detection result of the video.

After receiving the frame data of each image frame of the played video, the embodiment of the present invention may determine the display time of the image frame corresponding to each frame data by extracting the watermark timing information included in the frame data, based on the display of each image frame. Time detection of the continuity of the image frame, the detection result of the video is generated, that is, the probability of the occurrence of the Carton phenomenon and the time of the stuck time can be accurately counted, thereby improving the accuracy of the detection; at the same time, avoiding the video detection by manually detecting the video The phenomenon that the detection progress is slow, the detection efficiency is improved while reducing the workload of the test technician.

For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

Those skilled in the art will appreciate that embodiments of the embodiments of the invention may be provided as a method, apparatus, or computer program product. Thus, embodiments of the invention may be in the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, embodiments of the invention may take the form of a computer program product embodied on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

For example, Figure 4 illustrates a server in which the present invention can be implemented. The server conventionally includes a processor 410 and a computer program product or computer readable medium in the form of a memory 420. The memory 420 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Memory 420 has a memory space 430 for program code 431 for performing any of the method steps described above. For example, storage space 430 for program code may include various program code 431 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are typically portable or fixed storage units as described with reference to FIG. The storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 420 in the server of FIG. The program code can be, for example, in a suitable shape Compress. Typically, the storage unit includes computer readable code 431', code that can be read by a processor, such as 410, which, when executed by a server, causes the server to perform various steps in the methods described above.

Embodiments of the invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device Means are provided for implementing the functions specified in one or more of the flow or in one or more blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The instruction device implements the functions specified in one or more blocks of the flowchart or in a flow or block of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device such that a series of operational steps are performed on the computer or other programmable terminal device to produce computer-implemented processing, such that the computer or other programmable terminal device The instructions executed above provide steps for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.

While a preferred embodiment of the present invention has been described, it will be apparent that those skilled in the art can make further changes and modifications to the embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, or terminal device that includes a plurality of elements includes not only those elements but also Other elements that are included, or are included in the process, method, article or The elements inherent in the terminal equipment. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that comprises the element, without further limitation.

The method for detecting video data and the device for detecting video data provided by the present invention are described in detail above. The principle and implementation manner of the present invention are described in the following, and the description of the above embodiments is described. It is only used to help understand the method of the present invention and its core ideas; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scopes. The contents of this specification are not to be construed as limiting the invention.

Claims (13)

1. A method for detecting video data, comprising:

   Receiving frame data of each image frame of the played video, the frame data including watermark timing information;

   Extracting watermark timing information from each frame data respectively, and determining a display time of the image frame corresponding to each frame data;

   The continuity of the image frame is detected based on the display time of each image frame, and the detection result of the video is generated.
2. The method according to claim 1, wherein the receiving frame data of each image frame of the played video comprises:

   Connect the smart terminal where the player is located by wireless or wired;

   Receiving frame data extracted by the smart terminal from a designated area of each image frame, wherein each image frame is an image frame played in a video that has been played by the player.
3. The method according to claim 1, wherein the extracting the watermark timing information from each frame data to determine the display time of the image frame corresponding to each frame data comprises:

   Extracting watermark timing information from the frame data for each frame data;

   The extracted watermark timing information is parsed to determine a display time of the image data corresponding to the frame data.
4. The method according to any one of claims 1 to 3, wherein the detecting the continuity of the image frame based on the display time of each image frame, and generating the detection result of the video comprises:

   Calculating a difference between a display time of each image frame and pre-generated synchronization time information, and generating a time difference corresponding to each image frame;

   Determining whether the time difference corresponding to each image frame is within the playing time range;

   When the time difference corresponding to the image frame is not within the playing time range, the display time point of the image frame is used as the stuck time point, and the card detection result of the video is generated.
5. The method according to claim 4, wherein said display based on each image frame Time detecting the continuity of the image frame, and generating the detection result of the video, further comprising:

   Performing statistics on the display time of each image frame, determining an inter-frame time difference corresponding to the video, and a display time difference corresponding to each adjacent two image frames;

   Determining whether a display time difference corresponding to the two image frames is greater than the inter-frame time difference;

   When the display time difference is greater than the inter-frame time difference, it is determined that data is lost between the two image frames, and a frame loss detection result of the video is generated.
6. A device for inspecting video data, comprising:

   a receiving module, configured to receive frame data of each image frame of the played video, where the frame data includes watermark timing information;

   a display time determining module, configured to respectively extract watermark timing information from each frame data, and determine a display time of the image frame corresponding to each frame data;

   And a detecting module, configured to detect continuity of the image frame based on a display time of each image frame, and generate a detection result of the video.
7. The apparatus according to claim 6, wherein the receiving module comprises:

   Connecting a sub-module for connecting the smart terminal where the player is located by wireless or wired;

   And a data receiving submodule, configured to receive frame data extracted by the smart terminal from a specified area of each image frame, where each image frame is an image frame played in a video that has been played by the player.
8. The device according to claim 6, wherein the display time determining module comprises:

   Extracting a sub-module for extracting watermark timing information from the frame data for each frame data;

   The parsing sub-module is configured to parse the extracted watermark timing information to determine a display time of the image data corresponding to the frame data.
9. The device according to any one of claims 6 to 8, wherein the detecting module comprises:

   a time difference generation sub-module, configured to calculate a difference between a display time of each image frame and pre-generated synchronization time information, and generate a time difference corresponding to each image frame;

   The Carton judgment sub-module is configured to respectively determine whether the time difference corresponding to each image frame is within a play time range;

   The Carton result generation sub-module is configured to generate a carton detection result of the video when a time difference corresponding to the image frame is not within the playing time range, and a display time point of the image frame is used as a stuck time point.
10. The apparatus according to claim 9, wherein the detecting module further comprises:

    a statistic sub-module, configured to perform statistics on display time of each image frame, determine an inter-frame time difference corresponding to the video, and a display time difference corresponding to each adjacent two image frames;

    a frame loss judging module, configured to determine whether a display time difference corresponding to the two image frames is greater than the inter-frame time difference;

    The frame loss result generation sub-module determines, when the display time difference is greater than the inter-frame time difference, that data is lost between the two image frames, and generates a frame loss detection result of the video.
11. A computer program comprising computer readable code causing the server to perform a method of detecting video data according to any one of claims 1-5 when the computer readable code is run on a server.
12. A computer readable medium storing the computer program of claim 11.
13. A server, comprising:

    One or more processors;

    a memory for storing processor executable instructions;

    Wherein the processor is configured to:

    Receiving frame data of each image frame of the played video, the frame data including watermark timing information;

    Extracting watermark timing information from each frame data respectively, and determining a display time of the image frame corresponding to each frame data;

    The continuity of the image frame is detected based on the display time of each image frame, and the detection result of the video is generated.

Images