JP2007074489A - Device and method for reproduction evaluation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To quickly and exactly read information encoded as image data included in video data of a moving image. <P>SOLUTION: Positions of symbol graphics 401-404 are quickly and exactly determined by calculating positions and size of the symbol graphics 401-404 for distortion correction in a second information image 207 from the position and size of a symbol graphic 301 in a first photographed information image 206 and by detecting the symbol graphics 401-404 near the determined positions. Since a data graphic 405 included in the second information image 207 is read after correcting distortion, the data are exactly read. As information included in the data graphic 405, there are time of reproduction and a frame number and reproduction of the moving image is quantitatively evaluated from these pieces of information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a reproduction evaluation apparatus and method for evaluating reproduction of a moving image by an evaluated apparatus.

  Mobile phones in recent years have been dramatically enhanced, and those equipped with video shooting and playback functions are not uncommon. In general, embedded devices such as mobile phones have high-performance hardware (HW) installed in computers such as personal computers because they have problems such as downsizing, securing power, and cost constraints. Often not. For this reason, it is often the case that video playback and shooting functions are realized with insufficient HW resources, or that a dedicated processor for processing multimedia functions is installed and processed there.

  A moving image file handled in moving image shooting and reproduction is composed of two data, video and audio, and some include text data. These data have respective data format specifications, and further, it is necessary to consider the time to be reproduced, so that the processing for evaluation becomes enormous. As described above, when the dedicated processor for processing the multimedia function is used, the control between the main processor and the multimedia function processing processor becomes complicated, so that the evaluation test is further costly.

  In order to evaluate these enormous amounts, many human resources are required and costly. In addition, the same test needs to be repeated every time the program is updated, which further increases costs.

  In order to reduce costs, in these evaluation processes, if the operation screen on the display screen of the mobile phone can be shot with a camera and the shot video file can be automatically analyzed, the evaluation period can be shortened. . Especially for video playback tests, if video data that encodes some information for analysis is used as video data that composes the video, the status of video playback, such as whether the playback is good or not, is stopped automatically. It becomes possible to recognize.

  As a method for inserting information into a moving picture screen, a method shown in Patent Document 1 has been proposed. In this method, in order to put a lot of information on the screen, the information is divided and inserted into the moving image. However, image recognition is time-consuming because it handles a lot of data.

  In addition, when realizing a multimedia function with a small number of HW resources, there is a possibility that performance may become a problem, and it is necessary to quantitatively evaluate the performance.

  As a method for quantitative analysis of moving image reproduction and improvement proposal, a method shown in Patent Document 2 is proposed. However, since the method shown in Patent Document 2 is based on the premise that the reproduction processing system has means for detecting various information such as screen freeze detection, it is necessary to implement these means. Implementation is costly.

JP 2004-78351 A JP 2000-115766 A

  Video playback evaluation is time consuming and costly, and there is a possibility that the evaluation items may increase further in a system using a dedicated processor, and much time is spent on the evaluation work.

  In addition, as a method for quantitative evaluation of moving image reproduction, there are methods of making changes to the circuit configuration and mounting various information detection means to evaluate them comprehensively, but this method requires a lot of cost. .

The present invention
Video data acquisition means for acquiring video data obtained by capturing a video reproduced based on a video file by the evaluated device;
A reproduction evaluation apparatus having analysis means for analyzing acquired video data,
A moving image file including video data representing a moving image to be reproduced by the device to be evaluated includes first image data and second image data;
The first image data represents a first information image composed of a first symbol graphic representing a first specific position in the screen;
Second symbol graphics representing a plurality of second specific positions different from each other in the screen, and information for analysis, in which the second image data is to be reproduced before and after the first information image And a second information image including a data graphic encoded with
The analysis means is
Determining the first specific position based on the first symbol graphic in the first information image reproduced by the device under evaluation;
Based on the position information representing the determined first specific position, the device to be evaluated determines the position where the second symbol graphic is to be reproduced, and the second reproduced near the calculated position. The position of the second symbol figure is determined by searching for the second symbol figure, the distortion of the screen is corrected based on the deviation of the determined second specific position from the determined position, and the data Provided is a reproduction evaluation apparatus characterized by decoding data encoded by a figure.

  According to the present invention, it is possible to automatically and accurately confirm whether video and audio data can be reproduced at a designated time by shooting a playback screen of a moving image of a playback device to be evaluated.

  In addition, the frame rate of the display can be accurately measured by shooting a moving image playback screen of the playback device to be evaluated.

  Furthermore, since the information encoded by the video data of the moving image can be read quickly and accurately, an embedded device having insufficient HW resources can be used for reproduction evaluation.

Embodiment 1 FIG.
FIG. 1 is a system configuration diagram showing a reproduction evaluation apparatus 100 according to Embodiment 1 together with a reproduction apparatus 90 to be evaluated (that is, as an evaluation target apparatus).
The illustrated reproduction evaluation apparatus 100 is for analyzing an image displayed on the display unit 93 of the reproduction apparatus 90. In addition to the display unit 93, the playback device 90 includes a playback data providing unit 91 and a playback signal processing unit 92, and a playback signal processing unit 92 generates a signal for playback of a moving image file provided from the playback data providing unit 91. Processing is performed, and display is performed on the display unit 93 based on the signal from the reproduction signal processing unit 92. The reproduction data providing unit 91 may receive, for example, a broadcast moving image file or a moving image file transmitted via a communication network, or may read a moving image file recorded on a recording medium.

  The reproduction evaluation device 100 captures a video displayed on the display unit 93 and acquires a camera 101 as an input unit that acquires video data, a CPU 103 that performs analysis processing of the acquired video data, and an analysis processing program of the CPU 103. Operation of a memory 104 as a primary storage device for operation, a hard disk drive (HDD) 105 as a secondary storage device for storing analysis processing programs, calculation results, and log files, and an analysis processing program And a monitor 102 as an output unit for a screen and calculation results.

  FIG. 2 shows a moving image file representing a moving image to be reproduced, which is provided from the reproduction data providing unit 91 in the reproducing device 90 of FIG. The moving image file includes a common header portion 211 located at the head of the file, and a synchronization recognition data portion 212 that follows the common header portion 211.

  The common header section 211 is composed of a blank image 201 for 1 second, an information data section 213 for 1 second, followed by a blank image for 1 second. As described above, the 1-second information data portion 213 is sandwiched between the 1-second blank images 201 and 205 located at the front and back. The 1-second information data portion 213 is composed of a 300 msec first information image 202, a 300 msec second information image 203 followed by a 400 msec blank image 205 in that order.

  The synchronization confirmation data unit 212 includes a data set G for one second (subscripts (i−1), i, (i + 1) are added to represent individual data sets, and G (i−1) , Gi, G (i + 1), etc. may be used). Similar to the information data portion 213 of the common header portion 211, the 1-second data set G includes a first information image 206 of 300 msec, a second information image 207 of 300 msec, followed by a blank image of 400 msec. The order is 208.

  The first information image 206 of the synchronization confirmation data part 212 has the same content as the first information image 202 of the common header part 211, and the second information image 207 of the synchronization confirmation data part 212 has a common header part. 211 is the same as the second information image 203 (however, the content of the information encoded by the graphic is not always the same). Each data set G may be referred to as an information data portion.

  The playback device 90 plays back the video represented by the video file based on the video file provided from the playback data providing unit 91 and causes the display unit 93 to display the video. In the video represented by the synchronization confirmation data section 212, the first and second information images appear alternately (reproduced) every certain unit time (1 second in the illustrated example).

  FIG. 3 is a diagram showing a pattern of the first information image. As illustrated, the first information image includes a symbol graphic (first symbol graphic) 301 displayed at the center of the screen and indicating the center position of the image. The dotted line shows the coordinate system that divides the screen and is not displayed on the actual screen. The symbol figure has a size of 4 units in each of the vertical and horizontal directions. Here, the “unit” includes a predetermined number of pixels or lines. In this figure, the photographed image is binarized with a certain threshold value. All subsequent image processing is performed on the binarized data of the captured image data.

  FIG. 4 is a diagram showing a pattern of the second information image, and the coordinate system for dividing the screen is displayed by dotted lines as in FIG. This line is also not displayed on the actual screen. As shown in FIG. 4, the second information image includes symbol graphics (second symbol graphics) 401, 402, 403, and 404 and an information pattern graphic 405. The symbol graphics 401 to 404 represent a plurality of different specific positions on the screen, for example, the positions of the four corners of the screen, for correcting the distortion of the screen due to photographing as described later. The display positions of the symbol figures 401 to 404 are positions where the center position of the symbol figure is shifted by 7 units in the vertical direction and 10 units in the horizontal direction from the center of the screen. Unlike the other three symbol figures, the symbol figure 403 indicating the lower left position of the screen is blank at the center of the image. By detecting this symbol figure 403, the position is at the lower left side of the screen. Can be understood.

  In the illustrated example, the information pattern graphic 405 is displayed at the center of the screen, and an information pattern graphic (data graphic) in which information such as a moving image file ID and a reproduction time is encoded (graphic encoding) with a graphic. ). An information pattern figure 405 represents 1-bit information per unit. In the first embodiment, 160-bit information can be expressed.

  In the information pattern figure 405 of the second information image 207 of each group (information data) Gi of the synchronization confirmation data section 212, the reproduction time (to be reproduced) of the first information image 206 of the next group G (i + 1) A portion obtained by graphic-coding data representing (time).

The playback evaluation apparatus 100 captures and acquires (captures) the video displayed on the display unit 93 of the playback apparatus 90 by the camera 101 and analyzes it with the CPU 103. This analysis includes projection data creation, symbol graphic recognition, determination of the screen center position and unit size, distortion correction (for this purpose, generation of a coordinate system in consideration of distortion), as described below. This includes processing such as information image analysis and synchronization confirmation using a coordinate system that takes distortion into account.
As will be described later, not only the video data captured and captured by the camera 101 is analyzed immediately, but also after the video data is stored once, it may be reproduced and analyzed. The video data may be received from another device, and the received video data may be analyzed.

  FIG. 5 shows projection data used for detecting the symbol graphic 301 indicating the center position of the image from the first information image. A symbol graphic recognition method for determining the center position and unit size of the screen will be described with reference to FIG. In order to obtain the position in the vertical direction, the projection data 501 obtained by accumulating the image data in the horizontal direction is obtained, and an area where the projection data is collected (continuous) is recognized as the vertical position of the symbol figure ( Determine). Similarly, in order to obtain the horizontal position, projection data 502 obtained by accumulating image data in the vertical direction is obtained, and an area where the data is collected (continuously) is recognized as the horizontal position of the symbol figure ( Determine).

  In this way, the position and size of the symbol graphic 301 of the first information image are determined. In the first embodiment, the center position of the video is estimated from the position of the symbol graphic 301, and the size of the coordinate system unit that divides the screen from the size of the symbol graphic 301 is estimated. However, an accurate coordinate system is obtained from the positions of the symbol graphics 401 to 404 at the four corners included in the second information image, as will be described later. The unit size of the coordinate system estimated here is used to determine a region for detecting the positions of the symbol graphics 401 to 404 at the four corners included in the second information image. As described above, since the symbol figures 401 to 404 at the four corners in the second information image pattern are determined in the screen, the second information is determined from the center position of the video and the unit size of the coordinate system. The positions where the symbol figures 401 to 404 indicating the positions of the four corners included in the image pattern should be displayed can be determined. Then, as will be described later, the displayed symbol graphics 401 to 404 are searched in the vicinity of the determined position, and the actual display positions of the symbol graphics 401 to 404 are detected.

  FIG. 6 shows projection data used for detecting the positions of the four corners of the second information image pattern. The recognition method of the symbol figures 401-404 for determining the position of the four corners of a screen is demonstrated using FIG. Regions 601, 602, 603, and 604 are symbol graphic detection regions. When the symbol graphic 401 is completely inside the detection area 601 as in the detection area 601, the start point and end point of the detection area 601 in both the vertical and horizontal directions (here, “start point” and “end point” are Projection data 605 means an end point of a detection region that switches from the outside to the inside of the detection region 601 and an end point of the detection region that switches from the inside to the outside of the detection region 601 when viewed in the order of scanning of lines or pixels). Since the value of 606 is 0, it can be determined that the symbol graphic 401 is completely within the detection area 601. When such a result is obtained, it is assumed that the position of the symbol figure 401 has been detected. In the case of the detection area 602, the projection data in the vertical direction for determining the horizontal position of the symbol graphic 402 has a valid value (a value other than 0) at the start point of the detection area 602, so the boundary of the detection area 602 It can be seen that the line and the boundary of the symbol graphic 402 intersect. In such a case, the symbol figure 402 is detected again by shifting the detection area 602, and the position of the symbol figure 402 is determined (determined) in a state where the symbol figure 402 is completely within the detection area 602.

In order to accurately read the information pattern graphic 405 included in the second information image, it is necessary to correct distortion at the time of shooting from the positions of the symbol graphics 401 to 404 at the four corners. A coordinate system is obtained by using projective transformation. FIG. 7 is a diagram showing the concept of projective transformation. In projective transformation, when a point on one plane 701 is converted to a point on another plane 703, a straight line connecting the projection center and the point Q (x, y) on the one plane 701, and the other This is a transformation that associates the intersection point P (u, v) with the plane with the point Q (x, y) on the one plane 701 and is expressed by the following equation (1).
u = (a1x + a2y + a3) / (a7x + a8y + 1)
v = (a4x + a5y + a6) / (a7x + a8y + 1)
... (1)

FIGS. 8A and 8B show the pre-projection conversion when projecting four points (for example, corresponding to the positions of the symbol figures 401 to 404 and illustrated as vertices of a quadrilateral). An example of the coordinate value after conversion is shown. When these coordinate values are applied to the above equation (1), the following equation (2) is obtained. In this model, one of the four points (Q0, P0) remains unchanged (0, 0) before and after conversion, so the terms a3 and a6 are 0, and the calculation formula is omitted.
a = (a1 * 0 + a2 * h) / (a7 * 0 + a8 * h + 1)
b = (a4 * 0 + a5 * h) / (a7 * 0 + a8 * h + 1)
c = (a1 * g + a2 * h) / (a7 * g + a8 * h + 1)
d = (a4 * g + a5 * h) / (a7 * g + a8 * h + 1)
e = (a1 * g + a2 * 0) / (a7 * g + a8 * 0 + 1)
f = (a4 * g + a5 * 0) / (a7 * g + a8 * 0 + 1)
... (2)
From this, the relationship of the following formula | equation (3) is formed.
a1 =-(bce-ade) / (-bc + ad + be-de-af + cf) g
a2 = (ade−acf) / (bc−ad−be + de + af−cf) h
a4 = (− bcf + adf) / (− bc + ad + be−de−af + cf) g
a5 = − (− bde−bcf) / (bc−ad−be + de + af−cf) h
a7 = − (− be + de + af−cf) / (bc−ad−be + de + af−cf) g
a8 = − (bc−ad−be + af) / (bc−ad−be + de + af−cf) h
... (3)

  That is, the distance between the symbol figures 401 to 404 before conversion (corresponding to the points Q1 to Q4 in FIG. 8A) and the positions of the four points after projective conversion (points P0 to P3 in FIG. 8B). Is obtained, the projective transformation coefficients (a1 to a8) can be obtained. The reason why there are four points is that the positions of the symbol figures 401 to 404 are obtained from the distance from the center of the image, so that four points are required to determine the origin position.

  FIG. 9 is a diagram showing a second information image pattern (a pattern of an image acquired by the camera 101) photographed in a distorted state, and an upper right symbol graphic 402A is extended to the upper right. When the coordinate system is determined on the assumption that the positions of the symbol graphics 401A to 404A at the four corners are projection-transformed, a coordinate system such as a dotted line is determined. Information of the information pattern figure 405A is read in accordance with this new coordinate system. In this way, in the analysis of the second information image, a new coordinate system is constructed using the projective transformation from the obtained position of the symbol graphic, and the content of the information pattern graphic including the encoded information is accurately determined. Can be read.

  Next, the flow of processing by the CPU 103 will be described using a flowchart. FIG. 10 shows the entire process. First, a process S11 for acquiring information included in the common header 211 is performed, and then an information data analysis process S12 is performed. In the first embodiment, the information data analysis process is an analysis process of the synchronization confirmation data unit 212.

  FIG. 11 is a flowchart showing details of the common header information acquisition process S11 of FIG. When the common header information acquisition process is started (S100), first, a first information image detection process S101 is performed. In this detection process, not only the presence / absence of a symbol graphic in the first information image but also its position and size (size) are detected. The processing after step S101 is performed for each frame of the captured moving image. In NTSC photography with a digital video camera, since the frame rate is 29.97 fps, one frame of image data is processed about every 33.37 milliseconds. For the processed image data, it is determined whether or not the central pattern figure 301 has been detected (S102). If not detected (No in S102), the first information image detection process (No. S101) is performed. The detection procedure is as described above. All subsequent first information image detection processes are performed by the method as described above.

  If the center pattern figure 301 is detected (Yes in S102), the second information image detection process S103 is performed from the next frame.

  The second information image detection processing S103 is as described above. In step S101, the symbol graphics 401 to 404 at the four corners are obtained from the center position and unit size of the screen obtained from the symbol graphics 301 in the first information image. The range to be searched (the range including the positions where the symbol graphics at the four corners should be displayed and the positions in the vicinity thereof) is determined, and the symbol graphics 401 to 404 at the four corners are searched within the range. (In this search process, as shown in FIG. 6, when the symbol graphic 402 protrudes from the detection area 602, the position of the symbol graphic 402 is determined while the detection area 602 is shifted and enters the detection area 602. Processing is also included.) All of the subsequent second information image detection processing is performed by this method.

If the symbol graphics 401 to 404 at the four corners are not detected (No in S104), the same processing is performed for the next frame. When the symbol graphics 401 to 404 at the four corners are detected (Yes in S104), a coordinate system for reading the information pattern graphic 405 is determined by using projective transformation (S105), and is represented by the information pattern graphic 405 (graphic encoded). Information data such as content ID and test number is read (S106).
Thereby, the header information acquisition is completed (S107).

  When the acquisition of the common header information 211 is completed, an information data analysis process is performed. The procedure of the information data analysis process is shown in FIG. The analysis is performed in units of frames of the captured video. When the analysis of the information data is started (S200), it is first determined whether or not there is a photographed frame. If the shooting of the moving image is completed and there is no data to be analyzed (No in S201), the analysis of the information data analysis process is terminated (S211), and all the processes are completed.

  If there is a frame to be analyzed (Yes in S201), the first information image detection process S202 is performed. In this image detection process, if the symbol graphic 301 at the center of the screen is detected, the process proceeds to the next process. If it cannot be detected (No in S203), the same process is repeated for the next frame.

When the symbol figure 301 is detected (Yes in S203), the detection time at that time is stored. The detection time is obtained by counting with a clock (not shown) in the evaluation apparatus 100. For example, the detection time is obtained by counting a vertical synchronization signal for imaging by the camera 101, which is generated according to the clocking operation of the clock. The playback elapsed time, for example, the number of seconds representing the elapsed time from the beginning of the moving image file.
The detection time obtained in this way and the reproduction time information included in the previous information pattern graphic 405 (of the data set Gi including the first information image 206 including the symbol graphic 301 are included. It is determined whether or not it matches the reproduction time information (represented by the second information image 207 of the previous data set G (i-1)) (S204). If the time is shifted, the display timing is shifted. Is recorded as an error (S205). When the information data analysis process is started and detected for the first time (when the symbol graphic 301 included in the first information image 206 of the first data set is detected), the previous data set is It does not exist, and the information pattern figure 405 immediately before is not read, so nothing is done.

  Next, the information data in the second information image is read. As shown in FIG. 2, when the reading of the second information image 203 displayed for 300 msec continues to fail, the first information image is displayed for one second thereafter. Since the second information image 203 is not displayed, it is necessary to stop the detection of the second information image and return to the process of detecting the first information image 202 that appears next (S206). In Embodiment 1, since the display period of the first information image is 300 msec and the display period of the second information image is 300 msec, the timeout value is set to 600 msec. For this reason, the symbol graphic 301 is detected at the end of the display period of the first information image 202, and then the detection of the symbol graphics 401 to 404 of the second information image 203 continues to fail, and at the stage where a timeout occurs, The display is displaying a blank image, and the symbol graphic 301 of the next first information image 202 can be detected from the beginning of the display period of the first information image 202.

  If no timeout has occurred (No in S206), symbols in the four corners of the second information image 203 are obtained from the center position and unit size of the screen obtained from the symbol graphic 301 in the first information image in step 1202. The figures 401 to 404 are detected (S207). The detection of the four corner symbol graphics 401 to 404 in step S207 is also performed in the same manner as in step S103, based on the screen center position and unit size obtained from the symbol graphics 301 in the first information image. This is done by determining a range for searching for and searching for symbol graphics 401 to 404 at the four corners within that range.

  If the symbol graphics 401 to 404 are not found in the (predicted) area calculated based on the symbol graphics 301 of the first information image 202 (No in S208), the process returns to step S206 and is not timed out ( In step S206, the positions of the symbol figures 401 to 404 of the second information image are similarly obtained for the next frame.

When the symbol graphics 401 to 404 at the four corners are detected from the second information image 203, a new coordinate system is determined using projective transformation (S209). According to the determined coordinate system, the encoded information (information data) included in the second information image 203 is read, and the appearance time of the next first information image included in the information is obtained (S210).
Thereafter, the process returns to step S201, the first information image detection process is performed again, and the same process is repeated.
In this manner, in the image reading apparatus described in the first embodiment, the symbol graphics 401 to 404 included in the second information image 203 are determined from the position and size of the symbol graphics 301 read from the first information image 202. Since the search positions are estimated and the symbol figures 401 to 404 are searched within the range, the positions of the symbol figures 401 to 404 can be accurately determined by a relatively simple algorithm, and the information can be read accurately. As a result, it is possible to automatically monitor that the video data of the moving image file is displayed according to the time.

  In the first embodiment, the symbol graphic 301 representing the specific position of the screen in the first information image 202 is located at the center of the screen. However, this can be performed at any place as long as a certain place on the screen can be specified. Good. In addition, four symbol figures representing the specific positions necessary for correcting the distortion of the screen due to shooting in the second information image are located at the four corners of the screen. It is sufficient that the necessary number is located at an arbitrary place.

  Further, in the above example, the means for acquiring the moving image includes a camera and analyzes the video data input from the camera. However, from the moving image file obtained as a result of shooting by shooting the video played in advance with the camera. It is also possible to read This also applies to Embodiments 2 to 4 described below.

Embodiment 2. FIG.
FIG. 13 is a system configuration diagram illustrating the reproduction evaluation apparatus according to the second embodiment together with the reproduction apparatus 90 to be evaluated.
13 includes a reproduction data providing unit 91 and a reproduction signal processing unit 92 in addition to the display unit 93. The reproduction signal processing unit 92 reproduces a moving image file provided from the reproduction data providing unit 91. And displayed on the display unit 93. The moving image file provided by the reproduction data providing unit 91 of the reproducing apparatus 100 includes audio data as will be described later, and the reproduction signal processing unit 92 performs signal processing for reproducing the audio data in the moving image file. And output from the speaker 94. The reproduction evaluation apparatus 100 is for analyzing the image displayed on the display unit 93 of the reproduction apparatus 90 and the sound output from the speaker 94.

  The reproduction evaluation apparatus shown in FIG. 13 is generally the same as the reproduction evaluation apparatus shown in FIG. 1, and the same reference numerals denote the same members. The playback evaluation apparatus of FIG. 13 is different from the playback evaluation apparatus of FIG. 1 in that it includes a microphone 106 as input means for picking up sound from a speaker 94 and acquiring voice data. The CPU 103 analyzes the audio data acquired by the microphone 106 in addition to the video data acquired by the camera 101.

  FIG. 14 is a diagram showing a data structure of a moving image file representing a moving image to be played back by the playback device 90 to be evaluated in the second embodiment. As illustrated, specific audio data 1401, 1402, 1403, and 1404 are inserted in the synchronization confirmation data unit 212 in synchronization with the data set G at a certain unit time, for example, at intervals of 1 second.

  The specific sound data is, for example, DTMF (dual tone multi-frequency) sound, and a certain numerical value is expressed by a combination of frequencies constituting the sound. FIG. 15 shows the relationship between frequency combinations and numerical values to be expressed. In the second embodiment, a numerical value from 0 to 9 is used cyclically, and a DTMF sound that expresses a number of 1's of elapsed playback seconds (for example, seconds indicating the elapsed time from the start of playback of a video file). Is inserted. That is, if a DTMF sound expressing “0” is included in one audio data area 1401 (corresponding to one data set G) in the synchronization confirmation data portion, the next audio data area 1402 (next data "1" for the next set G), "2" for the next voice data area 1403 (further corresponding to the next set G of data), and the next voice data area 1404 (further, The DTMF sound expressing “3” is inserted into the corresponding data set G). In the same manner, DTMF sound data representing numerical values of “4,“ 5 ”,“ 6 ”,“ 7 ”,“ 8 ”,“ 9 ”is inserted, and“ 9 ”is followed by“ Returning to “0”, DTMF sounds representing numerical values of 0 to 9 are repeatedly inserted in the same manner.

FIG. 14 also shows the temporal relationship between video data and audio data. That is, the audio data 1401, 1402, 1403, and 1404 represent the specific audio that should be played back at the start of the display of the first information image 206, that is, the head of the corresponding data set G, respectively. is there. Therefore, when the playback device 90 is performing a playback operation correctly, the start time of the DTMF sound of the audio data is the same as the playback start time of the first information image 206 image. In the second embodiment, the synchronized reproduction of audio and video is confirmed by determining the coincidence of these times.
In FIG. 14, the audio data ADT does not exist as a separate file from the video data VDT, but is inserted as a part of the same file as the video data VDT.

FIG. 16 is a diagram showing the timing of analysis of audio data. The audio data here is PCM data. Data for 256 samples is handled for one analysis. In the second embodiment, since the sampling frequency of audio data is 8 kHz, data for 256/8000 = 0.032 seconds (32 milliseconds) is handled. In the case of stereo data with a sampling width of 16 bits, the size is 256 (sample) × 2 (bytes) × 2 (ch) = 1024 (bytes).
Will be handled. Since the analysis is performed every 10 milliseconds, the analysis of the sample data 1502 after 10 milliseconds is performed after the analysis of the sample data 1501 is performed. Thereafter, analysis is sequentially performed in the same manner as sample data 1503, 1504, and 1505.

  Next, the audio data analysis operation will be described. Since the DTMF sound to be used has a value from 0 to 9 as described above, an elapsed seconds storage area 104a for 10 seconds is secured in the memory 104 with 10 seconds as one cycle, and the elapsed seconds (evaluation apparatus 100). For example, the number of seconds representing the elapsed time from the beginning of the moving image file) is recorded. Since the result when the DTMF sound inserted at intervals of 1 second is detected is recorded, the number of seconds elapsed 10 times in 10 seconds is recorded. Since the DTMF sound is detected in units of 10 milliseconds, the recorded time has a resolution of 10 milliseconds. When the number of elapsed seconds recorded as DTMF sound becomes 0 seconds, the result is output, the recorded result is cleared, and the recording of the next cycle (cycle from 0 to 9) is started. .

  FIG. 17 is a flowchart showing the procedure of the analysis process. When the analysis is started (S300), the acquired elapsed number of seconds storage area 104a in the memory 104 is initialized (S301). Next, it is determined whether there is PCM data to be subjected to data analysis processing (S302). If there is no audio data (No in S302), the process ends (S312). If there is audio data (Yes in S302), data for 256 samples shifted by 10 milliseconds from the previous analysis is extracted (S303). If no DTMF sound is detected as a result of the analysis (No in S304), the process returns to step S302, and the process is repeated from the beginning.

  When a DTMF sound is detected (Yes in S304), the value is confirmed (S305). If 0, the detection result for the past 10 seconds (data indicating the time when the DTMF sound was detected, stored in the elapsed seconds storage area 104a) is output to a log (that is, recorded in the log file 105a in the HDD 105). ), The elapsed seconds storage area 104a is cleared (S306). If it is other than 0 in Step S305 (No in S305), it is compared with the previously detected value (recorded in the elapsed seconds storage area 104a) (S307), and the numerical value represented by the current DTMF sound is It is determined whether or not the value is one more than the numerical value represented by the DTMF sound (S307). If it is not “a numerical value that is larger by one”, it is an analysis error or the previous DTMF sound is not sounded. Therefore, it is recorded as an error (S308). If YES in step S307, or after performing the process of step S306 or S308, the process proceeds to step S309.

  In step S309, the time at which the DTMF sound is detected (data indicating the time at which the DTMF sound is detected, recorded in the log file 105a in the HDD 105) is managed as a sound detection time by the program. The detection of audio data and the detection of video data are performed by different processes, and the procedure of the video data detection operation is performed in the same manner as in the first embodiment. As shown in FIG. 14, the time at which the DTMF sound is output from the speaker 94 and the display time of the first information image should be essentially the same, and the playback processing system to be measured (the playback in FIG. 13). If there is no processing error in the signal processing unit 92, the display unit 93, and the speaker 94), these should be detected at substantially the same time. If the video data can be detected (S310), the time at that time is compared with the audio detection time, and this difference is recorded in the HDD 105 as a deviation of the synchronous reproduction of the video and audio (S311).

  In this way, in the playback evaluation device described in the second embodiment, the playback device 90 to be evaluated performs playback based on a moving image file including audio information and video information. More specifically, the moving image file includes specific audio data (DTMF sound data) every unit time (for example, 1 second), and first and second information images (206, 207) according to the unit time. Represents a moving image composed of video data in which a data set G including “A” is repeated. Then, the reproduction evaluation apparatus 100 automatically detects the difference between the reproduction time of the video and the audio by detecting whether or not the detection time of the first information image (206) matches the detection time of the specific audio data. Can be detected.

Embodiment 3 FIG.
FIG. 18 is a system configuration diagram illustrating the reproduction evaluation apparatus according to the third embodiment together with the reproduction apparatus 90 to be evaluated.
The reproduction evaluation apparatus 100 shown in FIG. 18 is for analyzing an image displayed on the display unit 93 of the reproduction apparatus 90, similarly to the reproduction evaluation apparatus 100 shown in FIG. The reproduction evaluation apparatus 100 is the same as that shown in FIG. 1, but the memory 104 has an acquired frame number storage area 104d.

  FIG. 19 is a diagram showing a moving image file representing a moving image to be played back by the playback device 90 to be evaluated in the third embodiment. The configuration of the common header unit 211 is the same as that in the first and second embodiments. In the third embodiment, a frame rate confirmation data unit 222 is provided instead of the synchronization confirmation data unit 212 of FIG. The frame rate confirmation data section 222 is configured by repeating the information image 227 for each one second. Each of a plurality of frames constituting the information image 227 for one second each includes the frame number in the second as information in order from 1. For example, as shown in FIG. 19, in the case of a 10 fps moving image file, “1” is input to the first frame E1 within one second, “2” in the next frame E2, and “3” in the next frame E3. "10", and "10" is input in the last frame E10 of 1 second. The frame number “1” is input again to the first frame E1 of the next one second, and the frame number is similarly incremented by one.

  As the information image 411 expressing the frame number, as shown in FIG. 20, the same information image as the second information image used in the first and second embodiments is used. That is, the information image 411 includes four block graphics 401 to 404 and an information pattern graphic 412 representing a frame number. Therefore, the image recognition procedure is performed in the same manner as in the first and second embodiments. The system configuration of the reading apparatus according to the third embodiment is the same as that of the first embodiment, and the reading method is also performed according to the flowchart shown in FIG. 10, and the procedure is the same as that of the first embodiment. For this reason, only the information data analysis part (processing of the frame rate confirmation data part 222) different from that of the first embodiment will be described with reference to the flowchart of FIG.

  After reading the common header information 211, the information data analysis operation is started, but the first information image is included in the information data portion (frame rate confirmation data portion 222) of the video data constituting the moving image file handled in the third embodiment. (Indicated by reference numeral 206 in the first embodiment) is not included. For this reason, as the center position of the screen and the unit size of the coordinate system, those detected when the common header information 211 is read are used as they are.

  The analysis is performed with 1 second as one cycle. When analysis is started (S400), first, an area (acquired frame number storage area) 104d for securing analysis data for one second is cleared (S401). If there is next photographed image data (Yes in S402), the second information image is detected using the center position of the screen and the unit size of the coordinate system used when the common header information 211 is read. Processing is performed (S403).

  If four symbol figures in the second information image cannot be detected (No in S404), the process returns to step S402, and the same process is performed on the next image. If four symbol figures 401 to 408 can be detected (Yes in S404), a new coordinate system is determined using projective transformation based on the position information (S405). According to the determined coordinate system, the encoded information included in the second information image is read, and the frame number is acquired (S406).

  If the acquired frame number is 1 (Yes in S407), it is determined that the analysis cycle has been completed, and the detection result up to that point (the frame number stored in the acquired frame number storage area 104d) is output to the log file. After recording in 105a, the acquisition frame number storage area 104d is cleared (S408). Then, “1”, which is the frame number acquired this time, is stored in the acquired frame number storage area 104d (S409), and the process returns to step S402 to process the next frame.

  If the acquired frame number is not 1 (No in S407), a comparison is made with the previously acquired frame number (stored in the acquired frame number storage area 104d). The previously acquired frame number is the largest number of valid data in the acquired frame number storage area 104d. If the currently acquired frame number is one larger than the previously acquired frame number (Yes in S410), it is determined that the frame is being played back normally, and the currently acquired frame number is stored in the acquired frame number storage area 104d ( In step S409, the process returns to step S402 to process the next frame.

If the frame number acquired this time is not 1 larger than the frame number acquired last time (No in S410), the magnitude relationship between the frame number acquired this time and the frame number acquired last time is compared (S411), If the currently acquired frame number is smaller than the previously acquired frame number (Yes in S411), it is determined that the analysis cycle has been completed, and after outputting the result, the acquired frame number storage area 104d is cleared (S408). The frame number acquired this time is stored in the acquired frame number storage area 104d (S409), and the process returns to step S402 to process the next frame.
If the currently acquired frame number is not smaller than the previously acquired frame number (No in S411), it is determined that the analysis cycle has not been completed, and the currently acquired frame number is stored in the acquired frame number storage area 104d ( In step S409, the process returns to step S402 to process the next frame.

  When the photographing is finished and there is no image data to be analyzed (No in S402), the analysis process is finished (S412).

  The detection result recorded in the log file 105a is used for confirming the number of frames per unit time. Specifically, it is determined that the frame whose frame number could not be detected is not displayed, and is used to measure or confirm the number of frames displayed per unit time, that is, the rate.

  In this manner, the image reading apparatus described in the third embodiment can accurately read the number of the video frame included in the data graphic, and therefore can accurately measure the playback frame rate.

Embodiment 4 FIG.
FIG. 22 is a system configuration diagram illustrating the reproduction evaluation apparatus according to the fourth embodiment together with the reproduction apparatus 90 to be evaluated.
The reproduction evaluation apparatus 100 shown in FIG. 22 is for analyzing an image displayed on the display unit 93 of the reproduction apparatus 90, similarly to the reproduction evaluation apparatus 100 shown in FIG. This playback evaluation apparatus 100 is the same as that shown in FIG. 1, except that the memory 104 has an acquisition frame number storage area (current acquisition frame number storage area) 104d similar to that of the third embodiment and the previous acquisition. It has a frame number storage area 104e.

  FIG. 23 is a diagram showing a moving image file representing a moving image to be played back by the playback device 90 to be evaluated in the fourth embodiment. The configuration of the common header section 211 is the same as that in the first embodiment, the second embodiment, and the third embodiment. In the fourth embodiment, as in the third embodiment, a frame rate confirmation data unit 222 is provided instead of the synchronization confirmation data 212 of FIG. The frame rate confirmation data section 222 is configured by repeating the information image 237 for each one second. Similarly to the third embodiment, the plurality of frames constituting the information image 237 for each one second include the frame numbers within the one second as information in order from 1. In the third embodiment, the information image 411 including four symbol graphics is used as the frame number information. However, in the fourth embodiment, the frame number is expressed by a block graphic representing the frame number.

  In the example shown in FIG. 23, each information image 237 is composed of 30 frames (first to 30th frames F1 to F30), and the first, second, third, seventh, twentieth, thirtyth, and so on in FIG. FIG. 24 shows block diagrams B1, B2, B3, B7, B20, and B30 of the frames F1, F2, F3, F7, F20, and F30.

  As can be understood from the example shown in FIG. 24, the block graphic of the information image 237 is one in which 30 rectangular areas at different positions are filled in black as an inscription, depending on the frame number. , Rectangular regions at different positions (ie, not overlapping each other) are filled. The rectangular areas are arranged in a matrix of 5 rows and 6 columns, and the block figure B1 of the first frame F1 is filled with the rectangular area in the upper left (first row and first column). The block figure B2 of the first frame F2 is a rectangular area in the first row and the second column, the block figure B3 of the third frame F3 is a rectangular area in the first row and the third column, and so on. In each row, the position of the filled area is shifted in order from the left end to the right in each row. In this way, the markings (filled areas) corresponding to different frames are provided at positions that do not overlap each other in the screen.

  FIG. 24 shows a coordinate system that divides the screen with a dotted line only for the block graphic B1 of the first frame F1. As shown in the figure, the position of the block graphic uses the same coordinate system as that used to construct the first information image and the second information image, and is obtained by analyzing the first information image. The position can be specified from the center position of the screen and the unit size of the coordinate system.

  In the moving image file handled in the fourth embodiment, the position of the block graphic expresses the frame number, and therefore, when the frame rate at the time of camera shooting is low, a plurality of block graphics that are reproduced images are captured and overlapped. Specifically, as shown in FIG. 25, a plurality of block graphics (in FIG. 25, a block graphic B8 of the eighth frame F8 and a block graphic B9 of the ninth frame F9 in FIG. 25) are captured. For this reason, even when the frame rate of the camera is low, it is possible to capture the display information of the reproduction system without leaking.

  The system configuration of the reading apparatus according to the fourth embodiment is the same as that of the first embodiment, and the reading method is also performed according to the flowchart shown in FIG. 10, and the procedure is the same as that of the first embodiment. For this reason, only the analysis processing of the information data portion (processing of the frame rate confirmation data portion 222) different from the first embodiment will be described using the flowchart of FIG.

  After the common header information 211 is read, the analysis operation of the information data portion is started, but the first information is included in the information data portion (frame rate confirmation data portion 222) of the video data constituting the moving image file handled in the fourth embodiment. An image (shown by reference numeral 206 in the first embodiment) is not included. For this reason, as for the center position of the screen and the unit size of the coordinate system, what is detected when the common header information is read is used as it is, as in the third embodiment.

  Also in the fourth embodiment, the analysis is performed with 1 second as one cycle. When the analysis is started (S500), first, the current acquisition frame number storage area 104d and the previous acquisition frame number storage area 104e, which are areas for securing analysis data for one second, are cleared (S501). If there is next photographed image data (Yes in S502), a block figure that means a frame number using the center position of the screen and the unit size of the coordinate system used when reading the common header information 211 Is detected, and the frame number is acquired (S503). In the fourth embodiment, in order to prioritize the processing speed, the projective transformation for the purpose of distortion correction is not performed on the captured information image, and the center position of the screen specified from the symbol graphic 301 included in the first information screen is performed. The position of the block graphic (B1 to B30) representing the frame number is estimated from the unit size of the coordinate system, and the presence or absence of the block graphic at that position is detected and the frame number is detected. Here, in the case of FIG. 25, two frame numbers are detected.

  If the block graphic cannot be detected (No in S504), the process returns to step S502, and the same processing is performed on the next video data.

  If the frame number can be detected (Yes in S504), the frame number (one or more frame numbers) is stored in the previously acquired frame number (previously acquired frame number storage area 104e, which will be described later. If a plurality of previous frame numbers are detected by the process of step S514, the largest value among them is recorded as “last acquired frame number” to 30 (for 1 second) It is determined whether or not it is within the range up to the number of frames, and therefore the maximum frame number (S505). If the corresponding frame number is detected in step S505 (Yes in S506), if a plurality of frame numbers are detected in step S503 as described above, the previously acquired frame number is detected for each detected frame number. It is determined whether it is in the range from the number to 30 (the maximum value of the frame number). As a result of this determination, all frame numbers determined to be in the above range are stored in the acquired frame number storage area 104d (S507).

Next, a search is made for a frame number (one or two or more) detected in step S503 that is smaller than the previously acquired frame number (S508). If no corresponding one is found (No in S509), it is determined that the analysis cycle has not been completed, and the largest one of the frame numbers acquired this time is stored in the storage area 104e as the “frame number acquired last time”. (S510).
If a corresponding one is found (Yes in S509), it is determined that the analysis cycle has been completed, and the acquisition frame number stored in the acquisition frame number storage area 104d, which is data for one second, is output and recorded in the log file 105a. (S511). Then, the acquired frame number storage area 104d is cleared (S512), the current frame number corresponding to the current frame number is stored in the acquired frame number storage area 104d (S513), and the largest frame number corresponding to the current time is determined as the previously acquired frame number. Is stored in the storage area 104e (S514). Thereafter, by returning to step S502, the same processing is performed for the next image data. If there is no more image data (No in S502), the analysis is terminated (S515).

  The acquired frame number recorded in the log file 105a is used to calculate the number of frames displayed per unit time, that is, the frame rate.

  In this manner, the image reading apparatus described in Embodiment 4 can perform analysis processing on image data obtained by capturing a plurality of information images, so even if a camera with a low shooting frame rate is used. The frame rate of playback can be measured accurately.

  The analysis means in the reproduction evaluation according to the present invention is typically realized by a general-purpose personal computer. However, when the above-described data structure for reproduction evaluation is used, the analysis becomes a light process, so the HW resource is not sufficient. Analysis can also be performed with embedded devices.

It is a system block diagram which shows the reproduction | regeneration evaluation apparatus of Embodiment 1 of this invention with the reproducing | regenerating apparatus 90 used as evaluation object. It is a figure which shows the video data which comprises the moving image file showing the moving image reproduced | regenerated with the reproducing | regenerating apparatus of FIG. It is the figure which showed the pattern of the 1st information image. It is the figure which showed the pattern of the 2nd information image. It is the figure which showed the projection data used in order to detect the symbol figure which shows the center position of an image from the 1st information image. It is the figure which showed the projection data used in order to detect the position of the four corners of a 2nd information image pattern. It is a conceptual diagram of projective transformation. (A) And (b) is the figure which showed the coordinate relationship before and after projective transformation. It is a figure which shows an example of the pattern of the 2nd information image image | photographed in the distorted state. 5 is a flowchart showing the entire processing of the first, second, third, and fourth embodiments. It is a flowchart which shows the detail of the common header information acquisition process of FIG. 5 is a flowchart showing analysis processing of an information data portion in video data according to the first and second embodiments. It is a system block diagram which shows the reproduction | regeneration evaluation apparatus of Embodiment 2 with the reproduction | regeneration apparatus used as evaluation object. 6 is a diagram illustrating a data structure of a moving image file representing a moving image to be played back by a playback device to be evaluated in Embodiment 2. FIG. It is the table | surface which showed the relationship between the combination of the frequency which comprises a DTMF sound, and the numerical value which it represents. It is the figure which showed the timing of the analysis of audio | voice data. 10 is a flowchart illustrating a procedure of audio data analysis processing according to the second embodiment. FIG. 10 is a system configuration diagram illustrating a reproduction evaluation apparatus according to a third embodiment together with a reproduction apparatus to be evaluated. FIG. 10 is a diagram illustrating a moving image file representing a moving image that is played back by a playback device that is an evaluation target in the third embodiment. 10 is a diagram illustrating an example of an information image expressing a frame number used in Embodiment 3. FIG. 12 is a flowchart illustrating an analysis process of an information data portion in video data according to the third embodiment. FIG. 10 is a system configuration diagram showing a playback evaluation apparatus according to Embodiment 4 together with a playback apparatus to be evaluated. FIG. 10 is a diagram illustrating a moving image file representing a moving image that is played back by the playback device 90 that is an evaluation target in the fourth embodiment. It is the figure which showed the block figure of each frame in the video data used in Embodiment 4. FIG. It is a figure which shows the example which was image | photographed in multiple block figures which are reproduction images, when the frame rate at the time of camera imaging | photography is low. 10 is a flowchart illustrating an analysis process of an information data portion in video data according to a fourth embodiment.

Explanation of symbols

90 playback device, 91 moving image providing unit, 92 playback signal processing unit, 93 display unit, 94 speaker, 100 playback evaluation device, 101 camera, 102 monitor, 103 CPU, 104 memory, 105 HDD, 106 microphone, 201, 204, 205 , 208 Blank image, 202, 206 First information image, 203, 207, 411 Second information image, 301 Symbol graphic of the first information image, 401, 402, 403, 404 Symbol graphic of the second information image 405 Data graphic of second information image 501, 502, 605, 606, 607, 608 Cumulative data of image data 601, 602, 603, 604 Symbol graphic detection area 701, 703 plane, 702 Projection center, 1401, 1402, 1403, 1404 D in audio data MF sound, 1501,1502,1503,1504,1505 256 samples of voice data.

Claims (20)

Video data acquisition means for acquiring video data obtained by capturing a video reproduced based on a video file by the evaluated device;
A reproduction evaluation apparatus having analysis means for analyzing acquired video data,
A moving image file including video data representing a moving image to be reproduced by the device to be evaluated includes first image data and second image data;
The first image data represents a first information image composed of a first symbol graphic representing a first specific position in the screen;
Second symbol graphics representing a plurality of second specific positions different from each other in the screen, and information for analysis, in which the second image data is to be reproduced before and after the first information image A second information image including a data graphic encoded with a graphic,
The analysis means is
Determining the first specific position based on the first symbol graphic in the first information image reproduced by the device under evaluation;
Based on the position information representing the determined first specific position, the device to be evaluated determines the position where the second symbol graphic is to be reproduced, and the second reproduced near the calculated position. The position of the second symbol figure is determined by searching for the second symbol figure, the distortion of the screen is corrected based on the deviation of the determined second specific position from the determined position, and the data A reproduction evaluation apparatus characterized in that it decodes data encoded by a figure. The analyzing means detects a size of the first symbol graphic in the first information image reproduced by the device under evaluation;
Based on not only the position information indicating the first specific position but also the position information indicating the size of the first symbol graphic, the evaluation target device determines the position where the second symbol graphic is to be reproduced. 2. The reproduction evaluation apparatus according to claim 1, wherein indexing is performed. The video data of the video file represents video in which the first and second information images are alternately repeated,
Reproduction time information indicating the time at which the first information image reproduced first after the reproduction of the second information image is to be reproduced is included in the data encoded by the data graphic in the second information image. Is included,
The analysis means is
Reproduction time information obtained by decoding a data graphic in the second information image reproduced by the device under evaluation;
2. The reproduction according to claim 1, wherein it is detected whether or not a time when the first information image is reproduced by the device to be evaluated first after the reproduction of the second information image. 3. Evaluation device. The moving image file represents a video in which the first and second information images are alternately and repeatedly reproduced, and the moving image file contains audio to be reproduced in synchronization with the reproduction of the first information image. Voice data to represent,
Audio data acquisition means for acquiring audio data obtained by collecting audio reproduced based on the audio data;
The analysis means is
The time at which the first information image is reproduced by the device under evaluation and the time at which the sound is reproduced by the device under evaluation are detected. Reproduction evaluation device. The video file is
Represents a video that contains graphics representing the numbers of each of the frames that make up the video,
Based on a frame number obtained by decoding the video reproduced by the device under evaluation, the analysis means,
The playback evaluation apparatus according to claim 1, wherein the number of frames displayed per unit time is confirmed. The reproduction evaluation apparatus according to claim 5, wherein the frame number is cyclically changed at a predetermined period. The video data of the video file represents video including an inscription representing a frame number displayed at a position that does not overlap each other on the screen,
6. The reproduction evaluation apparatus according to claim 5, wherein the analysis unit confirms the number of frames displayed per unit time based on video data obtained by capturing a video including the inscription. . The analysis means is
Confirmation of the number of frames based on video data obtained by estimating the position of the video including the stamp from the first symbol graphic in the first information image and reading the video including the stamp The reproduction evaluation apparatus according to claim 7, wherein: The plurality of second specific positions are positions of the four corners of the screen;
2. The reproduction evaluation according to claim 1, wherein the second symbol graphic representing the position of one of the four corners is different from the second symbol graphic representing the position of the other corner. apparatus.   The reproduction evaluation apparatus according to claim 1, wherein the analysis unit corrects distortion of the screen by projective transformation. A video data acquisition step of acquiring video data obtained by imaging a video reproduced based on a video file by the evaluated device;
A playback evaluation method comprising: an analysis step for analyzing the acquired video data,
A moving image file including video data representing a moving image to be reproduced by the device to be evaluated includes first image data and second image data;
The first image data represents a first information image composed of a first symbol graphic representing a first specific position in the screen;
Second symbol graphics representing a plurality of second specific positions different from each other in the screen, and information for analysis, in which the second image data is to be reproduced before and after the first information image And a second information image including a data graphic encoded with
The analyzing step comprises:
Determining the first specific position based on the first symbol graphic in the first information image reproduced by the device under evaluation;
Based on the position information representing the determined first specific position, the device to be evaluated determines the position where the second symbol graphic is to be reproduced, and the second reproduced near the calculated position. The position of the second symbol figure is determined by searching for the second symbol figure, the distortion of the screen is corrected based on the deviation of the determined second specific position from the determined position, and the data A reproduction evaluation method characterized by decoding data encoded by a figure. The analyzing step detects a size of the first symbol graphic in the first information image reproduced by the device under evaluation;
Based on not only the position information indicating the first specific position but also the position information indicating the size of the first symbol graphic, the evaluation target device determines the position where the second symbol graphic is to be reproduced. 12. The reproduction evaluation method according to claim 11, wherein indexing is performed. The video data of the video file represents video in which the first and second information images are alternately repeated,
Reproduction time information indicating the time at which the first information image reproduced first after the reproduction of the second information image is to be reproduced is included in the data encoded by the data graphic in the second information image. Is included,
The analyzing step comprises:
Reproduction time information obtained by decoding a data graphic in the second information image reproduced by the device under evaluation;
12. The reproduction according to claim 11, wherein it is detected whether or not the time when the first information image is reproduced by the device under evaluation first coincides with the reproduction of the second information image. Evaluation methods. The moving image file represents a video in which the first and second information images are alternately and repeatedly reproduced, and the moving image file contains audio to be reproduced in synchronization with the reproduction of the first information image. Voice data to represent,
An audio data acquisition step of acquiring audio data obtained by collecting audio reproduced based on the audio data;
The analyzing step comprises:
The time at which the first information image is reproduced by the device under evaluation and the time at which the sound is reproduced by the device under evaluation are detected. Reproduction evaluation method. The video file is
Represents a video that contains graphics representing the numbers of each of the frames that make up the video,
The analysis step is based on a frame number obtained by decoding the video reproduced by the device to be evaluated.
The playback evaluation method according to claim 11, wherein the number of frames displayed per unit time is confirmed. The reproduction evaluation method according to claim 15, wherein the frame number changes cyclically at a predetermined period. The video data of the video file represents video including an inscription representing a frame number displayed at a position that does not overlap each other on the screen,
16. The reproduction evaluation method according to claim 15, wherein the analysis step confirms the number of frames displayed per unit time based on video data obtained by capturing a video including the inscription. . The analyzing step comprises:
Confirmation of the number of frames based on video data obtained by estimating the position of the video including the stamp from the first symbol graphic in the first information image and reading the video including the stamp The reproduction evaluation method according to claim 17, wherein: The plurality of second specific positions are positions of the four corners of the screen;
12. The reproduction evaluation according to claim 11, wherein the second symbol graphic representing the position of one of the four corners is different from the second symbol graphic representing the position of the other corner. Method.   The reproduction evaluation method according to claim 11, wherein the analysis step performs correction of distortion of the screen by projective transformation.

Images