JP5092028B2 - Video processing apparatus and video processing method - Google Patents

Description

  The present invention relates to a video processing apparatus and video processing method for reproducing moving image data.

  In recent years, opportunities to reproduce and view moving image data on electronic devices such as personal computers and video recorders have increased. The moving image data to be reproduced is obtained from moving image data sharing sites on the Internet in addition to moving image data recorded on a DVD or moving image data recorded by broadcast program data broadcasted by a television broadcast signal. Moving image data. For this reason, there are various electronic devices such as a personal computer and a video recorder such as MPEG-2 (H.262 | MPEG-2), MPEG-4, MPEG-4 AVC (H.264 | MPEG-4 AVC). A reproduction function corresponding to the moving image data in the format is required.

  Patent Document 1 discloses an audio / video synchronized reproduction method capable of controlling synchronization between audio and video without using a frame rate described in video data. In this audio / video synchronized playback method, a difference time and the number of frames between the latest time stamp and the previous time stamp are calculated using a frame with a time stamp added in the video data. The frame rate is calculated using the time and the number of frames.

Japanese Patent Laid-Open No. 11-355726

  By the way, it may not be essential to add the information regarding the reproduction timing to the moving image data for each processing unit such as GOP depending on the format of the moving image data. For example, MPEG-4 AVC (H.264 | MPEG-4 AVC) moving image data may use a GOP that does not include information related to playback timing. For this reason, for example, when moving image data such as a live stream is reproduced from the middle, there is a possibility that the display timing of the picture is not known and cannot be reproduced smoothly.

  In addition, there is a possibility that moving image data distributed on the Internet does not strictly conform to the standard, and there is moving image data to which information regarding reproduction timing is not added. Such moving image data is also difficult to reproduce smoothly because the reproduction timing is unknown.

  The present invention has been made in consideration of the above-described circumstances, and an object thereof is to provide a video processing apparatus and a video processing method capable of smoothly reproducing moving image data whose reproduction timing is unknown.

In order to solve the above-described problem, a video processing apparatus according to the present invention includes decoding means for decoding encoded moving image data including a plurality of processing units each including a plurality of pictures corresponding to a predetermined reproduction time. When the processing unit to be reproduced in the moving image data is decoded by the decoding unit, the number of pictures included in the processing unit to be reproduced is counted to detect the number of pictures to be reproduced. Detecting means for detecting a ratio between a progressive frame picture and an interlaced field picture included in the processing unit; and when the timing information is not included in the playback target processing unit, the playback target processing unit the number and the progressive previous picture detected by said detecting means at the time of decoding the reproduced processing units of And percentage of the field picture of the frame picture and an interlace method in the method, the frame rate calculating means for calculating a reproduction frame rate based on said predetermined reproduction time, on the basis of the reproduction frame rate the calculated, the reproduction object Display timing determining means for determining the display timing of a plurality of pictures included in the processing unit.

  ADVANTAGE OF THE INVENTION According to this invention, the video processing apparatus and video processing method which can reproduce smoothly the moving image data whose reproduction timing is unknown can be provided.

The perspective view which shows the example of the external appearance of the video processing apparatus which concerns on one Embodiment of this invention. The block diagram which shows the structural example of the video processing apparatus of the embodiment. 2 is an exemplary block diagram showing an example of the functional configuration of a video processing application used in the video processing apparatus of the embodiment. FIG. The figure which shows the structural example of the moving image data input into the video processing apparatus of the embodiment. The figure which shows the specific structural example of the moving image data of FIG. The figure for demonstrating the method of calculating the display timing of the moving image data of FIG. The figure which shows the specific example which calculates the display timing of the moving image data of FIG. The figure which shows another specific example which calculates the display timing of the moving image data of FIG. 6 is an exemplary flowchart illustrating a procedure of display timing calculation processing executed by the video processing apparatus according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, with reference to FIG. 1 and FIG. 2, the structure of the video processing apparatus which concerns on one Embodiment of this invention is demonstrated. The video processing apparatus according to the present embodiment is realized by, for example, a notebook portable personal computer 10 that functions as an information processing apparatus.

  The personal computer 10 can reproduce video content data (audio visual content data) such as broadcast program data, video data input from an external device, and video data distributed through a network such as the Internet.

  FIG. 1 is a perspective view of the computer 10 with the display unit opened. The computer 10 includes a computer main body 11 and a display unit 12. The display unit 12 incorporates a display device including a TFT-LCD (Thin Film Transistor Liquid Crystal Display) 17.

  The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position where the upper surface of the computer main body 11 is exposed and a closed position covering the upper surface of the computer main body 11. The computer main body 11 has a thin box-shaped housing, and has a keyboard 13 on its upper surface, a power button 14 for powering on / off the computer 10, an input operation panel 15, a touch pad 16, and a speaker. 18A, 18B, etc. are arranged.

  Next, the system configuration of the computer 10 will be described with reference to FIG.

  As shown in FIG. 2, the computer 10 includes a CPU 101, a north bridge 102, a main memory 103, a south bridge 104, a graphics processing unit (GPU) 105, a video memory (VRAM) 105A, a sound controller 106, a BIOS- ROM 109, LAN controller 110, hard disk drive (HDD) 111, DVD drive 112, video processor 113, memory 113A, network controller 114, IEEE 1394 controller 115, embedded controller / keyboard controller IC (EC / KBC) 116, TV tuner 117, And an EEPROM 118 and the like.

  The CPU 101 is a processor that controls the operation of the computer 10 and executes various application programs such as an operating system (OS) 201 and a video processing application program 202 that are loaded from the hard disk drive (HDD) 111 to the main memory 103. To do. The video processing application program 202 is software for reproducing moving image data. The video processing application program 202 is received by the LAN controller 110, moving image data recorded on the broadcast program data received by the TV tuner 117, moving image data recorded on a DVD or the like stored in the HDD 111 or the DVD drive 112, and the like. Video data distributed from a server on the network can be reproduced. The CPU 101 also executes a BIOS (Basic Input Output System) stored in the BIOS-ROM 109. The BIOS is a program for hardware control.

  The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the GPU 105 via a PCI EXPRESS standard serial bus or the like.

  The GPU 105 is a display controller that controls the LCD 17 used as a display monitor of the computer 10. A display signal generated by the GPU 105 is sent to the LCD 17. The GPU 105 can also send a digital video signal to the external display device 1 via the HDMI control circuit 3 and the HDMI terminal 2.

  The HDMI terminal 2 is an external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display device 1 such as a television with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to the external display device 1 called an HDMI monitor via the HDMI terminal 2.

  The south bridge 104 controls each device on an LPC (Low Pin Count) bus and each device on a PCI (Peripheral Component Interconnect) bus. The south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the hard disk drive (HDD) 111 and the DVD drive 112. Further, the south bridge 104 has a function of executing communication with the sound controller 106.

  Furthermore, a video processor 113 is connected to the south bridge 104 via a PCI EXPRESS standard serial bus or the like.

  The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B or the HDMI control circuit 3.

  The LAN controller 110 is a communication device that executes, for example, IEEE 802.3 standard communication. The network controller 114 is a wireless communication device that performs wireless communication of, for example, the IEEE 802.11 standard. The IEEE 1394 controller 115 executes communication with an external device via an IEEE 1394 standard serial bus.

  The embedded controller / keyboard controller IC (EC / KBC) 116 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard (KB) 13 and the touch pad 16 are integrated. . The embedded controller / keyboard controller IC (EC / KBC) 116 has a function of powering on / off the computer 10 in accordance with the operation of the power button 14 by the user. Further, the embedded controller / keyboard controller IC (EC / KBC) 116 has a function of executing communication with the remote control unit interface 20.

  The TV tuner 117 is a receiving device that receives broadcast program data broadcast by a television (TV) broadcast signal, and is connected to the antenna terminal 19. The TV tuner 117 is realized as a digital TV tuner capable of receiving digital broadcast program data such as terrestrial digital TV broadcast. The TV tuner 117 also has a function of capturing video data input from an external device.

  FIG. 3 is a block diagram showing the configuration of the video processing application program 202. As described above, the video processing application program 202 is the moving image data that records the broadcast program data received by the TV tuner 117, the moving image data that is recorded on the DVD stored in the HDD 111 or the DVD drive 112, the Internet The moving image data distributed from the server can be reproduced. Hereinafter, an example in which the moving image data 111A stored in the HDD 111 is reproduced will be described.

  The video processing application program 202 decodes and reproduces the encoded (compressed) moving image data 111A. The moving image data 111A is, for example, H.264. H.264 | MPEG-4 AVC (hereinafter referred to as H.264 / AVC), MPEG-2, and MPEG-4. This moving image data 111A is composed of a plurality of GOPs. Each GOP is a processing unit including a plurality of pictures corresponding to a predetermined reproduction time. The video processing application program 202 includes a control unit 31, a content decoding unit 32, a display timing calculation unit 33, a reproduction processing unit 34, a data storage unit 35, a picture group information detection unit 36, and a frame rate calculation unit 37.

  The control unit 31 controls each unit in the video processing application program 202. The content decoding unit 32 reads the compressed and encoded moving image data 111A stored in the HDD 111, and decodes the read moving image data 111A. The decoding of the moving image data 111A can be executed in units of GOP, for example.

  FIG. 4 is a diagram illustrating an example of the configuration of the moving image data 111A. The moving image data 111A is configured in a unit called GOP (Group of Pictures) 41. The GOP 41 includes data of a plurality of pictures that are reproduced during a predetermined period (for example, 0.5 seconds). The GOP 41 is composed of a plurality of access units (AU) 42.

  The access unit 42 is a unit for accessing information in the bit stream of the encoded moving image data for each picture. Each access unit 42 includes a plurality of NAL units 43.

  Each NAL unit 43 includes a NAL header 431 and compressed moving image data 432. The NAL header 431 includes nal_ref_idc that is information indicating whether the NAL unit is a reference picture, and nal_unit_type that is an identifier indicating the type of the NAL unit.

  The NAL unit 43 includes a VCL NAL unit and a non-VCL NAL unit. The VCL NAL unit is a NAL unit including picture (slice) data that is image data. The non-VCL NAL unit is a NAL unit including metadata such as a parameter set such as SPS (Sequence Parameter Set) and PPS (Picture Parameter Set), SEI (Supplemental Enhancement Information), and AU delimiter.

  FIG. 5 is a diagram illustrating examples of several NAL units 51 that can be included in the access unit 42.

  The access unit 42 includes an AU delimiter 511, SPS 512, PPS 513, SEI 514, main picture 515, redundant picture 516, EOS (End of Sequence) 517, EOS (End of Stream) 518, and the like.

  The AU delimiter 511 is a start code indicating the head of the access unit. The SPS 512 is a header including information related to encoding of the entire sequence such as a profile, a level, and an encoding mode of the entire sequence. However, the SPS 512 is not added to the head of the sequence, but the SPS 512 sent up to the head of the sequence is used as header information. The PPS 513 is header information indicating a coding mode (for example, an entropy coding mode, a quantization parameter initial value for each picture) of the entire picture. However, the PPS 513 is not added to all pictures. When there is no PPS 513, the PPS 513 sent up to the head of the picture is used as header information. SEI 514 indicates additional information that is not essential for decoding the sequence. For example, picture timing information, information used for random access, information defined by the user, and the like are described. The main picture 515 includes normal picture information. By decoding the information included in the main picture 515, the pictures in the sequence can be restored. The redundant picture 516 includes information on a picture used when a transmission error or the like occurs. Therefore, the redundant picture 516 is used when a part of data of the main picture 515 is lost due to a transmission error or the like. EOS 517 is a code indicating the end of one sequence. The EOS 518 is a code indicating the end of the stream.

  The content decoding unit 32 decodes the moving image data 111A, analyzes the structure of the GOP 41, the access unit 42, the NAL unit 43, and the like as described above, and outputs the analysis result to the display timing calculation unit 33. Also, the picture group information detection unit 36 provided in the content decoding unit 32 detects picture group information related to a picture group included in the reproduction target GOP when the reproduction target GOP is decoded. The picture group information indicates the number of pictures included in the GOP to be played back, the ratio of progressive frame pictures and interlaced field pictures contained in the processing unit to be played back, and the like. The picture group information detection unit 36 outputs the detected picture group information to the data storage unit 35.

  The data storage unit 35 stores the input picture group information in the main memory 103 or the like. The picture group information is saved every time the GOP to be reproduced is decoded. Accordingly, when the picture group information of the previous GOP to be reproduced is stored, the data storage unit 35 updates this picture group information with the picture group information of the new GOP to be reproduced.

  The display timing calculation unit 33 determines the display timing of each picture in the GOP to be played based on the analysis result by the content decoding unit 32. When reproducing the access unit 423, the display timing calculation unit 33 determines the timing for displaying the picture stored in the main picture 515 based on the parameters included in the SPS 512 and the SEI 514. The display timing is calculated using, for example, Picture Timing SEI which is a part of SEI 514 and VUI (Video Usability Information) which is a part of SPS 512.

  In the Picture Timing SEI, picture structure information and the like are described. In Picture Timing SEI, for example, information of pic_struct is described.

  pic_struct describes the structure of a picture. For example, the order in the data of the picture corresponding to the odd-numbered line and the picture corresponding to the even-numbered line in the interlace system, the number of times of displaying each picture, and the like are described.

  In the VUI, parameters related to video display information are described. For example, values of time_scale and num_units_in_tick are set in the VUI. time_scale indicates the number of time units per second. For example, in the case of a 27 MHz clock, a value of 27000 is set in time_scale.

  Num_units_in_tick indicates the number of time units at the clock operating frequency time_scale [Hz]. This value becomes 1 increment in the clock counter (clock tick counter). One clock tick is a minimum unit of time that can be expressed in the encoded data. For example, when the video clock frequency is 30000/1001 [Hz], 30000 is set to time_scale, and 1001 is set to num_units_in_tick.

  The display timing calculation unit 33 determines the display timing of each of the pictures included in the GOP 41 including the plurality of access units 42 by using the above-described Picture Timing SEI pic_struct, VUI time_scale, num_units_in_tick, and the like.

  However, the only NAL unit essential for the access unit 42 is the main picture 515, and other NAL units such as the SPS 512 and the SEI 514 are optional NAL units stored in the access unit as necessary. That is, it is not indispensable to add information related to the reproduction timing to the moving image data 111A for each access unit 42 or for each GOP 41. In addition, there is a possibility that moving image data distributed on the Internet does not strictly conform to the standard and there is an access unit 42 or GOP 41 to which information regarding reproduction timing is not appropriately added. . Accordingly, when moving image data such as a live stream is reproduced from the middle, or when the NAL unit storing the reproduction timing information is not included in the access unit 42 (GOP 41), the picture display timing is set. It is difficult to reproduce smoothly without knowing.

  For this reason, the content decryption unit 32 determines whether or not the decrypted GOP to be reproduced includes information regarding display timing. When the GOP to be played back does not include information related to the display timing, the display timing calculation unit 33 uses the information (picture group information) of the GOP that has been played back immediately before the GOP to be processed (the previous GOP). Using this, the display timing (time stamp value) of the GOP to be processed is calculated.

  Information on the previous GOP is stored in the main memory 103 or the like by the data storage unit 35. As described above, the previous GOP information includes the number of pictures included in the previous GOP, the ratio between the frame picture and the field picture included in the previous GOP, and the like. Also, the information on the previous GOP may further include information such as the playback time of the previous GOP, the number of times the picture is displayed, and the like.

  The frame rate calculation unit 37 provided in the display timing calculation unit 33 is, for example, based on the playback time of the previous GOP 411 and the number of pictures included in the previous GOP 411 as shown in FIG. The frame rate of the GOP 411, that is, the number of reproduced frames per unit time [frame / second] is calculated by the following equation.

The number of pictures included in the previous GOP / the playback time of the previous GOP In this way, the frame rate calculation unit 37 has the picture group information (the previous one stored in the main memory 103 or the like by the data storage unit 35). The frame rate is calculated using the GOP picture group information).

  FIG. 7 shows an example in which the display timing is determined based on the playback time of the previous GOP 411 and the number of pictures. In the example shown in FIG. 7, the playback time of the previous GOP 411 is 0.5 seconds, and the number of pictures 61 included in the previous GOP 411 is fifteen. It is assumed that all pictures 61 included in the immediately preceding GOP 411 are progressive pictures (frame pictures).

  In this case, the number of playback frames per unit time is 30 frames / second. The display timing calculation unit 33 determines the display timing of the picture included in the GOP to be processed based on the calculated number of playback frames per unit time. When the number of playback frames per unit time is 30 frames / second, the display timing calculation unit 33 determines the display timing so that a picture is displayed every 1/30 seconds.

  FIG. 8 shows another example in which the display timing calculation unit 33 determines the display timing. In the example shown in FIG. 8, the playback time of the previous GOP 411 is 0.5 seconds. The picture 71 included in the previous GOP 411 is 24 interlaced field pictures 71 composed of 12 pictures for displaying odd lines and 12 pictures for displaying even lines. For the display of one frame, two pictures of an odd line picture and an even line picture are used. Therefore, a 12-frame image is displayed on the LCD 17 by 24 interlaced pictures 71. Therefore, the number of playback frames per unit time is 24 frames / second. When the number of playback frames per unit time is 24 frames / second, the display timing calculation unit 33 sets the display timing so that an odd line picture and an even line picture are displayed every 1/24 second. decide.

  8 shows a picture 72 when the picture 71 included in the previous GOP 411 is displayed by the 3: 2 pull-down method. As shown in the figure, the number of frames to be displayed is increased by displaying some pictures twice. For this reason, an image of 15 frames is displayed on the LCD 17 during a reproduction time of 0.5 seconds. Therefore, the number of playback frames per unit time is 30 frames / second. When the number of playback frames per unit time is 30 frames / second, the display timing calculation unit 33 sets the display timing so that an odd line picture and an even line picture are displayed every 1/30 seconds. decide.

  The display timing calculation unit 33 outputs the determined display timing information to the reproduction processing unit 34.

  The reproduction processing unit 34 displays the picture included in the GOP to be processed on the LCD 17 based on the determined display timing information. That is, the reproduction processing unit 34 adds time stamp information based on the display timing to the picture included in the GOP to be processed. The picture is displayed on the LCD 17 according to the added time stamp information.

  With the above configuration, even when playing back a GOP to which information about display timing is not added, the display timing of the GOP to be processed using the information of the previous GOP 411 estimated to be the same or similar in structure. The moving image data 111A can be smoothly reproduced by reproducing the picture included in the processing target GOP according to the estimated display timing.

  FIG. 9 is a flowchart illustrating a procedure of display timing calculation processing by the video processing application 202.

  First, the video processing application 202 decodes the GOP to be reproduced in the moving image data 111A, and determines whether or not the decoded GOP includes information about display timing such as Picture Timing SEI and VUI (step S101). ). Further, at the time of decoding the GOP to be played back, the video processing application 202 counts the number of pictures included in the GOP to be played back, and the process of counting the number of frame pictures and field pictures included in the GOP to be played back. Execute.

  When information about display timing is included in the GOP to be played back (YES in step S101), the video processing application 202 uses the Picture Timing SEI, VUI, and the like to display the display timing of the pictures included in the GOP to be played back. Calculate (step S102).

  When the information on display timing is not included in the reproduction target GOP (NO in step S101), the video processing application 202 reproduces the reproduced GOP (one previous GOP) positioned immediately before the reproduction target GOP. Based on the information 411 (picture group information), the display timing is calculated (step S103). The video processing application 202 calculates the display timing based on the saved playback time, the number of pictures, and the picture structure (ratio of frame picture to field picture) of the previous GOP 411. Specifically, the video processing application 202 calculates the number of frames (frame rate) per unit time from the playback time of the previous GOP 411 and the number of frames displayed on the LCD 17 during this playback time. Then, the video processing application 202 determines the timing for displaying each picture in consideration of whether each picture is a progressive picture or an interlace picture.

  Then, the video processing application 202 displays the picture included in the GOP to be reproduced on the LCD 17 in accordance with the calculated display timing (step S104). That is, the video processing application 202 adds time stamp information corresponding to the display timing to the picture included in the GOP to be reproduced. Pictures included in the GOP to be played are played according to the time stamp information.

  In addition, the video processing application 202 stores the number of pictures included in the GOP to be played back and the picture structure information in the main memory 103 or the like as picture group information (step S105).

  Next, the video processing application 202 determines whether or not a GOP next to the GOP to be reproduced exists in the moving image data 111A (step S106).

  If there is a GOP next to the GOP to be played back (YES in step S106), the next GOP is set as a new GOP to be played back (step S107), and the processes after step S101 are executed.

  If there is no GOP next to the GOP to be reproduced (NO in step S106), it is determined that the moving image data 111A has been reproduced to the end, and the process ends.

  Through the above processing, the moving image data 111A can be smoothly reproduced even when the GOP to be reproduced does not include information regarding display timing. When the GOP to be reproduced includes information related to the display timing, the video processing application 202 calculates the display timing of the picture using the information, and the GOP to be reproduced includes information related to the display timing. If not, the display timing of the GOP to be reproduced is calculated using the information of the previous GOP 411 estimated to have the same or similar structure.

  When the GOP to be reproduced is the first GOP of the sequence of the moving image data 111A, the picture included in the GOP is displayed according to a predetermined display timing, and the reproduced GOP is displayed when the subsequent GOP is displayed. The display timing may be determined using the number of pictures of the previous GOP, the picture structure, etc., and the pictures included in the GOP to be processed may be displayed.

  As described above, according to this embodiment, it is possible to smoothly reproduce moving image data whose reproduction timing is unknown. The display timing calculation unit 33 of the video processing application 202 determines the display timing of the picture included in the reproduction target GOP using this information when the information about the display timing is included in the reproduction target GOP. If the GOP to be played back does not contain information related to display timing, the number of pictures of the previous GOP obtained when playing the played GOP located immediately before the GOP to be played back, Based on the picture structure or the like, the display timing of the picture included in the GOP to be reproduced is determined.

  It is presumed that the GOP to be reproduced and the GOP immediately before the reproduction GOP have the same or similar picture display timing. For this reason, when information about display timing is not included in the GOP to be reproduced, the display timing is determined based on the number of pictures, the picture structure, etc. of the previous GOP 411, and the reproduction target GOP 411 is determined according to the determined display timing. By displaying the picture included in the GOP, it is possible to smoothly reproduce moving image data whose reproduction timing is unknown.

  Since reproduction of the moving image data 111A requires real-time processing, the present embodiment detects the number of pictures and the picture structure of the reproduction target GOP each time the reproduction target GOP is decoded. If the display timing information is not included in the GOP to be played back, the current GOP to be played back is based on information such as the number of pictures and the picture structure detected when decoding the previous GOP that has been played back. Display timing is calculated. Therefore, even when streaming playback such as playback while receiving moving image data via a network or when playing moving image data such as a live stream from the middle, moving image data is played back smoothly in real time. can do.

  In addition, the procedure of the display timing calculation process of this embodiment can be executed entirely by software. For this reason, the effect similar to this embodiment can be easily realized only by installing and executing a program for executing the procedure of the display timing calculation process on a normal computer through a computer-readable storage medium.

  Further, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

202 ... Video processing application, 31 ... Control unit, 32 ... Content analysis unit, 33 ... Display timing calculation unit, 34 ... Playback processing unit, 35 ... Data storage unit, 36 ... Picture group information detection unit, 37 ... Frame rate calculation unit 111, HDD, 111A, moving image data.

Claims (6)

Decoding means for decoding encoded moving image data composed of a plurality of processing units each including a plurality of pictures corresponding to a predetermined reproduction time;
When the processing unit to be played back in the moving image data is decoded by the decoding means, the number of pictures is detected by counting the pictures included in the processing unit to be played back, and the processing to be played back Detecting means for detecting a ratio between a progressive frame picture and an interlace field picture included in a unit;
When timing information is not included in the processing unit to be played back, the number of pictures detected by the detecting means when decoding the played back processing unit immediately before the processing unit to be played back and the progressive method Frame rate calculating means for calculating a playback frame rate based on a ratio between the frame picture of the first frame picture and the interlaced field picture and the predetermined playback time;
A video processing apparatus comprising: display timing determining means for determining display timings of a plurality of pictures included in the processing unit to be reproduced based on the calculated reproduction frame rate.   The video processing apparatus according to claim 1, wherein the display timing determining unit determines the display timing based on the timing information when the timing information is included in the processing unit to be reproduced. A storage unit that stores the number of the detected pictures and the ratio of the progressive frame picture and the interlaced field picture in a memory;
The frame rate calculation means calculates a ratio of the field picture of the frame picture and an interlace method in the number and the progressive system of pictures stored in the memory, the reproduction frame rate based on the predetermined reproduction time The video processing apparatus according to claim 1. Decoding encoded moving image data composed of a plurality of processing units each including a plurality of pictures corresponding to a predetermined reproduction time;
When the processing unit to be played back in the moving image data is decoded by the decoding, the number of pictures is detected by counting the pictures included in the processing unit to be played back , and the playback target Detect the proportion of progressive frame pictures and interlaced field pictures included in the processing unit,
When timing information is not included in the processing unit to be played back, the number of pictures detected by the detection at the time of decoding the played back processing unit immediately before the processing unit to be played back and the progressive A playback frame rate is calculated based on the ratio of the frame picture of the system and the field picture of the interlace system and the predetermined playback time;
A video processing method for determining display timings of a plurality of pictures included in the processing unit to be reproduced based on the calculated reproduction frame rate. The video processing method according to claim 4, wherein the determining includes determining the display timing based on the timing information when the timing information is included in the processing unit to be reproduced. Storing the number of detected pictures and the ratio of the progressive frame picture and the interlaced field picture in a memory;
The calculating includes calculating the reproduction frame rate based on the number of pictures stored in the memory, a ratio between the progressive frame picture and the interlaced field picture, and the predetermined reproduction time. Item 5. The video processing method according to Item 4 .

Images