JP2007221535A - Data processing apparatus, system thereof, method thereof, program thereof, and recording medium for recording the program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an edit apparatus capable of generating a video stream whereby reproduction processing at a plurality of reproduction speeds is facilitated. <P>SOLUTION: The edit apparatus 300 recognizes that a multiple of a photographing speed of a high speed camera 220 is 4 and sets the recognized multiple of the photographing speed to be an M value of the video stream. The edit apparatus 300 codes frame image data from the high speed camera 220 on the basis of the M value to produce display data including I pictures, P pictures, and B pictures. The edit apparatus 300 generates a sequence header wherein a frame rate is set to a multiple of one, that is, the sequence header denoting that photographing is executed at a single multiple photographing speed. The edit apparatus 300 generates the video stream including the display data and the sequence header. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a data processing apparatus that generates video data, a system thereof, a method thereof, a program thereof, and a recording medium on which the program is recorded.

  2. Description of the Related Art Conventionally, for example, a method is known in which a frame rate higher than that in the NTSC (National Television System Committee) system, that is, a video imaged at a high speed is recorded on a recording medium (see, for example, Patent Document 1).

The one described in Patent Document 1 continuously records image information to be read when reproducing at a normal speed in a recording area provided on the inner periphery of the optical disc as basic information. Furthermore, image information that can be read only during low-speed playback is collectively recorded as interpolation information in a recording area provided on the outer periphery of the optical disc.
In the case of low-speed playback, a configuration is adopted in which the interpolation information recording area can be accessed with reference to the interpolation information start address described in the private packet.

Japanese Patent No. 3604186 (pages 5-9)

  However, in the configuration as described in Patent Document 1 described above, when reproducing at low speed, it is necessary to refer to the interpolation information start address in order to read out interpolation information for low-speed reproduction, which complicates the low-speed reproduction processing. The problem of fear is an example.

  In view of such circumstances, an object of the present invention is to provide a data processing device capable of generating video data that facilitates playback processing at a plurality of playback speeds, a system thereof, a method thereof, a program thereof, and a program thereof. Is provided.

  The invention according to claim 1 is a data processing device for generating video data for displaying a video shot by a shooting device on a display device, wherein the shooting device is different from a frame rate of the display device. Frame image data for displaying a frame image shot at a shooting speed can be output, and the video data includes an I picture, a P picture encoded from the frame image data based on the MPEG (Motion Picture Experts Group) standard, And display data having a series of data string structures in which B pictures are associated in display order, and shooting state information indicating that the frame image has been shot at a predetermined shooting speed, and the shooting speed A photographing speed recognizing means for recognizing the photographing speed, and a photographing speed recognizing a magnification of the photographing speed relative to a frame rate of the display device Speed magnification recognizing means and M value setting means for setting the recognized photographing speed magnification as an M value representing an interval between the I picture and the P picture in the display data or an interval between the P pictures. Video encoding means for acquiring the frame image data and generating the I picture, the P picture, and the B picture encoded based on the set M value, and the generated I picture The display data generating means for generating the display data based on the P picture and the B picture, and the frame image indicating that the frame image was shot at a shooting speed equal to the frame rate of the display device Shooting state information generating means for generating shooting state information; and the video data based on the display data and the shooting state information. , A video data generation means for generating a data processing apparatus characterized by comprising a.

  A seventh aspect of the present invention displays the data processing apparatus according to any one of the first to fourth aspects of the present invention and an image captured by the photographing apparatus connected to the data processing apparatus so that various data can be transmitted and received. An output control device that performs control, wherein the data processing device includes data transmission means for transmitting the video data to the output control device, and the output control device includes the data control device. Data receiving means for receiving the video data from a processing device, and video decoding for decoding the I picture, the P picture, and the B picture of the received video data and outputting the frame image data And the frame image is shot at a shooting speed equal to the frame rate of the display device based on the shooting state information of the video data. Shooting state recognition means for recognizing the fact that the image decoding means decodes the I picture, the P picture, and the B picture based on an input operation, and the frame image data is displayed on the display device as the frame. Display at a rate and display a first video in which a predetermined object moves at a speed different from the actual moving speed, or decode the I picture and the P picture to decode the frame image data at the frame rate And a display control means for controlling to display a second image in which the object moves at a speed substantially equal to the actual moving speed.

  According to an eighth aspect of the present invention, there is provided the data processing device according to the fifth or sixth aspect, and a control for displaying video captured by the photographing device connected to the data processing device so that various data can be transmitted and received. An output control device that performs control to output sound collected by the sound collection device, wherein the data processing device transmits the video data and the sound data to the output control device And a data receiving means for receiving the video data and the sound data from the data processing apparatus, the I picture of the received video data, the P picture, and A video decoding means for decoding the B picture and outputting the frame image data, and based on the shooting state information of the video data, Shooting state recognition means for recognizing that a frame image was shot at a shooting speed equal to the frame rate of the display device; and decoding the encoded sound data of the received sound data and outputting the sound collection data Sound decoding means, sampling state recognition means for recognizing that the collected sound data is sampled at the reference sampling frequency based on sampling state information of the sound data, and video decoding based on an input operation Means for decoding the I picture, the P picture, and the B picture to display the frame image data on the display device at the frame rate, and the predetermined object moves at a speed different from the actual moving speed. Control to display a first video, or decode the I picture and the P picture to generate the frame image Data is displayed at the frame rate, and display control means for controlling to display a second video in which the object moves at a speed substantially equal to the actual moving speed, and the display control means controls the first video. When the control to display is performed, the sound decoding means decodes the encoded sound data in the sound output order, and the sound collection data is output from the sound output device at the reference sampling frequency, When the control for outputting the first sound at a speed different from the actually collected sound is performed, and the control for displaying the second video by the display control means is performed, the sound output order is the photographing Control for decoding the encoded sound data at intervals equal to the speed magnification and outputting the collected sound data at the reference sampling frequency to output a second sound having a speed substantially equal to the actually collected sound. The And a sound output control means for carrying out the data processing system.

  The invention according to claim 9 is a data processing method for generating video data for displaying on the display device the video imaged by the imaging device by the computing means, the imaging device comprising: Frame image data for displaying a frame image taken at a shooting speed different from the frame rate can be output, and the video data is an I picture obtained by encoding the frame image data based on the MPEG (Motion Picture Experts Group) standard Display data having a series of data string structures in which a P picture and a B picture are associated in display order, and shooting state information indicating that the frame image was shot at a predetermined shooting speed. The calculation means recognizes the shooting speed, and sets a magnification of the shooting speed with respect to a frame rate of the display device as a shooting speed magnification. Recognizing and setting the recognized photographing speed magnification as an M value representing an interval between the I picture and the P picture or an interval between the P pictures in the display data, and obtaining the frame image data Then, the I picture, the P picture, and the B picture encoded based on the set M value are generated, and based on the generated I picture, the P picture, and the B picture Generating the display data, generating the shooting state information indicating that the frame image was shot at a shooting speed equal to the frame rate of the display device, and based on the display data and the shooting state information A data processing method for generating the video data.

  A tenth aspect of the present invention is a data processing program that causes an arithmetic means to function as the data processing device according to any one of the first to sixth aspects.

  The invention described in claim 11 is a data processing program characterized by causing a calculation means to execute the data processing method described in claim 9.

  According to a twelfth aspect of the present invention, there is provided a recording medium on which a data processing program is recorded, wherein the data processing program according to the tenth or eleventh aspect is recorded so as to be readable by an arithmetic means.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, a recording / reproducing system capable of reproducing and displaying the recorded video and sound at a plurality of reproduction speeds while recording the captured video and the collected sound will be described as an example.
In the following, an image in which a photographed predetermined object, for example, a ball, moves at a speed substantially equal to the actual moving speed is referred to as a normal reproduction image, and an image in which the moving image is 1/4 of the actual moving speed. Are referred to as slow-play video. Furthermore, the collected sound, for example, a cheering sound whose speed is substantially equal to the actual speed, is referred to as a normal reproduction sound, and a quarter of the actual speed is referred to as a slow reproduction sound.
Here, the video and sound during slow playback correspond to the first video and the first sound of the present invention, and the video and sound during normal playback correspond to the second video and the second sound of the present invention. .
FIG. 1 is a block diagram showing a schematic configuration of a recording / reproducing system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a schematic configuration of the editing apparatus. FIG. 3 is a schematic diagram showing a schematic configuration of a video stream. FIG. 4 is a conceptual diagram showing a sampling state of sound collection data. FIG. 5 is a schematic diagram showing a schematic configuration of an audio stream. FIG. 6 is a schematic diagram showing a schematic configuration of a system stream. FIG. 7 is a block diagram illustrating a schematic configuration of the editing control unit. FIG. 8 is a block diagram showing a schematic configuration of the recording / reproducing apparatus. FIG. 9 is a block diagram showing a schematic configuration of the recording / reproducing control unit.

[Recording and playback system configuration]
In FIG. 1, reference numeral 100 denotes a recording / reproducing system as a data processing system. The recording / reproducing system 100 includes a display device 200, a speaker 210 as a sound output device, a high-speed camera 220 as a photographing device, a microphone 230 as a sound collecting device, and an editing device 300 as a data processing device. And a recording / reproducing device 500 as an output control device.

The display device 200 is connected to the recording / reproducing device 500 and displays a video at a predetermined reproduction speed based on the video signal from the recording / reproducing device 500. The display device 200 switches and displays frame images based on frame image data (to be described later) of a video signal at a frame rate of the NTSC (National Television System Committee) system, that is, at a rate of 30 frames per second, and has a predetermined reproduction speed. Play and display the video.
Examples of the display device 200 include a liquid crystal panel, an organic EL (Electro Luminescence) panel, a PDP (Plasma Display Panel), a CRT (Cathode-Ray Tube), an FED (Field Emission Display), and an electrophoretic display panel.
The display device 200 is not limited to the NTSC system, but may be a PAL (Phase-Alternation Line system) system or a SECAM system.

  The speaker 210 is connected to the recording / reproducing apparatus 500, and outputs a sound at a predetermined reproduction speed based on the audio signal from the recording / reproducing apparatus 500.

The high speed camera 220 is configured to be detachable from the editing apparatus 300. The high-speed camera 220 shoots an object such as a ball at a shooting speed of 120 frames per second, that is, a shooting speed that is four times the frame rate of the display device 200. Here, the magnification of the photographing speed with respect to the frame rate of the display device 200 is referred to as a photographing speed magnification N.
Then, the high-speed camera 220 appropriately generates frame image data for displaying a frame image for 1/120 seconds, that is, a frame image shot with a shooting time of 1/120 seconds, and converts the frame image data into an analog video signal. Then, it is output to the editing apparatus 300 together with the vertical synchronization signal.
Note that the high-speed camera 220 is not limited to a camera with a shooting speed four times the frame rate of the display device 200.

The microphone 230 has a configuration that is detachable from the editing apparatus 300. The microphone 230 collects sound generated in the vicinity. Then, sound collection data for outputting the collected sound is appropriately generated, converted into an analog audio signal, and output to the editing apparatus 300.
Note that the microphone 230 is not limited to a configuration that can be attached to and detached from the editing device 300, and may be a configuration that is disposed inside a case body (not shown) of the editing device, for example.

The editing apparatus 300 is configured to be detachable from the recording / reproducing apparatus 500. The editing apparatus 300 performs a process of editing and storing the video captured by the high-speed camera 220 and the sound collected by the microphone 230 as appropriate, and a process of outputting to the recording / reproducing apparatus 500.
Then, as shown in FIG. 2, the editing apparatus 300 includes a video A (Analog) / D (Digital) converter 310, video encoding means, display data generation means, shooting state information generation means, and video data. An MPEG (Motion Picture Experts Group) video encoder 320 as a generation unit, a sequence header editor 330 as a shooting state information generation unit, an audio A / D converter 340, and an audio editor 350 as a sampling unit , Sound encoding means, sound output data generation means, sampling state information generation means, audio encoder 360 as sound data generation means, MPEG system stream editor 370 as multiplexed data generation means, and data An MPEG stream transmitter 380 as a transmission means, a storage device 390, and an author It includes a grayed device 400, an editing control section 410, a.

The video A / D converter 310 is connected to the MPEG video encoder 320 and the editing control unit 410. Further, the video A / D converter 310 is appropriately connected to the high speed camera 220.
The video A / D converter 310 acquires the analog video signal output from the high-speed camera 220, converts it into a digital video signal, and outputs the digital video signal to the MPEG video encoder 320. In addition, the vertical synchronization signal of the video signal is output to the edit control unit 410.

The MPEG video encoder 320 is connected to the sequence header editor 330 and the edit control unit 410.
The MPEG video encoder 320 is controlled by the editing control unit 410 and acquires frame image data of a video signal output from the video A / D converter 310. Then, encoding is performed based on the MPEG standard at a speed higher than the shooting speed of the high-speed camera 220 to generate a video stream 720 as video data as shown in FIG.

Specifically, the MPEG video encoder 320 encodes the frame image data of the video signal from the video A / D converter 310 under the control of the editing control unit 410, so-called I picture 731 and P picture 732. And a B picture 733 are generated. The MPEG video encoder 320 represents the interval between the I picture 731 and the P picture 732 or the interval between the P pictures 732 based on M value setting information described later from the editing control unit 410 during the encoding. It is recognized that the photographing speed magnification N is set as a so-called M value.
Then, the MPEG video encoder 320 encodes the frame image data with the M value as the shooting speed magnification N, that is, the M value as 4, and generates an I picture 731, a P picture 732, and a B picture 733. Further, a series of display data 730 having a data string structure in which the I picture 731, the P picture 732, and the B picture 733 are associated in the display order is generated.

In addition, the MPEG video encoder 320 uses a frame rate obtained by multiplying the frame rate of the display device 200 by the shooting speed magnification N as a frame rate when displaying a frame image based on the display data 730 (hereinafter referred to as an N-times frame rate). A sequence header 740 is generated as shooting state information recorded. That is, the sequence header 740 is generated to the effect that the frame image has been shot at the shooting speed of the shooting speed magnification N. Here, a sequence header 740 in which a four times frame rate is recorded is generated.
Then, the MPEG video encoder 320 generates a video stream 720 including the display data 730 and the sequence header 740 and outputs the video stream 720 to the sequence header editor 330.

The sequence header editor 330 is connected to the MPEG system stream editor 370, the MPEG stream transmitter 380, and the edit control unit 410.
The sequence header editor 330 acquires the video stream 720 from the MPEG video encoder 320. Then, the content of the sequence header 740 of the video stream 720 is changed based on sequence header change information described later from the edit control unit 410.
Specifically, the sequence header editor 330 changes the quadruple frame rate recorded in the sequence header 740 to a single frame rate. That is, the sequence header 740 is recorded in which the fact that the frame image was captured at a shooting speed of 1 × instead of the shooting speed magnification N is generated. Then, the video stream 720 in which the content of the sequence header 740 is changed is appropriately output to the MPEG system stream editing machine 370 and the MPEG stream sending machine 380.

The audio A / D converter 340 is connected to the audio editor 350. The audio A / D converter 340 is appropriately connected to the microphone 230.
Then, the audio A / D converter 340 acquires the analog audio signal output from the microphone 230, converts it into a digital audio signal, and outputs the digital audio signal to the audio editor 350.

The audio editor 350 is connected to the audio encoder 360 and the edit control unit 410.
The audio editing machine 350 is controlled by the editing control unit 410, acquires the collected sound data of the audio signal output from the audio A / D converter 340, and samples it at a predetermined cycle.

Specifically, the audio editor 350 recognizes that oversampling is performed at a sampling frequency obtained by multiplying a reference sampling frequency by a photographing speed magnification N based on sampling cycle setting information described later from the editing control unit 410. That is, as shown in FIG. 4, it is recognized that oversampling is performed with a period C2 that is 1/4 times the period C1, instead of the period C1 corresponding to the reference sampling frequency.
Then, the audio editor 350 oversamples the collected sound data at the cycle C2 and outputs the data to the audio encoder 360.

The audio encoder 360 is connected to the MPEG system stream editing machine 370 and the editing control unit 410.
The audio encoder 360 is controlled by the edit control unit 410 and acquires sound collection data output from the audio editor 350. Then, for example, encoding is performed based on the MPEG standard to generate an audio stream 760 as sound data as shown in FIG.

  Specifically, the audio encoder 360 generates encoded sound data 771 by sequentially encoding the sound collection data oversampled by the audio editor 350 in the cycle C2 based on, for example, the MPEG standard. Further, sound output data 770 having a series of data string structures in which the encoded sound data 771 is associated in the sound output order is generated.

Also, the audio encoder 360 records that the collected sound data based on the sound output data 770 is sampled not at the sampling frequency cycle C2 multiplied by the shooting speed magnification N but at the reference sampling frequency cycle C1. An audio header 780 is generated as sampling state information.
Then, the audio encoder 360 generates an audio stream 760 including the sound output data 770 and the audio header 780, and outputs the audio stream 760 to the MPEG system stream editor 370.

The MPEG system stream editor 370 is connected to the MPEG stream transmitter 380, the authoring device 400, and the edit controller 410.
The MPEG system stream editing machine 370 is controlled by the editing control unit 410 and appropriately acquires the video stream 720 and the audio stream 760 from the sequence header editing machine 330 and the audio encoder 360, respectively. Then, a system stream 700 as multiplexed data as shown in FIG. 6 is generated.

Specifically, the MPEG system stream editor 370 acquires a video stream 720 and an audio stream 760, respectively. These are associated as a series of data string structures in the output order, for example. Furthermore, a system header 710 in which various information related to the system stream 700 is recorded is generated.
Then, the MPEG system stream editor 370 generates a system stream 700 including a system header 710, a video stream 720, and an audio stream 760, and outputs the system stream 700 to the MPEG stream transmitter 380 and the authoring apparatus 400 as appropriate.

The MPEG stream transmitter 380 is connected to the editing control unit 410. The MPEG stream transmitter 380 is appropriately connected to the recording / reproducing apparatus 500.
The MPEG stream transmitter 380 is controlled by the editing control unit 410, acquires the video stream 720 from the sequence header editor 330, and transmits it to the recording / reproducing apparatus 500 as appropriate. Further, the system stream 700 from the MPEG system stream editing machine 370 is acquired and appropriately transmitted to the recording / reproducing apparatus 500.

The storage device 390 is connected to the authoring device 400 and the edit control unit 410.
The storage device 390 has a configuration in which a DVD (Digital Versatile Disc) 1 is detachable. The storage device 390 is controlled by the editing control unit 410, and the DVD format data (hereinafter referred to as DVD format data) generated by the authoring device 400 is stored in the DVD 1 so as to be appropriately readable, that is, stored. do.
Note that the storage device 390 is not limited to the configuration in which the storage device 390 is stored in the DVD 1, but may be stored in an HD (Hard Disk), an optical disk, a memory card, or the like.

The authoring device 400 is connected to the edit control unit 410.
The authoring apparatus 400 appropriately acquires the system stream 700 from the MPEG system stream editing machine 370 under the control of the editing control unit 410. The system stream 700 is converted into DVD format data corresponding to the DVD 1 and output to the storage device 390.

  As shown in FIG. 7, the editing control unit 410 includes a shooting speed recognition unit 411, an M value setting unit 412 that also functions as a shooting speed magnification recognition unit, and system stream generation as various programs stored in a memory (not shown). A control unit 413, a storage control unit 414, and a transmission control unit 415 are provided.

The shooting speed recognition unit 411 recognizes the shooting speed of the high-speed camera 220 connected to the video A / D converter 310.
Specifically, the photographing speed recognition unit 411 acquires a vertical synchronization signal input from the high speed camera 220 via the video A / D converter 310. Then, based on the period for acquiring this vertical synchronization signal, the imaging speed of the high-speed camera 220 is recognized, and imaging speed recognition information to that effect is output to the M value setting means 412.

The M value setting unit 412 sets the M value and generates M value setting information.
Specifically, the M value setting unit 412 acquires shooting speed recognition information from the shooting speed recognition unit 411 and recognizes the shooting speed of the high-speed camera 220. Then, for example, the magnification of the imaging speed with respect to the frame rate of the display device 200 that has been recognized before is recognized as the imaging speed magnification N. Then, M value setting information for setting the photographing speed magnification N as the M value is generated and output to the MPEG video encoder 320.

The system stream generation control unit 413 performs control to generate the system stream 700.
Specifically, the system stream generation control unit 413 generates sequence header change information for changing the quadruple frame rate recorded in the sequence header 740 to a single frame rate, and the sequence header editor To 330. Then, by controlling the MPEG video encoder 320 and the sequence header editor 330, the display data 730 in which the M value is set to the value of the shooting speed magnification N and the frame image were shot at a shooting speed of 1 ×. A video stream 720 having a sequence header 740 to the effect is generated.
In addition, the system stream generation control unit 413 generates sampling frequency setting information indicating that oversampling is performed at a sampling frequency obtained by multiplying the imaging speed magnification N recognized by the M value setting unit 412 by a reference sampling frequency, that is, a cycle C2. Output to the editor 350. Furthermore, the audio editing apparatus 350 and the audio encoder 360 are controlled so that the audio output data 770 oversampled in the period C2 and the audio header 780 in which it is recorded in the period C1 are recorded. A stream 760 is generated.
Then, the system stream generation control unit 413 controls the MPEG system stream editor 370 to generate the system stream 700.

The storage control unit 414 controls the DVD format data generated by the authoring device 400 to be stored in the DVD 1.
Specifically, when the storage control unit 414 recognizes that the DVD format data is stored in the DVD 1 based on an input operation of an operation unit (not shown), the MPEG system stream editing machine 370, the authoring apparatus 400, and the storage apparatus 390 are connected. Under control, the DVD format data generated by the authoring device 400 is stored in the DVD 1.

The transmission control means 415 controls to transmit the system stream 700 and the video stream 720 to the recording / reproducing apparatus 500.
Specifically, when the transmission control unit 415 recognizes that the video stream 720 is to be transmitted to the recording / reproducing apparatus 500 based on the input operation, the transmission control unit 415 controls the sequence header editor 330 to transmit the video stream 720 to the MPEG stream. Output to the machine 380. When recognizing that the system stream 700 generated by the MPEG system stream editor 370 is to be transmitted, the MPEG system stream editor 370 is appropriately controlled to output the system stream 700 to the MPEG stream transmitter 380.
Then, the transmission control means 415 controls the MPEG stream transmitter 380 to appropriately transmit the acquired video stream 720 and system stream 700 to the recording / reproducing apparatus.

The recording / reproducing apparatus 500 performs processing for appropriately storing the system stream 700 and processing for outputting a frame image and sound.
As shown in FIG. 8, the recording / reproducing apparatus 500 includes an input means 510, an authoring apparatus 520, a storage apparatus 530, a decoding means 540 as a video decoding means and a sound decoding means, a memory 550, and a memory control. 560, a video signal generator 570, an audio signal generator 580, and a recording / playback control unit 590.

The input unit 510 is connected to the recording / playback control unit 590.
The input unit 510 is disposed in front of a case body (not shown), for example, and includes various operation buttons (not shown) and operation knobs that are input. Then, by a setting item input operation, a signal corresponding to the setting item is appropriately output to the recording / playback control unit 590 to be set and input.

The authoring device 520 is connected to the storage device 530 and the recording / playback control unit 590. Further, the authoring device 520 is appropriately connected to the editing device 300.
The authoring device 520 is controlled by the recording / playback control unit 590 and acquires the system stream 700 and the video stream 720 output from the editing device 300. Then, the same processing as that of the authoring device 400 of the editing device 300 is performed, and output to the storage device 530.

The storage device 530 is connected to the decryption unit 540 and the recording / playback control unit 590.
The storage device 530 is controlled by the recording / playback control unit 590 and has a configuration in which the DVD 1 can be attached / detached similarly to the storage device 390 of the editing device 300, and stores the DVD format data from the authoring device 520 in the DVD 1. Further, the DVD format data of the DVD 1 is read out as appropriate and output to the decoding means 540.

The decoding unit 540 is connected to the memory controller 560 and the recording / playback control unit 590.
When the decoding unit 540 acquires the DVD format data, that is, the system stream 700 from the storage apparatus 530 under the control of the recording / playback control unit 590, the I picture 731, the P picture 732, and the B picture 733 of the video stream 720 of the system stream 700 are obtained. Are selectively decoded at a decoding speed of 30 frames per second, that is, at a decoding speed equal to the frame rate of the display device 200. Then, the frame image data obtained by decoding is output to the memory controller 560, and the sequence header 740 of the video stream 720 is output to the recording / playback control unit 590.

Further, upon obtaining the system stream 700, the decoding unit 540 performs the above-described processing based on the video stream 720 of the system stream 700 and outputs the frame image data to the memory controller 560. Also, the encoded sound data 771 of the audio stream 760 of the system stream 700 is selectively decoded as appropriate, and the collected sound data is output to the memory controller 560. Further, the sequence header 740 and the audio header 780 of the audio stream 760 are output to the recording / playback control unit 590.
The sequence header 740 and the audio header 780 may be output from the storage device 530 to the recording / playback control unit 590.

The memory 550 is connected to the memory controller 560.
The memory 550 accumulates the frame image data and sound collection data output from the memory controller 560 so that they can be read out appropriately. The memory 550 has a capacity capable of storing a predetermined number of frame image data and sound collection data.

The memory controller 560 is connected to the video signal generator 570, the audio signal generator 580, and the recording / playback control unit 590.
The memory controller 560 is controlled by the recording / playback control unit 590, acquires frame image data and sound collection data output from the decoding unit 540, and stores them in the memory 550. Also, frame image data is acquired as appropriate and output to the video signal generator 570 in the order of reproduction. Furthermore, sound collection data is acquired as appropriate and output to the audio signal generator 580 in the order of reproduction.

The video signal generator 570 is appropriately connected to the display device 200.
The video signal generator 570 acquires frame image data output from the memory controller 560. Then, it is converted into a video signal corresponding to the display device 200 and output to the display device 200.

The audio signal generator 580 is appropriately connected to the speaker 210.
The audio signal generator 580 acquires sound collection data output from the memory controller 560. Then, it is converted into an audio signal corresponding to the speaker 210 and output to the speaker 210.

  As shown in FIG. 9, the recording / playback control unit 590 includes a storage control unit 591, a display control unit 592 that also functions as a photographing state recognition unit, and a sound output control unit that also functions as a sampling state recognition unit. 593.

  The storage control unit 591 performs the same processing as the storage control unit 414 of the editing apparatus 300 to store the DVD format data in the DVD 1.

The display control unit 592 controls the display device 200 to display a video in a predetermined playback state based on the system stream 700 and the video stream 720.
Specifically, when the display control unit 592 acquires a signal for normal reproduction from the input unit 510, the display control unit 592 displays a video based on frame image data obtained by decoding the I picture 731, the P picture 732, and the B picture 733. recognize. Then, the storage device 530, the decoding unit 540, and the memory controller 560 are controlled to decode the I picture 731, the P picture 732, and the B picture 733 of the predetermined video stream 720, and to store the frame image data in the memory 550. .

Further, the display control unit 592 acquires the sequence header 740, and based on the sequence header 740, the frame image was shot at the shooting speed of 1 ×, so the frame rate at the time of display is set to 1 ×. Recognize that In other words, because it was shot at 30 frames per second even though it was shot at 120 frames per second, it is recognized that normal playback video can be displayed by displaying the frame images in the display order. To do.
Then, the memory controller 560 and the video signal generator 570 are controlled so that the frame image of the frame image data is displayed on the display device 200 as if it was taken at a magnification of the display order.
That is, the display control unit 592 displays the frame image actually captured at 4 × based on the sequence header 740 as being captured at 1 ×, so that an operation for normal playback is performed. Regardless, control is performed to display a 1/4 times slow playback video.

In addition, when the display control unit 592 acquires a signal for fast-forward playback from the input unit 510, the display control unit 592 recognizes that a video obtained by decoding the I picture 731 and the P picture 732 is displayed without decoding the B picture 733. In other words, even though 120 frames are captured per second, 30 frames are captured per second, so that a fast-forward playback video can be displayed by displaying frame images with a display order of every four frames. Recognize.
Then, the I picture 731 and the P picture 732 of the predetermined video stream 720 are decoded, and frame image data is accumulated. That is, frame image data with a display order of every 4 is accumulated.

Further, the display control unit 592 obtains the sequence header 740 and controls the display device 200 to display the frame image of the frame image data as being captured at a magnification of every four frames.
In other words, the display control unit 592 displays the frame image actually captured at 4 × based on the sequence header 740 as being captured at 1 × every 4 frames. In spite of this, the control is performed to display the normal playback video of 1 ×.

Based on the system stream 700, the sound output control means 593 performs control to output a sound in a predetermined reproduction state through the speaker 210.
Specifically, when the sound output control means 593 obtains a signal for normal reproduction, the sound output control means 593 recognizes that it decodes the encoded sound data 771 and outputs sounds of continuous sound collection data in the sound output order. To do. Then, the decoding unit 540 and the memory controller 560 are controlled to decode the encoded sound data 771 of the predetermined audio stream 760 in the sound output order, and the collected sound data is accumulated in the memory 550.

Furthermore, the sound output control means 593 acquires the audio header 780, and recognizes that the collected sound data has been sampled at the period C1 based on the audio header 780. Then, the memory controller 560 and the video signal generator 570 are controlled so that the sound of the sound collection data is output from the speaker 210 as being sampled by 1 times in the sound output order.
That is, the sound output control means 593 outputs the sound that is actually oversampled by 4 times as being sampled by 1 time based on the audio header 780, so that an operation for normal reproduction is performed. Nevertheless, control is performed to output 1/4 times slow playback sound synchronized with 1/4 times slow playback video.

  Further, when the sound output control means 593 obtains the signal indicating that the fast-forward playback is performed, the sound output control means 593 recognizes that the sound output sequence outputs a sound obtained by decoding the encoded sound data 771 every number corresponding to the M value, that is, every four. To do. Then, the encoded sound data 771 of the predetermined audio stream 760 is decoded into the encoded sound data 771 whose sound output order is every four, and the sound collection data is accumulated.

Furthermore, the sound output control means 593 performs control to acquire the audio header 780 and output the sound of the sound collection data whose sound output order is every 4 as sampled at the period C1.
That is, the sound output control means 593, based on the audio header 780, causes the sound output order actually oversampled by 4 times to be output as a sound sampled every 4 times, so that fast-forward playback is performed. In spite of the operation to that effect, control is performed to output the normal reproduction sound of 1 time synchronized with the normal reproduction video.

[Operation of recording and playback system]
Next, the operation of the recording / reproducing system 100 will be described with reference to the drawings.
FIG. 10 is a flowchart showing a system stream saving process. FIG. 11 is a flowchart showing system stream playback processing.

(System stream save processing)
First, as an operation of the recording / reproducing system 100, a storage process of the system stream 700 in the editing apparatus 300 will be described.

The editing apparatus 300 uses the video A / D converter 310 to obtain the frame image data of the video imaged by the high speed camera 220 and the vertical synchronization signal as a camera input signal as shown in FIG. 10 (step S101). ). Then, the editing control unit 410 recognizes the photographing speed magnification N based on the acquired vertical synchronization signal (step S102), and generates M value setting information. Thereafter, the M value setting information is output to the MPEG video encoder 320, and the M value is set to the photographing speed magnification N (step S103).
Further, the edit control unit 410 outputs a sequence header change information to the sequence header editor 330, and causes the sequence header editor 330 to recognize that the frame rate is changed from 4 times to 1 time. This is implemented as a frame rate setting process (step S104). Further, the sampling cycle setting information is output to the audio editor 350, and the oversampling cycle is set to a cycle C2 corresponding to the sampling frequency obtained by multiplying the basic sampling frequency by the photographing speed magnification N (step S105).

  Thereafter, the editing apparatus 300 encodes the frame image data from the high speed camera 220 and the sound collection data from the microphone 230 (step S106), and generates a system stream 700 (step S107). Then, the generated system stream 700 is converted into DVD format data (step S108) and stored in the DVD 1 (step S109).

(System stream playback processing)
Next, as an operation of the recording / reproducing system 100, a reproducing process of the system stream 700 in the recording / reproducing apparatus 500 will be described.

In the recording / playback apparatus 500, the recording / playback control unit 590 determines whether or not there is a playback instruction as shown in FIG. 11 (step S201). If it is determined in step S201 that there is no reproduction instruction, for example, the process of step S201 is performed after a predetermined time has elapsed.
On the other hand, if it is determined in step S201 that there is a reproduction instruction, the DVD format data instructed for reproduction, that is, the system stream 700 is input from the DVD 1 to the decoding unit 540 (step S202). Thereafter, the recording / reproduction control unit 590 determines the designated reproduction method (step S203).

  If it is determined in step S203 that normal playback is instructed, the decoding means 540 and the memory controller 560 play back all frames indicating that the I picture 731, P picture 732, and B picture 733 are decoded and played back. Instructed to do so (step S204). Thereafter, the recording / reproducing apparatus 500 decodes the encoded sound data 771 in which the I picture 731, the P picture 732, the B picture 733, and the sound output order are continuous (step S 205). Then, despite the operation for normal playback, the slow playback video is displayed and the sound is output (step S206).

  On the other hand, if it is determined in step S203 that fast-forward playback has been instructed, only IP picture 731 and P picture 732 are decoded and played back as an IP playback instruction (step S207). Thereafter, the encoded sound data 771 having an I picture 731, a P picture 732, and a sound output order of 4 is decoded (step S 208). Then, despite the operation for fast-forward playback, normal playback video is displayed and sound is output (step S209).

[Function and effect of recording / reproducing apparatus]
As described above, in the above embodiment, the editing apparatus 300 recognizes that the shooting speed magnification N of the high-speed camera 220 is 4, and sets the recognized shooting speed magnification N as the M value of the video stream 720. . Then, the frame image data from the high-speed camera 220 is encoded based on the M value to generate display data 730 having an I picture 731, a P picture 732, and a B picture 733. Further, a sequence header 740 with a frame rate set to 1 is generated, that is, a sequence header 740 indicating that the image was shot at 1 × shooting speed. Then, a video stream 720 having display data 730 and a sequence header 740 is generated.

For this reason, when a normal frame rate is recorded in the general recording / reproducing apparatus 500, that is, in the sequence header 740, when it is recognized that normal reproduction is performed, the I picture 731, the P picture 732, and B Recording that reproduces normal-playback video by decoding picture 733 and, when recognizing that fast-forward playback is to be performed, decodes I-picture 731 and P-picture 732 and plays fast-forward playback video at a magnification corresponding to the M value The playback apparatus 500 can perform the following playback process.
That is, when it is recognized that normal reproduction is to be performed, it is assumed that a frame image captured at 4 × is captured at 1 × in the display order based on the I picture 731, P picture 732, and B picture 733. By displaying it, it is possible to display a 1/4 times slow playback video.
In addition, when recognizing that fast-forward playback is performed, based on the I picture 731 and the P picture 732, a frame image captured at 4 × is displayed as being captured at 1 × every 4 frames. Playback video can be displayed.
By the way, for example, in the case of a configuration in which a video stream is generated by setting the M value to a value X obtained by multiplying the shooting speed magnification N by an integer of 2 or more, when normal playback is performed using the general recording / playback apparatus 500 described above, Slow playback video can be played in the same way as in the above embodiment. However, when fast forward playback is performed, frame images shot at 4x are displayed as being shot at 1x for every X, so normal playback video is displayed. Cannot play.
Therefore, by generating the video stream 720 described above, it is possible to facilitate playback processing at a plurality of playback speeds without referring to special information for slow playback.

A high-speed camera 220 capable of shooting at a shooting speed faster than the frame rate of the display device 200 is applied as the shooting apparatus of the present invention.
For this reason, when it is recognized that normal playback is performed, a predetermined scene can be slowly played back, and the user can recognize, for example, detailed movements of a sports player. Therefore, convenience can be improved.

Further, the edit control unit 410 recognizes the shooting speed of the high speed camera 220 based on the period of the vertical synchronization signal output together with the frame image data from the high speed camera 220.
For this reason, since the photographing speed is recognized using a signal normally transmitted from the high-speed camera 220, it is possible to appropriately cope with many high-speed cameras 220 and to easily expand the use.

Furthermore, the editing apparatus 300 samples the sound collection data from the microphone 230 at a sampling frequency that is four times higher. Further, sound output data 770 having encoded sound data 771 obtained by encoding the sampled sound collection data is generated. Then, an audio header 780 indicating that the collected sound data of the encoded sound data 771 has been sampled at the reference sampling frequency is generated, and an audio stream 760 including the audio header 780 and sound output data 770 is generated.
For this reason, when it is recorded in the general recording / reproducing apparatus 500, that is, the audio header 780 that the sampling is performed at the reference sampling frequency, the encoded sound data 771 is output as a sound when recognizing the normal reproduction is recognized. When the recording / reproducing apparatus 500 reproduces the fast-forward playback sound corresponding to the M value of the video stream 720 when it recognizes that the normal-playback sound is reproduced by decoding in order and the fast-forward playback is performed, A reproduction process such as
That is, when recognizing the normal reproduction, the encoded sound data 771 is decoded in the sound output order, and the sound sampled by 4 times is output as being sampled by 1 time in the sound output order. Therefore, it is possible to output a 1/4 times slow playback sound.
In addition, when recognizing that fast-forward playback is performed, the encoded sound data 771 is decoded every four, and the sound sampled four times is output as being sampled four times. Can be output.
Therefore, with respect to the sound reproduction process, the reproduction process can be facilitated without referring to special information for slow reproduction. In addition, it is possible to output sound at a playback speed corresponding to the video, and the convenience can be further improved.

Further, the editing apparatus 300 generates a system stream 700 in which the video stream 720 and the audio stream 760 are multiplexed.
Therefore, management of the video stream 720 and the audio stream 760 can be facilitated. Further, these can be transmitted as one system stream 700 to the recording / reproducing apparatus 500, for example, and the transmission processing can be facilitated.

The recording / playback system 100 is provided with an editing device 300 and a recording / playback device 500.
For this reason, the recording / playback system 100 can cause the recording / playback apparatus 500 to perform slow playback or normal playback of the system stream 700 edited by the editing apparatus 300 as described above. It is possible to allow the user to view playback and normal playback video and sound.

[Modification of Embodiment]
In addition, this invention is not limited to embodiment mentioned above, The deformation | transformation shown below is included in the range which can achieve the objective of this invention.

That is, although the high-speed camera 220 is applied as the imaging device of the present invention, the present invention is not limited to this, and a configuration capable of imaging at a shooting speed slower than the frame rate of the display device 200 may be applied.
In such a configuration, for example, when the shooting speed is ½, when recognizing normal playback, a fast-forward image with a double playback speed is displayed, and when recognizing slow playback, Although a playback video is displayed, playback processing at a plurality of playback speeds can be facilitated as in the above embodiment.

Further, the configuration for recognizing the shooting speed of the high-speed camera 220 based on the period of the vertical synchronization signal from the high-speed camera 220 has been illustrated, but the present invention is not limited to this.
That is, the high speed camera 220 is provided with a function of outputting shooting speed information in which the shooting speed is recorded. Then, the editing control unit 410 may recognize the shooting speed based on the shooting speed information.

The editing apparatus 300 may not have the function of generating the audio stream 760 as described above, and the recording / playback apparatus 500 may not have the function of reproducing the audio stream 760 as described above.
With such a configuration, the configuration of the editing apparatus 300 and the recording / reproducing apparatus 500 can be simplified.

Further, the editing apparatus 300 may store the video stream 720 and the audio stream 760 separately without generating the system stream 700.
With such a configuration, the configuration of the MPEG system stream editing machine 370 can be simplified.

Furthermore, the functions of the editing apparatus 300 and the recording / reproducing apparatus 500 may be provided and configured as one apparatus.
Further, the data processing apparatus of the present invention may be applied to an authoring apparatus.
Further, the high-speed camera 220 may be configured to have the function of the editing device 300, or may be configured to have the functions of the editing device 300 and the recording / playback device 500.

  Each function described above is constructed as a program. However, for example, it may be configured by hardware such as a circuit board or an element such as one integrated circuit (IC), and can be used in any form. By adopting a configuration that allows reading from a program or a separate recording medium, handling is easy, and usage can be easily expanded.

  In addition, the specific structure and procedure for carrying out the present invention can be appropriately changed to other structures and the like within a range in which the object of the present invention can be achieved.

[Effects of Embodiment]
As described above, in the above embodiment, the editing apparatus 300 sets the shooting speed magnification N of the high speed camera 220 as the M value of the video stream 720. Then, the frame image data from the high-speed camera 220 is encoded based on the M value, and display data 730 is generated. Further, a sequence header 740 with a frame rate set to 1 is generated. Then, a video stream 720 having display data 730 and a sequence header 740 is generated.
For this reason, a general recording / reproducing apparatus 500 can perform the following reproducing process.
That is, when it is recognized that normal reproduction is to be performed, it is assumed that a frame image captured at 4 × is captured at 1 × in the display order based on the I picture 731, P picture 732, and B picture 733. By displaying it, it is possible to display a 1/4 times slow playback video.
In addition, when recognizing that fast-forward playback is performed, based on the I picture 731 and the P picture 732, a frame image captured at 4 × is displayed as being captured at 1 × every 4 frames. Playback video can be displayed.
Therefore, by generating the video stream 720 described above, the playback process can be facilitated without referring to special information for slow playback.

The recording / playback system 100 is provided with an editing device 300 and a recording / playback device 500.
For this reason, the recording / playback system 100 can cause the recording / playback apparatus 500 to perform slow playback or normal playback of the system stream 700 edited by the editing apparatus 300 as described above. It is possible to allow the user to appropriately view the playback and normal playback video and sound.

It is a block diagram which shows schematic structure of the recording / reproducing system which concerns on one embodiment of this invention. It is a block diagram which shows schematic structure of the editing apparatus in the said one Embodiment. It is a schematic diagram which shows schematic structure of the video stream in the said embodiment. It is a conceptual diagram which shows the sampling state of the sound collection data in the said one Embodiment. It is a schematic diagram which shows schematic structure of the audio stream in the said one Embodiment. It is a schematic diagram which shows schematic structure of the system stream in the said one Embodiment. It is a block diagram which shows schematic structure of the edit control part in the said one Embodiment. It is a block diagram which shows schematic structure of the recording / reproducing apparatus in the said one Embodiment. It is a block diagram which shows schematic structure of the recording / reproducing control part in the said one Embodiment. It is a flowchart which shows the preservation | save process of the system stream in the said one Embodiment. It is a flowchart which shows the reproduction | regeneration process of the system stream in the said embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Recording / reproducing system as a data processing system 200 ... Display apparatus 210 ... Speaker as a sound output device 220 ... High speed camera as a photographing device 230 ... Microphone as a sound collecting device 300 ... Editing device as a data processing device 320 ... Video encoding means, display data generation means, shooting state information generation means, and MPEG video encoder 330 as video data generation means ... Sequence header editor as shooting state information generation means 350 ... Audio as sampling means Editor 360: Sound encoding means, sound output data generating means, sampling state information generating means, and audio encoder 370 as sound data generating means 370 ... MPEG system stream editor 380 as multiplexed data generating means Data transmission MPEG stream transmitter 411. Shooting speed recognizing means 412. M value setting means also functioning as shooting speed magnification recognizing means 500. Recording / reproducing apparatus 540 as output control apparatus 540 Decoding as video decoding means and sound decoding means Means 592: Display control means that also functions as photographing state recognition means 593 ... Sound output control means that also functions as sampling state recognition means 700 ... System stream as multiplexed data 720 ... Video stream as video data 730 ... Display data 731 ... I picture 732 ... P picture 733 ... B picture 740 ... Sequence header as shooting state information 760 ... Audio stream as sound data 770 ... Sound output data 771 ... Encoded sound data 780 ... O as sampling state information Audio header

Claims (12)

A data processing device for generating video data for displaying a video shot by a shooting device on a display device,
The photographing device can output frame image data for displaying a frame image photographed at a photographing speed different from a frame rate of the display device,
The video data is display data having a series of data string structures in which I picture, P picture, and B picture obtained by encoding the frame picture data based on the MPEG (Motion Picture Experts Group) standard are associated in display order. And shooting state information indicating that the frame image was shot at a predetermined shooting speed,
Photographing speed recognition means for recognizing the photographing speed;
A photographing speed magnification recognizing means for recognizing a magnification of the photographing speed with respect to a frame rate of the display device as a photographing speed magnification;
M value setting means for setting the recognized shooting speed magnification as an M value representing an interval between the I picture and the P picture in the display data or an interval between the P pictures;
Video encoding means for acquiring the frame image data and generating the I picture, the P picture, and the B picture encoded based on the set M value;
Display data generating means for generating the display data based on the generated I picture, P picture, and B picture;
Shooting state information generating means for generating the shooting state information indicating that the frame image was shot at a shooting speed equal to the frame rate of the display device;
Video data generating means for generating the video data based on the display data and the shooting state information;
A data processing apparatus comprising: The data processing apparatus according to claim 1,
The data processing device, wherein the photographing device is capable of photographing at a photographing speed faster than a frame rate of the display device. The data processing apparatus according to claim 1 or 2, wherein
The imaging device can output a synchronization signal of the frame image data,
The data processing device, wherein the photographing speed recognition means acquires the synchronization signal from the photographing device and recognizes the photographing speed based on a period of the synchronization signal. The data processing apparatus according to claim 1 or 2, wherein
The photographing device can output photographing speed information related to the photographing speed,
The data processing apparatus, wherein the photographing speed recognition unit acquires the photographing speed information from the photographing apparatus and recognizes the photographing speed based on the photographing speed information. A data processing device according to any one of claims 1 to 4,
Sampling means for acquiring sound collection data of the sound collected by the sound collector, and sampling the acquired sound collection data at a sampling frequency obtained by multiplying a reference sampling frequency by the photographing speed magnification;
Sound encoding means for generating encoded sound data obtained by encoding the sampled sound collection data; and
Sound output data generating means for generating sound output data having a series of data string structures in which the generated encoded sound data is associated in the sound output order;
Sampling state information generating means for generating sampling state information indicating that the sampled sound collection data has been sampled at the reference sampling frequency;
Sound data generating means for generating sound data having the sound output data and the sampling state information;
A data processing apparatus comprising: The data processing apparatus according to claim 5, wherein
A data processing apparatus comprising: multiplexed data generating means for generating multiplexed data obtained by multiplexing the video data and the sound data. A data processing device according to any one of claims 1 to 4, an output control device that is connected to the data processing device so that various types of data can be transmitted and received, and controls to display a video imaged by the imaging device, A data processing system comprising:
The data processing device includes:
Data transmission means for transmitting the video data to the output control device;
The output control device includes:
Data receiving means for receiving the video data from the data processing device;
Video decoding means for decoding the I picture, the P picture, and the B picture of the received video data and outputting the frame image data;
Shooting state recognition means for recognizing that the frame image was shot at a shooting speed equal to the frame rate of the display device based on the shooting state information of the video data;
Based on the input operation, the video decoding means decodes the I picture, the P picture, and the B picture, and displays the frame image data at the frame rate on the display device. Control for displaying a first video that moves at a speed different from the moving speed of the image, or decoding the I picture and the P picture to display the frame image data at the frame rate, so that the object actually moves Display control means for controlling to display a second video moving at a speed substantially equal to the speed;
A data processing system characterized by comprising 7. The data processing device according to claim 5 or 6, and a sound collected by the sound collecting device and a control for displaying video taken by the photographing device connected to the data processing device so that various data can be transmitted and received. An output control device for controlling the output of
The data processing device includes:
Data transmission means for transmitting the video data and the sound data to the output control device,
The output control device includes:
Data receiving means for receiving the video data and sound data from the data processing device;
Video decoding means for decoding the I picture, the P picture, and the B picture of the received video data and outputting the frame image data;
Shooting state recognition means for recognizing that the frame image was shot at a shooting speed equal to the frame rate of the display device based on the shooting state information of the video data;
Sound decoding means for decoding the encoded sound data of the received sound data and outputting the sound collection data;
Sampling state recognition means for recognizing that the collected sound data is sampled at the reference sampling frequency based on the sampling state information of the sound data;
Based on the input operation, the video decoding means decodes the I picture, the P picture, and the B picture, and displays the frame image data at the frame rate on the display device. Control for displaying a first video that moves at a speed different from the moving speed of the image, or decoding the I picture and the P picture to display the frame image data at the frame rate, so that the object actually moves Display control means for controlling to display a second video moving at a speed substantially equal to the speed;
When the display control means performs control to display the first video, the sound decoding means decodes the encoded sound data in the sound output order, and the sound collection data is sent from the sound output device. Control is performed to output the first sound at a speed different from the actually collected sound by outputting at the reference sampling frequency, and control to display the second video by the display control means is performed. In this case, the encoded sound data is decoded at intervals equal to the shooting speed magnification and the sound collection data is output at the reference sampling frequency so that the sound output order is substantially equal to the actually collected sound. Sound output control means for performing control to output a second sound of speed;
A data processing system characterized by comprising A data processing method for generating video data for displaying a video shot by a shooting device on a display device by a calculation means,
The photographing device can output frame image data for displaying a frame image photographed at a photographing speed different from a frame rate of the display device,
The video data is display data having a series of data string structures in which I picture, P picture, and B picture obtained by encoding the frame picture data based on the MPEG (Motion Picture Experts Group) standard are associated in display order. And shooting state information indicating that the frame image was shot at a predetermined shooting speed,
The computing means is
Recognizing the shooting speed,
Recognizing the magnification of the photographing speed with respect to the frame rate of the display device as a photographing speed magnification,
The recognized shooting speed magnification is set as an M value representing an interval between the I picture and the P picture in the display data, or an interval between the P pictures,
Obtaining the frame image data and generating the I picture, the P picture, and the B picture encoded based on the set M value;
Based on the generated I picture, P picture, and B picture, the display data is generated,
Generating the shooting state information indicating that the frame image was shot at a shooting speed equal to a frame rate of the display device;
The data processing method, wherein the video data is generated based on the display data and the shooting state information. A data processing program for causing an arithmetic means to function as the data processing device according to any one of claims 1 to 6. A data processing program for causing a calculation means to execute the data processing method according to claim 9. A recording medium on which a data processing program is recorded, wherein the data processing program according to claim 10 or 11 is recorded so as to be readable by an arithmetic means.

Images