JP2007221563A - Reproduction control apparatus, data processing apparatus, reproduction control method, program thereof, and recording medium for recording the program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a recording and reproducing system capable of excellently applying ordinary reproduction and slow reproduction to a video image. <P>SOLUTION: A coded stream is configured with a plurality of closed GOPs. A recording and reproducing apparatus 400 is provided with 16 MPEG video decoders 411 in parallel. The recording and reproducing apparatus 400 extracts 16 closed GOPs from the coded stream and distributes them to the 16 MPEG video decoders 411 to allow the decoders 114 to decode the closed GOPs and stores frame image data to a video memory 420. The recording and reproducing apparatus 400 allows a display apparatus 200 to display the frame image data at a ratio of one per four according to a display order thereby executing control of displaying a video image of ordinary reproduction or executing control of displaying a video image of slow reproduction by displaying the frame image data in the display order. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention reproduces video data having a plurality of frame image data for displaying a predetermined frame image, and performs a control to display the predetermined video on a display device, a data processing device, a reproduction control method, The present invention relates to the program and a recording medium on which the program is recorded.

2. Description of the Related Art Conventionally, a configuration is known in which audio is reproduced without a sense of incongruity when a video recorded on a recording medium is reproduced at a speed desired by a user (see, for example, Patent Document 1).
Further, for example, a method is known in which a frame rate faster than the frame rate in the NTSC (National Television System Committee) system, that is, a video shot at a high speed is recorded on a recording medium (see, for example, Patent Document 2).

The device described in Patent Document 1 includes a plurality of video decoder units.
For video reproduction, a so-called open GOP (Group Of Pictures) is input to these video decoder units, decoded, and output to the video output control unit. That is, two consecutive GOPs including pictures that are referred to across different GOPs are continuously input to one video decoder unit. Then, a configuration is adopted in which the temporally subsequent GOP is decoded by referring to the temporally previous GOP among the continuous GOPs and output to the video output control unit.

In the apparatus described in Patent Document 2, image information to be read when reproducing at a normal speed is continuously recorded as basic information in a recording area provided on the inner periphery of the optical disc. Furthermore, image information that can be read only during low-speed playback is collectively recorded as interpolation information in a recording area provided on the outer periphery of the optical disc.
In the case of low-speed reproduction, a configuration is adopted in which low-speed reproduction is performed by reading interpolation information and basic information.

JP 2001-202698 A (page 11 left column-page 12 left column) Japanese Patent No. 3604186 (pages 5-9)

However, in the configuration as described in Patent Document 1 described above, in order to decode the GOP of a predetermined scene in the video decoder unit, it is necessary to decode the GOP temporally prior to this GOP, One problem is that the efficiency at the time of decoding may decrease.
Further, in the configuration as described in Patent Document 2 described above, when a scene played immediately before playback at normal speed is played back at low speed, only basic information is read out during normal speed playback. As an example, there is a problem that it is necessary to newly read out the interpolation information for this purpose and there is a possibility that the low-speed reproduction cannot be started quickly.

  In view of such circumstances, an object of the present invention is to provide a playback control device, a data processing device, a playback control method, a program thereof, and a recording in which the program is recorded. To provide a medium.

  According to the first aspect of the present invention, reproduction control for controlling reproduction of a predetermined video on a display device capable of displaying the frame image at a predetermined frame rate based on video data for displaying the predetermined frame image. The image data includes a plurality of frame image groups having a series of data string structures in which encoded image data obtained by encoding frame image data for displaying the frame image is associated in display order. The encoded image data is encoded so as to be decodable without referring to the encoded image data of the frame image group that does not have the encoded image data, and the video data is acquired to obtain the frame Extraction means for extracting a plurality of image groups is provided in parallel to decode the encoded image data of the frame image group. A plurality of decoding means for outputting the frame image data; an allocation means for allocating the plurality of frame image groups extracted by the extracting means to the plurality of decoding means; and the frame image data output from the decoding means. Frame image storage processing means for storing the image data in the frame image storage means, and based on the input operation, the display sequence sequentially obtains the frame image data for each predetermined interval from the frame image storage means, and the display device stores the frame image data. Control to display at the frame rate and play back the video at the first playback speed, or sequentially acquire the frame image data in the display order and display it at the frame rate to make it faster than the first playback speed. And a playback control means for controlling playback of a video having a slow second playback speed. It is a device.

  According to a seventh aspect of the present invention, there is provided a playback control apparatus according to any one of the first to sixth aspects, a video data generating means for acquiring the frame image data and generating the video data, and the video Video storage processing means for storing the video data generated by the data generation means in video data storage means, and the extraction means acquires the video data from the video data storage means A data processing device.

  The invention according to claim 8 is provided so as to be connectable to the reproduction control device according to any one of claims 4 to 6 and a photographing apparatus capable of photographing at a photographing speed faster than the frame rate. Video data generating means for acquiring the frame image data of a frame image photographed by the apparatus and generating the video data, and video for storing the video data generated by the video data generating means in the video data storage means Storage processing means, and the extraction means acquires the video data from the video data storage means.

  According to the ninth aspect of the present invention, the control unit reproduces the predetermined video on the display device capable of displaying the frame image at the predetermined frame rate based on the video data for displaying the predetermined frame image. The video data is a frame image having a series of data string structures in which encoded image data obtained by encoding frame image data for displaying the frame image is associated in display order. A plurality of groups, and the encoded image data is encoded so as to be decodable without referring to the encoded image data of the frame image group not having the encoded image data, and the frame image group A plurality of decoding means for decoding the encoded image data and outputting the frame image data are provided in parallel, and the video data is Obtaining a plurality of the frame image groups, allocating the extracted plurality of frame image groups to the plurality of decoding means, and the frame image data output from the decoding means to the frame image storage means Based on the input operation, the frame image data for which the display order is every predetermined interval is sequentially acquired from the frame image storage means, and displayed on the display device at the frame rate, so that the first reproduction speed is set. Control for reproducing video, or control for sequentially obtaining the frame image data in the display order, displaying the frame image data at the frame rate, and reproducing video at a second reproduction speed slower than the first reproduction speed. A reproduction control method characterized by:

  A tenth aspect of the present invention is a reproduction control program that causes a calculation unit to function as the reproduction control device according to any one of the first to sixth aspects.

  According to an eleventh aspect of the present invention, there is provided a reproduction control program that causes a calculation means to execute the reproduction control method according to the ninth aspect.

  According to a twelfth aspect of the present invention, there is provided a recording medium on which a reproduction control program according to the tenth or eleventh aspect is recorded so as to be readable by an arithmetic means.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, a recording / reproduction system capable of reproducing and displaying the recorded video at a plurality of reproduction speeds while photographing and recording the video will be described as an example.
In the following, an image in which a photographed predetermined object, for example, a ball, moves at a speed approximately equal to the actual moving speed is referred to as a normal reproduction image. An image in which the ball moves at a speed that is ¼ of the actual moving speed is referred to as a slow reproduction image.
Here, the playback speed during normal playback corresponds to the first playback speed of the present invention, and the playback speed during slow playback corresponds to the second playback speed of the present invention.
FIG. 1 is a block diagram showing a schematic configuration of a recording / reproducing system according to an embodiment of the present invention. FIG. 2 is a schematic diagram illustrating a schematic configuration of an encoded stream. FIG. 3 is a conceptual diagram showing a closed GOP allocation state. FIG. 4 is a block diagram showing a schematic configuration of the CPU. FIG. 5 is a conceptual diagram showing a schematic configuration of frame image data stored in the video memory during search reproduction. FIG. 6 is a conceptual diagram showing a schematic configuration of frame image data stored in the video memory when the search reproduction speed is reset.

[Recording and playback system configuration]
In FIG. 1, reference numeral 100 denotes a recording / reproducing system. The recording / reproducing system 100 includes a display device 200, a high-speed camera 300 as a photographing device, and a recording / reproducing device 400 as a data processing device.

The display device 200 is connected to the recording / reproducing device 400 and displays a video at a predetermined reproduction speed based on the video signal from the recording / reproducing device 400. The display device 200 switches and displays frame images based on frame image data 650 (see FIG. 5) described later of the video signal at a frame rate of the NTSC (National Television System Committee) system, that is, at a rate of 30 frames per second. Thus, a video with a predetermined reproduction speed is reproduced and displayed.
Examples of the display device 200 include a liquid crystal panel, an organic EL (Electro Luminescence) panel, a PDP (Plasma Display Panel), a CRT (Cathode-Ray Tube), an FED (Field Emission Display), and an electrophoretic display panel.
The display device 200 is not limited to the NTSC system, but may be a PAL (Phase-Alternation Line system) system or a SECAM system.

The high speed camera 300 is configured to be detachable from the recording / reproducing apparatus 400. The high-speed camera 300 shoots an object such as a ball at a shooting speed of 120 frames per second, that is, a shooting speed that is four times the frame rate of the display device 200. Then, frame image data for displaying a frame image for 1/120 seconds, that is, a frame image shot with a shooting time of 1/120 seconds is appropriately generated, converted into an analog video signal, and recorded and reproduced by the recording / playback apparatus 400 Output to.
Note that the high-speed camera 300 is not limited to a camera with a shooting speed four times the frame rate of the display device 200.

The recording / reproducing apparatus 400 displays the video captured by the high speed camera 300 on the display apparatus 200 as a normal playback or slow playback video. In addition, a video in which a predetermined object moves at a speed four times the actual moving speed while being so-called fast forward or rewind is displayed as a video for search reproduction. Further, the playback speed at the time of search playback (hereinafter referred to as search playback speed) is reset as appropriate to display the video.
Here, the search playback speed corresponds to the third playback speed of the present invention. Further, fast-forward search reproduction corresponds to reproduction at the third reproduction speed in the forward direction of the display order of the present invention, and rewind search reproduction corresponds to third reproduction in the reverse direction of the display order of the present invention. Supports playback at playback speed.
The recording / reproducing apparatus 400 includes a decoding unit 410, a video memory 420 as a frame image storage unit, a video A (Analog) / D (Digital) converter 430, and an MPEG (Motion Picture Experts) as a video data generation unit. Group) video encoder 440, storage device 450, allocation means 460 that also functions as extraction means, video memory controller 470 that also functions as frame image storage processing means, video signal generator 480, and jog switch 490, a playback speed setting switch 500, a user interface control unit 510, and a CPU (Central Processing Unit) 520.

The decoding unit 410 includes an MPEG video decoder 411 as 16 decoding means provided in parallel.
These MPEG video decoders 411 are connected to the allocation means 460, the video memory controller 470, and the CPU 520, respectively.
The MPEG video decoder 411 is controlled by the CPU 520 and acquires a closed GOP (Group Of Pictures) 610, which will be described later, output from the allocating means 460. Further, the encoded image data 620 of the closed GOP 610 is decoded at a decoding speed of 30 frames per second, that is, a decoding speed equal to the frame rate of the display device 200 (hereinafter referred to as a 1-time decoding speed). Then, the eight frame image data 650 obtained by decoding is output to the video memory controller 470.

  Here, the number of MPEG video decoders 411 provided in the decoding unit 410 is set based on the following equation (1).

W ≧ N × V / P (1)
W: number of MPEG video decoders 411 N: magnification of shooting speed of high-speed camera 300 with respect to frame rate of display device 200 V: magnification of search playback speed with respect to normal playback speed P: MPEG video with respect to frame rate of display device 200 Decoding rate magnification of the decoder 411

That is, as described above, since the values of N, V, and P in the formula (1) are 4, 4, and 1, respectively, the value of W is 16.
For this reason, the number of MPEG video decoders 411 included in the decoding unit 410 is set to 16 satisfying Expression (1).

The video memory 420 is connected to the video memory controller 470.
The video memory 420 accumulates the frame image data 650 output from the video memory controller 470 so as to be appropriately readable. The video memory 420 has a capacity capable of storing a maximum of 480 frame image data 650. That is, since one frame image data 650 is for displaying a frame image for 1/120 seconds as described above, it has a capacity capable of storing frame image data 650 for 4 seconds at the maximum. .

The video A / D converter 430 is connected to the MPEG video encoder 440. In addition, the video A / D converter 430 is appropriately connected to the high speed camera 300.
The video A / D converter 430 acquires the analog video signal output from the high speed camera 300, converts it into a digital video signal, and outputs the digital video signal to the MPEG video encoder 440.

The MPEG video encoder 440 is connected to the storage device 450 and the CPU 520.
The MPEG video encoder 440 is controlled by the CPU 520 and acquires frame image data 650 of the video signal output from the video A / D converter 430. Then, encoding is performed based on the MPEG standard at a speed equal to or higher than the shooting speed of the high speed camera 300 to generate an encoded stream 600 as video data as shown in FIG.

Specifically, the MPEG video encoder 440 encodes the frame image data 650 of the video signal from the video A / D converter 430, and encodes so-called I picture, P picture, or B picture. 620. Here, in FIG. 2, encoded image data 620 indicated as “I”, “P”, and “B” represent an I picture, a P picture, and a B picture, respectively.
Further, the MPEG video encoder 440 associates, for example, eight encoded image data 620 corresponding to one I picture, one P picture, and six B pictures in the display order. A plurality of closed GOPs 610 as a frame group having a series of data string structures are generated.
The encoded image data 620 of the closed GOP 610 is encoded so that it can be decoded without referring to another closed GOP 610. That is, the B picture of the closed GOP 610 is encoded so as to be decodable with reference to the I picture or P picture of the same closed GOP 610 without referring to the I picture or P picture of another closed GOP 610.
Then, the MPEG video encoder 440 generates an encoded stream 600 having a series of data string structures associated in the order in which the closed GOP 610 is reproduced, and outputs the encoded stream 600 to the storage apparatus 450.

The storage device 450 is connected to the allocation unit 460 and the CPU 520. The storage device 450 includes an HD (Hard Disk) 451 as a video data storage unit, a stream storage processing unit 452 as a video storage processing unit, and a stream reading unit 453.
The stream storage processing unit 452 is controlled by the CPU 520, acquires the encoded stream 600 output from the MPEG video encoder 440, and stores it in the HD 451 so that it can be appropriately read, that is, stores it.
The stream reading unit 453 is controlled by the CPU 520 and appropriately reads the encoded stream 600 stored in the HD 451 and outputs it to the allocating unit 460.
The video data storage means of the present invention is not limited to the HD 451 but may be a DVD (Digital Versatile Disc), an optical disc, a memory card, or the like.

The allocating means 460 is connected to 16 MPEG video decoders 411 and a CPU 520.
The allocation unit 460 is controlled by the CPU 520, acquires the encoded stream 600 from the storage apparatus 450, and extracts 16 closed GOPs 610 in which the display order is continuous. Then, as shown in FIG. 3, one closed GOP 610 is output in a state of being allocated to one MPEG video decoder 411.

The video memory controller 470 is connected to the video signal generator 480 and the CPU 520.
The video memory controller 470 is controlled by the CPU 520, acquires the frame image data 650 output by decoding the closed GOP 610 in the MPEG video decoder 411, and stores it in the video memory 420.
In addition, the video memory controller 470 selectively acquires the frame image data 650 as appropriate under the control of the CPU 520 and outputs it to the video signal generator 480 in the order of reproduction.

The video signal generator 480 is appropriately connected to the display device 200.
The video signal generator 480 acquires the frame image data 650 output from the video memory controller 470. Then, it is converted into a video signal corresponding to the display device 200 and output to the display device 200.

The jog switch 490 is connected to the user interface control unit 510. The jog switch 490 includes a substantially disc-shaped jog dial 491, a touch sensor (not shown), and a rotation sensor.
The jog dial 491 is disposed so as to be rotatable in the circumferential direction about a substantially disc-shaped center as desired, for example, in front of a case body (not shown) of the recording / reproducing apparatus 400.
The touch sensor is disposed on the back side of the jog dial 491, for example. This touch sensor detects that the user has touched the jog dial 491 and outputs a contact detection signal to that effect to the user interface control unit 510.
The rotation sensor is disposed in the vicinity of the rotation center of the jog dial 491, for example. This rotation sensor detects the rotation angle and rotation speed of the jog dial 491 and outputs a rotation detection signal related to these to the user interface control unit 510.

The playback speed setting switch 500 is connected to the user interface control unit 510. The playback speed setting switch 500 includes a playback speed setting button 501 and a setting detection unit (not shown).
The playback speed setting button 501 is arranged facing the front of a case body (not shown) of the recording / playback apparatus 400, and is provided so that an input operation can be performed.
The setting detection unit is disposed on the back side of the playback speed setting button 501, for example. Based on the input operation of the playback speed setting button 501, the setting detection unit outputs a playback speed signal indicating normal playback or slow playback to the user interface control unit 510.

The user interface control unit 510 is connected to the CPU 520.
The user interface control unit 510 appropriately acquires a contact detection signal, a rotation detection signal, and a reproduction speed signal from the jog switch 490 and the reproduction speed setting switch 500. Based on these, if the user recognizes that the jog dial 491 is being rotated, the video is fast-forwarded or rewinded from the current scene according to the rotational angle and rotational speed of the jog dial 491. A reproduction control signal for performing the above is generated and output to the CPU 520.
Also, when the user recognizes that he has released his hand from the jog dial 491, based on the playback speed signal, a playback control signal for starting normal playback or slow playback from the scene being played back when the hand is released Is output to the CPU 520.

As shown in FIG. 4, the CPU 520 serves as various programs stored in a memory (not shown), as shown in FIG. 4. Search speed resetting means 524 and reproduction control means 525 are provided.
Here, the MPEG video decoder 411, the allocation means 460, the video memory controller 470, the remaining number judgment means 523, the search speed resetting means 524, and the reproduction control means 525 are used in the present invention. A playback control device is configured.

The stream storage control unit 521 controls the storage device 450 to store the encoded stream 600 of the video captured by the high speed camera 300.
Specifically, the stream storage control unit 521 controls the MPEG video encoder 440 to acquire the frame image data 650 from the high speed camera 300 input via the video A / D converter 430. Based on the frame image data 650, an encoded stream 600 is generated. Further, the storage apparatus 450 is controlled to store the encoded stream 600 in the HD 451.

The frame image accumulation control unit 522 is controlled by the reproduction control unit 525 and controls to accumulate the frame image data 650 in the video memory 420 based on the encoded stream 600 stored in the storage device 450.
Specifically, the frame image accumulation control unit 522 controls the storage device 450 and the allocation unit 460 to extract 16 closed GOPs 610 that are continuous in time series from the predetermined encoded stream 600. Then, the extracted closed GOP 610 is allocated to each MPEG video decoder 411. Also, the MPEG video decoder 411 is controlled to decode the closed GOP 610 and output the frame image data 650 to the video memory controller 470.

Here, as described above, the MPEG video decoder 411 has a capability of decoding the encoded image data 620 at a decoding speed of 1 ×. The closed GOP 610 has eight pieces of encoded image data 620. Therefore, the frame image accumulation control unit 522 causes the decoding unit 410 to decode 128 pieces of encoded image data 620 at a time using the 16 MPEG video decoders 411 and output the frame image data 650.
Then, the video memory controller 470 is controlled to store the frame image data 650 from each MPEG video decoder 411 in the video memory 420.

  The remaining number determining means 523 is the frame image data 650 stored in the video memory 420 during the search reproduction, and the frame image data whose display order is the search reproduction direction side with respect to the frame image data being displayed (hereinafter referred to as search reproduction). It is determined whether or not the number of 650 (referred to as frame image data for use) satisfies the following expression (2). Here, the search reproduction direction means the rewind direction side when search reproduction is rewind, and means the fast forward direction when fast forward.

U / N <H × V / P (2)
U: number of frame image data 650 for search reproduction among frame image data 650 stored in the video memory 420 H: number of encoded image data 620 included in the closed GOP 610

Assuming that the value of H is 8, the values of V and P in equation (2) are 4 and 1, respectively, so the value of U is 128.
Here, the value of H is a common-sense value in encoding, but there is a relative factor with the maximum number Q of frame image data 650 that can be stored in the video memory 420. In this recording / reproducing system 100, since (H × W) frame image data 650 is replenished to the video memory 420 as a unit, if this value is larger than Q, buffer control becomes difficult. For this reason, the value of H is assumed to be 8.
Therefore, the remaining number determination unit 523 determines whether the number of frame image data 650 for search reproduction out of the frame image data 650 stored in the video memory 420 is less than 128.
Then, the remaining number determination unit 523 outputs remaining number determination information regarding whether or not the expression (2) is satisfied to the reproduction control unit 525.

Search speed resetting means 524 performs a search playback speed resetting process.
Specifically, the search speed resetting means 524 sets the search reproduction speed at which the magnification with respect to the normal reproduction speed is the magnification obtained by the following equation (3).

X ≦ U × P / (H × N) (3)
X: Ratio of search playback speed to be reset with respect to normal playback speed

That is, as described above, since P, H, and N in the formula (3) are 1, 8, and 4, respectively, the value of X is (U / 32).
For this reason, the search speed resetting means 524 sets the search reproduction speed at which the magnification with respect to the normal reproduction speed is (U / 32) times or less. For example, when the number U of frame image data 650 for search reproduction satisfies 80, for example, 80, the search reproduction speed is reset from 4 times to 2.5 times or less.
Here, the search reproduction speed reset based on the expression (3) corresponds to the fourth reproduction speed of the present invention.
Then, search speed resetting means 524 outputs search speed resetting information relating to the reset search playback speed to playback control means 525.

The playback control means 525 controls the display device 200 to display normal playback, slow playback, and search playback videos.
Specifically, the reproduction control unit 525 acquires a reproduction control signal based on input operations of the jog switch 490 and the reproduction speed setting switch 500 from the user interface control unit 510. Then, based on this playback control signal, for example, when recognizing that normal playback is performed while recording the video currently being shot by the high-speed camera 300, the frame image accumulation control means 522 is controlled, and the frame image data 650 is stored. It is stored in the video memory 420.
Also, the playback control means 525 controls the video memory controller 470 to acquire the frame image data 650 at a ratio of 1 in 4 according to the display order, and outputs it to the display device 200 via the video signal generator 480. Let That is, in accordance with the frame rate of the display device 200, the frame image data 650 every 1/30 seconds is displayed on the display device 200 at a rate of 30 frames per second, thereby controlling the normal playback video. To do. Further, the reproduction control unit 525 appropriately deletes the frame image data 650 used for normal reproduction from the video memory 420 and appropriately stores new frame image data 650 in the video memory 420.

Further, when the reproduction control means 525 recognizes that rewind search reproduction is performed during normal reproduction, for example, the reproduction control means 525 starts search reproduction from the frame image data 650 currently reproduced. Further, with the frame image data 650 as a reference, the frame image data 650 is acquired at a rate of 1 out of 16 in accordance with the display order, and a search reproduction video is displayed. That is, by controlling the display device 200 to display the frame image data 650 every 4/30 seconds at a rate of 30 frames per second, control is performed to display the video of search reproduction four times the normal reproduction. Then, the reproduction control unit 525 deletes the frame image data 650 from the stored frame image data 650 and gradually deletes the frame image data 650 so that the display order of the frame image data 650 displayed by the search reproduction gradually becomes approximately intermediate. Let the accumulation process.
For example, as shown in FIG. 5, the playback control means 525 is substantially in the middle of the 240th, 241st, etc. in the state where the frame image data 650 with the display order from 1st to 480th is accumulated in the video memory 420 The deletion and accumulation processing is performed so that the frame image data 650 of the image is displayed. Here, in FIGS. 5 and 6, the frame image data 650 indicated by numerals such as “1”, “2”, and “240” represents that the display order is 1, 2, and 240, respectively.
When the fast-forward search playback is recognized, the playback control unit 525 does not perform the search playback because the frame image data 650 in the fast-forward direction is not stored in the video memory 420.

Further, the reproduction control means 525 obtains remaining number judgment information that the expression (2) is satisfied from the remaining number judgment means 523 during search reproduction, that is, that the frame image data 650 for search reproduction is less than the number U. Then, if the search reproduction is continued at this search reproduction speed, it is recognized that the search reproduction is interrupted.
That is, for example, as shown in FIG. 6, in the state where the 81st frame image data 650 in the display order is displayed during the rewind search reproduction, the search reproduction frame image data 650 is expressed by the equation (2). 1) to 80th frame image data 650 satisfying the above. When the number of search reproduction frame image data 650 is U, the time from search reproduction at the V-times search reproduction speed until the search reproduction frame image data 650 disappears is obtained by Expression (4). .

Y = U × T / V (4)
Y: Time until the frame image data 650 for search reproduction disappears [seconds]
T: Frame image shooting time per frame

That is, as described above, U, T, and V in Equation (4) are 80, 1/120, and 4, respectively, so the value of Y is about 160 milliseconds.
Further, the time until new frame image data 650 is accumulated is obtained by Expression (5).

Z = H / (30 × P) (5)
Z: Time until new frame image data 650 is accumulated [seconds]

That is, as described above, since H and P in Equation (5) are 8 and 1, respectively, the value of Z is about 260 milliseconds.
For this reason, the time Y until the frame image data 650 for search reproduction disappears is shorter than the time Z until the new frame image data 650 is accumulated. Therefore, if search reproduction is continued at a search reproduction speed of 4 times. Recognize that search playback is interrupted.

  Then, the playback control unit 525 causes the search speed resetting unit 524 to perform search playback speed resetting processing to acquire search speed resetting information. For example, when the search speed reset information indicating that the speed is 2.5 times or less is acquired, the search playback at the search playback speed of 4 times is finished, and the search playback at the search playback speed of 2.5 times or less is completed. To start. For example, the frame image data 650 is acquired at a rate of one out of eight in accordance with the display order, and the search reproduction video at the double search reproduction speed is displayed.

Further, when the playback control means 525 recognizes that slow playback is to be performed during, for example, rewind search playback, the playback control means 525 recognizes that the video memory controller 470 starts slow playback from the frame image data 650 being displayed at the time of recognition. That is, for example, if a user wants to watch a previously played scene again with a slow video, if the user performs an operation to perform a slow playback after performing a rewind search playback, it recognizes that the slow playback starts from the scene at the time of this operation. To do.
Then, the reproduction control unit 525 reproduces the slow reproduction video by outputting the frame image data 650 to the display device 200 in the display order. That is, by controlling the display device 200 to display frame image data 650 every 1/120 second at a rate of 30 frames per second, control is performed to display a video image that is 1/4 times slower than normal playback.

[Operation of recording and playback system]
Next, the operation of the recording / reproducing system 100 will be described with reference to the drawings.
FIG. 7 is a flowchart showing normal playback processing. FIG. 8 is a flowchart showing a frame image data accumulation process. FIG. 9 is a flowchart showing search reproduction processing and slow reproduction processing.

(Normal playback processing)
First, normal playback processing will be described as the operation of the recording / playback system 100.

The CPU 520 of the recording / playback apparatus 400 normally plays back the stored video based on the user's input operation as shown in FIG. 7, for example, during the process of saving the video shot by the speed camera 300 in the storage device 450. It is determined whether or not to perform (step S101). If it is determined in step S101 that normal reproduction is not performed, for example, the process of step S101 is performed after a predetermined time has elapsed.
On the other hand, if it is determined in step S101 that normal playback is to be performed, the frame image data 650 is stored in the video memory 420 (step S102).
After performing the accumulation process in step S102, a process for displaying a normal reproduction video on the display device 200 based on the frame image data 650 accumulated in the video memory 420 is performed (step S103).

Thereafter, CPU 520 determines whether or not frame image data 650 needs to be stored in order to continue normal reproduction (step S104). If it is determined in step S104 that accumulation is necessary, the process of step S102 is performed.
If it is determined in step S104 that accumulation is not necessary, it is determined whether or not normal reproduction is to be terminated (step S105). If it is determined in step S105 that the process will not end, the process of step S103 is performed.
On the other hand, if it is determined in step S105 that the process is to be terminated, the normal reproduction process is terminated.

In addition, in the storage process of the frame image data 650 in step S102, as shown in FIG. 8, the allocation unit 460 extracts 16 closed GOPs 610 whose display order is continuous (step S201). Further, a process of allocating the extracted closed GOP 610 to the 16 MPEG video decoders 411 is performed (step S202).
Thereafter, the MPEG video decoder 411 decodes the encoded image data 620 of the closed GOP 610 (step S203), and outputs the frame image data 650 to the video memory controller 470. Then, the video memory controller 470 accumulates 128 frame image data 650 from the 16 MPEG video decoders 411 in the video memory 420 (step S204).

(Search playback processing and slow playback processing)
Next, search playback processing and slow playback processing will be described as operations of the recording / playback system 100.

The CPU 520 of the recording / reproducing apparatus 400 determines whether or not to start search reproduction as shown in FIG. 9, for example, during normal reproduction of the captured video by the high speed camera 300 (step S301). If it is determined in step S301 that search reproduction is not performed, for example, the process of step S301 is performed after a predetermined time has elapsed.
On the other hand, if it is determined in step S301 that search playback is to be performed, processing for recognizing fast forward or rewind, that is, processing for acquiring the search playback direction is performed (step S302). Thereafter, the speed designated by the operation unit, that is, the jog switch 490 is acquired (step S303), and it is determined whether or not the frame image data 650 for search reproduction is less than the number U obtained by the equation (2). (Step S304).

In step S304, if the CPU 520 determines that the number is less than several U, it determines whether or not it is 0 (step S305). And when it is judged that it is 0, it returns to step S301. Here, in this step S305, the frame image data 650 for search reproduction is determined to be 0, for example, when normal reproduction is in progress and the frame image data 650 in the fast-forward direction is not stored in the video memory 420. is there.
On the other hand, if it is determined in step S305 that it is not 0, the search reproduction speed is reset based on equation (3) (step S306). Thereafter, the search playback speed is changed to the reset search playback speed (step S307), and search playback is performed (step S308).
Also, when it is determined in step S304 that the number is more than several U, the process of step S308 is performed.

And CPU520 implements the process of step S102 after step S308. In the process of step S102 performed after step S308, a process of accumulating the display order of the frame image data 650 displayed by the search reproduction gradually in a substantially intermediate state is performed.
Thereafter, it is determined whether or not the search reproduction is ended (step S309). If it is determined in step S309 that the process will not end, the process of step S302 is performed.
On the other hand, if it is determined in step S309 that the reproduction is to be terminated, it is determined whether or not the search reproduction is terminated and the slow reproduction is started (step S310).
If it is determined in this step S310 that slow playback is not performed, for example, the process of step S310 is performed after a predetermined time has elapsed.
On the other hand, if it is determined in step S310 that slow playback is to be performed, slow playback is started based on the frame image data 650 stored in the video memory 420 (step S311).

Thereafter, the CPU 520 determines whether or not the frame image data 650 needs to be accumulated (step S312). If it is determined in step S312 that accumulation is necessary, the process of step S102 is performed. Then, after the process of step S102 or when it is determined in step S312 that accumulation is not necessary, it is determined whether or not the slow reproduction is to be ended (step S313).
If it is determined in step S313 that the process will not end, the process of step S312 is performed.
On the other hand, if it is determined in step S313 that the process is to end, the process ends.

[Effects of recording / playback system]
As described above, in the above-described embodiment, the encoded stream 600 for displaying a predetermined video on the display device 200 has a plurality of closed GOPs 610 in which the encoded image data 620 are associated in the display order. Furthermore, the encoded image data 620 is encoded so that it can be decoded without referring to the encoded image data 620 of another closed GOP 610. The recording / reproducing apparatus 400 is provided with 16 MPEG video decoders 411 that decode the encoded image data 620 and output the frame image data 650 in parallel.
Then, the recording / reproducing apparatus 400 extracts 16 closed GOPs 610 from the encoded stream 600, and allocates and decodes them to the 16 MPEG video decoders 411. Thereafter, the decoded frame image data 650 is stored in the video memory 420. Further, based on the user's input operation, the frame image data 650 is acquired at a rate of one out of four in accordance with the display order and displayed at the frame rate of the display device 200, thereby displaying a normal playback video. . Further, the frame image data 650 is acquired in the display order, and is displayed at the frame rate of the display device 200, thereby displaying a slow playback video.

For this reason, since the 16 MPEG video decoders 411 decode the closed GOP 610 of a predetermined scene, there is no need to decode the adjacent closed GOP 610, and the efficiency of decoding the closed GOP 610 of the predetermined scene is reduced. Can be suppressed.
By the way, the decoding unit 410 is composed of only one single-speed MPEG video decoder 411, and is made equal to the M value (4 in the present embodiment) of the encoded stream 600, and only I and P pictures are reproduced. By doing so, it is possible to reproduce the captured video of normal reproduction in real time. However, in such a case, since all the frame image data 650 is not stored in the video memory 420, re-decoding is necessary at the start of the slow playback, and at that time, the image display stops, so Cannot start playback properly. Further, with respect to the accuracy at the time of search reproduction, only one image can be displayed per N of actual photographed images, so that the search accuracy becomes coarse. Therefore, when the scene played immediately before during normal playback is played back slowly, the MPEG video decoder 411 uses the frame image data 650 stored in more video memories 420 than in a single configuration to play back slowly. Thus, it is not necessary to newly decode and store the frame image data 650 used for the slow playback, and the slow playback can be started quickly.
Further, by providing a plurality of MPEG video decoders 411 having a 1 × decoding speed that is widely used, the number of encoded image data 620 that can be decoded in a predetermined time is increased. There is no need to newly design and manufacture an MPEG video decoder 411 having a decoding speed.
Therefore, the recording / reproducing apparatus 400 can satisfactorily reproduce the video normally and normally.

The plurality of closed GOPs 610 have a configuration in which the same number of encoded image data 620 is provided.
For this reason, the decoding completion timing of the closed GOP 610 in the 16 MPEG video decoders 411 can be made equal, and the timing design for inputting the closed GOP 610 to be decoded next can be simplified.

Also, the encoded stream 600 is configured to have a plurality of closed GOPs 610 encoded based on the MPEG standard.
For this reason, since it is possible to process data conforming to the widely spread MPEG standard, the use can be easily expanded.

The frame image data 650 is used to display a frame image by the high-speed camera 300 that can shoot at 4 × speed. Then, the number of MPEG video decoders 411 provided in the decoding unit 410 is set based on Expression (1).
Here, when the frame image data 650 at the quadruple speed is searched and reproduced at the search reproduction speed of four times, one frame is displayed at a ratio of 16 pieces. The frame image data 650 needs to be accumulated.
For this reason, since 16 MPEG video decoders 411 having a decoding speed of 1 are provided based on the equation (1), 16 frame image data 650 can be stored at a time, and search can be performed smoothly. Can play.

Further, the recording / reproducing apparatus 400 accumulates the frame image data 650 in a state where the display order of the frame image data 650 displayed by the search reproduction gradually becomes substantially intermediate in the accumulated frame image data 650. ing. If it is determined that the number of frame images 650 for search reproduction does not satisfy the expression (2) during search reproduction, the search reproduction at this search reproduction speed is terminated.
Therefore, by determining whether or not the expression (2) is satisfied, it can be recognized that the search reproduction is interrupted when the search reproduction speed is continued without being changed, and the search reproduction can be performed more appropriately. Further, it is possible to recognize in advance that there is no frame image data 650 for search reproduction, and malfunctions can be prevented.

Further, when the recording / reproducing apparatus 400 determines that the expression (2) is not satisfied, the recording / reproducing apparatus 400 resets the search reproduction speed based on the expression (3) and continues the search reproduction.
For this reason, even if there is a possibility that the frame image data 650 for search reproduction is lost, search reproduction can be continued by automatically changing the search reproduction speed. Therefore, the search reproduction can be made more appropriate.

The frame image data 650 is used to display a frame image taken by the high speed camera 300.
For this reason, the video image | photographed with the high speed camera 300 according to a user's liking, for example, the image | video of a sport can be favorably normally reproduced | regenerated and slow reproduction | regeneration, and expansion of utilization can be aimed at more easily.

Further, the recording / reproducing apparatus 400 acquires frame image data, generates an encoded stream 600 based on the frame image data, and stores the encoded stream 600 in the storage apparatus 450. Then, the closed GOP 610 is extracted from the encoded stream 600 stored in the storage device 450 and allocated to the MPEG video decoder 411.
For this reason, the recording / reproducing apparatus 400 can be provided with a function for generating an encoded stream 600 for normal reproduction and slow reproduction in addition to a function for performing normal reproduction and slow reproduction of the video satisfactorily. Can improve convenience.

Furthermore, the recording / reproducing apparatus 400 is configured to be connectable to the high speed camera 300. Then, the recording / reproducing apparatus 400 generates and stores the encoded stream 600 based on the frame image data from the high speed camera 300.
For this reason, while the encoded stream 600 for reproducing the video imaged by the high speed camera 300 is stored, the video image can be normally reproduced or reproduced at the same time, and the convenience of the recording / reproducing apparatus 400 can be further improved.

[Modification of Embodiment]
In addition, this invention is not limited to embodiment mentioned above, The deformation | transformation shown below is included in the range which can achieve the objective of this invention.

That is, a configuration in which the number of encoded image data 620 provided in the closed GOP 610 is not equal or a configuration that does not satisfy Expression (2) may be employed.
Further, the encoded image data 620 is not encoded according to the MPEG standard, but may be encoded by another method.

The search reproduction may be configured not to perform control for starting from frame image data 650 whose display order is substantially intermediate.
With such a configuration, the processing load on the CPU 520 can be reduced.

In addition, the number of MPEG video decoders 411 may be provided so as not to satisfy Expression (1).
With such a configuration, the number of MPEG video decoders 411 can be reduced and the configuration can be simplified as compared with the configuration of the above embodiment.
If, for example, an MPEG video decoder 411 having a double decoding speed is used, it is only necessary to arrange eight according to equation (1), and the configuration is simplified with the same decoding capability as in the above embodiment. Can be.

Further, it may be configured such that processing for determining whether or not Expression (2) is satisfied during search reproduction, that is, processing for recognizing in advance that there is no frame image data 650 for search reproduction.
Alternatively, the search reproduction may be interrupted when it is determined that Expression (2) is not satisfied without resetting the search reproduction speed based on Expression (3).
With such a configuration, the processing load on the CPU 520 can be further reduced and the configuration can be simplified.

The encoded stream 600 is not limited to the one generated based on the video from the high speed camera 300 but may be one generated by computer graphics.
Further, the recording / reproducing apparatus 400 may be configured not to include the video A / D converter 430 and the MPEG video encoder 440.
Further, the high-speed camera 300 may be provided with a video A / D converter 430 and an MPEG video encoder 440.

  Each function described above is constructed as a program. However, for example, it may be configured by hardware such as a circuit board or an element such as one integrated circuit (IC), and can be used in any form. By adopting a configuration that allows reading from a program or a separate recording medium, handling is easy, and usage can be easily expanded.

  In addition, the specific structure and procedure for carrying out the present invention can be appropriately changed to other structures and the like within a range in which the object of the present invention can be achieved.

[Effects of Embodiment]
As described above, in the above embodiment, the encoded stream 600 has a configuration in which a plurality of closed GOPs 610 are provided. The recording / reproducing apparatus 400 is provided with 16 MPEG video decoders 411 in parallel.
Then, the recording / reproducing apparatus 400 extracts 16 closed GOPs 610 from the encoded stream 600, allocates and decodes them to the 16 MPEG video decoders 411, and stores the frame image data 650 in the video memory 420. Further, the normal reproduction video is displayed by causing the display device 200 to display the frame image data 650 at a ratio of one to four in accordance with the display order. Further, by displaying the frame image data 650 in the display order, a slow playback video is displayed.

For this reason, since the 16 MPEG video decoders 411 decode the closed GOP 610 of a predetermined scene, there is no need to decode another closed GOP 610, and the efficiency of decoding the closed GOP 610 of a predetermined scene is reduced. Can be suppressed.
By the way, the decoding unit 410 is composed of only one single-speed MPEG video decoder 411, and is made equal to the M value (4 in the present embodiment) of the encoded stream 600, and only I and P pictures are reproduced. By doing so, it is possible to reproduce the captured video of normal reproduction in real time. However, in such a case, since all the frame image data 650 is not stored in the video memory 420, re-decoding is necessary at the start of the slow playback, and at that time, the image display stops, so Cannot start playback properly. Further, with respect to the accuracy at the time of search reproduction, only one image can be displayed per N of actual photographed images, so that the search accuracy becomes coarse. Therefore, when the scene played immediately before during normal playback is played back slowly, the MPEG video decoder 411 uses the frame image data 650 stored in more video memories 420 than in a single configuration to play back slowly. Thus, it is not necessary to newly decode and store the frame image data 650 used for the slow playback, and the slow playback can be started quickly.
Further, by providing a plurality of MPEG video decoders 411 having a 1 × decoding speed that is widely used, the number of encoded image data 620 that can be decoded in a predetermined time is increased. There is no need to newly design and manufacture an MPEG video decoder 411 having a decoding speed.
Therefore, the recording / reproducing apparatus 400 can satisfactorily reproduce the video normally and normally.

Further, the recording / reproducing apparatus 400 acquires frame image data, generates an encoded stream 600 based on the frame image data, and stores the encoded stream 600 in the storage apparatus 450. Then, the closed GOP 610 is extracted from the encoded stream 600 stored in the storage device 450 and allocated to the MPEG video decoder 411.
For this reason, the recording / reproducing apparatus 400 can be provided with a function for generating an encoded stream 600 for normal reproduction and slow reproduction in addition to a function for performing normal reproduction and slow reproduction of the video satisfactorily. Can improve convenience.

Furthermore, the recording / reproducing apparatus 400 is configured to be connectable to the high speed camera 300. Then, the recording / reproducing apparatus 400 generates and stores the encoded stream 600 based on the frame image data from the high speed camera 300.
For this reason, while the encoded stream 600 for reproducing the video imaged by the high speed camera 300 is stored, the video image can be normally reproduced or reproduced at the same time, and the convenience of the recording / reproducing apparatus 400 can be further improved.

It is a block diagram which shows schematic structure of the recording / reproducing system which concerns on one embodiment of this invention. It is a schematic diagram which shows schematic structure of the encoding stream in the said one Embodiment. It is a conceptual diagram which shows the allocation state of closed GOP in the said one Embodiment. It is a block diagram which shows schematic structure of CPU in the said one Embodiment. It is a conceptual diagram which shows schematic structure of the frame image data accumulate | stored in the video memory at the time of the search reproduction | regeneration in the said embodiment. 4 is a conceptual diagram showing a schematic configuration of frame image data stored in a video memory when resetting a search reproduction speed in the embodiment. FIG. It is a flowchart which shows the normal reproduction | regeneration processing in the said one Embodiment. It is a flowchart which shows the accumulation | storage process of the frame image data in the said embodiment. It is a flowchart which shows the search reproduction | regeneration processing and slow reproduction | regeneration processing in the said embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 200 ... Display apparatus 300 ... High speed camera as an imaging device 400 ... Recording / reproduction apparatus as a data processing apparatus 411 ... MPEG video decoder as decoding means constituting a reproduction control apparatus 420 ... Video memory as frame image storage means 440 ... MPEG video encoder 451 as video data generation means 451 HD as video data storage means
452 ... Stream storage processing means as video storage processing means 460 ... Allocation means that also functions as extraction means constituting the playback control apparatus 470 ... Video memory controller 523 that also functions as frame image storage processing means constituting the playback control apparatus ... Remaining number judgment means constituting the playback control device 524. Search speed resetting means as playback speed resetting means constituting the playback control device 525... Playback control means constituting the playback control device 600... Encoding as video data Stream 610 ... Closed GOP as a frame group
620 ... Encoded image data 650 ... Frame image data

Claims (12)

A playback control device that controls playback of a predetermined video on a display device capable of displaying the frame image at a predetermined frame rate based on video data for displaying the predetermined frame image,
The video data includes a plurality of frame image groups having a series of data string structures in which encoded image data obtained by encoding frame image data for displaying the frame image is associated in display order,
The encoded image data is encoded so as to be decodable without referring to the encoded image data of the frame image group not having the encoded image data,
Extracting means for acquiring the video data and extracting a plurality of the frame image groups;
A plurality of decoding means provided in parallel for decoding the encoded image data of the frame image group and outputting the frame image data;
Allocating means for allocating the plurality of frame image groups extracted by the extracting means to the plurality of decoding means;
Frame image storage processing means for storing the frame image data output from the decoding means in a frame image storage means;
Based on the input operation, the frame image data whose display order is every predetermined interval is sequentially acquired from the frame image storage means and displayed on the display device at the frame rate to reproduce the video at the first playback speed. Or control for sequentially acquiring the frame image data in the display order, displaying the frame image data at the frame rate, and playing back a video with a second playback speed slower than the first playback speed. Control means;
A reproduction control apparatus comprising: The playback control device according to claim 1,
The plurality of frame image groups have an equal number of the frame image data. The reproduction control device according to claim 1 or 2,
The reproduction control apparatus, wherein the encoded image data is encoded based on a MPEG (Motion Picture Experts Group) standard. A reproduction control device according to any one of claims 1 to 3,
The frame image data is for displaying a frame image photographed by a photographing device capable of photographing at a photographing speed faster than the frame rate,
The reproduction control unit reproduces an image in which a predetermined object photographed by the photographing apparatus moves at a speed substantially equal to an actual moving speed as an image at the first reproduction speed, and the predetermined object is actually A video that moves at a speed obtained by multiplying the moving speed by the magnification of the frame rate with respect to the shooting speed is played back as a video at the second playback speed, and the display order is the first playback speed based on an input operation. Recognizing that the frame image data at intervals larger than the time of playback at the time is sequentially acquired, displayed at the frame rate, and the video is played at a third playback speed higher than the first playback speed. Then, playback of the video at the third playback speed is started,
The magnification of the photographing speed of the photographing device with respect to the frame rate is N,
A ratio of the third playback speed to the first playback speed is V,
A ratio of the decoding speed of the decoding means to the frame rate is P,
As
W ≧ N × V / P (1) provided with the number W of decoding means obtained by the following equation (1)
A reproduction control apparatus characterized by that. The playback control device according to claim 4,
The number of encoded image data included in the frame image group is H,
As
The display order is higher than the frame image that is stored in the frame image data storage means and is displayed at the time of playback at the third playback speed in either the forward direction or the reverse direction of the display order. A remaining number judging means for judging whether or not the number U of the frame image data of the frame image in any one direction side satisfies the following expression (2):
U / N <H × V / P (2)
When the playback at the third playback speed is started, the frame image storage processing unit converts the frame image data of the frame image being displayed at the time of playback at the third playback speed into the frame image storage unit. The frame image data is deleted and the new frame image data is stored in a state in which the display order is substantially in the middle of the frame image data.
The reproduction control device, wherein the reproduction control means ends reproduction at the third reproduction speed when the remaining number judging means judges that the expression (2) is not satisfied. The playback control device according to claim 5,
A reproduction speed resetting means for setting a fourth reproduction speed at which a magnification with respect to the first reproduction speed is a magnification X determined by the following equation (3);
X ≦ U × P / (H × N) (3)
When the reproduction control means finishes reproduction at the third reproduction speed, the reproduction control means starts reproduction in the one direction at the fourth reproduction speed set by the reproduction speed resetting means. A reproduction control device characterized by the above. A reproduction control device according to any one of claims 1 to 6,
Video data generating means for acquiring the frame image data and generating the video data;
Video storage processing means for storing the video data generated by the video data generation means in video data storage means;
Comprising
The data processing apparatus characterized in that the extraction means acquires the video data from the video data storage means. A reproduction control device according to any one of claims 4 to 6,
Video data generating means provided so as to be connectable to a shooting device capable of shooting at a shooting speed faster than the frame rate, and acquiring the frame image data of the frame image shot by the shooting device and generating the video data When,
Video storage processing means for storing the video data generated by the video data generation means in video data storage means;
Comprising
The data processing apparatus characterized in that the extraction means acquires the video data from the video data storage means. A reproduction control method for performing control to reproduce a predetermined video on a display device capable of displaying the frame image at a predetermined frame rate based on video data for displaying the predetermined frame image by an arithmetic means,
The video data includes a plurality of frame image groups having a series of data string structures in which encoded image data obtained by encoding frame image data for displaying the frame image is associated in display order,
The encoded image data is encoded so as to be decodable without referring to the encoded image data of the frame image group not having the encoded image data,
A plurality of decoding means for decoding the encoded image data of the frame image group and outputting the frame image data are provided in parallel.
Obtaining the video data, extracting a plurality of the frame image groups,
Assigning the extracted plurality of frame image groups to the plurality of decoding means;
Storing the frame image data output from the decoding means in a frame image storage means;
Based on the input operation, the frame image data whose display order is every predetermined interval is sequentially acquired from the frame image storage means and displayed on the display device at the frame rate to reproduce the video at the first playback speed. Or control to sequentially acquire the frame image data in the display order, display the frame image data at the frame rate, and reproduce a video having a second reproduction speed lower than the first reproduction speed. A reproduction control method characterized by the above. A reproduction control program for causing a calculation means to function as the reproduction control device according to any one of claims 1 to 6. A reproduction control program for causing a calculation means to execute the reproduction control method according to claim 9. 12. A recording medium on which a reproduction control program according to claim 10 or 11 is recorded so as to be readable by an arithmetic means.

Images