JP2002354406A - Dynamic image reproducing equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide dynamic image reproducing equipment which performs automatic reproduction in which an intention of a user is reflected. SOLUTION: This dynamic image reproducing equipment is provided with a dynamic image accommodating means in which a dynamic image to which a frame number is imparted previously is accommodated, an operation input means to which operation data of designation of the dynamic image and reproduction command of the dynamic picture image are inputted, and a dynamic image reproducing means which captures a designated dynamic image from the dynamic image accommodating means and reproduces the image on the basis of the inputted operation data. The dynamic image reproducing equipment is also provided with an operation history information producing means which produces operation history information by making correspondence between the operation data inputted during regeneration of the designated dynamic image, and a frame number of the dynamic image when the operation data are inputted, an operation history information accommodating means in which the produced operation history information is accommodated, and an operation history executing means which retrieves operation history information of the designated dynamic image, executes the operation data corresponding to the frame number, in accordance with historical order of the operation history information when the operation history information is detected, and reproduces the dynamic picture image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a moving picture reproducing apparatus for reproducing a moving picture.

[0002]

2. Description of the Related Art In a method of reproducing a moving image in a moving image digital recording / reproducing system, in addition to functions such as normal reproduction and fast forward, a representative image at the time of a scene change is displayed as a thumbnail and viewed from the thumbnail. There is an apparatus which selects and reproduces a desired moving image. As the scene detection method, for example, a luminance change, a movement vector amount (motion compensation), and an audio change (switching between monaural and stereo, a volume change, no sound detection, etc.) are used, and the scene change is mechanically detected. I have.

FIG. 7 shows the configuration of a conventional moving picture reproducing apparatus. The moving image recording / reproducing system 11 includes a moving image input device 12 and a moving image reproducing device 1. Video input device 12
Comprises an input operation unit 15, a moving image input unit 13, a thumbnail processing unit 16, and an encoding unit 14.

An input operation unit 15 detects a recording instruction of a moving image by a user and controls recording. Video input unit 13
Sends the moving image signal input from the tuner or the camera to the encoding unit 14 while storing the moving image signal in the frame memory. The thumbnail processing unit 16 detects a scene change based on the moving image signal temporarily stored in the frame memory, determines a frame to be a thumbnail, and sends the frame to the encoding unit 14.

[0005] The encoder 14 converts the moving image signal into an MPEG2 signal.
And compression coding using such a coding method as described above to convert the data into moving image data. The frame to be thumbnailed is reduced in size and compression-encoded. The video playback device 1 includes a video data storage unit 4, a playback operation unit 9, a decoding unit 3, and a display unit 2.

[0006] The moving image data storage unit 4 stores encoded moving image data. The decoding unit 3 decodes the video data output from the video data storage unit 4 and outputs the video data to the display unit 2. The display unit 2 displays the data from the decoding unit 3. The reproduction operation unit 9 detects a user's thumbnail display instruction and a moving image reproduction instruction, and outputs the moving image data storage unit 4.
, And sends the thumbnail data and the moving image data to the decoding unit 3.

The processing flow of the video recording / playback system will be described. When a moving image is input from a tuner or a camera, the moving image input unit 13 sends the moving image signal to the encoding unit 14 and stores it in the frame memory. The stored video signal is detected by the thumbnail processing unit 16 in a frame immediately after a scene change occurs. Then, the video signal of the frame is sent to the encoding unit 14.

[0008] The moving image data encoded by the encoding unit 14 is sent to and stored in the moving image data storage unit 4. Next, when the reproduction operation unit 9 detects the selection of the moving image data and the thumbnail display instruction by the user, the reproduction operation unit 9 reads the thumbnail data from the moving image data storage unit 4 and sends the thumbnail data to the decoding unit 3. The decoding unit 3 decodes the received thumbnail data and displays it on the display unit 2. When the user selects a desired content from the displayed plurality of thumbnail data, the reproduction operation unit 9 detects the instruction, retrieves the instruction from the moving image data storage unit 4, and sends it to the decoding unit 3. The moving image data is decoded and displayed.

[0009]

However, for a user who plays back and views a moving image, the portion to be fast forwarded and the portion to be divided into scenes and displayed as thumbnails differ from individual to individual. Therefore, when a scene change is mechanically detected and thumbnail display is performed, the thumbnails are displayed in such a way that the thumbnails are too finely divided. Therefore, for the user, the work of confirming where the image to be viewed is and where to fast-forward is located Was difficult.

[0010] The present invention has been made in view of the above points, and is a moving image reproducing apparatus that performs reproduction reflecting the intention of a user.

[0011]

A moving image storing means for storing a moving image to which a frame number is previously assigned, an operation input means for inputting operation data for designating a moving image and for instructing reproduction of a moving image, A moving image reproducing unit that obtains the moving image obtained from the moving image storage unit and reproduces the moving image according to the input operation data. An operation history information generation unit that generates operation history information in association with a frame number of a moving image when operation data is input, an operation history information storage unit that stores the generated operation history information,
Operation history execution means for executing operation data corresponding to a frame number and reproducing a moving image according to a history order of the operation history information when the operation history information of the designated moving image is searched, and when the operation history information is detected, It is a configuration provided.

With this configuration, for example, during playback of a recorded moving image, the fast-forward key is pressed to skip a commercial, and when the commercial ends, the play key is pressed, and the history of operation data corresponds to the frame number. In addition, it is generated and registered as operation history information. After that, when playing back the moving image, the operation history is called from the operation history information and the same operation is automatically executed, so the user can see only the moving image that he wants to view without troublesome operation Becomes

[0013] Further, first frame acquisition means for acquiring a frame of a moving image and a plurality of frames before and after the moving image frame when operation data is input during reproduction of a specified moving image, and a plurality of frames adjacent to the acquired plurality of frames. A first frame number obtaining means for extracting a frame whose change amount of a predetermined characteristic between frames is equal to or more than a predetermined threshold value and obtaining the frame number, and a characteristic comprising a predetermined characteristic and a change amount in the obtained frame number; And a first characteristic operation history information generating means for generating operation history information by associating the data with the operation data.

In order to acquire the characteristic data and create the operation history information with this configuration, a frame at the time of mode change (for example, a switching frame at the time of changing from the playback mode to the fast-forward mode) during reproduction of a moving image. ) Can be detected. For example, if the fast-forward key is pressed when a commercial starts, a part of the commercial part is played back, but the first frame number acquisition means detects a switching frame to the commercial, so that the first frame number is obtained. The display of extra moving images is reduced.

A first characteristic operation history information acquiring means for acquiring designated operation history information, and extracting a frame having the same frame number as that of the acquired operation history information from a designated moving image. A second frame acquisition unit for acquiring the extracted frame and a plurality of frames before and after the extracted frame; a change amount of a predetermined characteristic between adjacent frames of the acquired plurality of frames; and characteristic data acquired from the operation history information. The second frame number obtaining means for obtaining the frame number of the smallest frame whose difference from the change amount is equal to or less than the threshold value, and the obtained frame number and the characteristic data are obtained by the first characteristic operation history information obtaining means. A second characteristic operation history information generating means for generating operation history information in association with the operation data of the operation history information.

[0016] With this configuration, the operation history information of a moving image for which characteristic data has been acquired is added to another moving image for which the same operation is to be performed automatically (for example, a current affair news / commercial / sports news / It is possible to automatically generate operation history information of a news program whose content to be broadcast such as a weather forecast is determined in chronological order. As a result, once the operation history information is created for the base moving image, it is not necessary to create an operation table for each of the other similar moving images while reproducing and pressing the operation key. Automatic reproduction reflecting the intention of the user can be easily performed.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a configuration diagram of a moving picture reproducing apparatus according to an embodiment. The moving image recording / reproducing system 11 includes a moving image reproducing device 1 and a moving image input device 12 for inputting a moving image signal from a television, a camera, or the like. The moving image input device 12 includes a moving image input unit 13, an encoding unit 14, an input operation unit 15, and a thumbnail processing unit 16. The operation of each unit is as follows.
Same as the prior art.

The moving image reproducing apparatus 1 includes a display unit 2 for displaying reproduced moving images and the like, a decoding unit 3 for reproducing moving image data, moving image data received from the encoding unit 14, and a stored moving image. Moving image data storage unit 4 for storing and holding a list including names of the same, an operation table generating unit 5 for creating a moving image operation table from the moving image data, and an operation table storage unit 6 for storing and holding the operation table and the table list A playback control unit 7 for detecting a user's operation instruction or an operation history of an operation table and performing playback control, and an operation input unit for inputting operation data such as a designation of a moving image by a user and a playback key and a fast-forward key. 8.

A moving image signal is converted from a television or the like into moving image data through a moving image input device 12 by a user's recording operation, and a list including the converted moving image data and names of moving images is stored in a moving image data storage unit. 4 in advance. FIG. 2 shows a flowchart of the processing of the moving image reproducing apparatus. First, the selection of the reproduction mode or the operation table generation processing displayed by the reproduction control unit 7 is detected (Step S1). Next, in the case of the table generation process, the selection of the operation mode between the basic generation process and the application generation process by the user is detected (step S2). At the time of the basic generation processing, when the operation input unit 8 detects the user's designation, the reproduction control unit 7 reads out the list of the moving image data stored in the moving image data storage unit 4 and causes the display unit 2 to display the list. Next, the user specifies a moving image from the list. The user also specifies whether to acquire characteristic data relating to the amount of change between frames (step S3).

Next, an operation table generation process for the moving image A when the moving image A is designated is performed (Step S4). FIG. 3 illustrates an operation table generation process. FIG. 4 shows a flowchart of the operation table generation processing for the moving image A. First, when a reproduction key is detected, reproduction of a moving image is started (FIG. 4).
S11 step).

Next, since the moving image is reproduced and displayed, the user waits for the operation key to be pressed, and when the operation key is detected, the content is determined (step S12). If the key is a fast-forward key, the frame when the fast-forward key is detected (eg, frame 10 in FIG. 3)
0) to determine whether or not it is necessary to acquire characteristic data (S13).
Steps). If the characteristic data is not acquired, the process goes to step S15, and the fast forward operation key is registered in association with the frame number of the acquired frame.

When acquiring the characteristic data, a plurality of predetermined frames before and after the frame at the time of detecting the fast-forward key are taken out. Then, the amount of change between the frames is obtained, and a frame having a maximum change amount that is equal to or larger than a predetermined threshold value (for example, the frame 95 in FIG. 3) is determined as a frame for table registration. If the inter-frame change amount equal to or larger than the predetermined threshold value cannot be detected, the frame at the time of detecting the fast-forward key (frame 100 in FIG. 3) is determined as a table registration frame, and the frame change amount column is blank ( S1
4 steps).

An existing technique is used as a method of detecting the amount of change between frames. For example, a method of acquiring a luminance difference between adjacent frames on a YUV color space (Y is a luminance signal, UV is a color difference signal) is used. In addition to the luminance, it can be used in combination with other characteristics such as a change in volume.
Next, the contents of the operation command of the fast-forward key and the characteristic data and the acquired change amount (for example, the change amount m of the luminance) are associated with the frame number of the determined frame (frame 95 in FIG. 3) in the operation table A ( 3 (operation table of FIG. 3) (step S15).

Next, the reproduction key is waited for (step S16). When the reproduction key is input, the table generation processing (S16) is performed.
(Steps 14 and S15). That is, the frame at the time of detecting the reproduction key (frame 15 in FIG. 3)
0), and a predetermined plurality of frames before and after that are obtained. Then, a change amount between the frames is obtained, and a frame having a maximum change amount that is equal to or larger than a predetermined threshold (frame 140 in FIG. 3) is determined as a table generation frame. Then, the operation command of the reproduction key and the content of the characteristic data and the change amount thereof (for example, the change amount n of the luminance) are registered in the operation table A in association with the frame number. When the inter-frame change amount equal to or larger than the predetermined threshold value cannot be detected, the frame at the time of detecting the reproduction key (the frame 150 in FIG. 3) is determined as the table generation frame, and the frame change amount column is set to blank, and the operation table is set to blank. A is associated with the operation command and registered (step S17).

Next, if the stop key is pressed in the state of waiting for the fast-forward key, it is determined that the reproduction has been completed, and the frame number (frame 300 in FIG. 3) at the time of key detection is obtained (step S18). Next, the operation command of the stop key is registered in the operation table A in association with the frame number (step S19). Thus, the creation of the operation table A for the reproduced moving image is completed.

Next, an example of generating an operation table B for a moving image B of a television program having the same configuration as that of the moving image A (for example, a moving image of another day such as a news program broadcast every day at the same time zone) will be described. . First, when the application generation processing mode is detected by detecting the operation mode setting in step S2 of FIG. 2, the reproduction control unit 7 is stored in the moving image data storage unit 4 by the user's designation using the operation input unit 8. The operation table list is read out from the moving image data list and the operation table storage unit 6 and displayed. Then, the moving image B and the operation table A are designated by the user (Step S5).

Next, when the moving image B is designated, an operation table generating process for the moving image B is performed (Step S6). FIG. 5 shows a flowchart of the operation table generation processing for the moving image B.
Next, operation commands are sequentially searched from the operation table storage unit 6 from the top of the frame number of the operation table A (FIG. 5).
S21 step).

When an operation command is detected, the type of the operation command is determined (step S22). When a fast-forward command is detected, characteristic data of the command is read, and a frame of the moving image B corresponding to the frame number at which the fast-forward command is detected is searched in the moving image data storage unit 4. Then, a plurality of predetermined frames before and after the detected frame are read from the moving image data storage unit 4. Then, an amount of change is obtained for the same characteristic as the characteristic data of the operation table A between the frames, and a frame having a minimum difference from the amount of change m of the operation data A and equal to or less than a predetermined threshold (frame 110 in FIG. 3) Is determined (S
23 steps). If it cannot be determined or if the characteristic data of the operation table A is blank, the frame number of the operation data A (frame 95 in FIG. 3) is assigned.

A fast-forward command is registered in the operation table B in association with the determined frame number of the frame (step S24). Next, the search of the operation table A is continued, and when a reproduction command is detected (S25 step), a table generation process (the frame 160 in FIG. 3 is registered by the same process as the steps S23 and S24) is performed (S26). Steps). If it cannot be determined or if the characteristic data of the operation table A is blank, the operation data A
(Frame 140 in FIG. 3).

Next, the search for operation commands is further continued, and if a stop command is detected, the end of processing is regarded as the end of the processing, and the stop command is registered in the operation table B in association with the frame number (frame 300 in FIG. 3). (Step S27). Thereby, the operation table B can be generated for the moving image B. Next, when the reproduction processing of the moving image is selected in step S1 of FIG. 2, first, the moving image to be reproduced is specified from the moving image list by the user (step S7). When the moving image B is specified, the reproducing process is performed on the moving image (Step S8).

FIG. 6 shows a flowchart of the reproduction processing of the moving image B. First, when a reproduction key is detected (step S31),
The reproduction is started and read out from the moving image data storage unit for each frame and displayed (step S32). Then, the presence / absence of an operation command is checked for the frame number corresponding to the read frame from the operation table B (S
33 steps).

An operation command is detected, and its type is determined (step S34). In the case of the fast-forward command, the reproduction command is searched by sequentially searching the frame numbers of the operation table B. When the reproduction command is detected, the fast-forward is stopped and the mode is set to the reproduction mode (S35 step). Next, while reading the frame is continued, the search for the operation command in the operation table B is continued for the frame number of the read frame.

When the stop command is detected, the reading of the frame from the moving image data storage is stopped, and the process is terminated. When the same moving image A is reproduced on the operation table A, the same operation can be performed in accordance with the processing flow of FIG.
Although not shown, when the operation table is not used, normal reproduction processing is performed.

By performing the above operation, the operation performed once during the reproduction is stored, so that when the same moving image is viewed many times, the operation is automatically executed. Eliminates the need. In addition, by setting another moving image, it is possible to automatically perform reproduction according to a user's request when reproducing the same program, such as fast-forwarding a CM or the like entering the same time. Become.

It is also possible for the user to have a function of editing the operation table. For example, an ON / OFF function can be provided, or a new operation command or the like can be directly reflected in the setting in order to reflect only an arbitrary operation command among the operation commands set in the operation table A at the time of moving image reproduction. Also, thumbnail display can be performed in response to an operation command. For example, before automatically reproducing the moving image B, a frame corresponding to the operation command is displayed as a thumbnail, and it is possible to select and reproduce a plurality of moving images to be viewed.

When the time from the operation to the release of the operation in the operation data is short, the processing can be invalidated as an erroneous operation. For example, the operation input unit 8
In this method, even if a reproduction key operation is performed several seconds after the start of fast-forwarding, the processing is invalidated as meaningless processing and fast-forwarding is continued. Also, after reproducing a part of the moving image data and creating a part of the operation table, the remaining part of the moving image data is searched for a frame having the same characteristic data of the inter-frame variation, and By assigning operation commands, the entire operation table can be completed. As a result, in the case of repeating scenes having the same characteristics, such as when you want to fast-forward a commercial,
By reproducing a part of the moving image, the operation table for the entire moving image can be completed, and thus the operation table can be easily created.

[0037]

According to the present invention, when the same moving image or another moving image is reproduced by operating the portion to be fast-forwarded by itself and reproducing once, it is possible to automatically perform reproduction according to the user's preference. It becomes possible and operability is improved.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a moving image reproducing apparatus according to an embodiment.

FIG. 2 is a flowchart of processing of a moving image reproducing apparatus according to an embodiment;

FIG. 3 is an explanatory diagram of an operation table generation process according to the embodiment;

FIG. 4 is a flowchart of an operation table generation process for a moving image A according to the embodiment;

FIG. 5 is a flowchart of an operation table generation process for a moving image B according to the embodiment;

FIG. 6 is a flowchart of a moving image B reproducing process according to the embodiment;

FIG. 7 is a configuration diagram of a conventional moving picture recording / playback apparatus.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 moving image reproducing device 2 display unit 3 decoding unit 4 moving image data storage unit 5 operation table generation unit 6 operation table storage unit 7 reproduction control unit 8 operation input unit 9 reproduction operation unit 11 moving image recording / reproduction system 12 moving image input Device 13 Video input unit 14 Encoding unit 15 Input operation unit 16 Thumbnail processing unit

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C052 AB03 AB04 AC08 CC11 DD04 5C053 FA14 FA30 GA11 GB09 GB38 HA30 JA21 JA22 KA01 KA04 KA24 LA06 5D044 DE17 DE37 EF05 FG18

Claims (3)

[Claims] 1. A moving image storing means for storing a moving image to which a frame number is assigned in advance, an operation inputting means for inputting operation data for designating a moving image and for instructing reproduction of a moving image, A moving image reproducing device having a moving image reproducing unit that obtains from the moving image storing unit and reproduces the operation data according to the input operation data, wherein the operation data input during reproduction of the specified moving image is
Operation history information generation means for generating operation history information in association with a frame number of a moving image at the time of input of operation data; operation history information storage means for storing the generated operation history information; Operation history information searching means for executing operation data corresponding to a frame number and reproducing a moving image in accordance with a history order of the operation history information when the operation history information is detected. A moving image reproducing apparatus characterized by the following. 2. A first frame acquiring means for acquiring a frame of a moving image and a plurality of frames before and after the moving image when operation data is input during reproduction of a specified moving image, and adjacent to the acquired plurality of frames. First frame number acquiring means for extracting a frame having a maximum amount of change in predetermined characteristics between frames equal to or greater than a predetermined threshold and obtaining the frame number; and a characteristic comprising a predetermined characteristic and a change amount in the obtained frame number. 2. The moving image reproducing apparatus according to claim 1, further comprising: first characteristic operation history information generating means for generating operation history information by associating data with operation data. 3. A first characteristic operation history information acquiring means for acquiring designated operation history information, and extracting a frame having the same frame number as that of the acquired operation history information from a designated moving image. A second frame acquisition unit that acquires the extracted frame and a plurality of frames before and after the extracted frame; a change amount of a predetermined characteristic between adjacent frames of the acquired plurality of frames; and characteristic data acquired from the operation history information. A second frame number acquisition unit for acquiring a frame number of a frame whose difference from the change amount is equal to or less than a threshold value and a minimum frame, and an acquired frame number and characteristic data acquired by a first characteristic operation history information acquisition unit. 3. The apparatus according to claim 2, further comprising second characteristic operation history information generating means for generating operation history information in association with the operation data of the operation history information. Moving image reproduction apparatus.