JP2006279267A - Moving video division and display device, and operation method of the display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To aim harmony of glance nature, recognition, and operation nature in user interface display, and search a frame including a necessary scene, using a simple operation, when a user opens a moving video file, and searches a desired frame during reproducing and browsing the moving video. <P>SOLUTION: The moving video is divided into a predetermined time interval, frames of each time interval are taken out as still image data, and a plurality of thumbnails are generated. One of the plurality of thumbnails is made as a main thumbnail of a large size which is displayed in a display window 2a, and other thumbnails are displayed in display windows 2 which are continuously arranged from an upper part, and a lower part to a slanting upward part, and a slanting downward part, time interval between the thumbnails is changed by the operation of a left and right direction indicating key, and a plurality of thumbnails jump by the operation of an upper and lower direction indication key. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving image division display device and a method for operating the display device. More specifically, the moving image data is divided at predetermined time intervals, and the first frame for each time interval is extracted as still image data in time series. The present invention relates to a moving image divided display device that is easy to grasp the entire contents of moving image data and that has good operability by generating and displaying a plurality of thumbnails, and an operation method of the display device.

  In recent information processing apparatuses such as personal computers, PDAs, mobile phones, and game machines, moving images are often handled in addition to still images. In such an information processing apparatus, when video editing or video playback is performed, in order to quickly select video data desired by the user from video data having a large amount of data, the content of the video data as a whole is selected. It is necessary to display quickly with a simple content display.

  In a conventional information processing apparatus, when searching for a frame including a desired scene from a large amount of moving image data using a user interface display screen, a moving image file is opened and browsed, or fast forward, rewind, and slow playback are performed. While doing, the method of arriving at the required frame was taken.

  In addition, an index image called a chapter list is displayed on the image monitor, and the selected still image or movie is enlarged on the image monitor by selecting a still image or movie to be enlarged and reproduced from the index image and pressing the execution button. I was trying to display it.

  Further, a desired still image or moving image is displayed on the image monitor by operating the frame advance button or the frame return button without using the index image. When a movie (the first frame of a movie) is selected by the frame advance button or the frame return button, all the frames of the selected movie file are played back as movies by pressing the execute button. It was.

  Under such circumstances, many attempts have been made to develop a user interface display with good operability. As one of them, Patent Document 1 discloses a reduction for easily displaying the contents of moving image data. A method for creating a thumbnail that is an image and a method for displaying the thumbnail are disclosed, and in order to express the contents of the moving image data quickly and concisely, one frame in the moving image data is taken out as still image data to be a thumbnail, and the moving image data Multiple thumbnails can be created, and if thumbnails created in this way are displayed, the contents of multiple video data can be displayed simultaneously in frame-by-frame display. It is possible to easily select one of the following.

Further, Patent Document 2 discloses an image playback device that enables display so that the entire content of a moving image can be grasped when the moving image is displayed during frame advance or index playback. , A 4-screen multi-image is composed of the first frame image of the shooting, the middle two frame images, and the last frame image of all the frames that make up the movie. By displaying like this, it is possible to determine whether or not the video is desired to be played back before starting the playback of the video.
JP-A-11-284948 JP 2001-197447 A

  However, in the conventional apparatus, it is necessary to browse a large amount of unnecessary data until a desired frame is found from a large amount of moving image data, which requires a great deal of time and effort for the user. In addition, it is necessary to use many assigned keys such as fast forward, rewind, and slow playback, and it is difficult to search for necessary frames in a short time with a simple operation.

  Further, in an apparatus that displays a plurality of index images composed of thumbnail images, which is called a chapter list, the images are “field-shaped” or displayed in a horizontal row, and the list property and the recognizability are not compatible. That is, if a thumbnail image is displayed in a large size in order to improve recognizability, the number of images that can be displayed is reduced and the listability is lacking. If the number of displays is increased to improve the listability, the individual becomes smaller and the recognizability decreases. In addition, in order to arrive at the target thumbnail image, the up / down / left / right operation must be performed, which is complicated.

  Therefore, when searching for a desired frame while opening a moving image file and reproducing and browsing the moving image, the present invention achieves harmony of listability, recognizability, and operability in the user interface display, and includes necessary scenes. It is an object of the present invention to provide a moving image split display device and method capable of searching for a frame by a simple and easy-to-understand operation.

  In addition, it is possible to easily change the time interval (time increment) between the screens to be played back in the user interface display, and it is displayed as if the video is zoomed in / out in time, It is an object of the present invention to provide a moving image split display device and method that enable a moving image viewing mode that is clearly different from the moving image viewing mode such as fast-forwarding.

  In addition, video such as direct in, scene cut, chapter editing, etc. that can be directly reproduced from a desired scene by a method such as time designation without scene search such as AB repeat and fast forward which could not be easily performed in the conventional user interface display It is an object of the present invention to provide a moving image division display device and method capable of easily performing an editing operation and a moving image reproduction operation.

  The first technical means divides the moving image data at predetermined time intervals, takes out the first frame for each time interval as still image data, generates a plurality of thumbnails, and displays the plurality of thumbnails on a plurality of display screens. In the video split display device for displaying on a window, one of the plurality of thumbnails is displayed as a large thumbnail on the main display window in the screen, and the other thumbnails are arranged in a horizontal or inclined direction from the main display window. The display window is displayed as a small thumbnail, the time interval is changed by a left-right operation, and the plurality of thumbnails are moved between the plurality of display windows by a vertical operation.

  According to a second technical means, in the moving image split display device of the first technical means, the plurality of display windows are arranged in a generally square or substantially C shape with the main display window as a bent portion, A plurality of thumbnails are arranged in time series.

  According to a third technical means, in the video split display device according to the first technical means, the plurality of display windows are arranged in a stepwise manner with the main display window as a central portion in the left-right direction, and the plurality of thumbnails are sometimes displayed. It is characterized by being arranged in series.

  According to a fourth technical means, in the video split display device according to the first technical means, the plurality of display windows are arranged diagonally as a whole with the main display window being a central portion in the left-right direction, and the plurality of thumbnails are It is characterized by being arranged in series.

  According to a fifth technical means, in the moving image split display device according to any one of the first to fourth technical means, a time interval between the adjacent thumbnails is uniform.

  According to a sixth technical means, in the video divided display device according to any one of the first to fourth technical means, each time interval between the adjacent thumbnails can be arbitrarily set.

  According to a seventh technical means, in the video divided display device according to any one of the first to sixth technical means, the predetermined operation in the left-right direction is an operation of a left-right direction indicating device.

  According to an eighth technical means, in the moving image split display device according to any one of the first to sixth technical means, the predetermined operation in the vertical direction is an operation of the vertical direction indicating device.

  According to a ninth technical means, in the video divided display device according to any one of the first to eighth technical means, the position and ratio of the plurality of thumbnails displayed on the screen are relative to the whole video. And a gauge indicating the position of the main thumbnail in the entire moving image is displayed.

  The tenth technical means is characterized in that, in the moving picture split display device of any one of the first to eighth technical means, the moving picture data after the main thumbnail is reproduced in full screen by a predetermined operation.

  The eleventh technical means is characterized in that, in the video divided display device of any one of the first to eighth technical means, the video data after the main thumbnail is reproduced by a predetermined operation.

  The twelfth technical means divides the moving image data at a predetermined time interval, takes out the first frame at each time interval as still image data, generates a plurality of thumbnails, and selects one of the plurality of thumbnails. Is displayed as a large main thumbnail on the main display window, and other thumbnails are displayed on a plurality of display windows arranged in a horizontal or inclined direction from the upper and lower portions of the main display window. The method of operating a video split display device, wherein a time interval between the thumbnails is changed by a left / right direction instruction operation, and the plurality of thumbnails are moved between the plurality of display windows by an up / down direction instruction operation. And

  According to the present invention, a plurality of thumbnails obtained by dividing moving image data at predetermined time intervals and taking out the first frame for each time interval as still image data are displayed as large thumbnails on the main display window in the screen. The other thumbnails are displayed as small thumbnails in a display window arranged in a horizontal or inclined direction from the main display window, the time interval is changed by a predetermined operation in the horizontal direction, Since the plurality of thumbnails are moved between the plurality of display windows by an operation, the contents of a large amount of image data included in the moving image data are harmonized with the listability and the recognizability, and are displayed on the screen. It becomes possible to grasp in detail and easily by the thumbnail of the size.

  In addition, the plurality of display windows are arranged in a substantially square shape, a substantially C shape, a staircase shape, or a diagonal shape as a whole, a plurality of thumbnails are displayed in time series, and the time interval is set by operating the left / right direction key. Since the plurality of thumbnails are moved and jumped by changing or operating the up / down direction key or the like, the screen configuration makes it easy to imagine the operation when operating the display device, and during movie playback and movie editing work Sometimes it is possible to easily search for a desired frame.

  In addition, the time intervals between the thumbnails (time increments) are displayed in a uniform time sequence and the index list display where the time intervals between thumbnails can be arbitrarily set by the user. This makes it possible to easily search for a desired scene by changing the time interval as necessary during moving image playback or moving image editing.

  In addition, by changing the time interval between thumbnails in uniform time alignment display and index list display, it is possible to display the video as if it were zoomed in and out in time, and the conventional video It is possible to provide a viewing mode of moving image content different from the slow playback, fast forward playback, and the like performed in playback.

  In addition, moving image editing operations such as AB repeat, direct-in, scene cut, and chapter editing and moving image reproduction operations that could not be easily performed in the conventional user interface display can be easily performed.

When searching for a desired frame while opening a moving image file and reproducing and browsing the moving image, the present invention achieves harmony of listability, recognizability, and operability in the user interface display, and makes the desired frame simple and easy to understand. It is an object of the present invention to provide a moving image divided display device that can be searched by operation and an operation method of the display device. Therefore, moving image data is divided at predetermined time intervals, and the first frame for each time interval is set as still image data. And generating a plurality of thumbnails, and displaying the plurality of thumbnails in a list on a plurality of display windows in the screen, wherein each of the plurality of thumbnails has a large size on the main display window in the screen The other thumbnails are arranged continuously from the main display window in a horizontal or inclined direction. Display windows are displayed in time series as small thumbnails, the time interval is changed by a predetermined operation in the left-right direction, and the plurality of thumbnails are moved between the display windows by a predetermined operation in the up-down direction. Configured as follows.
Hereinafter, the moving image division display device and the operation method of the moving image division display device of the present invention will be described based on the embodiments shown in FIGS.

FIG. 1 is a diagram showing a moving image dividing display device according to the first embodiment. FIG. 1 (A) shows a moving image dividing display device by uniform time display, and FIG. 1 (B) is a moving image dividing display by index list display. Indicates the device.
The moving image dividing display device according to the first embodiment can be used as a display device for a user interface in any information processing device such as a personal computer (PC), a PDA, a mobile device, a car navigation system, a mobile phone, a game machine, and the like. As a means for storing and providing the information, not only a hard disk (HDD), a DVD, a CD, an SD / CF card, etc., any recording medium readable by a computer is used.

  In the moving image division display device of the first embodiment, the moving image display unit 1 is provided at the center of the screen. For example, the moving image display unit 1 divides moving image data recorded on the hard disk at predetermined time intervals. Are extracted in time series as still image data, and a plurality of thumbnails generated by reducing the size of each still image are displayed. The plurality of generated thumbnails are displayed in a plurality of display windows 2 arranged in a substantially square shape as a whole. The order of the arrangement of the thumbnails displayed in a substantially square shape is generally displayed in chronological order so as to form a new frame in the counterclockwise direction. It is not limited. Although it can be said that the larger the number of thumbnails displayed on one screen, the better from the viewpoint of the listability for grasping the whole image of the moving image, in the example shown in FIG. 1, nine thumbnails are displayed, depending on the screen size and resolution. An optimal number is set.

  As described above, the plurality of display windows 2 are generally arranged in a substantially square shape, and the display window located in the bent portion at the center left side of the screen is the main display window 2a which is a current display window and has a large size. The other display windows are arranged continuously from the upper right part of the main display window 2a in an obliquely upward direction and from the lower right part in an obliquely downward direction. Therefore, as shown in the figure, when nine thumbnails are displayed in the nine display windows 2, the thumbnail located at the center is displayed in the main display window 2a, and is displayed as a large thumbnail that is larger in size than the other thumbnails. The In the example of FIG. 1A, the main thumbnail is enlarged about three times both vertically and horizontally compared to other thumbnails, so that details can also be displayed in detail. A plurality of thumbnails other than the main thumbnail 2a are small thumbnails, but need not all have the same size. For example, several sizes may be used, or the size may be gradually changed toward the main thumbnail. Conceivable.

On the right side of the main thumbnail at the position of the main display window 2a, a detailed information display section 3 for displaying the name, information amount, creation date and time of the image file corresponding to the main thumbnail is displayed.
In addition, a gauge 4 is displayed at the right end of the moving image display unit 1, and the range of the plurality of currently displayed thumbnails is in what position and what proportion of the entire moving image data. The main thumbnail is displayed so that the position of the moving image data can be grasped.

  FIG. 1A shows an example in which a plurality of thumbnails are arranged in a uniform time array display, and the time intervals between the thumbnails are uniform. In the uniform time array display, as shown in the lower part of FIG. 1A, all moving image files are divided into equal intervals at a certain time (divided into 18 equal parts in FIG. 1A) as chapters. The first scene of each chapter is created as a thumbnail. Of these thumbnails, nine thumbnails that are continuous in time are selected and displayed as shown in the upper part of FIG. Further, a thumbnail located at the center of the nine thumbnails is displayed as a main thumbnail in the main display window 2a. The time scale at the bottom of the screen in FIG.

  In order to operate the display of thumbnails in the uniform time aligned display in FIG. 1A, an up / down direction instruction key, a left / right direction instruction key, or the like can be used. Scroll down or up to jump between windows. In addition, the time interval (time increment) between thumbnails can be changed by pressing the up / down direction key. Further, the main thumbnail can be displayed in full screen by pressing the enter key, and the image data after the main thumbnail can be reproduced as a moving image.

  FIG. 1B shows an example in which a plurality of thumbnails are displayed in an index list display, and the time interval between the thumbnails can be arbitrarily set by the user. The time scale below (B) in FIG. 1 indicates the positions (A), (B), (C),..., (L) of each index (the first scene of the chapter is a thumbnail) arbitrarily set in advance by the user. ). In the index list display, nine temporally continuous thumbnails are selected from these thumbnails and displayed as shown in FIG. A thumbnail located at the center of the nine thumbnails is displayed as a main thumbnail in the main display window 2a. The time scale at the bottom of the screen in FIG.

  In order to operate thumbnails in the index list display of FIG. 1B, for example, using the up / down direction key, the left / right direction key, etc., the entire thumbnail is moved downward or upward by pressing the up or down direction key. Scroll to jump between display windows. Also, the main thumbnail can be displayed in full screen by pressing the enter key, and the main thumbnail and subsequent can be reproduced as a moving image.

The time interval between thumbnails and the time increment will be further described.
FIG. 2 is a diagram for explaining a time interval between thumbnails in a uniform time aligned display, that is, a time step. Here, the entire reproduction time of the moving image data is 90 minutes, and nine thumbnails are displayed on the moving image display portion of the screen.
In the example of FIG. 2 (A), the time interval (time increment) between the thumbnails in the uniform time array display is 10 minutes, and is 0 to less than 10 minutes, less than 10 to 20 minutes,. Equally divided into 80 to 90 minutes, a frame located at 0 minutes, 10 minutes,..., 80 minutes is generated as a thumbnail, and a frame located at 40 minutes is processed into a large main thumbnail having a large size. It is displayed on the display window 2a. The time interval between the thumbnails is displayed on the gauge 4 as described above.

  In the example of FIG. 2B, the time interval is 5 minutes, and 0 to less than 5 minutes, less than 5 to 10 minutes, less than 10 to 15 minutes,..., 80 to less than 85 minutes, 85 The frame is equally divided into ~ 90 minutes, and the frames located at 20 minutes, 25 minutes, 30 minutes, ..., 55 minutes, 60 minutes are generated as thumbnails, and the thumbnails of the frames located at the center 40 minutes are the size A large main thumbnail is displayed in the main display window 2a.

  The example of FIG. 2C is the same, and the time interval is 2 minutes and 30 seconds, and the positions are 30 minutes 00 seconds, 32 minutes 30 seconds, 35 minutes 00 seconds, ..., 47 minutes 30 seconds, 50 minutes 00 seconds. Are generated as thumbnails, and a frame located at the center of 40 minutes is set as a large main thumbnail and displayed in the main main display window 2a.

  Similarly, as in the example of FIG. 2D, the time interval can be set to a 10-second interval, a 5-second interval, and a GOP interval in MPEG. The minimum time interval may be the interval between recorded frames as in the example of FIG.

An operation for selecting a thumbnail and changing the display in the divided video display apparatus according to the first embodiment and the display at that time will be described.
FIG. 3 is a diagram illustrating a state in which the uniform time display is changed by a key operation.
FIG. 3 (A) shows the moving image dividing display device by the uniform time arrangement display shown in FIG. 1 (A). Here, in the uniform time arrangement display, the left and right direction instruction operation is performed using the vertical and horizontal direction (four directions) instruction keys. , The time increment can be changed to a small value, and the display in FIG. 3A with the time increment of 5 minutes is set to 2 minutes 30 seconds as shown in FIG. 3B, and FIG. It is possible to display a new thumbnail located in the middle of each thumbnail displayed on the screen. Further, by performing the left direction instruction operation n times, the minimum time increment of 1/30 seconds can be obtained as shown in FIG. Further, by repeating the right direction instruction operation from the display of FIG. 3C, it is possible to return to a display with a large time increment as shown in FIGS. 3B and 3A.

  Next, in the uniform time aligned display of FIG. 3A, if an up / down direction instruction operation is performed, a plurality of thumbnails can be jumped, and any thumbnail can be moved to the main display window 2a and displayed in an enlarged manner. it can. That is, if the downward direction operation is performed in the display of FIG. 3A, the entire thumbnails jump so that they scroll in the counterclockwise direction, and instead of the 40-minute thumbnail image, The adjacent 35-minute thumbnail is newly moved to the position of the main display window as shown in FIG. Further, if a downward direction instruction operation is performed in the display of FIG. 3D, the 30-minute thumbnail is newly moved to the position of the main display window as shown in FIG. Also, by repeating the upward direction operation from the display of FIG. 3E, a plurality of thumbnails are turned clockwise to jump back to the original display as shown in FIGS. 3D and 3A. Can do. Further, in FIGS. 3A, 3B, 3D, and 3E, within a predetermined time interval determined by the left-right direction operation by a long press operation of the enter key, etc. It is also possible to display a desired scene on the main display window by playing back a moving image on the main display window or fast-forwarding / fast-rewinding by long-pressing the up / down direction key. In the index list display, the same display is performed by the same operation.

  Further, in the uniform time aligned display of FIG. 3A, full-screen playback or full-screen display can be performed from the scene of the main thumbnail as shown in FIG. 3F by operating the enter key. In order to return from the full-screen playback or full-screen display of FIG. 3F to the display of FIG. 3A, return to the menu screen and select the uniform time aligned display. In the index list display, the main thumbnail can be displayed in full screen by the same operation.

  As described above, according to the present invention, (1) the video can be divided and displayed by uniform time alignment display and index list display, and (2) the time interval or time interval between thumbnails is easily matched with the operation feeling. (3) The point that the scene jump can be easily performed by a simple operation that matches the operation feeling, and (4) the thumbnail displayed in the main display window. It is possible to easily perform full-screen playback with a simple operation, (5) playback, fast-forwarding, and rewinding in the main display window, and (6) display with thumbnails. The basic feature is that it is possible to search a place where a desired scene is expected while looking at the gauge.

Next, an operation for searching for a desired scene from a large number of scenes included in the moving image content in the information processing apparatus or the like will be described.
FIG. 4 is a diagram illustrating a state in which display is changed by a key operation when a desired scene is searched from a large number of scenes included in the moving image content.
FIG. 4A is a video content thumbnail screen in which icons of various titles (video content) are arranged in a horizontal row at the top of the screen, and the icon at the center position is so-called focused and the folder of the icon is displayed. Is selected. The video files belonging to the selected folder are arranged in parallel below the icon column, with multiple file names and related items arranged in parallel, and the central file name and related items are focused and the selected file is It has been revealed that. For the selected file and the previous and subsequent files adjacent to the selected file, thumbnails representing the contents are generated and displayed beside the file name and related items.

  In FIG. 4A, when the enter key is pressed, the selected thumbnail is displayed in full screen as shown in FIG. 4B, and the reproduction of the moving image data thereafter starts. When performing operations such as AB repeat, scene cut, and still image capture during playback, pressing the function key further displays the function menu as shown in FIG. Select a function and shift to the processing of I.

In FIG. 4A, when the function key is pressed, the function menu of FIG. 4D is displayed in an overlapping manner, and a necessary function can be selected by operating the up / down direction instruction key. When the button is selected, the screen shifts to the moving image division display screen shown in FIG. 4E. Here, the uniform time alignment display and the index list display can be switched appropriately and displayed. In FIG. 4 (E), the operation described with reference to FIG. 3 is performed, the thumbnail is jumped, the time increment is changed, the thumbnail is fast-forwarded / returned, the thumbnail of the desired scene is searched, and the thumbnail is selected as the main. A predetermined operation such as displaying on the display window and pressing the enter key may display the thumbnail in full screen as shown in FIG. 4F, or play back the moving image data from the thumbnail. it can.
Also, in FIG. 4C or 4D, if AB repeat, scene cut, still image capture, or the like is selected, the process proceeds to I and II.

Next, operations for performing AB repeat, scene cut, and still image capture operations using the moving image split display device shown in FIG. 1 will be described. This operation corresponds to the processes I and II shown in FIG.
Here, AB repeat means that points A and B are set in the entire scene and playback is repeated between points AB. Scene cut means that points A and B are set and A -It means cutting between points B, and still image capture means saving one scene of a moving image as a still image (capture of a scene).

FIG. 5 is a diagram illustrating a state in which display is changed by a key operation when setting points A and B when performing AB repeat and scene cut.
FIG. 5G shows an example of a uniform time display and an index list display in which the scenes following I and II in FIG. 4 are displayed and displayed in small time increments, and each shows a scene cut or AB repeat. Is instructed to set point A for Here, as shown in FIG. 5H, the thumbnail is jumped to rotate clockwise or counterclockwise by the up / down direction key operation, and the desired thumbnail is moved to the position of the main display window. By changing the time step by operating the instruction key, or by fast-forwarding / fast-rewinding by pressing and holding the up / down instruction key, etc., the desired scene is displayed on the main thumbnail, and the enter key is operated. Set point A as shown in 5 (I). Next, since it is instructed to set the point B as shown in FIG. 5 (J), the same operation as that for setting the point A in FIG. 5 (H) is performed again as shown in FIG. 5 (I). B point is set, the screen shifts to the full screen display of FIG. 5 (K), AB repeat is started, and AB is repeatedly reproduced. Alternatively, playback is performed from the scene after the scene cut.
In FIG. 5G, whether to display in a uniform time sequence or to display an index list is selected as appropriate depending on the application and function for performing image reproduction, but can be changed as appropriate.

FIG. 6 is a diagram illustrating a state in which a display is changed by a key operation when capturing a still image.
FIG. 6G shows an example of a uniform time display and an index list display in which the scenes following I and II in FIG. 4 are displayed and displayed in small time increments. You are instructed to select a scene.
In the display of FIG. 6 (G), by operating the up / down direction key, the thumbnail is jumped to turn clockwise or counterclockwise as shown in FIG. 6 (L), and the scene search is performed by changing the time increment. When the desired scene comes to the position of the main display window, it can be saved as a still image as shown in FIG. At this time, a display indicating that the image has been saved is displayed on the screen, and when a predetermined time has elapsed, full-screen reproduction is performed as shown in FIG.

A method for changing the time interval in the uniform time display will be described in detail.
FIG. 7 is a diagram showing, together with the time scale, how the display transitions by a key operation when changing the time interval in the uniform time array display. Here, the entire playback time of the moving image file is 90 minutes, and nine thumbnails are displayed on the moving image display portion of the screen. The time interval is changed from 10 minutes to 5 minutes in the first operation, and the next operation is performed. From 5 minutes to 1 minute, the value is changed to a predetermined value from 1 minute to 30 seconds by the third operation.
FIG. 7A shows a case in which the time interval between thumbnails is 10 minutes. As shown in the time scale shown on the left side of FIG. The frame is divided into nine equal areas of less than 10 to 20 minutes,..., 80 to 90 minutes, and a frame at a position of 0 minutes, 10 minutes,. Frames with these circles are displayed as a list as shown in the right figure of FIG. 7A, and a frame located 40 minutes of them is a large main thumbnail, and is displayed in the center of the main display window. Is done. The time interval between the frames can be displayed on the gauge 4 as described above, or can be displayed at an arbitrary position on the screen.

  FIG. 7B shows a case where the time interval between thumbnail images is 5 minutes, and all frames are from 0 to less than 5 minutes, from less than 5 to 10 minutes, from less than 10 to 15 minutes,..., From 80 to 85 minutes. Less than, 85-90 minutes equally divided, 20 frames, 25 minutes, 30 minutes, ..., 55 minutes, 60 minutes are formed in the thumbnail, and the frame located at the center of these 40 minutes Is a large main thumbnail and is displayed at the position of the main display window.

  FIG. 7C shows a case where the time interval between thumbnails is 1 minute, and all frames are 0 to less than 1 minute, less than 1 to 2 minutes, less than 2 to 3 minutes, ..., less than 88 to 89 minutes from the beginning. , 89-90 minutes, 9 frames at 36 minutes, 37 minutes, 38 minutes,..., 43 minutes, 44 minutes are formed in the thumbnail, and the scene located at the center of these 40 minutes A large main thumbnail image is displayed at the center of the main display window.

Similarly, as shown in FIG. 7D, the time interval between frames can be set to a 30-second interval, a 10-second interval, a 5-second interval, or the like. The minimum time interval can be the interval between recorded frames. If it is 30 frames / second, the time interval is 1/30 second.
The change of the time interval between thumbnails as described above can be performed by setting an arbitrary time interval by operating the left / right direction designation key of the keyboard.

Another example of changing the time interval in the uniform time array display will be described.
FIG. 8 is a diagram showing another example of how the display transitions by a key operation together with a time scale when changing the time interval in the uniform time aligned display. Here, the entire reproduction time of the moving image file is 90 minutes, and nine thumbnails are displayed on the moving image display portion of the screen.
Divide the thumbnail time before and after the main display window by the number of thumbnails to be displayed (9 in FIG. 8 because it is displayed as 9) so that the thumbnails before and after the main display window are displayed as a reference in one time interval change operation. ) Is the next time interval.
FIG. 8A shows a display similar to that shown in FIG. 7A when the time interval between thumbnails is 10 minutes.

  The display of FIG. 8 (B) is divided into eight parts by dividing the center display of FIG. 8 (A), that is, 30-50 minutes, which is 10 minutes before and after the thumbnail displayed in the main display window, into eight equal parts. 2 minutes and 30 seconds, 30 minutes to less than 32 minutes and 30 seconds, 32 minutes and 30 seconds to less than 35 minutes, 35 minutes to less than 37 minutes and 30 seconds, ..., 45 minutes to less than 47 minutes and 30 seconds, 47 minutes and 30 seconds to 50 seconds Divided into minutes, 30 minutes, 32 minutes 30 seconds, 35 minutes, ..., 47 minutes 30 seconds, 50 minutes 9 frames at the position of the circle on the left time scale in FIG. The frame located at the center of 40 minutes is the main thumbnail having a large size and is displayed in the center at the position of the main display window.

  The display of FIG. 8 (C) is a frame of 2 minutes 30 seconds before and after the central display of FIG. 8B, that is, a frame of 37 minutes 30 seconds to 42 minutes 30 seconds, 37 minutes 30 seconds to less than 38 minutes 07.5 seconds, 38 minutes 07.5 seconds to less than 38 minutes 45 seconds, 38 minutes 45 seconds to less than 39 minutes 12.5 seconds, ... 41 minutes 52.5 seconds to less than 41 minutes 52.5 seconds, 41 minutes 52.5 seconds to Divide 8 minutes into 42 minutes and 30 seconds, and form 9 frames at 37 minutes and 30 seconds, 38 minutes and 07.5 seconds, 38 minutes and 45 seconds, ..., 41 minutes, 52.5 seconds, and 42 minutes and 30 seconds as thumbnails Then, the frame located at the center of 40:00 is the main thumbnail having a large size and is displayed at the center of the main display window.

Another example of changing the time unit in the uniform time array display will be described.
FIG. 9 shows, with time scales, how the display transitions by key operation when changing the time interval in the uniform time aligned display, as in FIGS. 7 and 8. Here, the entire reproduction time of the moving image file is 90 minutes, and nine thumbnails are displayed on the moving image display portion of the screen.
In FIG. 9, the time interval (time increment) is halved by one time interval change operation. The display in FIG. 9A is a display similar to that shown in FIG. 8A when the time interval between thumbnails is 10 minutes.

In the display of FIG. 9B, in the display of FIG. 9A, the time interval between the thumbnails is halved to 5 minutes ^, and ^{a total of nine frames before} and after ^{the centrally displayed frame are used as thumbnails. 9 (} A), the frames located at the positions of 20 minutes, 25 minutes, 30 minutes,..., 55 minutes, 60 minutes on the time scale in the left diagram of FIG.

The display in FIG. 9C is a display in which the time interval between the thumbnails is further halved in the display of FIG. 9B to be half a half, 30 seconds, 30 minutes 00 seconds, 32 minutes 30 seconds, Frames at positions 35:00,..., 47 minutes 30 seconds, 50:00 hours are formed on thumbnails and displayed.
Similarly, the time interval can be halved repeatedly and can be changed to 1 minute 15 seconds, 37.5 seconds, etc., and the minimum time interval is a predetermined interval not less than the recorded frame interval. It can be a time interval.

Next, an operation for performing a scene jump in moving image division display will be described.
FIG. 10 is a diagram illustrating an operation for performing a scene jump and a display at that time in the uniform time aligned display.
In the display of FIG. 10 (A), in order to jump one thumbnail E displayed on the main display window to the position of thumbnail D and display thumbnail F on the main display window, the up direction designation key is operated. The entire plurality of thumbnails rotate clockwise, and the thumbnail F is enlarged and displayed on the main display window.
To jump backward one by one, operate the down direction key.

  When the time interval between thumbnails is small, if it is necessary to skip to a scene that is separated in time from the displayed frame, that is, a scene that is not displayed as a thumbnail, the number of skipped frames Can be specified with a specified key. In the display of FIG. 10 (B), in order to jump the main thumbnail E displayed on the main display window to the position of the thumbnail C by jumping one, and to display the thumbnail G on the main display window, the right direction key and the up key Use the direction specification key to set jumping by jumping one.

In the display of FIG. 10C, to jump three thumbnails and to display the thumbnail image I in the center on the main display window, the right direction key is pressed twice and the upward direction key is pressed.
Here, the operation of setting the number of pages to be skipped can be set by an operation shown on the side of FIG. 10A according to the number of times the right direction designation key is pressed.

FIG. 11 is a diagram showing an operation for performing a scene jump and a display at that time in the moving image division display.
The operation at the time of performing the scene jump in FIG. 11 can be applied to both the uniform time display and the index list display.
In the display of FIG. 11A, when the up direction key is pressed, the whole of the plurality of thumbnails jumps in the clockwise direction, and the thumbnail displayed on 2a in the main display window as shown in FIG. 11B. E moves to the position of thumbnail D, and thumbnail F is enlarged and displayed in the main display window. By the same operation, the thumbnail G is enlarged and displayed on the main display window as shown in FIG.

  In the display of FIG. 11A, when the right direction key is pressed once and then the upward direction key is pressed, the entire plurality of thumbnails rotate clockwise, as shown in FIG. 11D. A skipping jump is performed, and the thumbnail E that has been enlarged and displayed on the main display window is moved to the position of the thumbnail C, and the thumbnail G is enlarged and displayed on the main display window. By the same operation, the thumbnail I is enlarged and displayed on the main display window as shown in FIG.

In the display of FIG. 11A, when the right direction key is pressed twice and then the upward direction key is pressed, the entire thumbnail rotates clockwise, and three sheets are skipped as shown in FIG. A jump is performed, and the thumbnail E displayed on the main display window is moved to the position of the thumbnail A, and the thumbnail I is displayed on the main display window.
Similarly, when the right direction key is pressed twice and then the upward direction key is pressed, the thumbnail M that is not displayed is enlarged and displayed in the center on the main display window as shown in FIG. .

FIG. 12 is a diagram illustrating the moving image split display device according to the second embodiment.
The moving image split display device according to the first embodiment has a plurality of thumbnails arranged in a straight line from the main display window 2a to the upper right and lower right, and has a substantially square shape as a whole. As shown in FIGS. 12A and 12B, the split display device arranges thumbnails in an arc shape from the upper and lower parts of the main display window 2a to the upper right and the lower right so as to form a substantially C-shape as a whole. Is arranged. With such an arrangement of thumbnails, the vertical interval of the display area can be reduced, and display efficiency can be improved.

In the arrangement of thumbnails in the display of FIG. 12A, 12 thumbnails are generated every 10 minutes for a 120-minute program, and 9 of them are displayed.
The enlarged thumbnail displayed in the main display window 2a is a start thumbnail representing a start scene of 0 minutes out of 0 minutes to less than 10 minutes, and is counterclockwise from the start thumbnail for 10 minutes, 20 minutes, ..., thumbnails of 100 minutes and 110 minutes are displayed, and thumbnails of 50 minutes, 60 minutes and 70 minutes are not displayed. According to the display of FIG. 12A, the start thumbnail of 0 minutes and the end thumbnail of 110 minutes are displayed adjacent to each other, and the entire scene is displayed in a loop.

  On the other hand, in the arrangement of thumbnails in the display of FIG. 12B, the start thumbnail of the start scene and the end thumbnail of the end scene are not displayed adjacent to each other. That is, thumbnails of 10, 20, 30, 40 minutes are displayed on the lower right from the start thumbnail of 0 minutes displayed in the main display window, and 50 minutes, 60 minutes, ..., 100 minutes, 110 minutes. Each of the thumbnails is not displayed, and the start scene and the end scene are not displayed in a loop, so that, for example, the introduction part and the end part of the drama are not displayed simultaneously.

FIG. 13 is a diagram illustrating a moving image split display device according to the third embodiment.
The moving image division display device of the third embodiment generates 12 thumbnails A to L in 120 minute programs every 10 minutes, and displays seven of them. The arrangement of the moving image division display device of the first embodiment is as follows. As shown in FIG. 13A, the main display window 2a is arranged at the center in the horizontal direction of the screen, and a plurality of display windows are arranged from the upper left to the left of the main display window 2a. The other display windows are arranged in the right direction from the lower right of the main display window 2a, and the arrangement of thumbnails is arranged in a staircase as a whole.
In the display of FIG. 13A, thumbnails B to H of the 12 thumbnails A to L are displayed, and the thumbnail E is enlarged and displayed in the main display window 2a.

  In the display of FIG. 13 (A), by pressing the down direction key four times, the thumbnail is jumped four times downward, and the start thumbnail A of 0 minutes is displayed as the main display as shown in FIG. 13 (B). The thumbnails B, C, and D are displayed on the window. At this time, the scenes J, K, and L on the end scene side are not displayed, and the end thumbnail L is not displayed adjacent to the start thumbnail A.

  In FIG. 13A, by pressing the up direction key seven times, the thumbnail jumps seven times upward, and as shown in FIG. 13C, the end thumbnail L of 110 minutes is displayed in the main display window 2a. And thumbnails I, J, and K are displayed on the upper left. At this time, the thumbnails A, B, and C on the start scene side are not displayed, and the start thumbnail A is not displayed adjacent to the end thumbnail L. In order to transition from the display of FIG. 13 (A) to the display of FIG. 13 (C), instead of operating the up direction key seven times to jump the thumbnail seven times, the description has been made based on FIGS. Similarly to the above, it is also possible to display the desired thumbnail on the main thumbnail by skipping the thumbnail using the left / right direction instruction key. Further, as shown in FIG. 12A, the star, the thumbnail A, and the end thumbnail L can be displayed in a loop so as to be arranged. Furthermore, it is possible to display a larger number of thumbnails by moving the entire thumbnail in the vertical direction and shifting the position of the main thumbnail 2a.

FIG. 14 is a diagram illustrating a moving image split display device according to the fourth embodiment.
The moving image dividing display device of the fourth embodiment generates 12 thumbnails A to L in 10 minute increments of a 120 minute program, and displays 7 of them, and changes the arrangement of the moving image dividing display device of the third embodiment. The main display window 2a is arranged at the center in the left-right direction of the screen, and a plurality of display windows are arranged from the upper left to the upper left of the main display window 2a, and the lower right to the right of the main display window 2a. The other plurality of display windows are arranged in the downward direction, and the arrangement of thumbnails is arranged diagonally as a whole.
In the display of FIG. 14A, thumbnails B to H of the 12 thumbnails A to L are displayed, and the thumbnail E is enlarged and displayed on the main display window 2a.

  In the display of FIG. 14B, by pressing the down direction key four times in FIG. 14A, the whole of the plurality of thumbnails jumps down four times, and the start thumbnail A of 0 minutes is displayed in the main display window. The thumbnails B, C, and D can be displayed as well as being displayed on 2a, but the end-side thumbnails J, K, and L are not displayed at this time. In this state, by moving all the main display windows upward as shown in FIG. 14B, more scenes can be displayed.

  In FIG. 14C, by pressing the up direction key seven times in FIG. 14A, the plurality of thumbnails are jumped up seven times, and the end thumbnail L of 110 minutes is displayed in the main display window 2a. The scenes I, J, and K can be displayed as well as the scenes A, B, and C on the start side are not displayed. In this state, when the entire display window is moved downward together with the thumbnail and the end thumbnail L is displayed as shown in FIG. 14C, more scenes can be displayed. In order to move from the display of FIG. 14 (A) to the display of FIG. 14 (C), instead of operating the up direction key seven times to jump the thumbnail seven times, the description has been given based on FIGS. Similarly to the above, it is also possible to display the desired thumbnail on the main thumbnail by skipping the thumbnail using the left / right direction instruction key.

FIG. 15 is a diagram illustrating an operation for performing a scene jump for each thumbnail and a time interval change for each 1/2 and a display at that time in the moving image split display device according to the fifth embodiment. Here, the entire playback time of the moving image file is 70 minutes, and nine thumbnails are displayed on the moving image display portion of the screen.
The index list display device of the fifth embodiment is a display example in which thumbnails are arranged in a substantially C shape as a whole, and the display in FIG. 15A has a time increment of 10 minutes, so that 0 minutes, 10 minutes, 20 Minutes,..., Thumbnails A to G displaying 7/60 scenes are arranged, a start thumbnail A of 0 minutes is displayed in the main display window 2a, and between the thumbnail G of the 60 minute end scene and the thumbnail A of the start scene The window space for two thumbnails is blank. A boundary line is provided at the position shown in the figure, and the thumbnail on the start scene side and the thumbnail on the end scene side are not moved (jumped) beyond the boundary line.

In FIG. 15A, when the up direction designation key is pressed, the thumbnails A to G of all the frames A to G jump once so that they rotate clockwise, and the thumbnail B is the main one as shown in FIG. Move to the display window position.
Subsequently, in FIG. 15B, when the upward designation key is pressed twice, the jump is made twice, and the thumbnail D moves to the main display window position as shown in FIG. The three spaces after the end thumbnail G are blanked.
Further, in FIG. 15C, when the up direction designation key is pressed three times, the end thumbnail G moves to the main display window position as shown in FIG. 15D, and the thumbnails A to D cross the boundary line. The 6 spaces after the end thumbnail G are erased.
In the display of FIGS. 15B to 15D, it is possible to return to the display of FIGS. 15A to 15C by pressing the down direction designation key a predetermined number of times.

  In FIG. 15A, when the left direction designation key is pressed, as shown in FIG. 15E, the time interval between the thumbnails is changed to 1/2 of 5 minutes, and the thumbnails AB, BC, A thumbnail of 5 minutes, 15 minutes, 25 minutes,..., 65 minutes is newly inserted between CD,..., FG, and thumbnails after 35 minutes are erased and not displayed because they exceed the boundary line. To return from the display of FIG. 15E to the display of FIG. 15A, the right direction designation key may be pressed.

Similarly, when the left direction designation key is pressed a predetermined number of times in FIGS. 15B, 15C, and 15D, thumbnails as shown in FIGS. 15F, 15G, and 15H, respectively. The time interval between is changed.
15 (F), (G), and (H), the display of FIGS. 15 (B), (C), and (D) can be returned by pressing the right direction designation key a predetermined number of times.

FIG. 16 is a diagram illustrating an operation of performing a scene jump by one thumbnail and a time interval change by ½ in the moving image split display device according to the sixth embodiment. Here, the entire reproduction time of the moving image file is 70 minutes, and nine thumbnail images are displayed on the moving image display portion of the screen.
The uniform time array display device according to the sixth embodiment does not provide the boundary line in the moving image division display device according to the fifth embodiment, but instead, one thumbnail image is provided for each of the start scene side and the end scene side of the series of thumbnails. The difference is that a space is interposed, that is, when a series of thumbnails are arranged in a loop, the start thumbnail and the end thumbnail are not arranged adjacent to each other.

In FIG. 16A, when the up direction designation key is pressed three times, all thumbnails A to G jump three times so that they rotate clockwise, and the thumbnail D becomes the main display window 2a as shown in FIG. 16B. Is displayed enlarged. At this time, since there is no boundary line, the thumbnail A is not erased from the screen.
In FIG. 16B, when the up direction designation key is pressed three times, the jump is made three times, and the thumbnail G is displayed in the main display window as shown in FIG.
In FIGS. 16B and 16C, when the downward direction designation key is pressed a predetermined number of times, the display of FIGS. 16B and 16A can be returned. In this case, the start thumbnail A and the end thumbnail G are not adjacent to each other.

In FIG. 16A, when the left direction designation key is pressed, as shown in FIG. 16D, the time interval between the thumbnails is changed to ½ every 5 minutes, and thumbnails AB and BC are displayed. , CD,..., FG are newly inserted with thumbnails of 5 minutes, 15 minutes, 25 minutes,..., 65 minutes, and thumbnails A to 30 minutes are displayed. After that, two thumbnail images are left as spaces between the start thumbnail A and no display.
To return from the display of FIG. 16D to the display of FIG. 16A, the right direction designation key may be pressed.

In FIG. 16B, when the left direction designation key is pressed, the time interval between thumbnails is changed in increments of 5 minutes as shown in FIG. The 50-minute thumbnail F and the 10-minute thumbnail B are not displayed and are left as spaces.
To return from the display of FIG. 16E to the display of FIG. 16B, the right direction designation key may be pressed.

In FIG. 16C, when the left direction designation key is pressed, the time interval between thumbnails is changed in increments of 5 minutes as shown in FIG. Further, when the left direction designation key is pressed in FIG. 16F, the time interval between thumbnails is changed in increments of 2 minutes 30 seconds as shown in FIG. The thumbnails of 52 minutes 30 seconds, 55 minutes, and 57 minutes 30 seconds are inserted between the thumbnails G, but the thumbnail F of 50 minutes is deleted.
In FIGS. 16G and 16F, when the right direction designation key is pressed a predetermined number of times, the display of FIGS. 16F and 16C can be returned.

The relationship between thumbnail display transitions and gauge transitions will be described.
FIG. 17 is a diagram showing the transition of thumbnails and the transition of gauges displayed in the uniform time array display.
FIG. 17A corresponds to the case where the end side of the thumbnail is not displayed in the uniform time array display of FIG. 1A, and the entire playback time of the moving image file is 2 hours, and the time interval between the thumbnails. Is in 1 minute increments, and the main display window 2a displays a start thumbnail of the start scene of 0 minutes as a central display, and a thumbnail of 1 minute to 4 minutes is displayed in the lower right. At this time, the gauge 4 on the right side of the video display unit 1 displays that the total playback time of the video file is 2 hours by the total length of the gauge 4, and the position of the main thumbnail displayed on the main display window 2a A center bar 4b indicating the ratio of the currently displayed thumbnail range of 0 to 4 minutes to the entire file is displayed.

  In FIG. 17A, when the left direction key is pressed, the time interval between the thumbnails is changed in increments of 5 minutes, for example, 5 minutes, 10 minutes, 15 minutes, and 20 minutes to the lower right of the 0 minute start thumbnail. A thumbnail of is displayed. At this time, the length of the bar indicating the ratio corresponds to 20 minutes, and it is also displayed that five thumbnails are displayed.

  In FIG. 17B, when the up direction key is pressed three times, each scene jumps three times in the clockwise direction, and as shown in FIG. 2a is magnified and displayed, and thumbnails of scenes 0 to 35 are displayed. At this time, the central display mark 4a moves to the position of 15 minutes in conjunction with it, the range bar 4b becomes longer corresponding to 35 minutes, and it is also displayed that seven thumbnails are displayed.

  In FIG. 17C, when the up direction key is further pressed four times, the jump is made four times, and as shown in FIG. 17D, the thumbnail of the 35-minute scene is enlarged and displayed on the main display window. Minute to 9/55 thumbnails are displayed, the center display mark 4a of the gauge 4 moves to the 35 minute position, the range bar 4b has a length corresponding to 45 minutes, and 9 scene thumbnails are displayed. Is also displayed.

FIG. 18 is a diagram showing the transition of thumbnails and the transition of gauges displayed in the index list display.
FIG. 18A corresponds to an index list display in which the end side of the scene is not displayed. The entire playback time of the moving image file is 2 hours, and the time interval between scenes is 0 minute by the user. From the start thumbnail, indexes such as 10th, 11th, 12th, 62nd, 72nd, etc. are set, and as a result, 0th, 10th, 11th, 12th, 62th , 6/72 thumbnails are displayed, and a 10-minute thumbnail is displayed as a central display in the main display window 2a. At this time, it is displayed on the gauge 4 that the entire playback time of the moving image file is 2 hours, and the currently displayed thumbnail of 0 to 72 minutes is displayed together with the center display mark 4a indicating the position of the center display. A range bar 4b indicating the ratio of the range to the file is displayed.

  In FIG. 18A, when the up direction designation key is pressed five times, a thumbnail of 82 minutes moves to the main display window and is displayed as shown in FIG. 18B. It is not displayed because it is not set. At this time, the gauge 4 shows that the central display thumbnail displayed on the main display window is a thumbnail of 82 minutes, and the ratio of the currently displayed thumbnail range of 11 minutes to 82 minutes to the file. Is displayed by the range bar 4b.

  FIG. 18C shows an example of a special case of index list display. When the time interval between the thumbnails is set uniformly by the user, the same display as the uniform time display is performed. 4 is also displayed in the same manner as in the uniform time display.

Next, switching between uniform time display and index list display will be described.
FIG. 19 is a diagram illustrating an operation for switching between uniform time display and index list display, and a display at that time.
In order to switch between the uniform time display and the index list display, three types of operation methods are considered.
(1) Method of Switching from Function Menu In this method, as shown in FIG. 19A, a function menu is displayed on each screen in a state where any one is displayed, and a desired display is selected and switched.

(2) First Method of Switching Regardless of Function Menu As shown in FIG. 19 (B), this method displays time intervals at positions adjacent to the detailed information display unit 3 during uniform time alignment display and index list display. Section 5 is displayed, where the time interval (time increment) between the current thumbnails is displayed, and when the right direction mark displayed on the side is pointed, the time interval is “Min”,. “30 seconds”, “1 minute”, “5 minutes”, “10 minutes”,..., “Max”, “index” are cycled in the order. If you press the Enter key while any item other than “Index” is displayed, the specified time interval is set and the time is displayed in a uniform time, or if “Index” is selected, the index list is displayed. It becomes.

(3) Second Method of Switching Regardless of Function Menu As shown in FIG. 19 (C), this method displays time intervals at positions adjacent to the detailed information display unit 3 during uniform time alignment display and index list display. The upper part 5a of the time interval display part 5 displays time intervals that can be selected in the uniform time array display in a horizontal direction, and the lower part 5b displays an index list display. The direction indication key is operated to change the time interval together with the uniform time display, and the index list display is selected by operating the down direction key.

Next, image processing performed in the moving image division display device of the present invention will be described.
FIG. 20 is a block diagram showing an image processing apparatus for generating and displaying thumbnails in the moving image split display apparatus of the present invention.
In the example of the image processing device of the moving image split display device of the present invention, the moving image file to be reproduced is MPEG compressed, and its GOP (Group of Pictures) is arranged in stream data and recorded on the hard disk. A hard disk device 11 equipped with a hard disk, a file system unit 12, a moving image file I picture detection unit 13, a moving image file I picture decoding unit 14, an image layout processing unit 15, an image and list screen composition display processing unit 16, and a monitor output unit 17, a moving image file, a thumbnail list display control unit 18, a thumbnail list screen creation unit 19, an operation panel, an operation panel control detection unit 20 to which a display button 20a is connected, and the like.

FIG. 21 is a flowchart showing processing when the thumbnail screen and the thumbnail list screen (OSD screen) are combined and displayed in the image processing apparatus shown in FIG.
In an information processing apparatus having a display screen, when a user operates the operation panel 20a and a display button to instruct to generate and display a thumbnail list screen (OSD screen) (step 1), an operation panel control detection unit At 20, a list screen display request is detected (step 2).

  The video file thumbnail list display control unit 18 reads the file information (name, playback time, etc.) of the video file from the hard disk device 11 via the file system unit 12, and the video file I picture detection unit 13 The position information of the I picture data is acquired from the file (step 3). Here, the relationship between the position information (I picture address) of the moving image file and the time information is as shown in the table at the bottom of FIG.

  A list screen (OSD screen) is created by the thumbnail list screen creation unit 19 from the file information and I picture position information acquired in step 3 (step 4). Next, from the acquired I picture position information, the moving image file thumbnail list display control unit 18 extracts only I picture position information corresponding to the display time interval (for example, 10 minutes), and the image of the I picture is extracted. The moving picture file I picture decoding unit 14 decodes it (step 5).

  The image file decoded in step 5 is laid out at a necessary screen position by the image layout processing unit 15 (step 6). Next, the combined display processing unit 16 of the image and list screen combines the list screen (OSD screen) created in step 4 and the image layout screen created in step 6 (step 7), and the monitor output unit 17 Then, the moving image split display screen composed of the plurality of created thumbnail images is output on the monitor (step 8).

A process for changing the time interval between thumbnails on the video split display screen will be described.
FIG. 22 is a flowchart illustrating a process when changing the time interval between thumbnails on the moving image split display screen.
When the user operates the left and right operation buttons using the operation panel 20a (step 11), the operation panel control detection unit 20 detects a time interval change request for the list image (step 12). Here, the time interval is shortened by the left operation button, and the time interval is expanded by the right operation button.

  Only the I picture position information corresponding to the changed time interval (for example, 5 minutes) is extracted from the I picture position information acquired from the moving picture file I picture detection unit 13 by the moving picture file thumbnail list display control unit 18, and the I picture Are decoded by the code section 14 with the moving picture file I picture, and a thumbnail screen is created by the image layout processing section 15 (step 13).

  Next, a thumbnail list screen (OSD screen) with the time interval changed is created by the thumbnail list screen creation unit 19 (step 14), and the composite display processing unit 16 of the image and thumbnail list screen creates it at step 13. The thumbnail screen and the thumbnail list screen created in step 14 are synthesized (step 15), and the monitor output unit 17 monitors and outputs the created moving image split display screen (step 16).

A process for changing (jumping) the display position of the thumbnail on the video split display screen will be described.
FIG. 23 is a flowchart showing processing when changing the display position of the thumbnail on the thumbnail list screen.
When the user operates an operation button in the vertical direction using the operation panel 20a (step 21), the operation panel control detection unit 20 detects a request to change the display start position of the thumbnail list image (step 22). Here, the display start position is advanced by one by an upward operation of the cursor lever to jump upward, and the display start position is returned by one by the downward operation button to jump downward.

  Change the I-picture position information to be displayed (for example, advance it by one), decode only the corresponding I-picture image by the code part 14 with the moving picture I picture, and create the thumbnail screen by the image layout processing part 15 (Step 23). Further, the thumbnail list screen creation unit 19 creates a thumbnail list screen (OSD screen) with the time interval changed (step 24).

  The image / thumbnail list screen composition display processing unit 16 synthesizes the thumbnail list screen created in step 24 and the thumbnail screen created in step 23 (step 25), and the monitor output unit 17 creates the moving image segmentation. The display screen is output as a monitor (step 26).

FIG. 1A is a diagram illustrating a moving image division display device according to a first embodiment. FIG. 1A illustrates a moving image division display device based on uniform time display, and FIG. 1B illustrates a moving image division display device based on index list display. It is a figure for demonstrating the time interval between the thumbnails in uniform time arrangement display. It is a figure which shows a mode that the uniform time alignment display changes by key operation. It is a figure which shows a mode that a display changes by key operation, when searching a desired scene from the many scenes contained in a moving image content. It is a figure which shows a mode that a display changes by key operation at the time of the setting of A and B when performing AB repeat and a scene cut. It is a figure which shows a mode that a display changes by key operation, when performing a still image capture. It is a figure which shows a mode that a display changes with a key operation when changing a time interval in uniform time arrangement | sequence display with a time scale. It is a figure of another example which shows a mode that a display changes by key operation, when changing a time interval in uniform time arrangement | sequence display with a time scale. FIG. 11 is a diagram showing still another example showing how the display transitions by a key operation when changing half of the time interval repeatedly in the uniform time array display. It is a figure which shows the operation which performs a scene jump, and the display at that time in uniform time sequence display. It is a figure which shows operation which performs a scene jump, and the display at that time in a moving image split display. It is a figure which shows the moving image division | segmentation display apparatus of Example 2. FIG. It is a figure which shows the moving image division | segmentation display apparatus of Example 3. FIG. It is a figure which shows the moving image division | segmentation display apparatus of Example 4. FIG. FIG. 10 is a diagram illustrating an operation for performing a scene jump by one thumbnail and a time interval change by ½ and a display at that time in the moving image split display device according to the fifth embodiment. FIG. 20 is a diagram illustrating an operation of performing a scene jump by one thumbnail and a time interval change by ½ in the moving image split display device according to the sixth embodiment. It is a figure which shows the transition of the thumbnail currently displayed in the uniform time alignment display, and the transition of a gauge. It is a figure which shows the transition of the thumbnail currently displayed in the index list display, and the transition of a gauge. It is a figure which shows the operation which switches a uniform time arrangement display and an index list display mutually, and the display at that time. It is a block diagram which shows the image processing apparatus which produces | generates and displays a thumbnail in the moving image division | segmentation display apparatus of this invention. FIG. 21 is a flowchart showing processing when a thumbnail screen and a thumbnail list screen (OSD screen) are combined and displayed in the image processing apparatus shown in FIG. 20. It is a flowchart which shows the process at the time of changing the time interval between thumbnails in a moving image division | segmentation display screen. It is a flowchart which shows the process at the time of changing the display position of a thumbnail in a thumbnail list screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Movie display part, 2 ... Display window, 2a ... Main display window, 3 ... Detailed information display part, 4 ... Gauge, 4a ... Center display mark, 4b ... Range bar, 11 ... Hard disk drive, 12 ... File system part, DESCRIPTION OF SYMBOLS 13 ... Movie file I picture detection part, 14 ... Movie file I picture decoding part, 15 ... Image layout process part, 16 ... Composition display process part of an image and a list screen, 17 ... Monitor output part, 18 ... Movie file thumbnail list display Control unit, 19 ... thumbnail list screen creation unit, 20 ... operation panel control detection unit, 20a ... operation panel, display button.

Claims (12)

  Dividing video data at predetermined time intervals, extracting the first frame for each time interval as still image data, generating a plurality of thumbnails, and displaying the plurality of thumbnails on a plurality of display windows in the screen In the apparatus, one of the plurality of thumbnails is displayed as a large thumbnail in a main display window in the screen, and the other thumbnails are small thumbnails in a display window arranged in a horizontal or inclined direction from the main display window. The moving image split display device is characterized in that the time interval is changed by a left-right operation, and the plurality of thumbnails are moved between the plurality of display windows by a vertical operation.   2. The moving image split display device according to claim 1, wherein the plurality of display windows are arranged in a substantially square shape or a substantially C shape with the main display window as a bent portion, and the plurality of thumbnails are arranged in time series. A video segmented display device, characterized by being arranged in a row.   2. The moving image split display device according to claim 1, wherein the plurality of display windows are arranged in a staircase shape as a whole with the main display window being a central portion in a horizontal direction, and the plurality of thumbnails are arranged in time series. A video segmented display device characterized by the above.   2. The moving image split display device according to claim 1, wherein the plurality of display windows are arranged diagonally as a whole with the main display window being a central portion in a horizontal direction, and the plurality of thumbnails are arranged in time series. A video segmented display device characterized by   5. The moving image dividing display device according to claim 1, wherein time intervals between the adjacent thumbnails are uniform.   5. The moving image dividing display device according to claim 1, wherein each time interval between the adjacent thumbnails can be arbitrarily set.   7. The moving image dividing display device according to claim 1, wherein the predetermined operation in the left and right direction is an operation of a left and right direction indicating device.   7. The moving image dividing display device according to claim 1, wherein the predetermined operation in the up / down direction is an operation of an up / down direction indicating device.   The moving image split display device according to any one of claims 1 to 8, wherein a range and a ratio of a plurality of thumbnails displayed in the screen occupy the entire moving image, A moving image division display device that displays a gauge indicating the position of the main thumbnail in the entire moving image.   9. The moving image dividing display device according to claim 1, wherein moving image data after the main thumbnail is reproduced in full screen by a predetermined operation.   9. The moving image divided display device according to claim 1, wherein moving image data after the main thumbnail is reproduced by a predetermined operation.   The video data is divided at predetermined time intervals, the first frame for each time interval is taken out as still image data in time series to generate a plurality of thumbnails, and one of the thumbnails is displayed on the main display window as a main A method for operating a video split display device that displays thumbnails and displays other thumbnails on a plurality of display windows arranged in a horizontal or inclined direction from the top and bottom of the main display window. An operation method of a moving image split display device, wherein a time interval between the thumbnails is changed by an operation, and the plurality of thumbnails are moved between the plurality of display windows by an up / down direction instruction operation.

Images