JP2009151798A - Image processor and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generation device and method for generating a still index image representing the abbreviated content of a moving image in various types of methods. <P>SOLUTION: An index image generation means (index generation part 87) generates a still index image (VD index image) representing the abbreviated content of a moving image by combining each portion of a plurality of static images arranged in time series to configure a moving image. The index image generation means is provided with a function for extracting each portion from the plurality of static images in a plurality of various modes, and for generating the index image corresponding to the various modes on the basis of the extracted portion. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

The present invention relates to an image generation apparatus capable of generating an index image as a still image by reducing the outline of a moving image, for example, a system for searching for a desired moving image from a plurality of types of moving images. The present invention relates to an applied image generation apparatus.

  Information retrieval technology targeting characters has been widely used in the past, but there are few examples of retrieval technology targeting video, and various attempts are still being made. In particular, research on a moving image search method has been conducted from various viewpoints such as a method using an image recognition technique and a scene extraction technique.

  For example, in a VOD (Video On Demand) system configured by combining a moving image server and a database server, content (moving image content) can be searched by keyword search for title names and the like. However, the title name does not always appropriately represent the entire content, and in many cases, the content cannot be confirmed unless it is actually reproduced.

  In order to solve such problems, the present applicant has proposed a video browser technology that focuses on the list of moving images as disclosed in Japanese Patent Laid-Open No. 2-260075. This video browser technology generates an index image as a digest still image based on a partial image sampled by a moving slit window from each of a series of still images constituting a moving image. This is a technology that allows the outline contents of moving images to be confirmed at a glance by displaying them in a list.

  According to this video browser technology, the contents of a huge amount of moving images recorded in an invisible state are displayed in the form of still images compressed along the time axis, so the contents of moving images can be immediately grasped. can do.

JP-A-2-260075

  However, in the above-mentioned publication related to the video browser technology, a vertical moving slit window or a horizontal moving slit window is used as a method of sampling a partial image from each of a series of still images constituting a moving image by a moving slit window. The method is only shown, and it has not been possible to generate an index image by an appropriate and various method according to the type and application of the material (moving image), the situation of the system configuration, or the like.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image generation apparatus and method capable of generating an index image, which is a still image having a reduced content of a moving image, by various methods. Is to provide.

  The image generation apparatus according to the first and second aspects of the present invention reduces the content of a moving image by combining a part of each of a plurality of still images arranged in time series so as to form a moving image. An image generation apparatus comprising index image generation means for generating an index image as a still image expressed in a form, wherein the index image generation means extracts a part from each of a plurality of still images in a plurality of different modes and extracts Based on the determined portion, a function capable of generating an index image corresponding to each aspect is provided.

  In particular, the image generation apparatus according to the first aspect of the present invention extracts, in a plurality of different aspects, a vertically elongated partial image from each of a plurality of still images with a specified number of pixel lines. An aspect is included.

  Further, in the image generating apparatus according to the second aspect of the present invention, in the plurality of different aspects, a partial image that is elongated in the horizontal direction is extracted from each of the plurality of still images with an arbitrary designated number of pixel lines. An aspect is included.

  In the image generation device according to the first and second aspects of the present invention, the plurality of different modes include a mode in which a part is extracted from a limited region in each of the plurality of still images. Is possible. In this case, it is preferable that the limited area is a central area in each of the plurality of still images.

  In the image generation apparatus according to the first and second aspects of the present invention, the index image generation means further extracts one of the still images from a plurality of still images, and the extracted still image is also converted into the index image. It is possible to have a function used as

  The image generation method according to the first and second aspects of the present invention reduces the content of a moving image by combining a part of a plurality of still images arranged in time series so as to form a moving image. An image generation method for generating an index image as a still image expressed in a form by an index image generation unit in an image generation apparatus, wherein a part of each of a plurality of still images is used as a procedure executed by the index image generation unit In accordance with an aspect selected from a plurality of aspects for extraction, the method includes a step of extracting a part from each of a plurality of still images and a step of generating an index image by combining the extracted parts. is there.

  In particular, the image generation method according to the first aspect of the present invention extracts, in a plurality of different aspects, a vertically elongated partial image from each of a plurality of still images at a specified arbitrary number of pixel lines. An aspect is included.

  Also, in the image generation method according to the second aspect of the present invention, in the plurality of different modes, a partial image that is elongated in the horizontal direction is extracted from each of the plurality of still images with an arbitrary designated number of pixel lines. An aspect is included.

  In the image generation methods according to the first and second aspects of the present invention, the plurality of different modes include a mode in which a part is extracted from a limited area in each of the plurality of still images. Is possible. Here, it is preferable that the limited area is a central area in each of a plurality of still images.

  Further, in the image generation methods according to the first and second aspects of the present invention, any one of the still images is extracted from a plurality of still images, and the extracted still images are also used as index images. It is possible.

  In the image generating apparatus according to the first or second aspect of the present invention, the index image generating means combines a part of each of a plurality of still images arranged in time series so as to form a moving image, and An index image is generated as a still image that represents the image content in a contracted form. Such index image generation processing is performed in a plurality of different modes.

  In the image generation method according to the first or second aspect of the present invention, any one of a plurality of modes for extracting a part from each of a plurality of still images is selected, and this selected mode is selected. Accordingly, a part is extracted from each of the plurality of still images, and an index image is generated by combining the extracted parts.

  As described above, according to the image generation device according to any one of claims 1 to 8 or the image generation method according to any one of claims 9 to 16, each of a plurality of still images is provided. Since the process of extracting a part from an image and generating an index image corresponding to each aspect based on the extracted part can be performed in a plurality of different aspects, for example, appropriately changing the generation aspect Thus, there is an effect that it is possible to obtain an index image in an appropriate mode according to the nature and use of the moving image material.

  In particular, according to the image generation apparatus according to claim 2 or 6, or the image generation method according to claim 10 or 14, a part is extracted from a limited region in each of the plurality of still images in a plurality of different modes. Therefore, by utilizing this aspect, there is an effect that a compact and simple index image can be obtained.

  In addition, according to the image generation apparatus according to claim 4 or 8, or the image generation method according to claim 12 or 16, any one of the still images is extracted from a plurality of still images, and the extracted still images are also converted into index images. Even if it is difficult to understand the contents of the original moving image only with the index image, it is easy to understand the contents of the moving image by looking at the added still image. Play.

It is a block diagram showing the function structure of each component in the moving image search delivery system with which the image generation apparatus of one embodiment of this invention is applied. It is a block diagram showing the hardware constitutions of this moving image search delivery system with the hardware constitutions of the web server and terminal device which are the component. It is a block diagram showing the hardware constitutions of a moving image server. It is a figure showing an example of the internet browser screen displayed on the display apparatus of a terminal device. 5A to 5C are explanatory diagrams showing an example of a schematic procedure for generating a group of VD index images from a series of moving images. FIGS. 6A to 6D are explanatory diagrams showing an example of a procedure for generating one VD index image from a moving image of a certain section by a vertical extraction method. 7A to 7D are explanatory diagrams showing an example of a procedure for generating one VD index image from a moving image of a certain section by a horizontal extraction method. 8A to 8E are explanatory diagrams showing an example of a procedure for generating one VD index image from a moving image of a certain section by a partial extraction method. FIGS. 9A to 9E are explanatory diagrams showing an example of a schematic procedure for generating a group of VD index images from a series of moving images by a frame mixing method. FIG. 10 is an explanatory diagram showing the types of index generation modes supported by the index generation unit shown in FIG. FIG. 11 is a flowchart showing the processing contents in the index generation unit shown in FIG. FIG. 12 is a flowchart showing an example of index generation processing in a certain generation mode (M7 mode) performed in the index generation unit shown in FIG. FIGS. 13A to 13C are diagrams showing examples of VD index images of three modes generated by changing the number of extracted lines per frame under the M1 mode. FIGS. 14A to 14C are diagrams showing examples of VD index images of three modes generated under the respective modes M2, M5, and M3 while keeping the number of extracted lines per frame constant. FIG. 15 is an explanatory diagram showing a series of moving image search / delivery operations in the web server, terminal device, moving image server, and database server, respectively. FIG. 16 is an explanatory diagram following FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 2 shows the hardware configuration of a moving image search / distribution system configured by applying the image generation device according to the embodiment of the present invention, together with the internal configuration of the web server 3 and the terminal device 4 as its components. It represents. The moving image search / distribution system of the present embodiment is a system that enables searching and distribution of moving images using the World Wide Web (WWW), which is a system that enables access to information on the Internet. is there.

  As shown in this figure, this moving image search / distribution system includes a web server 3 that supports WWW, a terminal device 4 as a client, a moving image server 5 that stores moving images, and a moving image server 5. And a database server 6 that stores data relating to moving images stored in the database. Each of these elements is connected to a network 2 that forms part of the Internet. There are no particular restrictions on the number of web servers 3, terminal devices 4, moving image servers 5, and database servers 6 connected to the network 2, and the physical connection form to the network 2.

  The web server 3 mainly searches for a moving image in response to a request from the terminal device 4 and searches for a visual digest index image (hereinafter referred to as a VD index image) as a still image generated from the moving image. Distribution etc. are performed. The VD index image is obtained by reducing the content of a moving image into a still image, and the general content of the moving image can be grasped only by looking at the VD index image. The generation method will be described later. Here, the VD index image corresponds to the “index image” in the present invention.

  As shown in FIG. 2, the web server 3 includes a computer main body 11 and a display device 12, a keyboard 13, a mouse 14 and a hard disk device 15 connected to the computer main body 11. The computer main body 11 includes a CPU (Central Processing Unit) 21, a memory unit 22 including a ROM (Read Only Memory) and a RAM (Random Access Memory), and a display controller 23 for controlling the display device 12. Are connected to the keyboard 13 and the mouse 14 to control input / output (I / O) operations; a hard disk controller 25 to control the hard disk device 15; And a network controller 26 that performs control. These elements are connected to each other by a bus 27. The CPU 21 is configured to execute an application program stored in the hard disk device 15 by using the RAM in the memory unit 22 as a working storage area.

  The terminal device 4 is configured as, for example, a normal personal computer, and can play back a moving image distributed via the Internet browser, which is software for enabling browsing of information on the Internet, and the network 2. Possesses a moving image playback program which is software for As the Internet browser, for example, a general commercial browser such as Netscape Navigator (trademark of Netscape Communications, USA) can be used.

  As shown in FIG. 2, the terminal device 4 includes a computer main body 31, a display device 32, a keyboard 33, a mouse 34, speakers 35 a and 35 b, and a hard disk device 36 connected to the computer main body 31. Yes. The computer main body 31 performs a CPU 41, a memory unit 42 including a ROM and a RAM, a display controller 43 for controlling the display device 32, and image data compression / decompression processing according to the MPEG (Moving Picture Experts Group) standard. An MPEG processing unit 44, an I / O controller 45 connected to the keyboard 33 and mouse 34 and controlling input / output operations, a sound controller 46 controlling audio output from the speakers 35a and 35b, and a hard disk device 36 are controlled. A hard disk controller 47 for connecting to the network 2 and a network controller 48 for controlling communication. These elements are connected to each other by a bus 49. The CPU 41 is configured to execute an application program stored in the hard disk device 36 using the RAM in the memory unit 42 as a working storage area. The MPEG processing unit 44 may be realized by hardware or software.

  The terminal device 4 is not limited as hardware as long as it has the Internet browser function and the moving image playback function as described above.

  The moving image server 5 accumulates a plurality of types of moving images and provides them via the network 2 in response to a request, or generates a VD index image from the moving images.

  FIG. 3 shows the hardware configuration of the moving image server 5. As shown in this figure, the moving image server 5 is configured redundantly using a computer main body 51, a display device 52, a keyboard 53, a mouse 54, and a plurality of hard disks connected to the computer main body 51. A large capacity RAID (Redundant Array of Inexpensive Disks) 55 is provided.

  The computer main body 51 includes a CPU 61, a memory unit 62 including a ROM and a RAM, a display controller 63 for controlling the display device 52, an MPEG processing unit 64 for compressing / decompressing image data according to the MPEG standard, An I / O controller 65 connected to the keyboard 53 and the mouse 54 for controlling input / output operations, a RAID controller 66 for controlling the RAID 55, and a network controller 67 connected to the network 2 for controlling communication. ing. These elements are connected to each other by a bus 68. The CPU 61 is configured to execute an application program stored in the RAID 55 using the RAM in the memory unit 62 as a working storage area. The MPEG processing unit 64 may be realized by hardware or software.

  Next, a functional configuration of the moving image search / delivery system of the present embodiment will be described.

  FIG. 1 shows a functional configuration of each element in the moving image search / distribution system shown in FIG. As shown in this figure, the web server 3 includes an Internet server unit 71, a database search unit 72, an index search unit 73, an index storage unit 74, an index related processing unit 75, and an index related information storage unit 76. A GUI (Graphical User Interface) data generation unit 77, a GUI data storage unit 78, and a still image storage unit 79.

  The Internet server unit 71 is for managing and distributing information published on the Internet, and specifically exchanges with the terminal device 4, the moving image server 5, the database server 6, and the like.

  The database search unit 72 performs a process of issuing a moving image search request to the database server 6 in response to a request from the terminal device 4 and passing the obtained search result to the index search unit 73. This search result includes the title of the corresponding moving image, the file name of the moving image data, the name of the moving image server storing the moving image file (here, the moving image server 5), The storage location of the moving image file is included.

  The index search unit 73 is for searching for a target file from a plurality of VD index files stored in the index storage unit 74 based on the database search result received from the database search unit 72. Here, the VD index file is an image data file generated for each moving image title, as will be described later, and includes one or a plurality of VD index image data.

  The index storage unit 74 is for storing the VD index file sent from the moving image server 5.

  The index related processing unit 75 is for performing processing for obtaining various display parameter information related to the display mode of the VD index image, which is necessary when the GUI data generating unit 77 generates GUI data. The display parameter information includes, for example, the number of displayable VD index images according to the size of the Internet browser screen (hereinafter simply referred to as browser screen) of the display device 32 of the terminal device 4, and the number of generated VD index images. Includes the number of the VD index image to be selected when the number exceeds the displayable number, the VD index image display format corresponding to the length of the moving image, and the like. Here, the VD index image display format means that the user of the terminal device 4 can display the VD index image by selectively using or not using a part of the area where the VD index image can be displayed. This is to make it possible to determine the length of the moving image corresponding to the display format of the VD index image displayed on the browser screen of the device 32 only by looking at the display format.

  The index related information storage unit 76 is for storing the index related information sent from the moving image server 5. This index related information is information including the number of VD index images generated by the index generation unit 87 of the moving image server 5 and various generation parameters used for generating the VD index images. Here, the generation parameters include, for example, the number of frames used to generate one VD index image, the number of lines extracted from each frame, the direction of line extraction, and the like. Details thereof will be described later.

  The GUI data generation unit 77 is for generating or updating GUI data constituting a home page for moving image search provided to the terminal device 4 or the like. The data constituting the moving picture search home page is usually described in HTML (Hypertext Markup Language) language.

  The GUI data storage unit 78 is an area for storing the GUI data generated by the GUI data generation unit 77.

  The still image storage unit 79 is for storing the still image file sent from the moving image server 5 together with the VD index file. This still image file is composed of still image data associated with each VD index image included in the VD index file. As still image data, for example, data compressed in a GIF (Graphics Interchange Format) format is used.

  Among the functional units in the web server 3 described above, the Internet server unit 71, the database search unit 72, the index search unit 73, the index related processing unit 75, and the GUI data generation unit 77 are mainly the hard disk device in FIG. 15 is realized by an application program stored in the CPU 15 and a CPU 21 that executes the application program. Also, the index storage unit 74, the index related information storage unit 76, the GUI data storage unit 78, and the still image storage unit 79 are each realized by using a part of the hard disk device 15 in FIG.

  The terminal device 4 includes an internet browser unit 81 and a moving image playback unit 82.

  The Internet browser unit 81 has a function of accessing the Internet using the WWW, receiving and displaying information, and is realized by a general commercial browser such as the Netscape Navigator as described above.

  The moving image reproduction unit 82 is for decompressing and displaying the moving image data distributed from the moving image server 5, and is realized mainly by the MPEG processing unit 44 in FIG. However, the function of the moving image playback unit 82 can also be realized by a moving image playback program corresponding to the content type (for example, compression method) of the moving image. This moving image playback program is provided, for example, as plug-in software for an Internet browser.

  The moving image server 5 includes a moving image storage unit 85, a moving image distribution unit 86, and an index generation unit 87.

  The moving image storage unit 85 is a portion for storing moving image files, and is mainly realized by the RAID 55 in FIG. The moving image data included in the moving image file is compressed in the MPEG format.

  The moving image distribution unit 86 performs processing of taking out a target moving image from the moving image storage unit 85 and distributing it to the terminal device 4 via the network 2 in response to a request from the terminal device 4 or the like. It is mainly realized by the network controller 67 and the CPU 61.

  The index generation unit 87 visually reduces the content of the moving image stored in the moving image storage unit 85 to generate a VD index image as a still image, and uses this as a VD index file via the network 2. It has a function of transmitting to the web server 3. The index generation unit 87 also has a function of transmitting the number of generated VD index images and various generation parameters used for generating the VD index image to the web server 3 as index related information. Yes. The VD index file and the index related information sent to the web server 3 are stored in the index storage unit 74 and the index related information storage unit 76, respectively. The index generation unit 87 is mainly realized by the CPU 61 and the MPEG processing unit 64 in FIG. The detailed contents of the VD index image generation process will be described later. Here, the index generation unit 87 corresponds to “index image generation means” in the present invention.

  The database server 6 includes a database 91 and a search processing unit 92.

  The database 91 includes a title of a moving image, a moving image file name, a name of a moving image server in which the moving image file is stored (here, the moving image server 5), and a storage position of the moving image file in the moving image server. Etc.

  In response to a request from the database search unit 72 of the web server 3, the search processing unit 92 searches the database 91 based on the given keyword and sends the search result to the database search unit 72. It has become. The search processing unit 92 is realized by, for example, a database management system (DBMS) program such as Sybase (registered trademark of Sybase Inc., USA).

  FIG. 4 shows an example of an Internet browser screen displayed on the display device 32 of the terminal device 4. This browser screen is realized by the function of the Internet browser unit 81.

  The browser screen includes a system area 101 including a browser title bar, a menu bar, a tool bar, and the like, an index display area 102 for displaying a VD index image as a search result, a still image (more precisely, an index described later) A still image display area 103 for displaying a representative still image) and a moving image display area 104 for reproducing and displaying a moving image are included.

  The menu bar in the system area 101 has menu items such as “file”, “edit”, and “display”, and a pull-down menu is displayed by clicking each of them with a mouse. Tool icons such as “return” and “reread” are arranged on the toolbar, and a corresponding browser operation is performed by clicking each of them with a mouse. Here, the mouse click means that the mouse 34 is left-clicked, for example, with the mouse pointer 109 set to the target item. In the following description, this operation is described as simply clicking.

  In the index display area 102, the keyword used for the search, the number of titles of the searched moving image 106, the VD index image groups 107 and 108 for the searched moving image, and the like are displayed. . In the example shown in this figure, 117 moving images are searched for the keyword “Okazaki”. Among these, “Sakura Odorasaki Okazaki”, “Okazaki where history and the future breathe”, etc. VD index image groups 107 and 108 are displayed. Here, one VD index image group corresponds to a moving image of one title. Below each VD index image group, indicator bars 107a and 108a corresponding to the entire length of the corresponding moving image (total playback time) are arranged. The black portions in these indicator bars 107a, 108a, etc. indicate the position of the VD index image displayed on the indicator bars 107a, 108a and the like. By operating the scroll bar 110 at the right end of the index display area 102, a plurality of VD index image groups can be scrolled up and down and sequentially displayed.

  In the still image display area 103, a still image 103a corresponding to the selected one of the VD index images displayed in the index display area 102 is displayed. This still image 103a is an index representative still image to be described later. In the present embodiment, for example, by operating the mouse 34 and moving the mouse pointer 109 on a desired VD index image, the VD index image is selected.

  In the moving image display area 104, a moving image 104a corresponding to the selected one of the VD index images displayed in the index display area 102 is displayed together with a title name and a moving image file name 104b. Yes. In the present embodiment, for example, by moving the mouse pointer 109 over a desired VD index image and clicking, a moving image corresponding to the VD index image is selected. In this case, the reproduction start point is the head of the moving image section corresponding to the clicked VD index image. However, a position other than the beginning of the moving image section may be set as the playback start point. Here, operations such as playback, stop, pause, high-speed playback, reverse playback, and high-speed reverse playback of the moving image 104a can be performed by the operation unit 104c. Further, by clicking on the enlarged display icon 104d, the moving image 104a can be enlarged and displayed on the entire browser screen.

  Next, the operation of the moving image search / distribution system configured as described above will be described.

  Here, first, several VD index image generation methods that can be performed by the index generation unit 87 of the moving image server 5 will be described with reference to FIGS. 5A to 9C. There are basically four VD index image generation methods: a vertical extraction method, a horizontal extraction method, a partial extraction method, and a frame mixing method. Hereinafter, each method will be described.

  5A to 5C and FIGS. 6A to 6C conceptually show the processing contents for generating the VD index image by the vertical extraction method. Here, FIGS. 5A to 5C show a general procedure for generating a plurality of VD index images from a series of moving images, and FIGS. 6A to 6C show one image from a moving image of a certain section. A procedure for generating a VD index image is shown.

  First, as shown in FIGS. 5A and 6A, a moving image is defined as a rectangular parallelepiped model in which two-dimensional still images F are arranged along the time axis t. Hereinafter, a two-dimensional still image is also referred to as a frame. For example, in the case of the NTSC (National Television System Committee) system, each frame is composed of two fields each having a length of 1/60 second, so that one frame has a length of 1/30 second.

  Next, as shown in FIG. 5B, a rectangular parallelepiped model consisting of a whole series of moving images is divided into a plurality of section rectangular parallelepipeds Si (in this figure, i = 1 to 4) at regular time intervals. And each section rectangular parallelepiped Si is cut | disconnected diagonally along the diagonal surface which passes along diagonal line A1 of the upper surface, and strip | belt-shaped image information (henceforth slit image information) in each cut surface is extracted. Actually, as shown in FIG. 6B, the frame Fj (j = 1, 2,...) Is taken out from one section rectangular parallelepiped, and further, as shown in FIG. At the same time, the slit image information SLVj is sequentially cut out by a vertically long moving slit window that moves in the horizontal direction.

  Next, as shown in FIG. 6D, the slit image information SLVj extracted from the cut surface is sequentially arranged, and when it becomes a predetermined size, a predetermined compression process is performed on it. As a result, as shown in FIG. 5C, one VD index image IVi (i = 1 to 4) is generated for each section rectangular parallelepiped Si. Four) VD index images are generated. At this time, for each VD index image IVi, any one frame included in the section rectangular parallelepiped Si that is the origin of the VD index image IVi (that is, the original frame Fj that has not been subjected to extraction processing by the moving slit window). Are registered as an index representative still image SP. As the index representative still image SP, for example, a frame (frame F5 in FIG. 6D) used for generating the central portion of the VD index image IVi is selected. However, you may make it select the frame used for the production | generation of the other part (for example, edge part) in a VD index image.

  Such a vertical extraction method is particularly effective when, for example, a moving image as a material is taken by panning the camera in the horizontal direction. In the case of such a material, the transition direction of each frame content of the moving image and the arrangement direction of the slit image information SLVi constituting the generated index representative still image coincide with each other in the horizontal direction, This is because the VD index image is a natural representation of changes in the content of the moving image.

  Next, the horizontal extraction method will be described.

  FIGS. 7A to 7D are horizontal extraction methods in which VD index images are generated by extracting slit image information SLHj from a still image constituting a moving image through a moving slit window that is elongated in the horizontal direction (lateral direction). Is expressed.

  In this method, the cutting plane for cutting the section rectangular parallelepiped Si shown in FIG. 5B is not a plane that passes through the diagonal line A1 on the upper surface as described above, but a cutting that passes through the diagonal line A2 of the front surface of the section rectangular parallelepiped Si. Surface.

  That is, as shown in FIG. 7A and FIG. 7B, the frame Fj (j = 1, 2,...) Is taken out from the section rectangular parallelepiped Si (FIG. 5B), and further, as shown in FIG. The slit image information SLHj is sequentially cut out from each frame Fj by a horizontally long moving slit window that moves in the vertical direction with time.

  Next, as shown in FIG. 7D, the cut slit image information SLHj is sequentially arranged, and when it becomes a predetermined size, a predetermined compression process is performed on it. Thus, one VD index image IHi is generated for each section rectangular parallelepiped, and a plurality of VD index images are generated as the entire moving image. At this time, for each VD index image IHi, one of the frames Fj (frame F4 in the example of FIG. 7D) included in the section rectangular parallelepiped that is the basis of the VD index image IHi is associated. Register as SP.

  Such a horizontal extraction method is particularly effective when, for example, a moving image as a material is taken by panning the camera in the vertical direction. In the case of such a material, the transition direction of each frame content of the moving image and the arrangement direction of the slit image information SLi constituting the generated index representative still image coincide with each other in the vertical direction, This is because the VD index image is a natural representation of changes in the content of the moving image.

  Next, the partial extraction method will be described.

  8A to 8E do not extract the slit image information SLj directly from the frame Fj constituting the moving image, but only the main part (for example, the central region) of the frame Fj is set as the extraction target range. A region (for example, a peripheral region) represents a partial extraction method that is excluded from extraction targets.

  In this method, first, as shown in FIGS. 8A and 8B, the frame Fj (j = 1, 2,...) Is taken out from the section rectangular parallelepiped Si (FIG. 5B), and further shown in FIG. 8C. As described above, the partial frame Fj ′ is extracted from the central portion of each of the frames Fj. Here, the size of the partial frame Fj ′ is, for example, about 70% of the size of the original frame Fj. However, it is not limited to the value.

  Next, as shown in FIG. 8D, slit image information SLVj ′ is sequentially cut out from each partial frame Fj ′ by a vertically long moving slit window that moves in the horizontal direction with time.

  Next, as shown in FIG. 8E, the cut out slit image information SLVj is sequentially arranged, and when it becomes a predetermined size, a predetermined compression process is performed on it. Thus, one VD index image IVi ′ is generated for each section rectangular parallelepiped, and a plurality of VD index images are generated as the entire moving image. At this time, for each VD index image IVi ′, a partial frame Fj ′ (partial frame F5 ′ in FIG. 8E) extracted from one of the frames Fj included in the section rectangular parallelepiped that is the origin of the VD index image IVi ′ is obtained. The association is registered as an index representative still image SP ′.

  In such a partial extraction method, even if the width of the moving slit window is the same, the size (specifically, the amount of image data) of the slit image information SLVj ′ extracted thereby is the slit in FIG. 6C. As a result, the size of the generated VD index image IVi ′ is smaller than the size of the VD index image IVi in FIG. 6D. Therefore, it is effective in that the storage space for the VD index image can be reduced.

  In the examples shown in FIGS. 8A to 8E, the case where the vertical extraction method is combined with the partial extraction method has been described. However, as will be described later, the horizontal extraction method can be combined with the partial extraction method. .

  Next, the frame mixing method will be described.

  9A to 9C show a frame mixing method in which original frames are mixed in the generated VD index image group separately from the index representative still image. The example shown in this figure is a modification of the vertical extraction method shown in FIGS. 5A to 5C.

  In this method, each section rectangular parallelepiped Si is cut obliquely along the diagonal plane passing through the diagonal line on the upper surface, slit image information on each cut plane is extracted, and the VD index image IVi is extracted based on the extracted slit image information. Is generated. Up to this point, the process is the same as in FIGS. 5A to 5C.

  In this method, any frame included in each section rectangular parallelepiped Si is inserted as it is (without being processed) between the VD index images generated in this way. Hereinafter, this inserted frame is referred to as an insertion frame.

  There are various methods for determining the insertion frame and inserting it. For example, a frame corresponding to the head portion of each VD index image (that is, a frame that provides slit image information at the left end of the VD index image) is taken out, and the insertion frame is inserted in front of the VD index image. There is a way. In this method, for example, as shown in FIG. 9C, the frame Fα1 providing the slit image information at the left end of the VD index image IV2 is extracted from the section rectangular parallelepiped S2 (FIG. 9B), and this frame Fα1 is extracted from the VD index image. Insert between IV2 and IV1. Similarly, the frame Fα2 providing the slit image information at the left end of the VD index image IV3 is taken out from the section rectangular parallelepiped S3 (FIG. 9B), and this frame Fα2 is inserted between the VD index images IV3 and IV2. To do. The same applies to the frame Fα3.

  However, the method of determining the insertion frame and the method of insertion are not limited to the above. For example, the frames may be sampled at regular time intervals, and the frames may be arranged at appropriate positions in the VD index image array.

  In this method, each VD index image IVi is associated with any one frame included in the section rectangular parallelepiped Si that is the original, and is registered as an index representative still image SP. This is the same as in FIGS. 5A to 5C.

  As will be described later, such a frame mixing method includes an unprocessed still image in the array of VD index images, and thus has an advantage that confirmation of the content of the moving image is further facilitated.

FIG. 10 shows the types of generation modes that the index generation unit 87 of the moving image server 5 can take when generating the VD index image. As shown in this figure, in this embodiment, eight generation modes from M1 to M8 are prepared, which are a combination of the above-described vertical extraction method, horizontal extraction method, partial extraction method, and mixed frame method. ing. The meaning of each mode is as follows.
M1 mode: This mode uses only the vertical extraction method with the entire frame as an extraction target.
M2 mode: This mode uses only the horizontal extraction method with the entire frame as an extraction target.
M3 mode: A mode in which the vertical extraction method and the frame mixing method are used in combination with the entire frame as an extraction target.
M4 mode: A mode in which the horizontal extraction method and the frame mixing method are used in combination with the entire frame as an extraction target.
M5 mode: This mode uses only the vertical extraction method with partial frames as extraction targets.
M6 mode: This mode uses only the horizontal extraction method with partial frames as extraction targets.
M7 mode: A mode in which the vertical extraction method and the frame mixing method are used together with partial frames as extraction targets.
M8 mode: A mode in which a horizontal extraction method and a frame mixing method are used in combination with a partial frame as an extraction target.

  Next, mainly the operation of the index generation unit 87 of the moving image server 5 will be described with reference to FIG. 11 and FIG. Here, FIG. 11 shows the overall operation of the index generation unit 87, and FIG. 12 shows processing in the M7 mode as an example of processing in the index generation unit 87.

  First, the overall operation of the index generation unit 87 will be described with reference to FIG.

  The index generation unit 87 monitors input from, for example, the keyboard 53 in FIG. 3, and when an index generation command is input (step S101), the moving image file name, index generation mode, and extraction are input from the input command. The number of frames, the number n of extracted lines, etc. are taken in (step S102). Here, the index generation mode is any one of M1 to M8 described above. The number of extracted frames is the number of frames used for generating one VD index image. The number of extracted lines is the number of pixel lines in the vertical or horizontal direction of slit image information SLj (such as FIG. 6C) cut out from each frame by a moving slit window. In the following description, the slit image information is simply expressed as a line as necessary.

  Next, the index generation unit 87 checks the input index generation mode. As a result, in the whole extraction mode, that is, the mode that does not use the partial extraction method (step S104; Y) and the mode that does not use the frame mixing method (step S105; N), the index generation unit 87. Performs index generation processing in either the M1 mode or the M2 mode (steps S106 and S107). Specifically, index generation processing is performed in the M1 mode when using the vertical extraction method, and in the M2 mode when using the horizontal extraction method.

  If the mode is the whole extraction mode (step S104; Y) and the mode uses the frame mixing method (step S105; Y), the index generation unit 87 further includes an insertion frame (in FIG. 9C). Sampling points of frame Fα1 etc. are fetched (step S108). Then, the index generation unit 87 performs index generation processing in either the M3 mode or the M4 mode based on the input number of extracted frames, number of extracted lines n, and sampling point data of the insertion frame (step S109). , S110). Specifically, index generation processing is performed in the M3 mode when using the vertical extraction method, and in the M4 mode when using the horizontal extraction method.

  On the other hand, if the set generation mode is a mode that uses the partial extraction method (step S104; N), the index generation unit 87 further determines the extraction target region (that is, the partial frame Fj shown in FIG. 8C). The data specifying the size of 'and the position within the frame) is fetched (step S111). Next, the index generation unit 87 checks whether or not the set generation mode is a mode using the frame mixing method. As a result, when the frame mixing method is not used (step S112; N), the index generation unit 87 performs M5 based on the input number of extracted frames, number of extracted lines n, and extraction target area data. The index generation process is executed in either the mode or the M6 mode (steps S113 and S114). Specifically, index generation processing is performed in the M5 mode when using the vertical extraction method, and in the M6 mode when using the horizontal extraction method.

  If the frame mixing method is used (step S112; Y), the index generation unit 87 further captures the sampling point of the insertion frame (step S115). Then, the index generation unit 87 performs index generation processing in either the M7 mode or the M8 mode based on the input data of the number of extracted frames, the number of extracted lines n, the extraction target region, and the sampling points of the insertion frames. Execute (Steps S116 and S117). Specifically, index generation processing is performed in the M7 mode when using the vertical extraction method, and in the M8 mode when using the horizontal extraction method.

  As described above, the index generation unit 87 performs VD index image generation processing according to the requested generation mode.

  Next, as an actual processing example in the index generation unit 87, processing when index generation is performed in the M7 mode will be described with reference to FIG. Note that, as described above, the M7 mode is a mode in which the vertical extraction method and the frame mixing method are used together with partial frames as extraction targets.

  First, the index generation unit 87 sets the moving slit window to the initial position, then extracts a frame from the moving image file, and performs an expansion process by the MPEG processing unit 64 (step S201).

  Next, the index generation unit 87 extracts a line extraction target region (partial frame Fj ′ in FIG. 8C) from one frame (step S202), and from the partial frame Fj, a specified number (n The vertical line is extracted (step S203). Next, the index generation unit 87 moves n moving slit windows (step S204).

  The index generation unit 87 monitors the total number of lines extracted so far, and the total number of extracted lines does not reach a predetermined number (that is, the number of lines used to form one VD index image). (Step S204; N), the process returns to Step S201 again, and the processes of Steps S201 to S203 are performed.

  On the other hand, when the total number of extracted lines reaches a predetermined number (step S204; Y), the index generation unit 87 connects the extracted lines to generate one still image (step S206), and further generates the generated still image. The image is compressed to generate one VD index image IVi ′ (FIG. 8E), and a serial number is assigned thereto (step S207).

  Next, the index generation unit 87 registers the partial frame Fj ′ that provides the line at the left end portion of the generated VD index image IVi ′ as an insertion frame Fα1 or the like (FIG. 9C). A serial number following the VD index image IVi ′ is assigned (step S208).

  Further, the index generation unit 87 registers the partial frame Fj ′ that provides the line of the central portion of the generated VD index image IVi ′ as an index representative still image SP ′ (FIG. 8E). The same serial number as that of the VD index image IVi ′ is assigned (step S209).

  If all the frames of the moving image file have not been processed yet (step S210; N), the index generation unit 87 returns to step S201 and repeats the processes of steps S201 to S209.

  When the processing of all the frames of the moving image file is completed (step S210; Y), the margin portion is blackened so that the size of the VD index image generated last is the same as the size of the other VD index images. Perform the painting process. Further, the index generation unit 87 generates the number of generated VD index image files IVi ′, the generation parameters used for index generation (that is, the number of frames used to generate one VD index image, and the extraction lines per frame. The number n, the direction of the extraction line, the size of the extraction target area (partial frame), the position in the frame, the sampling point of the insertion frame, etc.) are registered as index related information (step S211), and the index generation process is terminated. .

  In this way, in the example of the M7 mode shown in FIG. 12, one VD index image group in which an insertion frame is inserted between each VD index image is formed for a moving image of one title. The The generated VD index image group and index related information are sent to the web server 3 via the network 2 and stored in the index storage unit 74 and the index related information storage unit 76, respectively. Each VD index image and insertion frame constituting this VD index image group have serial numbers given in the respective generation processes, and are managed by this serial number. It is handled in the same way as the generated VD index image group.

  In FIG. 12, an example in the case of the M7 mode has been described, but the other modes also differ depending on the presence or absence of processing steps for applying the partial extraction method and the frame mixing method. The processing of each basic part is almost the same as in FIG. 12, and the description thereof is omitted.

  FIGS. 13A to 13C and FIGS. 14A to 14C represent actual examples of VD index images generated in various generation modes based on the same moving image. Each of FIGS. 13A to 13C shows a VD index image group generated in the M1 mode (a mode in which a vertical line is extracted from the entire frame and no frame for insertion is mixed). Of these, FIG. 13A shows the case where the number of extraction lines per frame is 1, FIG. 13B shows the case where the number of extraction lines per frame is 2, and FIG. 13C shows the extraction per frame. This is a case where the number of lines is four.

  As can be seen from these figures, the smaller the number of extracted lines, the smaller the number of VD index images that are generated. On the other hand, since the degree of contraction increases, it is difficult to grasp the contents of the original moving image. It's not easy. Conversely, as the number of extracted lines increases, the number of generated VD index images increases. However, since the degree of contraction is small, it is easy to grasp the contents of the original moving image.

  FIG. 14A shows a VD index image group generated when the number of extracted lines per frame is 2 in the M2 mode (a mode in which horizontal lines are extracted from the entire frame and no frame for insertion is mixed). FIG. 14B shows a VD index image group generated when the number of extracted lines per frame is 2 in the M5 mode (a mode in which a vertical line is extracted from a partial frame and an insertion frame is not mixed). In this case, the size of the partial frame is 70% of the original frame, and the extraction position of the partial frame is the central portion of the original frame. FIG. 14C shows a VD index image group generated when the number of extracted lines per frame is 2 in the M3 mode (a mode in which vertical lines are extracted from the entire frame and frames for insertion are mixed). ing. In this case, the insertion frame is extracted from the original moving image frame at regular intervals (5 seconds in the example in this figure).

  As can be seen from the comparison between FIG. 14A and FIG. 13B, the generation conditions of both are the same except for the line extraction direction (vertical or horizontal), but the number of VD index images in the former is larger than that in the latter. . This is because the number of vertical lines in a frame is different from the number of horizontal lines. 14A and 13B have different line extraction directions, the contents of the VD index images are quite different from each other. As described above, for example, when a moving image as a material is taken while panning in the horizontal direction, it is preferable to use vertical line extraction as shown in FIG. 13B, and while panning in the vertical direction. In the case of an image taken, it is preferable to use horizontal line extraction as shown in FIG. 14A.

  As can be seen from a comparison between FIG. 14B and FIG. 13B, the generation conditions of both are the same except for the line extraction target region, but the size of each VD index image in the former is smaller than that in the latter. This is because the former extracts lines from partial frames, while the latter extracts lines from the entire original frame. Here, in the case of partial extraction as shown in FIG. 14B, as described above, the size of the VD index image is small and the amount of data is small. Therefore, a storage area (specifically, The size of the index storage unit 74 or the like of the web server 3 may be small.

  Further, as can be seen from a comparison between FIGS. 14C and 13B, the generation conditions of both are the same except for whether or not frames are mixed, but the number of elements included in the latter VD index image group is More than that. This is because the latter includes an insertion frame in addition to the generated VD index image. However, as described above, in the latter case, since the original frame is included as it is, it becomes easier to grasp the contents of the original moving image.

  Next, the overall operation of the moving image search / distribution system having the above-described configuration will be described with reference to FIGS. 15 and 16. FIG. 15 and 16 show a series of operations in the web server 3, the terminal device 4, the moving image server 5, and the database server 6 separately. Here, in response to a search request from the terminal device, the web server 3 and the database server 6 search for a VD index image for the corresponding moving image, and display this on the browser screen of the terminal device 4 and display it. A series of operations of displaying an index representative still image corresponding to the selected one of the VD index images and reproducing and displaying a moving image corresponding to the selected VD index image will be described. Note that here, the VD index image and the index representative still image for the moving image already stored in the moving image storage unit 85 of the moving image server 5 are the index storage unit 74 and the still image storage unit of the web server 3, respectively. 79 is stored.

  When the internet browser unit 81 is activated in the terminal device 4 (S1 in FIG. 15), the internet browser unit 81 accesses the web server 3 via the network 2 (S2). When receiving the access from the terminal device 4, the internet server unit 71 of the web server 3 reads the GUI data describing the homepage for video search from the GUI data storage unit 78 and distributes it to the terminal device 4 (S3).

  The internet browser unit 81 of the terminal device 4 displays the initial screen (not shown) of the homepage for video search on the browser screen of the display device 32 (FIG. 2) based on the GUI data sent from the web server 3. (S4).

  Here, when a moving image search keyword (hereinafter simply referred to as a keyword) is input (S5), the Internet browser unit 81 transmits the input keyword to the web server together with the moving image search request (S6).

  When the Internet server unit 71 of the web server 3 receives the moving image search request and the keyword from the terminal device 4, it starts up the database search unit 72. The database search unit 72 transmits the moving image information search command code together with the keyword to the database server 6 via the Internet server unit 71 and the network 2 (S7).

  The search processing unit 92 of the database server 6 searches the database 91 based on the received keyword, and transmits the search result to the web server 3 (S8). The web server 3 that has received the search result from the database server 6 activates the index search unit 73. The index search unit 73 searches the index storage unit 74 based on the search result from the database server 6 to extract the corresponding VD index file (S9), and passes this to the GUI data generation unit 77.

  The GUI data generation unit 77 generates GUI data based on the search result from the database server and the search result of the index storage unit (S10). This GUI data includes the title name of the moving image, the moving image file name, the storage location of the moving image file in the moving image server 5, the VD index image, and the like.

  When creating GUI data, index related information including the display format, display number, arrangement, and the like of the VD index image stored in the index related information storage unit 76 is referred to. GUI data having contents that can realize an optimal screen layout according to the length, the browser screen size of the display device 32 of the terminal device 4, and the like is created. Here, the index related information is, for example, data indicating the browser screen size of the display device 32 of the terminal device 4 or data indicating the length of the searched moving image transmitted together with the access request from the terminal device 4. Based on this, it is generated by the index related processing unit 75 and stored in the index related information storage unit 76.

  Next, the GUI data generation unit 77 stores the generated GUI data in the GUI data storage unit 78 and transmits it to the terminal device 4 as a search result (S11).

  The internet browser unit 81 of the terminal device 4 receives the GUI data sent from the web server 3 and, based on this data, in the index display area 102 of the search result display screen as shown in FIG. As the contents of the search result, the keyword, the number of corresponding moving images 106, the title name of the moving images, and the VD index image groups 107 and 108 are displayed (S12).

  Here, the internet browser unit 81 of the terminal device 4 monitors the position of the mouse pointer 109 and the presence or absence of a click, and the mouse pointer 109 (FIG. 4) is placed on any VD index image, and If it is determined that no click has been made, information for specifying the VD index image (hereinafter referred to as index specifying information) is acquired (S13 in FIG. 16). The index specifying information includes, for example, a VD index file name and a serial number assigned to the VD index image. And the internet browser part 81 transmits the request | requirement which requests | requires transmission of an index representative still image to the web server 3 with this acquired index specific information (S14).

  The Internet server unit 71 of the web server 3 acquires the index representative still image requested from the terminal device 4 from the still image storage unit 79 and transmits it to the terminal device 4 (S15).

  The internet browser unit 81 of the terminal device 4 receives the index representative still image sent from the web server 3 and displays it in the still image display area 103 (FIG. 4) of the browser screen (S16).

  Further, the internet browser unit 81 of the terminal device 4 monitors the position of the mouse pointer and the presence or absence of a click, and is clicked with the mouse pointer 109 (FIG. 4) being placed on any VD index image. If it is determined that the index identification information is obtained for the VD index image (S17). Then, the Internet browser unit 81 transmits a request for transmission of a moving image reproduction command code to the web server 3 together with the acquired index specifying information (S18).

  When the Internet server unit 71 of the web server 3 receives the transmission request for the moving image reproduction command code and the index specifying information sent from the terminal device 4, the Internet server unit 71 specifies the corresponding moving image based on the VD index specifying information. Then, a moving image playback command code including a moving image file name, a moving image file storage position, a playback start position, and the like is generated and transmitted to the terminal device 3 (S19).

  The internet browser unit 81 of the terminal device 4 receives the moving image playback command code from the web server 3, and requests the moving image server 5 to distribute moving images based on the received code (S20).

  The moving image distribution unit 86 of the moving image server 5 takes out the corresponding moving image from the moving image storage unit 85 based on the moving image reproduction command code sent from the terminal device 4 and sends it to the terminal device 4 in real time. Distribute (S21). At this time, the moving image distribution unit 86 extracts and distributes the moving image data in the moving image storage unit 85 from the reproduction start position specified by the moving image reproduction instruction code in a compressed state.

  The moving image playback unit 82 of the terminal device 4 performs moving image data distributed from the moving image server 5 on the moving image display area 104 (FIG. 4) of the browser screen while expanding the moving image data. It is displayed (S22). At this time, the reproduction start position of the moving image is, for example, a position corresponding to the head portion of the selected VD index image.

  In this state, when an operation such as playback, stop, pause, high speed playback, reverse playback or high speed reverse playback of the moving image 104a is performed on the operation unit 104c with the mouse pointer 109, the Internet browser unit 81 An instruction code corresponding to the operation is transmitted to the moving image server 5. Receiving these instruction codes, the moving image distribution unit 86 of the moving image server 5 reproduces and distributes the moving images in the moving image storage unit 85 to the terminal device 4 in a manner corresponding to the instruction codes. All of these operations are performed in near real time. When the enlarged display icon 104d in FIG. 4 is clicked, the Internet browser unit 81 displays the moving image 104a in an enlarged manner on the entire browser screen.

  As described above, according to the moving image search / distribution system of the present embodiment, the generation processing can be performed by a plurality of different methods when generating the VD index image by reducing the content of the moving image. As a result, it is possible to generate a VD index image in an appropriate mode according to the nature and use of the material.

  Although the present invention has been described with reference to the embodiment, the present invention is not limited to this embodiment, and various modifications can be made.

  For example, in the above-described embodiment, the line extraction direction has been described as either vertical or horizontal. However, the line may be extracted in another direction (oblique direction). Further, the present invention is not limited to line extraction, and block extraction for extracting image data from each frame may be performed using a rectangular or other shape block window that moves with time.

  In the above embodiment, as shown in FIGS. 8A to 8C, the partial frame is extracted from the central portion of the original frame. However, the present invention is not limited to this, and other portions are extracted. For example, the left or right half of the frame, or the upper or lower half of the frame may be extracted as a partial frame. However, generally, since an important image is often included in the central portion of the frame, it is preferable to extract the partial frame from the central portion.

  Further, in the above embodiment, as shown in FIGS. 9A to 9C, the insertion frames are inserted and arranged between all of the generated VD index images. For example, it may be inserted in another manner. For example, it is also possible to insert and dispose insertion frames intermittently (jumpingly) instead of all between VD index images. Further, the sampling of the insertion frame may be performed at an arbitrary timing in the moving image.

  In the above embodiment, the index generation unit 87 is arranged in the moving image server 5, but may be arranged in the web server 3. Alternatively, only the index generation unit 87 may be configured as an independent server and connected to the network 2.

  In the above embodiment, the moving image search / distribution system in which the web server 3, the terminal device 4, the moving image server 5, and the database server 6 are distributed and connected to each other via the network 2 has been described. However, it is possible to configure all of these elements in the same device as a stand-alone type moving image search device.

  DESCRIPTION OF SYMBOLS 3 ... Web server, 4 ... Terminal device, 5 ... Moving image server, 6 ... Database server, 71 ... Internet server part, 72 ... Database search part, 73 ... Index search part, 74 ... Index storage part, 75 ... Index related process , 76 ... index related information storage unit, 77 ... GUI data generation unit, 78 ... GUI data storage unit, 79 ... Still image storage unit, 81 ... Internet browser unit, 82 ... Moving image playback unit, 85 ... Moving image storage unit , 86 ... moving image distribution unit, 87 ... index generation unit.

Claims (16)

Index image generating means for generating an index image as a still image that represents a portion of a plurality of still images arranged in time series so as to constitute a moving image, and that represents the content of the moving image in a reduced form An image generation apparatus comprising:
The index image generation means has a function capable of extracting a part from each of the plurality of still images in a plurality of different modes and generating an index image corresponding to each mode based on the extracted portion. And
The plurality of different aspects includes an aspect in which a partial image elongated in the vertical direction is extracted from each of the plurality of still images with an arbitrary number of designated pixel lines. The plurality of different modes include a mode of extracting a part from a limited area in each of the plurality of still images,
The image generation apparatus according to claim 1, wherein an image having an image size smaller than that of an extraction source still image is generated as the index image.   The image generation apparatus according to claim 2, wherein the limited area is a central area in each of the plurality of still images. The index image generation means further includes
The image generating apparatus according to claim 1, further comprising a function of extracting any one of the plurality of still images and using the extracted still image as an index image. Index image generating means for generating an index image as a still image that represents a portion of a plurality of still images arranged in time series so as to constitute a moving image, and that represents the content of the moving image in a reduced form An image generation apparatus comprising:
The index image generation means has a function capable of extracting a part from each of the plurality of still images in a plurality of different modes and generating an index image corresponding to each mode based on the extracted portion. And
The plurality of different aspects includes an aspect in which a horizontally elongated partial image is extracted from each of the plurality of still images with a specified number of pixel lines. The plurality of different modes include a mode of extracting a part from a limited area in each of the plurality of still images,
The image generation apparatus according to claim 5, wherein an image having an image size smaller than that of an extraction source still image is generated as the index image.   The image generation apparatus according to claim 6, wherein the limited area is a central area in each of the plurality of still images. The index image generation means further includes:
The image generating apparatus according to claim 5, further comprising a function of extracting any one of the plurality of still images from the plurality of still images and using the extracted still image as an index image. An index image as a still image that is obtained by combining a part of a plurality of still images arranged in time series so as to constitute a moving image and expressing the content of the moving image in a reduced form, An image generation method for generation by a generation means,
As a procedure executed by the index image generating means,
Extracting a portion from each of the plurality of still images according to an aspect selected from a plurality of aspects for extracting a portion from each of the plurality of still images;
Combining the extracted portions to generate an index image,
The plurality of different modes include a mode of extracting a partial image that is elongated in the vertical direction from each of the plurality of still images with an arbitrary number of designated pixel lines. The plurality of different modes include a mode of extracting a part from a limited area in each of the plurality of still images,
The image generation method according to claim 9, wherein an image having an image size smaller than that of an extraction source still image is generated as the index image.   The image generation method according to claim 10, wherein the limited region is a central region in each of the plurality of still images.   The image generation method according to claim 9, further comprising extracting one of the still images from the plurality of still images and using the extracted still image as an index image. An index image as a still image that is obtained by combining a part of a plurality of still images arranged in time series so as to constitute a moving image and expressing the content of the moving image in a reduced form, An image generation method for generation by a generation means,
As a procedure executed by the index image generating means,
Extracting a portion from each of the plurality of still images according to an aspect selected from a plurality of aspects for extracting a portion from each of the plurality of still images;
Combining the extracted portions to generate an index image,
The plurality of different aspects include an aspect in which a horizontally elongated partial image is extracted from each of the plurality of still images with a specified arbitrary number of pixel lines. The plurality of different modes include a mode of extracting a part from a limited area in each of the plurality of still images,
The image generation method according to claim 13, wherein an image having an image size smaller than that of an extraction source still image is generated as the index image.   The image generation method according to claim 14, wherein the limited region is a central region in each of the plurality of still images.   14. The image generation method according to claim 13, further comprising extracting any one of the plurality of still images and using the extracted still image as an index image.

Images