JP2009111643A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus for generating a thumbnail that helps a user grasp image data stored in a recording medium, an image processing method, and a program. <P>SOLUTION: The image processing apparatus is provided, which includes an image determining part for reading a file and determining image data in the read file, and a group thumbnail generating part for generating thumbnails corresponding to respective pieces of the image data on the basis of the image data determined by the image determining part and generating a group thumbnail obtained by grouping the thumbnails. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing device, an image processing method, and a program.

  In recent years, digital still cameras, digital video cameras (Digital video cameras) such as “Handycam” for which the applicant has a trademark right, mobile phones with digital camera functions, etc. Devices having an imaging function for imaging have become widespread. Since the imaging function is provided in a portable device such as a mobile phone, for example, the frequency with which the user performs imaging increases and the number of images to be captured also increases. In addition, the storage capacity of recording media for storing captured image data is also increasing, and devices having an imaging function and computers such as PCs (Personal Computers) store more image data in one recording medium. It is possible to memorize.

  A user who uses the apparatus as described above can check the still image and the moving image stored in the recording medium at a later date (for example, the current day, a few days, or a few years later), thereby recollecting the scene at the time of shooting. Can be soaked in. Further, in the process of confirming the still image and the moving image stored in the recording medium, the user selects a specific image such as an image in which the subject is smiling from the still image or the moving image stored in the recording medium. It is also possible to find an image and extract the specific image.

  As a large amount of image data is recorded in one recording medium as described above, the time required for the user to grasp the image data stored in the recording medium increases, and what kind of image is given to the user. There is an increasing need for means for transmitting whether data is stored in a recording medium. For this reason, an imaging device such as a digital camera or a computer such as a PC uses a display method called “thumbnail” that displays a plurality of images as a list, that is, “thumbnail display”. ing.

  Under such circumstances, a technique for managing image data stored in a recording medium has been developed in order to assist the user to grasp the image data stored in the recording medium. As a technique for managing the image data stored in the recording medium by grouping the image data stored in the recording medium, for example, Patent Document 1 is cited.

JP 2007-181150 A

  The number of thumbnails (reduced image data) displayed on one screen in thumbnail display in a digital camera, a PC, or the like can be increased according to the screen size of the display device. However, since the number of thumbnails that can be displayed on one screen is limited, it is difficult for the user to find a desired image from among the images displayed as thumbnails as the number of images displayed at one time increases. It has become. In addition, when more images than the number that can be displayed on one screen are displayed as thumbnails at a time, for example, a display method called scroll may be used together. The amount of information in the image does not change.

  Further, the conventional technique for managing the image data stored in the recording medium is configured such that the number of images displayed as thumbnails by grouping the image data stored in the recording medium is the number of image data stored in the recording medium. However, if a number of images that cannot be displayed on a single screen are displayed as thumbnails at a time, the user can select a desired image from the displayed thumbnails. It is difficult to find.

  The present invention has been made in view of the above problems, and an object of the present invention is a novel and capable of generating thumbnails that assist the user to grasp the image data stored in the recording medium. An object is to provide an improved image processing apparatus, an image processing method, and a program.

  In order to achieve the above object, according to a first aspect of the present invention, an image determination unit that reads a file, determines image data from the read file, and the image data determined by the image determination unit. An image processing apparatus is provided that includes a thumbnail corresponding to each of the image data and a group thumbnail generation unit that generates a group thumbnail in which the thumbnails are grouped.

  With this configuration, it is possible to generate a thumbnail (group thumbnail) that assists the user in understanding the image data stored in the recording medium.

  In addition, an imaging unit that performs imaging, a storage unit that stores image data captured by the imaging unit, a meta information addition unit that adds meta information for identifying the image data to the image data captured by the imaging unit, , An image recording unit that records image data captured by the imaging unit in the storage unit, and image data that selectively reads out image data from the image data stored in the storage unit based on conditions relating to meta information The group thumbnail generation unit may further generate a group thumbnail based on the image data read by the image data reading unit.

  With this configuration, image data that meets the conditions regarding the meta information is read from the recording medium, and a thumbnail (group thumbnail) that assists the user in understanding the image data that matches the conditions regarding the meta information stored in the recording medium is generated. Can do.

  The meta information addition unit may include a face detection unit that detects a face area of a subject from image data captured by the imaging unit, and may add information on the face area as the meta information.

  With this configuration, face area information can be added to image data.

  The meta information adding unit includes an image specifying auxiliary information generating unit that generates image specifying auxiliary information for specifying an imaging location and / or an imaging time of the image data captured by the imaging unit, and the meta information includes the image specifying auxiliary information generating unit. Image specifying auxiliary information may be added.

  With this configuration, it is possible to add the image data imaging location and / or imaging time to the image data.

  The meta information addition unit may include an image analysis unit that generates image analysis information by analyzing the image data captured by the imaging unit, and may add the image analysis information as the meta information.

  With this configuration, the result of image analysis can be added to the image data.

  The image analysis unit may generate color information indicating a ratio of colors included in each of the image data as the image analysis information.

  With this configuration, color information indicating the color ratio can be added to the image data.

  In addition, an operation unit may be further provided that inputs conditions relating to the meta information to the image data reading unit.

  With this configuration, it is possible to selectively read out image data desired by the user.

  The storage unit stores a database in which the image data captured by the imaging unit and the meta information corresponding to the image data are recorded in association with each image data, and the image captured by the imaging unit A database recording unit that records the data and the meta information corresponding to the image data in association with each other and records the data in the database, and the image data reading unit stores the image data based on the database and the condition relating to the meta information; You may selectively read.

  With this configuration, it is possible to selectively read out image data that meets the conditions regarding the meta information.

  Further, the image processing apparatus further includes a file capturing unit that captures a file from an external device and determines image data from the captured file, and the meta information adding unit adds meta information to the image data determined by the file capturing unit. The image recording unit may record the image data determined by the file capturing unit in the storage unit.

  With this configuration, it is possible to add meta information to image data captured from an external device and record it in the storage unit.

  The display unit may further include a display unit that displays the group thumbnail generated by the group thumbnail generation unit.

  With this configuration, a group thumbnail can be presented to the user.

  Further, an operation unit for designating a file to be read by the image determination unit may be further provided.

  With this configuration, a group thumbnail can be generated based on a file selected by the user.

  In order to achieve the above object, according to a second aspect of the present invention, a step of reading a file, determining image data from the read file, and determining the image data determined in the determining step And generating a thumbnail corresponding to each of the image data, and generating a group thumbnail in which the thumbnails are grouped based on the thumbnail generated in the step of generating the thumbnail. A processing method is provided.

  By using such a method, it is possible to generate a thumbnail (group thumbnail) that assists the user to grasp the image data stored in the recording medium.

  In order to achieve the above object, according to a third aspect of the present invention, a step of reading a file and determining image data from the read file is based on the image data determined in the determining step. Generating a thumbnail corresponding to each of the image data, and generating a group thumbnail in which the thumbnails are grouped based on the thumbnail generated in the step of generating the thumbnail. Programs are provided.

  With such a program, it is possible to generate a thumbnail (group thumbnail) that assists the user in understanding the image data stored in the recording medium.

  According to the present invention, it is possible to generate a thumbnail that assists the user in grasping image data stored in a recording medium.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

  In the following description, the image processing apparatus according to the embodiment of the present invention is described as processing image data. However, the image data according to the embodiment of the present invention may be data indicating a still image, Alternatively, it may be data indicating a moving image (so-called video).

(Outline of thumbnails generated by the image processing apparatus according to the embodiment of the present invention)
Before describing the image processing apparatus according to the embodiment of the present invention, an outline of thumbnails generated by the image processing apparatus according to the embodiment of the present invention will be described.

  An image processing apparatus according to an embodiment of the present invention generates a thumbnail from image data stored on a recording medium in order to assist the user to grasp the image data stored on the recording medium. Here, the thumbnail generated by the image processing apparatus according to the embodiment of the present invention is different from the thumbnail generated by the conventional image processing apparatus. Hereinafter, a thumbnail generated by the conventional image processing apparatus and a thumbnail generated by the image processing apparatus according to the embodiment of the present invention will be described.

[Thumbnail generated by conventional image processing device]
FIG. 1 is an explanatory diagram showing an example of thumbnail display using thumbnails generated by a conventional image processing apparatus. As shown in FIG. 1, in a thumbnail display using thumbnails generated by a conventional image processing apparatus, a number (for example, nine in FIG. 1) of thumbnails tn1 to tn9 are displayed in one screen. Each thumbnail corresponds to one image. Further, in the thumbnail display using the thumbnails generated by the conventional image processing apparatus, when the number of generated thumbnails exceeds the number displayed in one screen, the scroll bar sc0 is displayed to enable scroll display.

  Therefore, in the thumbnail display using the thumbnails generated by the conventional image processing apparatus, an information amount corresponding to nine images can be given to the user in one screen.

[Thumbnail Generated by Image Processing Apparatus According to Embodiment of Present Invention]
Next, thumbnails generated by the image processing apparatus according to the embodiment of the present invention will be described. FIG. 2 is an explanatory diagram for explaining generation of thumbnails in the image processing apparatus according to the embodiment of the present invention.

  First, an outline of thumbnail generation processing in the image processing apparatus according to the embodiment of the present invention will be described. The conventional image processing apparatus generates one thumbnail from one image data as shown in FIG. 1, whereas the image processing apparatus according to the embodiment of the present invention generates one thumbnail from a plurality of image data. To do. That is, the thumbnails generated by the image processing apparatus according to the embodiment of the present invention have an information amount in which one thumbnail corresponds to a plurality of images. Hereinafter, a thumbnail generated from a plurality of image data according to an embodiment of the present invention (a thumbnail having information on a plurality of images), that is, a thumbnail in which so-called general thumbnails as shown in FIG. It is called “group thumbnail”.

  The image processing apparatus according to the embodiment of the present invention generates a group thumbnail by, for example, the following processes (I) to (III).

(I) Reading Image Data for Creating Group Thumbnail An image processing apparatus according to an embodiment of the present invention reads image data for creating a group thumbnail from a recording medium. Here, the recording medium is not limited to image data representing an image, but includes various data such as system data constituting an OS (Operating System), application programs, and application data (for example, document data) generated by the application programs. Data can be stored (hereinafter, the generic name of each data stored in the recording medium is referred to as “file”). That is, the data read from the recording medium is not always image data. Therefore, the image processing apparatus according to the embodiment of the present invention selectively reads image data from the recording medium by reading the file stored in the recording medium and determining the image data from the file.

(II) Generation of Thumbnail The image processing apparatus according to the embodiment of the present invention generates thumbnails TnA to TnD corresponding to each of the image data as shown in FIG. 2, for example, from the image data read in (I). Note that the image processing apparatus according to the embodiment of the present invention does not perform processing when there is no processing target, such as when the file read in (I) does not include image data.

(III) Generation of Group Thumbnail The image processing apparatus according to the embodiment of the present invention generates a group thumbnail based on the thumbnail generated in (II) above. When the number of thumbnails generated in (II) is, for example, one or less than a predetermined number, the image processing apparatus according to the embodiment of the present invention can skip the group thumbnail creation process. Further, the image processing apparatus according to the embodiment of the present invention can arbitrarily execute a group thumbnail creation process based on the thumbnail generated in (II). In the following, a group thumbnail generated based on the thumbnails TnA to TnD shown in FIG. 2 is illustrated, but the group thumbnail according to the embodiment of the present invention is generated based on the thumbnail generated from the four image data. It goes without saying that it is not limited to this.

(III-1) First Example of Group Thumbnail: Arrangement FIG. 3 is an explanatory diagram showing a first example of a group thumbnail generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 3, the image processing apparatus according to the embodiment of the present invention can generate a group thumbnail in which thumbnails TnA to TnD are arranged.

(III-2) Second Example of Group Thumbnail: Partial Cutout FIG. 4 is an explanatory diagram showing a second example of a group thumbnail generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 4, the image processing apparatus according to the embodiment of the present invention can generate a group thumbnail in which a part of the thumbnail is cut out and the ratio is changed.

(III-3) Third Example of Group Thumbnail: Superposition / Rotation FIG. 5 is an explanatory diagram showing a third example of the group thumbnail generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 5, the image processing apparatus according to the embodiment of the present invention can generate a group thumbnail in which thumbnails are superimposed and rotated.

(III-4) Fourth Example of Group Thumbnail: Reduction Ratio Change FIG. 6 is an explanatory diagram showing a fourth example of the group thumbnail generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 6, the image processing apparatus according to the embodiment of the present invention can generate a group thumbnail in which the thumbnail reduction ratio is changed.

(III-5) Fifth Example of Group Thumbnail: Panorama Synthesis In the first to fourth examples of the group thumbnail, groups generated using four thumbnails TnA to TnD generated from image data that are not related to each other. Although a thumbnail is shown, the group thumbnail according to the embodiment of the present invention is not limited to the above. For example, the group thumbnail according to the embodiment of the present invention can be generated from image data related to each other, such as image data obtained by capturing the same subject at approximately the same time.

  FIG. 7 is an explanatory diagram showing a fifth example of group thumbnails generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 7A, when three image data Left, Center, and Right imaged from the same bridge are stored in the recording medium, as shown in FIG. The image processing apparatus according to the above can generate a panoramic synthesized group thumbnail. Here, the image processing apparatus according to the embodiment of the present invention can determine image data related to each other based on meta information to be described later, and generate a panorama combined group thumbnail.

  The image processing apparatus according to the embodiment of the present invention can generate a group thumbnail by, for example, the processes (I) to (III). The group thumbnails shown in FIGS. 3 to 7 are examples of group thumbnails generated by the image processing apparatus according to the embodiment of the present invention, and the group thumbnails according to the embodiment of the present invention are the above first to fifth. It goes without saying that it is not limited to examples.

  FIG. 8 is an explanatory diagram showing an example of group thumbnail display using thumbnails generated by the image processing apparatus according to the embodiment of the present invention. As shown in FIG. 8, the image processing apparatus according to the embodiment of the present invention includes a group thumbnail (Tn1, Tn3, Tn6 in FIG. 8) according to the first example, and a group thumbnail according to the second example (FIG. 8). 8 Tn5), the group thumbnail according to the third example (Tn4 in FIG. 8), the group thumbnail according to the fourth example (Tn2 in FIG. 8), the group thumbnail according to the fifth example (FIG. 8). Tn8) and a normal thumbnail (Tn7 in FIG. 8) are generated, and a thumbnail display in which group thumbnails and thumbnails are arbitrarily mixed can be performed. Further, in the thumbnail display according to the embodiment of the present invention, when the number of generated group thumbnails and thumbnails exceeds the number to be displayed in one screen, the scroll bar sc1 is displayed to enable scroll display.

  In the thumbnail display using the group thumbnails generated by the image processing apparatus according to the embodiment of the present invention shown in FIG. 8, the number of thumbnails is eight, but 28 images are included in one screen. . Therefore, in the thumbnail display using the group thumbnail generated by the image processing apparatus according to the embodiment of the present invention shown in FIG. 8, an information amount corresponding to 28 images can be given to the user in one screen.

  On the other hand, in the thumbnail display using thumbnails generated by the conventional image processing apparatus shown in FIG. 1, nine images are displayed in one screen even though the number of displayed thumbnails is larger than that in FIG. Only the amount of information corresponding to minutes can be given to the user. Therefore, the image processing apparatus according to the embodiment of the present invention can present information related to more image data to the user at a time by generating a group thumbnail than a thumbnail generated by a conventional image processing apparatus. Therefore, it is possible to assist the user to grasp the image data stored in the recording medium.

[Screen transition example when a group thumbnail is selected]
As shown in FIG. 8, since the image processing apparatus according to the embodiment of the present invention generates various group thumbnails based on a plurality of image data, a plurality of image data are related to one group thumbnail. Thus, next, an example of screen transition when a group thumbnail according to the embodiment of the present invention is selected is shown. Here, the selection refers to, for example, a user specifying a specific group thumbnail using an operation input device such as a button or a mouse, but is not limited thereto.

  FIG. 9 is an explanatory diagram showing an example of screen transition when a group thumbnail is selected according to the embodiment of the present invention. In FIG. 9, as illustrated in FIG. 9A, the fifth example of the group thumbnail Tn8 in FIG. 8, that is, the group thumbnail illustrated in FIG. 7 will be described as an example.

[1] First example of screen transition: transition to a screen displaying a plurality of thumbnails FIG. 9B shows a first example of screen transition when a group thumbnail according to the embodiment of the present invention is used. ing. When group thumbnail Tn8 is selected in FIG. 8, as shown in FIG. 9B, thumbnails TnLeft, TnCenter, and TnRight corresponding to the image data (FIG. 7A) constituting the group thumbnail Tn8 are respectively displayed. Is displayed.

  In addition, in FIG. 9B, when any of the thumbnails TnLeft, TnCenter, and TnRight is selected, a transition is made to a screen on which an image corresponding to the selected thumbnail is displayed.

[2] Second Example of Screen Transition: Transition to a Screen Displaying a Representative Image FIG. 9C shows a second example of screen transition when a group thumbnail according to the embodiment of the present invention is used. ing. When the group thumbnail Tn8 is selected in FIG. 8, as shown in FIG. 9C, on the screen that displays the representative image of the image data (FIG. 7A) constituting the group thumbnail Tn8. Transition. FIG. 9C shows an example in which the image data Center shown in FIG. 7A is displayed as a representative image.

  When the group thumbnail generated by the image processing apparatus according to the embodiment of the present invention is selected, for example, as shown in FIGS. 9B and 9C, the thumbnails and image data constituting the group thumbnail are displayed. It is possible to transition to a screen on which is displayed. Needless to say, the transition according to the embodiment of the present invention is not limited to FIGS. 9B and 9C. In addition, when a thumbnail (for example, a normal thumbnail such as Tn7 in FIG. 8) generated by the image processing apparatus according to the embodiment of the present invention is selected, the screen displays image data corresponding to the thumbnail. And transition.

[Configuration of Image Group According to Embodiment of Present Invention]
FIG. 9 shows an example of screen transition when the group thumbnail according to the embodiment of the present invention is selected. The screen transition by the selection is performed based on the image group to which the selected group thumbnail belongs. Then, next, the structure of the image group which concerns on embodiment of this invention is demonstrated.

  FIG. 10 is an explanatory diagram for explaining a configuration of an image group according to the embodiment of the present invention. In FIG. 10, a first example of the group thumbnail shown in FIG. 3 will be described as an example.

  Referring to FIG. 10, the image group according to the embodiment of the present invention includes a group thumbnail GTn and subgroups Gp1 to Gp4 of each image data constituting the group thumbnail GTn. The subgroup is composed of image data and thumbnails generated from the image data (for example, the subgroup Gp1 is composed of image data A and thumbnail TnA).

  The image processing apparatus according to the embodiment of the present invention can generate a group thumbnail for each image group having a relationship as shown in FIG. Note that the image processing apparatus according to the embodiment of the present invention can record the generated thumbnail, group thumbnail, and image group information on a recording medium, but the configuration is not limited thereto. For example, the image processing apparatus according to the embodiment of the present invention can also use the generated thumbnail, group thumbnail, and image group information as primary storage.

  As described above, the image processing apparatus according to the embodiment of the present invention generates a group thumbnail to present information related to more image data to the user at a time than the thumbnail generated by the conventional image processing apparatus. It is possible to do. Therefore, the image processing apparatus according to the embodiment of the present invention can assist the user to grasp the image data stored in the recording medium.

  In addition, since the image processing apparatus according to the embodiment of the present invention can generate a group thumbnail for each image group, the generated group thumbnail can be managed in association with the image data constituting the group thumbnail.

  The configuration of the image processing apparatus according to the embodiment of the present invention will be specifically described below.

(First embodiment)
FIG. 11 is a block diagram showing the image processing apparatus 100 according to the first embodiment of the present invention. Referring to FIG. 11, the image processing apparatus 100 includes a storage unit 102, an image determination unit 104, a group thumbnail generation unit 106, an image playback unit 108, a display unit 110, and an operation unit 112.

  The image processing apparatus 100 is configured by an MPU (Micro Processing Unit) or the like, and performs a variety of arithmetic processing using a control program or the like to control the entire image processing apparatus 100, and a control unit. A ROM (Read Only Memory; not shown) in which control data such as a program used by (not shown) and calculation parameters are recorded, and a RAM that temporarily stores a program executed by a control unit (not shown) (Random Access Memory; not shown), a communication unit (not shown) for communicating with an external device (not shown) may be provided. For example, the image processing apparatus 100 connects each component with a bus as a data transmission path.

  The image processing apparatus 100 and an external apparatus (not shown) may be physically connected via, for example, a USB (Universal Serial Bus) terminal or an IEEE 1394 standard terminal, or a WUSB (Wireless Universal Serial). Bus) or IEEE 802.11 (also referred to as “Wi-Fi”) or the like can be used for wireless connection. Furthermore, the image processing apparatus 100 and an external apparatus (not shown) can be connected via a network, for example. As the network, for example, a wired network such as a LAN (Local Area Network) or a WAN (Wide Area Network), a wireless network such as a WLAN (Wireless Local Area Network) using MIMO (Multiple-Input Multiple-Output), or a TCP Internet (Internet) using a communication protocol such as / IP (Transmission Control Protocol / Internet Protocol) may be mentioned, but is not limited thereto. Therefore, the communication unit (not shown) can have an interface corresponding to the connection form with the external device (not shown).

[Hardware Configuration Example of Image Processing Apparatus 100]
FIG. 12 is an explanatory diagram illustrating an example of a hardware configuration of the image processing apparatus 100 according to the first embodiment of the present invention. Referring to FIG. 12, the image processing apparatus 100 includes, for example, an MPU 150, a ROM 152, a RAM 154, a recording medium 156, an input / output interface 158, an operation input device 160, a display device 162, and a communication interface 164. Prepare. In addition, the image processing apparatus 100 connects each component via a bus 166 as a data transmission path, for example.

  The MPU 150 functions as a control unit that controls the entire image processing apparatus 100. The MPU 150 can function as, for example, the image determination unit 104, the group thumbnail generation unit 106, and the image playback unit 108. The ROM 152 stores control data such as programs and calculation parameters used by the MPU 150, and the RAM 154 primarily stores programs executed by the MPU 150.

  The recording medium 156 functions as the storage unit 102 of the image processing apparatus 100 and can store various files such as image data, system data, applications, and application data. Here, examples of the recording medium 156 include a magnetic recording medium such as a hard disk, an EEPROM (Electronically Erasable and Programmable Read Only Memory), a flash memory, a MRAM (Magnetoresistive Random Access Memory), and an FeRAM. Non-volatile memory such as (Ferroelectric Random Access Memory) and PRAM (Phase change Random Access Memory) can be mentioned, but is not limited to the above.

  The input / output interface 158 connects, for example, the operation input device 160 and the display device 162. Here, examples of the input / output interface 158 include a USB terminal, a DVI (Digital Visual Interface) terminal, and an HDMI (High-Definition Multimedia Interface) terminal, but are not limited thereto. Further, the operation input device 160 is provided on the image processing apparatus 100 such as a rotary selector such as a button, a direction key, a jog dial, or a combination thereof, and the input / output interface 158 inside the image processing apparatus 100. Connected. Further, the display device 162 is, for example, on the image processing apparatus 100 such as an LCD (Liquid Crystal Display), an organic EL display (also referred to as an organic light emitting diode display), or the like. Provided and connected to the input / output interface 158 inside the image processing apparatus 100. Needless to say, the input / output interface 158 can be connected to an operation input device (for example, a keyboard or a mouse) as an external device of the image processing apparatus 100 or a display device (for example, an external display).

  The communication interface 164 is an interface for communicating with an external device, and examples thereof include a LAN terminal, an infrared port, and an IEEE 802.11 port, but are not limited thereto.

  The image processing apparatus 100 can generate a group thumbnail with a hardware configuration as shown in FIG. 12 and perform thumbnail display using the generated group thumbnail. Needless to say, the hardware configuration of the image processing apparatus 100 according to the first embodiment of the present invention is not limited to the configuration shown in FIG.

  With reference to FIG. 11 again, each component of the image processing apparatus 100 will be described. The storage unit 102 is a storage unit included in the image processing apparatus 100, and stores various files such as image data, system data, applications, and application data, for example. For example, FIG. 11 shows an example in which image data A140, image data B142,..., Application 144, application data 146,.

  Examples of the storage unit 102 include a magnetic recording medium such as a hard disk, and a non-volatile memory such as an EEPROM and a flash memory, but are not limited thereto.

  The image determination unit 104 reads a file and determines image data from the read file. Here, the image determination unit 104 can determine whether the read file is image data by using, for example, the extension of the file or the header information of the file, but is not limited thereto. Here, as a file to be determined as image data to be determined by the image determination unit 104, for example, data recorded in a still image format such as JPEG (Joint Photographic Experts Group) or bitmap (bitmap) (indicating a still image) WMV (Windows Media Video) and H.264. Data recorded in a moving image format such as H.264 / MPEG-4 AVC (H.264 / Moving Picture Experts Group phase-4 Advanced Video Coding) (indicating moving images) can be mentioned, but the present invention is not limited thereto.

  The file read by the image determination unit 104 is set in accordance with, for example, a user input from the operation unit 112. Here, examples of the user input include designation of a predetermined location (for example, a predetermined folder) in the storage unit 102 and designation of a file to be read, but are not limited thereto.

  The group thumbnail generation unit 106 generates a thumbnail based on the image data determined by the image determination unit 104, and based on the generated thumbnail, for example, as in the first to fifth examples shown in FIGS. Generate group thumbnails. Further, the group thumbnail generation unit 106 can generate image group information as shown in FIG. 10, for example, together with the generation of the group thumbnail. Here, as shown in FIG. 8, for example, the group thumbnail generation unit 106 can randomly select whether or not to generate a group thumbnail and the format of the group thumbnail to be generated, but the configuration is not limited thereto. For example, the group thumbnail generation unit 106 can generate a group thumbnail in a predetermined format in response to a user input from the operation unit 112.

  In addition, the group thumbnail generation unit 106 can record the generated thumbnail, group thumbnail, and image group information in the storage unit 102, for example, but the configuration is not limited thereto. For example, the group thumbnail generation unit 106 can temporarily store the formed thumbnails, group thumbnails, and image group information in the RAM 154, for example.

  The image playback unit 108 displays a thumbnail display as shown in FIG. 8 on the display unit 110 based on the thumbnails and group thumbnails generated by the group thumbnail generation unit 106.

  Further, as described with reference to FIG. 9B or FIG. 9C, the image reproduction unit 108 changes the screen according to the selection of the group thumbnail / thumbnail based on the image group information.

  The display unit 110 is a display unit included in the image processing apparatus 100. For example, a thumbnail display screen as shown in FIG. 8 reproduced by the image reproduction unit 108 or an operation unit 112 displayed by a control unit (not shown). Various screens such as operation screens for operation are displayed. Here, examples of the display unit 110 include an LCD and an organic EL display, but are not limited thereto.

  The operation unit 112 is an operation unit of the image processing apparatus 100 that allows a user to perform a predetermined operation. When the image processing apparatus 100 includes the operation unit 112, the user can specify a file to be read by the image determination unit 104, a group thumbnail format setting operation, a thumbnail or group thumbnail selection operation, an image processing apparatus, for example. The image processing apparatus 100 can be made to perform an operation desired by the user by performing various setting operations 100. Here, examples of the operation unit 112 include an operation input device such as a keyboard and a mouse, a rotary selector such as a button, a direction key, and a jog dial, or a combination thereof, but is not limited thereto. Note that the operation unit 112 may be an integral part of the display unit 110 such as a touch screen.

  As described above, the image processing apparatus 100 according to the first embodiment of the present invention includes the image determination unit 104 that determines image data from a file that has been read and read, and the image data that the image determination unit 104 has determined. And a group thumbnail generation unit 106 for generating a group thumbnail based on the above. Here, the group thumbnail generated by the group thumbnail generation unit 106 is one in which a plurality of image data is associated with one group thumbnail (one group thumbnail and a plurality of image data belong to one image group). Yes, one group thumbnail has information related to the plurality of image data. Therefore, the image processing apparatus 100 can present information related to more image data to the user at a time than the thumbnail generated by the conventional image processing apparatus by generating the group thumbnail. It is possible to assist in grasping image data stored in the recording medium (storage unit 102).

[Modification of Image Processing Device 100 According to First Embodiment]
In the above, as the image processing apparatus 100 according to the first embodiment, the image processing apparatus 100 includes the storage unit 102, and the image determination unit 104 reads the file stored in the storage unit 102 and generates a group thumbnail. Indicated. However, the image processing apparatus according to the first embodiment is not limited to such a configuration. For example, the image determination unit does not include a storage unit, and the image determination unit is based on a file input from an external device via the communication unit. By determining the above, it is also possible to generate a group thumbnail based on the image data stored in the external device. Even with the above-described configuration, the image processing apparatus according to the modification of the first embodiment can generate a group thumbnail, so that more image data is generated than a thumbnail generated by a conventional image processing apparatus. Such information can be presented to the user at one time, and the user can assist in grasping the image data stored in the recording medium (storage medium of the external device).

  The image processing apparatus 100 has been described as the first embodiment of the present invention. However, the first embodiment of the present invention is not limited to such an embodiment, for example, an imaging apparatus such as a digital camera or a digital video camera, or a mobile phone. A portable communication device such as a telephone, a portable game machine such as PlayStation Portable (registered trademark), a computer such as a PC, a server, or a UMPC (Ultra Mobile Personal Computer), or an LCD, an organic EL display, etc. It can be applied to a display device or the like.

(Program according to the first embodiment)
The program for causing the image processing apparatus 100 according to the first embodiment of the present invention to function as a computer can generate a thumbnail (group thumbnail) that assists the user in understanding the image data stored in the recording medium. .

(Image processing method according to the first embodiment)
Next, an image processing method according to the first embodiment of the present invention will be described. FIG. 13 is a flowchart showing an example of an image processing method according to the first embodiment of the present invention.

  The image processing apparatus 100 reads a file (S100). The file read in step S100 can be set by the user using the operation unit 112, for example.

  When the file is read in step S100, the image processing apparatus 100 determines image data from the read file (S102). The image processing apparatus 100 can perform the determination in step S102 using, for example, a file extension or header information.

  When image data is determined in step S102, the image processing apparatus 100 generates thumbnails corresponding to the respective image data using the determined image data (S104), and group thumbnails based on the thumbnails generated in step S104. Is generated (S106).

  The image processing apparatus 100 displays the group thumbnail generated in step S106 on the thumbnail display screen (S108).

  The image processing apparatus 100 according to the first embodiment uses the image processing method shown in FIG. 13 to generate a thumbnail (group thumbnail) that assists the user in understanding the image data stored in the recording medium. Can be presented.

  FIG. 13 shows that the image processing apparatus 100 generates a group thumbnail (steps S100 to S106), and further displays the generated group thumbnail (step S108). However, the first embodiment of the present invention is shown in FIG. Such an image processing method is not limited to such a method, and the processing may be terminated in the group thumbnail generation processing in step S106. Even when the above method is used, the image processing apparatus 100 can generate a thumbnail (group thumbnail) that assists the user in understanding the image data stored in the recording medium.

(Second Embodiment)
In the image processing apparatus 100 according to the first embodiment described above, a configuration is shown in which image thumbnails are determined from read files and a group thumbnail is generated. With the above configuration, the image processing apparatus 100 according to the first embodiment can assist the user in grasping the image data stored in the recording medium (storage unit 102). However, the image processing apparatus according to the embodiment of the present invention is not limited to the above configuration. Therefore, next, as an image processing apparatus according to the second embodiment of the present invention, it is easy to specify image data for generating a group thumbnail by the user, and the group thumbnail is based on image data that matches the user's specification. The structure which can produce | generate is shown.

[Outline of Processing of Image Processing Apparatus According to Second Embodiment]
Before describing the configuration of the image processing apparatus according to the second embodiment of the present invention, first, an outline of the processing of the image processing apparatus according to the second embodiment will be described.

  The image processing apparatus according to the second embodiment facilitates designation of image data for generating a group thumbnail by the user by the following processes (A) to (C), and the image data matches the designation of the user. A group thumbnail is generated based on the above.

(A) Addition of Meta Information The image processing apparatus according to the second embodiment is configured to detect meta data (image data) for image data obtained by imaging or image data input from an external apparatus. Information about the data itself).

  Examples of the meta information added to the image data by the image processing apparatus according to the second embodiment include the following (1) to (5), but the meta information according to the embodiment of the present invention includes the following ( It is not limited to 1) to (5). Further, the image processing apparatus according to the second embodiment can selectively add meta information as shown in the following (1) to (5).

(1) Location Information The image processing apparatus according to the second embodiment uses, as meta information, information about a location where image data is captured or where image data is captured from an external device to the image processing apparatus, for example. Append to image data.

(2) Information on time The image processing apparatus according to the second embodiment uses, for example, time information when image data is captured or information on time when image data is captured from an external apparatus as meta information. Append to image data.

(3) Subject Information The image processing apparatus according to the second embodiment adds subject information included in the image indicated by the image data to the image data as meta information. Here, examples of subject information include (3-1) to (3-6) below, but are not limited to the following.
(3-1) Number of persons (3-2) Gender (3-3) Number of children (3-4) Number of smiles (number of specific facial expressions)
(3-5) Feature point information for identifying a person (3-6) Whether the image includes a sea and / or a mountain

  Here, the information of (3-1) to (3-5) can be generated by performing face detection processing on image data, for example. The information (3-6) can be generated based on, for example, information on the ratio of colors included in the image data.

(4) Color Information The image processing apparatus according to the second embodiment adds color information included in the image indicated by the image data to the image data as meta information. Here, the color information includes, for example, information on the ratio of colors included in the image data (color information). The image processing apparatus according to the second embodiment generates color information by analyzing image data, for example.

(5) Information Input by User The image processing apparatus according to the second embodiment adds information input by the user to image data as meta information. Here, examples of the information input by the user include the following (5-1) to (5-4), but are not limited to the following.
(5-1) A keyword selected by the user from keywords prepared in advance (5-2) A memo regarding an image input by the user with respect to the image data (5-3) Specification of a “favorite” image by the user (5) -4) Audio information

(B) Retrieval of Image Data Based on Conditions Related to Meta Information The image processing apparatus according to the second embodiment records, for example, image data to be processed based on conditions related to meta information designated by user input. To extract image data that meets the conditions related to the meta information.

(C) Generation of Group Thumbnail And the image processing apparatus according to the second embodiment is based on the image data extracted in (B) above, similarly to the image processing apparatus 100 according to the first embodiment. Generate group thumbnails.

  The image processing apparatus according to the second embodiment of the present invention can generate a group thumbnail corresponding to image data that matches the conditions specified by the user by the processes (A) to (C). The user using the image processing apparatus according to the second embodiment needs to specify image data directly or specify a location (for example, a folder) of a recording medium where the desired image data is not known. Instead, as long as the user specifies a condition, the image processing apparatus according to the second embodiment generates a group thumbnail related to the image desired by the user. Therefore, the image processing apparatus according to the second embodiment can easily specify image data for generating a group thumbnail by the user, and can generate a group thumbnail based on image data that matches the user's specification. .

  The configuration of the image processing apparatus according to the second embodiment of the present invention will be described below. FIG. 14 is a block diagram showing an image processing apparatus 200 according to the second embodiment of the present invention.

  Referring to FIG. 14, the image processing apparatus 200 includes a storage unit 202, an imaging unit 204, a file capturing unit 206, a meta information adding unit 208, a database recording unit 216, an image recording unit 218, and image data reading. Unit 220, image determination unit 104, group thumbnail generation unit 222, image reproduction unit 108, display unit 110, and operation unit 112.

  In addition, the image processing apparatus 200 is similar to the image processing apparatus 100 according to the first embodiment, and includes a control unit (not shown) configured by an MPU or the like, a program or calculation used by the control unit (not shown). Communicates with a ROM (not shown) in which control data such as parameters are recorded, a RAM (not shown) for temporarily storing a program executed by a control unit (not shown), and an external device (not shown) You may provide the communication part (not shown) etc. for performing. The image processing apparatus 200 connects each component with a bus as a data transmission path, for example.

[Hardware Configuration Example of Image Processing Apparatus 200]
FIG. 15 is an explanatory diagram illustrating an example of a hardware configuration of the image processing apparatus 200 according to the second embodiment of the present invention. Referring to FIG. 15, the image processing apparatus 200 includes, for example, a lens / imaging device 230, a signal processing circuit 232, an MPU 234, a ROM 152, a RAM 154, a recording medium 236, an input / output interface 238, and an operation input device. 160, a display device 162, a communication interface 164, a GPS receiving circuit 240, and a clock 242. In addition, the image processing apparatus 200 connects each component with a bus 166 as a data transmission path, for example.

  The lens / imaging element 230 and the signal processing circuit 232 function as the imaging unit 204. The lens / imaging element 230 can be constituted by an image sensor using a plurality of imaging elements such as an optical lens (Lens) and a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), for example. The signal processing circuit 232 includes, for example, an AGC (Automatic Gain Control) circuit and an ADC (Analog to Digital Converter), converts an analog signal generated by the image sensor into a digital signal (image data), and performs various signal processing. . Examples of the signal processing performed by the signal processing circuit 232 include white balance correction processing, interpolation processing, color tone correction processing, gamma correction processing, YCbCr conversion processing, edge enhancement processing, and Jpeg coding processing. I can't. Here, the white balance correction processing is performed by, for example, applying a preset gain for each color of RGB (Red Green Blue) to RAW image data (image before signal processing) and corresponding to each pixel. This is a process of amplifying the pixel value to be performed. The interpolation process is, for example, a process for creating RGB of all pixels from the Bayer array. The color tone correction process is, for example, a process for correcting the color tone of an image. The gamma correction process is, for example, a process for nonlinearly converting RGB signals to ensure visual linearity. The YCbCr conversion process is a process of converting RGB into YCbCr based on a predetermined conversion formula, for example. Here, Y represents luminance, Cb represents color difference (chrominance), and Cr represents color difference (chrominance). The edge enhancement process is, for example, a process for enhancing the density of an image by detecting an edge part from the image and increasing the luminance of the detected edge part. The Jpeg coding process is a process for converting an image into a Jpeg format image file.

  The MPU 234 functions as a control unit that controls the entire image processing apparatus 200. The MPU 234 can function as, for example, the meta information adding unit 208, the database recording unit 216, the image recording unit 218, the image determination unit 104, the group thumbnail generation unit 222, and the image playback unit 108. The ROM 152 stores control data such as programs and calculation parameters used by the MPU 150, and the RAM 154 primarily stores programs executed by the MPU 234.

  The recording medium 236 functions as the storage unit 202 of the image processing apparatus 200 and can store, for example, various files such as image data and application data, a database described later, and the like.

  The operation input device 160 and the display device 162 are connected to the input / output interface 238 in the same manner as the image processing apparatus 100 according to the first embodiment shown in FIG. In addition, the input / output interface 238 is further connected to a microphone 290 (microphone), so that audio information can be taken into the image processing apparatus 200.

  The communication interface 164 has the same configuration as that of the image processing apparatus 100 according to the first embodiment illustrated in FIG. 12 and can function as the file capturing unit 206.

  The GPS receiving circuit 240 receives radio waves from GPS satellites and specifies the position of the image processing apparatus 200 using GPS (Global Positioning System). The position information specified by the GPS receiving circuit 240 is transmitted to the MPU 234 and added to the image data as meta information. That is, the GPS receiving circuit 240 can function as a part of the meta information adding unit 208.

  For example, the clock 242 generates time information used for specifying an imaging time taken by the lens / imaging device 230 or specifying a position in the GPS receiving circuit 240, and transmits the time information to the MPU 234 or the GPS receiving circuit 240. To do. Here, the time information generated by the clock 242 is added to the image data as meta information. That is, the clock 242 can function as a part of the meta information adding unit 208.

  The image processing apparatus 200 realizes the processes (A) to (C) with a hardware configuration as shown in FIG. 15, and generates a group thumbnail corresponding to the image data that matches the condition specified by the user. Can do. Needless to say, the hardware configuration of the image processing apparatus 200 according to the second embodiment of the present invention is not limited to the configuration shown in FIG.

  With reference to FIG. 14 again, each component of the image processing apparatus 200 will be described. The storage unit 202 is a storage unit included in the image processing apparatus 200 and stores, for example, various files such as image data and applications, a database in which image data and meta information are associated, and the like. For example, FIG. 14 shows an example in which the storage unit 202 stores image data A140 and meta information A250 of image data A, image data B142 and meta information B250 of image data B,. Here, in the database 258, for example, the meta information shown in the above (1) to (5) is selectively recorded for each image data.

  Examples of the storage unit 102 include a magnetic recording medium such as a hard disk, and a non-volatile memory such as an EEPROM and a flash memory, but are not limited thereto.

  The imaging unit 204 includes, for example, a lens and an imaging element such as a CCD or a CMOS, performs imaging, and generates image data by imaging. In addition, the imaging unit 204 can perform imaging in accordance with, for example, an imaging command from the operation unit 112. However, the imaging unit 204 is not limited to the above, and a predetermined time or after a predetermined time has elapsed since receiving the imaging command. Imaging can also be performed automatically.

  The file capturing unit 206 performs wired / wireless communication with an external device, and captures a file from the external device. In addition, the file capturing unit 206 determines image data from the captured file. Here, for example, the file capturing unit 206 determines image data in the same manner as the image determining unit 104.

  The meta information adding unit 208 includes an image specifying auxiliary information generating unit 210, an image analyzing unit 212, and a face detecting unit 214. The meta information adding unit 208 adds meta data to image data generated by the imaging unit 204 or image data determined by the file capturing unit 206. Add information.

  The image specifying auxiliary information generation unit 210 adds location information (information (1) above) and / or time information (information (2) above) to the image data. Here, the location information can be generated using GPS, for example, when the image processing apparatus 200 includes a GPS receiving circuit. Further, the time information can be generated when the image processing apparatus 200 includes a clock. Note that the location information and / or time information added by the image specifying auxiliary information generation unit 210 corresponds to the imaging location and imaging time when the image data is image data generated by the imaging unit 204. .

  The image analysis unit 212 performs image analysis processing on the image data, and adds image analysis information that is a result of the image analysis processing to the image data. For example, the image analysis unit 212 adds color information (information of (4) above) indicating the proportion of colors constituting the image indicated by the image data as the image analysis information, but the image analysis information according to the embodiment of the present invention. Is not limited to color information. For example, the image analysis unit 212 can add luminance ratio information (luminance information) from the image data as image analysis information.

  In addition, the image analysis unit 212, for example, includes “the sea” in the image indicated by the image data if the ratio of blue is equal to or greater than a predetermined value, and indicates “ The information of (3-6) can be derived using color information such that “mountain” is included in the image indicated by the image data.

  For example, the face detection unit 214 detects the face of the subject by performing the following processes [1-1] and [1-2], and adds information based on the detection result to the image data.

[1-1] Identification of Face Area The face detection unit 214 detects the face of the subject from the image data, and specifies an area including the face portion of the subject (hereinafter referred to as “face area”). Here, the face area of the subject can be specified by, for example, detecting feature points such as eyes, nose, and mouth, or detecting areas similar to the luminance distribution and structure pattern of the face. It goes without saying that the means for specifying the face area of the subject according to the embodiment is not limited to the above. Note that data related to specifying a face area in the face detection unit 214, such as face luminance distribution and structure pattern data, can be stored in the storage unit 202, for example, but is not limited to the above. It can also be acquired from an external device (for example, a server connected via a base station) via a communication unit (not shown) included in 200.

  Further, when the image data is a moving image, the face detection unit 214 detects a moving object by taking a difference from the previous frame, and identifies the head from the moving object. Thus, the face area can be specified.

[1-2] Generation of Face Area Information and Addition to Image Data The face detection unit 214 analyzes each face area specified from the image data, and obtains information obtained as a result of the analysis (hereinafter “face”). Area information ”) is added to the image data as meta information.

Here, examples of the face area information include the following (i) to (iv), but the face area information is not limited to the following (i) to (iv).
(I) Information on the number of persons included in the image indicated by the image data (information in (3-1) above)
(Ii) Information on the gender of the person included in the image indicated by the image data (information in (3-2) above)
(Iii) Information on the number of children included in the image indicated by the image data (and / or information on the number of adults. Information on (3-3) above)
(Iv) Information on facial expressions such as smiles (information on (3-4) above)

  The face detection unit 214 can generate the information (i) using, for example, the number of identified face regions. In addition, the face detection unit 214 determines a child or an adult from, for example, the positional relationship between the feature points such as eyes, nose, and mouth detected from the face region and the skeleton, and the information of (ii) is obtained. Can be generated. Here, the face detection unit 214 can also add the positional relationship information of the feature points such as the eyes, nose, and mouth to the image data as meta information for specifying a person ((3-5) above) Information). Further, for example, the face detection unit 214 can determine the facial expression from the relative positions of feature points such as eyes, nose, and mouth detected from the face region, and generate the information (iv).

  Needless to say, the method of generating the information (i) to (iv) in the face detection unit 214 is not limited to the above. Note that the various determination data necessary for generating the information (i) to (iv) can be held in the storage unit 202, for example. However, the data is not limited to the above. For example, the image processing apparatus 200 includes the data. It can also be acquired from an external device via a communication unit (not shown).

  The meta information addition unit 208 includes an image specifying auxiliary information generation unit 210, an image analysis unit 212, and a face detection unit 214, thereby adding meta information to the image data. 14 shows a configuration in which the meta information adding unit 208 includes the image specifying auxiliary information generating unit 210, the image analyzing unit 212, and the face detecting unit 214, the meta information according to the second embodiment of the present invention. The information adding unit is not limited to the above configuration. For example, the meta information adding unit according to the second embodiment of the present invention is an input information adding unit (not shown; for example, (5) described above) that adds meta information corresponding to a user input from the operation unit 112 to the image data. -1) to (5-3) are added), and an audio information adding unit (not shown, not shown) that adds meta information corresponding to an input from an audio output device such as the microphone 290 to the image data. 5-4) information can be added. The meta information adding unit according to the second embodiment of the present invention includes an image specifying auxiliary information generating unit 210, an image analyzing unit 212, a face detecting unit 214, an input information adding unit (not shown), and an audio information adding unit. It goes without saying that a portion (not shown) can be selectively provided.

  The database recording unit 216 records the information of the image data (for example, the file name of the image data) added with the meta information by the meta information adding unit 208 and the meta information added to the image data in association with each other and records them in the database 258. .

  Further, the database recording unit 216 creates and records a new database when the database does not exist in the storage unit 202. Here, the database recording unit 216 can create a database whose structure is defined in advance based on database creation information that defines the structure of the database in a database language such as SQL, for example. For example, the database creation information is stored in the storage unit 202, but is not limited thereto, and may be stored in the ROM 152.

  The image recording unit 218 records the image data added with the meta information by the meta information adding unit 208 in the storage unit 202. Therefore, as shown in FIG. 14, the storage unit 202 stores image data A140 to which meta information A250 is added and image data B142 to which meta information B252 is added.

  The image processing apparatus 200 includes the storage unit 202, the imaging unit 204, the file capturing unit 206, the meta information addition unit 208, the database recording unit 216, and the image recording unit 218 described above. Meta information is added to each piece of image data obtained by input from the apparatus, recording is performed in a database in which image data information and meta information are associated, and image data is recorded in the storage unit 202. Can do. Although FIG. 14 shows a configuration in which the image processing device 200 includes the database recording unit 216, the image processing device according to the second embodiment of the present invention is not limited to the above configuration. For example, the image processing apparatus according to the second embodiment of the present invention may be configured not to include a database recording unit.

[Image Data Recording Method According to Second Embodiment]
Here, an image data recording method according to the second embodiment of the present invention will be described. FIG. 16 is a flowchart showing an image data recording method according to the second embodiment of the present invention.

  The image processing apparatus 200 captures an image or captures a file from an external apparatus (S200), and acquires image data to be processed. In step S <b> 200, the image processing apparatus 200 generates image data obtained by imaging using the imaging unit 204, and determines image data from the files captured by the file capturing unit 206. Each process shown below is performed on each of the image data acquired in step S200.

  When the image data is acquired in step S200, the image processing apparatus 200 adds image specifying auxiliary information to the image data (S202; first meta information adding process). The process of step S202 is performed by the image specifying auxiliary information generation unit 210. Here, examples of the image specifying auxiliary information include location information and time information, but are not limited thereto.

  When the image specifying auxiliary information is added in step S202, the image processing apparatus 200 analyzes the image data, and adds the image analysis information to the image data with respect to the image data (S204; second meta information adding process). . The process of step S204 is performed by the image analysis unit 212. Here, examples of the image analysis information include, but are not limited to, color information indicating the ratio of colors constituting the image indicated by the image data, information on the ratio of luminance, and the like.

  When the image analysis information is added in step S204, the image processing apparatus 200 performs face detection using the image data (S206), and determines whether or not a face has been detected (S208). For example, the image processing apparatus 200 performs the face detection process in step S206 by specifying a face area, and performs the process in step S208 depending on whether or not the face area is detected. If it is not determined in step S208 that a face has been detected, the image processing apparatus 200 performs the following process.

  If it is determined in step S208 that a face has been detected, the image processing apparatus 200 adds information about the detected face area to the image data (S210; third meta information addition process). The face detection unit 214 performs the processes in steps S208 and S210. Here, as the face area information, for example, the number of persons included in the image indicated by the image data, the gender information of the person included in the image indicated by the image data, or the child included in the image indicated by the image data Information of facial expressions such as smiles, or information on the positional relationship of feature points such as eyes, nose and mouth, but is not limited to the above.

  If it is not determined in step S208 that a face has been detected, or if face area information is added to the image data in step S210, the image processing apparatus 200 determines the image data information based on the added meta information. The meta information is associated and recorded in the database (S212).

  When the recording in the database is completed in step S212, the image processing apparatus 200 records the image data in the storage unit 202 (S214).

  The image processing apparatus 200 can record the image data to which the meta information is added in the storage unit 202 by using the image data recording method shown in FIG. The image data recording method according to the second embodiment of the present invention is not limited to the method shown in FIG. For example, the image processing apparatus 200 arbitrarily performs steps S202 (first meta information addition processing), S204 (second meta information addition processing), and steps S206 to S210 (third meta information addition processing) of FIG. Can be done in order. Even when the above method is used, the image processing apparatus 200 can record the image data to which the meta information is added in the storage unit 202.

  With reference to FIG. 14 again, the components of the image processing apparatus 200 will be described. The image data reading unit 220 selectively reads image data from the image data stored in the storage unit 202 based on a condition regarding meta information. Here, the condition regarding the meta information (hereinafter referred to as “search condition”) is transmitted to the image data reading unit 220 by a user input using the operation unit 112, for example. The image data reading unit 220 extracts image data that matches the search condition with reference to the database 258 or meta information of each image data, and reads the extracted image data from the storage unit 202.

  The search condition transmitted from the operation unit 112 includes, for example, [A] a search word input by the user and [B] a search word facilitated in advance, according to the second embodiment of the present invention. Search conditions are not limited to the above [A] and [B]. For example, the image processing apparatus 200 prepares a [C] display mode in which search conditions are specified in advance, and an image that matches the predetermined conditions by the user selecting a display mode using the operation unit 112. Data can also be retrieved and read. Here, examples of the display mode include “by date” and “by location”, but are not limited thereto.

  The image data reading unit 220 searches the display unit 110 when, for example, a search condition input request is received from the operation unit 112 (for example, when the user designates a search mode using the operation unit 112). Display the condition input screen and enable the input of search conditions. Here, on the search condition input screen, for example, a text box that allows the user to input a search word (text box; used for the input of [A] above) and / or a search that has been facilitated in advance by the user. A check box for selecting a word (check box; used for input of [B]) and a pull-down menu (pull-down menu. Used for input of [B]) are displayed.

  The text box for the user to input a search word includes, for example, “location” for inputting location information (for example, latitude and longitude information), “time” for inputting date and date, and “person” for inputting a person name. It may be provided for each search category such as “person” and “color” for inputting main colors included in the image.

  The image data reading unit 220 selectively reads the image data by searching the database 258 using the search word input to each text box. Here, the image data reading unit 220 can search the database 258 by applying the search word input in each text box to a database language such as SQL stored in advance. When there is an input in the text box “person”, the image data reading unit 220, for example, a person in which a person name is associated with information on the positional relationship of feature points such as eyes, nose, and mouth First, a database for identification (not shown) is read out, and image data relating to a specific person is selectively read out by using positional information of feature points specified by the database for person identification (not shown). Can do. Registration of information in a person identification database (not shown) can be performed by, for example, user input using the operation unit 112. However, the registration is not limited to the above. For example, the communication unit included in the image processing apparatus 200 is provided. It is also possible to acquire and register from an external device (for example, a server connected via a base station) via (not shown).

In addition, examples of check boxes and pull-down menus that allow the user to select a search word facilitated in advance include the following (B-1) to (B-11), but the following (B-1) to (B It goes without saying that it is not limited to B-11).
(B-1) “Place” for designating a specific place
(B-2) “Period” to specify a period
(B-3) “Person” for designating a specific person
(B-4) “Color” for designating main colors included in the image
(B-5) “Group photo” for designating an image including a plurality of persons
(B-6) “Gender” for specifying the gender of a person included in an image
(B-7) “Adult / Child” that specifies an image that includes an adult / child
(B-8) “Favorite” for designating an image set as a favorite image
(B-9) “Sea” that specifies an image of the sea
(B-10) “Mountain” that specifies an image of mountains
(B-11) “Image with sound” for designating an image to which sound is added as meta information

  The image data reading unit 220 selectively reads image data by searching the database 258 using the search word selected by each check box or pull-down menu. Here, the image data reading unit 220 can search the database 258 by applying the search word selected by each check box or pull-down menu to a database language such as SQL stored in advance.

  For example, the image data reading unit 220 selectively reads out image data based on a search condition (condition relating to meta information) by a user input using the operation unit 112 as described above, and the user uses the operation unit 112. By specifying the search condition, the image data reading unit 220 can selectively read, for example, a portrait image, a snap image, an image including a white or dark blue color, a smiling image, and the like. In the above description, the image data reading unit 220 reads the image data matching the search condition by searching the database 258. However, the image data reading method is not limited to the above. For example, the image data reading unit 220 can read image data that matches the search condition by directly searching meta information added to each of the image data stored in the storage unit 202.

  Similar to the image determination unit 104 according to the first embodiment illustrated in FIG. 11, the image determination unit 104 reads a file and determines image data from the read file.

  The group thumbnail generation unit 222 is the same as the group thumbnail generation unit 106 according to the first embodiment shown in FIG. 11 based on the image data read by the image data reading unit 220 or the image data determined by the image determination unit 104. Then, thumbnails are generated, and group thumbnails as in the first to fifth examples shown in FIGS. 3 to 7 are generated based on the generated thumbnails. Further, the group thumbnail generation unit 222 generates image group information as shown in FIG. 10, for example, together with the generation of the group thumbnail, in the same manner as the group thumbnail generation unit 106 according to the first embodiment shown in FIG. can do.

  Based on the thumbnails and group thumbnails generated by the group thumbnail generation unit 222, the image playback unit 108 displays a thumbnail display as shown in FIG. 8 in the same manner as the image playback unit 108 according to the first embodiment shown in FIG. It is displayed on the display unit 110. Further, as described with reference to FIG. 9B or FIG. 9C, the image reproduction unit 108 changes the screen according to the selection of the group thumbnail / thumbnail based on the image group information.

  The display unit 110 is a display unit included in the image processing apparatus 200. For example, the thumbnail display screen as shown in FIG. 8 reproduced by the image reproduction unit 108 or the operation unit 112 displayed by the control unit (not shown). Various screens such as an operation screen for operation and a search condition input screen displayed by the image data reading unit 220 are displayed. Here, examples of the display unit 110 include an LCD and an organic EL display, but are not limited thereto.

  The operation unit 112 is an operation unit of the image processing apparatus 200 that allows a user to perform a predetermined operation. When the image processing apparatus 200 includes the operation unit 112, the user performs, for example, input of search conditions, setting of a group thumbnail format, selection of thumbnails and group thumbnails, and various setting operations of the image processing apparatus 200. The image processing apparatus 200 can be made to perform an operation desired by the user. Here, examples of the operation unit 112 include an operation input device such as a keyboard and a mouse, a rotary selector such as a button, a direction key, and a jog dial, or a combination thereof, but is not limited thereto.

  The image processing apparatus 200 includes the image data reading unit 220, the image determination unit 104, the group thumbnail generation unit 222, the image reproduction unit 108, the display unit 110, and the operation unit 112 described above. In response to a user input (designation of a search condition) 112, image data desired by the user can be read from the storage unit 202, a group thumbnail can be generated based on the read image data, and thumbnail display can be performed.

  As described above, the image processing apparatus 200 according to the second embodiment of the present invention adds meta information to image data obtained by imaging or image data determined from a file imported from an external apparatus. The image data is recorded in the storage unit 202, and the image data information and the meta information are associated with each other and recorded in the database 258. Further, the image processing apparatus 200 searches the database 258 (or meta information of each image data) based on a search condition (condition related to meta information) input by a user input using the operation unit 112, and the search condition Is read from the storage unit 202. Then, the image processing apparatus 200 generates a group thumbnail based on the read image data, similarly to the image processing apparatus 100 according to the first embodiment. Therefore, the image processing apparatus 200 can read image data desired by the user from the storage unit 202, and generate a group thumbnail based on the read image data.

  In addition, the image processing apparatus 200 generates group thumbnails, so that the information related to more image data than the thumbnails generated by the conventional image processing apparatus, like the image processing apparatus 100 according to the first embodiment. Can be presented to the user at one time, so that the user can assist in grasping the image data stored in the recording medium (storage unit 102).

[Modification of Image Processing Device 200 According to Second Embodiment]
[I] First Modification In the above, the image processing apparatus 200 according to the second embodiment includes the meta information addition unit 208 and the database recording unit 216, and adds meta information to the image data and adds it to the database. A configuration that performs both recording and recording is shown. However, the image processing apparatus according to the second embodiment is not limited to such a configuration. For example, the image processing device may be configured to add either meta information to image data or record it in a database. Even with the above configuration, the image processing apparatus according to the first modification of the second embodiment has image data that matches a search condition (condition related to meta information) input by a user input using the operation unit. And a group thumbnail can be generated based on the read image data.

[II] Second Modification In the above, as the image processing apparatus 200 according to the second embodiment, the database recording unit 216 and the image recording unit 218 record the database and image data in the storage unit 202, and the storage unit The configuration in which the group thumbnail generation unit 222 generates a group thumbnail based on the image data selectively read from 202 is shown. However, the image processing apparatus according to the second embodiment of the present invention is not limited to such a configuration. For example, the database and the image data are recorded on the recording medium of the external apparatus via the communication unit, and the recording medium of the external apparatus is recorded. The group thumbnail generation unit can also generate a group thumbnail based on the selectively read image data. Even with the above-described configuration, the image processing apparatus according to the second modification of the second embodiment has image data that matches a search condition (condition related to meta information) input by a user input using the operation unit. And a group thumbnail can be generated based on the read image data.

[III] Third Modification Also, in the above description, the configuration including both the imaging unit 204 and the file capturing unit 206 is shown as the image processing apparatus 200 according to the second embodiment. However, the image processing apparatus according to the second embodiment of the present invention is not limited to such a configuration, and may be configured to include, for example, one of the imaging unit 204 and the file capturing unit 206. Even with the above configuration, the image processing apparatus according to the second modification of the third embodiment has image data that matches a search condition (condition relating to meta information) input by a user input using the operation unit. And a group thumbnail can be generated based on the read image data.

  The image processing apparatus 200 has been described as the second embodiment of the present invention. However, the second embodiment of the present invention is not limited to such an embodiment, for example, an imaging apparatus such as a digital camera or a digital video camera, or a mobile phone. It can be applied to portable communication devices such as telephones, portable game machines such as PlayStation Portable (registered trademark), computers such as PCs, servers and UMPCs, or display devices equipped with LCDs, organic EL displays, etc. .

(Program according to the second embodiment)
A program for causing the image processing apparatus 200 according to the second embodiment of the present invention to function as a computer reads image data that matches a search condition (condition relating to meta information) from a recording medium, and stores the data stored in the recording medium It is possible to generate a thumbnail (group thumbnail) that assists the user in grasping image data that meets the condition (condition relating to meta information).

(Image processing method according to the second embodiment)
Next, an image processing method according to the second embodiment of the present invention will be described. Hereinafter, two examples will be described as an image processing method according to the second embodiment of the present invention.

[First Image Processing Method According to Second Embodiment]
FIG. 17 is a flowchart showing a first image processing method according to the second embodiment of the present invention.

  The image processing apparatus 200 generates search information (S300). Here, the image processing apparatus 200 generates search information based on a user input from the operation unit 112, for example. The search information includes, for example, search conditions (meta-information-related conditions) such as [A] a search word input by the user using the operation unit 112 and [B] a search word facilitated in advance. ), But is not limited to the above.

  The image processing apparatus 200 searches and selectively reads out the image data stored in the storage unit 202 based on the search information generated in step S300 (S302). The image processing apparatus 200 can selectively read out image data that matches the search condition indicated by the search information by searching the meta information added to the database 258 or each image data.

  When image data is read in step S302, the image processing apparatus 200 determines whether there is read image data (S304). If it is determined in step S304 that there is no read image data, the image processing apparatus 200 performs an exception process (S306) and ends the process. Here, as the exception processing in step S306, for example, warning display is performed on the display unit 110, but is not limited thereto.

  If it is determined in step S304 that there is read image data, it is determined whether the read image data is a predetermined number or more (S308). Here, for example, the predetermined number of pieces of information are stored in the storage unit 202 and read out from the storage unit 202 by the group thumbnail generation unit 222, whereby the image processing apparatus 200 can perform the process of step S308.

  If it is determined in step S308 that the image data read out is greater than or equal to the predetermined number, the image processing apparatus 200 is a group as in step S106 of the image processing method according to the first embodiment shown in FIG. A thumbnail is generated (S310). If the image data read in step S308 is not determined to be greater than or equal to the predetermined number, the image processing apparatus 200 does not generate a group thumbnail (S312). In step S312, thumbnails corresponding to the image data read in step S302 are generated.

  Then, the image processing apparatus 200 performs thumbnail display as shown in FIG. 8 (or FIG. 1), for example (S314).

  The image processing apparatus 200 according to the second embodiment uses the image processing method shown in FIG. 17 to read image data that matches a search condition (condition relating to meta information) from the recording medium, and stores the image data in the recording medium. It is possible to generate a thumbnail (group thumbnail) that assists the user in grasping image data that matches the search condition (condition related to meta information).

[Second Image Processing Method According to Second Embodiment]
FIG. 18 is a flowchart showing a second image processing method according to the second embodiment of the present invention.

  The image processing apparatus 200 generates display mode information (S400). Here, the image processing apparatus 200 generates display mode information based on a user input from the operation unit 112, for example. Examples of the display mode information include search conditions (conditions related to meta information) defined by the [C] display mode selected by the user using the operation unit 112, but are not limited thereto.

  Based on the search information generated in step S400, the image processing apparatus 200 searches and selectively reads out the image data stored in the storage unit 202 as in step S302 of FIG. 17 (S402).

  When image data is read in step S402, the image processing apparatus 200 determines whether there is read image data as in step S304 of FIG. 17 (S404). If it is determined in step S404 that there is no read image data, the image processing apparatus 200 performs an exception process (S406) and ends the process, as in step S306 of FIG.

  If it is determined in step S404 that there has been read image data, it is determined whether the read image data is a predetermined number or more, as in step S308 in FIG. 17 (S408). ).

  If it is determined in step S408 that the image data read out is greater than or equal to the predetermined number, the image processing apparatus 200 generates a group thumbnail as in step S310 of FIG. 17 (S410). If it is not determined that the image data read in step S408 is equal to or greater than the predetermined number, the image processing apparatus 200 does not generate a group thumbnail as in step S312 of FIG. 17 (S412).

  Then, the image processing apparatus 200 performs thumbnail display as shown in FIG. 8 (or FIG. 1), for example (S414).

  The image processing apparatus 200 according to the second embodiment uses the image processing method shown in FIG. 18 to read image data that matches a search condition (condition relating to meta information) from the recording medium, and stores the image data in the recording medium. It is possible to generate a thumbnail (group thumbnail) that assists the user in grasping image data that matches the search condition (condition related to meta information).

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to the example which concerns. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  For example, in the image processing apparatuses according to the first and second embodiments shown in FIGS. 11 and 14, the configuration in which the image processing apparatus includes a storage unit is shown. However, the image processing apparatus according to the embodiment of the present invention is illustrated. Is not limited to such a configuration. For example, the image processing apparatus according to the embodiment of the present invention may include a storage unit that stores a detachable storage unit (for example, a memory stick), thereby detachably attaching the storage unit. Even if it is said structure, there can exist an effect similar to the image processing apparatus which concerns on 1st, 2nd embodiment mentioned above.

  The configuration described above shows an example of the embodiment of the present invention, and naturally belongs to the technical scope of the present invention.

It is explanatory drawing which shows an example of the thumbnail display using the thumbnail which the conventional image processing apparatus produces | generates. It is explanatory drawing for demonstrating the production | generation of the thumbnail in the image processing apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows the 1st example of the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows the 2nd example of the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows the 3rd example of the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows the 4th example of the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows the 5th example of the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows an example of the thumbnail display using the group thumbnail which the image processing apparatus which concerns on embodiment of this invention produces | generates. It is explanatory drawing which shows the example of a screen transition when the group thumbnail which concerns on embodiment of this invention is selected. It is explanatory drawing for demonstrating the structure of the image group which concerns on embodiment of this invention. 1 is a block diagram illustrating an image processing apparatus according to a first embodiment of the present invention. It is explanatory drawing which shows an example of the hardware constitutions of the image processing apparatus which concerns on the 1st Embodiment of this invention. 3 is a flowchart illustrating an example of an image processing method according to the first embodiment of the present invention. It is a block diagram which shows the image processing apparatus which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of the hardware constitutions of the image processing apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the image data recording method which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the 1st image processing method which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the 2nd image processing method which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100,200 Image processing apparatus 102,202 Storage part 104 Image determination part 106,222 Group thumbnail production | generation part 108 Image reproduction part 110 Display part 112 Operation part 204 Imaging part 206 File acquisition part 208 Meta information addition part 210 Image specific auxiliary information generation Unit 212 image analysis unit 214 face detection unit 216 database recording unit 218 image recording unit 220 image data reading unit

Claims (13)

An image determination unit that reads a file and determines image data from the read file;
A group thumbnail generation unit that generates thumbnails corresponding to each of the image data based on the image data determined by the image determination unit, and generates a group thumbnail in which the thumbnails are grouped;
An image processing apparatus comprising: An imaging unit for imaging;
A storage unit in which image data captured by the imaging unit is recorded;
A meta information adding unit for adding meta information for identifying the image data to the image data picked up by the image pickup unit;
An image recording unit that records image data captured by the imaging unit in the storage unit;
An image data reading unit that selectively reads out image data from image data stored in the storage unit based on a condition relating to meta information;
Further comprising
The image processing apparatus according to claim 1, wherein the group thumbnail generation unit generates a group thumbnail based on the image data read by the image data reading unit.   The meta information adding unit includes a face detecting unit that detects a face area of a subject from image data captured by the imaging unit, and adds the information of the face area as the meta information. Item 3. The image processing apparatus according to Item 2.   The meta information adding unit includes an image specifying auxiliary information generating unit that generates image specifying auxiliary information for specifying an imaging location and / or imaging time of image data captured by the imaging unit, and the image specifying as the meta information The image processing apparatus according to claim 2, wherein auxiliary information is added.   The meta information addition unit includes an image analysis unit that generates image analysis information by analyzing image data captured by the imaging unit, and adds the image analysis information as the meta information. Item 3. The image processing apparatus according to Item 2.   The image analysis unit generates color information indicating a ratio of colors included in each of the image data as the image analysis information. The image processing apparatus according to claim 5.   The image processing apparatus according to claim 2, further comprising an operation unit configured to input a condition relating to the meta information to the image data reading unit. The storage unit stores a database in which image data captured by the imaging unit and the meta information corresponding to the image data are recorded in association with each image data,
A database recording unit that records the image data captured by the imaging unit and the meta information corresponding to the image data in association with the database;
The image processing apparatus according to claim 2, wherein the image data reading unit selectively reads image data based on the database and the condition relating to the meta information. It further includes a file capturing unit that captures a file from an external device and determines image data from the captured file,
The meta information adding unit adds meta information to the image data determined by the file capturing unit,
The image processing apparatus according to claim 2, wherein the image recording unit records the image data determined by the file capturing unit in the storage unit.   The image processing apparatus according to claim 1, further comprising a display unit that displays the group thumbnail generated by the group thumbnail generation unit.   The image processing apparatus according to claim 1, further comprising an operation unit that designates a file to be read by the image determination unit. Reading a file and determining image data from the read file;
Generating thumbnails corresponding to each of the image data based on the image data determined in the determining step;
Generating a group thumbnail in which the thumbnails are grouped based on the thumbnails generated in the step of generating the thumbnails;
An image processing method characterized by comprising: Reading a file and determining image data from the read file;
Generating thumbnails corresponding to each of the image data based on the image data determined in the determining step;
Generating a group thumbnail in which the thumbnails are grouped based on the thumbnail generated in the step of generating the thumbnail;
A program that causes a computer to execute.

Images