JP5401962B2 - Image processing apparatus, image processing method, and image processing program - Google Patents

Description

  The present invention relates to an apparatus for processing image data, such as a digital still camera and a digital video camera, and a method and program used in the apparatus.

  In electronic devices that process image data such as digital still cameras and digital video cameras, various GUIs (Graphical User Interfaces) can be used to improve user operability. .

  In an electronic apparatus employing a GUI, a user can perform an operation through a graphical element such as an icon or a window displayed on the screen. Therefore, by using the GUI, even a user unfamiliar with electronic devices can appropriately perform an intended operation.

Various techniques for improving the usability of electronic devices by using a GUI are disclosed in the following patent documents.
JP 2007-274381 A Japanese Patent Laid-Open No. 2004-34362

  As described above, the user operability can be improved by adopting the GUI in the electronic apparatus. However, when an operation is performed on one icon, there are many cases where the operation is requested hierarchically, such that another operation is required. In such a case, the number of operations increases, and eventually the operation may be complicated.

  In view of this, it is desired that processes that need to be performed frequently, processes that need to be performed quickly, processes that need to be performed reliably, and the like can be executed by the simplest possible operation.

  In particular, in image processing devices such as digital still cameras and digital video cameras that are often carried and used, the target processing can be performed quickly and reliably by simple operations even when away from home. It is hoped to do.

  In view of the above, an object of the present invention is to enable a target process to be performed quickly and reliably with a simple operation when handling image data.

In order to solve the above-described problem, an image processing apparatus according to a first aspect of the present invention includes a motion detection unit that detects a motion of the device itself, and a setting unit that sets a search range of image data according to an operation on the operation unit. When the search range is set by the setting unit and the motion detection unit detects that a specific operation has been performed on the device, the search range image data is displayed on the display unit. In response to an operation on the processing unit and the operation unit, the image data is searched from the image data in the search range using a search key, and the search result image data is displayed on the display unit, and the search result image Recording process for recording image data of a search result in a predetermined storage location when it is detected that a specific operation has been performed on the own device through the motion detection unit while the data is displayed on the display unit A section.

As a result, the user simply performs a simple operation that can be detected by the motion detection unit , such as tilting, raising, tilting, shaking, or hitting the image processing apparatus, on the image processing apparatus. Can be performed quickly and reliably.

  According to the present invention, in an image processing apparatus that handles image data, it is possible to perform target processing quickly and reliably with a simple operation using the target image data as a processing target.

  Hereinafter, embodiments of the apparatus, method, and program of the present invention will be described with reference to the drawings.

[Configuration example of imaging device]
FIG. 1 is a block diagram for explaining a configuration example of an imaging apparatus 100 to which an embodiment of the apparatus, method, and program of the present invention is applied. The imaging apparatus 100 can shoot both still images and moving images and switch them to a recording medium by switching the shooting mode.

  However, in the embodiment described below, in order to simplify the description, the imaging apparatus 100 uses a function as a digital still camera, and mainly takes a case where a still image is taken or reproduced as an example. The configuration and operation of the imaging apparatus 100 will be described.

  As illustrated in FIG. 1, the imaging apparatus 100 includes a lens unit 101, an imaging element 102, a preprocessing unit 103, an image processing unit 104, a display processing unit 105, a display unit 106, a touch panel 107, a compression processing unit 109, and an expansion processing unit. 110 and a display image forming unit 111.

  The imaging apparatus 100 also includes a control unit 120, an operation unit 131, an external interface (hereinafter abbreviated as an external I / F) 132, an input / output terminal 133, a writing / reading unit 134, and a recording medium 135. In addition, the imaging apparatus 100 includes a touch panel 136, a motion sensor 137, a GPS reception unit 138, a GPS reception antenna 139, a communication unit 141, and a transmission / reception antenna 142 at the top of the set.

  Although not shown in FIG. 1, the imaging apparatus 100 according to this embodiment also includes a clock circuit. The clock circuit has a calendar function, can provide the current date, current day, and current time, and can also realize a function of a time counter that measures a predetermined time interval as necessary. It can be done.

  With the function of this clock circuit, information relating to the shooting date such as the shooting date and the shooting day can be added to the shot image data. In addition, a self-timer shooting function that enables shooting by automatically releasing the shutter after a predetermined time elapses from a predetermined operation can be realized by using a function of a clock circuit.

  In the imaging apparatus 100 according to this embodiment, the display unit 106 includes a so-called thin display element such as an LCD (Liquid Crystal Display) or an organic EL panel (Organic Electroluminescence Panel). As will be described later, a touch panel 107 is attached so as to form an operation surface over the entire display screen of the display unit 106.

  The touch panel 107 receives an instruction operation (contact operation) on the operation surface from the user (user), detects an instruction position (contact position) on the operation surface of the touch panel 107, and obtains coordinate data indicating the instruction position. This is to notify the control unit 120.

  As will be described later, the control unit 120 controls each unit of the imaging apparatus 100 and also grasps what kind of display is being performed on the display screen of the display unit 106. Based on the coordinate data indicating the designated position on the operation surface from the touch panel 107 and the display information on the display screen of the display unit 106 corresponding to the designated position, the control unit 120 performs an instruction operation (input operation from the user). ) Can be accepted.

  For example, assume that the user touches a position on the operation surface of the touch panel 107 with a finger or a stylus. In this case, when a number is displayed at a position on the display screen corresponding to (matching with) the contact position, the control unit indicates that the user has selected and input the displayed number. A determination can be made at 120.

  As described above, in the imaging apparatus 100, the display unit 106 and the touch panel 107 form a touch screen 108 as an input device. Note that the touch panel 107 is realized as, for example, a pressure-sensitive type or an electrostatic type.

  In addition, the touch panel 107 can detect each of operations performed at a plurality of locations on the operation surface at the same time, and can output coordinate data indicating each of the contact positions. In addition, the touch panel 107 can detect each instruction operation that is repeatedly performed on the operation surface, and can output coordinate data indicating each contact position.

  Furthermore, the touch panel 107 can detect the contact position continuously at a predetermined timing and output coordinate data indicating this while the finger or stylus is in contact with the user.

  Thereby, the touch panel 107 can receive and detect various instruction operations (operation inputs) from the user such as a so-called tap operation, double tap operation, drag operation, flick operation, and pinch operation. .

  Here, the tap operation is an operation (operation) for instructing only once on the operation surface by the user's finger or stylus. The double-tap operation is an operation for instructing “on” on the operation surface twice in succession.

  The drag operation is an operation of moving the user's finger or stylus while keeping it in contact with the operation surface. The flick operation is an operation for quickly “replacing” an arbitrary direction as it is after the user's finger or stylus is pointed to one point on the operation surface.

  The pinch operation is an operation in which two fingers or the like of the user are simultaneously brought into contact with the operation surface and the two fingers or the like are opened or closed. In this case, in particular, an operation of opening two fingers that are brought into contact is called a pinch-out operation, and an operation of closing two fingers or the like is called a pinch-in operation.

  The drag operation and the flick operation are operations that move on the operation surface after touching the user's finger etc. on the operation surface, although there is a difference in the speed of the operation (operation that traces on the operation surface). This is an operation that can be grasped by two types of information, that is, a moving distance and a moving direction.

  For this reason, in this specification, when the same processing can be performed by performing either a drag operation or a flick operation, the drag operation and the flick operation are collectively referred to as “swapping”. The word “operation” is used.

  And the control part 120 is connected with each part which comprises the imaging device 100, and controls each part of the imaging device 100 as above-mentioned, and is what is called a microcomputer.

  The control unit 120 is configured by a CPU (central processing unit) 121, a ROM (Read Only Memory) 122, a RAM (Random Access Memory) 123, and an EEPROM (Electrically Erasable and Programmable ROM) 124 connected through a CPU bus 125. Yes.

  The CPU 121 reads out and executes a program stored in the ROM 122, which will be described later, forms a control signal to be supplied to each part, supplies this to each part, receives data provided from each part, and receives this. It is something to process.

  As described above, the ROM 122 stores in advance various programs executed by the CPU 121 and various data necessary for processing. The RAM 123 is mainly used as a work area, such as temporarily storing intermediate results in various processes.

  The EEPROM 124 is a so-called nonvolatile memory, and stores and holds information that should be held even when the power of the imaging apparatus 100 is turned off. For example, various parameters set by the user, final results of various processes, processing programs and data newly provided for adding functions, and the like are stored in the EEPROM 124.

  As shown in FIG. 1, the control unit 120 configured as described above includes an operation unit 131, an external I / F 132, a writing / reading unit 134, a touch panel 136 on the set, a motion sensor 137, and a GPS receiving unit. 138 and a communication unit 141 are connected.

  The operation unit 131 includes operation keys such as various adjustment keys, function keys, and shutter keys. The operation unit 131 receives an operation input from the user and notifies the control unit 120 of the operation input. As a result, the control unit 120 can control each unit in accordance with the operation input from the user received through the operation unit 131, and can execute processing according to the operation input.

  The external I / F 132 is a digital interface conforming to a predetermined standard such as USB (Universal Serial Bus) and IEEE (Institute of Electrical and Electronics Engineers Inc) 1394.

  In other words, the external I / F 132 converts data received from an external device connected to the input / output terminal 133 into data in a format that can be processed by the own device, or receives data sent from the own device in a predetermined format. Or output after conversion.

  The writing / reading unit 134 writes data to or reads data recorded on the recording medium 135 according to the control of the control unit 120.

  The recording medium 135 is configured to be detachable from the imaging apparatus 100, and is, for example, a so-called memory card type removable memory using a semiconductor memory and having a storage capacity of several gigabytes or more.

  In addition to the memory card type removable memory, the recording medium 135 may be configured to use a built-in recording medium such as a built-in flash memory or a small hard disk.

  Further, as the recording medium 135, another removable recording medium such as an optical disk such as a small DVD (digital Versatile Disc) or CD (Compact Disc) may be used.

  The touch panel 136 at the top of the set is for receiving an instruction input from the user in a predetermined case. The touch panel 136 is also realized as a pressure-sensitive type or an electrostatic type. Note that the touch panel 136 at the top of the set does not necessarily need to be configured by a touch panel. You may implement | achieve as what is called a hardware key.

  The motion sensor 137 detects the movement of the imaging apparatus 100, and specifically includes a biaxial or triaxial acceleration sensor. The motion sensor 137 can detect how much the camera is tilted in any direction and notify the control unit 120 when the imaging device 100 is tilted.

  Further, the motion sensor 137 can detect the case where the imaging apparatus 100 is swung left and right and the case where it is swung up and down, and can notify the control unit 120 of this. In addition, the motion sensor 137 can detect and notify the control unit 120 when vibration is applied, for example, by being struck.

  The GPS receiving unit 138 receives a predetermined signal from a plurality of artificial satellites through the GPS receiving antenna 139, analyzes the current signal, detects the current position of the imaging device 100, and notifies the control unit 120 of the current position. Is something that can be done.

  With the function of the GPS receiving unit 138, the imaging apparatus 100 can acquire current position information at the time of shooting and add position information (GPS information) indicating the shooting position as metadata to the image data. I have to.

  Note that the GPS receiving unit 138 can be operated or stopped in accordance with an instruction from a user received through the operation unit 131, for example.

  Further, the communication unit 141 realizes a short-range wireless communication function such as, for example, Bluetooth through the transmission / reception antenna 142. The communication unit 141 communicates with an electronic device having a similar communication unit through the transmission / reception antenna 142 so that data and programs can be transmitted and received.

  In the imaging apparatus 100 shown in FIG. 1, the lens unit 101 includes an imaging lens (objective lens), an exposure adjustment mechanism, a focus adjustment mechanism, a shutter mechanism, and the like (not shown), and captures an image of a subject. This is the part that forms an image on the sensor surface of the image sensor.

  The imaging element 102 is composed of an imaging sensor (imaging element) such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) image sensor. The image sensor 102 captures an image formed on the sensor surface of the camera through the lens unit 101 as an electrical signal (image signal).

  In the image pickup apparatus 100 of this embodiment, the image pickup element 102 has a predetermined color pattern that forms any one of R (red), G (green), and B (blue) signals for each pixel. A single-plate color filter is provided.

  Then, the image signal captured through the image sensor 102 is supplied to the pre-processing unit 103 at the subsequent stage. The preprocessing unit 103 includes a CDS (Correlated Double Sampling) circuit, an AGC (Automatic Gain Control) circuit, an A / D (Analog / Digital) converter, and the like, and digitally converts an image signal from the image sensor 102. This is the part that is captured as data.

  The image signal (image data) captured through the preprocessing unit 103 is supplied to the image processing unit 104. Although not shown, the image processing unit 104 includes a detection circuit, a white balance circuit, a demosaic circuit, a resolution conversion circuit, other image correction circuits, and the like.

  In the image processing unit 104, first, based on the image data from the preprocessing circuit 103, parameters for exposure (exposure) adjustment, parameters for focus (focus) adjustment, parameters for white balance adjustment, etc. Form parameters for various adjustment processes.

  Of the parameters formed in the image processing unit 104, parameters for exposure (exposure) adjustment and parameters for focus (focus) adjustment are supplied to the control unit 120. The control unit 120 controls the exposure adjustment mechanism and the focus adjustment mechanism of the lens unit 102 based on the parameters from the image processing unit 104 so that the adjustment for exposure and focusing can be appropriately performed. Yes.

  The image processing unit 104 performs black level adjustment processing and white balance adjustment processing based on the parameters for white balance adjustment formed as described above on the image data from the preprocessing unit 103. Through these adjustment processes, the image formed by the image data from the pre-processing unit 103 is adjusted so as to have an appropriate hue.

  Thereafter, the image processing unit 104 performs demosaic processing (synchronization processing) and aperture correction processing for generating RGB data (three primary color data) for each pixel with respect to the image data adjusted to have an appropriate hue. Gamma (γ) correction processing is performed.

  Further, the image processing unit 104 performs Y / C conversion processing for forming a luminance signal (Y) and color signals (Cb, Cr) from the formed RGB data, chromatic aberration correction processing, resolution conversion processing, etc. A signal Y and color signals Cb and Cr are formed.

  The image data (luminance signal Y, color signals Cb, Cr) formed by the image processing unit 104 is supplied to the display processing unit 105, where it is converted into an image signal in a format to be supplied to the display unit 106 and displayed. To be supplied.

  As a result, the image of the subject captured through the lens unit 101 is displayed on the display screen of the display unit 106, and the user can confirm the subject image displayed on the display screen of the display unit 106 while viewing the target subject. Images can be taken.

  At the same time, the luminance signal Y and the color signals Cb and Cr formed by the image processing unit 104 are also supplied to the compression processing unit 109. At the timing when the shutter key of the operation unit 131 is pressed, the compression processing unit 109 compresses the image data of the image that was to be displayed on the display screen of the display unit 106 at that time, and controls this. To the unit 120.

  The compression processing unit 103 performs data compression processing according to a predetermined data compression method. As a data compression method, a JPEG (Joint Photographic Experts Group) method is used for a still image, and a Moving Picture Experts Group (MPEG) method is used for a moving image. Of course, the present invention is not limited to this, and various data compression methods can be used.

  The control unit 120 controls the writing / reading unit 134 to record the compressed image data from the compression processing unit 109 on the recording medium 135. In this way, the imaging apparatus 100 can capture an image of a subject and record image data forming the subject image on the recording medium 135.

  As will be described later in detail, the image data obtained by the imaging apparatus 100 as described above can be stored and managed in the recording medium 135 for each folder to be formed by the user. Yes.

  Folders can be formed according to the purpose, such as for each subject or event. In the imaging apparatus 100 according to this embodiment, for example, a folder is formed for each shooting event such as an entrance ceremony, athletic meet, birthday party, and the like. Of course, the photographed image data can be moved to a target folder later.

  The image data recorded on the recording medium 135 can be read by the writing / reading unit 134 controlled by the control unit 120. Image data read from the recording medium 135 is supplied to the decompression processing unit 110 through the control unit 120.

  The decompression processing unit 110 decompresses the image data supplied thereto according to the data compression method used at the time of data compression, restores the image data before data compression, and supplies this to the display image forming unit 111. .

  The display image forming unit 111 uses the image data from the decompression processing unit 110 and, if necessary, also uses various display data supplied from the control unit 120 to display the display screen of the display unit 106. The image data of the image to be displayed is formed and supplied to the display processing unit 105.

  The display processing unit 105 converts the image data from the display image forming unit 111 into an image signal to be supplied to the display unit 106 in the same manner as when the image data from the image processing unit 104 is processed, and displays it. To the unit 106.

  Thereby, an image corresponding to the image data recorded on the recording medium 135 can be displayed on the display screen of the display unit 106. That is, the image data of the target image recorded on the recording medium 135 can be reproduced.

  As described above, the imaging apparatus 100 according to this embodiment can capture an image of a subject and record it on the recording medium 135. Further, the imaging apparatus 100 can also read and reproduce image data recorded in the recording medium 135 and display an image corresponding to the image data on the display screen of the display unit 106.

  In the imaging apparatus 100 having the above-described configuration, information that is a candidate for a search key (search condition) such as a keyword is added to an image file recorded on the recording medium 135 by shooting as described below. In response to this, the image data can be searched.

  In the imaging apparatus 100, even when the image data search process needs to be repeated a plurality of times, the search can be performed with as few operation steps as possible. Further, in the imaging apparatus 100, the search result can be presented to the user in an easily understandable manner, or the search result can be determined by a simple operation.

[Configuration example of image file and image folder]
FIG. 2 is a diagram for explaining a layout example of an image file recorded on the recording medium 135 of the imaging apparatus 100. As shown in FIG. 2, the image file has a file name that is identification information for identifying each image file. This file name is automatically given by the control unit 120 at the time of shooting, for example.

  In addition, metadata including keywords, GPS information, image analysis information, camera information, shooting date and time, and the like is added to each image file. These metadata can be used as information corresponding to a search key for image data.

  Here, the keyword is mainly text data input by the user. Specifically, the keyword is registered with multiple pieces of information indicating the contents of the image, such as the name of the place where the image was taken, the name of the person in the image, and the name of the event held at the place where the image was taken Has been made possible.

  The keyword is input through the operation unit 131 or the touch screen 108 and added to the image file when an image is displayed on the display screen of the display unit 106 according to the image data of the image file to which the keyword is added. Have been able to.

  Further, for example, various metadata such as keywords are added to the image data on a personal computer, and the metadata is captured in the imaging apparatus 100 through the input / output terminal 133 and the external I / F 132 and recorded on the recording medium 135. It may be. In other words, image data obtained by adding metadata such as keywords in an external device can be taken into the imaging apparatus 100 and used.

  The GPS information is position information (longitude and latitude information) indicating the position at the time of shooting acquired through the GPS receiving unit 138 described above at the time of shooting, and can be added to the image file through the control unit 120. Has been.

  The image analysis information is obtained by performing image analysis (image analysis) on the image data of the image file by a predetermined method to obtain an image analysis result and storing it in each image file. This image analysis is mainly performed by the function of the control unit 120 at an appropriate timing after shooting and is added to the image file.

  The image analysis information, for example, can represent the characteristics of an image based on each image data by using various methods such as edge detection and color analysis. It is possible to compare the similarity of subjects.

  Further, the image analysis information is searched based on the result of the image analysis, searching for an image showing a similar person (face), searching for an image showing a similar place, or For example, it is possible to search for images having similar characteristics of color and complexity.

  As will be described later, the image analysis information is information obtained as a result of image analysis. The image analysis information includes the area of the person's face in the image, the number of people in the image, and the smile of the person in the image. It also includes various analysis information such as information indicating the degree and characteristics of the entire image.

  The camera information is information indicating an aperture and a shutter speed at the time of shooting. The camera information is information managed by the control unit 120, and is added to the image file by the control unit 120 when shooting is performed. Then, it is possible to grasp under what camera conditions the image data is captured based on the camera information.

  The shooting date and time is date and time information acquired by the control unit 120 during shooting through a clock circuit (not shown) and added to the image file, and is information including date and time. Thereby, it is possible to accurately grasp when the image data of each image file was taken.

  The image file stores, as main data, image data for forming an image of a subject obtained by shooting.

  The image file formed in this way is recorded on the recording medium 135 of the imaging apparatus 100. The image file is stored in an image folder created on the recording medium 135 in response to a user instruction, as will be described below.

  In the imaging apparatus 100 of this embodiment, when the user does not form an image folder, for example, a folder corresponding to the shooting date is automatically formed, and image data obtained by shooting is stored in the folder. To be able to.

  Then, as described above, the image folder in which the image file is stored is formed for each shooting event, shooting date, shooting date, etc., such as entrance ceremony, athletic meet, birthday party, etc. It is what is done.

  In addition to this, for example, an image folder is formed for each subject and used, or when the imaging apparatus 100 is shared by a family member, an image folder is formed for each photographer and used separately. You can also.

  FIG. 3 is a diagram for explaining a layout example of an image folder formed on the recording medium 135 of the image capturing apparatus 100. As shown in FIG. 3, the image folder has a folder name which is identification information for identifying each folder. This folder name is information corresponding to an event that has been taken, such as an entrance ceremony, athletic meet, birthday party, etc., or information relating to a shooting date such as a shooting date or a shooting date.

  Each image folder has an event title, creation date and time, and other various metadata of the image folder.

  When the image title is created corresponding to the event, the event title should be more detailed, such as “XX-chan ’s entrance ceremony 2008. 4.10”. The information to be shown can be stored.

  The creation date and time is information indicating the date and time when the image file is created, and is information that the control unit 120 acquires from a clock circuit (not shown) when the image folder is created.

  In addition, information that can be automatically given by the imaging apparatus 100 such as the number of image files stored in the image folder, annotation information (character information) input by the user, and the like are added as metadata. Is also possible.

  The image folder stores the file name, address on the recording medium, and shooting date / time of each image file belonging to the folder. Based on the information of the image folder, it is possible to grasp when the image file that was shot is stored in the image folder, and where the image file is stored on the recording medium.

  In each image file, the image file of the image data obtained by shooting is managed in chronological order according to the shooting date. Thus, based on the information of the image folder, the image data of the image file shown in FIG. To be able to.

[Search key candidate information table]
In the imaging apparatus 100 according to this embodiment, information (search key candidate information) that serves as a search key candidate is provided so that image data search processing using the search key can be easily performed. Registered in advance. The search key candidate information registered in the search key candidate information table can be used as a search key without being registered at the time of search, as will be described later.

  FIG. 4 is a diagram for explaining a search key candidate information table created in advance in the recording medium 135 of the imaging apparatus 100 or in the EEPROM 124 or the like. In the imaging apparatus 100 according to this embodiment, the search key candidate information table includes “person”, “location”, “color”, “season”, “subject”, “camera information”, “camera information”, as shown in FIG. The search key candidate information is managed by dividing it into seven categories “others”.

  The category “person” includes search key candidate information relating to a person, and information such as “family, father, mother, brother, sister, brother, sister,...” Is registered in advance as shown in FIG. Yes. The category “person” includes, for example, “○ child (user himself)”, “Mr. A”, “Mr. B”, “Mr. C”, the user's own name, and a friend who becomes the subject Users can also register their names and acquaintances.

  The category “place” includes search key candidate information related to the place. As shown in FIG. 4, information such as prefecture name, municipality name, ward name, other place name, station name, and various landmark names is included. Registered in advance. In addition, the user himself / herself can also register the name of a place that is not registered, such as a name of a newly created place or a name of a newly created landmark (such as a high-rise building or a commercial facility).

  As shown in FIG. 4, the category “color” belongs to color names such as red, white, black, blue,..., And a plurality of commonly used color names are registered in advance. Note that the user himself / herself can register color names that are not registered in advance.

  The category “season” belongs to search key candidate information relating to the season, and as shown in FIG. 4, in addition to “spring, summer, autumn, winter”, it relates to seasons such as new spring, early spring, early summer, early autumn, early winter. Some words are also registered in advance. Note that the user himself / herself can register words related to seasons that are not registered in advance.

  In the category “subject”, search key candidate information relating to what can be a subject is registered. As shown in FIG. 4, names of subjects that are often subjects, such as animals, flowers, trees, mountains, and seas, are preliminarily stored. It is registered. It should be noted that the user himself / herself can register words related to subjects that can be subjects that are not registered in advance.

  In the category “camera information”, search key candidate information such as camera setting conditions at the time of shooting such as aperture and shutter speed is registered in advance. For example, it is used when searching for an image taken using special setting conditions. The camera information that is not registered in advance can be registered by the user.

  In the category “others”, search key candidate information that does not belong to any of the above six categories is registered. For example, item names such as image analysis and GPS information are registered, and by selecting these, image analysis information of a specific image is used as a search key, or GPS information of a specific image is used as a search key. To be able to do so.

  In the imaging apparatus 100 of this embodiment, as described above, the user can attach various keywords to the image file recorded on the recording medium 135 by shooting. .

  As described above, the user reproduces an image based on the image data stored in the image file recorded on the recording medium 135 by photographing, and performs a predetermined operation for adding a keyword. A keyword can be input through the unit 131.

  In this case, a list of search key candidate information in the search key candidate information table shown in FIG. 4 can be displayed, and a target keyword can be selected and added from the displayed candidates.

  In addition, when the target keyword does not exist in the search key candidate information list, for example, text data such as a word is input through an input key realized by the touch screen 8 and added as a keyword. You can also.

  Of course, as described above, various kinds of metadata such as keywords are added to the image data on the personal computer, and the metadata is taken into the imaging apparatus 100 through the input / output terminal 133 and the external I / F 132 to be recorded. May be recorded. In other words, image data obtained by adding metadata such as keywords in an external device can be taken into the imaging apparatus 100 and used.

  It is also possible to add search key candidates to the search key candidate table of the imaging apparatus 100 through an external device such as a personal computer connected through the input / output terminal 133 and the external I / F 132.

  Of course, a search key candidate table formed by an external device such as a personal computer may be fetched through the input / output terminal 133 and the external I / F 132, stored in a predetermined memory such as the EEPROM 124, and used. it can.

  In this case, when the information input as a keyword does not exist in the search key candidate information table, the control unit 120 requests confirmation of whether or not to additionally register the keyword in the search key candidate information table.

  When instructed to perform additional registration, the control unit 120 can register the keyword in a category instructed by the user through the operation unit 131, for example.

  As described above, in the imaging apparatus 100 of this embodiment, any one of the keywords added to each image file stored in the recording medium 135 and the search key candidate information registered in the search key candidate information table. One of them has to be matched.

[Selection of search key used for image search]
Next, processing for selecting a search key to be used for image search from search key candidate information registered in the search key candidate information table shown in FIG. 4 in the imaging apparatus 100 of this embodiment will be described. 5 to 7 are diagrams for explaining processing for selecting a search key used for image search from search key candidate information registered in the search key candidate information table.

  In the imaging apparatus 100, for example, by performing a predetermined operation such as pressing a menu key provided in the operation unit 131, the control unit 120 has a menu having processing that can be executed by the own device as a selection item. Is displayed on the display unit 106.

  That is, the control unit 120 uses the display information stored in the ROM 122 to form menu display image data (menu screen). Then, the control unit 120 processes the formed menu display image data through the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105, and forms a menu display image signal to display the display unit. 106.

  As a result, a menu screen is displayed on the display screen 6G of the display unit 106, with a process that can be executed by the own device as a selection item. Note that there is no need for decompression processing for menu display image data, so no particular processing is performed in the decompression processing unit 110.

  In the imaging apparatus 100, as described with reference to FIG. 1, the touch screen 108 is formed by the display unit 106 and the touch panel 107, and an instruction input from the user is accepted through the touch screen 108.

  The user performs an operation for selecting the menu item “image search” from the menu displayed on the display screen 6 </ b> G of the display unit 106 with respect to the imaging apparatus 100. Specifically, a finger or the like is brought into contact with the position on the operation surface of the touch panel 107 corresponding to the display position of the menu item “image search”.

  Thereby, coordinate data indicating the contact position of the user on the operation surface is supplied from the touch panel 107 to the control unit 120. The control unit 120 determines which item has been selected by the user based on the coordinate data and display information displayed at a position on the display screen corresponding to the position on the operation surface indicated by the coordinate data. .

  In this case, the control unit 120 knows that the menu item “image search” is displayed at the position on the display screen 6G corresponding to the position on the operation surface touched by the user. Therefore, the control unit 120 can determine that the menu item “image search” has been selected by the user.

  Then, the control unit 120 displays the search range setting screen shown in FIG. 5A on the display screen 6G of the display unit 106 in the same manner as when the menu described above is displayed. As shown in FIG. 5A, the search range setting screen has a title (screen title) of “* image search *”, and includes an overall icon 6X, a folder icon 6Y, and a date icon for specifying the search range. It has 6Z. Further, as shown in FIG. 5A, the search range setting screen has an end icon 6A and an OK icon 6B at the upper right end.

  In FIG. 5A, the whole icon 6X is for designating all image files recorded in the recording medium 135 as search targets. Therefore, when the entire icon 6X is selected, the control unit 120 sets all image files recorded on the recording medium as search targets at the time of image search.

  The folder icon 6Y is for designating only the image file stored in the image folder selected by the user among the image files recorded on the recording medium 135 as a search target.

  When the folder icon 6Y is selected, the control unit 120 forms a list of image folders formed on the recording medium 135 and displays the list on the display screen of the display unit 106. To be able to select.

  When the image folder is selected by the user, the control unit 120 displays the folder name of the selected image folder on the display screen 6G of the display unit 106 as shown by the display 6Y1 in FIG. .

  Then, the control unit 120 searches only the image file stored in the selected image folder. Note that the number of image folders that can be selected is not limited to one, and a plurality of image folders can be searched.

  The date icon 6Z designates only the image files whose shooting date added to the image file belongs to the date range instructed by the user among the image files recorded on the recording medium 135 as the search target. belongs to.

  When the date icon 6Z is selected, the control unit 120 displays a date range setting screen on the display screen of the display unit 106 so that the user can input a target date range.

  When the date range is input, the control unit 120 displays the input date range on the display screen 6G of the display unit 106 as indicated by the display 6Z1 in FIG. Then, the control unit 120 searches only the image file to which the shooting date belongs in the input date range.

  It should be noted that the date range can be one day only, such as from October 1, 2008 to October 1, 2008, and can be in the range of days, weeks, months, years. Input (setting) is also possible.

  When the end icon 6A is selected on the search range setting screen shown in FIG. 5A, the control unit 120 ends the image search process, for example, in a state where the menu screen is displayed. Try to go back.

  When the OK icon 6B is selected on the search range setting screen shown in FIG. 5A, the control unit 120 searches for an image within the selected range. In this case, as shown in FIG. 5B, the control unit 120 forms a search key selection screen (1) having a category list display 611 and displays it on the display screen 6G of the display unit 106.

  When the OK icon 6B is selected even though the search range is not selected, the control unit 120 selects a search range by emitting a warning sound or displaying a warning message. To encourage users to do that.

  As shown in FIG. 5B, the search key selection screen (1) has an end icon 6A and a BK icon 6C, and a category list display 611 at the lower end of the display screen 6G.

  The category list display 611 is formed based on the category information of the search key candidate table described with reference to FIG. 4, and as shown in FIG. 5B, the person, place, color, season, subject , Camera information, etc., and so on.

  From the displayed category list display 611, the user selects a category name to which the search key candidate information to be used as a search key belongs. Specifically, the category name is selected by bringing a finger or the like into contact with the position on the operation surface of the touch panel 107 corresponding to the target category name display position.

  Based on the coordinate data from the touch panel 107 and the display information displayed at a position on the display screen 6G corresponding to the position on the operation surface of the touch panel 107 indicated by the coordinate data, the control unit 120 determines which one by the user. It is grasped whether such an instruction is input.

  Here, as illustrated in FIG. 5B, it is assumed that the user touches the position on the operation surface of the touch panel 107 corresponding to the display position of the category “person” by the user. In this case, the control unit 120 determines that the category “person” has been selected, and has a search key candidate information list display (search key candidate display) 621 belonging to the category “person” shown in FIG. This selection screen (2) is formed and displayed on the display screen 6G of the display unit 106.

  In FIG. 5B, when the end icon 6A is selected, the control unit 120 ends the image search process and returns to the state where the menu screen is displayed, for example. If the BK icon 6C is selected in FIG. 5B, the control unit 120 returns to the search range setting screen described with reference to FIG. 5A and sets the search range again. To be able to.

  As shown in FIG. 6A, the search key selection screen (2) has an end icon 6A, an OK icon 6B, and a BK icon 6C, and a search key candidate display 621 at the lower end of the display screen 6G. It is what you have.

  The search key candidate display 621 is a list of search key candidate information belonging to the category “person” selected on the search key selection screen (1) in the preceding stage. Further, as shown in FIG. 6A, the search key selection screen (2) has a left arrow icon 622 and a right arrow icon 623 for scrolling the search key candidate display.

  In this case, when a tap operation is performed on the left arrow icon 622, the control unit 120 scrolls the search key candidate display 621 by one search key candidate from the right side to the left side. By repeating the tap operation on the left arrow icon 622, the search key candidate display 621 can be sequentially scrolled from the right side to the left side by one search key candidate.

  Similarly, when the left arrow icon 623 is tapped, the control unit 120 scrolls the search key candidate display 621 by one search key candidate from the left side to the right side. By repeating the tap operation on the right arrow icon 623, the search key candidate display 621 can be sequentially scrolled from left to right by one search key candidate.

  By operating the left arrow icon 622 and the right arrow icon 623, the search key candidate display is scrolled, and when the target search key candidate information is displayed, the search key candidate information is selected. Perform the operation.

  Instead of using the left and right arrow icons 622 and 623, for example, the search key candidate display is scrolled by performing a left drag operation or a right drag operation on the operation surface of the touch panel 107. You can also.

  For example, in FIG. 6A, it is assumed that the item “Mr. A” in the search key candidate display is search key candidate information that the user wants to use as a search key. In this case, the user performs a tracing operation (drag operation or flick operation) by bringing a finger or the like into contact with the position on the operation surface of the touch panel 107 corresponding to the display position of the item “Mr. A”.

  As described above, the control unit 120 performs the tracing operation from the display position of the item “Mr. A” based on the coordinate data from the touch panel 107 and the display position of each display information on the display screen 6G. To figure out.

  In this case, the control unit 120 recognizes that the item “Mr. A” is selected as the search key, and displays the display 624 of “Mr. A” selected as the search key in addition to the display of the search key candidate display 621 on the display screen 6G. To display. Accordingly, the user can recognize that the item “Mr. A” has been selected as the search key in the imaging apparatus 100.

  Similarly, another item belonging to the category “person” can be selected as a search key. That is, it is possible to select a plurality of items (search key candidate information) as search keys in the same category.

  Then, after the item “Mr. A” is selected as the search key, when the user wants to end the image search itself, the user selects the end icon 6A. As a result, the control unit 120 ends the image search process and returns to the state where the menu is displayed, for example. In this case, the selected search key is not selected.

  In addition, after the item “Mr. A” is selected as the search key, the user selects the BK icon 6C in order to reselect the category. As a result, the control unit 120 returns to the search key selection screen (1) described with reference to FIG. 5B so that the category can be selected again. In this case, it is assumed that the item “Mr. A” has never been selected as a search key.

  When the OK icon 6B is selected after the item “Mr. A” is selected as the search key, the control unit 120 uses the item “Mr. A” selected in FIG. 6A as the search key. Identify.

  Then, as shown in FIG. 6B, the control unit 120 has a display 631 of the item “Mr. A” specified as the search key, and selects the search key that displays the category list display 611 again. A screen (3) is formed and displayed on the display screen 6G of the display unit 106. As a result, a category of the search key candidate information table can be newly selected.

  When the user wants to end the image search in the state shown in FIG. 6B, the user selects the end icon 6A. As a result, the control unit 120 ends the image search process and returns to the state where the menu is displayed, for example.

  When the user wants to redo the selection of the search key in the category “person”, the user selects the BK icon 6C. As a result, the control unit 120 returns to the search key selection screen (2) described with reference to FIG. 6A so that the search key selection in the category “person” can be performed again.

  In this case, the control unit 120 controls to cancel the already selected search key, cancel the already selected search key, select a new search key, or select a search key in addition to the already selected search key. And so on.

  When the search key selection is completed and the image search is to be performed using the selected search key in the state of FIG. 6B, the user selects the OK icon 6B. As a result, the control unit 120 deletes the category list display 611 in FIG. 6B so that the image search process can be executed.

  In this case, as will be described in detail later, the control unit 120 accepts a predetermined operation instructing to display an initial screen for image search in order to execute an image search according to the selected search key. To do.

  When the predetermined operation is received, the control unit 120 performs processing for displaying an initial image search screen. That is, the control unit 120 reads the image data in the search range set in FIG. 5A, controls the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105, and searches the entire display screen 6G. Thumbnail images of range images are displayed randomly (disjointly).

  Further, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to display a search key corresponding to the search key selected as described with reference to FIGS. 5 and 6 (FIG. 6B). (Display corresponding to the display 631 shown in FIG. 6) is displayed on the display screen 6G.

  Then, the control unit 120 waits for an instruction operation (contact operation) to search key display corresponding to the selected search key, which is an operation to instruct the start of image search. Thereafter, when the instruction operation is performed, the control unit 120 performs image search processing based on the selected search key, as will be described later.

  Further, when the search key is further selected in the state of FIG. 6B, the user tries to use the search key as in the case described with reference to FIG. 5B. Select the category name to which the search key candidate information belongs. That is, the category name is selected by bringing a finger or the like into contact with the position on the operation surface of the touch panel 107 corresponding to the display position of the target category name.

  Here, as illustrated in FIG. 6B, it is assumed that the user touches a position on the operation surface of the touch panel 107 corresponding to the display position of the category “place” by the user. The control unit 120 determines that the category “location” has been selected, and selects a search key having a list display (search key candidate display) 621 of search key candidate information belonging to the category “location” shown in FIG. A screen (4) is formed and displayed on the display screen 6G of the display unit 106.

  The search key selection screen (4) has an end icon 6A, an OK icon 6B, and a BK icon 6C, as shown in FIG. 7A, and a search key candidate display 641 at the lower end of the display screen 6G. It is what you have.

  The search key candidate display 641 is a list of search key candidate information belonging to the category “location” selected on the search key selection screen (3) in the preceding stage. Further, as shown in FIG. 7A, the search key selection screen (4) has a left arrow icon 642 and a right arrow icon 643 for scrolling the search key candidate display.

  In this case, when a tap operation is performed on the left arrow icon 642, the control unit 120 scrolls the search key candidate display 641 by one search key candidate from the right side to the left side. By repeating the tap operation on the left arrow icon 642, the search key candidate display 641 can be sequentially scrolled from the right side to the left side by one search key candidate.

  Similarly, when a tap operation is performed on the left arrow icon 643, the control unit 120 scrolls the search key candidate display 641 by one search key candidate from the left side to the right side. By repeating the tap operation on the right arrow icon 643, the search key candidate display 641 can be sequentially scrolled by one search key candidate from the left side to the right side.

  By operating the left arrow icon 642 and the right arrow icon 643, the search key candidate display is scrolled, and when the target search key candidate information is displayed, the search key candidate information is selected. Perform the operation.

  For example, in FIG. 7A, it is assumed that the item “Yokohama” being displayed as a search key candidate is search key candidate information that the user wants to use as a search key. In this case, the user performs a tracing operation (drag operation or flick operation) by bringing a finger or the like into contact with the position on the operation surface of the touch panel 107 corresponding to the display position of the item “Yokohama”.

  Based on the coordinate data from the touch panel 107 and the display position of each display information on the display screen 6G, the control unit 120 grasps that the tracing operation has been performed from the display position of the item “Yokohama”.

  In this case, the control unit 120 recognizes that the item “Yokohama” has been selected as the search key, and displays the display 644 of “Yokohama” selected as the search key on the display screen 6G in addition to the display of the search key candidate display 621. To do. Accordingly, the user can recognize that the item “Yokohama” has been selected as the search key in the imaging apparatus 100.

  Similarly, another item belonging to the category “place” can be selected as a search key. That is, it is possible to select a plurality of items (search key candidate information) as search keys in the same category.

  Then, after the item “Yokohama” is selected as the search key, when the user wants to end the image search itself, the user selects the end icon 6A. As a result, the control unit 120 ends the image search process and returns to the state where the menu is displayed, for example. In this case, the selected search key is not selected.

  Further, when the item “Mr. A” and the item “Yokohama” are selected as the search keys and the user wants to re-select the category, the user selects the BK icon 6C. As a result, the control unit 120 returns to the search key selection screen (3) described with reference to FIG. 6B so that the category can be selected again. In this case, it is assumed that the item “Yokohama” has never been selected as a search key.

  When the item “Mr. A” and the item “Yokohama” are selected as search keys and then the OK icon 6B is selected, the control unit 120 selects the item “Yokohama” selected in FIG. Is specified as a search key.

  Then, as shown in FIG. 7B, the control unit 120 has a display 631 of the item “Mr. A” specified as the search key and a display 651 of the item “Yokohama”, and again displays the category list display 611. The search key selection screen (5) is displayed. Then, the search key selection screen (5) shown in FIG. 7B is displayed on the display screen 6 G of the display unit 106.

  In this way, one or more search key candidate information can be selected and specified as a search key for the necessary categories from the seven categories in the search key candidate information table.

  Therefore, a plurality of search key candidate information from the same category can be selected as a search key, or one or more search key candidate information can be selected as a search key from each of a plurality of categories.

  When the user wants to end the image search in the state shown in FIG. 7B, the user selects the end icon 6A. As a result, the control unit 120 ends the image search process and returns to the state where the menu is displayed, for example. In this case, the search key is not selected.

  When the user wants to redo the selection of the search key in the category “place”, the user selects the BK icon 6C. As a result, the control unit 120 returns to the search key selection screen (4) described with reference to FIG. 7A so that the search key can be selected again in the category “place”.

  In this case, the control unit 120 controls to cancel the already selected search key, cancel the already selected search key, select a new search key, or select a search key in addition to the already selected search key. And so on.

  In the state shown in FIG. 7B, when the selection of the search key is completed and the image is searched using the selected search key, the user selects the OK icon 6B. As a result, the control unit 120 deletes the category list display 611 in FIG. 7B so that the image search process can be executed.

  In this case, as described above, the control unit 120 accepts a predetermined operation for instructing display of an initial screen for image search in order to execute image search according to the selected search key.

  When the predetermined operation is received, the control unit 120 performs processing for displaying an initial image search screen. That is, the control unit 120 reads the image data in the search range set in FIG. 5A, controls the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105, and searches the entire display screen 6G. Thumbnail images of range images are displayed randomly (disjointly).

  Further, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to display a search key corresponding to the search key selected as described with reference to FIGS. 5 to 7 (FIG. 7B). Display 631 and the display corresponding to the display 651) are displayed on the display screen 6G.

  Then, the control unit 120 waits for an instruction operation (contact operation) to search key display corresponding to the selected search key, which is an operation to instruct the start of image search. Thereafter, when the instruction operation is performed, the control unit 120 performs image search processing based on the selected search key, as will be described later.

  Note that the search key selection process described with reference to FIGS. 5 to 7 is an example, and the search key candidate information may be selected from the search key candidate information in a different manner. Is possible.

[Predetermined operation for instructing display of the initial image search screen]
In the imaging apparatus 100, as described with reference to FIGS. 5 to 7, when the image search range is designated, the search key is selected, and the OK icon 6B is operated, as described above. Then, it waits for acceptance of a predetermined operation for displaying the initial image search screen.

  FIG. 8 illustrates operations that can be performed as a predetermined operation for displaying the initial screen for image search after the search key for image search is selected in the imaging apparatus 100 of this embodiment. It is a figure for doing.

  FIG. 8A shows that the search key selection process used for the image search described with reference to FIGS. 5 to 7 is executed and the search range and the search key are selected. In this state, as shown in FIG. 8B, the operation of tilting, tilting, shaking, and tapping the imaging apparatus 100 is detected as a predetermined operation that instructs display of the initial screen for image search. .

  When these operations are performed on the imaging apparatus 100, the motion sensor 137 of the imaging apparatus 100 detects the movement of the own apparatus according to each operation, and notifies the control unit 120 of the detection result.

  Based on the detection output from the motion sensor 137, the control unit 120 can determine what operation has been performed on the own device. When the control unit 120 determines that any of the operations shown in FIG. 8B, that is, the operation of being tilted, tilted, swung, or hit, has been performed, the initial screen for image search Is displayed.

  That is, the control unit 120 reads the image data in the search range set in FIG. 5A, supplies this to the decompression processing unit 110, decompresses, and restores the original image data before data compression. This is supplied to the display image forming unit 111.

  The display image forming unit 111 forms thumbnail data for forming a thumbnail image (reduced image) by thinning out the image data from the expansion processing unit 110, and arranges the thumbnail images in a discrete manner on the display screen. An image signal for displaying an image is formed.

  The image signal formed by the display image forming unit 111 is supplied to the display processing unit 105, converted into a signal to be supplied to the display unit 106, and then supplied to the display unit 106. Thereby, as shown in FIG. 8C, the thumbnail images of the image files in the search range are displayed separately on the display screen 6G.

  Further, as described above, the control unit 120 forms a selection key display (selection key icon) corresponding to the selected selection key, and processes this through the display image forming unit 111 and the display processing unit 105, Displayed on the display screen 6G.

  In this way, the thumbnail image of the image file in the search range is displayed separately, and an initial image search screen is displayed on which the search key display corresponding to the selected search key is displayed.

  As described above, in the imaging apparatus 100 according to this embodiment, the search range and the search key are selected prior to the image search, and then, as shown in FIG. 8B, tilt, tilt, shake, and tap. When a simple operation such as the above is performed, an initial image search screen can be displayed.

  Here, it has been described that thumbnail data for thumbnail image display is formed by thinning out image data of an image file to be searched when displaying an initial image search screen. However, this is not a limitation.

  It is possible to use the thumbnail data added to the image file by forming thumbnail data in each image file in advance based on the image data of the image file and adding it to the image file. it can.

  In this case, since the expansion processing in the expansion processing unit 110 and the thumbnail data formation processing in the display image forming unit 111 are not necessary, the addition of the imaging device 100 can be reduced.

  In addition, the motion sensor 137 of the imaging apparatus 100 according to this embodiment can separately detect the case of being shaken in the left-right direction and the case of being shaken in the up-down direction. For this reason, for example, when it is shaken in the horizontal direction, it is determined that it is an instruction to display the initial screen for image search, and when it is shaken in the vertical direction, it is determined to be an instruction to display the initial screen for image search. It can also be determined according to the direction of swinging.

  Of course, it is also possible to determine that it is an instruction to display the initial screen of the image search when the image is shaken in the left-right direction and when it is shaken in the up-down direction.

  In addition, the imaging apparatus 100 of this embodiment includes a touch panel 136 at the top of the set. For this reason, the operation of hitting the imaging device 100 can be determined that the imaging device 100 has been hit when an operation of repeatedly touching the touch panel 136 at the top of the set is detected.

[Screen transition example during image search]
Next, as described above, an example of screen transition when an image search is performed using a selected search key after the search key is selected by the user will be described. 9 to 11, two search keys are selected as described with reference to FIGS. 5 to 7, and a predetermined operation is performed as described with reference to FIG. 8 to perform an image search. It is a figure for demonstrating the example of a transition of the screen in a case.

[When using one search key]
As described above, after selecting two target search keys and selecting the OK icon 6B, as described with reference to FIG. As shown in FIG. 9A, the initial screen of the image search screen is displayed on the display screen 6G.

  In the initial image search screen shown in FIG. 9A, search key displays (search key icons) K1 and K2 corresponding to the search key selected by the user are displayed, and images in the search range are displayed separately. It has been done.

  In the following description, a search key selected by the user and corresponding to the search key display K1 is referred to as a search key k1, and a search key corresponding to the search key display K2 is referred to as a search key k2.

  Then, when executing an image search corresponding to the search key k1 corresponding to the search key display K1 out of the two selected search keys, the user displays the search key display K1 as shown in FIG. 9B. A finger or the like is brought into contact with a position on the touch panel 107 corresponding to the position.

  Based on the coordinate data from the touch panel 107 and the display information displayed at the position on the display screen corresponding to the position on the operation surface indicated by the coordinate data, the control unit 120 is instructed to display the search key K1. It is recognized that there has been an instruction to execute image search.

  In this case, the control unit 120 uses the search key k1 corresponding to the designated search key display K1 to extract an image file having a keyword that matches the search key from the image file belonging to the search range.

  Then, the control unit 120 selects a thumbnail image of the image file extracted as matching the search key k1 for the image file in the search range on a predetermined position on the display screen 6G (for example, the search key display K1 Display in the vicinity).

  Even for the image file in the search range, the thumbnail image of the image file that has not been extracted according to the search key is displayed at a position away from a predetermined position on the display screen 6G.

  As a result, as shown in FIG. 9B, the images of the image file having the keyword that matches the search key k1 are gathered and displayed around the search key display K1, and the images of the other image files are searched. It is displayed at a position away from the key display K1.

  As shown in FIG. 9B, the processing for displaying thumbnail images is performed by the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105 that operate according to the control of the control unit 120. Are displayed on the display screen 6G of the display unit 106.

  Specifically, the image data of the image file in the search range is decompressed by the decompression processing unit 110 and supplied to the display image forming unit 111. The display image forming unit 111 forms thumbnail data by thinning the image data supplied thereto.

  Then, under the control of the control unit 120, the display image forming unit 111 displays the thumbnail image of the keyword that matches the search key k1 in the vicinity of the display position of the search key display K1, and searches for other thumbnail images. Image data to be displayed at a position distant from the key display K1 is formed.

  This image data is image data that forms an image for one screen. An image signal to be supplied to the display processing unit 105 is formed from the image data, and the image signal is supplied to the display processing unit 105. The display processing unit 105 forms a display image signal to be supplied to the display unit 106 in accordance with control from the control unit 120, and supplies this to the display unit 106. As a result, the result of the image search is displayed on the display screen 6G of the display unit 106 in the manner shown in FIG. 9B.

  As described above, when thumbnail data for displaying a thumbnail image is already prepared in each image file, the display shown in FIG. 9 is performed using the thumbnail data.

  When using thumbnail data prepared in advance for each image file, as described above, it is necessary to perform expansion processing in the expansion processing unit 110, formation processing of thumbnail data in the display image forming unit 111, and the like. And the load on the imaging apparatus 100 can be reduced.

  In this way, the user knows that the image search has been executed using the search key k1 corresponding to the search key display K1, and the result of the image search according to the information displayed on the display screen 6G. Can do.

  In addition, as shown in FIG. 9B, it is possible to grasp the outline of the image group that matches the search key and the outline of the image group that does not match the search key, so that the user can easily understand. Image search can be performed.

  Then, as shown in FIG. 9C, after the contact of the user's finger or the like to the search key display K1 is released, the control unit 120 displays the image until a certain time T (for example, up to several seconds). Maintain display of search results. While this display is maintained, the user can confirm the result of the image search.

[When using two search keys]
Further, in the case of the example described with reference to FIG. 9, the image search is performed using one of the two selected search keys that is designated by the user. However, it is not limited to this. An image search using both of the two selected search keys may be performed.

  FIG. 10 is a diagram for explaining a case where an image search is performed using both of the two selected search keys. As shown in FIG. 10A, a search key display K1 and a search key display K2 are displayed corresponding to the two search keys selected by the user.

  Then, as shown in FIG. 10B, it is assumed that the user touches both the search key display K1 and the search key display K2 with a finger or the like. That is, it is assumed that the user touches the operation surface of the touch panel 107 corresponding to each of the display positions of both the search key display K1 and the search key display K2.

  In this case, the coordinate data of the two contact positions is supplied from the touch panel 107 to the control unit 120. Then, based on the coordinate data from the touch panel 107 and the display information displayed at the position on the display screen corresponding to the position on the operation surface indicated by the coordinate data, the control unit 120 searches the search keys k1, k2. Is detected at the same time.

  In this case, the control unit 120 searches and extracts image files having both the search key k1 and the search key k2 as keywords, and collects thumbnail images of the extracted image files as shown in FIG. In this way, it is displayed on the display screen 6G.

  Thumbnail images of image files that do not have both the search key k1 and the search key k2 as keywords are displayed separately at positions distant from the collected and displayed image group.

  Similar to the case described with reference to FIG. 9, such display can be performed by the control unit 120 by controlling the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105. .

  Thereby, an image search using a plurality of search keys can be flexibly performed. Here, the case where two search keys are used has been described as an example, but the present invention is not limited to this. It is possible to select two or more search keys and perform image search using each of them simultaneously.

  In the example shown in FIG. 10, an image file that satisfies both the search key k1 and the search key k2 is searched. However, it is not limited to this. It is also possible to search for an image file that satisfies one of the search key k1 and the search key k2.

  That is, whether to search for an image file that satisfies all of the plurality of search keys or to search for an image file that satisfies any one of the plurality of search keys is set in advance for the imaging apparatus 100. Can be.

  Of course, at the start of the image search, the user can input and set which search is to be performed on the imaging apparatus 100.

[When using an image as a search key]
In the imaging apparatus 100 according to the above-described embodiment, an image file having a keyword that matches the search key is searched. That is, in the above-described embodiment, the search key is keyword information.

  However, the search key is not limited to keyword information. Similar images can be searched using the image itself, specifically, information on the result of image analysis as a search key. In the imaging apparatus 100 of this example, an image search is performed using the image itself as a search key.

  FIG. 11 is a diagram for explaining a case where an image search is performed using an image as a search key. As shown in FIG. 11A, the images that can be used as search keys are displayed in a distinguishable manner such as highlight display.

  As described with reference to FIG. 2, image analysis information obtained by image analysis of image data of the image file is added to each image file as metadata. As described above, this image analysis information can be used to digitize and show the characteristics of an image based on each image data by using various methods such as edge detection and color analysis. The composition and the similarity of the subject can be compared.

  For this reason, as a search key, for example, an image that has been found to be a well-characterized image, such as an image showing a large human face or an image of a building or landscape with a clear outline, as a result of image analysis. Be ready to use.

  Specifically, an image file that can be used as a search key is identified by setting a flag or the like. As a result, as shown in FIG. 11A, thumbnail images of images that can serve as search keys can be distinguished by being highlighted.

  Then, as shown in FIG. 11B, a finger or the like is brought into contact with the operation surface of the touch panel 107 on the display position of the thumbnail image of the target image in the thumbnail image of the image that can be a search key.

  In this case, the control unit 120 determines which thumbnail image is based on the coordinate data from the touch panel 107 and the thumbnail image displayed at the position on the display screen corresponding to the position on the operation surface indicated by the coordinate data. It can be recognized whether it is designated as a search key.

  The control unit 120 reads out image analysis information from the image file corresponding to the designated thumbnail image, and extracts an image file having image analysis information similar to the search key using the image analysis information as a search key. Then, the control unit 120 collects and displays the thumbnail images of the extracted image file at a predetermined position on the display screen as shown in FIG.

  In the case of the example shown in FIG. 11, a case where two thumbnail images are designated to be search keys is shown. In the case of this example, an image similar to both image analysis results of the designated two images is extracted. Note that it is possible to extract an image similar to one of the image analysis results of the instructed two images in accordance with a user instruction.

  In this way, by specifying an image as a search key, it is possible to narrow down the image using a person or a building shown in the image as a search condition. That is, an image similar to the image designated as the search key can be extracted.

  Here, the description has been made assuming that, as a result of image analysis, an image with clear characteristics is specified in advance as an image that can be designated as a search key. However, it is not limited to this. Of course, all images may be designated as search keys. In this case, it is not necessary to highlight the thumbnail image.

  It is also possible for the user himself to set an image used as a search key in advance.

[Search for image files having information similar to search key]
In the case of the image search described above, an image file having a keyword that matches the specified search key (character information) is searched, or image data similar to (related to) the specified image (image analysis information of the image) is retrieved. It explained that you can search for the image file you have.

  However, it is not limited to this. An image file having a keyword related to the designated search key (character information) can be searched. Further, when searching for an image file having image data related to the designated image, it is also possible to perform an image search according to the purpose.

  In the following, there are a case where an image file having a keyword similar to the designated search key (character information) is searched, and a case where an image file having image data related to the designated image is searched. A case of performing an image search according to the will be described.

[Configuration example of search key relevance dictionary]
First, a configuration for searching for image data having information related to a search key when the search key is character information will be described. In this case, the imaging apparatus 100 of this embodiment uses a search key relevance degree dictionary.

  FIG. 12 is a diagram for explaining a configuration example of a search key relevance dictionary. The search key relevance dictionary is configured to collect character information (keywords) related to the character information according to the relevance of the character information with respect to character information that may be used as a search key.

  In the example shown in FIG. 12, related keywords are registered in three stages of “high”, “medium”, and “low” for the search key. Here, the character information (keyword) having the degree of relevance “high” with respect to the search key has the same character information, character information as a synonym, and the same character with respect to the search key. Character information indicating meaning and contents.

  Further, the character information (keyword) having the degree of relevance “medium” with respect to the search key is character information directly linked to the search key as a general image. In addition, character information (keywords) with a relevance level of “low” for the search key is not directly linked to the search key as a general image, but some keyword is interposed between them. Is character information that can be linked to the search key.

  In the example shown in FIG. 12, “summer, summer, early summer, summer vacation,...”, Etc., are registered as keywords having a high degree of association with the search key “summer”. The keyword “summer” is the search key itself, the keyword “summer” is a synonym for the search key “summer”, and the keyword “early summer, summer vacation” has the same characters as the search key “summer” and is almost identical. Therefore, the degree of relevance is “high”.

  For the search key “summer”, keywords such as “sunflower, watermelon, fireworks display, sea,. The keyword “sunflower, watermelon” is mainly found in “summer” and is directly linked to the search key “summer”, so the degree of relevance is “medium”.

  The keyword “fireworks display” is mainly a feature of “summer” and is directly related to the search key “summer”, so the degree of relevance is “medium”. In addition, since the keyword “sea” often has the image of “summer”, the relevance level is “medium”.

  Also, for the search key “summer”, “rainy season, homework, school, travel” and the like are registered as keywords of “low” relevance. The keyword “rainy season” is the climate state just before summer and does not directly image the search key “summer”, but if “rainy season” is clear it will be “summer”, so the search key “summer” On the other hand, the degree of relevance is “low”.

  Further, since the keyword “homework, school, travel” can be associated with the search key “summer” via, for example, the word “summer vacation”, the degree of relevance is “low” in this example.

  In this way, the search key relevance dictionary is divided into three levels of relevance “high”, “medium”, and “low” for each of the words that may be used as search keys. Related keywords are registered in advance.

  The character information that may be used as a search key includes at least the categories “person”, “location”, “color”, “season”, “subject” in the search key candidate information table described with reference to FIG. Is the character information registered in.

  Therefore, a search key relevance dictionary as shown in FIG. 12 is formed for each character information that may be used as a search key, and is stored and held in, for example, the EEPROM 124 of the imaging apparatus 100.

  A search key relevance dictionary created in advance is provided, but the user can modify it and use it.

  Then, according to the configuration example of the search key relevance dictionary shown in FIG. 12, when the word “summer” is used as the search key, the relevance “high” and “medium” shown in FIG. , An image file (image data) having each keyword “low” can be searched and extracted.

  Then, the extracted image files are classified according to the degree of association, and can be handled for each of the degrees of association “high”, “medium”, and “low”.

[Example of criteria for determining relevance of images based on image analysis information]
Next, a configuration for searching for an image file having information related to the search key when the search key is an image (image analysis information of the image) will be described. In this case, the imaging apparatus 100 of this embodiment performs an image search based on the image analysis information.

  In this case, it is important which information of the image analysis information is used to perform the image search. FIG. 13 is a diagram for explaining information that can be a search key for image search in the image analysis information.

  As described with reference to FIG. 2, image analysis information obtained by analyzing the image data of each image file is added to each image file as metadata. In this image analysis information, as described above and as shown in FIG. 13, the area of the face of the person in the image, the number of persons in the image, the degree of smile of the person in the image, Information indicating the characteristics of the entire image is included.

  When the category “others” is selected in the category list display 611 shown in FIG. 5B or the like, each piece of information shown in FIG. 13 is displayed as information constituting the image analysis information. Select the information you want. Thereby, an image search according to the selected image analysis information can be performed.

  For example, it is assumed that “area of a person's face in an image” is selected as image analysis information and an image to be used as a search key is designated. In this case, the control unit 120 searches and extracts a related image from the recording medium 135 based on the “area of the person's face in the image” of the image analysis information of the image designated as the search key.

  Specifically, the control unit 120 sets the image of the person's face in the image to a first predetermined range of images with a relevance “high” and a second predetermined range of images with a relevance “medium”. As an image, an image in the third predetermined range is searched and extracted from the recording medium 135 with the relevance level “low”.

  In this case, the first predetermined range is the range closest to the area of the person's face in the image used as the search key, and the second and third predetermined ranges are gradually the face of the person in the image used as the search key. It is made to become the range away from the area of.

  As described above, when the “area of the person's face in the image” in the image analysis information is used, the area of the person's face in the image of the image used as the search key is used as a reference. It is possible to search and extract an image related to the image as the search key.

  Further, it is assumed that “the number of persons in the image” is selected as the image analysis information and an image to be used as a search key is designated. In this case, the control unit 120 searches and extracts a related image from the recording medium 135 based on the “number of persons in the image” of the image analysis information of the image designated as the search key.

  Specifically, for the “number of persons in the image”, the control unit 120 sets an image in the first predetermined range as an image having a relevance “high”, and sets an image in the second predetermined range as an image having a relevance “medium”. The images in the third predetermined range are retrieved from the recording medium 135 with the relevance level “low” and extracted.

  In this case, the first predetermined range is the range closest to the number of persons in the image used as the search key, and the second and third predetermined ranges gradually deviate from the number of persons in the image used as the search key. To be in range.

  Thus, when the “number of persons in the image” in the image analysis information is used, the search key is used based on the number of persons in the image of the image used as the search key. Images related to the image can be searched and extracted.

  Also, when the “analyzing degree of person in the image” that is the image analysis information is used, the control unit 120 is based on the “indicating degree of person smiling in the image” of the image designated as the search key. , Related images can be retrieved from the recording medium 135.

  In addition, when the “feature of the entire image” that is the image analysis information is used, the control unit 120 records a related image based on the “feature of the entire image” of the image designated as the search key. It is possible to search from the medium 135.

  In this case, the degree of similarity may be obtained from the color and complexity of the image, and related images may be extracted according to the degree of similarity and classified into the degree of association “high”, “medium”, and “low”. Be made possible.

  As described above, in the imaging apparatus 100 of this embodiment, by using the search key relevance dictionary and the image analysis information, it is possible to search and extract an image related to the instructed search key. In the imaging apparatus 100, the image extracted by searching can be displayed according to the degree of association with the search key.

[Display mode of search result of image file having information related to search key]
Next, as described above, a display mode of a search result when an image search is performed using the selected search key after the search key is selected by the user will be described. Here, a case where a search key as character information is selected will be described as an example.

  FIG. 14 is a diagram for explaining a display result of a search result when an image search is performed from a state where one search key (character information) is selected as described with reference to FIGS. FIG.

  14A shows a display form of a search result when an image search is performed according to the selected search key, and FIG. 14B shows a search result display in FIG. 14A. It is a figure for demonstrating the detail of area | region Ar.

  As described with reference to FIGS. 5 and 6, after the image search range is set and one target search key is selected, a predetermined operation is performed as described with reference to FIG. Then, the control unit 120 displays an initial screen for image search.

  Specifically, the control unit 120 displays the images (thumbnail images) corresponding to the image data in the search range in a discrete manner on the display screen 6G of the display unit 106. Further, the control unit 120 displays a search key display (search key icon) K1 corresponding to the selected search key on the display screen 6G of the display unit 106.

  Then, as shown in FIG. 14A, when the user touches a position on the operation surface of the touch panel 107 corresponding to the display position of the search key display K1 displayed on the display screen 6G, the touch panel 107 Supplies coordinate data indicating the contact position to the control unit 120.

  As described above, the control unit 120 manages where and what information is displayed on the display screen 6G. Based on the coordinate data indicating the designated position on the operation surface from the touch panel 107 and the display information on the display screen 6G of the display unit 106 corresponding to the designated position, the control unit 120 displays the search key display K1. The instruction can be detected.

  The control unit 120 recognizes that the search key display instruction instructs the start of an image search using the search key corresponding to the search key display, and performs an image search using the selected search key. . In this case, the control unit 120 also refers to the search key relevance dictionary configured as described with reference to FIG. 12, and searches for and extracts an image file having a keyword related to the search key.

  Then, the control unit 120 displays a thumbnail image corresponding to the image data of the extracted image file at a position corresponding to the degree of association of the keyword with the search key. In the case of this example, the control unit 120 displays the image data obtained as a result of the search within the area indicated by the search result display area Ar on the display screen 6G, and the position according to the degree of relevance of the keyword to the search key. To display.

  That is, as only the search result display area Ar is shown in FIG. 14B, the search result display area Ar is displayed in the direction from the central portion to the outside, the display area of the relevance “high”, the relevance “ The display area is “medium” and the display area is “low”.

  Therefore, in this example, in FIG. 14B, the control unit 120 displays the thumbnail image of the image file having the keyword having the “high” relevance level with respect to the search key in the central portion ArH of the display area Ar. .

  Then, the control unit 120 displays the thumbnail image of the image file having the keyword “relevance” with respect to the search key in the area ArM outside the display area where the relevance degree of the display area Ar is “high”.

  Further, the control unit 120 displays a thumbnail image of an image file having a keyword with a degree of relevance of “low” with respect to the search key in an area ArL outside the display area ArM with a degree of relevance of the display area Ar. .

  In this way, thumbnail images of image files having keywords of “high”, “medium”, and “low” with respect to the search key can be displayed at positions corresponding to the respective degrees of relevance. I have to.

  In the case of this example, for the image search, the control unit 120 selects a keyword related to the search key from the image files stored in the recording medium 135 based on the search key and the search key relevance dictionary. Search and extract the image file you have.

  The extracted image file is temporarily stored in, for example, the RAM 123, and the image data is read out according to the degree of relevance by the control unit 120 and supplied to the decompression processing unit 110. Data is restored.

  Then, the image data decompressed by the decompression processing unit 110 is supplied to the display image forming unit 111, where it is subjected to thinning processing to form thumbnail data, which is related to the keywords that the search key has. It is arranged at a position according to the degree.

  In this way, the display image forming unit 111 forms image data constituting an image for one screen, converts it into an image signal in a format supplied to the display processing unit 105, and displays the image processing unit 105. To supply.

  The display processing unit 105 receives the supply of the image signal from the display image forming unit 111, forms an image signal to be supplied to the display unit 106 and supplies the image signal to the display unit 106. As a result, as shown in FIG. 14A, an image having a keyword related to the selected search key is displayed on the display screen of the display unit 106 at a position corresponding to the degree of association.

  Note that, as the degree of relevance decreases, the thumbnail images having different degrees of relevance can be displayed so as to be distinguished by increasing the transparency of the narrowed down image or decreasing the brightness.

  As a result, images having keywords with different relevance levels with respect to the search key are displayed at positions corresponding to the relevance levels, and the user can check the result of the image search while being aware of the difference. The

  Instead of searching only for images that have keywords that match the search key as in the past, you can also search for drawings that have keywords related to the search key, taking into account differences in relevance Search results can be displayed. Therefore, the image search can be performed efficiently and the result can be used appropriately.

  Here, it has been described that the display image forming unit 111 forms thumbnail data for displaying thumbnail images by thinning the image data. However, it is not limited to this.

  The process of forming thumbnail data from image data is burdensome. Therefore, thumbnail data may be formed in advance from image data in each image file and stored in each image file.

  In this way, by previously forming and adding thumbnail data to each image file, the image data expansion processing in the expansion processing unit 110 and the thumbnail data formation processing in the display image forming unit 111 are omitted. be able to.

  That is, when thumbnail data exists in each image file, the image file corresponding to the search key is extracted, and the thumbnail data is read from the image file and supplied to the display image forming unit 111.

  Thereby, in the mode shown in FIG. 14, the thumbnail image of the image file having the keyword related to the search result with respect to the search key can be displayed at a position corresponding to the degree of association.

[Operation to confirm image search results]
In the imaging apparatus 100 of this embodiment, as described with reference to FIGS. 9 to 14, image search using a search key is performed, and the result is displayed on the display screen 6 </ b> G of the display unit 106. Then, it waits for acceptance of a predetermined operation for confirming the search result.

  FIG. 15 is a diagram for describing an operation that can be performed as a predetermined operation for determining the result of the image search in the imaging apparatus 100 according to the present embodiment.

  FIG. 15A shows a state in which an image search is performed using the selected search key and the result is displayed as described with reference to FIGS. As described above, when the result of the image search is displayed, as shown in FIG. 15B, an operation for raising the imaging device 100, an operation for tilting the imaging device 100, an operation for shaking the imaging device 100, and imaging. The operation of hitting the device 100 is detected as a predetermined operation for determining the search result.

  When these operations are performed on the imaging apparatus 100, the motion sensor 137 of the imaging apparatus 100 detects the movement of the own apparatus according to each operation, and notifies the control unit 120 of the detection result.

  Based on the detection output from the motion sensor 137, the control unit 120 can determine what operation has been performed on the own device. If the control unit 120 determines that any of the operations shown in FIG. 15B, that is, an operation such as being awakened, tilted, swung, or struck, has been performed, the displayed search is performed. Try to confirm the result.

  That is, as a result of the image search, the control unit 120 determines and holds an image file corresponding to the thumbnail image displayed so as to be gathered at a predetermined position on the display screen 6G as a result of the image search.

  Specifically, the control unit 120 temporarily stores and holds the search result in, for example, the RAM 123 or the EEPROM 124 so that the search result is not erased until a clear canceling process is performed. Maintain that state.

  Thereafter, the control unit 120 performs a predetermined process on the image file group as a result of the confirmed image search. For example, a process of storing an image file group as a result of the confirmed image search in a predetermined image folder is performed.

  The storage processing in the folder is performed by the control unit 120 controlling the writing / reading unit 134. Specifically, for each image file of the image file group obtained as a result of the image search, information for accessing each image file is recorded in a predetermined image folder formed on the recording medium 135. It is processing.

  In this case, for example, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to display the image image of the image folder that stores the image file as illustrated in FIG. To do. Then, the control unit 120 performs a process of storing the image file group as a result of the confirmed image search in a predetermined image folder.

  As described above, in the imaging apparatus 100 of this embodiment, after performing an image search, as shown in FIG. 15B, when a simple operation such as raising, tilting, shaking, or hitting is performed. A predetermined process can be executed.

  In this case, the control unit 120 can execute a predetermined process using the image file group obtained as a result of the image search as a processing target.

  Here, the case where the image file group obtained as a result of the image search is determined and stored and then stored in a predetermined image folder has been described as an example, but the present invention is not limited to this.

  For example, an image file group obtained as a result of image search can be reproduced. In this reproduction process, each image data of the image file group that has been determined and held is processed through the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105 under the control of the control unit 120, and a reproduced image is displayed. This is a process of displaying on the display screen 6G of the unit 106.

  As will be described in detail later, an image file group obtained as a result of the image search can be transmitted to another imaging device or the like. This transmission process is performed through the communication unit 141 controlled by the control unit 120.

  In this case, what kind of processing is to be performed on the image file group obtained as a result of the image search is set in advance, and a predetermined operation is performed on the imaging apparatus 100 as described above. In such a case, the set processing can be executed.

  Also, separate processing can be assigned to each operation such as raising, tilting, shaking, and hitting the imaging apparatus 100.

  For example, the operation of tilting the imaging device 100 is assigned to the storage processing of the image file group obtained as a result of the image search in the folder. Further, the operation of shaking the imaging device 100 is assigned to the reproduction process of the image file group obtained as a result of the image search. In addition, an image file group obtained as a result of the image search is assigned to an operation of hitting the image capturing apparatus 100 for transmission processing to another device.

  In this way, different processes can be executed in accordance with operations performed on the imaging apparatus 100.

[Details of processing during image search]
Next, processing at the time of image search performed in the imaging apparatus 100 of this embodiment will be described. As described above, this image search process is a series of processes including search range setting, search key selection, image search initial screen display, image search process, and image search result confirmation process. .

  FIGS. 16 and 17 are flowcharts for explaining processing at the time of image search performed in the imaging apparatus 100. The processes of the flowcharts shown in FIGS. 16 and 17 are processes mainly executed by the control unit 120 when the menu item “image search” is selected from the displayed menu, as described above.

  When the processing shown in FIGS. 16 and 17 is executed, the control unit 120 executes processing for setting an image search range and selecting search keys as described with reference to FIGS. 5 to 7 (step S101). ).

  And the control part 120 judges whether completion | finish operation was performed in the process of step S101 (step S102). When it is determined in the determination process of step S102 that the end operation has been performed, the control unit 120 performs a process of ending the image search process (step S103), ends the processes shown in FIGS. Return to the menu display.

  If it is determined in the determination process in step S102 that the end operation has not been performed, the control unit 120 determines that the search key has been properly selected, and executes an image search initial screen display process ( Step S104).

  In step S104, as will be described in detail later, as described with reference to FIG. 8, a predetermined operation for displaying the initial image search screen is received, and when the operation is received, the image search is performed. Processing to display the initial screen of.

  Then, the control unit 120 receives an operation input from the user through the touch screen 108 or the like (step S105), and determines whether the operation input has been received (step S106).

  If it is determined in step S106 that the operation input from the user is not accepted, the process from step S105 is repeated to wait for the operation input from the user.

  If it is determined in step S106 that an operation input from the user has been accepted, it is determined whether or not a search key display corresponding to the selected search key is instructed by the user (step S107).

  If it is determined in step S107 that the search key display corresponding to the selected search key is not instructed by the user, the control unit 120 executes a process corresponding to the operation input received in step S105 ( Step S108).

  In step S108, various processes can be performed in accordance with user operation input. For example, the search key can be changed and added.

  If it is determined in step S107 that the search key display is instructed by the user, the control unit 120 executes an image search using the search key corresponding to the instructed search key display, and displays the search result. It is displayed (step S109).

  In step S109, as described with reference to FIGS. 9, 10, 11, and 14, the control unit 120 collects the thumbnail images of the image files corresponding to the search key at a predetermined location on the display screen 6G. Display, and the process proceeds to the process of FIG.

  Then, the control unit 120 determines whether or not the contact of the user's finger or the like on the search key display has ended (step S110). If it is determined in step S110 that the contact is still continuing, the process from step S110 is repeated and the process waits until the contact ends.

  When it is determined in step S110 that the contact of the user's finger or the like to the search key display is completed, the control unit 120 uses the function of the clock circuit to contact the user's finger or the like to the search key display. The measurement of the time Ts after ending is started (step S111). Although not shown in FIG. 1, the clock circuit is included in the imaging apparatus 100 as described above.

  And the control part 120 judges whether time Ts which started measurement in step S111 became more than predetermined time T (step S112). When it is determined in the determination process of step S112 that the measurement time Ts is not equal to or longer than the predetermined time T, the control unit 120 receives an operation input from the user (step S113).

  And the control part 120 judges whether the operation input from a user was received (step S114). If it is determined in the determination process in step S114 that no operation input has been received, the control unit 120 repeats the process from step S112.

  When it is determined in the determination process of step S114 that the operation input has been received, the control unit 120 determines whether or not the received operation input is a search result confirmation operation (step S115).

  In the determination process of step S115, when determining that the received operation input is a search result determination operation, the control unit 120 determines the instructed image group as a group (step S116). The processing in step S116 is processing for maintaining the image file group as a result of the image search as it is.

  After the processing in step S116, the control unit 120 performs predetermined processing on the confirmed group images, such as storing the confirmed group images in a predetermined image folder, playing back the images, and transmitting the images to other devices. (Step S117). Thereafter, the control unit 120 repeats the processing from step S101 of FIG. 16, for example.

  The processes in steps S115 to S117 are a process for determining the result of the image search described with reference to FIG. 15 and a predetermined process for processing the determined image file group.

  In the determination process of step S115, when it is determined that the received operation input is not a search result confirmation operation, the control unit 120 determines whether or not the received operation input is a search result canceling operation ( Step S118).

  When it is determined in the determination process of step S118 that the received operation input is not a search result canceling process, the control unit 120 executes a process according to the received operation input (step S119).

  In the determination process of step S118, when it is determined that the received operation input is a search result canceling process, for example, the control unit 120 cancels the display of the image search result and displays the initial image search screen. Return (step S120).

  After the processing in step S120, the control unit 120 repeats the processing from step S105 in FIG. 16 to perform image search according to the displayed search key display or add a new search key. Image search can be performed.

  If it is determined in step S112 that the measurement time Ts is equal to or longer than the predetermined time T, the display of the image search result is canceled and the screen returns to the initial image search screen (step S120). Then, as described above, the processing from step S105 in FIG. 16 is repeated.

  As described above, in the imaging apparatus 100 of this embodiment, after setting the image search range and selecting the search key, the initial image search screen is displayed by a simple operation, and the image search is performed. Can be done.

  Further, after executing the image search, the image file group obtained as a result of the image search is determined by a simple operation, and the determined image file group is set as a processing target, stored in a folder, played back, and other devices. Predetermined processing such as transmission to can be executed.

  Note that the determination of the image file group obtained as a result of the image search means that the result of the image search is retained without canceling the result of the image search, as described above. Then, as described above, the predetermined processing is executed with the image file group obtained as a result of the image search determined as described above as a processing target.

  Also, the display of the image search results is automatically canceled when the user does not perform the search key operation and the confirmation operation is not performed until a certain period of time has elapsed after canceling the operation to specify the search key. can do.

  Accordingly, the user can perform an image search using the next search key without performing an operation for canceling the display of the result of the image search one by one.

[Initial screen display processing]
Next, the display process of the initial image search screen executed in step S104 of the image search process described with reference to FIGS. 16 and 17 will be specifically described. FIG. 18 is a flowchart for explaining display processing of an initial screen for image search executed in step S104 shown in FIG.

  First, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to form a message that prompts the user to perform a predetermined operation for displaying an initial image search screen. It is displayed on the screen 6G (step S1041).

  Here, as described with reference to FIG. 8B, the predetermined operation for displaying the initial image search screen is one of the operation of tilting, tilting, shaking, and tapping the imaging apparatus 100. .

  Then, the control unit 120 receives an operation (action) from the user to the own device (step S1042), and determines whether or not a predetermined operation for displaying the initial image search screen has been performed (step S1043). ).

  The determination processing in step S1043 can be determined by the control unit 120 based on the detection output from the motion sensor 137. Note that whether or not the imaging device 100 has been hit can be determined based on the detection output from the touch panel 1036 at the top of the set.

  If it is determined in step S1043 that the predetermined operation for displaying the initial image search screen has not been performed, the processing from step S1043 is repeated and the process waits until the predetermined operation is performed. .

  When it is determined in step S1043 that the predetermined operation for displaying the initial image search screen has been performed, the control unit 120 displays the thumbnail images of the image files in the search range on the display screen 6G. (Step S1044).

  The process of step S1044 is a process of displaying thumbnail images of image files in the search range set by the process of step S101 shown in FIG. 16 on the display screen 6G.

  That is, the processing in step S1044 is processing performed by the control unit 120 by controlling the expansion processing unit 110, the display image forming unit 111, and the display processing unit 111, similarly to the processing for displaying the thumbnail image described above.

  Specifically, in step S1044, the control unit 120 controls the above-described units, forms thumbnail data from image data of image files belonging to the search range, and randomly displays the thumbnail data on the display screen 6G.

  Thereafter, the control unit 120 controls the display image forming unit 111 and the display processing unit 111 to display a search key display (search key icon) corresponding to the search key selected in step S101 on the display screen 6G. Image retrieval is possible (step S1045). Then, the process shown in FIG. 18 ends.

  As described above, in the imaging apparatus 100 according to this embodiment, after setting an image search range and selecting a search key, image search can be performed by a simple operation such as tilting, tilting, shaking, or hitting the imaging apparatus 100. An initial screen can be displayed. That is, it is possible to prepare for image search with a very simple operation.

  Further, the image file group obtained as a result of the image search is determined by a simple operation similar to the operation for displaying the initial screen of the image search, and a predetermined image file group as a processing target is determined. Processing can be performed.

  The process of determining the image file group obtained as a result of the image search and executing a predetermined process on the group is performed mainly in steps S115 to S117 of the processes shown in FIGS. It is what is said.

[Send image files to other devices]
As described above, in the imaging apparatus 100 of this embodiment, an image search is performed using the search key selected by the user, the resulting image file group is determined, and the determined image file group is processed. It has been explained that predetermined processing can be performed as an object.

  Here, as described above, the predetermined processing includes storage processing of the image file group in the image folder, reproduction processing of the image file group, transmission processing to the other device of the image file group, and the like.

  The storage process in the image folder is a process closed in the imaging device 100 as described above. That is, information for accessing each image file of the image file group to the information of the image folder so that the determined image file group belongs to the predetermined image folder under the control of the control unit 120. Should be added.

  The image file group reproduction process is also a process closed in the imaging apparatus 100. That is, in this case, the control unit 120 controls the expansion processing unit 110, the display image forming unit 111, and the display processing unit 105 to reproduce and display an image corresponding to each image data of the specified image file group. It may be displayed on the display screen 6G of the unit 106.

  On the other hand, the process of transmitting the image file group to the other device requires communication with the other device, and is slightly different from the process of storing the image file group in the image folder or playing it back. There is a part.

  Hereinafter, a case will be described in which the imaging device 100 according to this embodiment transmits an image file group obtained as a result of image search to another imaging device (another device) configured similarly. 19 to 22 are diagrams for explaining a case where an image file group obtained as a result of an image search is transmitted to another imaging device (another device) configured similarly.

  When the result of the image search is displayed on the display screen 6G, when the following operation is performed on the imaging apparatus 100, the image file group obtained as a result of the image search is similarly selected. It is determined that an instruction to transmit to another configured imaging device (another device) has been issued.

  That is, when the imaging device 100 is tilted as shown in FIG. 19A, when the imaging device 100 is swung left and right as shown in FIG. 19B, the imaging device 100 as shown in FIG. 19C. If the upper surface is struck, it is determined that it is a transmission instruction to another machine.

  The imaging apparatus 100 that has received an instruction to transmit to another device communicates with a transmission destination device, establishes a communication connection, and then transmits the image file group obtained as a result of the image search to the transmission destination. Sent to other devices.

  On the other hand, the transmission destination device receives the image file group from the transmission source imaging apparatus 100 and stores the image file group in a predetermined image folder of the recording medium of the own device.

  In the transmission source imaging apparatus 100, during the transmission of the image file group, a display indicating that data transmission is in progress is performed. In addition, in the transmission destination device, during the reception of the image file group, a display indicating that data is being received is displayed.

  As shown in FIGS. 20 to 21, a specific case will be considered in which data is transmitted and received between the imaging device 100 (s) and the imaging device 100 (R) having the configuration described with reference to FIG. 1.

  As shown in FIG. 20A, the image capturing apparatus 100 (S) that is the transmission source in a state where the image file group (thumbnail image group of image files) obtained as a result of the image search is displayed on the display screen 6G is tilted. Suppose that In this case, the transmission source imaging device 100 (S) communicates with the transmission destination imaging device 100 (R) to establish a communication connection.

  Thereafter, the image file group as a result of the image search is transmitted from the imaging apparatus 100 (S) as the transmission source. On the other hand, the transmission destination imaging apparatus 100 (R) performs a process of receiving the transmitted image file group and storing it in a recording medium.

  In this case, in the transmission source imaging apparatus 100 (S), as shown in the upper part of FIGS. 20A, 20B, and 20C, the transmission state of the image file group as a result of the image search that is the transmission target. Accordingly, the display of the image file group is changed to indicate that data is being transmitted.

  On the other hand, in the imaging device 100 (R) as the transmission destination, as shown in the lower part of FIGS. 20A, 20 </ b> B, and 20 </ b> C, according to the reception state of the image file group, The display is changed to indicate that data is being transmitted.

  Further, as shown in FIG. 21A, the image capturing apparatus 100 (S) as the transmission source in a state where the image file group (thumbnail image group of the image file) obtained as a result of the image search is displayed on the display screen 6G. For example, suppose that it is swung from side to side.

  In this case as well, as in the case described with reference to FIG. 20, the transmission source imaging device 100 (S) communicates with the transmission destination imaging device 100 (R) to establish a communication connection. Like that.

  Thereafter, the image file group as a result of the image search is transmitted from the imaging apparatus 100 (S) as the transmission source. On the other hand, the transmission destination imaging apparatus 100 (R) performs a process of receiving the transmitted image file group and storing it in a recording medium.

  Then, as shown in the upper part of FIGS. 21A, 21B, and 21C, the image capturing apparatus 100 (S) that is the transmission source sets the transmission state of the image file group as a result of the image search that is the transmission target. In response, the display of the image file group is changed to indicate that data is being transmitted.

  On the other hand, in the imaging device 100 (R) as the transmission destination, as shown in the lower part of FIGS. 21A, 21 </ b> B, and 21 </ b> C, according to the reception state of the image file group, The display is changed to indicate that data is being transmitted.

  Also, as shown in FIG. 22A, the image capturing apparatus 100 (S) that is the transmission source in a state where the image file group (thumbnail image group of the image file) obtained as a result of the image search is displayed on the display screen 6G. For example, suppose that the upper surface of the set is hit.

  Also in this case, as in the case described with reference to FIGS. 20 and 21, the transmission source imaging 100 (S) communicates with the transmission destination imaging device 100 (R) to communicate with each other. To establish.

  Thereafter, the image file group as a result of the image search is transmitted from the imaging apparatus 100 (S) as the transmission source. On the other hand, the transmission destination imaging apparatus 100 (R) performs a process of receiving the transmitted image file group and storing it in a recording medium.

  Then, in the imaging device 100 (S) that is the transmission source, as shown in the upper part of FIGS. 22A, 22 </ b> B, and 22 </ b> C, the transmission state of the image file group as a result of the image search that is the transmission target is set. In response, the display of the image file group is changed to indicate that data is being transmitted.

  On the other hand, in the imaging device 100 (R) as the transmission destination, as shown in the lower part of FIGS. 22A, 22 </ b> B, and 22 </ b> C, the received image file group is changed according to the reception state of the image file group. The display is changed to indicate that data is being transmitted.

  As described above, when a predetermined operation is performed when the image capturing apparatus 100 according to the present embodiment is in a state where the thumbnail images of the image file group obtained as a result of the image search are displayed, It is possible to communicate with the partner device and transmit the image file group to the partner.

  Details of the above-described data transmission process of the transmission source imaging apparatus 100 (S) and the above-described data reception process of the transmission destination imaging apparatus 100 (R) will be described below.

[Data Transmission Processing of Imaging Device 100 (S) of Transmission Source]
FIG. 23 is a flowchart for explaining data transmission processing executed in the imaging apparatus 100 (S) that transmits the image file group obtained as a result of the image search. The process shown in FIG. 23 is a process performed in step S117 of the process described with reference to FIGS.

  That is, as described with reference to FIGS. 16 and 17, after setting a range of image search and selecting a search key, an image search is performed using the selected selection key, and the result of the image search is Suppose that it is in the state displayed on the display screen 6G.

  In this case, as described with reference to FIG. 17, an operation input from the user is received (step S113), and it is determined whether or not an operation has been performed based on the detection output from the motion sensor 137 (step S114). ).

  When it is determined that the operation is performed in step S114, the control unit 120 determines whether the received operation input is a predetermined operation such as tilting the imaging device 100, swinging left and right, or hitting the upper part of the set. (Step S115).

  If it is determined in the determination processing in step S115 that a predetermined operation such as tilting the image capturing apparatus 100, swinging left or right, or hitting the upper part of the set has been performed, the image file group obtained as a result of the image search is determined as the search result. (Step S116).

  Thereafter, in step S117 shown in FIG. 17, the data transmission process shown in FIG. 23 is executed. In this case, the control unit 120 of the transmission source imaging device 100 (S) forms a data reception request, which is transmitted through the communication unit 141 and the transmission / reception antenna 142 in this example, the imaging device 100 (the transmission destination device). R) (step S201). The reception request also includes an identification ID of the requesting imaging apparatus 100 (S).

  And the control part 120 performs the response reception process which receives the response with respect to the reception request transmitted in step S201 (step S202). The process of step S202 is terminated when any response is returned from the request destination or when there is no response within a predetermined time. After the response reception process in step S202, the control unit 120 determines whether a receivable response has been received from the transmission destination imaging apparatus 100 (R) (step S203).

  When determining in step S203 that no receivable response has been received, the control unit 120 ends the processing shown in FIG. 23, returns to the processing in step S117 in FIG. 17, and returns to step S101 in FIG. Repeat the process from.

  When it is determined in step S203 that the receivable response has been received, the control unit 120 transmits the image file group obtained as a result of the image search through the communication unit 141 and the transmission / reception antenna 142 to the imaging device 100 (R). The transmission to is started (step S204).

  That is, the identification ID of the imaging device 100 (R) that is the transmission destination is also added to the receivable response. For this reason, in step S204, the control unit 120 forms transmission data to the imaging apparatus 100 (R) to which the identification ID of the transmission destination imaging apparatus 100 (R) is also added, and this is formed as the imaging apparatus 100 (R). The process to send to is started.

  Then, as shown in the upper part of FIGS. 20, 21, and 22, the control unit 120 changes the display state of the image file group obtained as a result of the image search according to the transmission state of the image file group. Like that.

  Specifically, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to reduce the number of thumbnail images to be displayed according to the transmission amount, and gradually display the display position of the thumbnail images. The display is performed so as to move to the end of the screen.

  Then, the control unit 120 determines whether or not all the transmission target image file groups have been transmitted (step S206). If it is determined in step S206 that all the images have been transmitted, the control unit 120 forms an image file transmission completion command, which is transmitted to the destination imaging apparatus 100 (R) via the communication unit 141 and the transmission / reception antenna 142. Transmit (step S208).

  After the processing in step S208, the control unit 120 ends the processing shown in FIG. 23, returns to the processing in step S117 in FIG. 17, and repeats the processing from step S101 in FIG.

  If it is determined in step S206 that all data has not been transmitted, the control unit 120 determines whether or not an end operation such as pressing an end key has been performed (step S207).

  When determining in step S207 that the end operation has not been performed, the control unit 120 repeats the processing from step S205 and continues to transmit the image file group.

  When it is determined in the determination processing in step S207 that the end operation has been performed, the control unit 120 forms an image file transmission completion command, which is transmitted via the communication unit 141 and the transmission / reception antenna 142 to the transmission destination imaging device 100 (R ) (Step S208).

  After the process in step S208, as described above, the control unit 120 ends the process shown in FIG. 23, returns to the process in step S117 in FIG. 17, and repeats the process from step S101 in FIG. To do.

  In this way, the image capturing apparatus 100 (S) that is the transmission source can perform communication by simply performing operations such as tilting, shaking, and hitting the image capturing apparatus 100 (S) on the image file group obtained as a result of the image search. Can be sent to the other party.

[Data Reception Processing of Destination Imaging Apparatus 100 (R)]
FIG. 24 is a flowchart for explaining data reception processing executed in the imaging apparatus 100 (R) that receives an image file group transmitted from the transmission-source imaging apparatus 100 (S). The process illustrated in FIG. 24 is a process that is mainly executed in the control unit 120 of the imaging apparatus 100 (R) when the imaging apparatus 100 (R) is set to the data reception mode, for example.

  Note that the imaging apparatus 100 has operation modes such as a shooting mode for shooting, a playback mode for playing back an image file recorded on the recording medium 135, and a data reception mode for receiving data addressed to itself by short-range communication. I have. For example, the operation mode can be changed by selecting a target operation mode through a menu.

  Then, as described above, when a predetermined operation is performed to enter the data reception mode, the control unit 120 executes the process shown in FIG. 24 and first receives various requests addressed to itself. The request receiving process is executed (step S301). The process of step S301 is a process that is performed until a request for the device itself is received.

  In the process of step S301, when a request addressed to itself is received, control unit 120 determines whether or not the received request addressed to itself is a data reception request (step S302). If it is determined in step S302 that the received request is not a data reception request, the control unit 120 executes processing according to the received request (step S303), and thereafter, as shown in FIG. The process ends.

  If it is determined in the determination process in step S302 that the received request is a data reception request, the control unit 120 checks the operation status of the own device (step S304). In this step S304, for example, confirmation is made as to whether there is any remaining part of the battery, the free capacity of the recording medium 135, and other parts that interfere with the data reception process.

  Then, the control unit 120 determines whether or not the own device can receive data based on the operation status of the own device confirmed in step S304 (step S305).

  If it is determined in step S305 that the data cannot be received, the control unit 120 forms an unreceivable response, which is transmitted through the communication unit 141 and the transmission / reception antenna 142, and the transmission source imaging device 100 (S ) (Step S306). Thereafter, the control unit 120 ends the process shown in FIG.

  If it is determined in step S305 that the data can be received, the control unit 120 forms a receivable response, which is transmitted through the communication unit 141 and the transmission / reception antenna 142. (S) is transmitted (step S307).

  That is, the identification ID of the imaging device 100 (S) is also added to the reception request from the imaging device 100 (S). Therefore, the transmission destination imaging apparatus 100 (R) forms a receivable response including the identification ID of the transmission source imaging apparatus 100 (S) and the identification ID of the own apparatus, and uses this as a transmission source imaging apparatus 100. Send to.

  Thereafter, the control unit 120 controls the communication unit 141 to receive the image data of the image file group addressed to the own device transmitted from the imaging apparatus 100 (S) as the transmission destination and store the image data in the recording medium 135. Processing is started (step S308).

  Then, as shown in the lower part of FIGS. 20, 21, and 22, the control unit 120 displays a display image indicating the reception status displayed on the display screen 6 </ b> G of the display unit 106 according to the reception status of the image file group. The display state is changed (step S309).

  Specifically, the control unit 120 controls the display image forming unit 111 and the display processing unit 105 to increase the number of thumbnail images to be displayed and gradually change the display position of the thumbnail images according to the amount of received image data. The display processing is performed so as to move to the center of the display screen.

  Then, the control unit 120 determines whether or not a completion command has been transmitted from the transmission source imaging apparatus 100 (S) (step S310). When determining in step S310 that the completion command has not been transmitted, the control unit 120 repeats the processing from step S309, and performs the reception processing of the image data from the imaging device 100 (S) as the transmission source. continue.

  If it is determined in step S310 that the completion command has been transmitted, the transmission of the image data from the transmission source has been completed, and the control unit 120 ends the process shown in FIG.

  In this manner, the transmission destination imaging device 100 (R) can sequentially receive the image data transmitted from the transmission source imaging device 100 (S) and store it in its own recording medium 135. To be.

  As described above, in the imaging apparatus 100 according to this embodiment, the image data obtained as a result of the image search is not only stored in the recording medium and reproduced but also transmitted to other devices. Even can be executed with a simple operation.

  Here, the operation of tilting the imaging device 100 (S), swinging left and right, and hitting the upper part of the set is an operation for transmitting image data, but is not limited thereto. An operation for transmitting image data can also be performed for an operation of shaking up and down and an operation of hitting a side surface of the imaging apparatus 100 (S).

  In addition, one of the three operations of tilting, shaking, and hitting the imaging apparatus 100 (S) is assigned to an instruction operation for performing image data transmission processing, and other operations are performed separately. It is also possible to assign processing.

  Also, here, the case where image data is transmitted from the transmission source imaging device 100 (S) configured similarly to the transmission destination imaging device 100 (R) has been described as an example, but the present invention is not limited thereto. is not.

  The image data can be transmitted to various electronic devices that can communicate through the communication unit 141 and the transmission / reception antenna 142 of the transmission source imaging apparatus 100 (S). For example, it is possible to simply perform communication between the imaging device 100 (S) and a hard disk device capable of communication and backup image data to the hard disk device.

  In the above-described embodiment, the transmission source imaging apparatus 100 (S) and the counterpart device are described as performing wireless communication, but the present invention is not limited to this. In other words, it is of course possible to send and receive data to and from a counterpart device connected by wire. In this case, for example, communication may be performed through the external I / F 132 and the input / output terminal 133.

[Effect of the embodiment]
An image search initial screen is displayed or a group of image files obtained as a result of the image search is processed by an extremely simple operation on the image pickup apparatus 100 such as tilting, raising, tilting, shaking, or hitting the imaging apparatus 100. Processing.

  That is, it is possible to reliably execute a process that is always performed, a process that is frequently performed, or a process that needs to be surely performed without performing a complicated operation.

  In addition, based on detection outputs from the motion sensor 137 and the touch panel 136 at the top of the set, a simple operation from the user is accepted, and a target process, such as a data transmission process, is performed according to the operation. To be able to do.

  In addition, when image data is passed to another machine, the progress is provided in association with a real-world method, such as passing the object and receiving it, providing easy-to-understand feedback to the user. To be able to give.

[Method and program of the present invention]
As is clear from the above-described embodiment, the method and program of the present invention can be realized mainly as the method and program described with reference to the flowcharts shown in FIGS. 16, 17, 18, and 23. It is.

  That is, the method described with reference to FIGS. 16, 17, 18, and 23 is the method of the present invention.

  A program for executing the processing described with reference to FIGS. 16, 17, 18, and 23 is the program of the present invention.

  Therefore, the image processing apparatus of the present invention can be realized by implementing the program of the present invention and mounting the program on a digital still camera or various image processing apparatuses.

[Others]
In the above-described embodiment, the control unit 120 realizes each of the specifying unit and the processing control unit. The motion detection means is realized by a motion sensor 137 and a touch panel 136 at the top of the set.

  In addition, the processing unit realizes a reproduction system including a control unit 120 as a holding unit, a writing / reading unit 134 as a reproduction unit, an expansion processing unit 110, a display image forming unit 111, a display processing unit 105, and a display unit 106. doing. Further, the processing unit is realized by a writing / reading unit 134 as a recording unit and a communication unit 141 as a transmitting unit.

  In the above-described embodiment, the search key instruction means is realized by the cooperation of the display unit 106 and the touch panel 107, but the present invention is not limited to this. The search key instruction means can also be realized by a hardware key provided in the operation unit 131, for example.

  Specifically, after a search key used for image search is specified, when a predetermined hardware key for executing an image search is pressed using the search key, an image search using the search key is performed. Can be done.

  In this case, when two or more search keys are used, a plurality of predetermined hardware keys for executing an image search are provided correspondingly, and a touch panel is used. Similarly, image search can be performed.

  Further, by providing the hardware key as, for example, two hardware keys that are slidable, the image search using the two search keys is executed as described in the above-described embodiment. Is possible.

  In the above-described embodiment, an image file having a relevance degree is searched in three stages of a relevance degree “high”, a relevance degree “medium”, and a relevance degree “low” with respect to the search key. This is not a limitation. Of course, it is possible to divide the degree of relevance more finely.

  In the above-described embodiment, the case where the present invention is applied to an imaging apparatus has been described as an example. However, the present invention is not limited to this. For example, the present invention is applied to a mobile phone terminal with a camera function, a portable information terminal called PDA (Personal Digital Assistant) capable of processing image data, and other various image processing apparatuses capable of processing image data. be able to.

  The image data to be displayed is not limited to still image data. For example, the present invention can be applied to an image processing apparatus that displays representative images and thumbnail images of a plurality of moving image contents stored in a recording medium.

  In the above-described embodiment, the touch panel 107 included in the imaging apparatus 100 has been described as being capable of detecting contact with a user's finger or the like, but is not limited thereto. For example, when a finger or the like is brought close to a certain extent without touching the operation surface, any device that can detect the approached position can be used to realize the present invention.

  That is, the touch panel 107 is not limited to a contact type. For example, when a finger or the like approaches to some extent, it is possible to detect that the potential on the operating surface at the approaching position has changed or the brightness has changed, and the changed position on the operating surface can be specified as the indicated position A non-contact type touch panel may be used.

  In the above-described embodiment, as shown in FIGS. 9 and 10 and the like, the display position and the display direction of the thumbnail image to be displayed are displayed in a random (random) manner. It is not limited to.

  The display orientation may be constant. In short, when an image search is executed, thumbnail images of images that match the search key are displayed so as to be gathered at predetermined positions on the display screen, and the other parts are displayed in various ways. Can be.

  In addition, as described above, by forming thumbnail data from image data in advance and adding it to each image file, it is not necessary to form thumbnail data when displaying thumbnail images. Can be reduced.

It is a block diagram for demonstrating the example of a structure of the imaging device 100 to which one Embodiment of the apparatus, method, and program of this invention was applied. FIG. 25 is a diagram for describing a layout example of an image file recorded on a recording medium 135 of the imaging apparatus 100. FIG. 26 is a diagram for describing a layout example of an image folder formed on the recording medium 135 of 100 of the imaging apparatus. 6 is a diagram for explaining a search key candidate information table created in advance in the recording medium 135 of the imaging apparatus 100 or in the EEPROM 124 or the like. FIG. It is a figure for demonstrating the process which selects the search key used for an image search from the search key candidate information registered into the search key candidate information table. It is a figure for demonstrating the process which selects the search key used for an image search from the search key candidate information registered into the search key candidate information table. It is a figure for demonstrating the process which selects the search key used for an image search from the search key candidate information registered into the search key candidate information table. It is a figure for demonstrating operation which can be performed as predetermined operation | movement for displaying the initial screen of image search, after the search key for image search is selected. It is a figure for demonstrating the example of a transition of a screen when searching an image from the state where two search keys were selected. It is a figure for demonstrating the case where an image search is performed using both of two selected search keys. It is a figure for demonstrating the case where an image search is performed using an image as a search key. It is a figure for demonstrating the structural example of a search key relevance degree dictionary. It is a figure for demonstrating the information which can become a search key for an image search among image analysis information. It is a figure for demonstrating the display mode of the search result at the time of making it search an image from the state where one search key (character information) was selected. It is a figure for demonstrating operation which can be performed as predetermined operation for determining the result of an image search. 12 is a flowchart for explaining processing at the time of image search performed in the imaging apparatus. It is a flowchart following FIG. FIG. 17 is a flowchart for explaining an initial screen display process of image search executed in step S104 shown in FIG. It is a figure for demonstrating the case where the image file group obtained as a result of the image search is transmitted to the other imaging device (other machine) comprised similarly. It is a figure for demonstrating the case where the image file group obtained as a result of the image search is transmitted to the other imaging device (other machine) comprised similarly. It is a figure for demonstrating the case where the image file group obtained as a result of the image search is transmitted to the other imaging device (other machine) comprised similarly. It is a figure for demonstrating the case where the image file group obtained as a result of the image search is transmitted to the other imaging device (other machine) comprised similarly. It is a flowchart for demonstrating the data transmission process performed in the imaging device 100 (S) which transmits the image file group obtained as a result of the image search. It is a flowchart for demonstrating the data reception process performed in the imaging device 100 (R) which receives an image file group.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Imaging device 101 ... Lens part 102 ... Image pick-up element 103 ... Pre-processing part 104 ... Image processing part 105 ... Display processing part 106 ... Display part 107 ... Touch panel 109 ... Compression processing part 110 ... Decompression processing unit 111 ... Display image forming unit 120 ... Control unit 131 ... Operation unit 132 ... External I / F, 133 ... Input / output terminal, 134 ... Write / read unit, 135 ... Recording medium, 136 ... Upper part of set 137 ... motion sensor, 138 ... GPS reception unit, 139 ... GPS reception antenna, 141 ... communication unit, 142 ... transmission / reception antenna

Claims (6)

A motion detector that detects the movement of the aircraft,
A setting unit for setting a search range of image data in response to an operation on the operation unit ;
When the search range is set by the setting unit, when it is detected through the motion detection unit that a specific operation is performed on the own device, the image data of the search range is displayed on the display unit. A display processing unit to
In response to an operation on the operation unit, a search unit that searches image data from the image data in the search range using a search key and displays the image data of the search result on a display unit;
When the image data of the search result is displayed on the display unit and the motion detection unit detects that a specific operation has been performed on the own device, the image data of the search result is A recording processing unit for recording in the storage destination;
An image processing apparatus comprising: The image processing apparatus according to claim 1,
Operations performed on the subject aircraft detected through the motion detection unit include operations for defeating and raising the subject, tilting the subject, shaking the subject, and hitting the subject. One or more image processing devices. The image processing apparatus according to claim 1,
When the image data of the search result is displayed on the display unit, the image data of the search result is reproduced when it is detected that a specific operation is performed on the own device through the motion detection unit. An image processing apparatus further comprising a reproduction unit. The image processing apparatus according to claim 1,
When the image data of the search result is displayed on the display unit, when it is detected that a specific operation has been performed on the own device through the motion detection unit, the image data of the search result is transferred to the other device. An image processing apparatus further comprising: a transmission unit that transmits to A setting step for setting a search range of image data in accordance with an operation on the operation unit ;
When it is detected that a specific operation has been performed on the own device through the motion detection unit that detects the motion of the own device in a state where the search range is set by the setting step, an image of the search range A display step for displaying data on the display unit;
In response to an operation on the operation unit, a search step of searching image data from the image data in the search range using a search key and displaying the image data of the search result on a display unit;
When the image data of the search result is displayed on the display unit and the motion detection unit detects that a specific operation has been performed on the own device, the image data of the search result is A recording step for recording in a storage location;
An image processing method. A setting step for setting a search range of image data in accordance with an operation on the operation unit ;
When it is detected that a specific operation has been performed on the own device through the motion detection unit that detects the motion of the own device in a state where the search range is set by the setting step, an image of the search range A display step for displaying data on the display unit;
In response to an operation on the operation unit, a search step of searching image data from the image data in the search range using a search key and displaying the image data of the search result on a display unit;
When the image data of the search result is displayed on the display unit and the motion detection unit detects that a specific operation has been performed on the own device, the image data of the search result is A recording step for recording in a storage location;
An image processing program executed by a computer mounted on the image processing apparatus.

Images