JP2000217057A - Photographed image retrieval device, electronic camera apparatus and photographed image retrieval method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photographed image retrieval device by which a desired image can easily be retrieved and extracted at high speed among a huge amount of photographed images and the desired image can be displayed by diversified display methods, and to provide an electronic camera apparatus and a photographed image retrieval method. SOLUTION: The photographed image retrieval device that retrieves image information satisfying a prescribed condition among a plurality of image information sets is provided with an image information acquisition means 1 that acquires image information, a positioning means 2 that measures each acquired position of image information as position information, a storage means 4 that correlates the position information with image information and stores the position information, a condition acquisition means 5 that acquires a retrieval condition to retrieve image information, and arithmetic means 6 that calculates a specific amount between acquired positions of the image information on the basis of the position information and a retrieval means 7 that retrieves image information satisfying a prescribed retrieval condition among image information sets stored in the storage means 4.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a photographed image retrieving apparatus, an electronic camera apparatus, and a photographed image retrieving method. The present invention relates to a photographed image search device, an electronic camera device, and a photographed image search method capable of quickly and easily searching for and displaying desired image information from a large number of photographed image information.

[0002]

2. Description of the Related Art In recent years, images have been photographed as digital signals,
2. Description of the Related Art An electronic still camera capable of storing and displaying data, or a card-type camera unit to be mounted on a notebook personal computer or the like via a PCMCIA card has been developed and commercialized. In such an electronic still camera, depending on the capacity of a memory for storing image information, a huge number of images far exceeding 24 or 36 shots of a general silver halide photographic film can be taken. Can be. Therefore, there is a demand for a method of searching and displaying an image with high speed and excellent operability at the time of reproducing and displaying after capturing an image.

In general, as a method for retrieving an image stored in a memory in an electronic still camera or the like, a method of adding an image shooting time as time information to an image by a clock function built in the electronic still camera and storing the time information is used. Has been adopted. However, in such a method, after photographing an image, a camera user extracts a desired image from a huge amount of image information while recalling a photographing place and a photographing state based only on time information. I was forced to work. When displaying a desired image on a liquid crystal display panel (hereinafter abbreviated as LCD) or the like, a scroll display method of sequentially displaying images one by one based on the old or new shooting time, or a method of batching a plurality of images, It is necessary to browse and search for images and extract a desired image by a multi-screen display method in which the screen is divided into four or nine screens, so that considerable time and effort are required to search for a desired captured image. Had the problem of needing it.

On the other hand, in recent years, a global positioning system (Glob
al Positioning System: Hereinafter referred to as GPS. ), A navigation system that searches and displays related map information on the basis of the position information obtained by the method and displays the current location on the map has been widely used for car navigation, truck operation management, and the like. Is coming.
GPS is a positioning satellite system that detects weak radio waves from artificial satellites and detects positions such as latitude and longitude, and is a system developed by the United States Department of Defense, and is partially open to civilian use. The GPS performs 24 positioning satellites (also referred to as GPS satellites) arranged in four orbit planes, each of which is orbiting about 20,000 km above the ground, a control station that tracks and controls the positioning satellites, and performs positioning. And a GPS receiver.

[0005] A GPS user receives signals from three of the 24 positioning satellites at the same time, thereby obtaining a two-dimensional position (latitude and longitude) based on the principle of three-point surveying.
Can be calculated, and a three-dimensional position including altitude can be calculated by using a signal from the fourth positioning satellite. In this case, the positional information is corrected using the time difference between the atomic clock of the positioning satellite on the transmitting side and the quartz clock of the GPS receiver on the receiving side. That is, 2
Positioning is performed based on orbit information, error information, and status information emitted from four positioning satellites among the four positioning satellites. Such a GPS is characterized in that it can perform three-dimensional positioning continuously in almost all regions on the earth and in all weather, has a substantially constant positioning accuracy, and rarely generates a large error. Have.

Therefore, in order to solve the above problems,
In recent years, there has been known an electronic still camera that employs a technology of storing positional information measured by GPS in association with a captured image. For example, Japanese Patent Application Laid-Open No. 10-1506
In Japanese Patent Publication No. 25 and the like, a photographed image is stored in association with positional information measured by GPS and map information searched based on the positional information, and the photographing position is displayed on the map information when displaying the image. Is described. As a method of searching for a desired photographed image from the images photographed by such an electronic still camera, (1) a desired position on a map displayed on a monitor is inputted and designated, There are known a method of searching for an image photographed in (around), and a method of (2) searching for a photographed image associated with a place name by inputting the place name or the like.

[0007]

However, in the above-mentioned prior art, there is disclosed a method of storing and displaying position information as it is or associating map information retrieved based on the position information with a photographed image. It does not suggest a way to effectively use location information in aspects other than map search or navigation functions. In the search method (1) described above, the capacity of the map information is extremely large, the display processing of the map information is required, and the map information is displayed on the monitor in order to input and specify a desired position. It is necessary to scroll through the map to find the desired area, so if the same function is installed in the electronic still camera, search processing and display processing of map information are required in addition to the original image processing technology. Thus, there is a problem that high-speed and easy image search processing and display processing cannot be realized with a simple configuration and processing. In the search method (2) described above, character data such as a place name must be input as a search condition, so that the input operation becomes complicated or the place name of a place where a desired image is photographed is memorized. However, this method has a problem that high-speed and easy image search processing and display processing cannot be realized even with this method.

Therefore, the present invention enables a desired image to be searched and extracted quickly and easily from an enormous amount of photographed images, and the desired image can be displayed by various display methods. It is an object to provide a photographed image search device, an electronic camera device, and a photographed image search method.

[0009]

According to a first aspect of the present invention, there is provided a photographed image retrieval apparatus for retrieving photographed image information satisfying a predetermined condition from a plurality of photographed image information. A plurality of storage means for storing a plurality of pieces of the photographic image information stored in the storage means, wherein the distance between the photographic positions at which each of the photographic image information is obtained satisfies a predetermined condition; Search means for searching. The photographed image search device according to claim 2 is the photographed image search device according to claim 1, wherein the storage unit stores or manages a plurality of the photographed image information in a photographing order, and is adjacent to the storage unit. Computing means for calculating a distance between the photographing positions at which each of the photographed image information stored or managed is acquired, wherein the searching means is configured to perform the photographing wherein the distance calculated by the computing means satisfies a predetermined condition. It is characterized by searching for image information.

According to a third aspect of the present invention, there is provided the photographed image search apparatus according to the first aspect, wherein one of the photographed positions at which the one piece of the photographed image information stored in the storage means is acquired and a plurality of other photographed positions are acquired. Calculating means for calculating distances between the plurality of photographing positions at which the photographed image information is obtained, and the search means searches for the photographed image information in which the distance calculated by the calculating means satisfies a predetermined condition; It is characterized by the following. According to a fourth aspect of the present invention, there is provided a photographed image search apparatus.
In the photographed image search device described above, the storage unit further stores photographed position information indicating a photographed position of the photographed image information in association with the photographed image information, and stores the photographed position information stored in the storage unit. Computing means for computing the distance between the photographing positions of the photographed image information indicated by, and the retrieval means retrieves the photographed image information in which the distance computed by the computing means satisfies a predetermined condition. I do. The photographed image search device according to claim 5 is the photographed image search device according to claim 1, wherein the storage unit includes:
Further, in association with the photographed image information, identification information indicating that the distance between the photographing position of the photographed image information and the photographing position of the other photographed image information is the photographed image information satisfying a predetermined condition is provided. The storage means retrieves the photographed image information in which the identification information is stored in association with the storage means.

According to a sixth aspect of the present invention, there is provided the photographed image search device according to the first embodiment, wherein the storage means further associates the photographed image information with the photographed position of the photographed image information and associates the photographed position with another photographed image information. The distance information indicating the distance between the shooting position of the shooting image information and the shooting position is stored, and the search means,
It is characterized in that the captured image information in which the distance indicated by the distance information stored in the storage means satisfies a predetermined condition is searched. 8. The photographed image search device according to claim 7, wherein the storage unit stores the photographed image information in the same group in which a distance between photographing positions of the photographed image information satisfies a predetermined condition. It is characterized by being stored as According to a ninth aspect of the present invention, in the photographic image searching device according to the seventh aspect, the photographic position obtaining means for obtaining the photographic position information and the photographic position information obtained by the photographic position obtaining means indicate the photographic position information. Computing means for computing the distance between the photographing positions, and second retrieval means for retrieving the photographed image information in which the distance computed by the computing means satisfies a predetermined condition, wherein the storage means comprises: The photographed image information retrieved by the second retrieval means is stored as the same group.

According to a ninth aspect of the present invention, in the photographic image retrieval apparatus according to the seventh aspect, the photographic image information is obtained from a plurality of pieces of the photographic image information stored in the storage means. A second search unit configured to search for the captured image information in which a distance between image capturing positions satisfies a predetermined condition; the storage unit stores or manages a plurality of pieces of captured image information in a capturing order; The photographed image information stored or managed between the photographed image information retrieved by the retrieval means is stored as the same group. According to a tenth aspect of the present invention, in the photographic image retrieval apparatus according to the seventh aspect, the photographic image information acquired from the plurality of pieces of the photographic image information stored in the storage means is mutually related. A second search unit that searches for the photographed image information whose distance is equal to or less than a predetermined distance, wherein the storage unit stores the photographed image information searched by the second search unit as a same group. And The photographed image search device according to claim 11 is the photographed image search device according to any one of claims 7 to 10, wherein the search unit is configured to select from the photographed image information of each group stored in the storage unit. It is characterized in that predetermined photographed image information is searched.

According to a twelfth aspect of the present invention, in the photographic image search apparatus according to any one of the seventh to tenth aspects, the search means includes the photographic image information of the same group stored in the storage means. Is searched. 14. The photographed image search device according to claim 12, wherein the selection unit selects desired photographed image information from the photographed image information of the same group searched by the search unit. It is characterized by having. The photographed image search device according to claim 14, wherein the photographed image search device according to claim 1, wherein the selection unit selects the desired photographed image information from the photographed image information searched by the search unit; When the desired photographed image information is selected by the means, a second searching means for searching for the photographed image information not searched by the searching means is provided. A photographed image search device according to a fifteenth aspect is the photographed image search device according to the fourteenth aspect, wherein the desired photographed image information is selected from the photographed image information retrieved by the second retrieval means. Is provided.

According to a sixteenth aspect of the present invention, there is provided the photographed image search device according to the first aspect, wherein a display means for displaying the photographed image information stored in the storage means, and the search means retrieve the image information. Display control means for displaying the photographed image information on the display means longer than the other photographed image information that has not been searched. A photographed image search device according to claim 17, wherein the photographed image information stored in the storage unit is displayed by the photographed image search device according to claim 1, and the photographed image retrieved by the search unit is retrieved. When displaying the image information on the display means, a notifying means for notifying the user is provided. Claim 18
The photographed image retrieval device according to claim 1, wherein the photographed image information retrieved by the retrieval unit is displayed by a display unit that displays the photographed image information stored in the storage unit. A display control unit that performs image processing and displays the image when the image is displayed on the display unit.

According to a twelfth aspect of the present invention, in the photographic image retrieval apparatus according to the first aspect, the predetermined condition is that the photographic position at which the photographic image information stored in the storage means is acquired is obtained. It is characterized by being determined based on. 21. The photographed image search device according to claim 20, wherein said photographed image search device searches for photographed image information satisfying a predetermined condition from a plurality of photographed image information. Search means for searching, from among the plurality of pieces of photographed image information stored in the means, the direction of the photographing position at which each of the photographed image information has been acquired, satisfies a predetermined condition. It is characterized by the following. An electronic camera device according to claim 21, wherein a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information,
An electronic camera device capable of outputting the captured image information, comprising: an imaging unit that captures an image of a subject; a positioning unit that measures a capturing position of the image of the subject; Calculating means for calculating the distance, searching means for searching for the photographed image information in which the distance calculated by the calculating means satisfies a predetermined condition, and storing the photographed image information obtained by the image pickup by the image pickup means. Storage means for storing identification information in association with the photographed image information retrieved by the retrieval means.

An electronic camera capable of outputting the photographed image information to a photographed image search device for searching photographed image information satisfying a predetermined condition from a plurality of photographed image information. An apparatus for capturing an image of a subject, a positioning means for measuring a shooting position of the image of the subject, a calculating means for calculating a distance between the shooting positions measured by the positioning means, Storage means for storing the photographed image information acquired by the imaging by the imaging means, and storing the distance calculated by the arithmetic means in association with the photographed image information. An electronic camera device according to claim 23, wherein a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information,
An electronic camera device capable of outputting the captured image information, comprising: an imaging unit that captures an image of a subject; a positioning unit that measures a capturing position of the image of the subject; Calculating means for calculating the distance of the camera, searching means for searching for the photographed image information in which the distance calculated by the calculating means satisfies a predetermined condition, and storing the photographed image information obtained by the image pickup by the image pickup means Storage means for storing the captured image information retrieved by the retrieval means as the same group.

A photographic image search method according to claim 24 is a photographic image search method for searching photographic image information satisfying a predetermined condition from a plurality of photographic image information, wherein the plurality of photographic image information is stored. And a step of searching the stored plurality of pieces of photographed image information for the photographed image information in which a distance between photographing positions at which each of the photographed image information is acquired satisfies a predetermined condition. It is characterized by. 26. The photographed image search method according to claim 25, wherein the photographed image search method is for searching photographed image information satisfying a predetermined condition from a plurality of photographed image information, wherein the plurality of photographed images stored in a memory are stored. From the image information, a step of searching for the captured image information in which the distance between the imaging positions at which each of the captured image information is acquired satisfies a predetermined condition, and a step of displaying the searched captured image information, It is characterized by including. The photographed image search method according to claim 26,
A captured image search method for searching captured image information that satisfies a predetermined condition from among a plurality of captured image information, wherein a plurality of the captured image information stored in a memory is displayed on a display unit, A step of, when the photographed image information whose distance between the photographing positions at which each of the photographed image information is acquired and satisfying a predetermined condition is searched for and displayed on the display unit, notifying that fact. And

[0018]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a basic configuration of a captured image search device according to the present invention. FIG.
As shown in FIG. 1, the photographed image search device includes an image information acquisition unit 1, a positioning unit 2, a time measurement unit 3, a storage unit 4, a condition acquisition unit 5, a calculation unit 6, a search unit 7, It comprises a display control means 8, a display means 9, and a key input means 11. The image information acquiring means 1 acquires predetermined image information as a digital signal, for example, by photographing, capturing, or the like. For example, an image of a subject captured by the imaging unit is obtained as image information. Positioning means 2
Constitutes the positioning means or the photographing position obtaining means in the present invention, and measures and obtains the position or location where the image information is obtained as absolute or relative position information.

Note that the photographed image search device according to the present invention
When applied to a personal computer (hereinafter, referred to as a personal computer) or a portable information terminal that does not have a GPS receiving function (positioning means 2) or a photographing function (image information obtaining means 1), the image information obtaining means 1 This is a means for receiving image information transmitted from an electronic still camera with a GPS reception function and the acquisition position information of the image information.
The time measuring means 3 is a clock function built in the photographed image search device, and measures and acquires the time at which the image information was acquired as time information. The storage unit 4 stores the image information obtained by the image information obtaining unit 1 in association with the position information obtained by the positioning unit 2. The storage unit 4 may be configured to be built in the captured image search device or may be configured to be detachable.

The condition obtaining means 5 obtains a search condition for searching the image information stored in the storage means 4 by input from the key input means 11 or by a predetermined learning process. The calculation unit 6 extracts the position information stored in the storage unit 4 and calculates the distance (including the altitude difference) or the azimuth between the positions at which the image information was acquired as a specific amount.
The search means 7 constitutes the search means and the second search means in the present invention, and the search condition (threshold) acquired by the condition acquisition means 5 and the specific amount (distance, Azimuth) to extract image information that matches the search condition. Are preferentially displayed on the display means 9 by different display methods. Here, the display means 9 constitutes the display means and the notification means in the present invention.

Key input means 11 includes a mode switching key for setting a photographing (receiving) mode, a reproducing mode, a search condition (distance, azimuth, etc.) input mode, a shutter key for instructing photographing, and a reproduced image. A scroll (page feed) key (including a plus key and a minus key) for switching to the next image, a reset key, an execution key, and the like are provided. Here, the key input means 11 constitutes the selection means and the second selection means in the present invention. For example, by switching and displaying a reproduced image to an arbitrary image using a scroll key, and operating an execution key, Select the desired image. The arithmetic unit 6, the search unit 7, and the display control unit 8 constitute a control unit 10, and the function of each unit is realized by, for example, one microprocessor.

Hereinafter, each function realized by the above configuration will be sequentially described. (Image Information Storage Processing) The acquisition processing and storage processing of the image information of the photographed image search device according to the present invention will be described with reference to the drawings. FIG. 2 is a flowchart showing a process of acquiring and storing image information of the photographed image search device according to the present invention. First, an image recording state, that is, image information acquisition (photographing standby) by operating a mode switching key of the key input unit 11.
State (shooting mode), and then key input means 1
When the shutter key 1 is operated, the image information acquisition means 1
Thus, the image information is acquired by capturing the target image as a digital signal (step S11).
Here, when the image information is acquired (photographed), the position information (latitude, longitude, altitude information) of the place where the image information is acquired is measured by the positioning means 2 (step S12). Specifically, a signal emitted from a positioning satellite by the above-described GPS positioning method is received by a GPS antenna, and latitude, longitude, and altitude are calculated and acquired as position information.

Next, the acquired image information and position information are stored in a predetermined area of the storage means 4 in association with each other (steps S13 and S14). Here, a process of associating captured image information with position information will be described with reference to the drawings. FIG. 3 is a conceptual diagram showing an internal area of the storage means applied to the photographed image search device according to the present invention. As shown in FIG. 3, the internal area of the storage unit 4 is roughly divided into a format table area, an information table area, an image data area, and an offset area. The format table area stores comprehensive information on image information, that is, format information F1, F2,.

In the information table area, image information identification information D1, D2, including number information for identifying image information,
.., time information T1, T indicating the time when the image information was acquired
2,..., Position information L indicating the place where the image information is acquired
Information for identifying image information such as 1, L2,... Is stored. The image data area includes the acquired image information P1,
P2,... Are stored after being subjected to image processing such as compression, and the offset area includes image information P1, P2 in the image data area.
2. Stores offset data (blank) for fixing the data length of. Thus, each of the image information P1, P2,... Is stored in the information table area, and the time information T1, T2,.
.. Are stored in association with each other by having position information L1, L2,.

As described above, when the photographed image search device is applied to a personal computer or a portable information terminal not provided with the GPS receiving function (positioning means 2) or the photographing function, the key input means is determined in step S11. The mode switching key 11 is repeatedly operated to set an image information reception state (reception mode), and the image information acquisition means 1 uses a cable (such as a cable) or a wireless (radio wave, Image information transmitted by infrared rays or the like) and position information of the image information (that is, the information shown in FIG. 3).
After that, the processing of steps S12 and S13 is skipped, and the process proceeds to step S14 to store the received image information and position information in a predetermined area of the storage unit 4. In step S11, image information and position information are obtained by mounting a detachable memory, which is mounted on an electronic still camera with a GPS reception function or the like and stores information as shown in FIG. In such a case, the processing of steps S12 to S14 becomes unnecessary.

(Image Information Retrieval Processing) Next, the image information retrieval processing (photographed image retrieval method) applied to the photographed image retrieval apparatus according to the present invention will be described with reference to the drawings.
FIG. 4 is a flowchart illustrating an example of a search process of image information in the captured image search device according to the present invention. Here, distance is used as the specific amount calculated based on the position information. First, the mode switching key of the key input unit 11 is operated to set an image reproduction state (reproduction mode), that is, an image information display state (display mode). The position information is extracted (step S21), and the distance between the locations where the respective pieces of image information are obtained is calculated (step S22). Specifically, the distance between the two points is calculated based on the latitude and longitude acquired by the GPS positioning method as described above.

Next, the calculated distance is compared with a search condition for selecting and extracting an image (step S23), and image information having a distance meeting the condition is extracted (step S24). Here, the search condition may be such that the user of the photographed image search device operates the key input unit 11 to input and set the desired search condition in the condition acquisition unit 5 in the search process of the image information. Alternatively, a retrieval condition fixedly stored in the captured image retrieval device in advance may be acquired. In addition, those set by learning processing based on the appearance frequency (trend) of search conditions set in the past,
Alternatively, the distance may be set based on a statistical tendency of the distance calculated this time, for example, a user's action range determined based on a maximum latitude difference and a maximum longitude difference of position information (described later). See FIG. 18).

Next, a specific example of a process of calculating the distance between the locations where the respective pieces of image information are obtained and a process of comparing the calculated distance with the search condition will be described with reference to the drawings. FIG.
Is a calculation example of a distance between acquisition locations of image information by a distance calculation process applied to the captured image search device according to the present invention,
FIG. 9 is a conceptual diagram illustrating an example of search matching by search condition matching processing. First, as shown in FIG. 5A, image information P1 stored in chronological order according to the acquired time,
With respect to P2, P3,..., Respective position information is extracted. Here, the position information is latitude and longitude measured by the GPS positioning method. Therefore, the image information P1, P2, P3,... Were obtained by the three-square theorem from the difference in latitude and the difference in longitude (between two points) where the image information stored adjacently was obtained. Relative distances between locations P1-P2, P2-P3 / P4, P3 / P4-P
5, ... are calculated.

Next, as shown in FIG. 5B, the input and set search conditions are set as threshold values (indicated by dotted lines in the figure), and distances P1-P2, P3 /
Image information P2, P5, and P6 acquired at locations having P4-P5 and P5-P6 are extracted or marked as search results. As described above, the distance between the respective photographing locations is calculated, and the distance information is used to search for a photographed image acquired at a relatively distant place at a predetermined distance or more. It becomes possible to extract the information of the first (or last) image taken in the shooting area. Therefore, it is possible to quickly and easily search for and display the leading image (or representative image) for each shooting area by a simple processing method.

Next, a specific example of the search processing and the display processing when the reproduction mode is set by operating the mode switching key of the key input means 11 will be described with reference to the drawings. FIG. 6 is a flowchart showing search processing and display processing at the time of reproduction applied to the photographed image search device according to the present invention. FIG. It is a conceptual diagram which shows the example of calculation of distance, and another example of search collation. First, when the user operates the mode switching key of the key input unit 11 to set the reproduction mode, the image number n for specifying the image information to be displayed on the display unit 9 is initialized,
n = 1 is set (step S31). Next, the image information specified by the image number n (that is, the n-th image information) is read from the storage unit 4 and displayed on the display unit 9 (Step S32). The display of the n-th image information by the processing in step S32 is continued until the operation of the scroll key of the key input unit 11 is detected in step S33.

When the scroll key is operated while the image information is being displayed ("YE" in step S33).
S "), and then the scroll key is pressed for a predetermined time (for example, 2
It is determined whether or not the button has been pressed for more than (sec) (step S34). Here, if the key press is released before the predetermined time has elapsed, the process proceeds to step S35, where 1 is added to the image number n, and the process returns to step S32, where the next image information is displayed. If it is detected in step S34 that the scroll key has been continuously depressed for a predetermined time, the process proceeds to step S36, where the scroll key is stored in the storage unit 4 in association with the n-th and (n + 1) -th image information. Read each position information. Thereafter, the distance between the two points indicated by the read position information is calculated by using the above-described distance calculation method (step S37), and the calculated distance is obtained by the predetermined distance acquired by the condition acquiring means 5 (search condition). It is determined whether or not this is the case (step S38). If it is determined that the distance is equal to or shorter than the predetermined distance, the process proceeds to step S39, where 1 is added to the image number n, and the process returns to step S36. Hereinafter, the processing of steps S36 to S39 is repeated until it is determined that the distance is equal to or longer than the predetermined distance in step S38.

If it is determined in step S38 that the calculated distance is equal to or greater than the predetermined distance (P4-P5 and P9-P10 in FIGS. 15A and 15B), step S35 is performed.
, And after adding 1 to the image number n, step S3
Returning to FIG. 2, image information captured at a location that is at least a predetermined distance from the location where the previous image information was captured (FIG. 15)
(P5, P10 in (a) and (b)) are displayed. As described above, the operation of pressing the scroll key for a predetermined time is repeated (or the scroll key is continuously pressed for a predetermined time or more), so that the user moves away from the place where the immediately preceding image information was captured by a predetermined distance or more. 15 (that is, the first image information P5 and P10 among the images captured in each area shown as groups 2 and 3 in FIG. 15A) are sequentially displayed on the display unit 9. Since the displayed image information is displayed, when the first image information of the area where the desired image information is captured is displayed, switching to a normal scroll operation (operation of pressing a scroll key for less than a predetermined time) allows the image to be captured in the same area. The displayed image information can be sequentially displayed, and desired image information can be searched and displayed at high speed and easily.

In the search and display processing according to the present embodiment, the image information is searched and displayed sequentially from the oldest image (P1). However, the search and display processing is started from the latest image. It may be executed. In this case, the information of the last image captured among the images captured in each area (P in FIG. 15A and FIG.
4, P9) is displayed. In step S38 of the flowchart in FIG. 6, when the distance between the two points is equal to or longer than the predetermined distance, the process proceeds to steps S35 and S32 to display the search image. The search image may be displayed in the following cases. In the search processing and the display processing according to the present embodiment, the distance calculation processing and the search condition matching processing (step S
Steps 36 to S38) are performed at the time of reproducing the image information, but may be performed at the time of photographing or at an arbitrary time.

Hereinafter, specific examples of the photographing process, the search process, and the display process in the case where the distance calculation process and the search condition matching process are performed at the time of photographing will be described with reference to the drawings.
FIG. 7 is a flowchart showing search processing at the time of shooting applied to the shot image search apparatus according to the present invention;
FIG. 8 is a flowchart showing a display process at the time of reproduction applied to the captured image search device according to the present invention. In FIG. 7, first, the user operates the mode switching key of the key input unit 11 to set a shooting mode, and thereafter,
When the shutter key is operated at an arbitrary timing ("YES" in step S41), the image information is acquired as a digital signal through the image information acquiring means 1 to acquire the image information and store the image information in the storage means 4. At the same time, the position information of the place where the image information was obtained is measured and obtained by the positioning means 2 and stored in a predetermined area of the storage means 4 in association with the image information (step S4).
2). Then, it is obtained by the previous photographing,
And the position information acquired by the current shooting and stored in the storage means 4 (step S43).

Thereafter, the distance between the two points indicated by the read position information is calculated by using the above-described distance calculation method (step S44), and the calculated distance is obtained by the predetermined distance obtained by the condition obtaining means 5 (searching). It is determined whether or not the condition is satisfied (step S45). If it is determined that the distance is equal to or shorter than the predetermined distance, the process returns to step S41 to wait for the next shutter key operation. Step S45
When it is determined that the calculated distance is equal to or longer than the predetermined distance (in the case of P4-P5 and P9-P10 in FIGS. 15A and 15B), the process proceeds to step S46, and the image is acquired by the current shooting. The image information is the image information captured at a location that is at least a predetermined distance from the location where the previous image was captured (FIGS. 15A and 15B).
The flag information (identification information) indicating that the information is P5 and P10 in the middle is stored in the storage unit 4 as one piece of image identification information in association with the current image information. Then, step S
The process returns to step S41, and waits for the next shutter key operation. By the above processing, image information photographed at a place that is at least a predetermined distance from the place where the previous image information was photographed (that is, in each area shown as groups 2 and 3 in FIG. The flag information is stored in association with the first image information P5, P10) among the captured images.

Next, in FIG. 8, when the user operates the mode switching key of the key input means 11 to set the reproduction mode, the image number n for designating the image information to be displayed on the display means 9 is set. Initialization is performed and n = 1 is set (step S51). Next, the image information specified by the image number n (that is, the n-th image information) is read from the storage unit 4 and displayed on the display unit 9 (step S52). The display of the n-th image information by the processing in step S52 is performed by the key input unit 1 in step S53.
The operation is continued until the operation of one scroll key is detected. If the scroll key is operated while the image information is being displayed (“YES” in step S53), it is determined whether the scroll key has been continuously pressed for a predetermined time (for example, 2 seconds) or more. Is determined (Step S5)
4). If the key is released before the predetermined time has elapsed, the process proceeds to step S55, where 1 is added to the image number n, and the process returns to step S52, where the next image information is displayed.

If it is detected in step S54 that the scroll key has been continuously depressed for a predetermined time, 1 is added to the image number n in step S56, and then step S56 is performed.
The process proceeds to 57, where it is determined whether the flag information is stored in the storage unit 4 corresponding to the image information specified by the image number n. Here, when it is determined that the flag information is not stored, the process returns to step S56, and thereafter, the processes of steps S56 and S57 are repeated until it is determined that the flag information is stored in step S57. If it is determined in step S57 that the flag information is stored (see FIG. 15A), the process proceeds to step S57.
Returning to 52, the image information specified by the image number n at that time (P5 and P10 in FIGS. 15A and 15B)
Is displayed.

As described above, in the search processing and display processing (FIGS. 7 and 8) shown in this embodiment, the distance calculation processing and the search condition collation processing are performed at the time of photographing, and the immediately preceding image information is obtained. Image information captured at a location that is at least a predetermined distance from the location where the image was captured (that is, the first image information P5 among the images captured in each area shown as groups 2 and 3 in FIG. 15A) , P10), the flag information is stored in association with the image information,
By repeating the operation of pressing the scroll key for a predetermined time during reproduction (or by continuously pressing the scroll key for a predetermined time or more), only the image information associated with the flag information is searched and extracted, and Since the first image information of the image captured in each area can be displayed sequentially, the normal scrolling can be performed when the first image information of the area where the desired image information is captured is displayed. By switching to the operation, the image information shot in the same area can be sequentially displayed, and similar to the above-described search processing and display processing (FIG. 6), desired image information can be searched quickly and easily. Can be displayed.

In the search processing and display processing shown in the present embodiment, the distance calculation processing and the search condition matching processing (steps S43 to S45) are performed at the time of photographing. As compared with FIG. 6), the processing load during reproduction can be reduced, and the display processing speed can be further increased. In step S45 of the flowchart of FIG.
When the distance between the points is equal to or more than the predetermined distance, the process proceeds to step S46, and the flag information is stored. However, when the distance between the two points is equal to or less than the predetermined distance, the flag information may be stored.

In the search processing and display processing shown in the present embodiment, the case where the photographing processing of FIG. 7 and the reproduction processing of FIG. 8 are executed in a single photographed image search apparatus has been described. Only the photographing process of FIG. 7 is executed by an individual electronic still camera with a GPS receiving function or the like, and thereafter, the detachable memory is removed and attached to a photographed image search device such as a personal computer or a wired (cable or the like) or wireless (radio wave, Infrared, etc.)
For example, the storage information may be transferred to the captured image search device, and the reproduction process of FIG. 8 may be executed by the captured image search device. In the search processing and the display processing described in the present embodiment, the distance calculation processing, the search condition collation processing, and the flag information storage processing (steps S43 to S4) are performed at the time of shooting.
6) is performed to determine whether flag information is stored at the time of reproduction (step S57). However, the distance calculation processing and the calculated distance information storage processing are performed at the time of photographing, and the distance calculation processing and search condition matching are performed at the time of reproduction. Processing may be performed.

Hereinafter, in the above-described search processing and display processing (FIGS. 7 and 8), the distance calculation processing and the calculated distance information storage processing are performed at the time of photographing, and the distance calculation processing and the search condition matching processing are performed at the time of reproduction. An example will be described with reference to the drawings. FIG. 9 is a flowchart illustrating an example in which the distance calculation processing and the calculated distance information storage processing are applied at the time of shooting, and the distance calculation processing and the search condition matching processing are applied at the time of reproduction. In the photographing mode, when the distance between the two points is calculated in step S44 in FIG. 7, the processing transits to step S61 in FIG. 9A, and the calculated distance information is replaced with the image information acquired by the current photographing. The information is stored in the storage means 4 in association with each other. Thereafter, the process returns to step S41, and waits for the next shutter key operation. Next, in the reproduction mode, when 1 is added to the image number n in step S56 in FIG. 8, the process proceeds to step S71 in FIG.
The distance information stored in association with the image information of the image number n is read, and it is determined whether or not the read distance information is equal to or longer than a predetermined distance (step S72).

If it is determined that the distance is equal to or shorter than the predetermined distance, the process returns to step S56.
→ The processing of S71 → S72 is repeated. If it is determined in step S72 that the distance is equal to or longer than the predetermined distance, the flow returns to step S52, and the image information specified by the image number n at that time is displayed. In the present embodiment, the photographing process (FIGS. 9A and 7) and the reproduction process (FIG. 9B) are performed in a single photographed image search device.
Although FIG. 8) has been described, only the photographing process of FIG. 9A is performed by an electronic still camera with a GPS receiving function or the like, and then the detachable memory is removed and attached to a photographed image search device such as a personal computer. Alternatively, the stored information is transferred to the captured image search device by wire (cable or the like) or wirelessly (radio wave, infrared light, or the like), and the captured image search device performs the operations shown in FIG.
The reproduction processing of (b) may be executed. Also,
In the flowchart of FIG. 7, the flag information is stored in association with the image information photographed at a place that is at least a predetermined distance from the place where the previous image information was photographed. A plurality of pieces of image information taken at a nearby landing may be determined as one group and registered as a group.

Next, a description will be given, with reference to the drawings, of a specific example of the photographing process when the image information is registered in a group at the time of photographing, and the search process and display process performed at the time of reproduction in that case. FIG. 10 is a flowchart showing a group registration process when image information is group-registered at the time of shooting, and FIG. 11 is a flowchart showing a search process and a display process at the time of reproduction when performing group registration at the time of shooting. It is. In FIG. 10, first, when the user operates the mode switching key of the key input unit 11 to set the shooting mode, the group number m for group registration is initialized and set to m = 1 (step 1). S81). Thereafter, when the shutter key is operated ("YES" in step S82), the image information is acquired as a digital signal via the image information acquiring means 1 to acquire the image information, and the predetermined information in the storage means 4 is obtained. At the same time, the position information of the place where the image information is obtained is obtained by measurement by the positioning means 2 and stored in a predetermined area of the storage means 4 in association with the image information (step S83).

Subsequently, the position information obtained by the previous photographing and stored in the storage means 4 and the position information obtained by the current photographing and stored in the storage means 4 are read (step S84). Thereafter, the distance between the two points indicated by the read position information is calculated using the above-described distance calculation method (step S85), and the calculated distance is equal to or greater than the predetermined distance (search condition) acquired by the condition acquisition means 5. It is determined whether or not (step S86). If it is determined that the distance is equal to or shorter than the predetermined distance, the process proceeds to step S88, and the current group number m is stored in the storage unit 4 as one of the image identification information in association with the current image information. . If it is determined in step S86 that the calculated distance is equal to or longer than the predetermined distance (P4 in FIGS. 15A and 15B).
-P5, P9-P10), the process proceeds to step S87, and 1 is added to the group number m, and then the process proceeds to step S88.
Then, the new group number m is stored in the storage unit 4 as one piece of image identification information in association with the current image information.

After the group number m is stored in step S88, the flow returns to step S82 to wait for the next shutter key operation. By the above processing, FIG.
As shown in (a), image information captured relatively near is registered as the same group. Next, FIG.
First, when the user operates the mode switching of the key input means 11 to set the reproduction mode, the image number n for designating the image information to be displayed on the display means 9 is set to n = 1 (1). Step S91). Next, the image information specified by the image number n (that is, the n-th image information) is read from the storage unit 4 and displayed on the display unit 9 (Step S92). The display of the n-th image information by the processing in step S92 is continued until the operation of the scroll key of the key input unit 11 is detected in step S93. When the scroll key is operated while the image information is being displayed (“YE in step S93”).
S "), and then the scroll key is pressed for a predetermined time (for example, 2
It is determined whether or not the button has been pressed for more than (seconds) (step S94).

Here, if the key press is released before the predetermined time has elapsed, the flow shifts to step S95, where the image number n
Is returned to step S92, and the next image information is displayed. When it is detected in step S94 that the scroll key has been continuously pressed for a predetermined time, in step S96, the group information (group) stored in the storage unit 4 in association with the n-th and (n + 1) -th image information. Number), and it is determined whether or not the read group numbers are different (step S97).
Here, if it is determined that the group numbers are the same, the process transits to step S98, adds 1 to the image number n, and returns to step S96. Thereafter, until it is determined in step S97 that the group numbers are different, step S9 is performed.
6 to S98 are repeated. Then, step S97
When it is determined that the group numbers are different from each other (FIG. 15 (a)
Then, the process proceeds to step S95, where 1 is added to the image number n, and the process returns to step S92, where the image information designated by the image number n at that time (FIG. 15A,
(P5, P10 in (b)) will be displayed.

As described above, in the search processing and display processing (FIGS. 10 and 11) shown in this embodiment,
At the time of photographing, distance calculation processing and search condition collation processing are performed.
Image information taken at a location more than a predetermined distance from the location where the previous image information was taken (P5 in FIG. 15A,
When it is determined to be P10), the group number associated with the image information is stored differently, and the operation of pressing the scroll key for a predetermined time during reproduction is repeated (or
By pressing the scroll key continuously for a predetermined time or more), the first image information among the image information belonging to the groups having different group numbers can be sequentially displayed. By switching to a normal scroll operation when the first image information of the (group) is displayed, image information shot in the same area can be sequentially displayed, and the above-described search processing and display processing (FIG. 6, FIG. As in FIGS. 7 and 8), desired image information can be searched and displayed quickly and easily. Further, in the search processing and the display processing shown in the present embodiment, similarly to the search processing and the display processing shown in FIGS. 7 and 8, the distance calculation processing and the search condition matching processing (steps S84 to S86) are performed at the time of shooting. I decided to do it,
The processing load during reproduction can be reduced, and the display processing speed can be further increased.

In step S88 of the flowchart of FIG. 10, the group numbers are stored in association with each image information. However, the image information is sorted and stored in each storage area assigned for each group number. Alternatively, a plurality of pieces of image information (image numbers) belonging to the group may be stored in association with one group number. Further, in the present embodiment, the distance calculation processing, the search condition collation processing, and the group number registration processing (steps S84 to S88) are performed at the time of capturing the image information, but may be performed at any time after the capturing. Is also good. Further, in the present embodiment, a photographing (group registration) process (FIG. 10 or FIG. 14 described later) and a reproduction process (FIG. 11, or FIGS. 12 and 13 described later) are performed in a single photographed image search device. ) Has been described, but an electronic still camera with a GPS reception function etc.
After that, only the photographing process is executed, and then, the detachable memory is removed and the photographed image is retrieved and attached to a photographed image retrieval device such as a personal computer, or the stored information is transmitted to the photographed image retrieval device by wire (cable or the like) or wirelessly (radio wave, infrared ray or the like). Then, the captured image search device may execute the reproduction process shown in FIG.

In this embodiment, the photographing (group registration) process (FIG. 10,
Alternatively, FIG. 14 described later) and the reproduction process (FIG. 11 or
12 and 13 which will be described later are described.
As shown in (a), only the calculated distance storage process is executed, and thereafter, the detachable memory is removed and mounted on a photographed image search device such as a personal computer, or photographed by wire (cable or the like) or wirelessly (radio wave, infrared light, etc.) The storage information is transferred to the image search device, and the group registration process shown in FIG. 10 (or FIG. 14 described later) and the reproduction process shown in FIG. 11 (or FIG. 12 and FIG. 13 described later) are executed by the captured image search device. You may make it. Further, in the flowchart of FIG. 11, the first (or last) image information shot in each group is searched and displayed. Desired image information (for example, intermediate image information) in the group is searched and displayed (see FIG. 12 described later), and image information included in the same group is displayed collectively (for example, multi-screen display) (described later). 13 (see FIG. 13).

A specific example of a search process and a display process for searching and displaying intermediate image information among image information belonging to each group will be described below with reference to the drawings. FIG. 12 is a flowchart showing a search process and a display process when searching and displaying intermediate image information among the image information belonging to each group. In FIG. 12, first, when the user operates the mode switching key of the key input unit 11 to set the reproduction mode, the image number n for designating the image information to be displayed on the display unit 9 is set to n = 1. At the same time as (Step S101), the group number m indicating the group of the image information to be displayed on the display means 9 is set to m =
It is set to 1 (step S102). Next, the image information specified by the image number n (that is, the n-th image information) is read from the storage unit 4 and displayed on the display unit 9 (Step S103). The display of the n-th image information by the processing in step S103 is performed in step S104.
, Until the operation of the scroll key of the key input means 11 is detected.

If the scroll keys (including the plus key and the minus key) are repeatedly operated while the image information is being displayed ("YES" in step S104), the scroll keys are continuously operated for a predetermined time (for example, It is determined whether the button has been pressed for 2 seconds or more (step S105). Here, if the key press is released before the predetermined time elapses,
The process proceeds to step S106 to determine whether the scroll key operated in step S104 is a plus key or a minus key. If it is determined in step S106 that the key is a plus key, 1 is added to the image number n in step S107, and the group number stored in the storage unit 4 in association with the nth and (n-1) th image information It is determined whether or not is different (step S108). If it is determined in step S108 that the group numbers are different, after adding 1 to the group number m (that is, after setting the group number of the image information of the image number n set at the present time), the process proceeds to step S103. Returning, the image information of the image number n is read and displayed.

If it is determined in step S106 that the key is the minus key, the image number n is determined in step S110.
After subtracting 1 from, it is determined whether the group numbers stored in the storage unit 4 in association with the n-th and n + 1-th image information are different (step S111). If it is determined in step S111 that the group numbers are different, after subtracting 1 from the group number m (that is, after setting the group number of the image information of the image number n set at the present time), the process proceeds to step S103. Returning, the image information of the image number n is read and displayed. Step S
If it is detected at 105 that the scroll key has been continuously pressed for a predetermined time, the process proceeds to step S113, and it is determined at step S104 whether the operated scroll key is a plus key or a minus key.

Here, if it is determined that the key is the plus key, 1 is added to the group number m in step S114, and the process proceeds to step S115. If it is determined that the key is the minus key, the group number is determined in step D16. from m to 1
Then, the process proceeds to the step S115. In step S115, the image number n is set to the intermediate image information (FIG. 15) of the image information associated with the group number m.
(P2 or P3 and P7 in (a) and (b)) is rewritten to an image number for designating, and thereafter, the process returns to step S103, and image information (intermediate image) designated by the image number n at that time Will be displayed. By the above processing, the intermediate images of each group are searched and displayed, so that the number of times of operation of the scroll key is reduced as compared with the case where the image information belonging to the group is sequentially scrolled from the beginning and the desired image information is displayed. As a result, desired image information can be displayed efficiently, and the search speed can be further increased.

Next, a specific example of search processing and display processing in a case where image information included in the same group is displayed collectively and desired image information is selected will be described with reference to the drawings. FIG. 13 is a flowchart showing search processing and display processing in a case where image information included in the same group is displayed collectively and desired image information is selected. FIG.
First, when the user operates the mode switching key of the key input unit 11 to set the reproduction mode, a group number m for designating a group of image information to be displayed on the display unit 9 is set to m = 1. (Step S12
1). Next, image information belonging to the group specified by the group number m (for example, P1 to P4 of group 1 and P5 to P9 of group 2 in FIG. 15A) is read from the storage unit 4 and displayed. 9, a list is displayed by multi-screen display or the like (step S122). The list display of the image information of the group number m by the processing of step S122 is performed by selecting and specifying any of the image information listed in step S123 or by step S124.
, Until the operation of the scroll key of the key input means 11 is detected.

When the scroll key is operated while the list (multi-screen) is displayed ("YE" in step S124).
S "), 1 is added to the group number m in step S125, the process returns to step S122, and a list of image information belonging to the next group is displayed. If any of the image information displayed in the list is selected and designated in step S123, the process proceeds to step S126, and the selected image is displayed on the entire screen. As a method for selecting and specifying image information, a cursor is displayed on the screen, and the cursor is moved to a desired image by operating the plus key and the minus key, and then the execution key is repeated. There is a method of selecting and specifying. If the return key is operated while the selected image is being displayed by the process of step S126, the process returns to step S122 and returns to the list display. By the above processing, the scroll keys are sequentially operated until the image information of the group including the desired image is displayed in a list, and thereafter, the desired image is selected from the images displayed in the list, so that the desired image is displayed. Since the image can be displayed, the speed and ease of the image search process and the display process can be further improved.

Next, another specific example of the group registration processing will be described with reference to the drawings. FIG. 14 is a flowchart illustrating another example of the group registration process. In FIG. 14, the image number n for designating the image information stored in the storage unit 4 is set to n at an arbitrary timing (for example, the execution of the group registration process is instructed by a key operation).
= 1 (step S131), and a group number m indicating a group of image information is set to m = 1 (step S132). Subsequently, all the position information stored in the storage unit 4 in association with the image information is read, and it is determined whether or not there is position information within a predetermined distance from the position information of the image information of the image number n. (Step S133). Specifically, a distance between two points of the position information of the image information of the image number n and all other position information is calculated,
It is determined whether any of the calculated distances is equal to or less than a predetermined distance.

If it is determined in step S133 that there is position information within a predetermined distance, the process proceeds to step S134, and some of the detected position information within the predetermined distance is registered in a group. That is, it is determined whether the group number is stored in association with the image information associated with the position information within the predetermined distance. This is because the group registration (group number storage) processing is performed in order from the image information of the image number 1, so that the detected position information within the predetermined distance is smaller than the position information of the image number n that is currently undergoing the group registration processing. This is because it is before or after. Step S1
If it is determined at 33 that there is no position information within a predetermined distance,
Alternatively, if it is determined that all the position information within the predetermined distance detected in step S134 has not been registered as a group, the process proceeds to step S135, and the group number m set at the present time is set as a new group number. It is stored in association with the image information of the image number n.

Thereafter, 1 is added to the group number m in step S136, and 1 is added to the image number n in step S137. Then, the flow returns to step S133 to start the group registration processing of the next image information. Step S134
If it is determined that the position information within the predetermined distance includes the information registered in the group, step S1
Then, it is determined whether there is a plurality of group registered position information detected in step S134 and whether the group numbers of the plurality of position information are different from each other. Here, one location information registered in the group,
Alternatively, if it is determined that there is no position information having a different group number, the process shifts to step S139 and proceeds to step S139.
The same group number as the group registered position information detected in 134 is stored in the storage unit 4 in association with the image information of the image number n, and the process proceeds to step S137. Also,
If it is determined in step S138 that there is position information of a different group, the process proceeds to step S140 to detect the closest position information from the position information of the image number n among the plurality of position information and detect the detected position information. The same group number as described above is stored in the storage unit 4 in association with the image information of the image number n, and the process proceeds to step S137.

By the above processing, image information photographed in a relatively near field can be registered as the same group irrespective of the photographing order, and only the positional (location) element is considered without the temporal element. Since the registered group registration process can be performed, it is effective when searching and displaying desired image information using only the shooting location (region) or action range of the image information as a guide. In the flowchart of FIG. 14, the group registration process is performed at an arbitrary time after photographing, but may be sequentially performed at the time of photographing image information as in the flowchart of FIG. In this case, the process of step S134 is not necessary, and if it is determined in step S133 that there is position information within a predetermined distance, the process immediately proceeds to step S138.

Next, a specific example of a search process and a display process for searching and displaying image information matching predetermined search conditions while displaying all image information will be described with reference to the drawings. That is, each of the above-described reproduction processes (FIG. 6,
In FIGS. 8, 9B, 11, and 12), when the scroll key is kept pressed for a predetermined time or more (that is,
At the time of the search processing), only the image information that matches the search condition is displayed. However, here, other image information that does not match the search condition is also displayed as in a normal auto-scroll display. FIG. 16 is a flowchart showing a search process and a display process when searching for and displaying image information matching a predetermined search condition while displaying all image information.
It is assumed that the distance calculation processing and the search condition collation processing are performed at the time of reproduction, as in the flowchart of FIG.
In FIG. 16, first, when the user modifies the mode switching key of the key input means 11 to set the reproduction mode,
An image number n for designating image information to be displayed on the display means 9 is set to n = 1 (step S141).

Next, the image information designated by the image number n (that is, the n-th image information) is read from the storage means 4 and displayed on the display means 9 (step S14).
2). The display of the n-th image information by the processing in step S142 is continued until the operation of the scroll key of the key input unit 11 is detected in step S143. It is determined whether or not the scroll key has been operated while the image information is being displayed (step S143). Here, when the operation of the scroll key is detected, step S
The process proceeds to 144, where 1 is added to the image number n, and the image information designated by the image number n is read from the storage unit 4 and displayed on the display unit 9 (step S145).
Subsequently, the position information stored in the storage unit 4 in association with the n-th and (n-1) -th image information is read (step S146).

Thereafter, the distance between the two points indicated by the read position information is calculated by using the above-described distance calculation method (step S147), and the calculated distance is used as the condition obtaining means 5.
It is determined whether or not the distance is equal to or longer than the predetermined distance (search condition) acquired (step S148). Here, if it is determined that the calculated distance is equal to or longer than the predetermined distance, step S149 is performed.
To display a detection mark (icon) or the like at a predetermined position on the display means 9 and output a sound such as an alarm sound from a sound output device (notification means; not shown) such as a speaker. Notify. If it is determined in step S148 that the distance is equal to or shorter than the predetermined distance, or after performing the notification process in step S149, the process proceeds to step S150, and it is determined whether the scroll key is continuously pressed. If it is determined that the pressing of the scroll key is continued, the process returns to step S144, and thereafter, the process proceeds to step S150 until it is determined that the pressing of the scroll key is released in step S150.
The processing of 144 to S150 is repeated (auto scroll display).

If it is determined in step S150 that the scroll key has been released, the flow advances to step S150.
By returning to 142, the automatic scrolling (automatic page feed) is released. As described above, by continuously depressing the scroll key, the automatic scrolling of all the image information is sequentially performed, and the image is shot at a place at least a predetermined distance from the place where the previous image information was shot. When the displayed image information is displayed on the display means 9, a predetermined notification is given. Therefore, the notification is used as a guide (trigger), and the automatic scrolling is released by releasing the pressing of the scroll key to release the normal manual. By switching to the scroll operation, the image information is sequentially displayed, and the desired image information can be displayed. In the flowchart of FIG. 16, the notification process is performed when the search condition is matched. However, the display time of the image information that matches the search condition is set longer than the display time of the other image information. The notification may be performed by processing and displaying image information that matches the search condition.

FIG. 17 is a flowchart showing another specific example of the above-described search processing and display processing (FIG. 16). In the reproduction mode, step S148 in FIG.
If it is determined that the distance is equal to or longer than the predetermined distance, the processing transits to step S151 in FIG. 17A to start a timer for counting the lapse of a predetermined time longer than the normal display time. Then, in step S152, the process waits for the time-up (elapse of the predetermined time) to be detected, and then proceeds to step S150 in FIG. Accordingly, when the image information that matches the predetermined search condition is displayed while performing the automatic scroll of the image information, the notification is performed by displaying the image for a longer time than the normal display time.

Instead of displaying the image information matching the search condition for a predetermined time, the display may be continued until the user performs a predetermined key operation. In the reproduction mode, if it is determined that the distance is equal to or longer than the predetermined distance in step S148 of FIG. 16, the process proceeds to step S161 of FIG. 17B, and the image information of the image number n read and displayed in step S145 is added Predetermined processing (for example,
Display color change processing, passing processing, etc.) are performed and displayed on the display unit 9, and the process proceeds to step S150 in FIG.
As a result, while performing automatic scrolling of image information,
When the image information that matches the predetermined search condition is displayed, the notification is performed by performing predetermined image processing and displaying the image information in a different image state or display state from the normal image information.

Next, a search condition setting process in the case where the condition obtaining means applied to the photographed image search device according to the present invention obtains search conditions for searching the image information stored in the storage means by a learning process. Will be described with reference to the drawings. FIG. 18 is a flowchart showing a specific example of the search condition setting process when the search condition is obtained by the learning process in the condition obtaining means. In FIG.
First, the latitude information having the maximum value and the latitude information having the minimum value are searched and extracted from the latitude information stored in the storage means 4 (step S161). Then, the difference between the searched and extracted maximum value and minimum value is calculated (step S16).
2). Similarly, in steps S163 and S164, the longitude information stored in the storage unit 4 having the maximum value and the longitude information having the minimum value are searched and extracted, and the extracted maximum value and minimum value are extracted. Calculate the difference from the value.

Next, in step S165, step S1
A predetermined distance is calculated based on the latitude difference and the longitude difference calculated in 62 and S164, and registered as a search condition. That is, when the latitude difference and the longitude difference are large, a relatively long distance is set, and when the latitude difference and the longitude difference are small, a relatively short distance is set. Note that the search condition setting process is not limited to the method of FIG. 18. For example, in the flowchart of FIG. 18, even when the latitude difference and the longitude difference are large, when the shooting location is partially concentrated, It is also conceivable to shorten the set distance by weighting processing. As described above, since the search condition can be automatically set and registered by the condition obtaining unit based on the position information from which the image information has been obtained, the above-described search processing can be performed without the user performing key operations. , Display processing, or group registration processing, and desired image information can be quickly and easily searched and displayed by a simple operation method.

FIG. 19 is a conceptual diagram showing still another example of a distance calculation example and search collation. First, as shown in FIG. 19A, similarly to the case shown in FIG. 5, the image information P1, P2, P stored in chronological order according to the acquired time.
Extract position information for each of 3,. Here, of the extracted position information, specific image information P
1 is set as the reference position, and the absolute distances P1-P2, P1- P
3 / P4, P1-P5,... Are calculated. Next, as shown in FIG. 19B, the input and set search conditions are set as thresholds (indicated by dotted lines in the figure), and have distances P1-P6 and P1-P7 longer than the thresholds, for example. Was)
The image information P6 and P7 acquired at the place are extracted or marked as search results. According to such a distance calculation method, since an absolute distance between an arbitrary reference position and a position at which image information is obtained can be calculated, a region moved around the reference position for image information acquisition or Image information search processing can be performed using the range as a clue. Note that image information having position information within a predetermined distance from an arbitrary reference position may be searched and displayed.

FIG. 20 is a flowchart showing still another example of the image information search processing in the photographed image search apparatus. Here, the azimuth is adopted as the specific amount calculated based on the position information. First, the photographed image search device is operated to set the image reproduction state, that is, the image information display state, and the position information associated with each image information stored in the storage unit 4 is extracted (step S171). The azimuth between the locations where the information is obtained is calculated (step S17).
2). Specifically, a relative or absolute azimuth between two points is calculated based on the latitude and longitude acquired by the GPS positioning method as described above. Then, the calculated orientation,
A search condition for selecting and extracting an image is collated (step S173), and image information belonging to a direction matching the condition is extracted (step S174). Here, the search condition may be such that the user of the photographed image search device operates the key input unit 11 to input and set the desired search condition in the condition acquisition unit 5 in the search process of the image information. And
A search condition fixedly stored in the captured image search device in advance may be obtained. Further, even if the search condition is set based on the appearance frequency (trend) of the search condition set in the past or the like, or the search condition is set based on the statistical tendency of the azimuth calculated this time. Good.

Next, a specific example of the process of calculating the azimuth from which each piece of image information is obtained and the process of comparing the calculated azimuth with the search condition will be described with reference to the drawings. FIG. 21 is a conceptual diagram showing an example of the calculation of the azimuth and an example of the search and collation. First, as shown in FIG. 21A, position information is extracted for image information P1, P2, P3,... Stored in chronological order according to the acquired time. Here, the position information is latitude and longitude measured by the GPS positioning method. Therefore, the azimuth of the place where each piece of image information has been acquired with respect to an arbitrary reference position P0 is calculated as a coordinate value from the latitude and longitude, or as an angle using a trigonometric function. Next, as shown in FIG. 21B, the input and set search conditions are set as threshold values (indicated by dotted lines in the figure), and the image information P1 acquired at a location belonging to the west direction (W), for example,
P2 and P3 / P4 are extracted or marked as search results.

According to such an azimuth calculation method, the location where the image information is obtained for an arbitrary reference position P0 can be calculated as an absolute azimuth. Thus, a search process for image information can be performed. Here, the reference position may be an arbitrary place such as a home or a starting point of an action, or may be a fixed place such as a place where the first image information P1 is obtained. . Further, in the present embodiment, an example in which an absolute azimuth with respect to an arbitrary reference point is calculated has been described.

In the above-described image information search processing, an example is shown in which the distance and the azimuth are calculated based on the position information of the latitude and the longitude as the specific amounts, and any one of these is independently subjected to the search and collation processing. However, by combining a distance and a direction, and as shown in FIG. 3, by combining image identification information and time information stored in the information table area of the storage means, it is possible to narrow down search conditions. More various image search processing can be realized. In the above-described image information search process, the GP
The two-dimensional distance and azimuth were calculated using the latitude and longitude measured by the S positioning method, and were subjected to search and collation. However, the present invention is not limited to this. The altitude difference may be calculated based on the measured altitude.

(Image Display Process) Next, a specific example of the image display process applied to the photographed image search device according to the present embodiment will be described with reference to the drawings. FIG. 22 is a flowchart illustrating an example of a process of changing an image display method in the captured image search device according to the present invention. Here, a scroll display for sequentially displaying the image information stored in the storage unit 4 in chronological order will be described. First, the photographed image search device is operated to set an image reproduction state. For example, the user of the photographed image search device operates the key input unit 11 to input and set the condition in the condition acquisition unit 5 to acquire the search condition ( Step S181). Next, the image information stored in the storage unit 4 is sequentially displayed in a time-series manner and at a predetermined display interval (step S182). Then, when each image information is displayed, as shown in the above-described image information search processing, the search condition is compared with the calculated specific amount (distance, direction, altitude difference) (step S183), and the search condition is changed. If the image information that satisfies is detected, the image information is displayed and the display method is changed (step S184). If the displayed image information is not the desired image (step S185), the image information subsequent to the currently displayed image is further displayed in time series.

Here, the change of the display method specifically means that when image information satisfying the search condition is detected, normal scroll display is stopped, and the image information is given priority and used. Means to notify and recognize search results. As a change example of the display method, for example, a method of stopping the scroll display and displaying only the image information (FIGS. 6, 8, 9B, 11,
(FIG. 12), a method of displaying for a longer time than a predetermined display interval while continuing scroll display, a method of changing the light emission color of the display screen, or a method of displaying by flashing or blinking, and displaying notification information on the display screen A method, a method of notifying by voice using an attached speaker, or the like can be applied (FIGS. 16 and 17). In the high-speed scroll display employed in an electronic still camera or the like, there is a display that does not display each image information but displays only a page number. By directly displaying the image information that satisfies the search condition, the search result can be notified to the user.

Next, a specific example of the process of changing the image display method will be described with reference to the drawings. FIG. 23 is a diagram illustrating an example of changing the display method in the scroll display. First, as shown in FIG. 23A, image information P1, P2, P3,
・ ・ Is displayed at high speed scroll. In this case, instead of displaying the image information itself, for example, only the page number is scroll-displayed. As shown in FIG. 23B, when image information P2 and P7 satisfying the search condition are detected by the above-described image information search process, the process shown in FIG.
As shown in (c), the scroll display is interrupted, and the image information P2, P7 is displayed instead of the page number. According to such an image display method, even if the image information satisfying the search condition is detected even during the scroll display, the search result can be reliably notified to the user by changing the display method. It is possible to provide more various image display methods.

FIG. 24 is a flowchart showing a specific example of the image display processing and the image selection processing. First, the photographed image search device is operated to set an image reproduction state, and for example, a user of the photographed image search device operates the key input unit 11 to input and set desired search conditions to the condition acquisition unit 5 for search. The condition is acquired (step S191). Then
As shown in the above-described image information search processing, the search condition is compared with a specific amount (distance, azimuth, altitude difference) calculated for each image information (step S192), and image information satisfying the search condition is detected. If so, only the relevant image information is displayed (step S193). Then, if the displayed image information is a desired image, the image is selected by operating the execution key of the key input unit 11 to be displayed in a static manner, and the processing is terminated. Returning to step S193, the next image information satisfying the search condition is displayed (step S194).

Here, when the image information satisfying the search condition = the desired image information as shown in FIGS.
Although there is no problem with the flowchart of FIG. 4, if the image information satisfying the search condition is only image information serving as a guide for searching for desired image information as shown in FIGS. After the image is selected in step S194, the image information that does not satisfy the search condition following the selected image (in the case of FIGS. 6 to 9A) or the image information of the same group as the selected image (FIGS. 10 to 14) ),
As in steps S193 and S194, it is necessary to perform scroll display (or multi-screen display) and allow the user to select desired image information from among them. In addition,
The display method of the image information satisfying the search condition may be either the above-described scroll display or the multi-screen display in which a plurality of pieces of image information are displayed collectively on the divided screen. According to such an image display method, only the image information satisfying the search condition is sequentially displayed, and the search result can be displayed quickly and reliably.

FIG. 25 is a diagram showing still another example of the image display processing. Here, a multi-screen display in which the image information stored in the storage unit 4 is displayed collectively on the divided screens will be described. First, as shown in FIG.
For the image information P1, P2, P3,... Stored in chronological order according to the obtained time, the obtained search condition is compared with the calculated specific amount.
As shown in (b), a group G2 of image information satisfying the search condition (for example, P2, P4, P5, P7,...)
And a group G1 of other image information (for example, P
1, P3, P6,...). Then, the image information P2, P2 belonging to the image group G2 satisfying the search condition.
Only the image information (representative image) P2 at the head of 4, P5, P7,... Is displayed in advance, and when the user selects the image information, the user belongs to the same group G2 as shown in FIG. Undisplayed image information P4, P5, P7,
.. are displayed collectively on a screen divided into four screens, nine screens, or the like.

Here, in addition to the above-described method, the grouping of the image information is performed, for example, by using the image information P2 satisfying the search condition.
And the subsequent image information P3 to P6 (up to the next image information satisfying the search condition, for example, before P7) may be grouped. In this case, only the representative image P2 of the image group satisfying the search condition is displayed in advance, and when the image P2 is selected as a desired image, undisplayed image information P3 to P6 belonging to the same group are displayed on four screens or nine screens. Etc. are displayed collectively on the divided screen. According to such an image display method, the image information stored in the storage unit 4 is grouped in advance based on the search condition,
The multi-screen display allows a plurality of pieces of image information to be browsed collectively, and the search results can be displayed quickly and reliably. Here, in the present embodiment, the method of displaying the first image information as the representative image of the group of image information satisfying the search condition has been described, but any image information other than the first image information may be used.

In the above-described embodiment, an example has been described in which the calculation processing of the specific amount based on the position information and the image information search processing are performed at the time of reproducing the image information, but the image information is associated with the position information, the time information, and the like. When storing image information, a specific amount may be calculated and collated with a preset search condition, and a specific amount and a search result (marking) may be stored in association with each image information. . Then, for example, when displaying the marked image information, the display operation of the search image displays the mark information, that is, the search condition, and the image information satisfying the search condition. Specifically, in scroll display and multi-screen display,
By displaying characters such as "search distance: 10 km or more" over the image information, the user can be notified of the group (classification) of the displayed image information.

Further, in the above-described embodiment, an example is shown in which latitude and longitude information based on the GPS positioning method is used as position information indicating the acquisition position of image information. If the location can be seen from the satellite, the location where the image information is obtained can be measured and used as search information without being affected by the weather etc., and various technologies accumulated in the navigation system etc. can be used. It is possible to easily obtain high-accuracy position information using the information. Note that the method of calculating the position information of the acquisition location of the image information is not limited to the GPS positioning method, but may be, for example, a PHS (Personal Handyphone).
System) may be used.

Next, an embodiment in which the photographed image search device and the photographed image search method according to the present invention are applied to an electronic still camera with a GPS receiving function will be described. FIG. 26 is an external configuration diagram showing an example of the electronic still device according to the present invention. FIG.
As shown in FIGS. 6A and 6B, the electronic still camera according to the present embodiment includes various known key switches such as a shutter key 31, a plus / minus key 12, a power switch 13, a REC / PLAY key 19, and the like. Key input means, condition obtaining means), and a camera mechanism section (imaging means) including a strobe 14, an optical finder 15, a photographic lens 16, and the like.
And a GPS receiver 17 (positioning means) and an LCD 18 (display means).

Each component will be described sequentially. The shutter key 31 has a function as a shutter for taking a subject as an image at the time of photographing (recording mode).
When the menu key is pressed in the recording mode or the reproduction mode, a function as a YES key for selecting an arbitrary item from various items displayed on the LCD 18 is added and used as a multi-function key. Sometimes. Here, the menu key has a function of performing various system settings. For example, in the reproduction mode, various items such as erasing of an image are recorded, and in the recording mode, recording items necessary for recording an image are recorded. The definition of the image and the on / off state of the auto focus are displayed on the LCD 18. The plus / minus key 12 has a function of selecting a reproduced image and selecting various system settings. Here, “plus” means the selection direction, and in the case of image selection, means the direction of the latest image, and “minus”.
Means the opposite direction.

The power switch 13 is a switch for turning on / off the operation power of the electronic still camera,
The LAY key 19 sets switching between a recording mode for capturing and storing a desired subject and a reproduction mode for reproducing and displaying the stored image. In addition, as key switches provided in the electronic still camera, a display key having a function of overlappingly displaying various information on an image displayed on the LCD 18, a self-timer key for setting a self-timer, and setting of a flash condition of a strobe light are set. There is a strobe mode key and the like. Here, the types and names of the key switches are not necessarily unified depending on the manufacturer or the model, but have the functions described above. By operating such key switches, in the recording mode, a desired subject is imaged and stored via the camera mechanism unit, and in the reproduction mode, the reproduction and display of the stored image, search and the like are performed. Input settings of search conditions, position information of an imaging point, and the like can be displayed.

The strobe 14 is arranged near the photographic lens 16 and emits a flash light with a predetermined light amount according to the illuminance of the subject. Further, the optical finder 15 has an optical system linked to a focusing mechanism provided in the photographic lens 16, and the subject is directly observed through this optical system,
A shooting area is defined. The photographic lens 16 generally has an optical system composed of a combination of a plurality of lenses. A frame image (image signal) having a resolution can be generated. With such a camera mechanism, an image of a desired subject can be captured and stored as a digital signal.

The GPS receiver 17 receives a signal (satellite wave) emitted from the positioning satellite 100 based on the above-described GPS positioning method, and converts the satellite wave received by a known signal processing circuit into digital data. Convert and demodulate to obtain time and satellite orbit data. The photographing time and the photographing place are calculated based on these data.
As the LCD 18, for example, a TFT type color liquid crystal having clear display characteristics, natural coloring, and low power consumption is applied. In the recording mode, image information captured by the camera mechanism is displayed continuously to facilitate the definition of the subject. In the playback mode, the captured image is scrolled sequentially or divided into multiple screens. Display by

FIG. 27 is a block diagram of an electronic still camera according to this embodiment. 27, reference numeral 20 denotes a camera mechanism (imaging means), which includes a photographic lens 21 and a CCD.
22, a CCD drive system 23, a sample and hold circuit (step S / H) 24, an analog / digital converter (A /
D) 25, a lens drive system 26 and the like. 17 is a GPS receiver (positioning means), 18 is L
A CD (display unit), 27 is a memory (storage unit), 28 is a key input unit (selection unit, condition acquisition unit), 29 is a clock unit, and 30 is a CPU (calculation unit, search unit, display control unit). Each configuration will be described sequentially.

The CCD 22 is a solid-state image pickup device, and converts two-dimensional optical information into a time-series (serial) analog electric signal.
, And instructs each pixel of the CCD 22 to start photoelectric conversion and output the accumulated charge. S / H24 is
The time-series analog electric signal output from the CCD 22 is sampled at a frequency suitable for the resolution of the CCD 22, and the A / D 25 converts the analog electric signal sampled by the S / H 24 into a digital signal. The lens drive system 26 adjusts and drives the focal point of the photographic lens 21 based on the distance to the subject measured by a measurement mechanism such as an auto focus (not shown).

In the recording mode, the memory 27 associates the image information of the photographed subject, the photographing position information and the photographing time information calculated based on the signal received from the positioning satellite 100 with each image information, and This is a rewritable image memory used for storing in the indicated area, and has a sufficient capacity to store a plurality of images. The clock unit 29 is a quartz clock built in the electronic still camera, independently displays the current time and provides photographing time information, and controls the time included in the satellite wave received via the GPS receiving unit 17. By comparison with the ingredients,
It has a role of suppressing an error mixed in the position information. CP
U30 is for centrally controlling the operation of the camera by executing a predetermined control program, and the recording mode program and the reproduction mode program are stored in the internal RO of the CPU 30.
M, and is loaded from the internal ROM to the internal RAM of the CPU 30 and executed in each mode.

In particular, processing for storing in the memory 27 the image signal picked up by the camera mechanism section 20 in association with the shooting position information and the shooting time information calculated by the GPS receiving section 17, and setting by the key input section 28 and the like. Processing for searching for and extracting image information satisfying the search condition from the image information stored in the memory 27 based on the searched search condition, LC
A process for controlling a display method of image information to be displayed on D18, various menus, display of notification information, and the like is executed. With such a configuration, since the position information and the time information can be stored as search information in association with the image photographed by the electronic still camera as search information, a large amount of photographing can be performed by using the distance and direction (direction) between the photographing places as a clue. A desired image can be searched from the images. In particular, by adding conditions such as distance and direction in addition to the conventional search conditions such as time information, etc., it is possible to realize a wider variety of search processing, and to notify and display search results at high speed and accuracy. can do.

In the above-described embodiment, the straight-line distance is calculated when calculating the distance between two points. However, the distance of the route between two points (actually, using road data such as map data) is calculated. May be calculated.
In the above-described embodiment, the case where the photographed image search device and the photographed image search method according to the present invention are applied to an electronic still camera has been described. However, the present invention is not limited to the electronic still camera. . In short, a captured image having image information acquisition means for acquiring image information at different places (positions), storage means for storing the image information, and display means for displaying the stored plurality of image information by a predetermined display method If it is a search device, it can be a professional or consumer digital video camera, a notebook computer equipped with a card-type camera unit, or a P equipped with a camera function.
Needless to say, the present invention can be suitably applied to a portable document filing system, a handy scanner, and the like, in addition to a DA (Personal Digital Assistant). Also, in recent years, images taken by electronic still cameras have been transferred to image display devices such as personal computers via the Internet or the like, and image processing has been performed. The present invention can also be favorably applied as a search method.

[0092]

According to the first aspect of the present invention, there is provided a photographed image search apparatus for searching photographed image information satisfying a predetermined condition from a plurality of photographed image information. Since there is provided a search unit for searching the image information that satisfies a predetermined condition based on the distance between the image capturing positions at which the captured image information is acquired from the image information, the action at the time of acquiring (imaging) the image information is provided. By using a pattern (moving distance) as a guide, it is possible to provide a photographed image search device capable of quickly and easily searching and extracting desired photographed image information from an enormous amount of photographed image information. According to the second aspect of the present invention, there is provided a calculating means for calculating a distance between photographing positions in photographed image information stored or managed adjacent to the storing means, and a predetermined condition is determined based on the calculated distance. Is configured to search for image information that satisfies the following condition. For example, only image information captured at a location at least a predetermined distance from the imaging position of the immediately preceding image information is searched and extracted, and a desired image is extracted. The first shot image information in each area where the information was shot can be sequentially displayed, and when the first image information of the area where the desired image information is shot is displayed, all image information of the area is displayed. By sequentially scrolling or multi-displaying, desired image information can be searched quickly and easily.

According to the third aspect of the present invention, a photographing position at which one (specific) photographed image information stored in the storage means is acquired and a plurality of photographing positions at which other plural photographed image information is acquired. Calculation means for calculating the distance between
Based on the distance calculated by the calculating means, the camera is configured to search for captured image information that satisfies a predetermined condition. Since it is possible to search for photographed image information satisfying a predetermined distance condition based on the distance, an enormous amount of photographed images can be obtained based on an area (area or range) moved for photographing around the reference position. Desired captured image information can be searched and extracted quickly and easily from the information. According to the fourth aspect of the present invention, the storage means for storing the shooting position information indicating the shooting position of the shooting image information in association with the shooting image information, and the shooting of the shooting image information indicated by the stored shooting position information And calculating means for calculating the distance between the positions. Based on the distance calculated by the calculating means, the apparatus is configured to search for captured image information satisfying a predetermined condition. Based on the stored shooting position information, a distance is calculated from the shooting positions of arbitrary image information, and only image information satisfying a predetermined condition can be searched and extracted. Searching can be performed quickly and easily by a search method.

According to the fifth aspect of the present invention, the distance between the photographing position of the photographed image information and the photographing position of the other photographed image information satisfies a predetermined condition in association with the photographed image information. Storage means for storing the identification information indicating that the information is stored, and a search means for searching for the captured image information stored in association with the identification information in the storage means,
For example, when the photographing positions of the photographed image information are separated from each other by a predetermined distance or more, the identification information (flag information) is stored in association with the photographed image information, so that the image stored with the identification information associated with the image search is retrieved. Information, i.e., the image information taken first in each area can be displayed sequentially, and when the first image information of the area where the desired image information is taken is displayed, all the image information of the area is displayed. By displaying them sequentially or collectively,
Desired image information can be searched quickly and easily. Further, since identification information indicating whether or not a predetermined distance condition is satisfied is stored in association with image information, it is possible to search and extract photographed image information based on only the stored identification information at the time of image search. Therefore, the processing load during image display can be reduced, and the display processing speed can be further increased.

According to the sixth aspect of the present invention, the storage for storing the distance information indicating the distance between the photographing position of the photographed image information and the photographing positions of the other photographed image information in association with the photographed image information. Means, and search means for searching for captured image information in which the distance indicated by the distance information stored in the storage means satisfies a predetermined condition. ) Is stored in association with the photographed image information, and only the photographed image information having the distance information satisfying the predetermined search condition can be searched and extracted at the time of the image search, and the desired image information can be retrieved according to the search condition. Can be searched quickly and easily by various search methods. According to the seventh aspect of the present invention, since there is provided a storage unit for storing the photographed image information in which the distance between the photographing positions of the photographed image information satisfies a predetermined condition as the same group, for example, the photographing is performed in a relatively near field. Group information can be registered as the same group,
Based on the distance condition for each group, desired image information can be searched quickly and easily.

According to the eighth aspect of the present invention, the photographing position acquiring means for acquiring the photographing position information, the computing means for computing the distance between the photographing positions indicated by the photographing position information, and the computed distance satisfying a predetermined condition Search for captured image information that satisfies
And the retrieval means is configured to store the retrieved photographed image information in the storage means as the same group. For example, regardless of the photographing order, the image information for each photographing area is obtained based on only the distance condition. Are stored in the storage means as the same group, it is possible to quickly and easily search for a group in a shooting area satisfying a predetermined distance condition at the time of image search, and to sequentially or collectively obtain shot image information belonging to the group. To display and retrieve and extract desired image information.

[0097] According to the ninth aspect of the present invention, the second retrieval for retrieving, from a plurality of pieces of photographed image information stored in the storage means, photographed image information in which the distance between the photographing positions satisfies a predetermined condition. Means for storing or managing a plurality of pieces of photographed image information in the order of photographing, and storing the photographed image information stored or managed sandwiched between the retrieved photographed image information as the same group. If the image information taken this time is taken at a place at least a predetermined distance from the place where the previous image information was taken, the group number associated with the image information is stored differently from the previous group number. By doing so, for example, the first image information in each group can be sequentially displayed at the time of image search, and the first image information in the area where the desired image information was captured is displayed. In, turn the entire image information of the region,
Alternatively, the desired image information can be searched quickly and easily by displaying the image information collectively.

According to the tenth aspect of the present invention, a plurality of pieces of photographed image information stored in the storage means are searched for photographed image information in which the distance between the photographing positions at which the photographed image information is acquired is less than or equal to a predetermined distance. And a storage unit for storing the retrieved captured image information as the same group. For example, image information captured in a relatively near field can be stored in the same group based on only distance conditions. When the image is searched, a group that satisfies a predetermined distance condition can be searched quickly and easily, and photographed image information belonging to the group can be displayed sequentially or collectively to obtain a desired image. Image information can be searched and extracted. According to the eleventh aspect of the present invention, since there is provided a search means for searching for predetermined photographed image information from the photographed image information of each group stored in the storage means, for example, an intermediate of each group at the time of image search. By searching and displaying images, it is possible to reduce the number of operations related to image display as compared with the case where image information belonging to each group is sequentially displayed from the beginning and desired image information is searched, and the number of image display operations can be reduced. Desired image information can be displayed.

According to the invention of claims 12 and 13,
Since there is provided a search unit that searches for captured image information of the same group stored in the storage unit, based on only the distance condition in advance, when searching for image information stored grouped for each shooting region, Image information belonging to the same group that satisfies a predetermined distance condition can be quickly and easily searched. Because of the means, the photographed image information belonging to the searched group can be displayed sequentially or collectively, and desired image information can be efficiently selected.

According to the fourteenth and fifteenth aspects of the invention,
Selecting means for selecting desired photographed image information from the photographed image information retrieved by the retrieval means; and searching for photographed image information not retrieved by the retrieval means when the desired photographed image information is selected by the selecting means. A second search unit that performs a search when the image information searched by the search unit is image information (for example, a representative image of a predetermined group) serving as a guide for searching for desired image information. It is possible to search for and display the image information following the searched image information (not satisfying the search condition), and furthermore, to obtain desired photographed image information from the photographed image information searched by the second searching means. Is provided, the desired image information can be efficiently selected from the displayed image information.

According to the sixteenth aspect of the present invention, there is provided a display means for displaying photographed image information stored in the storage means,
Display control means for displaying the photographed image information retrieved by the retrieval means longer on the display means than other photographed image information which has not been retrieved, so that the photographed image information is displayed sequentially during the image retrieval. When the image information that matches the predetermined search condition is displayed, the image information can be displayed for a longer time than the normal display time, and the search result can be reliably notified to the user visually. According to the seventeenth aspect of the present invention, when the display means displays the captured image information stored in the storage means, and the captured image information searched by the search means is displayed on the display means, a notification is given to that effect. Means, for example, at the time of image search, while the captured image information stored in the storage means is sequentially displayed by auto-scrolling, when image information matching predetermined search conditions is displayed, voice or the like is displayed. The search result can be notified to the user by the predetermined notification method. By using the notification as a guide, the display method of the image is switched to the manual scrolling, whereby the desired image information can be searched quickly and easily. Can be displayed.

According to the eighteenth aspect of the present invention, a display means for displaying the photographed image information stored in the storage means,
When the photographed image information retrieved by the retrieval means is displayed on the display means, the image processing apparatus is provided with a display control means for performing image processing and displaying the photographed image information. When image information that matches the search condition is displayed, the image information can be displayed by performing predetermined image processing such as changing the display color, and the search result can be reliably notified to the user visually. be able to. According to the nineteenth aspect of the present invention, the predetermined condition is determined based on the photographing position at which the photographed image information stored in the storage means is obtained, so that the search condition can be set without the user performing a key operation. A series of search processing, display processing, or group registration processing can be performed by automatically setting and registering, and desired image information can be quickly and easily searched and displayed by a simple operation method. it can.

According to the twentieth aspect of the present invention, there is provided a photographed image search apparatus for searching photographed image information satisfying a predetermined condition from a plurality of photographed image information. And a search unit that searches for captured image information that satisfies a predetermined condition based on the azimuths of the captured positions at which the captured image information is obtained. It can be obtained as absolute azimuth information, and by using the action pattern (moving direction) at the time of obtaining (photographing) the image information as a guide, the desired photographic image information can be obtained from a vast amount of photographic image information at high speed. Further, it is possible to provide a photographed image search device that can be easily searched and extracted.

According to the twenty-first aspect of the present invention, an electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information. Positioning means for measuring a photographing position of an image of a subject; calculating means for calculating a distance between the photographing positions; search means for searching for photographed image information in which the calculated distance satisfies a predetermined condition; Storage means for storing the image information and storing the identification information in association with the retrieved photographic image information, so that the distance between the photographic positions in relation to the photographic image information satisfies a predetermined distance condition The identification information (flag information) indicating whether or not the image data is stored in the storage means can be stored in the storage means. Based on the information, a desired photographed image information fast and easy retrieval can be extracted.

According to the twenty-second aspect, an electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information. And positioning means for measuring the shooting position of the image of the subject, calculating means for calculating the distance between the shooting positions, and storing the shot image information, and storing the calculated distance in association with the shot image information Storage means for storing the distance information between the photographing positions in the storage means in association with the photographed image information, and the enormous amount of information stored in the storage means by the photographed image search device such as a personal computer. From the captured image information, it is possible to search for captured image information satisfying a predetermined search condition based on the distance information, and to efficiently select desired captured image information from the retrieved image information. That.

According to the twenty-third aspect, an electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information. Positioning means for measuring a photographing position of an image of a subject; calculating means for calculating a distance between the photographing positions; search means for searching for photographed image information in which the calculated distance satisfies a predetermined condition; Storage means for storing the image information and the photographed image information retrieved by the retrieval means as the same group, so that photographing is performed according to whether or not the distance between photographing positions satisfies a predetermined distance condition. The image information can be grouped and stored in the storage means, and a predetermined distance from a huge amount of the captured image information stored in the storage means by a captured image search device such as a personal computer. Find the groups satisfying the conditions, further, desired imaging image information fast and easily retrieved from the captured image information belonging to the group, can be extracted.

According to a twenty-fourth aspect of the present invention, there is provided a photographed image search method for retrieving photographed image information satisfying a predetermined condition from a plurality of photographed image information. From the stored plurality of pieces of photographed image information, to search for photographed image information in which the distance between photographing positions satisfies a predetermined condition. Using the distance as a guide, it is possible to realize a photographed image search process capable of quickly and easily searching and extracting desired photographed image information from an enormous amount of photographed image information. According to the invention described in claim 25, there is provided a captured image search method for searching captured image information satisfying a predetermined condition from a plurality of captured image information, wherein the plurality of captured images stored in a memory are provided. Since the method includes a step of searching for the photographed image information in which the distance between the photographing positions at which each of the photographed image information is acquired from the information satisfies a predetermined condition, and a step of displaying the searched photographed image information For example, an action at the time of acquiring (photographing) image information from photographed image information provided through a detachable memory storing a plurality of photographed image information captured by an image reading device such as an electronic camera device or a scanner. Using the pattern (moving distance) as a guide, it is possible to realize a photographed image search process capable of quickly and easily searching and extracting desired photographed image information.

According to the twenty-sixth aspect of the present invention, there is provided a photographed image retrieval method for retrieving photographed image information satisfying a predetermined condition from a plurality of photographed image information. A procedure for displaying the captured image information on the display unit, and the captured image information in which the distance between the captured positions at which each of the captured image information is acquired satisfies a predetermined condition is searched for,
When displayed on the display unit, a procedure for notifying that fact is included, so a removable memory storing a plurality of pieces of captured image information captured by an image reading device such as an electronic camera device or a scanner is included. When the image information that matches the predetermined distance condition is displayed while displaying the captured image information provided via the, the search result is reliably provided to the user by a predetermined notification method such as voice or image. The user can be notified, and using this notification as a guide, desired image information can be searched quickly and easily.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a basic configuration of a captured image search device according to the present invention.

FIG. 2 is a flowchart illustrating a process of acquiring and storing image information of a captured image search device according to the present invention.

FIG. 3 is a conceptual diagram showing an internal area of a storage unit applied to the captured image search device according to the present invention.

FIG. 4 is a flowchart showing an example of image information search processing in the captured image search device according to the present invention.

FIG. 5 is a conceptual diagram showing an example of distance calculation and an example of search collation in image information search processing according to the present invention.

FIG. 6 is a flowchart showing search processing and display processing at the time of reproduction applied to the photographed image search device according to the present invention.

FIG. 7 is a flowchart showing a search process at the time of shooting applied to the shot image search device according to the present invention.

FIG. 8 is a flowchart showing a display process at the time of reproduction applied to the captured image search device according to the present invention.

9 is an example of a case where the distance calculation processing and the calculated distance information storage processing are applied at the time of shooting and the distance calculation processing and the search condition matching processing are applied at the time of reproduction in the search processing and display processing shown in FIGS. 7 and 8; It is a flowchart which shows.

FIG. 10 is a flowchart showing a group registration process of image information at the time of photographing applied to the photographed image search device according to the present invention.

FIG. 11 is a flowchart showing search processing and display processing at the time of reproduction applied to the photographed image search device according to the present invention.

FIG. 12 is a flowchart illustrating a search process and a display process when searching and displaying intermediate image information among image information belonging to each group.

FIG. 13 is a flowchart showing a search process and a display process in a case where the image information included in the same group is collectively displayed and the desired image information is selected in the image information group registration process according to the present invention.

FIG. 14 is a flowchart illustrating another example of a group registration process of image information applied to the captured image search device according to the present invention.

FIG. 15 is a conceptual diagram showing an example of calculating a distance and another example of search collation in image information search processing according to the present invention.

FIG. 16 is a flowchart showing search processing and display processing using an auto scroll display applied to the captured image search device according to the present invention.

FIG. 17 is a flowchart illustrating another specific example of the search processing and the display processing illustrated in FIG. 16;

FIG. 18 is a flowchart showing a specific example of a search condition setting process in a condition obtaining unit applied to the captured image search device according to the present invention.

FIG. 19 is a conceptual diagram showing still another example of a distance calculation example and search collation in image information search processing according to the present invention.

FIG. 20 is a flowchart showing still another example of image information search processing applied to the captured image search device according to the present invention.

FIG. 21 is a conceptual diagram showing an example of azimuth calculation and an example of search collation in image information search processing according to the present invention.

FIG. 22 is a flowchart illustrating an example of a change process of an image display method applied to the captured image search device according to the present invention.

FIG. 23 is a diagram showing a modified example of the image display method applied to the captured image search device according to the present invention.

FIG. 24 is a flowchart showing a specific example of image display processing and image selection processing applied to the captured image search device according to the present invention.

FIG. 25 is a diagram showing still another example of the image display processing applied to the captured image search device according to the present invention.

FIG. 26 is an external view showing an example of an electronic still camera with a GPS receiving function to which a photographed image search device and a photographed image search method according to the present invention are applied.

FIG. 27 is a block diagram illustrating an example of an electronic still camera with a GPS reception function according to the embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 image information acquisition means 2 positioning means 3 time measurement means 4 storage means 5 condition acquisition means 6 arithmetic means 7 search means 8 display control means 9 display means 10 control unit 11 key input means 17 GPS receiving unit (positioning means) 18 LCD ( Display means) 20 camera mechanism (imaging means) 27 memory (storage means) 28 key input section (selection means, condition acquisition means) 29 clock section 30 CPU (calculation means, search means, display control means) 100 positioning satellite

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 G06F 15/401 310Z H04N 5/91 J

Claims (26)

[Claims] 1. A photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information, a storage unit that stores a plurality of the photographed image information, and a storage unit that stores the photographed image information. Searching means for searching, from among the plurality of pieces of photographed image information, the photographed image information in which the distance between the photographing positions at which each of the photographed image information is acquired satisfies a predetermined condition. Image search device. 2. The image capturing apparatus according to claim 2, wherein the storage unit stores or manages the plurality of pieces of captured image information in a capturing order, and acquires each of the captured image information stored or managed adjacent to the storage unit. 2. The photographed image according to claim 1, further comprising a computing unit that computes a distance between the positions, wherein the search unit retrieves the photographed image information in which the distance computed by the computing unit satisfies a predetermined condition. Search device. 3. A calculation for calculating a distance between a shooting position at which one piece of said shot image information stored in said storage means is obtained and a plurality of shooting positions at which another plurality of said shot image information is obtained. 2. The photographed image search device according to claim 1, further comprising: a search unit that searches for the shot image information in which the distance calculated by the calculation unit satisfies a predetermined condition. 3. 4. The storage unit further stores shooting position information indicating a shooting position of the shooting image information in association with the shooting image information, wherein the shooting position information stored in the storage unit indicates Computing means for computing the distance between the photographing positions of the photographed image information, wherein said retrieval means retrieves said photographed image information in which the distance computed by said computing means satisfies a predetermined condition. 1. The photographed image search device according to 1. 5. The image capturing apparatus according to claim 1, wherein the storage unit further associates the image capturing information with the image capturing information such that a distance between an image capturing position of the image capturing information and another image capturing position of the image capturing information satisfies a predetermined condition. 2. The photographing apparatus according to claim 1, wherein identification information indicating that the information is image information is stored, and wherein the search unit searches the captured image information stored in the storage unit in association with the identification information. 3. Image search device. 6. The storage means further stores distance information indicating a distance between a shooting position of the shooting image information and a shooting position of another shooting image information in association with the shooting image information, 2. The photographed image search device according to claim 1, wherein the search unit searches for the photographed image information in which a distance indicated by the distance information stored in the storage unit satisfies a predetermined condition. 7. The photographed image search device according to claim 1, wherein the storage unit stores the photographed image information in which a distance between photographing positions of the photographed image information satisfies a predetermined condition as a same group. . 8. A photographing position acquiring unit for acquiring the photographing position information; a computing unit for computing a distance between the photographing positions indicated by the photographing position information acquired by the photographing position acquiring unit; A second search unit that searches for the captured image information whose calculated distance satisfies a predetermined condition, wherein the storage unit sets the captured image information searched by the second search unit as a same group. The photographed image search device according to claim 7, wherein the stored image is stored. 9. A second method for searching the plurality of pieces of photographed image information stored in the storage means for the photographed image information in which a distance between photographing positions at which the photographed image information is acquired satisfies a predetermined condition. The storage means stores or manages a plurality of pieces of photographed image information in the order of photographing, and is stored or managed by being sandwiched between the pieces of photographed image information searched by the second search means. The photographed image search device according to claim 7, wherein the photographed image information is stored as the same group. 10. A second method for searching, from a plurality of pieces of photographed image information stored in the storage unit, the photographed image information in which a distance between photographing positions at which the photographed image information is acquired is less than or equal to a predetermined distance. The photographed image search device according to claim 7, further comprising a search unit, wherein the storage unit stores the photographed image information searched by the second search unit as a same group. 11. The apparatus according to claim 7, wherein the search unit searches for the predetermined image information from the image information of each group stored in the storage unit. The photographed image search device described in the above. 12. The photographed image search device according to claim 7, wherein the search unit searches the photographed image information of the same group stored in the storage unit. 13. The photographed image search apparatus according to claim 12, further comprising a selection unit that selects desired photographed image information from the photographed image information of the same group searched by the search unit. 14. A selecting means for selecting desired photographed image information from the photographed image information searched by said searching means, and said searching means when the desired photographed image information is selected by said selecting means. 2. The photographed image search device according to claim 1, further comprising: a second search unit that searches for the photographed image information that has not been searched by the first search unit. 15. The photographed image according to claim 14, further comprising a second selection unit that selects desired photographed image information from the photographed image information searched by the second search unit. Search device. 16. A display means for displaying the photographed image information stored in the storage means, and the photographed image information retrieved by the retrieval means is displayed more than the other unretrieved photographed image information. 2. The photographed image search device according to claim 1, further comprising: display control means for causing the display means to display the image for a long time. 17. A display means for displaying the photographed image information stored in the storage means, and a notice for notifying that the photographed image information retrieved by the retrieval means is displayed on the display means. The photographed image search device according to claim 1, further comprising: means. 18. A display unit for displaying the photographed image information stored in the storage unit, and when displaying the photographed image information retrieved by the retrieval unit on the display unit, performing image processing. 2. The photographed image search device according to claim 1, further comprising: display control means for displaying. 19. The photographed image search device according to claim 1, wherein the predetermined condition is determined based on the photographed position at which the photographed image information stored in the storage unit is obtained. 20. A photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information, a storage unit that stores a plurality of the photographed image information, and a storage unit that stores the photographed image information. Searching means for searching the photographed image information, from among the plurality of photographed image information, in which the azimuths of the photographing positions at which each of the photographed image information is acquired satisfy a predetermined condition. Image search device. 21. An electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information, comprising: Imaging means for capturing an image of the subject; positioning means for measuring a shooting position of the image of the subject; calculating means for calculating a distance between the shooting positions measured by the positioning means; and the distance calculated by the calculating means. Searching means for searching for the photographed image information that satisfies a predetermined condition; storing the photographed image information obtained by imaging by the imaging means; and identifying information associated with the photographed image information searched for by the searching means. An electronic camera device, comprising: a storage unit that stores the information. 22. An electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information, comprising: Imaging means for capturing an image of the subject; positioning means for measuring a shooting position of the image of the subject; calculating means for calculating a distance between the shooting positions measured by the positioning means; and An electronic camera device comprising: a storage unit that stores captured image information and stores the distance calculated by the calculation unit in association with the captured image information. 23. An electronic camera device capable of outputting photographed image information to a photographed image search device that retrieves photographed image information satisfying a predetermined condition from a plurality of photographed image information, comprising: Imaging means for capturing an image of the subject; positioning means for measuring a shooting position of the image of the subject; calculating means for calculating a distance between the shooting positions measured by the positioning means; and a distance calculated by the calculating means. Searching means for searching for the captured image information satisfying a predetermined condition; storing the captured image information obtained by imaging by the imaging means; and storing the captured image information searched by the searching means as the same group An electronic camera device comprising: a storage unit. 24. A photographed image search method for retrieving photographed image information satisfying a predetermined condition from a plurality of photographed image information, the method comprising: storing a plurality of the photographed image information; A step of searching the photographed image information for the photographed image information in which a distance between photographing positions at which each of the photographed image information is acquired satisfies a predetermined condition. 25. A photographed image search method for searching photographed image information satisfying a predetermined condition from a plurality of photographed image information, the method comprising: A step of searching for the photographed image information in which a distance between the photographing positions at which each of the photographed image information is acquired satisfies a predetermined condition; and a step of displaying the searched photographed image information. How to search for captured images. 26. A photographed image search method for retrieving photographed image information satisfying a predetermined condition from a plurality of photographed image information, wherein the plurality of photographed image information stored in a memory is displayed on a display unit. A displaying step, wherein the distance between the photographing positions at which each of the photographed image information is acquired is searched for the photographed image information satisfying a predetermined condition, and when displayed on the display unit, a step of notifying the user of the search,
A photographed image search method comprising: