JP2002259389A - Electronic album retrieving system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To classify or retrieve a large number of images by using names of places and the names of sightseeing spots or facilities as keywords. SOLUTION: When an image and the position of the photographing spot of the image are inputted, a position keyword corresponding to this position is read out of a map database 31 and such an image is stored in an image database 33 corresponding to the position keyword. When retrieving the image, the image corresponding to the inputted position keyword is read out of the image database 33. As such a position keyword, a name of a place, which can be specified from the position of that spot, or name of a sightseeing spot or facility is desirable.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an electronic album search system for storing, managing, and browsing a large number of images.

[0002]

2. Description of the Related Art As is well known, in a personal computer, a large number of images can be stored and managed, and these images can be selectively displayed on a display screen or printed out. Further, with the spread of digital cameras and the like, an image file system is often constructed on a personal computer. Normally, an image file is handled in the same row as a file such as a text file, and an image file is searched based on a file name, file date and time, and the like.

[0003]

However, when classifying a large number of images photographed by a camera or the like, one method is to classify by a place name of a photographing site, a sightseeing spot or a facility name. There was no system to do this.

On the other hand, in the system described in Japanese Patent Application Laid-Open No. 2000-65588, an image is stored and managed in association with a photographing position, and when searching for an image, a map in which the photographing position of the image is entered is displayed. When this position is designated, the image corresponding to this position is read out and displayed.

However, in this conventional system, it is necessary to indicate a position on a map, and it is not possible to search for an image using, for example, a place name, a sightseeing spot or a facility name as a keyword.

Accordingly, the present invention has been made in view of the above-mentioned conventional problems, and has been made in view of the above-mentioned problems. An electronic device capable of classifying and retrieving a large number of images by using a place name, a sightseeing spot or a facility name as a keyword. An object of the present invention is to provide an album search system.

[0007]

In order to solve the above problems, the present invention provides a map database in which a plurality of location keywords are stored in association with the location of each point, and a plurality of images corresponding to each location keyword. When a search database and an image database, which are attached and stored, and an image and a position of a point where the image is captured are input, a position keyword corresponding to this position is read from the map database, and a keyword corresponding to each image ID is searched for in the search database. Image management means for storing images assigned with respective IDs in an image database, and image search means for reading an image corresponding to the position keyword from the image database using a search database when a position keyword is input. ing.

According to the present invention having such a configuration, when an image and a position of a photographing point of the image are input, a position keyword corresponding to the position is read from the map database,
The keyword corresponding to each image ID is stored in the search database, and the image given each ID is stored in the image database. And when searching for images,
The image corresponding to the input position keyword is read from the image database using the search database.
As the position keyword, a place name that can be specified from the position of the point, a name of a sightseeing spot or a facility, and the like are good. For example, when the name of the amusement park is stored in the map database in association with the position of the amusement park, when the image and the position of the amusement park are input, the image is associated with the name of the amusement park. When the name of the amusement park is stored in the search database as a keyword corresponding to the ID and the name of the amusement park is input, the image corresponding to this name is read from the image database using the search database. In addition, a plurality of position keywords are set to 1
The image at this position may be stored in association with each position keyword, and the image may be read out regardless of the input of any of the position keywords.

In the present invention, the image management means assigns a keyword corresponding to each image ID to a search database in association with a position keyword, an image capturing date and time, and an arbitrary keyword. The obtained image is stored in the image database, and the image search means reads out the image corresponding to at least one of the position keyword, the image capturing date and time, and the arbitrary keyword from the image database using the search database.

As described above, in addition to the position keyword, the keyword corresponding to each image ID is associated with the photographing date and time of the image and an arbitrary keyword in the search database, and the image assigned each ID is stored in the image database. , It is possible to search for an image corresponding to one or some of the position keyword, the photographing date and time of the image, and an arbitrary keyword, and various searches can be performed.

Further, the present invention further comprises display means for writing the position of the photographing point and the number of images photographed at the position on a map, and displaying the map.

With such a display, the photographing location and the number of photographed images can be known on the map.

Further, in the present invention, the image processing apparatus further comprises a photographing means for detecting a position of a photographing point when photographing an image, and storing the image in association with the position. The position is input from the photographing means.

As described above, at the time of photographing an image, the position of the photographing point is detected, the image is associated with the position, and the image,
If the location of the shooting location is transferred from the shooting unit to the image management unit, the management of the image and the location of the shooting location becomes easy.

[0015]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a search apparatus main body 11 to which an embodiment of an electronic album search system according to the present invention is applied. FIG. 2 shows the search device main body 11 of FIG.
It is a block diagram showing a digital camera connected to,
This digital camera 21 is also included in the system of the present embodiment.

A digital camera 21 shown in FIG. 2 captures an image of a landscape or the like and outputs image data representing the image.
And a GPS (Global Positioning System) for detecting the position (latitude and longitude) of the point where the digital camera 21 is located at the time of photographing by the photographing unit 22, that is, the position of the photographing point.
The digital camera 21 includes a receiving unit 23, an image memory 24 that stores an image and a position of a shooting point in association with each other, and a control unit 25 that controls the digital camera 21.

The photographing unit 22 includes a CCD image sensor, a lens for projecting an image on the CCD image sensor, and the like, processes an output signal of the CCD image sensor, and outputs image data representing the image. The control unit 25 instructs the GPS receiving unit 23 to detect a position at the time of photographing by the photographing unit 22. In response, the GPS receiving unit 23 receives radio waves from a geostationary satellite and detects the position (latitude and longitude) of the shooting location. The control unit 25 has a built-in clock counter that measures the date and time, and stores image data indicating an image captured by the image capturing unit 22 in the image memory 24 in association with the location of the image capturing point and the image capturing date and time. The image memory 24 is a recording medium such as a magnetic disk and can be removed from the digital camera 21.

1 includes a memory reading unit 12, an input operation unit 13 such as a keyboard and a mouse, a display unit 14 for displaying images, a printer unit 15 for recording images on recording paper, Storage unit 16 for storing various data
, An image data search unit 17, a display image synthesis unit 18,
And a search data generation unit 19.

The storage unit 16 stores a map database 31,
A search database 32 and an image database 33 are stored. The map database 31 includes map data 31a and position data 31b as shown in FIG. The map data 31a includes image data indicating a world map, image data indicating a Japan map, respective image data indicating respective regions in Japan, and the like. The position data 31b is obtained by associating the names of ranges (shown using latitude and longitude) of each area, tourist spot, facility, etc., for example, the range of Tokyo with the name “Tokyo”, and the name of Shinagawa-ku. Scope and name "Shinagawa-ku", Tokyo ○
○ The range of the land and the name “Tokyo XX Land” are associated with each other. As shown in FIG. 4, the search database 32 stores the position of the photographing point, the photographing date and time, the position keyword, an arbitrary keyword, and the ID number of the image data indicating the image photographed at the photographing point and the photographing date and time in association with each other. ing. The image database 33 stores a large number of image data in association with their ID numbers, as shown in FIG.

The image memory 2 of the digital camera 21 will now be described.
4 is detached from the camera 21 and the search device body 1
1 is mounted on the memory reading unit 12. At this time, the search device main body 11 follows the flowchart shown in FIG.
Each image data from the image memory 24, the position of each shooting point,
And each shooting date and time are read and stored and managed.

First, when the image memory 24 removed from the digital camera 21 is mounted, the memory reading section 12 reads out each image data, the position of each photographing point, and each photographing date and time from the image memory 24, and Search data generation unit 1 retrieves image data, the position of each shooting point, and each shooting date and time.
9 (step S101).

The search data generation unit 19 generates each image data,
When the position of each photographing point and each photographing date and time are received, each image data is given a respective ID number. In addition, the search data generation unit 19 searches for at least one range including the position of the shooting point from the position data 31b of the map database 31 for each position of each shooting point, and reads the name of this range from the position data 31b. , The name of this range is set as the position keyword of the shooting location. For example, the range of Chiba Prefecture and the range of Tokyo XX Land including the position of the shooting point are searched, and the names of these ranges, "Chiba Prefecture" and "Tokyo XX Land", are set as position keywords.
Then, the search data generation unit 19 outputs, for each image data,
The position of the shooting point, the shooting date and time, at least one position keyword, and the ID number of the image data are stored in the search database 32 in association with each other (step S102).

The search data generator 19 stores each image data in the image database 33 in association with each ID number.

Next, the display image synthesizing section 18 selects the first ID number from each ID number, and selects the first ID number.
The image data corresponding to the D number is read from the image database 33, the shooting date and time and the position keyword corresponding to the first ID number are read from the search database 32, and the image indicated by the image data, the shooting date and at least one Display position keyword 14
At the same time, and an entry field for an arbitrary keyword is displayed on the display screen. For example, on the display screen, FIG.
Page 41 is displayed as shown in
A position keyword 42 consisting of a municipal name and a sightseeing place name is displayed, a shooting date and time 43 is displayed, and an entry field 44 for an arbitrary keyword is displayed. Further, on the display screen, an operation button 45 for instructing display of the next image, an operation button 46 for instructing display of the immediately preceding image, and the like are displayed.

Here, by operating the input operation unit 13, the cursor is moved to an arbitrary keyword entry field 44 on the display screen.
And enter an arbitrary keyword in the entry field 44, and the search data generation unit 19 outputs the ID of the image on the display screen.
The arbitrary keyword is stored in the search database 32 in association with the number (step S103). For example,
When you enter “Graduation trip” in the entry box 44,
Is stored as an arbitrary keyword (step S10).
3). Of course, a plurality of arbitrary keywords may be entered and stored, or an arbitrary keyword may not be entered.

Thereafter, when the operation button 45 for instructing the display of the next image is clicked by operating the input operation unit 13, the display image synthesizing unit 18 selects the second ID number, and selects the second ID number. Is read from the image database 33, and the shooting date and time and the position keyword corresponding to the second ID number are read from the search database 32, and at least one of the image indicated by the image data, the shooting date and time, The entry fields for the position keyword and any keyword are displayed on the display screen of the display unit 14. Then, when an arbitrary keyword is entered in the entry field, the search data generator 19 stores the arbitrary keyword in the search database 32 in association with the ID number of the image on the display screen.

Similarly, when the operation button 45 for instructing the display of the next image is clicked, entry fields for the next image, date and time of photographing, position keyword, and any keyword are displayed on the display screen. Keywords can be set.

When the operation button 46 for instructing the display of the previous image is clicked, a column for inputting the previous image, the photographing date and time, a position keyword, and an arbitrary keyword is displayed on the display screen. The keyword can be corrected or deleted (step S04).

After storing and managing a large number of images in this manner, a desired image can be browsed by appropriately selecting or instructing a position keyword, a shooting date and time, and an arbitrary keyword. The processing for browsing this image will be described with reference to the flowchart shown in FIG.

First, by operating the input operation unit 13, either the world map or the Japan map is selected, and an image search is instructed. For example, when a map of Japan is selected, the image data search unit 17 outputs the map data 3 in the map database 31.
Image data indicating a map of Japan is read from 1a. Also,
The image data search unit 17 determines the range of prefectures for each prefecture in Japan by using the position data 31b of the map database 31.
From the search database 32, the number of image data corresponding to the positions of these shooting points, that is, the number of image data shot in the range of the prefectures. Search number 3 database
Find from 2. Then, the image data search unit 17 provides the display image synthesizing unit 18 with the image data indicating the map of Japan and the number of image data obtained for each prefecture (step S201).

The display image synthesizing unit 18 writes the number of image data obtained for each prefecture at the position of each prefecture on the Japan map. For example, as shown in FIG. 9, a mark 51 is entered at the position of Chiba Prefecture on the Japan map, and the size of the mark 51 is adjusted according to the number of image data shot in the range of Chiba Prefecture. Similarly, if other prefectures have image data captured in the prefectures, the mark 51 is entered at the position of the prefecture, and the size of the mark 51 is adjusted according to the number of image data. . Then, the display image synthesizing unit 18 displays the map of Japan with the mark 51 entered on the display screen of the display unit 14 (Step S202).

The display image synthesizing unit 18 also includes a selection field 52 for selecting whether to make the size of the mark proportional to or inversely proportional to the number of each image data, as well as the map of Japan, and to enter the shooting date and time and a keyword. A column 53 is displayed on the display screen of the display unit 14.

Further, when the mark 51 of, for example, Chiba prefecture is clicked by operating the input operation unit 13, the image data search unit 17 reads out the map of Chiba prefecture from the map data 31a of the map database 31 in response to this. Further, the image data search unit 17 separates the range of each municipality in Chiba Prefecture by
The range is read from the position data 31b of the map database 31, and the positions of all the shooting points that fall within the range are searched from the search database 32, and the number of image data corresponding to the positions of these shooting points, that is, the range The number of captured image data is obtained from the search database 32. Then, the image data search unit 17 provides the display image synthesizing unit 18 with the map of Chiba Prefecture and the number of each image data obtained for each municipal area. The display image synthesizing unit 18 displays the position of each municipality on the map of Chiba Prefecture as shown in FIG.
A mark 51 of a size corresponding to the number of each image data is entered, and this map is displayed on the display screen of the display unit 14 (step S203).

The display screen also displays a selection field 52 for selecting whether the size of the mark is to be proportional to or inversely proportional to the number of each image data, and a field 53 for inputting a shooting date and time and a keyword.

Further, one mark 51 may be clicked on the map of Chiba prefecture by operating the input operation unit 13. In this case, a map in a range where the mark 51 is entered is searched from the map data 31a of the map database 31, and the range is searched for in the position data 31 of the map database 31.
b, the positions of all shooting points that fall within the range are searched from the search database 32, and the number of pieces of image data corresponding to the positions of these shooting points is obtained from the search database 32. Then, a mark 51 of a size corresponding to the number of each image data is entered at the position of each photographing point on the map in this range, and this map is displayed on the display screen of the display unit 14. For example, on a map of Chiba Prefecture,
When the municipal mark 51 of the land is clicked, a map of Tokyo OO Land as shown in FIG. 11 is displayed on the display screen of the display unit 14.

Here, in any of the display screens shown in FIGS. 9, 10 and 11, when the portion "proportional" is clicked in the selection field 52 by operating the input operation unit 13, the display image synthesizing unit 18 , The larger the number of pieces of image data photographed in the range where the mark 51 is
To increase. As a result, a range in which the number of each image data is large can be easily found. Conversely, when the part "inversely proportional" is clicked in the selection field 52, the display image synthesizing section 18 enlarges the mark 51 as the number of pieces of image data shot in the range where the mark 51 is written is smaller.
Thereby, even if the number of each image data is small, the range can be easily found.

Next, for example, on the display screen of FIG.
By operating the input operation unit 13, the cursor is moved to the “date and time” or “keyword” part of the entry column 53, and any one of the photographing date and time, the position keyword, and any keyword is input. Click on the “search start” part. For example, if a part of "search start" is clicked after inputting the position keyword, in response to this, the image data search unit 17 is shot at the position of the shooting point within the range of Chiba Prefecture and input. The ID number of the image data corresponding to the position keyword is searched from the search database 32. In other words, the ID of each image data taken in Chiba Prefecture
From the numbers, the ID number of each image data to which the input position keyword is assigned is narrowed down and searched, and the ID number of each narrowed down searched image data is given to the display image synthesizing unit 18 (step S204).

The display image synthesizing section 18 reads out the respective image data corresponding to each ID number from the image database 33 and displays each image indicated by the image data on the display screen of the display section 14. For example, a plurality of images 55 are arranged and displayed on the display screen of the display unit 14 as shown in FIG. Each image 55 may have a coarse pixel density. In this state, when one of the images 55 is selected by operating the input operation unit 13, the display image combining unit 18 is selected.
Displays the selected image 55 on an enlarged scale,
The position keyword and any keyword are also displayed (step S205).

In step S204, a plurality of items are selected from the photographing date and time, the position keyword, and an arbitrary keyword, and each item is entered in the entry column 53. May be clicked. In this case, all of the entered items are I
It is possible to search for image data registered in association with the D number, or to search for image data in which any of the items is registered in association with the ID number.

On the display screen shown in FIG. 10, if no entry is made in the entry field 53 and the "search start" portion in the entry field 53 is clicked, all the image data shot in the Chiba prefecture range will be displayed. The images are retrieved from the image database 33, and the images indicated by the image data are arranged and displayed on the display screen of the display unit 14.

Similarly, in the display screens shown in FIGS. 9 and 11, after the photographing date and time, the position keyword, and any keyword are entered in the entry column 53, or without entering anything in the entry column 53, the "search" Clicking on the “start” part causes the image data corresponding to the search condition to be stored in the image database 33.
, And the images indicated by the respective image data are arranged and displayed on the display screen of the display unit 14. If all of the searched images cannot be displayed on the display screen of the display unit 14, each image is displayed on a plurality of display screens.

The present invention is not limited to the above embodiment, but can be variously modified. For example,
Not only a digital camera but also a still camera may be applied. In the case of a still camera, the position of each photographing point is stored in a recording medium in correspondence with each image of the film, each image of the film is read by a scanner, and the position of each photographing point is read from the recording medium.

[0044]

As described above, according to the present invention, when an image and a position of a photographing point of the image are input, a position keyword corresponding to the position is read from the map database, and a keyword corresponding to each image ID is read. Are stored in the search database, and the images assigned with the respective IDs are stored in the image database. When searching for an image, an image corresponding to the input position keyword is read from the image database using the search database. As the position keyword, a place name that can be specified from the position of the point, a name of a sightseeing spot or a facility, and the like are good.
For example, when the name of the amusement park is stored in the map database in association with the position of the amusement park, when the image and the position of the amusement park are input, the image is associated with the name of the amusement park, respectively. The keyword corresponding to the image ID is stored in the search database, the image assigned with each ID is stored in the image database, and when the name of the amusement park is input, the image corresponding to this name is retrieved from the image database using the search database. Is read.

Further, according to the present invention, not only the position keyword but also the date and time of photographing of the image and an arbitrary keyword, a keyword corresponding to each image ID is assigned to the search database with each ID. Images stored in the image database, it is possible to search for an image corresponding to one or some of the position keyword, the shooting date and time of the image, and an arbitrary keyword, and various searches can be performed. .

Further, according to the present invention, the position of the photographing point and the number of images photographed at the position are entered on the map, and this map is displayed. With such a display, the photographing location and the number of photographed images can be known on the map.

According to the present invention, upon photographing an image, the position of the photographing point is detected, the image is associated with the position, and the image and the position of the photographing point are transferred from the photographing means to the image management means. Since the delivery is performed, the management of the position of the image and the photographing point becomes easy.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a main body of a search device to which an embodiment of an electronic album search system according to the present invention is applied.

FIG. 2 is a block diagram showing a digital camera connected to the search device main body of FIG. 1;

FIG. 3 is a diagram showing a concept of a map database in a storage unit in the main body of the search device in FIG. 1;

FIG. 4 is a diagram showing a concept of a search database in a storage unit in the search device body of FIG. 1;

FIG. 5 is a diagram showing a concept of an image database in a storage unit in the main body of the search device in FIG. 1;

FIG. 6 is a flowchart showing processing for storing and managing image data by the main body of the search apparatus in FIG. 1;

FIG. 7 is a diagram showing a page for confirming an image displayed on a display unit in the main body of the search device in FIG. 1;

8 is a flowchart showing a process for searching for image data by the main body of the search device in FIG. 1;

9 is a diagram showing a map of Japan displayed on a display unit in the main body of the search device in FIG. 1;

FIG. 10 is a diagram showing a map of Chiba Prefecture displayed on a display unit of the search device main body of FIG. 1;

11 is a diagram showing a map of Tokyo OO Land displayed on a display unit of the main body of the search device in FIG. 1;

FIG. 12 is a diagram showing a plurality of images displayed on a display unit in the main body of the search device in FIG. 1;

[Explanation of symbols]

 Reference Signs List 11 search device main body 12 memory reading unit 13 input operation unit 14 display unit 15 printer unit 16 storage unit 17 image data search unit 18 display image synthesis unit 19 search data generation unit 21 digital camera 22 shooting unit 23 GPS reception unit 24 image memory 25 Control unit

Claims (4)

[Claims] 1. A map database in which a plurality of location keywords are stored in association with the location of each point, and a plurality of images are associated with each location keyword,
When a search database storing keywords corresponding to respective image IDs, an image database storing images assigned with the respective IDs, an image, and a position of a point where the image is captured are input,
Image management means for reading a position keyword corresponding to this position from the map database, storing the image in the image search database in association with the position keyword, and inputting the position keyword causes the image corresponding to the position keyword to be stored in the search database. An electronic album search system, comprising: an image search unit that reads out from an image database by using the image search unit. 2. The image management means associates a keyword corresponding to each image ID with a search keyword in association with a position keyword, a photographing date and time of an image, and an arbitrary keyword, and stores an image assigned with each ID into an image. 2. The image retrieval device according to claim 1, wherein the image retrieval means reads out an image corresponding to at least one of a position keyword, a photographing date and time of the image, and an arbitrary keyword from the image database using the retrieval database. Electronic album search system described in 1. 3. The electronic device according to claim 1, further comprising a display unit for writing a position of a photographing point and the number of images photographed at the position on a map, and displaying the map. Album search system. 4. A photographing means for detecting a position of a photographing point when photographing an image, and storing the image in association with the position, wherein the image management means stores the image and the position of the photographing point from the photographing means. The electronic album search system according to claim 1, wherein the electronic album search is input.