JP2003288363A - Information providing device and information providing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and quickly retrieve intended information. <P>SOLUTION: In an electronic picture book 1, a prescribed characteristic (size, color, shape or the like of a floor or leaf) is extracted from a taken image to be examined, and information for probable plants as the object of examination is retrieved and displayed based on the present position, the present time, and the extracted characteristic. According to a user's selection, detailed information related to a specified plant matter of these plants is displayed. Thus, the user can know what kind of plants the object of examination is only by taking the picture of the object of examination, and an examination for plants or the like can be performed without searching with a picture book of document. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing apparatus and an information providing method for providing information regarding a search target.

[0002]

2. Description of the Related Art In recent years, an information providing apparatus has been used which retrieves information related to a survey target such as a plant or an animal from information stored in a database and provides it to a user. The information providing device is also called an “electronic picture book” or the like, and generally, a recording medium storing various kinds of information is stored in a PC (Personal).
Computer) and the like, and a method of preliminarily storing various information in a storage device provided in a dedicated information processing device and searching the information in the storage device by the processing device. ing.

Here, as an example of such an electronic picture book,
The technique described in JP-A-8-190573 can be mentioned. Japanese Unexamined Patent Application Publication No. 8-190573 discloses a technique for searching for target information by recognizing a voice or an image. Further, as another example, Japanese Patent Laid-Open No. 8-
The technique described in Japanese Patent No. 63490 is cited. Japanese Patent Laid-Open No. 8-63490 discloses a technique for narrowing down information by inputting a distribution area of plants and animals.

[0004]

However, when searching for the target information by recognizing voice or images, it is difficult to search for accurate information with the current image and voice recognition technology, and it is difficult to narrow down the information. There is a problem that can not be done properly. In addition, if the distribution area of flora and fauna is input, the input becomes complicated and there is a problem that the target information cannot be retrieved unless a lot of other information is input.

Further, in the past, when searching a survey object with a picture book, the searcher often cannot search for appropriate information unless he or she has some knowledge about the study object. It was one of the problems. An object of the present invention is to easily and quickly search for desired information.

[0006]

In order to solve the above problems, the invention according to claim 1 stores predetermined information about a plurality of elements (for example, a plurality of plants to be investigated, a plurality of animals, etc.). An information providing apparatus including: an information storage unit that stores information, a search unit that searches the information storage unit for information to be searched, and an information providing unit that can provide the information searched by the search unit to a user. , A photographing means (for example, the CCD camera 12 in FIG. 1) for photographing a subject to be searched, and analyzing an image photographed by the photographing means,
Feature extraction means (for example, CPU 11 in FIG. 1) that extracts the characteristics of the subject, location information acquisition means (for example, the GPS function unit 14 in FIG. 1) that obtains information about the location where the subject was photographed, and the subject is photographed. Date and time information acquisition means (for example, the real-time clock unit 17 in FIG. 1) that acquires information related to the date and time that the information was stored,
Information about morphological characteristics of the element and information about temporal distribution (for example, habitat) or regional distribution (for example, habitat) of the element is stored, and the retrieval unit stores the characteristics of the extracted subject. From the information storage means based on whether or not the information on the morphological characteristics is matched and whether the information on the place or the information on the date and time is matched to the information on the temporal distribution or the regional distribution. The feature is that the information to be searched can be searched.

Here, "information on morphological characteristics",
The “information regarding temporal distribution or regional distribution” is stored in a form that can be compared with the features extracted by the feature extraction means, and includes, for example, quantified color, size, time, region, and the like. A second aspect of the present invention is the information providing apparatus according to the first aspect, wherein the information extracting means can extract, as the feature of the subject, a feature relating to the entire subject and a feature relating to a part of the subject. The information providing apparatus according to claim 1, wherein the information providing apparatus is provided.

The invention according to claim 3 is the information providing apparatus according to claim 2, wherein the information storage means stores information about the plant that is the element, and the feature extraction means,
As the characteristics of the subject, characteristics relating to the entire plant,
The feature is that the feature about the flower and the feature about the leaf can be extracted respectively.

The invention according to claim 4 is the information providing apparatus according to any one of claims 1 to 3, wherein the feature extracting means is capable of extracting features of the size, color or shape of the subject. It is characterized by being. The invention according to claim 5 is the information providing apparatus according to any one of claims 1 to 4, wherein the location information acquisition means is a GPS (Global).
Positioning System) is used to acquire the location of the device itself.

According to the sixth aspect of the present invention, information storage means for storing predetermined information about a plurality of elements, search means for searching the information storage means for information to be searched, and the search means are searched. An information providing method in an information providing apparatus including information providing means capable of providing information to a user, wherein the information storing means includes information on morphological characteristics of the element and temporal distribution or regional distribution of the element. Information about the subject is stored, a subject to be searched is photographed, the photographed image is analyzed to extract the feature of the subject, and the extracted feature of the subject matches the information on the morphological feature. Based on whether or not the information regarding the place or the date and time when the subject was photographed matches the information regarding the temporal distribution or the regional distribution. Is characterized by providing information to be retrieved from the storage means the search to the user.

According to a seventh aspect of the invention, there is provided the information providing method according to the sixth aspect, characterized in that, as the features of the subject, a feature relating to the whole subject and a feature relating to a part of the subject are extracted. There is. The invention according to claim 8 is the information providing method according to claim 7, wherein the information storage means stores information about the plant that is the element, and the feature about the whole plant as the feature of the subject, The feature is that the feature about the flower and the feature about the leaf are extracted.

According to a ninth aspect of the present invention, there is provided the information providing method according to any one of the sixth to eighth aspects, wherein the features of the subject such as size, color or shape are extracted. Is characterized by. The invention according to claim 10 is the information providing method according to any one of claims 6 to 9, characterized in that the location of the information providing device is acquired using GPS.

According to the present invention, predetermined features (size, color, shape of flower or leaf, etc.) are extracted from an image of a subject,
Based on the information about the place, the information about the time, and the extracted features, the information to be searched is displayed. Therefore, the user can know what the target is just by photographing the object to be searched, and can investigate the target without checking a picture book or the like of the document.

That is, when an object such as a plant is examined by a pictorial book of a document, it is difficult to accurately examine the object unless one has some knowledge. You can search for information. Therefore, it is possible to provide a useful information providing device, from children to old people, especially to users who have little knowledge about plants and users who are not good at operating machines.

Further, the current position, altitude, etc. are grasped by the GPS, or the current time is grasped by the date / time information providing means, etc., and then the retrieval is made in consideration of whether or not the target is suitable for these information. Therefore, the information to be searched becomes more appropriate as a target, and the search accuracy can be improved.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of an electronic picture book according to the present invention will be described in detail below with reference to the drawings. The electronic picture book according to the present invention is a type of information providing device, and is a device that provides a user with information stored in the device. Further, the electronic picture book according to the present invention is provided with an image pickup means, and by analyzing the photographed image of the survey target by a predetermined method and by referring to the predetermined information, information about the survey target can be quickly obtained. It is a searchable device.

First, the structure will be described. FIG. 1 is a block diagram showing a functional configuration of the electronic picture book 1. Also, in FIG.
It is a perspective view of the electronic picture book 1. In FIG. 1, electronic picture book 1
Is a CPU (Central Processing Unit) 11 and a CC
A D (Charge Coupled Diode) camera 12, a distance sensor 13, a GPS (Global Positioning System) function unit 14, a RAM (Random Access Memory) 15, a flash ROM (Read Only Memory) 16, and a real-time clock unit 17. , LCD 18 and touch panel 19
And a camera shutter unit 20 and a speaker 21.

The CPU 11 controls the entire electronic picture book 1 and reads out and executes programs for various processes stored in the flash ROM 16 in accordance with various instruction signals input from the touch panel 19. For example,
The CPU 11 recognizes an image when the CCD camera 12 takes an image, and the flash ROM 16
A recognition / retrieval processing program (described later) for retrieving target information from the information stored in is read and executed. Then, the CPU 11 causes the RAM 15 or the flash ROM to store the processing results of executing various programs or controls.
It is stored in a predetermined area of 16, is displayed on the LCD 18, or is output from the speaker 21.

The CCD camera 12 is equipped with a CCD sensor and photographs a subject in response to the depression of the camera shutter section 20 and converts it into digital image data. The distance sensor 13 has a function of measuring the distance to the subject using ultrasonic waves, infrared rays, or the like. Then, the distance sensor 13 performs the process of measuring the distance to the subject in response to the depression of the camera shutter unit 20, and outputs the data regarding the measured distance to the RAM 15 according to the instruction of the CPU 11.

The GPS function unit 14 has a function of receiving radio waves from GPS satellites and calculating the current position and altitude of the own device based on the radio waves. Then, the GPS function unit 14
In response to the depression of the camera shutter unit 20, the position and altitude of the electronic picture book 1 at that time are indexed, and the indexed position and altitude (hereinafter referred to as “position information”) are instructed by the CPU 11. According to the above, it outputs to the RAM 15.

The RAM 15 has a work area for temporarily storing various data generated by various processes such as recognition / retrieval process (described later) executed by the CPU 11. Further, the RAM 15 is a table (hereinafter, referred to as “evaluation result table”) that stores the result of the recognition / search processing.
Memorize FIG. 3 is a diagram showing an initialized evaluation result table, and FIG. 4 is a diagram showing a state in which the results of recognition / search processing are stored in the evaluation result table. In FIG. 4, the evaluation result table stores six pieces of data of the search target candidates searched as a result of the recognition / search processing. For each of the first to sixth candidates, a “serial number” to be described later is stored. , "Total error count", "plant information error count", "flower information error count", and "leaf information error count" are stored. In addition, in the evaluation result table,
You may store any number of candidates for the survey,
Here, the description will be made assuming that the six most likely objects to be surveyed are stored.

The flash ROM 16 is a non-volatile storage device, and stores a recognition / search processing program and programs related to various processings for controlling the electronic picture book 1. In addition, the flash ROM 16 stores a database (hereinafter, referred to as “plant database”) that stores various kinds of information regarding plants. FIG. 5 is a diagram showing an example of data stored in the plant database. Figure 5
In, the plant database is stored as a data group (hereinafter, referred to as “record”) including predetermined information for each type of plant, and each record includes “serial number” and “relative to the next record”. It includes “address”, “plant information”, “flower information”, “leaf information”, “plant photo”, and “plant description”.

Here, as shown in FIG. 6 (a), the "plant information" includes information on the habitat area, habitation altitude, habitation period, and size, and as shown in FIG. 6 (b). , "Flower information" includes flowering time (season), flowering time, flower color,
It contains information about flower size and flower shape. Further, as shown in FIG. 6C, the “leaf information” includes information about the leaf color, leaf size, and leaf shape.

Further, the same relative address is given in each record to each information included in the record of FIG. That is, the information specified by the address unique to each record is the "serial number", and the "relative address of the next record" in each record is "A".
1 "," A2 "for" plant information "," A3 "for" flower information "," A4 "for" leaf information "," photograph of plant "
“A5” is assigned to “A5” and “A6” is assigned to “Explanation of plants”. In other words, each record has the same data structure. For example, for a plurality of plants, "flower information"
When referring to "A" in the data of each record
It is only necessary to scan the data of the address of 3 ".

Note that the electronic picture book 1 can also retrieve information other than plants, and in this case, a flash ROM
16 stores a database corresponding to the information to be searched. Specifically, in addition to plants, it is possible to target animals, insects, fish and the like, and it is also possible to target artificial ones such as vehicles. At this time, other information such as a bark of an animal can be included in the database.

The real-time clock section 17 is provided with means for measuring the current time, and outputs the current time to the CPU 11. In addition, the real-time clock unit 17
Corresponds to the depression of the camera shutter unit 20 and the time at that time according to the instruction of the CPU 11 in the RAM 1
Output to 5. The LCD 18 displays various data such as a photographed surveyed object, various processing results such as information on the surveyed object, and a message to the user according to an instruction from the CPU 11.

The touch panel 19 is an input device to which information is input when the user touches it. In addition, the touch panel 19 uses the CPU 11, the RAM 15, or the flash ROM to store the information input by the contact of the user.
It is output to each functional unit such as 16. The touch panel 19
Is made of a transparent material, and is configured to transmit the information displayed on the LCD 18 which is provided on the lower side in an overlapping manner.

The camera shutter unit 20 sends a depression signal to the CP.
It is a switch that outputs to U11. Further, the pressing signal of the camera shutter unit 20 is output to the CCD camera 12, the distance sensor 13, the GPS function unit 14, the RAM 15, and the real-time clock unit 17, and each function unit performs a predetermined process in response to the input of the pressing signal. I do. The speaker 21 is
Based on the instruction signal of the CPU 11, the voice information regarding the survey target, the dial tone in various processes, and the like are output.

Next, the operation will be described. 7 and 8
4 is a flowchart showing a recognition / search process executed by the CPU 11. The recognition / search processing is executed when the electronic picture book 1 is powered on. In FIG. 7, when the recognition / search process is started, the CPU 11 causes the camera shutter unit 20 to
It is determined whether or not is pressed (step S1), and when it is determined that the camera shutter unit 20 is not pressed, step S1 is repeated.

When it is determined in step S1 that the camera shutter unit 20 is pressed down, the CPU 11 performs a process of photographing the subject to be investigated (step S1).
2) The distance sensor 13 measures the distance to the subject (step S3). Next, the CPU 11 measures the current position (latitude and lightness) by the GPS function unit 14 (step S4) and measures the altitude (step S).
5), the shooting date / time (month,
Day, hour, minute) are acquired (step S6).

Next, the CPU 11 initializes an evaluation object value which is a parameter for recognizing the investigation object (step S7). Here, the evaluation target value is represented by a binary code, for example, and is initialized to "000".
It is said that Each bit of the evaluation target value is a predetermined condition in the image of the subject (whether or not a flower region, which will be described later, is specified, whether or not a leaf region is specified, etc.)
Is shown.

Then, the CPU 11 specifies the flower area from the photographed image (step S8). In order to specify the flower region, for example, a method of performing edge detection, color discrimination, and the like on the captured image can be used. Subsequently, in step S8, the CPU 11 determines whether or not the flower area is specified from the photographed image (step S9). When it is determined that the flower area is not specified, the CPU 11 determines in step S13. Move to processing.

On the other hand, when it is determined in step S8 that the flower region is specified, the CPU 11 adds information for identifying the flower region to the evaluation target value (step S10). Here, in order to add information for identifying that the flower region is specified, a method of ORing (ORing) binary codes “000” and “010” which are evaluation target values is available. It is possible. As a result, the second bit of the evaluation target value indicating whether or not the flower region is specified becomes “1” indicating that the flower region is specified.

Next, the CPU 11 digitizes the flower color in the specified flower area (step S11). At this time, for example, the color of the flower can be digitized by representing the color information in the flower area by the values of R, G, and B of the RGB signal. Subsequently, the CPU 11 calculates the actual flower size based on the distance to the subject and the size of the flower region in the captured image (step S1).
2).

Next, the CPU 11 specifies one leaf area from the photographed image (step S13), and determines whether or not the leaf area is specified (step S1).
4). In step S14, from the captured image,
When it is determined that the area of one leaf is not specified, C
When the PU 11 proceeds to the processing of step S18 and determines that one leaf area is specified from the captured image, the CPU 11 identifies that the leaf area is specified with respect to the evaluation target value. Information to be added (step S1)
5). Here, in order to add information for identifying that the leaf area has been identified, the logical sum of the evaluation target value and the binary code “001” is obtained as in the case where the flower area is identified. Method is possible.

Next, the CPU 11 digitizes the color of the leaf in the specified leaf area (step S16), and then, based on the distance to the subject and the size of the leaf area in the photographed image. The actual leaf size is calculated (step S17). Then, the CPU 11 specifies the address "1" in the address in the plant database (hereinafter referred to as "plant data address") (step S18).

Next, the CPU 11 initializes the evaluation result table as shown in FIG. 3 (step S19),
Set "0" to the plant information error parameter (initialization)
Yes (step S20). In addition, in FIG. 3, “0x
7fff ”indicates that no data is stored. Then, the CPU 11 sets the plant information stored in the address“ A2 ”of the record of the address specified in the plant database to“ plant data ”. information"
(Step S21).

Next, the CPU 11 sets (initializes) "0" to the flower information error parameter (step S2).
2) Among the records of the addresses specified in the plant database, the flower information stored at the address "A3" is set as "flower information" (step S).
23). Next, the CPU 11 sets (initializes) "0" to the leaf information error parameter (step S24),
The leaf information stored in the address "A4" of the record of the address specified in the plant database is set as "leaf information" (step S2).
5).

Then, the CPU 11 compares the latitude / longitude of the present location with the habitat area of "plant information" to calculate a habitat error parameter (step S26). Here, the various error parameters are values indicating the degree of error between the survey target and the data in the plant database. For example, if it is a habitat error parameter, it is “0” if the current location is inside the habitat, and if the current location is outside the habitat, it is a value from “1” to “10” in proportion to the distance from the habitat. can do. If the parameter is a flower color error parameter, “0” to “1” is calculated based on the difference between the RGB signal values.
Values up to 0 "can be set.

Returning to FIG. 7, the CPU 11 adds a plant information error parameter and a habitat error parameter,
The result is used as a plant information error parameter (step S27). Next, the CPU 11 calculates the altitude of the current location,
The habitation altitude error parameter is calculated by comparing with the habitation altitude of "plant information" (step S28).

Then, the CPU 11 adds the plant information error parameter and the habitation altitude error parameter, and sets the result as the plant information error parameter (step S).
29). Next, the CPU 11 compares the shooting date with the habitation period of the “plant information” and calculates the habitation period error parameter (step S30).

Then, the CPU 11 adds the plant information error parameter and the habitat error parameter and sets the result as the plant information error parameter (step S).
31). Next, moving to FIG. 8, the CPU 11 determines whether the logical product (AND) of the evaluation target value and “010” is “0” (step S32), and determines that the logical product is not “0”. If so, the process proceeds to step S44.
Here, the logical product of the evaluation target value and "010" being "0" means that the flower region is not specified in step S9 and the evaluation target value indicating that the flower region is specified is It means that 2 bits are "0". Therefore, it is possible to determine whether or not the flower region is the evaluation target by the determination in step S32.

On the other hand, when it is determined in step S32 that the logical product (AND) of the evaluation target value and "010" is "0", the CPU 11 determines the shooting date and "flower information".
And the flowering time error parameter is calculated (step S33). Then, the CPU 11 adds the flower information error parameter and the flowering time error parameter, and sets the result as the flower information error parameter (step S34).

Next, the CPU 11 compares the photographing time with the flowering time of "flower information" to calculate a flowering time error parameter (step S35). And the CPU 11
Adds a flower information error parameter and a flowering time error parameter, and sets the result as a flower information error parameter (step S36).

Next, the CPU 11 compares the digitized flower color of the subject with the flower color of the "flower information" to calculate a flower color error parameter (step S37). Then, the CPU 11 adds the flower information error parameter and the flower color error parameter, and sets the result as the flower information error parameter (step S38). Next, CPU
11 compares the flower size of the subject with the flower size of the "flower information" to calculate a flower size error parameter (step S39).

Then, the CPU 11 adds the flower information error parameter and the flower size error parameter and sets the result as the flower information error parameter (step S).
40). Subsequently, the CPU 11 extracts the flower shape from the flower area of the captured image (step S41), compares the extracted flower shape with the flower shape of the "flower information",
Calculate the flower shape error parameter (step S4)
2).

Then, the CPU 11 adds the flower information error parameter and the flower shape error parameter and sets the result as the flower information error parameter (step S4).
3). Next, the CPU 11 sets the evaluation target value and “001”.
If it is determined that the logical product (AND) with and becomes "0" (step S44), and it becomes "0",
Then, the process proceeds to step S61.

On the other hand, when it is determined in step S44 that the logical product (AND) of the evaluation target value and "001" is "0", the CPU 11 determines the digitized leaf color of the subject and "leaf The leaf color error parameter is calculated by comparing with the leaf color of "information" (step S45). And
The CPU 11 adds the leaf information error parameter and the leaf color error parameter, and sets the result as the leaf information error parameter (step S46).

Next, the CPU 11 compares the leaf size of the subject with the leaf size of the "leaf information" to calculate a leaf size error parameter (step S47). Then, the CPU 11 adds the leaf information error parameter and the leaf size error parameter, and sets the result as the leaf information error parameter (step S48).

Subsequently, the CPU 11 extracts the leaf shape from the leaf area of the photographed image (step S49), and compares the extracted leaf shape with the leaf information "leaf information". , Calculate leaf shape error parameters (step S
50). Then, the CPU 11 adds the leaf information error parameter and the leaf shape error parameter, and sets the result as the leaf shape error parameter (step S5).
1).

Next, the CPU 11 adds the plant information error parameter, the flower information error parameter, and the leaf information error parameter to calculate the total number of errors (step S52). Then, the CPU 11 updates the evaluation result table (step S53). That is, CPU
11 performs a process of rearranging the records in the evaluation result table in ascending order of the total number of errors (hereinafter referred to as "evaluation result table update process").

Next, the CPU 11 updates the address in the plant database to the next record (the record indicated by the next relative address) (step S54). Then, the CPU 11 indicates that the address of the next record (next relative address) is the last address "-1".
If it is determined that the address of the next record is not “−1” (step S55), the relative address of the next record is added to the current address in the plant database to add a new plant. As an address in the database (step S56), step S20
Process shifts to.

On the other hand, if it is determined in step S55 that the address of the next record is not "-1", CP
U11 displays the photos of the first to sixth candidates stored in the evaluation result table (step S57), and proceeds to the process of step S1. Next, the CPU 11 performs step S
The evaluation result table update processing executed in 53 will be described.

The evaluation result table update processing program is
This subroutine is called during the execution of the recognition / retrieval process, and is a process of rearranging the records (one row) of the evaluation result table in order of decreasing total error count. FIG. 9 is a flowchart showing the evaluation result table updating process. In FIG. 9, “x” and “y” represent the order of records in the evaluation result table.

In FIG. 9, first, the CPU 11
"1" is substituted for "x", and the first stored record of the evaluation result table (currently the candidate record with the smallest error) is set as the comparison target (step S10).
1). Next, the CPU 11 compares the total number of errors in the record of the current address in the plant data table with the total number of errors in the x-th record of the evaluation result table (step S102), and in the record of the current address. If it is determined that the total number of errors is not smaller than the total number of errors in the x-th record, the process proceeds to step S108. Here, since the record of the current address is a candidate that is less likely to be investigated than the xth record, the storage address of the xth record is maintained, and the record of the current address is evaluated. In the result table,
It should be stored at a lower address.

On the other hand, when the CPU 11 determines that the total number of errors in the record of the current address is smaller than the total number of errors in the xth record, the CPU 11 outputs "y".
“6” is substituted into and the sixth record stored in the evaluation result table is set as the comparison target (step S
103). Next, the CPU 11 determines whether or not “y” is equal to “x” (step S104), and when it is determined that “y” is not equal to “x”, the evaluation target table stores the current address. Since it is necessary to add a record and change the order, the CPU 11 lowers the (y-1) th record to the yth record (step S1).
05).

The CPU 11 then replaces "y" with "y-
1 "(change the comparison target to a candidate with a higher possibility as a research target) (step S106), and then step S1
The processing moves to 04. On the other hand, when it is determined in step S104 that “y” is equal to “x”, the CPU 1
1 stores the record of the current address as the x-th candidate record (step S107), and returns to the main flow of the recognition / search process.

When it is determined in step S102 that the total number of errors in the record of the current address is not smaller than the total number of errors in the xth record, the CPU 11 changes "x" to "x + 1" ( Change the comparison target to a candidate with a lower possibility as a survey target (step S108), and then "x" is "6"
It is determined whether or not it is larger (step S10).
9).

When it is determined in step S109 that "x" is not greater than "6", the CPU 11 proceeds to the process of step S102, while "x" is "6".
When it is determined that it is larger, the process returns to the main flow of the recognition / search process. As a result of the recognition / retrieval process and the evaluation result table updating process as described above, the evaluation result table stores the first to sixth candidate records that are highly likely to be investigated.

Then, in the recognition / retrieval process, these candidates are displayed on the LCD 18. FIG. 10 is a diagram showing a state in which images of these first to sixth candidate flowers are displayed. In FIG. 10, the image of each flower is displayed so that the user can select it, and the user selects the image that is considered to be the most appropriate as the survey target from these. Then, as shown in FIG. 11, detailed information of the flower corresponding to the image is displayed on the LCD 18.

When the user determines that the selected candidate is not the survey target, the user can return to the screen displaying the first to sixth candidates and select another candidate. As described above, the electronic pictorial book 1 to which the present invention is applied extracts predetermined characteristics (size, color, shape of flower or leaf, etc.) from the photographed image of the survey target, and calculates the current position, current time, etc. ,
Based on the extracted features, information on plants that are likely to be surveyed is retrieved and displayed. Then, according to the user's selection, detailed information regarding a specific plant is displayed from among these.

Therefore, the user can know what kind of plant the survey target is just by photographing the survey target, and can survey the plant etc. without checking the pictorial book or the like of the document. . That is, when examining plants etc. with a picture book of a document, it is difficult to accurately investigate the survey target unless you have some knowledge,
It is extremely easy and quick to retrieve information about a target survey object. Therefore, it is possible to provide a useful electronic picture book from children to elderly people, especially to users who have little knowledge about plants and users who are not good at operating machines.

Further, the current position, the altitude, etc. are grasped by the GPS, or the current time is grasped by the real-time clock unit 17, and then a search is made in consideration of whether or not the survey object is suitable for these information. Therefore, the candidates provided by the search become more appropriate as the survey target, and the search accuracy can be improved. In addition,
In the present invention, when the survey target is searched and the survey target is determined by the user, the photographed image of the survey target may be added (and replaced) to the plant database.

In this case, as the electronic picture book 1 is used,
The information stored in the plant database will be abundant, and, for example, even for the same plant, the number of images of the sample plant will increase. Therefore, it is possible to more appropriately search the candidates in the process of searching the survey target.

[0065]

According to the present invention, a predetermined feature (size, color, shape, etc. of a flower or leaf) is extracted from an image of a subject, and information about a place, information about time, and the extracted feature are extracted. Based on this, the information to be searched is displayed.
Therefore, the user can know what the target is just by photographing the object to be searched, and can investigate the target without checking a picture book or the like of the document.

That is, when an object such as a plant is examined by a pictorial book of a document, it is difficult to accurately inspect the object unless one has some knowledge. You can search for information. Therefore, it is possible to provide a useful information providing device, from children to old people, especially to users who have little knowledge about plants and users who are not good at operating machines.

In addition, the current position, altitude, etc. are grasped by the GPS, or the current time is grasped by the date and time information providing means, etc., and the retrieval is made considering whether or not the target is suitable for these information. Therefore, the information to be searched becomes more appropriate as a target, and the search accuracy can be improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a functional configuration of an electronic picture book 1.

FIG. 2 is a perspective view of an electronic picture book 1.

FIG. 3 is a diagram showing an initialized evaluation result table.

FIG. 4 is a diagram showing a state in which a result of recognition / search processing is stored in an evaluation result table.

FIG. 5 is a diagram showing an example of data stored in a plant database.

[Fig. 6] "Plant information", "Flower information", "Leaf information"
It is a figure which shows the content of.

FIG. 7 is a flowchart (part 1) showing a recognition / search process executed by the CPU 11.

FIG. 8 is a flowchart (part 2) showing a recognition / search process executed by the CPU 11.

FIG. 9 is a flowchart showing an evaluation result table updating process.

FIG. 10 is a diagram showing a state in which images of first to sixth candidate flowers are displayed.

FIG. 11 is a diagram showing a state in which detailed information of a specific flower is displayed on LCD 18.

[Explanation of symbols]

1 Electronic picture book 11 CPU 12 CCD camera 13 Distance sensor 14 GPS function section 15 RAM 16 Flash ROM 17 Real-time clock section 18 LCD 19 touch panel 20 Camera shutter part 21 speakers

Claims (10)

[Claims] 1. An information storage unit for storing predetermined information about a plurality of elements, a search unit for searching the information storage unit for information to be searched, and a user provided with the information searched by the search unit. An information providing device including a possible information providing means, a photographing means for photographing a subject to be searched, a feature extracting means for analyzing an image photographed by the photographing means and extracting a characteristic of the subject, The information storage unit includes a location information acquisition unit that acquires information about a place where the subject is photographed, and a date and time information acquisition unit that acquires information about a date and time when the subject is photographed. Information and information on temporal distribution or regional distribution of the elements are stored, and the retrieval means relates to the extracted morphological characteristics of the subject. Based on whether or not the information is suitable and whether or not the information on the place or the information on the date and time is suitable for the information on the temporal distribution or the regional distribution, the information to be searched is retrieved from the information storage means. An information providing device characterized by being searchable. 2. The information providing apparatus according to claim 1, wherein the information extracting means can extract, as the features of the subject, a feature relating to the whole subject and a feature relating to a part of the subject. 3. The information storage means stores information about the plant, which is the element, and the feature extraction means includes, as the features of the subject, features relating to the entire plant, features relating to flowers, and features relating to leaves. The information providing apparatus according to claim 2, wherein each of the information can be extracted. 4. The feature extracting means includes a size of a subject,
The information providing apparatus according to any one of claims 1 to 3, wherein a feature about a color or a shape can be extracted. 5. The location information acquisition means acquires the location of the own device using GPS.
4. The information providing device according to any one of 4 above. 6. An information providing method in an information providing apparatus, comprising: an information storage means for storing predetermined information about a plurality of elements; and a search means for searching information to be searched from the information storage means, The information storage means stores information on the morphological characteristics of the element and information on the temporal distribution or regional distribution of the element, photographs the subject to be searched, analyzes the photographed image, and analyzes the photographed image. Whether or not the extracted features of the subject match the information on the morphological features,
Information about the place where the subject was shot or the date and time
An information providing method comprising: searching for information to be searched from the information storage means and providing the information to the user based on whether or not the information about the temporal distribution or the regional distribution is met. 7. The information providing method according to claim 6, wherein the features of the entire subject and the features of the portion of the subject are extracted as the features of the subject. 8. The information storage means stores information about a plant that is the element, and extracts, as the features of the subject, a feature about the whole plant, a feature about a flower, and a feature about a leaf, respectively. Claim 7 characterized by
How to provide the described information. 9. The information providing method according to claim 6, wherein a feature about a size, a color, or a shape of the subject is extracted as the feature of the subject. 10. The information providing method according to claim 6, wherein the location of the information providing device is acquired using GPS.