JP2005108027A - Method and program for providing object information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method and a program for providing object information that can specify an object by performing efficient high-precision retrieval. <P>SOLUTION: A mobile telephone terminal 10 transmits image information including photographic condition information of a photographed flower F to an information providing system 20. A managing computer 21 of the information providing system 20 acquires area information and weather information according to the photographic condition information and calculates the actual size of the flower F according to the image information. The managing computer 21 collates the obtained area information and weather information, data regarding the calculated actual size of the flower F, and property information of plant information stored in a plant information storage part 25 to extract corresponding plant information. Further, the managing computer 21 collates image information of the extracted plant information and image information received from the mobile telephone terminal 10 to extract the most matching plant information. The managing computer 21 transmits the extracted plant information to the mobile telephone terminal 10. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a subject information providing method and a subject information providing program for providing information about a photographed subject.

  Today, with the widespread use of mobile phone terminals with cameras, it has become possible to easily take and send pictures. By using such a camera-equipped mobile phone terminal, the user can easily take pictures of animals or plants of interest when he / she sees them. If you don't know the names of animals and plants, you can check them later with a pictorial book using the images taken. In this case, it is convenient if the names of the animals and plants can be easily checked at the shooting site.

In view of this, a technique is disclosed in which the names of animals and plants can be examined based on captured images of animals and plants and recorded calls (see, for example, Patent Document 1).
In Patent Document 1, a mobile phone terminal transmits captured image data and recorded audio data to a pictorial book server. The pictorial book server searches the pictorial book dictionary based on the received data, and acquires information on the corresponding object. Then, the pictorial book server transmits the acquired information to the mobile phone terminal.
JP 2003-44497 A (2nd to 3rd pages)

  However, it may be difficult to accurately identify the subject only with the received image data and audio data. Therefore, in order to improve the search accuracy for specifying the subject, there may be a method in which the user inputs auxiliary information such as the situation at the time of shooting. However, such auxiliary information is complicated for the user.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a subject information providing method and a subject information providing program capable of specifying a subject by performing an efficient and more accurate search.

  In order to solve the above-mentioned problems, the invention described in claim 1 includes a picture book data storage means for recording picture book data in which item attribute information and item image data are associated, a management computer connectable to a user terminal, A subject information providing method for providing information about a subject, wherein the management computer specifies subject image data obtained by photographing the subject based on a request from the user terminal; Extracting the photographing condition data at the time of photographing from the subject image data, calculating subject information from the photographing condition data, an information collating step for collating the subject information with the attribute information, and the subject image data Image collation stage for collating the item image data, and results of the information collation stage and the image collation stage Based on, and summarized in that includes a subject identifying step of identifying the item of the object, and a transmission step of transmitting data about an item identified in the subject identifying step to the user terminal.

According to a second aspect of the present invention, in the subject information providing method according to the first aspect, the photographing condition data includes data on a photographing distance to the subject and a focal length at the time of photographing, and the obtaining step includes: A calculation step of calculating an actual size of the subject from the length of the subject of the image based on the shooting distance and the focal length, and the information matching step includes the size of the subject calculated in the calculation step The gist of the present invention is to include collation of information regarding length and the attribute information.

  According to a third aspect of the present invention, in the subject information providing method according to the first or second aspect, the shooting condition data includes data relating to a shooting time, and the information collating step includes the step of identifying the subject at the shooting time. The gist is to include collating information with the attribute information.

  According to a fourth aspect of the present invention, in the subject information providing method according to any one of the first to third aspects, the photographing condition data includes data relating to a direction when the subject is photographed, and the acquisition is performed. The step includes a calculation step of calculating a direction of the subject from data relating to a direction when the subject is photographed, and the information matching step includes information on the direction of the subject calculated in the calculation step, the attribute information, Including the verification.

  According to a fifth aspect of the present invention, in the subject information providing method according to any one of the second to fourth aspects, the shooting condition data includes data related to a shooting location, and the obtaining step includes the shooting location. The information on the location of the subject is calculated from the data on the subject, and the information collation step includes collating information on the location of the subject and the attribute information.

  A sixth aspect of the present invention is the subject information providing method according to any one of the first to fifth aspects, wherein the photographing condition data includes data relating to a photographing time and a photographing place, and the obtaining step includes: The gist of the present invention is that weather information is acquired based on data relating to the photographing time and the photographing location, and the information collation step includes collating the weather information with the attribute information.

  According to the seventh aspect of the present invention, provision of information about a subject is provided by using a picture book data storage unit that records picture book data in which item attribute information and item image data are associated with each other, and a management computer that can be connected to a user terminal. A subject information providing program for performing subject image data identification means for identifying subject image data obtained by photographing a subject based on a request from the user terminal, and photographing at the time of photographing from the subject image data. Extracting condition data, obtaining means for calculating subject information from the photographing condition data, information matching means for matching the subject information and the attribute information, image matching for matching the subject image data and the item image data On the basis of the results of the means, the information collating means and the image collating means. Object specifying means for specifying the beam, and the gist of the case in which the data relating to the item identified as transmission means for transmitting to the user terminal in the subject identifying means.

  According to an eighth aspect of the present invention, in the subject information providing program according to the seventh aspect, the shooting condition data includes data relating to a shooting distance to the subject and a focal length at the time of shooting. A calculation unit that calculates an actual size of the subject from the length of the subject of the image based on the shooting distance and the focal length, and the information collating unit calculates the size of the subject calculated by the calculation unit; The gist of the present invention is to include collation of information regarding length and the attribute information.

  According to a ninth aspect of the present invention, in the subject information providing program according to the seventh or eighth aspect, the shooting condition data includes data relating to a shooting time, and the information collating unit is configured to detect the subject at the shooting time. The gist is to include collating information with the attribute information.

  According to a tenth aspect of the present invention, in the subject information providing program according to any one of the seventh to ninth aspects, the photographing condition data includes data relating to a direction when the subject is photographed, and the acquisition is performed. The means includes calculation means for calculating the orientation of the subject from data relating to a direction when the subject is photographed, and the information matching means includes information on the orientation of the subject calculated by the calculation means, the attribute information, Including the verification.

  According to an eleventh aspect of the present invention, in the subject information providing program according to any one of the eighth to tenth aspects, the shooting condition data includes data relating to a shooting location, and the acquisition unit includes the shooting location. The information on the location of the subject is calculated from the data on the subject, and the information collating unit includes collating information on the location of the subject and the attribute information.

  The invention according to claim 12 is the subject information providing program according to any one of claims 7 to 11, wherein the photographing condition data includes data relating to a photographing time and a photographing place, and the acquisition unit includes: The gist is that weather information is acquired based on data relating to the shooting time and the shooting location, and the information checking means includes checking the weather information and the attribute information.

(Function)
According to the first or seventh aspect of the invention, the management computer acquires subject information related to the subject from the shooting condition information included in the subject image data, and collates the subject information with the attribute information. Then, the management computer specifies an object corresponding to the subject based on the collation result between the subject information and the attribute information and the collation result between the image information of the subject image data and the image information of the picture book data. For this reason, the management computer narrows down the subject based on the information acquired from the photographing condition information of the image data, and thus can accurately specify the subject without imposing a burden of input on the user.

  According to the second or eighth aspect of the invention, the management computer calculates the actual size of the subject from the length of the subject of the image based on the shooting distance and the focal length. For this reason, the management computer can specify the subject while referring to the actual size of the subject, so that the subject can be specified with high accuracy.

  According to the invention described in claim 3 or 9, the management computer collates the information related to the photographing time with the attribute information. For this reason, since the management computer can obtain time information when the subject is photographed, the subject can be identified while referring to this information.

  According to the fourth or tenth aspect of the present invention, the management computer can calculate the orientation of the photographed subject and identify the subject while referring to information on the orientation of the subject.

  According to the fifth or eleventh aspect of the invention, the management computer uses the subject based on the comparison between the shooting location and the attribute information and the comparison between the subject information calculated from the other shooting condition data and the attribute information. Can be specified.

  According to the invention described in claim 6 or 12, the management computer can acquire the weather information from the information regarding the shooting time and the shooting location, and can specify the subject from the weather information.

  ADVANTAGE OF THE INVENTION According to this invention, the information regarding a to-be-photographed object can be efficiently provided with a high precision with respect to a user.

  Hereinafter, an embodiment embodying the present invention will be described with reference to FIGS. In this embodiment, a subject specifying information providing method for providing information for specifying a plant photographed as a subject will be described.

  As shown in FIG. 1, in this embodiment, a mobile phone terminal 10 is used as a user terminal. The cellular phone terminal 10 includes an image pickup mechanism, and generates image data obtained by photographing the subject using the image pickup mechanism. Further, the cellular phone terminal 10 of the present embodiment can adjust the focal length and shooting distance of the imaging mechanism.

  The cellular phone terminal 10 includes a display unit 101, and displays an image to be photographed on the display unit 101 or displays received data. The mobile phone terminal 10 includes a plurality of dial number buttons 102 and function buttons 103. By using the dial number button 102, various data can be input. The function button 103 has a pointer movement function and a click function. The pointer can be moved by giving a direction instruction using the function button 103, and the item indicated by the pointer can be selected by pressing the function button 103. Furthermore, the mobile phone terminal 10 has a built-in gyro that measures the orientation (azimuth) and horizontal angle when the image is taken. In addition, the mobile phone terminal 10 has a GPS (Global Positioning System) function for specifying the position (longitude and latitude) of the mobile phone terminal 10.

  The mobile phone terminal 10 is connected to the information providing system 20 via the mobile phone network N connected to the base station 15. The mobile phone terminal 10 can send and receive data to and from the information providing system 20 via the mobile phone network N by sending and receiving data to and from the base station 15.

  On the other hand, the information providing system 20 includes a management computer 21. The management computer 21 includes a CPU, a RAM, a ROM, and the like (not shown), and performs later-described processing (subject image data identification stage, acquisition stage including calculation stage, information collation stage, image collation stage, subject identification stage, transmission stage, etc. Process). Then, by executing the subject information providing program for this purpose, the management computer 21 functions as subject image data identification means, acquisition means including calculation means, information collation means, image collation means, subject identification means, transmission means, and the like. To do.

  The management computer 21 of the information providing system 20 is connected to a user information storage unit 22, a regional information storage unit 23, a weather information storage unit 24, a plant information storage unit 25 as a pictorial book data storage unit, and a search condition information storage unit 26. Has been.

  As shown in FIG. 2, the user information storage unit 22 records user information 220 regarding users who receive the service. This user information 220 is recorded when the user performs user registration for receiving this service. In addition, the user information 220 includes data relating to a user identifier, a user name, a terminal identifier, a password, and a contact address.

Data relating to an identifier for identifying a user is recorded in the user identifier data area.
Data related to the user's name is recorded in the user name data area.

  In the terminal identifier data area, data relating to a terminal identifier for specifying the user's mobile phone terminal 10 is recorded. In the present embodiment, the mobile phone number or mail address of the mobile phone terminal 10 is used as the terminal identifier.

  Data related to the user's password is recorded in the password data area. This password is used to authenticate the user when the user uses the information providing system 20.

In the contact data area, data related to the user's contact information is recorded. In the present embodiment, the user's address is used as the contact address.
As shown in FIG. 3, the area information storage unit 23 stores area information 230 regarding the area. The area information 230 is registered before the service is provided, for example, based on data acquired from a map company site or the like. The area information 230 includes data on latitude, longitude, area, and classification code.

In the latitude data area, data relating to latitude for specifying the area data and the classification code data is recorded.
In the longitude data area, data relating to longitude for specifying area data and classification code data is recorded.

In the area data area, data related to an area specified based on latitude and longitude is recorded. Specifically, it is a subdivided area in a narrow area such as Minato Ward in Tokyo.
In the classification code data area, a classification code used for searching for data relating to plant habitat is recorded. This classification data is data based on classification such as a coniferous forest zone at an altitude of about 2000 m.

  As shown in FIG. 4, weather information 240 relating to observed weather is recorded in the weather information storage unit 24. This weather information 240 is acquired and recorded from a weather information site (not shown). The weather information 240 includes data related to date / time, region, weather, and temperature.

In the date / time data area, data relating to date / time (year / month / day and hour / minute) for specifying weather data is recorded.
In the area data area, data relating to an area for specifying weather data is recorded. The area information 230 and the weather information 240 are associated with each other through the data recorded in the area data area.

In the weather data area, data related to the weather specified based on the date / time data and the area data is recorded. Specifically, the data recorded in the weather data area includes “light rain”, “sunny”, “sunny”, and the like.
As the data stored in the temperature data area, data related to the temperature determined based on the date data and the area data is recorded.

  As shown in FIG. 5, plant information 250 relating to various plants is recorded in the plant information storage unit 25. The plant information 250 is recorded until the information providing system 20 provides a service for information on a known plant, and information on a new plant is stored in the plant information storage unit 25 after the ecology of the plant is revealed. To be recorded. The plant information 250 includes data on plant names, habitat distributions, features, flowering conditions, flower images, and feature amounts. In the present embodiment, the plant name, habitat distribution, characteristics, and flowering conditions of the plant information 250 correspond to item attribute information, and the flower image of the plant information 250 corresponds to item image data.

In the plant name data area, data relating to the normal name, common name, scientific name, and the like of the plant is recorded.
In the habitat distribution data area, data on the habitat of plants is recorded. The area information 230 and the plant information 250 are associated with each other through the data recorded in the data area.

In the feature data area, data related to plant features is recorded. For example, the size of a flower, the shape of a leaf, the presence or absence of a sting, and the like.
In the flowering condition data area, data relating to conditions when the plant blooms is recorded. This condition is “temperature 25 ° C. or higher”, “daytime”, or the like.

In the flower image data area, plant flower image data is recorded.
In the feature amount data area, data relating to the feature amount of the image of the flower image data is recorded. The feature amount of the image of the flower image data includes the values of the respective items relating to the shape and color of the flower in the image.

  As shown in FIG. 6, the search condition information storage unit 26 records search condition information 260 related to the search conditions used for specifying the subject. Each item of the search condition information 260 is recorded when the management computer 21 acquires each search condition. The search condition information 260 includes data related to images, shooting conditions, feature amounts, season / time, region, weather, orientation, and subject size. In the present embodiment, data relating to season / time, region, weather, orientation, and subject size corresponds to subject information.

In the image data area, data relating to image information including a subject to be searched is recorded.
In the shooting condition data area, data (shooting condition data) related to shooting condition information attached to the image data is recorded.

  In the feature amount data area, data relating to the feature amount of the image recorded in the image data area is recorded. This feature amount is configured to include the values of items relating to the shape, pattern and color of the subject in the image.

In the season / time data area, data relating to the season and time when the image was taken is recorded.
In the area data area, data relating to the area where the image is taken is recorded.

In the weather data area, data related to the weather in which the image is taken is recorded. In the present embodiment, the weather recorded in this data area is specifically weather and temperature.
In the azimuth data area, data relating to the direction in which the image was taken is recorded.
Data relating to the actual size of the photographed subject is recorded in the subject size data area.

  Next, the processing procedure of the subject specifying information providing method in the information providing system 20 will be described with reference to FIGS. Here, as shown in FIG. 1, a case where a flower F found by the user is photographed using the mobile phone terminal 10 and the name of the flower is examined will be described.

First, the user photographs a flower whose name is to be examined. Specifically, the user operates the function button 103 of the mobile phone terminal 10 to display the flower F as the subject at the center of the display unit 101 using the imaging mechanism. At this time, the mobile phone terminal 10 focuses on the flower F that is the subject. Then, the user operates the function button 103 to photograph the flower F. Thereby, the mobile phone terminal 10 generates and records image data regarding the photographed flower F.

  At this time, the image data recorded on the mobile phone terminal 10 can use, for example, an Exif format in addition to a normal image recording format such as JPEG or TIFF. Here, the Exif format is an image recording format of a digital camera, and shooting condition information and the like are recorded in a predetermined format as Exif tag information. In the present embodiment, it is assumed that image data in Exif format is transmitted as will be described later. In the present embodiment, the shooting condition information specifically includes the set number of pixels, focal length, shooting distance, gyro value of the mobile phone terminal 10, shooting date and time, and shooting position (latitude and longitude of the mobile phone terminal 10). ) Etc.

  Next, as shown in FIG. 7, the user operates the dial number button 102 and the function button 103 of the mobile phone terminal 10 to access the information providing system 20 (step S1-1). Specifically, when the mobile phone terminal 10 is connected to the information providing system 20, it receives a password transmission request from the information providing system 20. In response to this, the mobile phone terminal 10 displays an input screen on the display unit 101 and prompts the user to input a password. When the password input is completed and the transmission button is selected, the mobile phone terminal 10 transmits the input password data to the information providing system 20. At this time, the mobile phone terminal 10 also transmits data related to the terminal identifier of the mobile phone terminal 10 together with the password data.

  Next, the management computer 21 of the information providing system 20 performs user authentication (step S1-2). Specifically, the management computer 21 extracts user information 220 corresponding to the received terminal identifier from the user information storage unit 22. Then, the management computer 21 collates the password of the extracted user information 220 with the received password. As a result of the collation, if the two match, the management computer 21 completes the user authentication. If the two do not match, the management computer 21 notifies the mobile phone terminal 10 to that effect and stops the processing.

After the user authentication is completed, the information providing system 20 requests the mobile phone terminal 10 to transmit search target image data (step S1-3).
Therefore, the mobile phone terminal 10 performs processing for transmitting captured image data (step S1-4). Here, the user takes a picture using the imaging mechanism of the mobile phone terminal 10, calls and transmits the image data of the flower F recorded in the mobile phone terminal 10. In the present embodiment, it is assumed that image data to be transmitted includes shooting condition information.

  The management computer 21 of the information providing system 20 registers the received image data (step S1-5). Specifically, the management computer 21 extracts data relating to image information from the received image data and records it in the image data area of the search condition information storage unit 26. In addition, the management computer 21 extracts data relating to shooting condition information from the received image data, and records it in the shooting condition data area of the search condition information storage unit 26.

  Next, the management computer 21 extracts the feature amount of the image information of the registered image data (step S1-6). Specifically, the management computer 21 specifies a flower that is a subject from the color distribution of the image based on the image information in the search condition information storage unit 26 and its feature amount. That is, the management computer 21 extracts the outline and color of the flower in the image. Furthermore, the size of the flower on the image is specified from the contour and color of the image.

Then, the management computer 21 registers the extracted feature amount of the image in the feature amount data area of the search condition information storage unit 26 (step S1-7).
Next, the management computer 21 determines whether or not the received image data includes shooting condition information (step S1-8).

  Here, when the image data received from the mobile phone terminal 10 includes shooting condition information (in the case of “YES” in step S1-8), subject information registration processing is performed (step S1-9). .

In this subject information registration processing, the management computer 21 performs processing according to the processing procedure shown in FIG.
First, the management computer 21 acquires and records data relating to the season and time taken (step S2-1). Specifically, the management computer 21 first extracts the date / time data that has been taken from the shooting condition information included in the image data. Then, the management computer 21 specifies the season and time corresponding to this date / time data, and records them in the season / time data area of the search condition information storage unit 26.

  Next, the management computer 21 determines whether or not position information is included in the shooting condition information (step S2-2). At this time, if position information is included in the shooting condition information (“YES” in step S2-2), the management computer 21 acquires and records area information based on the position information (step S2-2). S2-3). Specifically, the management computer 21 acquires area data corresponding to the position information and classification data from the area information storage unit 23.

  Furthermore, the management computer 21 acquires and records weather information (step S2-4). Specifically, the management computer 21 extracts the corresponding weather information 240 from the weather information storage unit 24 based on the regional data acquired in step S2-3 and the date / time data extracted from the shooting information information. As a result, the management computer 21 obtains data relating to the weather and temperature when the image data is taken. Then, the management computer 21 records the acquired data on the climate and temperature in the weather data area of the search condition information storage unit 26. Note that if the shooting condition information does not include position information (“NO” in step S2-2), the management computer 21 does not execute steps S2-3 to S2-4.

  Next, the management computer 21 acquires and records the direction information (step S2-5). Specifically, the management computer 21 first extracts a gyro value from the shooting condition information of the image data. Then, the management computer 21 calculates an orientation corresponding to the extracted gyro value. Then, the management computer 21 records the calculated direction information in the direction data area of the search condition information storage unit 26. At this time, the angle with respect to the horizontal plane is calculated together with the direction of east, west, south, and north.

Next, the management computer 21 performs subject size calculation processing (step S2-6). This subject size calculation process will be described with reference to FIG.
First, the management computer 21 calculates a focal plane scale (step S3-1). Specifically, the management computer 21 extracts the shooting distance and the focal length from the shooting condition information of the image data. Then, the management computer 21 calculates a focal plane scale in the shooting range from the focal length, the shooting distance, and the shooting angle. Next, the management computer 21 calculates the subject size (step S3-2). Specifically, the management computer 21 uses the contrast adjustment and color gamut of the image in the search condition information 260 to determine the actual subject from the size of the subject on the image and the focal plane scale calculated in step S3-1. Calculate the size.

Here, as shown in FIG. 1, the management computer 21 calculates the diameter R of the actual flower F using the focal plane scale when the diameter “G” of the “flower” on the screen is set. The calculated subject size is recorded in the subject size of the search condition information storage unit 26. In this way, the management computer 21 obtains information regarding the diameter of the flower F of the photographed subject in the subject size calculation process.

When the subject size calculation process ends (step S2-6), the management computer 21 ends the subject information registration process and returns to the processing procedure shown in FIG. 7 (step S1-9).
Next, the management computer 21 performs information collation processing (step S1-10). Specifically, the management computer 21 records a plant corresponding to this information in the plant information storage unit 25 based on the information registered in the search condition information storage unit 26 in the subject information registration process of step S1-9. It searches from the plant information 250 which is done. In the present embodiment, the management computer 21 extracts corresponding plant information 250 from the plant information storage unit 25 based on information regarding the season and time of flowering, the direction, and the diameter R of the flower F. In addition, when there is position information in the photographing condition information, the management computer 21 extracts plant information 250 including the regional data acquired in step S2-3 in the habitat distribution from the extracted plant information 250. Furthermore, the management computer 21 extracts the plant information 250 corresponding to the weather information acquired in step S2-4.

  If the image data received from the mobile phone terminal 10 does not include shooting condition information (in the case of “NO” in step S1-8), the management computer 21 performs steps S1-9 to S1-10. Do not execute.

  Next, the management computer 21 performs image collation processing (step S1-11). Specifically, the management computer 21 compares the feature amount of the flower image of the plant information 250 extracted as applicable in the information matching process in step S1-10 with the feature amount of the image received from the mobile phone terminal 10. To do. As a result of this comparison, the management computer 21 identifies a plant having the highest image similarity. At this time, the plant is specified based on the contour and color distribution of the plant in the image. Then, the management computer 21 that has identified the plant acquires information about the plant from the plant information 250 of the identified plant.

  Next, the management computer 21 transmits the identified plant information to the mobile phone terminal 10 (step S1-12). At this time, the information transmitted by the management computer 21 includes information such as the plant name, characteristics, and flowering conditions of the plant.

  Then, the mobile phone terminal 10 that has received the information displays the specified plant information on the display unit 101 of the mobile phone terminal 10 (step S1-13). Thereby, the user can acquire the information regarding the flower F seen in the valley of a rock.

As described above, according to the present embodiment, the following effects can be obtained.
-In this embodiment, the management computer 21 extracts the plant information 250 applicable to the information regarding the season and time of flowering, the direction, and the diameter of the flower F acquired from the imaging condition information. Furthermore, the management computer 21 acquires the most similar plant information 250 from the extracted plant information 250 based on the feature amount of the image received from the mobile phone terminal 10. That is, the management computer 21 specifies the plant information 250 related to the subject from both the image received from the mobile phone terminal 10 and the information related to the subject obtained from the shooting conditions. Therefore, the management computer 21 can provide information corresponding to the subject in the image received from the mobile phone terminal 10 to the user with higher accuracy.

In addition, since the management computer 21 acquires information about the subject from the shooting condition information included in the image data, the search accuracy can be improved without imposing a data input burden on the user.

  In the present embodiment, the management computer 21 calculates a focal plane scale from the focal length and the photographing distance included in the photographing condition information, and from this focal plane scale and the diameter G in the image of the flower F, the actual computer The diameter R of the flower F is calculated. For this reason, the flower F can be specified while referring to the size of the flower F.

  -In this embodiment, the management computer 21 acquires the data of the season and time when the flower F was image | photographed from the information regarding the imaging | photography time contained in imaging | photography condition information. The season and time of flowering vary depending on the plant. Therefore, the management computer 21 can identify the flower F based on the season and time data that has been taken.

  In the present embodiment, the management computer 21 calculates the direction in which the subject is photographed based on the gyro value included in the photographing condition information. The flowering direction (orientation) varies depending on the plant. For example, the sunflower blooms in the direction of the sun. Therefore, the management computer 21 can identify the flower F based on the calculated orientation information.

  In the present embodiment, when the shooting condition information includes position information (“YES” in step S2-2), the management computer 21 acquires area information based on the position information. Record (step S2-3). Specifically, the management computer 21 acquires area data corresponding to the position information and classification data from the area information storage unit 23. Then, the management computer 21 performs information collation processing (step S1-10). Specifically, the management computer 21 extracts from the plant information 250 the plant information 250 that includes the regional data acquired in step S2-3 in the habitat distribution. Since plants have different habitat areas, the flower F can be identified while referring to information on the location where the image is taken, that is, the area where the plants inhabit.

  In the present embodiment, the management computer 21 acquires weather information from information regarding shooting conditions and shooting locations included in the shooting condition information. Plants may have different flowering states depending on weather conditions. For this reason, the management computer 21 can identify the flower F while referring to the weather information.

In addition, you may change the said embodiment as follows.
In the above embodiment, the diameter R of the flower F is calculated. Instead of this, the size of the plant may be specified. For example, the type of plant may be specified by referring to information related to the shooting time included in the shooting condition information. Plants vary in height depending on the season. For this reason, the management computer 21 can specify the type of the subject based on the photographed season and time data as well as the size of the subject.

  In the above embodiment, the management computer 21 receives image data including a subject to be searched from the mobile phone terminal 10. Alternatively, the image to be searched may be recorded in a predetermined server in advance, and the image including the subject to be searched may be received by receiving the designation of the image data to be searched from the mobile phone terminal 10. .

  In the above embodiment, the management computer receives image data from the mobile phone terminal 10. The transmission destination of the image data is not limited to this. For example, image data captured by a digital camera may be transmitted using a personal computer.

In the above embodiment, the case where the plant that is the subject is specified has been described. The target of the subject is not limited to this, and may be other items such as animals, minerals, celestial bodies, and vehicles. For example, in the case of a rising fish, the name can be specified from its size and season. In the case of minerals, the name can be specified from the area where the mineral was photographed or the photographed image.

  In the above embodiment, the management computer 21 transmits the plant information 250 regarding the identified flower F to the mobile phone terminal 10. Not limited to this, the management computer 21 may transmit only a part of the plant information 250, for example, a name.

  In the above embodiment, the mobile phone terminal 10 acquires position information using the GPS function. The acquisition of the position information may not be limited to this. For example, when the mobile phone terminal 10 is a PHS terminal (Personal Handyphone System), the position information of the base station is acquired, the position information of the base station is converted into longitude and latitude, and the position information is converted into the shooting conditions. Data may be recorded in the subject image data.

  In the above embodiment, the mobile phone terminal 10 with a built-in gyro and a GPS function is used. However, the present invention is not limited to this, and even a mobile phone terminal that does not have a built-in gyroscope or GPS function may be searched using information about the subject acquired from other shooting condition data. As a result, the subject can be accurately identified.

1 is a schematic diagram of a system in the present embodiment. Explanatory drawing of the data recorded on the user information storage part. Explanatory drawing of the data recorded on the area information storage part. Explanatory drawing of the data recorded on the weather information storage part. Explanatory drawing of the data recorded on the plant information storage part. Explanatory drawing of the data recorded on the search condition information storage part. The flowchart for demonstrating the process sequence of the whole process of this embodiment. 6 is a flowchart for explaining a processing procedure of subject information registration processing of the present embodiment. 6 is a flowchart for explaining a processing procedure of subject size calculation processing according to the present embodiment.

Explanation of symbols

  F ... Flowers as a subject, 10 ... Mobile phone terminal as a user terminal, 21 ... Management computer, 25 ... Plant information storage unit as pictorial book data storage means.

Claims (12)

A subject information providing method for providing information about a subject using a pictorial book data storage unit that records pictorial book data in which item attribute information and item image data are associated, and a management computer connectable to a user terminal. ,
The management computer is
A subject image data specifying step for specifying subject image data obtained by photographing a subject based on a request from the user terminal;
Extracting shooting condition data at the time of shooting from the subject image data and obtaining subject information from the shooting condition data; and
An information matching step of matching the subject information and the attribute information;
An image matching step for matching the subject image data with the item image data;
A subject identifying step for identifying an item of the subject based on the results of the information matching step and the image matching step;
And a transmission step of transmitting data relating to the item identified in the subject identification step to the user terminal. The shooting condition data includes data on the shooting distance to the subject and the focal length at the time of shooting,
The obtaining step includes a calculation step of calculating the actual size of the subject from the length of the subject of the image based on the shooting distance and the focal length,
The subject information providing method according to claim 1, wherein the information collation step includes collating information regarding the size of the subject calculated in the calculation step and the attribute information. The shooting condition data includes data related to shooting time,
The subject information providing method according to claim 1, wherein the information collating step includes collating information on the subject at the photographing time with the attribute information. The shooting condition data includes data relating to the direction when shooting the subject,
The obtaining step includes a calculating step of calculating an orientation of the subject from data relating to a direction when the subject is photographed.
The subject information according to any one of claims 1 to 3, wherein the information collation step includes collating information regarding the orientation of the subject calculated in the calculation step and the attribute information. How to provide. The shooting condition data includes data regarding the shooting location,
The obtaining step calculates information on the location of the subject from data on the shooting location,
5. The subject information providing method according to claim 2, wherein the information collating step includes collating information on the location of the subject with the attribute information. The shooting condition data includes data related to shooting time and shooting location,
In the obtaining step, weather information is obtained based on data relating to the photographing time and the photographing location,
The subject information providing method according to claim 1, wherein the information collating step includes collating the weather information with the attribute information. A subject information providing program for providing information about a subject using a pictorial book data storage unit that records pictorial book data in which item attribute information and item image data are associated with each other and a management computer connectable to a user terminal. ,
The management computer,
Subject image data specifying means for specifying subject image data obtained by photographing a subject based on a request from the user terminal;
Acquisition means for extracting shooting condition data at the time of shooting from the subject image data and calculating subject information from the shooting condition data;
Information collating means for collating the subject information and the attribute information;
Image collating means for collating the subject image data and the item image data;
Based on the results of the information collating unit and the image collating unit, a subject specifying unit that specifies the item of the subject, and a transmission unit that transmits data related to the item specified by the subject specifying unit to the user terminal. Subject information providing program characterized by this. The shooting condition data includes data on the shooting distance to the subject and the focal length at the time of shooting,
The acquisition means includes calculation means for calculating the actual size of the subject from the length of the subject of the image based on the shooting distance and the focal length,
8. The subject information providing program according to claim 7, wherein the information collating unit includes collating information regarding the size of the subject calculated by the calculating unit with the attribute information. The shooting condition data includes data related to shooting time,
9. The subject information providing program according to claim 7, wherein the information collating unit includes collating information on the subject at the photographing time with the attribute information. The shooting condition data includes data relating to the direction when shooting the subject,
The acquisition means includes calculation means for calculating the orientation of the subject from data relating to the direction when the subject is photographed,
The subject information according to any one of claims 7 to 9, wherein the information collating unit includes collating information on the orientation of the subject calculated by the calculating unit and the attribute information. Offer program. The shooting condition data includes data regarding the shooting location,
The acquisition means calculates information on the location of the subject from data on the shooting location,
The subject information providing program according to any one of claims 8 to 10, wherein the information collating unit includes collating information on the location of the subject and the attribute information. The shooting condition data includes data related to shooting time and shooting location,
The acquisition means acquires weather information based on data related to the shooting time and the shooting location,
The subject information providing program according to any one of claims 7 to 11, wherein the information collating unit includes collating the weather information and the attribute information.

Images