JP2009225148A - Information provision system and method using image, program, and medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system for providing information by preventing provision of erroneous information even when the image of a photographed object is erroneously recognized, using a portable terminal as it is. <P>SOLUTION: This information provision system is constituted of: the portable terminal which transmits e-mail to which an image photographed by a camera is attached to an inquiry server device, and receives replied e-mail; an inquiry server device which constitutes a data base retrieval query including the photographed image of the received e-mail, issues the data base retrieval query to an image recognition server device, receives an image ID and a URL which are replied, refers to check data in which the image ID is associated with an information provision e-mail address, acquires the information provision e-mail address corresponding to the received image ID, and when the acquired information provision e-mail address matches a transmission destination address, returns the received URL to a transmission source address; and an image recognition server device which retrieves a featured value data base to extract and reply the image ID and the URL using the issued data base retrieval query. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

The present invention relates to a system, method, program, and medium for providing information (for example, campaign information) searched using an image to a mobile terminal device (for example, a mobile phone).

Conventionally, there is a guidance service using image recognition technology as a method for easily accessing a mobile phone WEB site. In this guidance service, the content of the service provided on the WEB site can be changed according to the image taken by the mobile phone.
The present invention is particularly useful when recruiting for a campaign using a photographed image of a campaign object.

Examples of image recognition technology using a mobile phone include the following.
<< 1. Two-dimensional code
There is a technique in which a two-dimensional code is photographed with a mobile phone, embedded information is taken out, and the information is used.
For example, Patent Document 1 discloses a technique for capturing job information and job information by photographing a two-dimensional code of a job information magazine with a mobile phone, decoding the URL, and connecting to a corresponding site on the Internet. ing.
<< 2. Object"
There is a technique in which an image obtained by photographing an object prepared by an organizer is photographed with a mobile phone, the image is recognized, and a recognition result is used.
For example, in Non-Patent Document 1, when a user of a mobile phone takes an image of a camera using a dedicated application program set in the mobile phone, the result of matching the captured image from an image matching server connected by the dedicated application program And a technique for displaying it on a mobile phone is disclosed.
JP 2006-39785 A (pages 3 to 4, FIG. 1) Olympus Corporation New Business Planning Department, “SyncR”, Service Overview-Features (Outline of SyncR), Olympus Corporation, [online], [Search March 10, 2008], Internet <Http://gwmj.jp/>

By the way, in the technique of patent document 1, in order to print a two-dimensional code on a target object, there existed a malfunction that the beauty | look was impaired.
In the technique of Non-Patent Document 1, a dedicated application program for obtaining feature data from a photographed image and transmitting it to an image recognition WEB site is registered in advance in a mobile phone. For this reason, there is a drawback that it takes time to download and install the program.
In the technique of Non-Patent Document 1, since a plurality of different image recognition services share an image recognition WEB site, if a captured image is mistakenly recognized as an image of a different image recognition service, the service has nothing to do with it. There was a problem of providing information to mobile phones.

The present invention has been made in consideration of such a conventional technique, and an object of the present invention is to use a mobile terminal device as it is and to display erroneous information even if an image of a photographed object is erroneously recognized. It is to provide a system, method, program, and medium for providing information by preventing the provision.

The present invention solves the above problems by the following means. That is, the invention of claim 1 is an information providing system including a mobile terminal device, an inquiry server device, and an image recognition server device, wherein the mobile terminal device includes a camera for photographing an object, a transmission destination An e-mail transmission means for sending an e-mail to an inquiry server device by attaching a photographed image of an object photographed by the camera to an e-mail having an address and a sender address, and an e-mail returned by the inquiry server device A terminal device comprising: an e-mail receiving means for receiving the inquiry server device, wherein the inquiry server device stores a check unit that associates the information providing mail address with the image identification information, and the portable terminal device transmits the check data Receive an email, compose a database search query that includes the captured image attached to the email, and display it. A verification request unit that is issued to the recognition server device and holds the transmission destination address and the transmission source address of the e-mail, a verification result reception unit that receives a verification result returned from the image recognition server device, and a verification result reception unit Using the image identification information included in the collation result, referring to the check data stored in the storage unit to obtain the associated information provision mail address, and the information provision mail address and the transmission held by the collation request means If the comparison result of the determination means that compares the destination address and whether or not both match, and the comparison result of the determination means match, the URL (abbreviation of Uniform Resource Locator) is obtained from the verification result received by the verification result receiving means. And create an information provision email containing this, or if the comparison result of the judgment means does not match, An e-mail reply unit that creates an e-mail including loss information and returns the created e-mail to a transmission source address held by the collation request unit, and the image recognition server device includes: A storage unit that stores a feature amount database in which image feature amount information, image identification information, and a URL are associated with each other, and a database search query issued by an inquiry server device are received. URL acquisition means for searching and extracting image identification information and URL; and verification result reply means for creating a verification result including the image identification information and URL extracted by the URL acquisition means and returning the verification result to the inquiry server device; Is an information providing system characterized by being a server device.

Here, it is possible to obtain desired correct information by photographing an object and sending it by e-mail using an existing camera-equipped mobile phone without downloading or installing a special program.

According to the second aspect of the present invention, a storage unit for storing check data in which an information providing mail address and image identification information are associated with each other, and an electronic mail transmitted from the portable terminal device are received and a photograph attached to the electronic mail is received. A database search query including an image is constructed, issued to the image recognition server device, and collation request means for holding the destination address and source address of the e-mail, and the collation result returned by the image recognition server device The collation result receiving means to receive, the check data stored in the storage unit using the image identification information included in the collation result received by the collation result receiving means, to obtain the associated information providing mail address, The information providing e-mail address is compared with the transmission destination address held by the verification requesting means to determine whether the two match or not. If the comparison result of the means matches, the URL (abbreviation of Uniform Resource Locator) is extracted from the comparison result received by the comparison result receiving means, and an information providing mail including this URL is created, or the comparison result of the determination means is An inquiry server comprising: an e-mail reply unit that creates an e-mail including collation failure information if it does not match, and replies the created e-mail to a source address held by the collation request unit Device.

According to a third aspect of the present invention, there is provided information using a feature amount database in which image feature information, an information providing mail address and image identification information are associated, and check data in which the information providing mail address is associated with image identification information. In this method, (1) an inquiry server device receives an electronic mail transmitted from a mobile terminal device, constructs a database search query including a photographed image attached to the electronic mail, and uses the database search query as an image recognition server. A verification request step for issuing to the apparatus and retaining the transmission destination address and the transmission source address of the e-mail; (2) The image recognition server apparatus accepts the database search query issued by the inquiry server apparatus and uses it A URL extraction step of searching a feature database stored in the storage unit and extracting image identification information and a URL; and (3) an image The recognition server device generates a collation result including the extracted image identification information and URL, and returns the comparison result to the inquiry server device; and (4) the inquiry server device returns the response to the inquiry server device. The collation result is received, and the information providing mail address associated with the check data is obtained using the image identification information included in the collation result, and the information providing mail address and the collation requesting step are stored. A comparison determination step that compares the destination address and determines whether or not both match, and (5) the inquiry server device includes the comparison result received in the comparison determination step if the comparison results match. If the comparison result does not match, create an e-mail containing the verification failure information and verify the created e-mail Is information providing method characterized in that it is made in a procedure including an information providing mail reply step of replying to the sender address held in determined steps.

The invention of claim 4
A computer program that causes a computer to operate as the information providing system according to claim 1 or 2 by being incorporated in the computer.

The invention of claim 5 is a computer-readable recording medium on which the computer program according to claim 4 is recorded.

According to the present invention,
(1) The object to be photographed by the mobile phone is not limited as long as it can be photographed by the mobile phone.
(2) Even if a photographed image photographed with a mobile phone is mistakenly recognized, it is possible to prevent providing wrong information.
Therefore, even if the image recognition is wrong, there is no fear of guiding the mobile phone to a WEB site provided by a different image recognition service, and the guidance service can be provided with peace of mind.

(Example)
Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings.

FIG. 1 is a diagram for explaining an outline of an information providing system 1 according to the present invention.
In the information providing system 1, a mobile terminal device 100, a mail server device 200, an inquiry server device 300, an image recognition server device 400, and a mobile WEB server device 500 (= WEB site) are connected to a network. Configured.

The mobile terminal device 100 is, for example, a camera-equipped mobile phone. The mobile terminal device 100 includes a mobile WEB browser.

The mail server device 200 is a server computer equipped with an existing mail server program.

The inquiry server device 300 is a computer provided with a dedicated program to be described later in a server computer.

The image recognition server device 400 is a server computer that includes an existing image recognition program and an existing database management program.
The image recognition server device 400 may be a server device described in Non-Patent Document 1, for example.

The portable WEB server device 500 is a server computer provided with an existing WEB server program.

Next, the flow of processing will be described using an example in which campaign information is provided.
<< 1. Sending shot images >>
The mobile phone owner takes a picture of an object using the camera function of the mobile phone (FIG. 1 (1)).
When the mobile phone owner sends an e-mail attached with a photographed image to the campaign secretariat, the e-mail server device 200a for the campaign secretariat holds this (2).
<< 2. E-mail reception >>
The inquiry server device 300 inquires of the mail server device 200a whether there is an e-mail addressed to the campaign secretariat, and if it exists, acquires it ((3)).
The inquiry server device 300 creates a collation request using the image attached to the e-mail and transmits it to the image recognition server device 400 ((4)).

<< 3. Image recognition
The image recognition server device 400 accepts the collation request, recognizes the attached image, and returns the campaign information (= URL of the campaign WEB site) associated with the recognized image ((5 )).
The URL is an abbreviation for Uniform Resource Locator.
<< 4. Confirmation of recognition result >>
The inquiry server device 300 confirms that the URL returned by the image recognition server device 400 is the URL of the WEB site of the corresponding campaign, and returns the confirmed URL to the mobile phone by e-mail ((6)). ).
<< 5. Provision of information >>
When the inquiry server device 300 replies the confirmed URL by e-mail to the mobile phone, the mobile phone mail server device 200b holds this URL ((7)).

<< 6. Access to WEB site >>
The cellular phone 100 inquires of the cellular phone mail server device 200b whether there is an e-mail addressed to it, and if it exists, acquires it ((8)).
The mobile phone accesses the WEB site 500 using the URL of the reply mail acquired from the mail server apparatus 200b ((9)).
The WEB site 500 provides WEB page data that can be browsed by the mobile WEB browser of the mobile phone in response to the URL access from the mobile phone 100 ((10)).
The “WEB page display” mobile phone receives the WEB page data from the WEB site 500 and displays it on the mobile WEB browser ((11)).

FIG. 2 is a detailed configuration diagram of the mobile terminal device 100.
The mobile terminal device 100 includes a CPU 101, an input unit 102, a display unit 103, a camera 104, a wireless communication unit 105, a power supply unit 108, a storage unit 109, and an application program.

The CPU 101 is a central processing unit.
The display unit 103 is an LCD (liquid crystal display device) or an EL (organic electroluminescence) display.
The input unit 102 is a button keyboard, a touch pen, a touch pad, a soft keyboard using the display unit 103, or the like.
The camera 104 is a digital camera.
The wireless communication unit 105 has an antenna. The wireless communication unit 105 transmits and receives telephone radio waves via an antenna. The wireless communication unit 105 performs wireless communication with a base station (not shown). The base station connects to the Internet via a gateway (not shown).
The storage unit 109 is a semiconductor memory or a magnetic memory.
The storage unit 109 stores application programs.

In addition, an e-mail transmission unit 110, an e-mail reception unit 120, a mail display unit 130, and a mobile WEB browser 140 are provided. Each of these means is realized by each application program, and functions when the application program is interpreted and executed by the CPU 101.

The e-mail transmission unit 110 captures an object captured by the camera in an e-mail in which a transmission destination address and a transmission source address are set (hereinafter, an e-mail created and transmitted by the mobile terminal device 100 is referred to as a billing e-mail). An image is attached and transmitted to the inquiry server device. The e-mail receiving unit 120 receives the e-mail returned from the inquiry server device 300.
The mail display unit 130 displays the received electronic mail on the display unit 103.

The mobile web browser 140 accesses the web site 500 using the URL designated by the designation information input from the input unit 102, acquires web page data, and displays this on the display unit 103.

FIG. 3 is an explanatory diagram of data included in the billing mail.
FIG. 3A is a view for explaining attributes of data included in the billing mail.
The request mail 191 includes a transmission destination address 191a, a transmission source address 191b, and attached image data 191c.
The transmission destination address 191a is an electronic mail address to which the billing mail is sent.
The sender address 191b is the email address of the sender of the billing mail.
The attached image data 191c is an image taken by a camera.

FIG. 3B is an example of data included in the billing mail.
The data included in the exemplified billing mail is that the destination address 191a is “aaa@dnp.jp”, the source address 191b is “zzz@*wxy.jp”, and the attached image data 191c. Is digital photo data.
The meaning of this example is that a billing email with digital photo data attached is sent from the sender whose email address 191a is "zzz@*wxy.jp" to the destination whose email address is "aaa@dnp.jp" Means that the email has been sent.

FIG. 4 is a detailed configuration diagram of the inquiry server device 300.
The inquiry server device 300 includes a CPU 301, a network communication unit 305, a storage unit 309, and a dedicated program.

The CPU 301 is a central processing unit.
The network communication unit 305 is a LAN adapter. The storage unit 309 is a semiconductor memory or a magnetic memory.
The storage unit 309 stores check data 391.
The check data 391 is data in which the information providing mail address is associated with the image identification information.
The non-volatile area of the storage unit 309 stores a dedicated program.

In addition, a collation request unit 310, a collation result receiving unit 320, a determination unit 330, and an e-mail reply unit 340 are provided. Each of these means is realized by each dedicated program, and functions when the dedicated program is interpreted and executed by the CPU 301.

The collation request unit 310 receives the billing mail transmitted by the mobile terminal device 100, forms a database search query including the photographed image attached to the billing mail, and combines this with the query number, and the image recognition server Issue to device 400. At the same time, the collation request unit 310 records the e-mail transmission destination address and transmission source address in a predetermined area of the storage unit 309 in association with the inquiry number.
The verification result receiving unit 320 receives the verification result including the inquiry number returned from the image recognition server device 400.

The judging unit 330 refers to the check data 391 stored in the storage unit 309 using the image identification information included in the collation result received by the collation result receiving unit 320, and acquires the associated information providing mail address. Next, the determination unit 330 refers to the transmission destination address recorded in the predetermined area of the storage unit 309 by the verification request unit 310 using the inquiry number included in the verification result received by the verification result reception unit 320. Get the associated destination address and source address. Finally, the determination unit 330 compares the acquired information providing mail address and the transmission destination address to determine whether or not they match.

If the comparison result of the determination unit 330 matches, the e-mail reply unit 340 extracts a URL (abbreviation of Uniform Resource Locator) from the collation result received by the collation result receiving unit, and creates an information providing mail including the URL. Then, the determination unit 330 replies to the acquired source address. Alternatively, if the comparison result of the determination unit 330 does not match, the e-mail reply unit 340 creates an information provision mail including the verification failure information, and the transmission source address obtained by the determination unit 330 for the created information provision mail Reply to

FIG. 5 is a diagram for explaining the check data 391.
FIG. 5A illustrates the format of the check data 391.
The check data 391 is data in which the information providing mail address 391a and the image identification information 391b are associated with each other.
The information providing mail address 391a is an electronic mail address of a billing mail destination.
The image identification information 391b is an image ID.

FIG. 5B is an example of the check data 391.
For example, in the illustrated check data 391, the information providing mail address 391a is “aaa@dnp.jp”, and the image identification information 391b is “00000001”.
The meaning of this example is that when the image ID is “00000001”, the electronic mail address of the billing mail destination must be “aaa@dnp.jp”.

Alternatively, in the illustrated check data 391, the information providing mail address 391a is “aaa@dnp.jp”, and the image identification information 391b is “00000002”.
The meaning of this example is that when the image ID is “00000002”, the electronic mail address of the billing mail destination must be “aaa@dnp.jp”.

Alternatively, in the illustrated check data 391, the information providing mail address 391a is “bbb@dnp.jp” and the image identification information 391b is “00000010”.
The meaning of this example is that when the image ID is “00000010”, the electronic mail address of the billing mail destination must be “bbb@dnp.jp”.

FIG. 6 is a detailed configuration diagram of the image recognition server device 400.
The image recognition server device 400 includes a CPU 401, a network communication unit 405, a storage unit 409, and a dedicated program.

The CPU 401 is a central processing unit.
The network communication unit 405 is a LAN connection terminal.
The storage unit 409 is a semiconductor memory or a magnetic memory.
The storage unit 409 stores an image feature amount database 493.
The image feature amount database 493 is a database including data in which image feature amount information, a URL, and image identification information are associated with each other.

In addition, a URL acquisition unit 410 and a verification result reply unit 420 are provided. Each of these means is realized by each application program, and functions when the application program is interpreted and executed by the CPU 401.

The URL acquisition unit 410 receives a combination of the database search query and the query number issued by the query server device 300, and uses this to search the feature amount database 493 stored in the storage unit 409, and the image identification information and the URL To extract.
Note that the extracted image identification information and URL are image identification information and URL associated with image feature information having the highest degree of similarity with the feature amount information of the captured image included in the database search query.
The collation result reply unit 420 creates a collation result including the inquiry number received by the URL acquisition unit 410, the image identification information extracted by the URL acquisition unit 410, and the URL, and returns the collation result to the inquiry server device 300.

Note that a web server program (for example, Apache) is used for the inquiry server device 300, a program called from the web server program issues a request (= database search query, etc.) to the image search server device 300, and the program When the verification requesting means 310 and the verification result receiving means 320 are implemented as a single program module in such a way that the system waits until the response to the request is received, it is not always necessary to use the inquiry number.
Because, in this case, when a plurality of billing emails are simultaneously received from a plurality of users, a process for issuing a database search query occurs for each billing email, and depending on the execution environment on the query server device 300, This is because the response to the request from the image search server apparatus 300 is delivered to the process that issued the request.

FIG. 7 is a diagram for explaining the collation result 491.
(A) of FIG. 7 is a figure explaining the format of the collation result 491. FIG.
The collation result 491 includes image identification information 491a, a URL 491b, and an e-mail text 491c.
The image identification information 491a is an image ID.
The URL 491b is a description indicating the location of the information resource on the portable WEB site.
The electronic mail sentence 491c is a character string described in the information providing mail.

FIG. 7B is an example of the collation result 491.
In the illustrated matching result 491, the image identification information 491a is “00000001”, the URL 491b is “http://abc.jp/index.html”, and the e-mail text 491c is “to campaign”. If you are a participant, please access the mobile site. "
The meaning of this example is that the collation result 491 obtained by searching the photographed image with the search key has the image ID “00000001”, the URL “http://abc.jp/index.html”, and the e-mail text 491c. , "If you participate in the campaign, please go to the mobile site."

FIG. 8 illustrates the procedure of the determination process when the comparison results match.
Using the image ID 491a “00000003” included in the collation result, the determination unit 330 refers to the image ID 391b of the check data and acquires the information providing mail address 391a “aaa@dnp.jp” when both are located. (FIG. 8 (1)).
The determination unit 330 compares the acquired information providing mail address 391a “aaa@dnp.jp” with the billing mail destination address 191a “aaa@dnp.jp” and determines that they match (same as above). (2)).
Since the comparison result of the judging means 330 is the same, the e-mail reply means 340 sends the e-mail text 491c “If you are participating in the campaign, please access the mobile site.” And the URL “http: // abc The information providing mail having “.jp / index.html” is replied to the sender address 191b “zzz@*wxy.jp” of the billing mail.

FIG. 9 illustrates the procedure of the determination process when the comparison results do not match.
Using the image ID 491a “00000011” included in the collation result, the determination unit 330 refers to the image ID 391b of the check data and acquires the information providing mail address 391a “bbb@dnp.jp” when both are located. (FIG. 9 (1)).
The determination unit 330 compares the acquired information providing mail address 391a “bbb@dnp.jp” with the billing mail destination address 191a “aaa@dnp.jp” and determines that they do not match (same as above). (2)).
Since the comparison result of the determination unit 330 is inconsistent, the e-mail reply unit 340, for example, sends an information providing e-mail having an e-mail sentence 491c “Matching of photographed image failed.” Reply to 191b "zzz@*wxy.jp".

In this way, when the collation result is wrong in the URL unrelated to the campaign, it is possible to prevent the wrong information from being notified to the mobile phone.

The figure explaining the outline | summary of the information provision system 1 by this invention Detailed configuration diagram of the mobile terminal device 100 Explanatory diagram of data included in the billing email Detailed configuration diagram of the inquiry server device 300 The figure explaining check data 391 Detailed configuration diagram of the image recognition server device 400 The figure explaining collation result 491 Illustration of judgment processing procedure when comparison results match Illustration of judgment processing procedure when comparison results do not match

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information provision system 100 Portable terminal device 110 E-mail transmission means 120 E-mail reception means 130 Mail display means 140 Portable WEB browser 191 Requested mail 191a Transmission destination address 191b Transmission source address 191c Attached image data 200 Mail server apparatus 200a / 200b Mail Server apparatus 300 Inquiry server apparatus 310 Verification request means 320 Verification result reception means 330 Determination means 340 Email reply means 391 Check data 391a Information providing email address 391b Image identification information, image ID
400 Image recognition server apparatus 410 URL acquisition means 420 collation result return means 491 collation result 491a Image identification information, image ID
491b URL
491c E-mail sentence 500 Mobile WEB server device

Claims (5)

In an information providing system including a mobile terminal device, an inquiry server device, and an image recognition server device,
The portable terminal device
A camera for shooting the object;
An e-mail transmission means for attaching a captured image of an object photographed by the camera to an e-mail having a transmission destination address and a transmission source address, and transmitting the e-mail to an inquiry server device;
E-mail receiving means for receiving an e-mail returned by the inquiry server device;
A terminal device comprising:
The inquiry server device
A storage unit for storing check data in which the information providing mail address and the image identification information are associated with each other;
The mobile terminal device receives the e-mail sent, composes a database search query including the captured image attached to the e-mail, issues it to the image recognition server device, and sends the e-mail destination address and A verification request means for holding the source address;
Collation result receiving means for receiving the collation result returned by the image recognition server device;
Using the image identification information included in the verification result received by the verification result receiving means, refer to the check data stored in the storage unit to obtain the associated information provision email address, A determination unit that compares the destination address held by the request unit and determines whether or not both match,
If the comparison result of the determination unit matches, the URL (abbreviation of Uniform Resource Locator) is extracted from the verification result received by the verification result reception unit, and an information providing mail including the URL is created, or the comparison result of the determination unit If there is a mismatch, an e-mail including the verification failure information is created, and an e-mail reply means for returning the created e-mail to the source address held by the verification request means;
A server device comprising:
The image recognition server device
A storage unit for storing a feature database in which image feature information, image identification information, and URL are associated;
URL acquisition means for receiving a database search query issued by the inquiry server device and using this to search a feature amount database stored in the storage unit and extracting image identification information and a URL;
Collation result reply means for creating a collation result including the image identification information extracted by the URL acquisition means and the URL and returning the collation result to the inquiry server device;
A server device comprising:
An information providing system characterized by that. A storage unit for storing check data in which the information providing mail address and the image identification information are associated with each other;
The mobile terminal device receives the e-mail sent, composes a database search query including the captured image attached to the e-mail, issues it to the image recognition server device, and sends the e-mail destination address and A verification request means for holding the source address;
Collation result receiving means for receiving the collation result returned by the image recognition server device;
Using the image identification information included in the verification result received by the verification result receiving means, refer to the check data stored in the storage unit to obtain the associated information provision email address, A determination unit that compares the destination address held by the request unit and determines whether or not both match,
If the comparison result of the determination unit matches, the URL (abbreviation of Uniform Resource Locator) is extracted from the verification result received by the verification result reception unit, and an information providing mail including the URL is created, or the comparison result of the determination unit If there is a mismatch, an e-mail including the verification failure information is created, and an e-mail reply means for returning the created e-mail to the source address held by the verification request means;
An inquiry server device comprising: An information providing method using a feature amount database in which image feature information, an information providing email address and image identification information are associated, and check data in which the information providing email address and image identification information are associated with each other,
(1) The inquiry server device receives the electronic mail transmitted by the mobile terminal device, forms a database search query including the photographed image attached to the electronic mail, and issues the database search query to the image recognition server device. A verification request step that holds the email destination address and source address;
(2) The image recognition server device accepts a database search query issued by the inquiry server device, and uses this to search a feature database stored in the storage unit and extract image identification information and a URL. Steps,
(3) The image recognition server device generates a collation result including the extracted image identification information and URL, and returns a comparison result to the inquiry server device;
(4) The inquiry server device receives the collation result returned from the image recognition server device, obtains an associated information providing mail address by referring to the check data using the image identification information included therein. The comparison determination step of comparing the information providing email address with the transmission destination address held in the verification request step to determine whether or not both match,
(5) If the comparison result matches, the inquiry server device creates an email including the URL included in the comparison result received in the comparison determination step. If the comparison result does not match, the inquiry server device displays the verification failure information. An information providing email reply step of creating an included email and returning the created email to the source address held in the verification request step;
An information providing method characterized in that it is performed by a procedure including A computer program that causes a computer to operate as the information providing system according to claim 1 by being incorporated in the computer. The computer-readable recording medium which recorded the computer program of Claim 4.

Images