JP2008210364A - Taken picture using system and taken picture using method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically provide related information of an object taken by a mobile terminal, and to automatically collect an entrance charge to a place where the object exist. <P>SOLUTION: A taken picture using system comprises: an image search apparatus 4 which searches a database for an image resemble to an image taken by a user terminal 1 and sends related information corresponding to it to the user terminal 1; an account processing server 6 which performs an account process of the entrance charge to a destination of the user terminal 1; a related information control server 5 which sends a terminal ID of the user terminal 1 to a gate device 2a placed at an entrance of the destination and sends account settlement information to the user terminal 1 when the account process is settled; and the gate device 2a which is placed at the entrance of the destination. A reading means of the gate device 2a allows the user terminal 1 to pass the gate device 2a when the account settlement information is read from the user terminal 1 when the user terminal 1 passes the entrance, and the terminal ID read from the user terminal 1 and the terminal ID sent from the information control server 5 are identical with each other. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a captured image utilization system and a captured image utilization method that utilize a captured image captured by a mobile terminal.

  In recent years, mobile terminals such as mobile phones have been used in various fields as their functions have remarkably improved.

  For example, Patent Document 1 describes an article related information providing system using a mobile phone. According to this, when the mobile phone reads the information of the RFID tag attached to the advertisement etc. and requests the article related information providing server for the related information of the article posted in the advertisement etc., the article related information providing server And send related information to the mobile phone.

Patent Document 2 describes a train fare collection system using a mobile phone. According to this, at the timing when the user carries the mobile phone and passes through the automatic ticket gate, the automatic ticket gate reads the ticket without contact from the IC chip built in the mobile phone, and the authentication result of the ticket If it is normal, the boarding information is written in the IC chip in a non-contact manner, and then the user is allowed to pass. The railroad company server requests transmission of boarding / alighting information of the mobile phone at regular intervals, and settles the user fare based on the boarding / alighting information transmitted from the mobile phone.
JP 2005-182676 A Japanese Patent Laid-Open No. 2003-0707019 JP 2003-259457 A

  By the way, most mobile terminals currently have a camera function. When a user finds an object such as a building of interest, the user captures the object as a subject and stores the captured image. Is increasing.

  Therefore, in the future, it is considered that there is an increasing demand from the user side to acquire related information related to the object photographed by the mobile terminal.

  However, the article-related information providing system described in Patent Document 1 is photographed with a mobile terminal because the objects from which the relevant information can be acquired are limited to articles that are published in advertisements with RFID tags attached. Information related to the object cannot be acquired.

  In addition, when the user can acquire the related information of the object photographed by the mobile terminal, it is considered that the number of cases of going to the place where the object is located after seeing the related information is increased. However, there are cases where an entrance fee is required to enter the place where the object is located. In such a case, if there is a mechanism for automatically paying the entrance fee, it is convenient for the user.

  Therefore, in the future, it is considered that there is an increasing demand from the user side to automatically collect an entrance fee to a place where an object photographed by a mobile terminal is located.

  However, since the train fare collection system described in Patent Document 2 is limited to collection of train fare, it is not possible to collect an entrance fee to a place where an object is located.

  Accordingly, an object of the present invention is to provide a captured image that can automatically provide related information of an object photographed by a mobile terminal and can automatically collect an entrance fee to a place where the object is located. It is to provide a usage system and a captured image usage method.

In order to achieve the above object, the captured image utilization system according to the first aspect of the present invention includes:
A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
Before the mobile terminal passes through the gate device installed at the entrance of the location corresponding to the relevant information transmitted to the mobile terminal, the settlement processing of the entrance fee to the location where the target is performed is performed. Settlement means,
When the settlement processing is performed by the settlement processing means, the terminal identification information of the mobile terminal is transmitted to the gate device installed at the entrance of the place where the object corresponding to the related information transmitted to the mobile terminal is located And a management means for transmitting the account settlement information to the mobile terminal,
Provided in a gate device installed at each entrance of the place where the plurality of objects are located, and attempts to read information from the mobile terminal at a timing when the mobile terminal passes through the entrance. Reading that permits passage of the gate device when the account settlement information is read and the terminal identification information read from the mobile terminal matches the terminal identification information transmitted from the management means to the gate device And means.

  According to this configuration, the user who uses the mobile terminal can automatically acquire the related information of the object photographed by the mobile terminal, and go to the place where the object is located by looking at the related information. In that case, the entrance fee is automatically collected before passing through the gate device installed at the entrance of the place.

In order to achieve the above object, the captured image utilization system according to the second aspect of the present invention provides:
A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
When the related information is transmitted from the image search means to the mobile terminal, the management for transmitting the terminal identification information of the mobile terminal to the gate device installed at the entrance of the place where the object corresponding to the related information exists Means,
Provided in a gate device installed at each entrance of the place where the plurality of objects are located, and attempts to read information from the mobile terminal at a timing when the mobile terminal passes through the entrance. A reading unit that permits passage of the gate device when the read terminal identification information matches the terminal identification information transmitted from the management unit to the gate device;
When the passage of the gate device is permitted, there is a settlement processing means for performing settlement processing of an entrance fee to a place with an object corresponding to the related information transmitted to the mobile terminal.

  According to this configuration, the user who uses the mobile terminal can automatically acquire the related information of the object photographed by the mobile terminal, and go to the place where the object is located by looking at the related information. In this case, an entrance fee is automatically collected when passing through a gate device installed at the entrance of the place.

  According to the present invention, a user using a mobile terminal can automatically acquire related information of an object photographed by the mobile terminal, and go to a place where the object is located by looking at the related information. In this case, an effect that the entrance fee to the place is automatically collected is obtained.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a diagram showing a configuration of a captured image utilization system according to the first embodiment of the present invention.

  As shown in FIG. 1, the captured image utilization system of the present embodiment includes a user terminal 1, a gate device 2 a installed at a place where an object (subject) 2 is located, a network 3, an image search device 4, A related information management server 5 and a settlement processing server 6 are provided. In FIG. 1, the object 2 is a Tokyo tower.

  The user terminal 1 includes an RFID tag 19 (see FIGS. 4 and 7) and a camera (see FIG. 7), a mobile phone, a PHS (simple mobile phone), a personal digital assistant (PDA), etc. Mobile terminal. The user terminal 1 also includes a mobile terminal used by connecting to a digital camera. The user terminal 1 has an image search button 1a (see FIG. 4).

  The target object 2 may be a real object or may be an object listed in a publication such as a public notice, newspaper, magazine, book, or printed matter. Further, the object 2 may be an object displayed on the screen of a television or a personal computer.

  The gate device 2a is installed at an entrance of a place where there is an object such as a building, a station, a museum, a zoo, an amusement park, a concert hall or the like. The entrance here may be an entrance that also serves as an exit. The gate device 2a is provided with reading means such as an RFID reader and a sensor for reading information from the RFID tag 19 of the user terminal 1 when the user carries the user terminal 1 and passes through the gate device 2a. The user terminal 1 is allowed to pass according to the read result. The gate device 2a may be an automatic door, a reception guide plate, a surveillance camera, or the like. The reading unit may read information from the RFID tag 19 by performing visible light communication, infrared communication, non-contact communication, or the like with the user terminal 1.

  The network 3 is the Internet or the like, and exchanges images of the object 2 and related information.

  The image search device 4 stores, for each object such as a building, a station, a museum, a zoo, an amusement park, and a concert venue, an image (photograph) of the object, related information of the object, and storage of the related information. An image information database 41 (see FIG. 5) in which URLs or E-mail addresses, which are location information indicating the location of the original related information management server 5, is registered in association with each other is provided. The image information database 41 is not necessarily provided in the image search device 4 and may exist on the network 3 in a state where it can be used from the image search device 4. When the image of the object 2 is transmitted from the user terminal 1, the image search device 4 searches the image information database 41 for an image similar to the image of the object 2. If the related information is associated with the searched image, the image search device 4 synthesizes the related information with the searched image and transmits it to the user terminal 1. If the related information is not associated with the searched image, the image search device 4 is a storage source of the related information based on the URL or the E-mail address associated with the searched image. The related information management server 5 is automatically accessed to request transmission of related information. When the related information is received from the related information management server 5, the image search device 4 synthesizes the related information with the searched image and transmits it to the user terminal 1, and registers the latest related information in the image information database 41. To do. Further, when a plurality of images are searched from the image information database 41, the image search device 4 assigns a priority order to each of the plurality of images according to the degree of similarity, and places the plurality of images in the order of priority. Rearrangement, the image having the highest priority and the related information associated with the image are combined and transmitted to the user terminal 1.

  The related information management server 5 stores related information of an object corresponding to an image registered in the image information database 41, and provides the related information on the website. That is, when the related information management server 5 receives a transmission request for related information from the image search device 4, the related information management server 5 transmits the requested related information to the image search device 4. In addition, when the user terminal 1 moves to a place where the object is located, the related information management server 5 transmits the reservation information to the gate device 2a installed at the entrance of the place, and the settlement processing server 6 When the settlement process of the entrance fee to the place where the object is present is performed, the settlement information is transmitted to the user terminal 1.

  The settlement processing server 6 performs settlement processing for the entrance fee when the user terminal 1 moves to the place where the object is located, and collects the entrance fee from the user. Specifically, the settlement processing server 6 deducts the amount corresponding to the entrance fee from the account of the user who uses the user terminal 1 and transfers it to the account of the company that operates the related information management server 5. The settlement process is performed in advance before the user terminal 1 reaches the place where the object is located, or when the user terminal 1 passes through the gate device 2a installed at the entrance of the place where the object is located. Do.

  FIG. 2 is a diagram for explaining an example of the photographing operation by the user terminal 1.

  In the example shown in FIG. 2, the user terminal 1 is photographing the real Tokyo Tower as the object 2.

  FIG. 3 is a diagram for explaining another example of the photographing operation by the user terminal 1.

  In the example shown in FIG. 3, the user terminal 1 takes a picture of Tokyo Tower published in the book 21 which is a publication as the object 2.

  FIG. 4 is a diagram for explaining functions of the user terminal 1.

  As shown in FIG. 4, the user terminal 1 includes an image search button 1 a for requesting the image search device 4 to search for an image of the object 2. When the image search button 1a is pressed, an image similar to the object 2 and related information corresponding to the image are automatically transmitted from the image search device 4. Further, the user terminal 1 includes an RFID tag 19 in which a terminal ID that is terminal identification information for identifying the user terminal 1, account settlement information, and the like are registered. In addition, it is also possible to register the image received from the image search device 4 and related information in the RFID tag 19.

  FIG. 5 is a block diagram showing a configuration of the image search device 4.

  As illustrated in FIG. 5, the image search device 4 includes an image information database 41, an image extraction unit 42, an image search unit 43, and a synthesis unit 44.

  The image information database 41 includes, for each object such as a building, a station, a museum, a zoo, an amusement park, a concert hall, etc., an image (photograph) of the object, related information about the object, and information on the related information. The URL or E-mail address of the related information management server 5 that is the storage source is registered in association with each other. In the image information database 41, these pieces of information are registered for each type of object (location, person, etc.).

  When receiving an image obtained by photographing the object 2 from the user terminal 1, the image extraction unit 42 extracts a characteristic part of the image of the object 2 and specifies the type (location, person, etc.) of the object 2. The feature portion of the image is determined based on the color, shape, size, position, etc. of the feature portion.

  The image search unit 43 targets an image of the same type as the object 2 among the images registered in the image information database 41, and moves, enlarges, reduces, etc. the position of the characteristic part of the image of the object 2. An image similar to the image of the target object 2 is searched by comparing the color, shape, size, and position of the characteristic portion. If there is related information associated with the searched image, the image search unit 43 passes the related information together with the searched image to the combining unit 44. On the other hand, if there is no related information associated with the searched image, the image search unit 43 stores the related information on the basis of the URL or E-mail address associated with the searched image. A related information management server 5 is automatically accessed to send a related information transmission request. When the related information is received from the related information management server 5, the image search unit 43 passes the related information together with the searched image to the combining unit 44 and registers the latest related information in the image information database 41.

  The synthesizer 44 synthesizes the image passed from the image search unit 43 and the related information and transmits the synthesized information to the user terminal 1.

  FIG. 6 is a diagram illustrating an example of image information registered in the image information database 41.

  In the example shown in FIG. 6, the image information database 41 includes, for each target object, an image (photograph) of the target object, the name of the target object, QR-coded related information of the target object, The URL and E-mail address of the related information management server 5 that is the storage source of the related information are registered in association with each other.

  Further, when the search from the image information database 41 is completed, the image search unit 43 gives priority to each of the searched images according to the degree of similarity with the image of the target object 2, and gives priority to the searched images. Rearrange in order of highest priority.

  For example, the image of Tokyo Tower, which has the highest priority, includes the name “Tokyo Tower”, the URL “http: //www.toukyoutawer…”, and the E-mail address “toukyoutawer@ab.jp…” , QR-related related information is associated with each other. Therefore, the image search unit 43 passes the information obtained by decoding the QR-coded related information together with the image of the Tokyo Tower to the synthesis unit 44.

  FIG. 7 is a block diagram showing a configuration of the user terminal 1.

  As shown in FIG. 7, the user terminal 1 includes an antenna 11, a transmission / reception unit 12, a control unit 13, a camera 14, a speaker 15, a display unit 16, a storage unit 17, an operation unit 18, an RFID, And a tag 19.

  The operation unit 18 is a part where the user performs an operation, and includes an image search button 1a.

  The antenna 11 is an antenna for performing wireless communication with a radio base station (not shown). That is, the user terminal 1 is connected to the network 3 by performing wireless communication with the wireless base station using the antenna 11, and can communicate with the image search device 4, the settlement processing server 6, and the like via the network 3.

  The transmission / reception unit 12 transmits an image obtained by capturing the object 2 at the timing when the image search button 1a is pressed with the image search device 4, and receives an image and related information for the image. In addition, when the transmission / reception unit 12 decides to go to the place where the object is located with the settlement processing server 6, the transmission / reception unit 12 transmits information to that effect, and the entrance fee to the place where the object is located is settled. In the event of a failure, the account settlement information to that effect is received.

  The camera 14 images the object 2.

  The speaker 15 outputs a call voice and the like, and the display unit 16 displays an image received from the image search device, related information, and the like on a screen.

  The storage unit 17 stores the image received from the image search device 4 and related information.

  The RFID tag 19 is registered with the terminal ID of the user terminal 1, the settlement information received from the settlement processing server 6, and the like. The image received from the image search device and related information may be registered in the RFID tag 19.

  The control unit 13 controls each component in the user terminal 1.

  FIG. 8 is a diagram illustrating an example of an image search result displayed on the screen of the user terminal 1.

  In the example illustrated in FIG. 8, the image of the Tokyo Tower that is the target object and related information are displayed on the screen of the user terminal 1 as the image search result received from the image search device 4. On the screen, it is possible to decide to go to a place where the object is located, that is, to settle the entrance fee for entering the place.

  FIG. 9 is a diagram illustrating an example of an operation for allowing the user terminal 1 to pass through the gate device 2a.

  In the example shown in FIG. 9, the gate device 2 a is an automatic door, and an RFID reader 7 is provided as a reading unit that reads information from the user terminal 1.

  For example, let us consider a case where it is assumed that the user terminal 1 performs settlement processing for the entrance fee before passing through the gate device 2a installed at the entrance of the destination.

  In this case, when the settlement processing by the settlement processing server 6 is finished, the related information management server 5 sends the user terminal 1 to the gate device 2a installed at the entrance of the place where the target object is the destination. The reservation information including the terminal ID of 1 is transmitted, and the account settlement information is transmitted to the user terminal 1.

  Therefore, the RFID reader 7 tries to read information from the user terminal 1 at the timing when the user terminal 1 passes through the entrance, and the settled information is read from the user terminal 1 and read from the user terminal 1. When the terminal ID and the terminal ID included in the reservation information transmitted from the related information management server 5 to the gate device 2a match, the user terminal 1 is permitted to pass the gate device 2a, and the gate device 2a open.

  On the other hand, let us consider a case where it is assumed that the user terminal 1 performs settlement processing of the entrance fee when passing through the gate device 2a installed at the entrance of the destination.

  In this case, the related information management server 5 has a gate installed at the entrance of the place where the target object is the user terminal 1 when the image and the related information are transmitted from the image search device 4 to the user terminal 1. The reservation information including the terminal ID of the user terminal 1 is transmitted to the device 2a.

  Therefore, the RFID reader 7 tries to read information from the user terminal 1 at the timing when the user terminal 1 passes through the entrance, and the terminal ID read from the user terminal 1 and the related information management server 5 to the gate device 2a. When the terminal ID included in the transmitted reservation information matches, the user terminal 1 is allowed to pass the gate device 2a, and the gate device 2a is opened.

  FIG. 10 is a diagram for explaining another example of the operation for allowing the user terminal 1 to pass through the gate device 2a.

  In the example shown in FIG. 10, the gate device 2 a is a reception guide plate 72. Since the process of this example is the same as that of FIG. 9, description is abbreviate | omitted.

  Hereinafter, the overall operation of the captured image utilization system of the present embodiment will be described.

  First, the overall operation when it is assumed that the user terminal 1 performs settlement processing of the entrance fee before passing through the gate device 2a installed at the entrance of the destination will be described.

  FIG. 11 is a flowchart for explaining the overall operation when it is assumed that the user terminal 1 performs settlement processing for the entrance fee before passing through the gate device 2a installed at the entrance of the destination. FIG. 12 is a diagram schematically illustrating the operation of FIG. 11.

  As shown in FIGS. 11 and 12, first, the user terminal 1 captures an image of the object 2 as a subject by the camera 14, and when the image search button 1a is pressed, the image of the object 2 is imaged by the transmission / reception unit 12. It transmits to the search device 4 (step A1).

  Next, the image search device 4 searches the image information database 41 for an image similar to the image of the object 2 by the image search unit 43. As a result, if there is related information associated with the searched image, the image search device 4 combines the image and the related information by the combining unit 44 and transmits the combined information to the user terminal 1 (step A4). On the other hand, if there is no related information associated with the retrieved image, the image retrieval device 4 uses the URL or E-mail address associated with the image retrieved by the image retrieval unit 43 as the associated information. A request for transmission of related information is made to the management server 5 (step A2). In response to this, the related information management server 5 extracts the related information of the image requested from the image search device 4 and transmits it to the image search device 4 (step A3). When the related information is received from the related information management server 5, the image search device 4 registers the related information in the image information database 41 by the image search unit 43, and combines the image and the related information by the combining unit 44. To the user terminal 1 (step A4).

  Thereby, the user terminal 1 can automatically acquire related information of the object.

  Here, the user sees the relevant information on the object on the screen of the user terminal 1 as shown in FIG. 8 and goes to the place where the object is located, that is, the entrance fee for entering the place. Suppose you decide to do the closing process. Then, the user terminal 1 notifies the settlement processing server 6 to that effect by the transmission / reception unit 12 (step A5).

  Next, the settlement processing server 6 deducts the amount corresponding to the entrance fee from the account of the user who uses the user terminal 1, and transfers it to the account of the company that operates the related information management server 5, thereby performing the settlement processing of the entrance fee. Perform (Step A6).

  Next, the related information management server 5 transmits settled information indicating that the settlement process has been performed to the user terminal 1 (step A7). This account settlement information is registered in the RFID tag 19 of the user terminal 1 together with the terminal ID. Further, the related information management server 5 transmits reservation information indicating that the user terminal 1 has made an admission reservation to the gate apparatus 2a installed at the entrance of the place where the target object is the user terminal 1. (Step A8). This reservation information includes the terminal ID of the user terminal 1 and is registered in the RFID reader 7 provided in the gate device 2a.

  Thereafter, when the user sees relevant information on the screen of the user terminal 1 and moves to the destination, the RFID reader 7 moves from the user terminal 1 at the timing when the user carrying the user terminal 1 passes through the entrance of the destination. Attempt to read information. Then, the account settlement information is read from the user terminal 1, and the terminal ID read from the user terminal 1 matches the terminal ID included in the reservation information transmitted from the related information management server 5 to the gate device 2a. In this case, the RFID reader 7 allows the user terminal 1 to pass the gate device 2a, and the gate device 2a is opened.

  Thereafter, the user carrying the user terminal 1 passes through the gate device 2a (step A9).

  The user terminal 1 registers the image and related information received from the image search device 4 in step A4 in the RFID tag 19, and moves to the destination in step A5 even after a certain period of time has passed. If the decision is not made, it is determined that the movement has been stopped, and even if a decision to that effect is made thereafter, the settlement processing server 6 is not notified.

  Further, when a plurality of gate devices 2a are installed at the destination, the related information management server 5 can transmit the reservation information to each of the plurality of gate devices 2a in step A8. Thereby, the user can pass all the plurality of gate devices 2a.

  Next, a description will be given of the overall operation when it is assumed that the user terminal 1 performs settlement processing for the entrance fee when passing through the gate device 2a installed at the entrance of the destination.

  FIG. 13 is a flowchart for explaining the overall operation when it is assumed that the user terminal 1 performs a settlement process for the entrance fee when passing through the gate device 2a installed at the entrance of the destination.

  As shown in FIG. 13, first, the user terminal 1 captures the object 2 as a subject by the camera 14, and when the image search button 1 a is pressed, the image search device 4 displays the image of the object 2 by the transmission / reception unit 12. (Step B1).

  Next, the image search device 4 searches the image information database 41 for an image similar to the image of the object 2 by the image search unit 43. As a result, if there is related information associated with the searched image, the image search device 4 combines the image and the related information by the combining unit 44 and transmits the combined information to the user terminal 1 (step B4). On the other hand, if there is no related information associated with the retrieved image, the image retrieval device 4 uses the URL or E-mail address associated with the image retrieved by the image retrieval unit 43 as the associated information. A request for transmission of related information is made to the management server 5 (step B2). In response to this, the related information management server 5 extracts the related information of the image requested from the image search device 4 and transmits it to the image search device 4 (step B3). When the related information is received from the related information management server 5, the image search device 4 registers the related information in the image information database 41 by the image search unit 43, and combines the image and the related information by the combining unit 44. To the user terminal 1 (step B4).

  Thereby, the user terminal 1 can automatically acquire related information of the object.

  Next, the image search device 4 notifies the related information management server 5 that the image and the related information have been transmitted to the user terminal 1 by the combining unit 44 (step B5).

  Next, the related information management server 5 determines that a place where the object is located is set as a destination by the user terminal 1 and that an entry to the destination is reserved, and the user terminal 1 displays reservation information indicating the reservation. It transmits to the gate apparatus 2a installed in the entrance of the place with the target object made into the destination (step B6). This reservation information includes the terminal ID of the user terminal 1 and is registered in the RFID reader 7 provided in the gate device 2a.

  Thereafter, when the user sees relevant information on the screen of the user terminal 1 and moves to the destination, the RFID reader 7 moves from the user terminal 1 at the timing when the user carrying the user terminal 1 passes through the entrance of the destination. Attempt to read information. When the terminal ID read from the user terminal 1 matches the terminal ID included in the reservation information transmitted from the related information management server 5 to the gate device 2a, the RFID reader 7 performs the gate operation by the user terminal 1. The gate device 2a is opened by allowing the passage of the device 2a.

  Thereby, the user carrying the user terminal 1 passes through the gate device 2a (step B7). Further, the gate device 2a notifies the settlement processing server 6 that the user terminal 1 is permitted to pass through the gate device 2a (step B8).

  Next, the settlement processing server 6 deducts the amount corresponding to the entrance fee from the account of the user who uses the user terminal 1, and transfers it to the account of the company that operates the related information management server 5, thereby performing the settlement processing of the entrance fee. Perform (Step B9).

  Thereafter, the related information management server 5 transmits the account settlement information indicating that the account settlement process has been performed to the user terminal 1 (step B10).

  Note that the gate device 2a receives the image and the related information together with the reservation information from the related information management server 5 in step B6 and registers them in the RFID reader 7, and even if a certain period of time has passed, the gate device 2a in step B7. If it does not pass, it is determined that the movement has been stopped, and even if it passes through the gate device 2a thereafter, the settlement processing server 6 is not notified.

  Further, when a plurality of gate devices 2a are installed at the destination, the related information management server 5 can transmit the reservation information to each of the plurality of gate devices 2a in step B6. Thereby, the user can pass all the plurality of gate devices 2a.

  As described above, in the present embodiment, when the user terminal 1 transmits the image of the target object 2, the image search device 4 searches the image information database 41 for an image similar to the image of the target object 2 and performs a search. The related information associated with the obtained image is combined with the image of the object 2 and transmitted to the user terminal 1. Further, when the user terminal 1 goes to a place where the object 2 is located, the settlement processing server 6 collects an entrance fee before or after passing through the gate device 2a installed at the entrance of the place.

  Therefore, the user can automatically acquire the related information of the target object 2 photographed by the user terminal 1, and when viewing the related information and going to a place where the target object 2 is located, the entrance of the place The entrance fee is automatically collected before or when passing through the gate device 2a installed in the vehicle.

(Second Embodiment)
FIG. 14 is a diagram showing a configuration of a captured image utilization system according to the second embodiment of the present invention.

  As shown in FIG. 14, the captured image utilization system of this embodiment is different from the first embodiment shown in FIG. 1 in that a management control device 8 and an information processing device 144 are provided. In FIG. 14, the settlement processing server 6 is omitted.

  As shown in FIG. 14, in a place far away from the target object (the real thing of Tokyo Tower) 2 (in an area different from the area where Tokyo Tower exists, for example, a library in Okinawa), the target object (book, newspaper, Rather than performing network communication to capture the necessary information by photographing Tokyo Tower (published in articles, magazines, etc.) 2, it is closer to the object (the real thing of Tokyo Tower) 2 (the area where Tokyo Tower exists) In the same area), it is considered that the frequency of performing network communication for capturing necessary information (real thing of Tokyo Tower) 2 and obtaining necessary information is considered to be higher.

  Therefore, in a place close to the target object (the real thing of Tokyo Tower) 2 (in the same area as the area where the Tokyo Tower exists), communication by the user terminal 1 is concentrated and it becomes difficult to connect to each device on the network 3. In addition, it takes time to download necessary information data. Further, the area where the target object (the real thing of Tokyo Tower) 2 exists is short of resources.

  By the way, in recent years, mobile terminal communication systems include 2G (second generation), 3G (third generation) W-CDMA (Wideband-Code Division Multiple Access), 4G (fourth generation), WLAN (Wireless Local Area Network), Communication systems such as WiMAX (Worldwide Interoperability for Microwave Access) and Wi-Fi (Wireless Fidelity) have been put into practical use, and a technique for enabling the use of a plurality of communication systems in one user terminal has also been proposed. As an example, based on information on the available wireless systems obtained by the multi-service terminal detecting its own location and sending the location information to the management server, it is optimal for the selection conditions from the available wireless systems. There is a method of selecting and using a simple wireless system (for example, see Patent Document 3).

  However, the technique disclosed in Patent Document 3 does not select a communication line in the service area based on the position information of the photographed object or the position information of the photographed user terminal.

  Therefore, the captured image utilization system of the present embodiment has the following configuration in order to improve the problem as shown in FIG.

  In FIG. 14, the object 2 (the actual Tokyo Tower) 2 and the user terminal 1A in Minato-ku, Tokyo are a W-CDMA service area (hereinafter referred to as a W-CDMA area) centered on the W-CDMA base station 10a. And a WiMAX service area (hereinafter referred to as a WiMAX area) centered on the WiMAX base station 9a. The library object (publication) 2 and the user terminal 1B in Okinawa are located in a W-CDMA area centered on the W-CDMA base station 10b.

  When the user terminals 1 </ b> A and 1 </ b> B photograph the object 2, the user terminals 1 </ b> A and 1 </ b> B transmit an image of the object 2 to the image search device 4 via the network 3. Further, the user terminals 1A and 1B have a GPS function, automatically acquire position information by the artificial satellite 100, and transmit the position information to the image search device 4 simultaneously with the image of the object 2.

  The image search device 4 transmits the position information of the user terminal that is the image transmission source of the target object 2 and the target object (the real thing of Tokyo Tower) 2 to the management control device 8 via the network 3.

  The management control device 8 uses the image transmission source user terminal and the object (Tokyo Tower actual) 2 and the location information of the base station in each service area, and the image transmission source user terminal and the object (Tokyo Tower actual). ) Determine whether 2 is in the same service area.

  If the management control device 8 determines that the user terminal of the image transmission source and the object (Tokyo Tower) 2 are in the same service area, the image transmission source user terminal and the object (Tokyo Tower) 2 confirms the status of the communication line in the WiMAX area and the W-CDMA area in which the area 2 is located, and among the communication lines in the WiMAX area and the W-CDMA area, the communication line with the least number of lines used (the communication line with the most free space) Alternatively, the communication line with the fastest transmission speed is automatically selected.

  The image search device 4 switches to the communication line selected by the management control device 8 and transmits the image of the object 2 and related information to the user terminals 1A and 1B.

  A plurality of 2G, 4G, wireless LAN, Wi-Fi, and the like can be used as communication lines other than WiMAX and 3G W-CDMA.

  FIG. 15 is a block diagram illustrating a configuration of the image search device 4.

  As illustrated in FIG. 15, the image search device 4 includes an image information database 41, an image extraction unit 42, an image search unit 43, a synthesis unit 44, and a line control unit 45.

  In the image information database 41, for each target object such as a building, a station, a museum, a zoo, an amusement park, a concert venue, etc., an image (photograph) of the target object, related information about the target object, and the target object The position information, the related information, and the URL or E-mail address of the related information management server 5 that is the storage source of the position information are registered in association with each other. In the image information database 41, these pieces of information are registered for each type of object (location, object, etc.).

  When the image extraction unit 42 receives an image of the object 2 from the user terminals 1A and 1B, the image extraction unit 42 extracts a characteristic portion of the image of the object 2 and specifies the type (location, object, etc.) of the object 2 To do. The feature portion of the image is determined based on the color, shape, size, position, etc. of the feature portion.

  The image search unit 43 targets an image of the same type as the object 2 among the images registered in the image information database 41, and moves, enlarges, reduces, etc. the position of the characteristic part of the image of the object 2. An image similar to the image of the target object 2 is searched by comparing the color, shape, size, and position of the characteristic portion. If the related information and the position information associated with the searched image exist in the image information database 41, the image search unit 43 passes the related information together with the searched image to the synthesizing unit 44, and the position information is transferred. Then, the information is transmitted to the management control device 8 together with the position information received from the user terminal of the image transmission source, and a communication line selection request is made. On the other hand, if the related information and the position information associated with the retrieved image do not exist in the image information database 41, the image retrieval unit 43 uses the URL or E-mail address associated with the retrieved image. In addition, the related information management server 5 that is a storage source of the related information and the position information is automatically accessed to request transmission of the related information and the position information. When the related information and the position information are received from the related information management server 5, the image search unit 43 passes the related information together with the searched image to the combining unit 44, and transmits the position information to the management control device 8 to select the communication line. A request is made and the latest related information and position information are registered in the image information database 41.

  The combining unit 44 combines the image passed from the image search unit 43 and the related information.

  The line control unit 45 switches to a communication line instructed by a communication line selection unit 84 (to be described later) of the management control device 8, and transmits the image synthesized by the synthesis unit 44 and related information to the user terminals 1A and 1B.

  FIG. 16 is a block diagram showing the configuration of the management control device 8.

  As shown in FIG. 16, the management control device 8 includes a user terminal position information unit 81, an object position information unit 82, a communication line monitoring unit 83, a communication line selection unit 84, and a WiMAX area information storage unit 85. , A W-CDMA area information storage unit 86 and a 4G area information storage unit 87.

  The WiMAX area information storage unit 85 stores a plurality of WiMAX base station information # 1 to #N. Furthermore, the WiMAX base station information # 1 includes a plurality of WiMAX terminal information # 1 to #N. The WiMAX base station information # 1 to #N and the WiMAX terminal information # 1 to #N of each WiMAX base station information are position information, transmission speed, usage status, and the like. Similar information is also stored in the W-CDMA area information storage unit 86 and the 4G area information storage unit 87.

  Although omitted from FIG. 16, the management control device 8 is also provided with information storage units for the 2G area, the wireless LAN area, and the Wi-Fi area.

  The user terminal position information unit 81 receives the position information of the user terminals 1A and 1B when the user terminals 1A and 1B photograph and transmit the object 2 via the image search unit 43 of the image search device 4. .

  The target object position information unit 82 receives position information of the target object 2 from the image search unit 43 of the image search device 4.

  The communication line monitoring unit 83 includes the location information of the user terminals 1A and 1B, the location information of the object 2, the base station information such as the WiMAX area, the W-CDMA area, the 4G area 16, and the location information of each terminal information. Are constantly monitored and registered in the WiMAX area information storage unit 85, the W-CDMA area information storage unit 86, and the 4G area information storage unit 87.

  Upon receiving a communication line selection request from the image search unit 43 of the image search device 4, the communication line selection unit 84 receives the user terminal of the image transmission source, the object (the real thing of Tokyo Tower) 2, and the base station of each service area. Based on the position information, it is determined whether or not the user terminal of the image transmission source and the object (the real thing of Tokyo Tower) 2 are in one or more of the same service areas. If it is determined that the user terminal of the image transmission source and the object (Tokyo Tower actual) 2 are in the same service area, the image transmission source user terminal and the object (Tokyo Tower actual) 2 are in the area. Check the status of the communication lines in one or more service areas (in this case, the WiMAX area and the W-CDMA area), and use the communication line with the least number of lines used in the communication lines in the WiMAX area and the W-CDMA area. The communication line having the highest transmission speed) or the communication line with the fastest transmission speed is automatically selected, and the instruction information for selecting the communication line is transmitted to the line control unit 45 of the image search apparatus 4.

  The operation of the captured image utilization system of this embodiment will be described below.

  First, operations of the user terminals 1A and 1B and the management control device 8 will be described.

  FIG. 17 is a flowchart illustrating the operations of the user terminals 1A and 1B and the management control device 8.

  As illustrated in FIG. 17, when the user terminals 1A and 1B photograph the target object 2, the user terminals 1A and 1B transmit the image of the target object 2 and position information to the image search device 4 (step S1).

  The management control device 8 determines whether or not the user terminal that is the image transmission source and the object (the real thing of Tokyo Tower) 2 are in the same service area (step S2).

  If the image transmission source determines that the user terminal 1A is located across the same service area as the object (the real thing of Tokyo Tower) 2, that is, the WiMAX area and the W-CDMA area, the management control device 8 The status of the communication line in the WiMAX area and the W-CDMA area where the user terminal 1A and the target object (the real thing of Tokyo Tower) 2 are located is confirmed, and among the communication lines in the WiMAX area and the W-CDMA area, the used line is The communication line with the fewest communication lines (the communication line with the largest available space) or the communication line with the fastest transmission speed is automatically selected (step S3).

  Thereafter, the user terminals 1A and 1B switch to the communication line selected by the management control device 8 and receive the image of the object 2 and related information from the image search device 4 (step S5).

  On the other hand, if it is determined that the image transmission source is the user terminal 1B located in a different service area from the object (the real thing of the Tokyo Tower) 2, the management control device 8 first has the service in which the user terminal 1B is located. An area is preferentially selected (step S4). In step S3, the management control device 8 uses the communication line with the least number of used lines (communication line with the most available lines) or the communication line with the fastest transmission speed among the communication lines in the service area selected in step S4. Will be selected automatically.

  Next, as the overall operation of the captured image utilization system according to the present embodiment, the W-CDMA area in the W-CDMA area and the WiMAX area where the user terminal 1A that captures the target object (the real thing of Tokyo Tower) 2 is located is included. An operation based on the premise that many other user terminals 1 are located in the WiMAX area will be described.

  FIG. 18 is a flowchart for explaining an example of the overall operation of the captured image utilization system of this embodiment, and FIG. 19 is a diagram for schematically explaining the operation of FIG.

  As shown in FIGS. 18 and 19, first, when the user terminal 1 </ b> A takes a picture of the object (the real thing of Tokyo Tower) 2 as a subject and the image search button 1 a is pressed, the image of the object 2 is transmitted by the transmission / reception unit 12. The position information of the user terminal 1A is transmitted to the image search device 4 via the WiMAX base station 9a in the WiMAX area (step C1) (step C2).

  Next, the image search device 4 searches the image information database 41 for an image of the object 2 by the image search unit 43. As a result, if there is related information and position information associated with the searched image, the image search device 4 transmits the position information of the user terminal 1A and the target object 2 to the management control device 8, and the communication line Is selected (step C5). In response to this, the management control device 8 selects a communication line in the WiMAX area or the W-CDMA area by the communication line selection unit 84. Here, there are many other user terminals 1 in the WiMAX area, the communication lines in the W-CDMA area use fewer lines (there are more vacancies), and the transmission speed is faster. The device 8 selects a communication line in the W-CDMA area, and transmits communication line selection instruction information to the line control unit 45 of the image search device 4 (step C6). On the other hand, if there is no related information and position information associated with the retrieved image, the image retrieval device 4 uses the URL or E-mail address associated with the image retrieved by the image retrieval unit 43. The related information management server 5 is requested to transmit related information and position information (step C3). In response to this, the related information management server 5 extracts the related information and position information of the image requested from the image search device 4 and transmits them to the image search device 4 (step C4). When the communication line selection instruction information is received from the management control device 8, the image search device 4 registers the related information and position information in the image information database 41 by the image search unit 43 and also stores the position information in the management control device 8. To the communication terminal and requests the communication line to be selected, and the combining unit 44 combines the image and the related information, and passes through the W-CDMA base station 10a in the W-CDMA area (step C7), to the user terminal 1A. (Step C8).

  Thereby, since the user terminal 1A receives the related information of the target object 2 via the W-CDMA base station 10a in the W-CDMA area where the number of lines used is small (there are many vacancies) and the transmission speed is high, Information related to the object 2 can be acquired by high-speed download.

  Next, as an overall operation of the captured image utilization system of the present embodiment, among the W-CDMA area and the WiMAX area where the user terminal 1A that captures the object (the real thing of the Tokyo Tower) 2 is located, the area within the WiMAX area is more than that. An operation based on the assumption that many other user terminals 1 are located in the W-CDMA area will be described.

  FIG. 20 is a flowchart illustrating another example of the overall operation of the captured image utilization system according to the present embodiment, and FIG. 21 is a diagram schematically illustrating the operation of FIG.

  As shown in FIGS. 20 and 21, first, when the user terminal 1 </ b> A takes an image of the object (the real thing of Tokyo Tower) 2 as a subject and the image search button 1 a is pressed, the image of the object 2 is transmitted by the transmission / reception unit 12. The position information of the user terminal 1A is transmitted to the image search apparatus 4 via the W-CDMA base station 10a in the W-CDMA area (step D1) (step D2).

  Next, the image search device 4 searches the image information database 41 for an image of the object 2 by the image search unit 43. As a result, if there is related information and position information associated with the searched image, the image search device 4 transmits the position information of the user terminal 1A and the target object 2 to the management control device 8, and the communication line Is selected (step D5). In response to this, the management control device 8 selects a communication line in the WiMAX area or the W-CDMA area by the communication line selection unit 84. Here, there are many other user terminals 1 located in the W-CDMA area, and the communication line in the WiMAX area uses fewer lines (there are more vacancies) and the transmission speed is faster, so the management control is performed. The device 8 selects a communication line in the WiMAX area and transmits communication line selection instruction information to the line control unit 45 of the image search device 4 (step D6). On the other hand, if there is no related information and position information associated with the retrieved image, the image retrieval device 4 uses the URL or E-mail address associated with the image retrieved by the image retrieval unit 43. The related information management server 5 is requested to transmit related information and position information (step D3). In response to this, the related information management server 5 extracts the related information and position information of the image requested from the image search device 4 and transmits them to the image search device 4 (step D4). When the communication line selection instruction information is received from the management control device 8, the image search device 4 registers the related information and position information in the image information database 41 by the image search unit 43 and also stores the position information in the management control device 8. The communication unit 44 requests the communication line to be selected, and the combining unit 44 combines the image and the related information, and transmits it to the user terminal 1A via the WiMAX base station 9a in the WiMAX area (step D7). (Step D8).

  Thereby, since the user terminal 1A receives the related information of the target object 2 via the WiMAX base station 9a in the WiMAX area where the number of lines used is small (there are many vacancies) and the transmission speed is fast, Related information can be obtained by high-speed download.

  FIG. 22 is a diagram illustrating an example of image information registered in the image information database 41.

  As shown in FIG. 22, in the image information database 41, for each target object, an image (photograph) of the target object, the name of the target object, QR-coded related information of the target object, The URL and E-mail address of the related information management server 5 that is the storage source of the related information are registered in association with the position information such as the latitude and longitude of the target object.

As described above, in the present embodiment, when the user terminals 1A and 1B transmit the image of the object 2, the management control device 8 determines that the user terminal and the object (the real thing of Tokyo Tower) 2 are the image transmission source user terminal. It is determined whether or not the user is in the same service area. If it is determined that the image transmission source is the user terminal 1A located in the same service area as the target object (Tokyo Tower actual) 2, the user terminal 1A and the target object (Tokyo Tower actual) 2 are present. Of the communication lines in the service area, the communication line with the least number of lines used (the communication line with the largest available space) or the communication line with the fastest transmission speed is automatically selected and switched. On the other hand, if it is determined that the image transmission source is the user terminal 1B located in a different service area from the target object (the real thing of Tokyo Tower) 2, the service area where the user terminal 1B is located is preferentially selected, Of the communication lines in the selected service area, the communication line with the least number of lines used (the communication line with the largest available space) or the communication line with the fastest transmission speed is automatically selected and switched.
Therefore, the user terminals 1 </ b> A and 1 </ b> B can obtain the effect that the related information of the object 2 can be acquired by high-speed download.

  In the present embodiment, it is also conceivable that the user publishes an image of the object 2 photographed by the user terminal 1A in a book 21 or a publication such as a newspaper, an article, or a magazine. In such a case, the user makes an application for image registration in advance to a company related to the object 2 (here, a company that operates the related information management server 5), and acquires registration recognition information.

  FIG. 23 is a diagram for explaining registration recognition information of an image photographed by the user terminal 1A.

  In this case, the user terminal 1 </ b> A transmits an image registration request for the object 2 to the related information management server 5 and makes an image registration application before the user places the object 2 in the publication. The related information management server 5 transmits the registration recognition information 151 to the user terminal 1 and the image search device 4 when the use of the image is permitted by the company that operates the related information management server 5, and the user terminal 1 and the image search device 4, registration recognition information 151 is registered. The registration recognition information 151 is identification information such as a logo mark, characters, alphanumeric characters, pictures, barcodes, QR codes, URLs, encryption codes, E-mails, and the like.

  The user terminal 1 </ b> A acquires the related information of the target object 2 from the image search device 4 by adding the registration recognition information 151 to a part of the image of the target object 2 and transmitting it to the image search device 4. As shown in FIG. 23, the user posts the related information of the object 2 together with the image and the registration recognition information 151 in publications such as books 21, newspapers, articles, and magazines.

  In addition, although the part which publishes the registration recognition information 151 was made into the lower right of the image in FIG. 23, it is not specifically limited.

  In addition, when the other user terminal 1 has passed through the entrance of the destination based on the image of the object 2 using the registration recognition information 151, the registration of the registration recognition information 151 is performed in advance. The user who applied for the service will be paid a percentage of the usage count from the company that applied for registration as an advertising fee.

  In this embodiment, the information related to the object 2 on which the user terminal 1 has taken an image is displayed on the information processing apparatus 144 that is a computer or server used by the same user as the user terminal 1 shown in FIG. It is possible to manage.

  FIG. 24 is a diagram for explaining a management table of related information managed by the information processing apparatus 144 shown in FIG.

  When the user terminal 1 passes through the entrance of the destination based on the image taken by the user terminal 1 and the settlement process is performed, the information processing apparatus 144 automatically receives the image of the target object, related information about the target object, and the contents of the settlement. Is transmitted and stored in the information processing apparatus 144. In order to automatically transmit these pieces of information to the information processing apparatus 144, the address information of the information processing apparatus 144 is set in advance in the image search apparatus 4 and the settlement processing server 6.

It is a figure which shows the structure of the picked-up image utilization system of the 1st Embodiment of this invention. It is a figure explaining an example of imaging | photography operation | movement by the user terminal shown in FIG. It is a figure explaining the other example of imaging | photography operation | movement by the user terminal shown in FIG. It is a figure explaining the function of the user terminal shown in FIG. It is a block diagram which shows the structure of the image search apparatus shown in FIG. It is a figure which shows an example of the image information registered into the image information database shown in FIG. It is a block diagram which shows the structure of the user terminal shown in FIG. It is a figure which shows an example of the image search result displayed on the screen of the user terminal shown in FIG. It is a figure explaining an example of the operation | movement which permits the user terminal shown in FIG. 1 to pass a gate apparatus. It is a figure explaining the other example of the operation | movement which permits the user terminal shown in FIG. 1 to pass a gate apparatus. 2 is a flowchart for explaining an example of the overall operation of the captured image utilization system shown in FIG. 1. It is a figure which illustrates typically the operation | movement shown in FIG. 7 is a flowchart for explaining another example of the overall operation of the captured image utilization system shown in FIG. 1. It is a figure which shows the structure of the picked-up image utilization system of the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the image search device shown in FIG. It is a block diagram which shows the structure of the management control apparatus shown in FIG. It is a flowchart explaining an example of operation | movement of the user terminal and management control apparatus which were shown in FIG. It is a flowchart explaining an example of the whole operation | movement of the picked-up image utilization system shown in FIG. It is a figure which illustrates typically the operation | movement shown in FIG. 15 is a flowchart for explaining another example of the overall operation of the captured image utilization system shown in FIG. 14. It is a figure which illustrates typically the operation | movement shown in FIG. It is a figure which shows an example of the image information registered into the image information database shown in FIG. It is a figure explaining the registration recognition information of the image image | photographed with the user terminal shown in FIG. It is a figure explaining the management table of the relevant information managed with the information processing apparatus shown in FIG.

Explanation of symbols

1, 1A, 1B User terminal 11 Antenna 12 Transmission / reception unit 13 Control unit 14 Camera 15 Speaker 16 Display unit 17 Storage unit 18 Operation unit 19 RFID tag 1a Image search button 2 Object (subject)
21 books (publications)
2a Gate device 3 Network 4 Image search device 41 Image information database 42 Image extraction unit 43 Image search unit 44 Composition unit 5 Related information management server 6 Account processing server 7 RFID reader 8 Management control device 81 User terminal position information unit 82 Object position Information unit 83 Communication line monitoring unit 84 Communication line selection unit 85 WiMAX area information storage unit 86 W-CDMA area information storage unit 87 4G area information storage unit 9a WiMAX base station 10a, 10b W-CDMA base station 100 satellite 144 Information processing device

Claims (22)

A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
Before the mobile terminal passes through the gate device installed at the entrance of the location corresponding to the relevant information transmitted to the mobile terminal, the settlement processing of the entrance fee to the location where the target is performed is performed. Settlement means,
When the settlement processing is performed by the settlement processing means, the terminal identification information of the mobile terminal is transmitted to the gate device installed at the entrance of the place where the object corresponding to the related information transmitted to the mobile terminal is located And a management means for transmitting the account settlement information to the mobile terminal,
Provided in a gate device installed at each entrance of the place where the plurality of objects are located, and attempts to read information from the mobile terminal at a timing when the mobile terminal passes through the entrance. Reading that permits passage of the gate device when the account settlement information is read and the terminal identification information read from the mobile terminal matches the terminal identification information transmitted from the management means to the gate device And a captured image utilization system. A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
When the related information is transmitted from the image search means to the mobile terminal, the management for transmitting the terminal identification information of the mobile terminal to the gate device installed at the entrance of the place where the object corresponding to the related information exists Means,
Provided in a gate device installed at each entrance of the place where the plurality of objects are located, and attempts to read information from the mobile terminal at a timing when the mobile terminal passes through the entrance. A reading unit that permits passage of the gate device when the read terminal identification information matches the terminal identification information transmitted from the management unit to the gate device;
When the passage of the gate device is permitted, a photographed image utilization system comprising settlement processing means for performing settlement processing for an entrance fee to a place with an object corresponding to the related information transmitted to the mobile terminal.   When a plurality of images are searched from the database, the image search unit assigns a priority to the plurality of images according to the degree of similarity, and related information associated with the image with the highest priority The captured image utilization system according to claim 1, wherein the captured image is transmitted to the mobile terminal. The database further registers, for each of the plurality of objects, an image of the object and location information of the management means that is a storage source of related information of the object,
If there is no related information associated with the image retrieved from the database, the image retrieval unit accesses the management unit based on the location information associated with the image and obtains the related information. The captured image utilization system according to any one of claims 1 to 3. The mobile terminal
A camera for shooting the object;
Image search button and
5. The apparatus according to claim 1, further comprising: a unit that transmits, when the image search button is pressed, a captured image captured by the camera as an image to be searched for by the image search unit to the image search unit. The captured image utilization system according to any one of the above items.   The imaging according to any one of claims 1 to 5, wherein the reading unit reads information from the mobile terminal by performing visible light communication, infrared communication, or non-contact communication with the mobile terminal. Image utilization system. A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
If it is determined whether the mobile terminal and the target object are in the same service area, and it is determined that the mobile terminal and the target object are in the same service area, Management control means for selecting a communication line with the least number of used lines or a communication line with the fastest transmission speed among the communication lines,
The captured image utilization system, wherein the image search means transmits related information to the mobile terminal through a communication line selected by the management control means. A captured image using system that uses a captured image of an object captured by a mobile terminal,
For each of a plurality of objects, a database that associates and registers an image of the object and related information of the object;
An image search means for searching an image similar to an image captured by the mobile terminal from the database and transmitting related information associated with the searched image to the mobile terminal;
If it is determined whether the mobile terminal and the target object are in the same service area, and if it is determined not to be in the same service area, priority is given to one or more service areas in which the mobile terminal is located And a management control means for selecting a communication line with the least number of used lines or a communication line with the fastest transmission speed among the communication lines of the selected service area,
The captured image utilization system, wherein the image search means transmits related information to the mobile terminal through a communication line selected by the management control means.   The captured image utilization system according to claim 7 or 8, wherein the service area includes a 2G, 3G, 4G, WLAN, WiMAX, or Wi-Fi service area. The mobile terminal transmits a registration request for the image for posting the image of the object in a publication to the management means,
The captured image utilization system according to any one of claims 1 to 9, wherein the management means transmits registration recognition information to the mobile terminal when permitting the use of the image.   The content of the related information of the object is notified from the image search means, the content of the closing process is notified from the settlement processing means, and the content of the related information of the object notified from the image search means The photographed image utilization system according to any one of claims 1 to 10, further comprising information processing means for storing the contents of the settlement processing notified from the settlement processing means. A captured image using method that uses a captured image of an object captured by a mobile terminal,
A registration step in which the image search means associates an image of the target object with relevant information of the target object and registers it in the database for each of the plurality of target objects;
A search step in which the image search means searches the database for an image similar to an image taken by the mobile terminal, and transmits related information associated with the searched image to the mobile terminal;
Admission fee to the location where the target is located before the mobile terminal passes through the gate device installed at the entrance of the location where the target corresponding to the related information transmitted to the mobile terminal is located. The settlement step for performing the settlement process of
When the settlement process is performed, the management means transmits the terminal identification information of the mobile terminal to the gate device installed at the entrance of the place where the object corresponding to the related information transmitted to the mobile terminal exists. , A notification step of transmitting the account settlement information to the mobile terminal;
The reading means provided in the gate device installed at the entrance of the place where the object corresponding to the related information transmitted to the mobile terminal passes from the mobile terminal at the timing when the mobile terminal passes through the entrance. Attempts to read information, the settled information is read from the mobile terminal, and the terminal identification information read from the mobile terminal matches the terminal identification information transmitted from the management means to the gate device And a reading step for allowing passage through the gate device. A captured image using method that uses a captured image of an object captured by a mobile terminal,
A registration step in which the image search means associates an image of the target object with relevant information of the target object and registers it in the database for each of the plurality of target objects;
A search step in which the image search means searches the database for an image similar to an image taken by the mobile terminal, and transmits related information associated with the searched image to the mobile terminal;
When the management means transmits related information from the image search means to the mobile terminal, the terminal identification information of the mobile terminal is sent to the gate device installed at the entrance of the place where the object corresponding to the related information exists. A notification step for sending
The reading means provided in the gate device installed at the entrance of the place where the object corresponding to the related information transmitted to the mobile terminal passes from the mobile terminal at the timing when the mobile terminal passes through the entrance. A reading step that attempts to read the information and permits the passage of the gate device when the terminal identification information read from the mobile terminal matches the terminal identification information transmitted from the management means to the gate device;
When the settlement processing means is permitted to pass through the gate device, the photographed image has a settlement step for performing settlement processing of the entrance fee to the place with the target object corresponding to the related information transmitted to the mobile terminal. How to Use.   In the search step, when a plurality of images are searched from the database, the image search unit assigns a priority to the plurality of images according to the similarity and associates the images with the highest priority. 14. The captured image utilization method according to claim 12 or 13, wherein the related information is transmitted to the mobile terminal. In the registration step, for each of the plurality of objects, the image search unit further associates an image of the object with location information of the management unit that is a storage source of related information of the object. Registered with
In the search step, when there is no related information associated with the image retrieved from the database, the image retrieval unit accesses the management unit based on the location information associated with the image. 15. The method for using a captured image according to claim 12, wherein the related information is acquired. The mobile terminal photographing an object with a camera;
The mobile terminal, when an image search button of the mobile terminal is pressed, sending a captured image taken by the camera as an image to be searched in the image search means to the image search means; The captured image utilization method according to any one of claims 12 to 15, further comprising:   17. The information reading device according to claim 12, wherein in the reading step, the reading unit reads information from the mobile terminal by performing visible light communication, infrared communication, or non-contact communication with the mobile terminal. The captured image using method according to the item. A captured image using method that uses a captured image of an object captured by a mobile terminal,
A registration step in which the image search means associates an image of the target object with relevant information of the target object and registers it in the database for each of the plurality of target objects;
A search step in which the image search means searches the database for an image similar to an image taken by the mobile terminal, and transmits related information associated with the searched image to the mobile terminal;
When the management control means determines whether or not the mobile terminal and the target object are in the same service area, and determines that the mobile terminal and the target object are in the same service area, the mobile terminal and the target object are in the range 1 Selecting a communication line with the least number of used lines or a communication line with the fastest transmission speed from among the communication lines in the service area,
In the retrieval step, the image retrieval unit transmits the related information to the mobile terminal through the communication line selected by the management control unit. A captured image using method that uses a captured image of an object captured by a mobile terminal,
A registration step in which the image search means associates an image of the target object with relevant information of the target object and registers it in the database for each of the plurality of target objects;
A search step in which the image search means searches the database for an image similar to an image taken by the mobile terminal, and transmits related information associated with the searched image to the mobile terminal;
If the management control means determines whether or not the mobile terminal and the object are in the same service area, and determines that the mobile terminal and the object are not in the same service area, one or more services in which the mobile terminal is in the service area Selecting an area preferentially, and selecting a communication line with the least number of used lines or a communication line with the fastest transmission speed from among the communication lines of the selected service area,
In the retrieval step, the image retrieval unit transmits the related information to the mobile terminal through the communication line selected by the management control unit.   The captured image utilization method according to claim 18 or 19, wherein the service area includes a 2G, 3G, 4G, WLAN, WiMAX, or Wi-Fi service area. Transmitting the image registration request for the mobile terminal to publish the image of the object in a publication;
The captured image utilization method according to any one of claims 12 to 20, further comprising a step of transmitting registration recognition information to the mobile terminal when the management means is permitted to use the image. The image search means notifying the information processing means of the content of the relevant information of the object;
The settlement processing means notifying the information processing means of the contents of settlement processing;
The information processing means further comprises the step of storing the contents of the related information of the object notified from the image search means and the contents of the settlement process notified from the settlement processing means. 22. The method for using a captured image according to any one of 21.