JP2011187001A - Guide information providing device, guide information providing method, and guide information providing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To simplify content data to be delivered, using provided guide information. <P>SOLUTION: The guide information providing device 1 includes: an image collation module for extracting, as a registration image, an image of high image feature amount from a collation image registered in advance, based on a retrieval image transmitted from a user terminal; a presentation information providing module for providing the user terminal with presentation content information set in advance for the extracted registration image; and a distribution data generating module for acquiring an input designation as a distribution designation request for distribution data, when the input designation is performed to the provided presentation content information, collecting the distribution content information corresponding to the distribution designation request from the preset distribution content information, generating the distribution data comprising the collected contents, and providing the user terminal with the distribution data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a content providing system that provides content information in response to a request from a user.

In exhibitions, theme parks, temples, shopping streets, etc., a guidance information provision system is used to provide users with guidance information such as explanations and map information related to exhibits and buildings posted locally. Has been.
The guide information in the guide information providing system is generally guide content such as image content and audio content, and the guide content is sent from an information providing device such as a server device to a terminal owned by the user. Provided and played back on the terminal display screen and speakers.

When guidance information (guidance content) is provided to a user-owned terminal, the user creates a target image list by extracting, for example, a target image of interest from this guidance information, and a sentence is written in this list. Etc. can be used as the material information of the recorded content in the form of a diary or the like.
Furthermore, the user can use the provided guidance information, and in addition to personal record information, an article for publication in a format that can be published via the Internet and an article for posting in a social networking service (SNS). Can be generated.

  In particular, when generating an article for posting as described above, a user captures an image by combining an object to be captured (object) included in a photograph image captured by the user with a sentence related to the object. You can create diary and blog-style article content with a sense of presence in the field.

As a related technique for this, object information (such as the name of an object) stored in a preset object database is acquired from a captured image, a shooting position, and a shooting direction data for providing information, and the captured image is acquired. A technique for providing data obtained by linking object information to each of the above objects to a terminal is disclosed (Patent Document 1).

  Further, a technique is disclosed in which a user searches his / her location from map information and creates album data by associating a comment, a photograph, or the like with the location information (Patent Document 2).

  Furthermore, as a related technique for this, the content material information related to the entire headline image on the preset content material list screen is displayed, and the user selects the desired material information from this material information, so that the distribution data is displayed. A technique for generating and distributing is disclosed (Patent Document 3).

  Further, as this related technique, an advertisement distribution server that selects advertisement information using a customer search history, customer attribute information, position information, and the like and distributes the advertisement information to the customer is disclosed (Patent Document 4).

  In addition, as a related technology, a system that provides display explanation (guidance information) in which image data obtained by photographing an ID mark is associated with the ID mark is disclosed (Patent Document 5).

  Further, as this related technique, image data is used as key data for search, and direct search processing is performed in which candidate data selected by index search is directly compared with still image data extracted based on key data. A content search technique for supplying a search processing result to a distribution server is disclosed (Patent Document 6).

Furthermore, as this related technique, as a technique for constructing a server system for teaching annotation information, a specimen database in which form information and annotation information are registered,
Receiving means for receiving a photographed image to be searched from a client via a communication line;
Search means for searching and extracting from the specimen database a thing that matches the object to be searched by comparing the captured image with portable information, and a transmission means for sending annotation information of the extracted thing to the client via a communication line; There is disclosed a server system that has an image annotation server including the above and teaches annotation information to a user (Patent Document 7).

JP 2003-16091 A JP 2002-175315 A JP 2006-92310 A JP 2008-160879 A JP 2008-33613 A JP 2008-33613 A JP 2008-33613 A

  However, according to the contents of Patent Documents 1 to 7 and the combination thereof, the user who has received the guidance information understands the guidance information (exhibition explanation) displayed on the terminal and uses the information for distribution data generation. For example, it is necessary to extract the description and information by inputting (as memo information) by writing or keyboard input, etc., and it is necessary to create distribution data such as a diary or a blog based on the extracted information, including guidance information There is an inconvenience that it takes time and effort for generating the data for distribution, which is a heavy burden on the user.

[Object of invention]
The present invention improves the inconvenience of the related technology, and can easily generate content data for distribution in which user-desired information is added to previously set guidance information, and a guidance information providing system It is an object of the present invention to provide a guide information providing method and a guide information providing program.

  In order to achieve the above object, a guidance information providing apparatus according to the present invention is a guidance information providing apparatus having distribution data providing means for providing distribution data in response to a request from a user terminal, and is sent from the user terminal. Image collating means for collating with a collation image registered in advance based on the retrieved image and extracting a collation image whose commonality with the image feature amount in the search image is higher than a certain value as a registered image; and The content information for presentation set in advance corresponding to the registered image and the content information for provision set in correspondence with the content information for presentation are respectively extracted, and the content information for presentation is extracted to the user terminal. The information providing means for presentation provided to the user and the input designation when the input designation for the provided presentation content information is performed. The distribution data is acquired as a distribution designation request for the distribution data, the distribution content information corresponding to the content information for presentation for which the input designation has been performed is collected, and includes the distribution content information and the search image A distribution data generating unit configured to generate distribution data;

  The guidance information providing system according to the present invention includes a guidance information providing device that provides distribution data in response to a request sent via a communication line, and a search image transmitted to the guidance information providing device. A guidance information providing system including a user terminal that requests distribution data corresponding to an image, wherein the guidance information providing device is configured to check with a matching image registered in advance based on a search image sent from the user terminal. Image collation means for performing collation and extracting, as a registered image, a collation image having a commonality with an image feature amount in the search image that is higher than a certain value, and for presentation that is set in advance corresponding to the extracted registered image Each of the content information and the providing content information set corresponding to the content information for presentation is extracted, and the content information for presentation is extracted. Information providing means for providing to the user terminal, and when the input designation for the provided presentation content information is performed, the input designation is acquired as a distribution designation request for the distribution data, and A distribution data generating unit that collects the distribution content information corresponding to the presentation content information for which input is specified, and generates the distribution data including the distribution content information and the search image; It is characterized by that.

  Furthermore, the guide information providing method according to the present invention includes a guide information providing device that provides distribution data in response to a request sent via a communication line, and a search image transmitted to the guide information providing device. A guidance information providing system including a user terminal that requests distribution data corresponding to an image, the guidance information providing method for providing the distribution data to the user terminal, and sent from the user terminal Based on the search image, collation with a pre-registered collation image is performed, and a collation image whose commonality with the image feature amount in the search image is higher than a certain value is extracted as a registration image. Correspondingly, the corresponding presentation content information and the provision content information set in correspondence with the presentation content information are extracted. Providing the presentation content information to the user terminal, and obtaining an input designation as a delivery designation request for the delivery data when an input designation is made for the provided presentation content information, The distribution content information corresponding to the content information for presentation for which input designation has been performed is collected, the distribution data including the distribution content information and the search image is generated, and the distribution data is used as the user device. It is characterized by transmitting to.

  The guide information providing program according to the present invention provides a guide information providing device that provides distribution data (object information, guide information) in response to a request sent via a communication line, and searches the guide information providing device. A guidance information providing system including a user terminal that requests distribution data corresponding to the search image by transmitting an image, and provides the distribution data to the user terminal A collation image that is collated with a collation image registered in advance based on a search image sent from a user terminal and has a higher commonality with the image feature amount in the search image than a certain value is used as a registration image. Corresponding to the image collation function to be extracted, the presentation content information set in advance corresponding to the extracted registered image, and the presentation content information The content information for provision set in the above is extracted, the information provision function for providing the content information for presentation to the user terminal, and the input designation for the content information for presentation provided are performed. If the input designation is acquired as a delivery designation request for the delivery data, the delivery content information corresponding to the presentation content information for which the input designation has been performed is collected, and the delivery content information and the search are collected. A distribution data generation function for generating the distribution data including an image is executed by a computer.

  Since the present invention is configured and functions as described above, the present invention includes means for extracting providing content information related to the search image sent from the user, the providing content information and the search image. Information generating system for generating distribution content data in which user-desired information is added to the provided guidance information. A guidance information providing apparatus, a guidance information providing method, and a guidance information providing program can be provided.

It is a schematic block diagram which shows one Embodiment in the guidance information provision system by this invention. It is a schematic block diagram which shows an example of the internal structure of the guidance information provision apparatus in the guidance information provision system disclosed in FIG. It is a schematic block diagram which shows an example of a function module structure implement | achieved by the program processing of the guidance information provision apparatus in the guidance information provision system disclosed in FIG. It is a schematic block diagram which shows an example of a functional module structure of the delivery data creation module in FIG. It is explanatory drawing which shows an example of the image for designation | designated input designation | designated shown on the user terminal in the guidance information provision system disclosed in FIG. It is a flowchart which shows the operation | movement process step of the search process operation | movement in the guidance information provision system disclosed in FIG. It is a flowchart which shows the operation | movement process step of the delivery process operation | movement in the guidance information provision system disclosed in FIG. It is a schematic block diagram which shows an example of the internal structure of the guidance information provision apparatus in the guidance information provision system disclosed in FIG. It is a schematic block diagram which shows an example of a functional module structure implement | achieved by the program processing of the guidance information provision apparatus in the guidance information provision system disclosed in FIG. It is a schematic block diagram which shows an example of the functional module structure of the delivery data creation module in the guidance information provision apparatus of FIG. It is explanatory drawing which shows an example of the image for designation | designated input designation | designated shown on the user terminal in the guidance information provision apparatus disclosed in FIG. It is a flowchart which shows the operation | movement process step of the delivery process operation | movement in the guidance information provision apparatus disclosed in FIG.

[Embodiment 1]
Next, embodiments for carrying out the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the guidance information providing system as Embodiment 1 of the present invention is based on a search image (search image) sent from the user terminal 100, and guide information content (distributed data) related to this search image. ) Is generated and transmitted to the user terminal.

This will be described in detail below.
As shown in FIG. 2, the guidance information providing device 1 is a server device including a central processing unit (hereinafter referred to as “CPU”) 2, a storage medium 3, and an input / output interface 4.
The CPU 2 controls the functional operation of the guidance information providing apparatus 1 by executing various software programs (computer programs) set in advance in the storage medium 3.

The storage medium 3 is assumed to be storage means such as a hard disk drive (HDD) that stores and holds various software programs and data necessary for the execution.
The input / output interface 4 is used for data communication with the outside of the guidance information providing apparatus 1 and is a communication interface that enables communication between the CPU 2 and an external device via the input / output interface 4.
The input / output interface 4 may be, for example, a connector that relays a communication signal sent from an external device to the communication line, or a device that receives a radio signal. It may be a part of

Here, the guidance information providing apparatus 1 implements the following software modules by executing various software programs set in advance while appropriately referring to information transmitted and received by the CPU 2 from the input / output interface 4.
This will be outlined below.

  The guidance information providing apparatus 1 includes an image collation module 12 that collates a search image sent from the user terminal 100 with a preset collation image, and presents information as information related to the search image (registered image) based on the collation result. Reference data storage means for extracting and storing the guidance content and the distribution guidance content, the information presentation module 14 for presenting the guidance content for presentation to the user, and the guidance content for information presentation presented to the user The information presentation history management module 15 that manages the history information as well as the distribution guidance content based on the distribution request and the history information from the user, and the distribution data content including the distribution content and the search image are generated. And a distribution data creation module 16.

  This will be described in detail below.

As shown in FIG. 3, the guidance information providing apparatus 1 includes an image matching module 12 that performs a matching search between a search image sent from the user terminal 100 and a preset matching image, and a matching search performed by the image matching module 12. The reference data storage module 13 for performing processing for storing the image (registered image) and the search image extracted by the above in a preset storage area, and the guide content for presentation stored in the preset storage area as a user terminal 100, the information presentation module 14 provided to the user terminal 100, the information presentation history management module 15 that acquires and stores information indicating the guidance content for presentation presented on the user terminal 100, and the input designation content sent from the user terminal 100. A distribution data creation module 16 for generating distribution data including the retrieved image, and the function module It includes a body portion 10 comprising a control module 11 for controlling the operation process in the Le.
Note that each functional module is realized by execution processing of a software program by the CPU 2.

  The image collation module 12 includes an image (hereinafter referred to as “search image”) and a storage medium that are input as information search keys by a terminal (hereinafter referred to as “user terminal”) that requests the guidance information providing apparatus 1 to provide information. 3 is collated with an image stored in advance (hereinafter referred to as “collation image”) (image collation function), so that an image corresponding to the search image is extracted as a registered image based on a preset image feature amount (image Search extraction function).

In addition, when the image feature amount calculated from the registered image is stored in a storage area set as a reference data storage module 13 described later, instead of the matching image (or together with the matching image), A setting for performing collation using an image feature amount may be used.
The image matching module 12 may be set to use the following technique as an image matching technique for searching for a registered image corresponding to a search image as the image matching function.
In particular, Patent Document 8 (document image feature value generation apparatus, method, program, and document) includes a signboard or a guide board that includes a character string as an imaging target included in a registered image or a search image. Image collation can be effectively performed by applying the technique disclosed in Image Search Collation Device, Method, Program) and Patent Document 9 (Image Collation Device, Method, Program).

[Patent Document 8]
International number WO2008 / 066542A1
[Patent Document 9]
International number WO2009 / 060975A1

The reference data storage module 13 has a guide content extraction / storage function for storing each of the guide content for presentation and the guide content for distribution preset in correspondence with the registered image in a storage area preset in the storage medium 3. .
Note that the reference data storage module 13 is configured to store an image feature amount (hereinafter referred to as “image feature amount”) calculated in advance from a registered image for use in image matching of the image matching module 12. Good.

The reference data storage module 13 is associated with at least one information presentation guide content and at least one information distribution guide content (one or more types of image feature quantities) for each registered image. Assume that it is stored in a state.
Further, it is assumed that the reference data storage module 13 stores at least one distribution guide content in association with one presentation guide content.

The presentation guidance content is stored corresponding to at least one distribution guidance content, and is information indicating the type and information form of the corresponding distribution guidance content. Further, the presentation guidance content may be information such as a thumbnail that simply displays the content of the corresponding distribution guidance content.
As a result, when a selection designation is made for the presentation guidance content displayed on the user terminal, a distribution in which a distribution guidance content set in advance corresponding to the selected guidance guidance content is incorporated. Data can be generated.

  The information presentation module 14 acquires the presentation guidance content associated with the registered image corresponding to the search image by the image matching module 12 from the reference data storage module 13 and transmits it to the user terminal (reference information). Send function).

The information presentation module 14 has a presentation content transmission function for transmitting the presentation guidance content stored by the reference data storage module to the user terminal 100.
Thereby, the guidance content for presentation is output and displayed on the display screen (display) of the user terminal 100 as the designated input image.
When the guidance content for presentation is an audio file, it is output as a sound from a speaker or headphones set in advance in the user terminal 100. When the presentation guidance content is a data file including audio and image information or a video file, the presentation guidance content is simultaneously output with audio and image information as designated input information. Further, the designation input information may be set to use a presentation unit other than audiovisual.

Alternatively, a display screen for outputting (displaying) the guidance content for presentation and the data for distribution may be provided on the outer surface of the guidance information providing apparatus 1.
Thereby, the guidance content for presentation can be output and displayed on the display screen of the guidance information providing apparatus 1.
In this case, it is assumed that the user can specify and input the guidance content for presentation output on the display screen of the guidance information providing apparatus 1.

Here, when different guidance information for presentation associated with the registered image is stored, the setting may be such that all the extracted guidance content for extraction is provided to the user terminal 100.
In addition, when providing the presentation guidance content to the user terminal 100, the information presentation module 14 generates specific presentation stable content based on the presentation conditions for each user set in advance according to the user's age, sex, and the like. It may be a setting that is selected and presented to the user terminal 100.

  The information presentation history management module 15 has a history information holding function for holding a history of information presentation guidance content presented by the information presentation module 14 and a distribution sent from the user terminal 100 corresponding to each information presentation guidance content. It has a distribution designation information storage function for receiving and holding designation information.

  The distribution data creation module 16 is a distribution data including a search image, distribution guide content specified based on the history information of the information presentation guide content held by the information presentation history management module 15 and distribution designation information, and distribution data ( A distribution content generation function for generating distribution content).

  As shown in FIG. 4, the distribution data creation module 16 is stored by a distribution designation tabulation module 161 that acquires history information of information presentation guidance content held by the information presentation history management module 15 and a reference data storage module 13. A distribution data collecting module 162 for acquiring the distribution guidance content, and a distribution data editing module 163 for generating distribution data including the acquired distribution guidance content and the search image.

The distribution designation totaling module 161 acquires the history information of the guidance content for presentation held by the information presentation history management module 15 and the distribution designation request sent from the user terminal 100, and based on the history information and the distribution designation request, It has a designated presentation content identification function for identifying the guidance content for presentation designated (distribution request) by the user terminal 100.
The distribution data collection module 162 has a function of specifying the distribution guide content set in correspondence with the presentation guide content specified by the distribution designation totaling module 161 and collecting the distribution guide content.
The distribution data editing module 163 has a function of generating distribution data (distribution content) in which the distribution guide content collected by the distribution data collection module 162 and the search image are incorporated.
Here, the distribution data editing module 163 may be configured to generate distribution data based on a preset content format (for example, a blog format).

Here, an example of the distribution data transmitted from the guidance information providing apparatus 1 to the user terminal 100 is shown in FIG.
As shown in FIG. 5, this distribution data is content data in a format in which a search image, a registered image corresponding to the search image, distribution guidance content, and a character input blank are combined.
Note that a plurality of combinations may be combined instead of a combination (corresponding to n = 1).
The blank space for character input is a space for inputting a user's comment for recording by the user or when making a call.

The control module 11 controls input / output of input / output data from the outside (user terminal 100), and controls the operation of each operation module in the guidance information providing device 1 and communication between the operation modules.
In the present embodiment, the control module 11 is configured to include the input / output interface 4, but the configuration is not limited thereto. Further, the input from the user terminal 100 includes an input of a search image, an input of a distribution data distribution destination specified by the user, and distribution designation information input from the user via the guidance information for presentation.

  Moreover, although the said embodiment demonstrated the case where the user terminal 100 and the guidance information provision apparatus 1 were comprised as an apparatus which each isolate | separated, the user terminal 100 was equipped with the outer surface of the guidance information provision apparatus 1, and was integrated. It may be a configuration.

[Description of Operation of First Embodiment]
Next, the operation of the guidance information providing system according to the first embodiment will be outlined.
First, the image collation module 12 performs collation with a collation image registered in advance based on the search image sent from the user terminal 100, and the commonality with the image feature amount in the search image is higher than a certain value. The image is extracted as a registered image (image collation process), and the information presentation module 14 extracts an image having a high image feature amount from the collation image as a registered image, and presenting content set in advance corresponding to the registered image Information and providing content information set corresponding to the presentation content information are extracted, respectively, and the presentation information providing means provides the presentation content information to the user terminal.
Next, when the user terminal 100 performs an input designation for the presentation content information, the distribution data creation module 16 acquires the input designation as a distribution data distribution designation request, and for the presentation for which the input designation has been performed. The distribution content information corresponding to the content information is collected, and the distribution data generation means generates the distribution data including the distribution content information and the search image. Here, the image collation process, the presentation information provision process For the delivery data generation process, the execution content may be programmed and processed.

Next, the operation of the guidance information providing system according to the first embodiment will be described with reference to the flowcharts of FIGS.
Here, as the overall operation in the present embodiment, the search processing operation (A1) of the guidance information providing device 1 that searches for content information for distribution data based on the search image sent from the user terminal 100, and the user terminal 100 A distribution processing operation (A2) for generating distribution data based on the input designation from the terminal and distributing the distribution data to the user terminal 100 will be described.

  First, a search processing operation (A1) that shows a process for extracting presentation guidance content based on a search image in the guidance information providing apparatus 1 and providing it to the user terminal 100 and accepting an input designation from the user terminal 100 is shown in FIG. This will be described based on a flowchart.

  Here, prior to the start of the search processing operation (A1), the guidance information providing apparatus 1 according to the present embodiment includes a data storage area (reference data storage means) included in the reference data storage module 13 in a collation. Assume that image data (second image), presentation guidance content and distribution guidance content associated with each verification image data are stored in advance.

First, the control module 11 receives a search image sent from the user terminal 100 (step S11). Here, the control module 11 activates the image collation module 12 (step S12).
The image collation module 12 selects a high image whose preset image feature quantity approximates the target object included in the search image from the collation images stored in the preset storage area in the storage medium 3. Extract as a registered image (collation image extraction function).
The collation image extraction function may be set to select a plurality of different collation images having a set approximate value of the image feature amount higher than a certain value as registered images.
In this case, it may be set to request the user to select and input a registered image by transmitting different selected registered images to the user terminal 100.
Thereby, even when the image collation module 12 detects a plurality of different objects in the search image, a registered image corresponding to the user-desired object can be reliably selected.

Next, the reference data storage module 13 stores preset presentation storage contents and distribution guide contents corresponding to the extracted registered images (for example, the presentation content storage area and the distribution). Content storage area).
Here, the information presentation module 14 acquires the presentation guidance content corresponding to the registered image from the presentation content storage area and transmits it to the user terminal 100 as the input designation content.
As a result, the presentation guidance content (input designation content) is output on the display screen of the user terminal 100.

Here, it is assumed that the presentation guidance content transmitted to the user terminal 100 is all the presentation guidance content set in correspondence with the registered image.
When a plurality of presentation guidance contents associated with the registered image are stored, the content is set based on user information such as age and gender set in advance corresponding to the user of the user terminal that is the provision destination. The setting may be such that the guide content for presentation is selected based on the selected condition and provided to the user terminal.

Next, the information presentation history management module 15 stores information indicating the guidance content for presentation transmitted to the user terminal 100 as presentation history information (step S13).
Further, the control module 11 detects that the guidance content for presentation has been presented to the user terminal 100, and sets the information distribution designation from the user terminal 100 to a state (acceptance standby state) (step S14).

Here, for example, when the display screen of the user terminal 100 has a touch panel interface, the user taps the icon of the guidance information for presentation displayed on the display screen (performs designation input), Input designation information (distribution designation request) corresponding to the guidance information for presentation designated for input is sent to the control module 11.
Thereby, the control module 11 receives this input designation information.

  Here, for example, when there is only one guide content for presentation, the control module 11 transmits information in a dialog format that prompts the user terminal 100 to input whether or not to distribute the guide content. At the same time, it may be set to acquire information indicating the presence / absence of a distribution request from the user terminal 100.

  In addition, the control module 11 uses the preset timer function to specify the delivery designation when the delivery request (input designation) is not returned from the user terminal 100 within the preset time after the delivery of the guidance information for presentation. It may be set to determine that there is no.

When the control module 11 acquires a distribution designation request from the user terminal 100, the information presentation history management module 15 preliminarily stores information indicating the presence / absence of distribution designation for each of the provided guidance contents provided based on the distribution designation request. Append to the stored history information (step S15).
Here, the control module 11 determines whether or not the entire content search processing A1 corresponding to the search image received in step S11 has been completed (step S16), and when all operation processing steps have been completed (step S16). YES), the content search process A1 is terminated.

In addition, when a search processing end request is sent from the user terminal 100 to the guidance information providing apparatus 1 or when the time specified by the timer function is exceeded, there is no input of the next search image (designated input is If not, it is determined that the search operation has ended.
On the other hand, if the next search image is sent within a preset time, a content search process is newly executed based on this search image (to step S11).

Next, the operation of the content distribution process A2 in the first embodiment will be described based on the flowchart of FIG.
Note that the content distribution processing A2 in the guidance information providing apparatus 1 is performed, for example, when an explicit distribution request instruction is issued from the user terminal 100 (at the time of distribution request), or at a preset date and time.
Here, as described above, a case will be described in which the designation input sent from the user terminal 100 is received as a distribution request instruction.

  First, the distribution designation totaling module 161 of the distribution data creation module 16 specifies the distribution guidance content requested for distribution from the user terminal 100 based on the history information stored by the information presentation history management module 15 (step S21).

Next, the distribution data collection module 162 collects the specified distribution guide content from the storage area of the reference data storage module 13 (step S22).
Next, the distribution data editing module 163 edits (generates) distribution data based on the collected information distribution guide content (step S23). Here, the information distribution guide content specified by the distribution designation tabulation module 161 and the search image are processed.
Next, the control module 11 distributes the generated distribution data to the terminal 100 (transmission data transmission: step S24).

  This distribution data transmission may be distributed by attaching to e-mail, for example. Alternatively, the setting may be stored in a predetermined storage unit on the computer or the computer network.

As described above, in the guidance information providing apparatus 1 according to the first exemplary embodiment, two types of guidance content for presentation and guidance content for distribution are provided using an image (search image) obtained by photographing an object sent from a user terminal as a search key. The content is searched and extracted, and the guidance content for presentation is provided to the user terminal.
Further, the guidance information providing apparatus 1 identifies the corresponding distribution content based on the input designation made by the user for the presentation guidance content, and the distribution data (distribution) including the identified distribution content and the search image. Guide content).

  Thereby, for example, when the search image sent to the guidance information providing apparatus 1 is an image captured by the user, the user can include the photograph taken by himself / herself by including the search image in the distribution data. It is possible to easily generate distribution data (for example, distribution data in a blog format) including information related to the target object (for example, explanatory text related to the target object: target object description information).

  In the first embodiment, the generated distribution data may be distributed at a preset timing. Thereby, the user can periodically create a blog article using an image taken by the user.

[Embodiment 2]
Next, a guidance information providing system as Embodiment 2 according to the present invention will be described. Here, the same reference numerals are assigned to the same portions as those of the first embodiment described above.
In the second embodiment, the device components of the system have substantially the same configuration as that of the first embodiment described above (FIG. 1). In the internal configuration of the guidance information providing apparatus (referred to as 1B) in the second embodiment, FIG. As shown in FIG. 9, a character recognition module 27 is provided, and a distribution data creation module 26 is provided instead of the distribution data creation module 16 in the first embodiment, which is different from the first embodiment.
Here, in order to distinguish from the guide information providing apparatus 1 in the first embodiment, the guide information providing apparatus in the second embodiment is referred to as a guide information providing apparatus 1B.

This will be described in detail below.
Here, the structure of the guidance information provision apparatus 1B which concerns on Embodiment 2 of this invention is demonstrated.
As shown in FIG. 8, the guidance information providing apparatus 1B of the second embodiment has the same internal configuration as the internal configuration in the above-described first embodiment (FIG. 2).

Similarly to the first embodiment, the guidance information providing apparatus 1B executes various software programs set in advance while referring to information transmitted and received from the input / output interface 4 by the CPU 2 as follows. Is realized (FIG. 9).
Here, in the guidance information providing apparatus 1B, the image matching module 12, the reference data storage module 13, the information presentation module 14, and the information presentation history management module 15 are provided with the same functional modules as in the first embodiment. It shall be.

Furthermore, the guidance information providing apparatus 1B includes a character recognition module 27 that performs processing for detecting character information included in the search image, and a distribution data creation module 26 that generates distribution data including the detected character information. Have a configuration. The guidance information providing apparatus 1B includes a control module 21 that controls operation processing in the functional module.
The control module 21 has a function of controlling the operation of the character recognition module 27 in addition to the function of the control module 11 in the first embodiment.

The character recognition module 27 has a character recognition function for detecting and recognizing characters (or character strings) included in a search image. The character recognition module 27 outputs the result of the character recognition process to the distribution data creation module 26.
Note that techniques for recognizing characters (rows) included in an image are disclosed in, for example, Japanese Patent No. 3661774, Japanese Patent Application Laid-Open No. 2006-107205, Japanese Patent No. 3092576, and WO 2005/066682.

  The distribution data creation module 26 uses the search image input from the user terminal 100, the history information of the presentation guidance content held by the information presentation history management module 15, and the distribution set corresponding to the designated presentation guidance content. The distribution data including the guidance content and the character (column) data output from the character recognition module 27 is created.

  As shown in FIG. 10, the distribution data creation module 26 is stored by a distribution designation totaling module 161 that acquires history information of guidance information for information presentation held by the information presentation history management module 15 and a reference data storage module 13. A distribution data collection module 162 that acquires the distribution guidance content that has been acquired, and distribution data that includes the acquired distribution content, search image, and character (column) data output from the character recognition module 27. The distribution data editing module 263 that performs generation is configured.

  For example, as shown in FIG. 11, the distribution data distributed by the guide information providing apparatus 1B is set in accordance with a search image input to the guide information providing apparatus 1B, a registered image corresponding to the search image, and the search image. It is assumed that a plurality (n) of contents obtained by combining the distribution guidance content thus distributed and the character recognition result detected (recognized) by the character recognition module 27 are created in a combined form.

[Description of Operation of Embodiment 2]
Next, the operation of the guidance information providing apparatus 1B according to the second embodiment will be described.
As in the first embodiment, which is the operation content of the second embodiment, the content search processing operation B1 and the content distribution processing operation B2 are performed.
The search processing operation B1 is the same as the search processing A1 operation in the first embodiment described above.

Hereinafter, the content distribution processing operation B2 of the guidance information providing apparatus 1B according to the second embodiment will be described based on the flowchart of FIG.
In the content distribution processing operation B2, as in the case of the content distribution processing A2 in the first embodiment, for example, when an explicit distribution request instruction is issued from the user terminal 100 (at the time of distribution request), or set in advance. Shall be performed at the date and time.
Here, a case where the designation input sent from the user terminal 100 is received as a distribution request instruction will be described.

  First, the distribution designation totaling module 161 of the distribution data creation module 16 specifies the distribution guidance content requested for distribution from the user terminal 100 based on the history information stored by the information presentation history management module 15 (step S21).

Next, the distribution data collection module 162 collects the specified distribution guide content from the storage area of the reference data storage module 13 (step S22).
Next, the character recognition module 27 acquires the recognized character (string) by recognizing the character (string) from all the input search images by a predetermined method (step S25B).
Next, the distribution data creation module 26 (distribution data editing module 263) generates distribution data (step S23B).

  Here, in step S23 (distribution data editing) in the first embodiment, distribution data including the distribution guide content and the search image specified by the distribution designation tabulation module 161 is generated, whereas the second embodiment. In step S24, in addition to the distribution guidance content specified by the distribution designation totaling module 161, for the distribution combining the character (string) recognition result acquired by the character recognition module 27, the distribution guidance content, and the search image. Data shall be generated.

  As a result, even when the distribution guidance content 161 cannot be specified by the distribution designation tabulation module 161 (for example, when the reference data related to the object to be searched is not stored in the reference data storage module 13), it is acquired. It is possible to generate distribution data in which the recognized character string is added as an explanatory text for the search image.

  Next, the control module 11 distributes the generated distribution data to the terminal 100 (distribution data transmission: step S24).

  This distribution data transmission may be distributed by attaching to e-mail, for example, as in the first embodiment. Alternatively, the setting may be stored in a predetermined storage unit on the computer or the computer network.

As described above, in the guidance information providing apparatus 1B according to the second exemplary embodiment, it is possible to effectively reduce the user input load for generating the distribution data related to the search image.
In addition, by presenting the guidance content for presentation, the information distribution guidance content corresponding to the guidance content for information presentation designated by the user and the object image used as a search key are recognized as characters (strings). Distribution data can be generated based on the obtained character string.

Furthermore, it is possible to acquire a character string related to an object for which reference data is not registered in advance. Furthermore, only a part of the acquired character string is modified, and a character string can be copied, deleted, and pasted. It is possible to provide the user terminal with the distribution data edited by attaching the data.
Thereby, it is possible to reduce a user's character string input load. Furthermore, original data for creating information distribution guide content and information presentation guide content in which the acquired character string information is included in the reference data ( It can also be used as reference data.

In the first and second embodiments, in order to realize processing relating to a preset time (determination processing relating to the presence / absence of delivery designation by a timer, information delivery of a designated date / time), a clock is provided in the guidance information providing apparatus 1. It may be a setting having a function or a calendar function. Moreover, you may provide the function to hold | maintain designated time and date.
For example, if distribution is set to be performed at a certain time every day, information distribution guide contents for which distribution is designated within 24 hours will be distributed together, so it is easy to use when creating a diary. Data will be distributed in the form.

  Further, the guidance information providing apparatus according to the first and second embodiments may be set so that the guidance information providing apparatus provides the registered image itself to the user terminal. Thereby, the capacity for storing the guidance content for presentation can be reduced.

  Further, by storing in advance the image feature amount calculated from the registered image in the reference data storage module 13, storing of the registered image can be omitted. At this time, the image collation module 12 uses the image feature amount for image collation. In this case, the registered image in the distribution data is omitted.

  In the first and second embodiments described above, each module executed by the CPU 2 has been described as a program as an example. However, each functional module described above executes a program when the above-described guidance information providing device is realized. By doing so, it can be recognized as a predetermined functional unit. Therefore, a configuration in which some or all of these modules are realized as hardware may be employed.

Note that the registered image, the information presentation guide content, and the information distribution guide content need not necessarily be the same character string.
For example, for a registered image obtained by copying an object in which a character string is described in a certain language (for example, English), information presentation guide content or information distribution guide content described in another language (for example, Japanese) If registered, it can be used in a translation device.

In addition, when the attribute information (age, gender, residential area, preference, etc.) of the user of the guidance information providing device 1 of the first and second embodiments can be acquired, the guidance information providing device 1 presents information according to the acquired attribute. It is good also as a setting which changes the content of the guidance content for business.
For this reason, for example, in addition to storing the guidance content for presentation and the guidance content for distribution in advance for general users, the guidance content for information presentation that is easy to explain is presented assuming that the user is a child. In addition, the configuration may be such that presentation guidance content and distribution guidance content are set so that distribution data including distribution guidance content including information useful for learning at school and home can be generated. .

In addition, by setting information for identifying a product, for example, an image of an object having a model number described in the product as a registered image, the guidance information providing apparatus of the present embodiment searches for product information. Can be used to
In this case, the guidance content for presentation may include information related to product characteristics. In addition, information useful for purchase may be included in the information distribution guide content.
It is also possible to update at least one of the information presentation guide content and the information distribution guide content as needed to include information that was not known at the time of product launch regarding safety and the like.
Thereby, for example, the user of the guidance information providing apparatus can search for information related to the safety and the like of a previously released product including information updated after the release.

Also, by setting a newspaper or magazine article printed on paper as a registered image, the guidance information providing apparatus of this embodiment can be used to search for newspaper or magazine articles.
As a result, it is difficult to find newspapers, magazines and other related information described in other issues related to the articles from articles of newspapers and magazines printed on paper.
However, on a computer network, for example, a related article can be browsed by attaching a link.
In addition, if the information presentation guidance content and the information distribution guidance content include other issues or other related information, such problems can be improved.

  Furthermore, it is also possible to use a guidance information providing device to search for stores. For example, a signboard of a store may be used as the registered image, a menu or a map may be included as the information presentation guide content, and a discount coupon or a map may be included as the information distribution guide content.

In addition, the information presentation guidance content and the information distribution guidance content in the guidance information providing apparatus of Embodiments 1 and 2 may be prepared by the user himself / herself and used to evoke the user's own memory.
For example, if a photograph taken of an object when it was visited in the past is stored as a registered image and a record at that time is stored as information presentation guidance content or information distribution guidance content, the same object is photographed again and searched. When an image is used, it is possible to receive presentation / delivery of past records.

  Here, if the registration image, the information presentation guidance content, and the information distribution guidance content are permitted to be disclosed to other users, the registered image when the other user uses the guidance information providing device, the information distribution guidance content, It can also be used as guide content for information presentation. For example, it is possible to provide such a function to the user at a site on the Internet, a social networking service (SNS), or the like.

  The present invention generates distribution data including a camera device that captures an object, information related to the object image in the captured image data (object information), and the captured image data. The present invention can be usefully applied to a content generation system including a distribution data generation device.

1, 1B Guidance information providing device 2 Central processing unit (CPU)
DESCRIPTION OF SYMBOLS 3 Storage medium 4 Input / output interface 11, 21 Control module 12 Image collation module 13 Reference data storage module 14 Information presentation module 15 Information presentation history management module 16, 26 Distribution data creation module 27 Character recognition module 161 Distribution designation totalization module 162 Distribution Data collection module 163, 263 Distribution data editing module

Claims (10)

A guide information providing apparatus having distribution data providing means for providing distribution data in response to a request from a user terminal,
Image collation that collates with a pre-registered collation image based on a search image sent from a user terminal and extracts a collation image whose commonality with an image feature amount in the search image is higher than a certain value as a registered image Means,
The presentation content information preset corresponding to the extracted registered image and the provision content information set corresponding to the presentation content information are respectively extracted, and the presentation content information is extracted from the user Presentation information providing means to be provided to the terminal;
When an input designation is made for the provided presentation content information, the input designation is acquired as a delivery designation request for the delivery data, and the delivery corresponding to the presentation content information for which the input designation is made An apparatus for providing guidance information, comprising: distribution data generation means for collecting content information and generating the distribution data including the distribution content information and the search image. In the guidance information provision device according to claim 1,
Information related to the presentation content information provided to the user terminal is stored as history information, and the distribution corresponding to the presentation content information designated by the user terminal based on the history information A guidance information providing apparatus comprising a distribution content specifying means for specifying content. In the guidance information provision apparatus according to claim 1 or 2,
Character recognition means for extracting character information included in the sent search image,
The distribution data generation unit generates distribution data including the extracted character information. In the guidance information provision apparatus according to claim 1 or 2,
Character recognition means for extracting character information included in the sent search image,
The distribution data generation unit generates distribution data including the extracted character information and the search image. In the guidance information provision apparatus according to claim 1 or 2,
The delivery data generation means, when an input designation is made for the presentation content information within a predetermined time after the presentation content information is provided, the input designation as a delivery designation request for the delivery data A guide information providing apparatus characterized by having a function for obtaining input designation within time. A guide information providing device that provides distribution data in response to a request sent via a communication line, and a user terminal that requests distribution data corresponding to the search image by transmitting the search image to the guide information providing device A guidance information providing system comprising:
The guidance information providing device includes:
Image collation that collates with a pre-registered collation image based on a search image sent from a user terminal and extracts a collation image whose commonality with an image feature amount in the search image is higher than a certain value as a registered image Means,
The presentation content information preset corresponding to the extracted registered image and the provision content information set corresponding to the presentation content information are respectively extracted, and the presentation content information is extracted from the user Presentation information providing means to be provided to the terminal;
When an input designation is made for the provided presentation content information, the input designation is acquired as a delivery designation request for the delivery data, and the delivery corresponding to the presentation content information for which the input designation is made A guidance information providing system comprising: distribution data generation means for collecting content information and generating the distribution data including the distribution content information and the search image. In the guidance information provision system according to claim 6,
The user terminal is
Presentation content output means for outputting the presentation content information presented by the presentation information providing means;
A guidance information providing system comprising: content input designating means for designating input for the output content information for presentation. In the guidance information provision system according to claim 6 or 7,
The guidance information providing system, wherein the user terminal includes photographing means for photographing an object and image information transmitting means for transmitting the photographed image information as the search image. A guide information providing device that provides distribution data in response to a request sent via a communication line, and a user terminal that requests distribution data corresponding to the search image by transmitting the search image to the guide information providing device A guidance information providing method for providing the distribution data to the user terminal,
A collation with a pre-registered collation image based on the search image sent from the user terminal is performed and a collation image having a commonality with an image feature amount in the search image higher than a certain value is extracted as a registration image,
The presentation content information preset corresponding to the extracted registered image and the provision content information set corresponding to the presentation content information are respectively extracted, and the presentation content information is extracted from the user Provided to the device,
When an input designation is made for the provided presentation content information, the input designation is acquired as a delivery designation request for the delivery data, and the delivery corresponding to the presentation content information for which the input designation is made A guide information providing method comprising: collecting content information; generating the distribution data including the distribution content information and the search image; and transmitting the distribution data to the user device. A guide information providing device that provides distribution data (object information, guide information) in response to a request sent via a communication line, and a search image is transmitted to the guide information providing device, thereby responding to the search image. A guidance information providing system comprising a user terminal that makes a request for distribution data, and a guidance information provision program for providing the distribution data to the user terminal,
Image collation that collates with a pre-registered collation image based on a search image sent from a user terminal and extracts a collation image whose commonality with an image feature amount in the search image is higher than a certain value as a registered image Function and
The presentation content information preset corresponding to the extracted registered image and the provision content information set corresponding to the presentation content information are respectively extracted, and the presentation content information is extracted from the user Information providing function for presentation provided to the terminal,
When an input designation is made for the provided presentation content information, the input designation is acquired as a delivery designation request for the delivery data, and the delivery corresponding to the presentation content information for which the input designation is made A guide information providing program that collects content information and causes a computer to execute a distribution data generation function for generating the distribution data including the distribution content information and the search image.

Images