JP6133967B1 - Information processing system, information processing device, information processing method, information processing program, portable terminal device, and control program therefor - Google Patents

Abstract

An application provides an appropriate service corresponding to user information possessed by a mobile terminal device. A content holding unit that holds an attribute of a user who requests provision of content and a content for guiding the user in association with each other, and an attribute of the user held in the mobile terminal device from the mobile terminal device. A user attribute receiving unit that receives the content, and a content providing unit that provides the mobile terminal device with content for guiding the user corresponding to the received user attribute. [Selection] Figure 1

Description

  The present invention relates to a technique for providing content to a mobile terminal device.

  In the above technical field, Patent Document 1 describes the achievement of input conditions from a sensor selected from an acceleration sensor, GPS (global positioning system), gyro sensor, illuminance sensor, radio wave sensor, NFC (Near Field Communication), and the like. A technique for activating corresponding advertisement information in a mobile terminal is disclosed.

JP 2014-032554 A

  However, in the technique described in the above document, the service provided by the application is common to each sensor, and an appropriate service corresponding to the user cannot be provided.

  The objective of this invention is providing the technique which solves the above-mentioned subject.

In order to achieve the above object, an information processing apparatus according to the present invention provides:
Content holding means for associating and holding identification information of a near field communication signal as activation information for activating content provision processing, the first content, and the second content;
Identification information determination means for determining that the identification information has been received from the mobile terminal device;
When the identification information determination unit determines that the identification information is received, the first content is provided to the portable terminal device and played, and then the second content is provided to the portable terminal device sequentially. Content providing means,
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. , and the second content, Ru Oh in the navigation content that guides the user to the location.

In order to achieve the above object, an information processing method according to the present invention includes:
An identification information determination step for determining that identification information of a short-range communication signal as activation information for activating content providing processing is received from the mobile terminal device;
When the identification information determination unit determines that the identification information is received, the content holding unit holds the identification information, the first content, and the second content in association with each other, and the first content is A content providing step of sequentially providing the second content to the mobile terminal device after being provided to the mobile terminal device and played ;
Only including,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. The second content is navigation content for guiding the user to the place .

In order to achieve the above object, an information processing program according to the present invention provides:
An identification information determination step for determining that identification information of a short-range communication signal as activation information for activating content providing processing is received from the mobile terminal device;
When the identification information determination unit determines that the identification information is received, the content holding unit holds the identification information, the first content, and the second content in association with each other, and the first content is A content providing step of sequentially providing the second content to the mobile terminal device after being provided to the mobile terminal device and played ;
An information processing program for causing a computer to execute the,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. The second content is navigation content for guiding the user to the place .

In order to achieve the above object, a mobile terminal device according to the present invention includes:
Attribute holding means for holding user attributes;
Detection means for detecting identification information of a near field communication signal as an activation condition for activating the content providing process;
A user attribute transmission unit that transmits the identification information and the attribute of the user held in the attribute holding unit to an information processing apparatus that performs the content providing process when the detection unit detects the identification information ;
Content receiving means for receiving second content from the information processing device sequentially after receiving and reproducing the first content from the information processing device in accordance with the identification information and the attribute of the user;
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. Yes, the second content, Ru Oh in the navigation content that guides the user to the location.

In order to achieve the above object, a control program for a mobile terminal device according to the present invention provides
A detection step of detecting identification information of a short-range communication signal as an activation condition for activating content provision processing;
When the identification information is detected in the detection step, the identification information and the user attribute held in the attribute holding means for holding the user attribute are transmitted to the information processing apparatus that performs the content providing process. A user attribute sending step;
A content receiving step of receiving the second content sequentially from the information processing device after receiving and playing back the first content according to the identification information and the attribute of the user;
A control program of a mobile terminal device to execute the computer,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. In addition, the second content is navigation content for guiding the user to the place .

In order to achieve the above object, an information processing system according to the present invention provides:
Content holding means for associating and holding attributes of a user who requests content provision, identification information of a near field communication signal as activation information for activating content provision processing, first content, and second content When,
In the portable terminal device, when the identification information is detected, the identification information and the user's attribute held in the attribute holding means for holding the user's attribute are processed to provide the content from the portable terminal device. User attribute transmission means for transmitting to the processing device;
Referring to the content holding means, the first content corresponding to the identification information and the user attribute is provided from the information processing device to the mobile terminal device and played back, and then the second content is sequentially received. Content providing means provided from the information processing device to the mobile terminal device;
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. , and the second content, Ru Oh in the navigation content that guides the user to the location.

  ADVANTAGE OF THE INVENTION According to this invention, the suitable service corresponding to the user information which a portable terminal device has can be provided with an application.

It is a block diagram which shows the structure of the information processing apparatus which concerns on 1st Embodiment of this invention. It is a conceptual diagram which shows operation | movement of the information processing system containing the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows operation | movement of the portable terminal device in the information processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the information processing system which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the procedure of the content registration process in the information processing system which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the procedure of the content provision process in the information processing system which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the content provision server as an information processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the provision content database which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the smart phone as a portable terminal device which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the user attribute holding | maintenance part which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the content provision server which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the content provision server which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the content registration process which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the content provision process which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the smart phone which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the smart phone which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the application execution process which concerns on 2nd Embodiment of this invention. It is a figure which shows operation | movement of the portable terminal device in the information processing system which concerns on 3rd Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the function structure of the content provision server as an information processing apparatus which concerns on 3rd Embodiment of this invention. It is a figure which shows the structure of the provision content database which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the procedure of the content provision process of the content provision server which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the function structure of the smart phone as a portable terminal device which concerns on 3rd Embodiment of this invention. It is a figure which shows the structure of the user attribute holding | maintenance part which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the procedure of the application execution process of the smart phone which concerns on 3rd Embodiment of this invention. It is a figure which shows operation | movement of the portable terminal device in the information processing system which concerns on 4th Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 4th Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 4th Embodiment of this invention. It is a figure which shows the structure of the provision content database which concerns on 4th Embodiment of this invention. It is a block diagram which shows the function structure of the smart phone as a portable terminal device which concerns on 4th Embodiment of this invention. It is a figure which shows the structure of the user attribute holding | maintenance part which concerns on 4th Embodiment of this invention. It is a flowchart which shows the procedure of the application execution process of the smart phone which concerns on 4th Embodiment of this invention. It is a figure which shows operation | movement of the portable terminal device in the information processing system which concerns on 5th Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 5th Embodiment of this invention. It is a figure which shows other operation | movement of the portable terminal device in the information processing system which concerns on 5th Embodiment of this invention. It is a sequence diagram which shows the procedure of the content provision process in the information processing system which concerns on 5th Embodiment of this invention. It is a block diagram which shows the function structure of the content provision server as an information processing apparatus which concerns on 5th Embodiment of this invention. It is a figure which shows the structure of the provision content database which concerns on 5th Embodiment of this invention. It is a block diagram which shows the function structure of the smart phone as a portable terminal device which concerns on 5th Embodiment of this invention. It is a sequence diagram which shows the procedure of the content provision process in the information processing system which concerns on 6th Embodiment of this invention. It is a figure which shows the structure of the provision content database which concerns on 7th Embodiment of this invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the constituent elements described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them.
[First Embodiment]
An information processing apparatus 100 as a first embodiment of the present invention will be described with reference to FIG. The information processing apparatus 100 is an apparatus for providing content to a mobile terminal device.

  As illustrated in FIG. 1, the information processing apparatus 100 includes a content holding unit 101, a user attribute receiving unit 102, and a content providing unit 103. The content holding unit 101 holds an attribute 111 of a user who requests provision of content and a content 112 for guiding the user in association with each other. The user attribute receiving unit 102 receives the user attribute 121 held in the mobile terminal device 120 from the mobile terminal device 120. The content providing unit 103 provides the mobile terminal device 120 with content 112 for guiding the user corresponding to the received user attribute 111 (121).

  According to the present embodiment, an application provides an appropriate service corresponding to the user information held by the mobile terminal device by associating and holding the user information held by the mobile terminal device and the content for guiding the user. be able to.

[Second Embodiment]
Next, an information processing system including an information processing apparatus according to the second embodiment of the present invention will be described. In the information processing system according to the present embodiment, it is determined that a video or an image captured by a camera that is an imaging unit of the mobile terminal device corresponds to an image registered in advance. If the captured image corresponds to the registered image, the content associated with the registered image and the user attribute acquired from the mobile terminal device is provided to the mobile terminal device and reproduced. This content is preferably selected and registered in advance according to a scenario along the flow line for guiding the user to the location indicated by the registered image. The video or image captured by the camera may be a building or landscape that can be captured from the position of the user, or may be an image including a photograph printed or drawn on a medium. In addition, content for guiding users includes content that introduces the contents of services to be provided, content that introduces products, content that introduces events, content that introduces destinations, and content that guides users to destinations. , Content that introduces the surrounding environment to or from the guidance destination.

  As user attributes held by the mobile terminal device and notified to the information processing device, in this embodiment, the user's general attributes, such as the country-specific region and language used held at the time of contract in the SIM card, etc., or , Weigh in, measure and currency. Note that the user attributes held by the mobile terminal device are not limited to this example. Other examples are shown in the following embodiments.

  For example, a video related to the building or landscape selected from the building or landscape projected from the camera of the mobile terminal device and the user attribute is reproduced. In addition, navigation is performed with the building or landscape as the destination. The user is intrigued by playing the video corresponding to the user attribute, or is more strongly guided to the destination by navigation. The destination may be a sightseeing spot or a tourist facility, or a company, public facility, store, or the like shown in the pamphlet. According to this example, if the destination is a known destination, the user is guided to the destination without hesitation by the route guidance of the mobile terminal device, and if the destination is an unknown destination, the user can be collected by a stronger guidance.

  Note that the content is not limited to promotional videos and navigation. That is, according to a scenario along a flow line for guiding a user based on a captured image or video and a user attribute, content created by a business owner who is also a client of the information processing system of this embodiment is created and registered Makes it a powerful weapon for marketing.

  Hereinafter, the configuration and operation of the present embodiment will be described using user languages as examples of user attributes, but similar effects can be obtained by other user attributes or combinations of user attributes.

《Information processing system》
Hereinafter, with reference to FIG. 2A thru | or FIG. 4B, the structure and operation | movement of an information processing system including the information processing apparatus of this embodiment are demonstrated. In this embodiment, the image matching process is described as being executed in the information processing apparatus as the content providing server. However, the matching process is performed in a portable terminal device capable of high-performance and high-speed processing. The configuration may be such that the result is notified to the information processing apparatus.

(Operation concept)
FIG. 2A is a conceptual diagram showing an operation of the information processing system 200 including the information processing apparatus according to the present embodiment.

  In the information processing system 200, a smartphone (tablet) 210 as a mobile terminal device and a content providing server 230 as an information processing device are connected via a network such as the Internet or the cloud.

  When the smartphone 210 receives the trigger 201 based on the activation information (start condition), the smartphone 210 requests the content providing server 230 to provide the content. To this request message, the user attribute held by the smartphone 210, the language setting 202 in FIG. 2A, is added. In FIG. 2A, English (EN) is used, but languages used all over the world such as Chinese (CN), Korean (KR), Japanese (JP) are included in the language setting 202.

  When a content provision request message including EN that is the language setting 202 from the smartphone 210 is received, the content provision server 230 searches the provision content database for content registered in advance in the language and sends it to the smartphone 210. For example, if the language setting 202 is English (EN), the contents 213, 215, 223, etc. are sorted and sent to the smartphone 210. If the language setting 202 is Chinese (CN), the contents 214, 216, 224, etc. are selected and sent to the smartphone 210.

  On the smartphone 210, the content sent from the content providing server 230 is reproduced and displayed (203). If the content includes sound, it is played back and output as sound. Information provision to the user is not limited to display or audio output. For example, vibration of the smartphone 210 is also included.

  FIG. 2B is a diagram illustrating an operation of the smartphone 210 as a mobile terminal device in the information processing system 200 according to the present embodiment.

  The application of this embodiment for providing content to the smartphone 210 is downloaded and installed on the smartphone 210. Here, the application of this embodiment provides content corresponding to the language used, which is a user attribute held by the smartphone 210, when the imaging information of the smartphone 210 satisfies the content provision conditions. Then, the application (“BR bonus” in FIG. 2B) 211 of the present embodiment is activated.

  For example, an image 212 including a Sekai tree is captured by the camera of the smartphone 210 while the application of the present embodiment is activated. The smartphone 210 or the content providing server 230 determines the sekai tree in the image 212 from the feature amount. If it is determined that the captured image is for the Sekai tree, the content providing server 230 acquires the language used as the user attribute held in the smartphone 210, is related to the Sekai tree, and is the user's language used. Provide and play promotional videos from as content. Next, it provides and executes video content in the user's language, showing navigation that guides the user to the Sekai tree.

  In FIG. 2B, an example of provided content when the user's language is English is shown as an English promotional video 213 and an English navigation 215 in the upper right. On the other hand, examples of provided contents when the user's language is Chinese are shown as a Chinese promotional video 214 and a Chinese navigation 216 in the lower right. In the drawing, detailed portions may not correspond to the language used.

  In FIG. 2B, the user attribute held in the smartphone 210 is represented by the language used, but it may be a measure or currency.

  FIG. 2C is a diagram illustrating another operation of the smartphone 210 as the mobile terminal device in the information processing system 200 according to the second embodiment of the present invention. In FIG. 2C, the same reference numerals are assigned to the same components as in FIG. 2B, and duplicate descriptions are omitted.

  While the application of the present embodiment is activated, an image 222 including, for example, display items and menus of a canteen (sushi restaurant) is captured by the camera of the smartphone 210. The smartphone 210 or the content providing server 230 determines “Nigiri Sushi” in the image 222 from the feature amount. If it is determined that the captured image is targeted for “Nigiri Sushi”, the content providing server 230 acquires the language used as the user attribute held in the smartphone 210 and corresponds to “Nigiri Sushi” of this sushi restaurant. In addition, content that informs the user of materials used, prices, etc. in the user's language is provided and reproduced.

  In FIG. 2C, an example of the provided content when the user's language is English is shown as English content 223 informing the user of the material used, the price, and the like on the upper right. On the other hand, an example of provided content in the case where the user's language is Chinese is shown as Chinese content 223 for notifying the user of materials and prices used in the lower right. In the drawing, detailed portions may not correspond to the language used.

(Constitution)
FIG. 3 is a diagram illustrating a configuration of the information processing system 200 according to the present embodiment.

  A client PC 220 of company A, which is a client, connects to a “BR Bonus server”, which is a content providing server 230 of company B, via the Internet 340, and uploads target images and contents in each language used. The target image and the content in each language used may be existing ones, but it is desirable to use an original adapted to the present embodiment, which is photographed and produced by Company A. Moreover, it is desirable that the content in each language used is content suitable for each language and user rather than translation of Japanese content. Alternatively, a URL address or a navigation system may be embedded in the content, and the next content may be automatically transferred according to the end of the content or a user's skip instruction. In this case, the content or the content of the navigation system may be provided from the external provider 350 based on the URL address.

  In the content providing server 230 of company B, the target image and language used uploaded by the client PC 220 and the content are registered in association with each other. At this time, the color feature amount corresponding to the present embodiment is extracted from the target image, and is used as a collation target and a search key. Company B not only registers the target image uploaded by the client PC 220 and the content in each language used, but also produces a target image and content in each language used in Company B based on the marketing information of Company A. May be provided to Company A. When the target image is an image on a medium such as a printed material, a print material including the target image may be produced and provided by company B. In addition, when the target image is an actual building or landscape, a plurality of matching information is prepared in order to cope with changes in the feature amount of the target image, for example, changes due to differences in direction, season, time, and weather. Alternatively, the target image may be collated with simplified shape information or drawing.

  In the end user's smartphone 210, a dedicated application provided in advance is installed. Then, the application is started. When the target image on the paper medium is picked up by the camera of the smart phone 210 or the smart phone 210 is pointed at the target image while the application is running, the picked-up image is transmitted to the content providing server 230 of the B company. To do. In addition, the user attributes held in the smartphone 210 are transmitted to the content providing server 230. If the smartphone 210 is capable of extracting and collating the image feature amount with high functionality, the feature amount of the target image around the current position is distributed, and the collation result and the user attribute are transmitted to the content providing server 230 of the B company. It may be configured to.

  The content providing server 230 of the company B extracts the feature amount of the received captured image, collates with the feature amount of the target image stored in advance, and distributes the content associated with the collation result and the user attribute to the smartphone 210. Execute. The end user's smartphone 210 receives and reproduces the content associated with the target image and the user attribute from the content providing server 230 and attracts and guides the end user according to the purpose of marketing.

(Content registration sequence)
FIG. 4A is a sequence diagram illustrating a procedure of content registration processing in the information processing system 200 according to the present embodiment.

  In step S411, communication is established between the client PC 220 and the content providing server 230. Next, in step S413, the client PC 220 and the client are authenticated by the content providing server 230 or the authentication server (not shown).

  In step S415, the client PC 220 uploads the first language content to the content providing server 230, and the content providing server 230 registers the first language content corresponding to the language. In step S417, the client PC 220 uploads the nth language content to the content providing server 230, and the content providing server 230 registers the nth language content corresponding to the language. Note that n varies depending on the contents.

  In step S419, the client PC 220 sets activation information for the content providing server 230, and the content providing server 230 registers the activation information and the content in each language in association with the search information so as to be searchable. In the present embodiment, the activation information is a target image and is stored not by image data itself but by a color feature amount.

  Note that the order of steps S415, S417, and S419 may be any order.

(Content provision sequence)
FIG. 4B is a sequence diagram illustrating a procedure of content providing processing in the information processing system 200 according to the present embodiment. 4B shows a sequence in which the content providing server 230 extracts image feature amounts and performs image matching.

  In step S <b> 421, communication is established between the end user's smartphone 210 and the content providing server 230. Next, in step S423, authentication processing of the smartphone 210 and the end user is performed by the content providing server 230 or the authentication server (not shown). If authenticated, the smartphone 210 downloads the application from the content providing server 230 in step S425.

  When the end user intends to receive the service provision of this embodiment, the downloaded application is activated in step 431. Then, an image is captured by the camera of the smartphone 210 while the application is activated, and the captured image and the user attribute (language used) held in the smartphone 210 are transmitted to the content providing server 230 in step S433. In step S435, the content providing server 230 extracts the feature amount of the captured image received from the smartphone 210, and collates it with the feature amount of the target image stored in advance in the content providing server 230.

  If the feature amount of the captured image matches the feature amount of the target image within a predetermined range, in step S437, the content providing server 230 obtains the first language content corresponding to the first language that is the language used in the associated content. Is transmitted to the smartphone 210, and the smartphone 210 reproduces the received first language content and notifies the end user. Alternatively, in step S441, the n-th language content corresponding to the n-th language that is the language used in the associated content is transmitted from the content providing server 230 to the smartphone 210, and the smartphone 210 reproduces the received n-th language content. And notify the end user. FIG. 4B illustrates an example in which the n-th language content is not provided in the content providing server 230, and thus is provided from the external provider 350 in step S439.

《Functional configuration of content providing server》
FIG. 5 is a block diagram showing a functional configuration of the content providing server 230 as the information processing apparatus according to the present embodiment.

  The content providing server 230 includes a communication control unit 501, a registration information receiving unit 502, a provided content database 503, a user registration unit 504, and an application transmission unit 505. The content providing server 230 further includes an image feature matching unit 506, a content acquisition unit 507, a content transmission unit 508, a content reception unit 509, and a user attribute reception unit 510. Note that the captured image received by the image feature matching unit 506 and the user attribute received by the user attribute receiving unit 510 are preferably included in the same message, but are not limited thereto. The provided content database 503 is not included in the content providing server 230, and a dedicated server may be provided outside.

  The communication control unit 501 controls communication between the content providing server 230 and the end user's smartphone 210, the business owner's client PC 220, or the external provider 350. The registration information receiving unit 502 includes an authentication unit that authenticates the client, receives the target image and the content in each language used from the client PC 220, and instructs registration related to the provided content database 503. The provided content database 503 registers the target image and user attribute transmitted from the client PC 220 in association with the content in each language used. Then, when a captured image that matches the target image is received from the smartphone 210, the content associated with the target image and the user attribute (language used) is searched and passed to the content acquisition unit 507. The user registration unit 504 has an authentication unit that authenticates end users, and registers users who receive the service of the information processing system. And the application transmission part 505 transmits an application to the smart phone 210 of the authenticated end user.

  The image feature collating unit 506 extracts the feature amount of the captured image received from the smartphone 210 and collates it with the feature amount of the target image registered in the provided content database 503. If the feature amounts match within a predetermined range, the content acquisition unit 507 is instructed to acquire content associated with the target image and the user attribute (language used) from the provided content database 503. The image feature matching unit 506 instructs the content transmission unit 508 to transmit the content acquired by the content acquisition unit 507 from the provided content database 503. The content acquisition unit 507 acquires content associated with the target image and the user attribute (language used) from the provided content database 503 based on the content acquisition instruction from the image feature matching unit 506. When the content is provided from the external provider 350, the content acquisition unit 507 acquires the content received from the external provider 350 by the content reception unit 509. The content transmission unit 508 transmits the content acquired by the content acquisition unit 507 and associated with the target image and the user attribute (language used) to the smartphone 210. The content reception unit 509 receives content from the external provider 350 and passes it to the content acquisition unit 507. The user attribute reception unit 510 receives the held user attribute (language used) together with the captured image from the smartphone 210 and transmits it to the content acquisition unit 507 for use in content acquisition from the provided content database 503.

(Provided content database)
FIG. 6 is a diagram showing a configuration of the provided content database 503 according to the present embodiment. The provided content database 503 includes an association table 610 that associates an image ID as activation information and a language used as one of user attributes with provided content, and a content storage unit 620 that stores each content. The configuration of the provided content database 503 is not limited to FIG.

  The association table 610 stores the provided content ID 613 in association with the activation information (in this example, the target image ID) 611 and the language ID 612 used. The association table 610 further includes an end-user guidance scenario (marketing flow line) 614 that has created or selected activation information and provided content, and a client ID 615 that is registered in association with the activation information and provided content according to the guidance scenario 614. Remember.

  The content storage unit 620 stores the content 623 and the external content ID 624 in association with the content ID 621 and the language 622 used. When the external content ID 624 is stored, it is provided from the external provider 350.

《Functional configuration of smartphone》
FIG. 7 is a block diagram illustrating a functional configuration of the smartphone 210 as the mobile terminal device according to the present embodiment.

  The smartphone 210 includes a communication control unit 701, a user registration unit 702, an application acquisition unit 703, an application execution unit 704, an imaging unit (camera) 705, a user attribute holding unit 706, an output unit 707, and an input unit. 708.

  The communication control unit 701 controls communication with the content providing server 230 via the network. The user registration unit 702 stores user information and requests the content providing server 230 to register a user. When the user is authenticated and registered, the application acquisition unit 703 acquires the application downloaded from the content providing server 230. The application execution unit 704 operates the smartphone 210 to execute the downloaded application of the present embodiment and receive and reproduce the content associated with the target image and the user characteristics held by the smartphone 210.

  An imaging unit (camera) 705 acquires an image or video by imaging processing. If this application is being executed, the captured image or video is passed to the application in order to collate with the target image. The user attribute holding unit 706 holds an attribute of a user who uses the smartphone 210. In the present embodiment, the user attributes include general attributes that are not limited to the individual user, such as the user's country, territory, and language. The output unit 707 includes a display unit and an audio output unit. The display unit is used as an operation screen such as a menu display for starting an application, a monitor during imaging, or a content reproduction screen. The audio output unit is a speaker and outputs user instruction audio, content reproduction audio, or navigation audio. The input unit 708 includes an operation unit and a voice input unit. The operation unit includes a touch panel and inputs user operation instructions. The voice input unit is at least one microphone and inputs a user operation voice.

(Application execution part)
The application execution unit 704 includes an image information transmission unit 741, an image feature extraction unit 742, an attribute information transmission unit 743, a content reception unit 745, a content reproduction unit 746, and a content end notification unit 747.

  The image information transmission unit 741 transmits the image or video captured by the imaging unit 705 or the feature amount of the image or video extracted by the image feature extraction unit 742 to the content providing server 230. The optional image feature extraction unit 742 extracts the feature amount of the image or video captured by the imaging unit 705, in this example, the color feature amount. The attribute information transmission unit 743 transmits the user attributes held in the user attribute holding unit 706 to the content providing server 230. In FIG. 7, the image information transmission unit 741 and the attribute information transmission unit 743 are separately illustrated, but it is preferable that the image information and the user attribute information are transmitted to the content providing server 230 in the same message.

  The content receiving unit 745 receives content associated with the user attribute transmitted from the target image and attribute information transmitting unit 743 from the content providing server 230. The content playback unit 746 plays back the content received by the content reception unit 745 and outputs the content to the output unit 707. The content end notification unit 747 notifies the content providing server 230 that the content reproduction by the content reproduction unit 746 has been completed. Note that when a plurality of contents are acquired and continuously played back in a sequence, the content end notification unit 747 collectively notifies the end of content playback. On the other hand, when a plurality of contents are downloaded in order, the end of reproduction of each content is notified. Further, when the user instructs the operation unit to stop the subsequent reproduction in the middle of the content reproduction, the operation proceeds to the next content at the first content reproduction, and the reproduction is terminated at the last content reproduction.

(User attribute holding part)
FIG. 8 is a diagram showing a configuration of the user attribute holding unit 706 according to the present embodiment. The user attribute holding unit 706 holds an attribute of a user who uses the smartphone 210 and is used for selecting content provided from the content providing server 230. In addition, although FIG. 8 shows a user's general attribute set, for example at the time of the purchase of the smart phone 210 or the replacement of the SIM card, the user attribute is not limited to these. That is, the user attribute holding unit 706 includes general attributes set at the time of purchasing the smartphone 210, replacement of the SIM card, and the like, as well as individual user attributes set and input based on an input instruction by the user, a content providing server User attributes provided from 230 or external provider 350 may also be retained.

  The user attribute holding unit 706 stores the general attribute 803 of the user in association with the device ID 801 and the user ID of the smartphone 210. The user's general attributes 803 include the user's country area, language used, measure, currency, and the like.

<< Hardware configuration of content providing server >>
FIG. 9 is a block diagram illustrating a hardware configuration of the content providing server 230 according to the present embodiment.

  In FIG. 9, a CPU (Central Processing Unit) 910 is a processor for arithmetic control, and implements the functional components shown in FIG. 5 by executing a program. A ROM (Read Only Memory) 920 stores fixed data and programs such as initial data and programs. The communication control unit 501 controls communication between the content providing server 230 and another device such as the smartphone 210 as a mobile terminal device.

  A RAM (Random Access Memory) 940 is a random access memory used by the CPU 910 as a work area for temporary storage. In the RAM 940, an area for storing data necessary for realizing the present embodiment is secured. The registration start image 941 stores a start image (target image) instructed to be registered by the client PC 220. The activation image feature amount 942 stores a feature amount (a color feature amount in this example) extracted from the registration activation image 941. The registered content 943 stores content including the first language content and the nth language content instructed to be registered from the client PC 220. The received image 944 stores a captured image that is received from the smartphone 210 and collated with the target image. The received image feature value 945 stores the feature value extracted from the received image 944. The collation result (image ID) 946 stores the collation result between the startup image feature amount 942 and the received image feature amount 945. If the collation results match within a predetermined range, the collation result (image ID) 946 also stores an image ID for searching for the content to be provided. The user attribute (used language or the like) 949 stores the user attribute received from the smartphone 210. The provided content 947 stores content corresponding to the user attribute (language used) when the received image matches the activation image within a predetermined range. The transmission / reception data 948 stores data to be transmitted / received via the communication control unit 501.

  The storage 950 stores a database, various parameters, or the following data or programs necessary for realizing the present embodiment. The provided content database 503 is a database that registers startup images, user attributes, and content in association with each other. The storage 950 stores the following programs. The content providing server control program 951 is a program that controls the entire content providing server 230. The content registration module 952 is a module for associating the activation image, user attribute, and content requested for registration from the client PC 220 with the provided content database 503. The content determination module 953 is a module that determines that the captured image or video transmitted from the smartphone 210 is activation information serving as a trigger for providing the content, and selects the content corresponding to the user attribute from the corresponding content. If the captured image or video transmitted from the smartphone 210 is activation information that provides content, the content providing module 954 searches the provided content database 503 for content corresponding to the user attribute held by the smartphone 210 and is searched. It is a module that provides content.

  Note that the RAM 940 and the storage 950 in FIG. 9 do not show programs and data related to general-purpose functions and other realizable functions of each server.

<< Processing procedure of content providing server >>
FIG. 10A is a flowchart showing a processing procedure of the content providing server 230 according to the present embodiment. This flowchart is executed by the CPU 910 in FIG. 9 using the RAM 940, and implements the functional configuration unit in FIG.

  In step S <b> 1011, the content providing server 230 determines whether the activation information from the client PC 220 is a content registration request corresponding to the activation information. If it is the registration information of the activation information and the content corresponding to the activation information, the content providing server 230 authenticates the client in step S1013, and executes the provided content registration process in step S1015.

  If it is not a registration request for the activation information and the content corresponding to the activation information, the content providing server 230 determines in step S1021 whether or not it is a user registration request from the smartphone 210. If it is a user registration request, the content providing server 230 authenticates the user in step S1023. Then, in step S1025, the content providing server 230 provides an application to the smartphone 210 carried by the user.

  If it is neither a content registration request nor a user registration request, the content providing server 230 determines in step S1031 whether or not a captured image is received by the camera, which is activation information according to an application executed by the smartphone 210. . If the captured image is received according to the application, the content providing server 230 authenticates the user in step S1033. In step S <b> 1035, the content providing server 230 executes a content providing process for providing the registered content corresponding to the user attribute (use language) using the captured image as the activation information.

(Content registration process)
FIG. 10B is a flowchart showing a procedure of content registration processing (S1015) according to the present embodiment.

  In step S1041, the content providing server 230 assigns a content registration ID to the authenticated client. In step S1043, the content providing server 230 acquires the first language content from the client PC 220 together with the content registration ID. In step S1045, the content providing server 230 acquires the nth language content from the client PC 220 having the same content registration ID. Further, when there is other content, the content acquisition is repeated.

  In step S1047, the content providing server 230 acquires a target image as activation information from the client PC 220. In step S1049, the content providing server 230 extracts the feature amount of the acquired target image. In step S1051, the content providing server 230 registers the content in the corresponding language in association with the feature amount of the target image and the language used, and notifies the client PC 220 of the completion of registration.

(Content provision processing)
FIG. 10C is a flowchart illustrating a procedure of content providing processing (S1035) according to the present embodiment.

  In step S1061, the content providing server 230 acquires an image or video captured by the smartphone 210 as activation information. In step S1063, the content providing server 230 extracts the feature amount when the captured image itself is acquired, and compares the feature amount with the feature amount of the target image registered in advance when the feature amount is acquired. Then, it is determined whether or not they match within a predetermined range. When the feature value matching process can be executed by the smartphone 210, a matching result is acquired. If there is no matching target image feature amount, the acquired captured image is not activation information, and the process returns without doing anything. In addition, you may notify that it does not correspond with the smart phone 210. FIG.

  When the feature amount of the matching target image is found, the content providing server 230 acquires the user attribute (language used) held by the smartphone 210 in step S1065. In addition, reception of the user attribute from the smart phone 210 in the content provision server 230 may be performed in common in step S1061.

  In step S1067, the content providing server 230 acquires the content associated with the activation information and the user attribute (language used) from the provided content database 503. Then, the content providing server 230 provides the acquired content to the smartphone 210 in step S1069.

  Furthermore, when content is continuously transmitted, the content providing server 230 acquires the second content from the provided content database 503 in step S1071. Then, the content providing server 230 provides the acquired second content to the smartphone 210 in step S1073. The provision of such content is repeated until a predetermined number of provisions. In addition, the first content and the second content may not be acquired and provided sequentially, but may be acquired and provided together with a plurality of content and played back sequentially with the application of the smartphone 210. .

《Smartphone hardware configuration》
FIG. 11 is a block diagram illustrating a hardware configuration of the smartphone 210 according to the present embodiment.

  In FIG. 11, a CPU 1110 is a processor for arithmetic control, and implements a functional component of the smartphone 210 of FIG. 7 by executing a program. The ROM 1120 stores fixed data and programs such as initial data and programs. The communication control unit 701 controls communication with the content providing server 230 in this embodiment.

  The RAM 1140 is a random access memory used by the CPU 1110 as a work area for temporary storage. The RAM 1140 has an area for storing data necessary for realizing the present embodiment. The content providing server address 1141 stores the IP address of the content providing server 230. The registration information 1142 stores terminal information and user information registered in the content providing server 230. The activation information (captured image) 1143 stores a captured image as the activation information of the application of this example. The user attribute information 1144 stores the attribute of the user who uses the smartphone 210 to be transmitted to the content providing server 230. The received content 1145 stores the content corresponding to the user attribute received when the captured image matches the target image. The input / output data 1148 stores data input / output by the input / output device via the input / output interface 1160. The transmission / reception data 1149 stores data to be transmitted / received to / from the content providing server 230 via the communication control unit 701.

  The storage 1150 stores a database, various parameters, or the following data or programs necessary for realizing the present embodiment. The user attribute holding unit 706 holds an attribute of a user who uses the smartphone 210. The storage 1150 stores the following programs. The smartphone control program 1152 is a program that controls the entire smartphone 210. The application program 1153 is an application for acquiring downloaded content. The activation information transmission module 1154 is a module that is included in the application program 1153 and transmits an image or video captured by the imaging unit 705 to the content providing server 230 as activation information. An optional feature amount extraction module 1155 is included in the application program 1153, and is a module for extracting the feature amount of the captured image by the smartphone 210. The attribute information transmission module 1156 is a module that transmits the user attributes held in the user attribute holding unit 706 to the content providing server 230. The content reception / playback module 1157 is a module that receives and plays back a content acquired in accordance with a user attribute using a captured image or video as a startup image. Note that the activation information transmission module 1154 and the attribute information transmission module 1156 may be a common module.

  The input / output interface 1160 performs an interface for controlling data input / output with the input / output device. In the present embodiment, the input / output interface 1160 is connected to an output unit 707 including a display unit and a voice output unit, and an input unit 708 including an operation unit and a voice input unit. The input / output interface 1160 is further connected to an imaging unit (camera) 705, a current position calculation unit (GPS) 1161, and the like.

  Note that the RAM 1140 and the storage 1150 in FIG. 11 do not show programs and data related to general-purpose functions and other realizable functions of the smartphone 210.

《Smartphone processing procedure》
FIG. 12A is a flowchart illustrating a processing procedure of the smartphone 210 according to the present embodiment. This flowchart is executed by the CPU 1110 of FIG. 11 using the RAM 1140, and implements the functional configuration unit of FIG.

  In step S1211, the smartphone 210 determines whether to request user registration for the service provided by the content providing server 230. When requesting user registration, the smartphone 210 transmits user information to the content providing server 230 in step S1213. In step S1215, the smartphone 210 completes the user authentication and registration, and downloads the application of the service transmitted from the content providing server 230. In step S1217, the smartphone 210 displays an icon for starting the application.

  If it is not a user registration request, the smartphone 210 determines whether or not it is an application activation instruction in step S1221. If there is an application activation instruction, the smartphone 210 performs an application execution process in step S1223.

  If the request is not a user registration request nor an application activation instruction, the smartphone 210 determines whether another application is selected in step S1231. In the case of selecting another application, the smartphone 210 executes another application in step S1233.

(Application execution process)
FIG. 12B is a flowchart showing a procedure of application execution processing (S1223) according to the present embodiment.

  At an arbitrary timing after the application is activated, in step S1241, the smartphone 210 captures an image or video by an imaging unit (camera) and acquires activation information. The smartphone 210 determines whether or not the activation condition is satisfied in the optional step S1243. When the smartphone 210 does not have a special activation condition determination function, the smartphone 210 acquires a user attribute from the user attribute holding unit 706 in step S1245. In step S1246, the smartphone 210 transmits the acquired captured image and user attribute information to the content providing server 230.

  In step S1247, the smartphone 210 waits for reception of the content associated with the captured image and the user attribute from the content providing server 230. In the meantime, the smartphone 210 waits for a notification that the activation condition is not satisfied from the content providing server 230 in step S1249. If there is a notification that the activation condition is not satisfied from the content providing server 230, it is determined that the image does not satisfy the activation condition or there is no content corresponding to the user attribute (language used), and the process returns to step S1241 to perform the next imaging. wait. If the content providing server 230 is configured not to notify that the activation condition is not satisfied, a step of determining a timeout may be added.

  If the content is received from the content providing server 230, the smartphone 210 reproduces the received content in step S1251. Next, the smartphone 210 waits for reception of the next content from the content providing server 230 in step S1253. If the next content is received, the smartphone 210 reproduces the received next content in step S1255.

  In step S1257, the smartphone 210 determines whether termination of the application has been instructed. If termination of the application is not instructed, the smartphone 210 returns to step S1241 and waits for the next captured image as activation information. If an application termination instruction is given, the application is terminated.

  According to the present embodiment, by providing content for guiding the user in response to a captured image captured by the mobile terminal device and user information included in the mobile terminal device, user attributes included in the mobile terminal device, for example, It is possible to provide an appropriate service corresponding to the language used, metrology, currency, etc.

[Third Embodiment]
Next, an information processing system including an information processing apparatus according to the third embodiment of the present invention will be described. The information processing system according to the present embodiment differs from the second embodiment in that the application process start in the mobile terminal device is related to position detection including the current position. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the present embodiment, when the current position calculated by the mobile terminal device based on GPS or the like is less than a predetermined distance from the target position, application processing is started and the target position and the mobile terminal device are detected from the information processing device. Content associated with the retained user attributes is provided. In the present embodiment, the predetermined distance is 70 m, but the present invention is not limited to this. A long distance is set when the user is on a vehicle. Also in this embodiment, the content is selected and registered in advance according to a scenario along a flow line for guiding the user to the target position or a place related to the target position.

  As user attributes held by the mobile terminal device and notified to the information processing device, in the present embodiment, in addition to the second embodiment, the attributes are specific to the user's individual, such as gender, age, name, address , History (behavior history etc.), preference etc. are assumed. Note that the user attributes held by the mobile terminal device are not limited to this example.

  From the current position calculated by the portable terminal device carried by the user from GPS or the like, for example, an image or video related to the current position and user attributes is reproduced. Subsequently, navigation to the destination in the image or video may be performed. The user will be intrigued by the playback of images and videos and will continue to be more strongly guided to the destination by navigation. The destination may be a sightseeing spot or tourist facility near the current position, a company, a public facility, a store, or the like. According to this example, users can be gathered to a known destination or an unknown destination by stronger guidance, and guidance can be performed without hesitation by way guidance of the mobile terminal device.

  The provided content is not limited to the promotion video and navigation. In other words, the business owner who is also a client of the information processing system according to the present embodiment creates and registers the content to be provided according to the scenario along the flow line for guiding the user from the current position, thereby enabling powerful marketing. Become a weapon.

《Information processing system》
Hereinafter, the configuration and operation of the information processing system 1300 including the information processing apparatus of this embodiment will be described with reference to FIGS. 13A and 13B.

(Operation concept)
FIG. 13A is a diagram illustrating an operation of the smartphone 210 as a mobile terminal device in the information processing system 1300 according to the present embodiment. In FIG. 13A, the target location is a predetermined downtown (dining hall), and considering the preference as a user attribute, the first content provides a commercial video including the appearance of the sushi restaurant, the store, and the menu (fee). The next content will provide navigation to the sushi restaurant. In FIG. 12A, the same components as those in FIGS. 2B and 2C are denoted by the same reference numerals, and redundant description is omitted. That is, after the application (“BR bonus”) 211 of the present embodiment is started.

  While the application of the present embodiment is activated, the smartphone 210 calculates the current position by the current position calculation unit (GPS). If the smartphone 210 does not have the activation determination function, the calculated current position is transmitted to the content providing server 1330, the distance from the target location 1312 of the current position is calculated, and the distance is less than 70 m (within the range 1313). If so, the content associated with the target location 1312 and user attributes (history, preference, etc.) held by the smartphone 210 is searched and transmitted to the smartphone 210. On the other hand, when the smartphone 210 has the activation determination function, the distance from the target location 1312 to be acquired and held is calculated, and if the distance is less than 70 m, the content associated with the target location 1312 and the user attribute is searched. The content providing server 1330 is requested to provide the content.

  The smartphone 210 or the content providing server 1330 provides and reproduces the video content indicating the promotion video of the sushi restaurant as the first content based on the user's preference in the predetermined cafeteria street at the target location. Then, when the reproduction of the first content ends or when the user gives a reproduction skip instruction, the navigation content for performing navigation to the sushi restaurant that is the target location is executed as the next content. The smartphone 210 can be guided by accurate navigation based on the current position and the target position that do not require the user's position determination.

  In FIG. 13A, an example of provided content when the user's language is English is shown as an English promotional video 1314 and an English navigation 1316 in the upper right. On the other hand, examples of provided contents when the user's language is Chinese are shown as a Chinese promotion video 1315 and a Chinese navigation 1317 in the lower right. In the drawing, detailed portions may not correspond to the language used.

  In FIG. 13A, the user personal attribute held in the smartphone 210 is represented by preference, but it may be age or sex. In FIG. 13A, the language used, which is the general attribute of the user, is combined with the user personal attribute. However, more user attributes may be combined, or content selection based only on the user personal attribute may be performed.

  FIG. 13B is a diagram illustrating another operation of the smartphone 210 as the mobile terminal device in the information processing system 1300 according to the present embodiment. FIG. 13B shows that the target location is in a predetermined building and the user attribute is taken into account, and the content provides navigation to a culture center on the second street in the building. In FIG. 13B, the same reference numerals are assigned to the same components as those in FIG. 2B, and duplicate descriptions are omitted. That is, after the application (“BR bonus”) 211 of the present embodiment is started.

  While the application of the present embodiment is activated, the smartphone 210 waits for reception of a transmission signal from the transmission device 1322 by short-range communication. In FIG. 13B, it is assumed that the transmitting device 1322 is installed at the No. 8 Street Culture Center (South Building 4F). When the smartphone 210 approaches within the short-range communication range 1323, a transmission signal from the transmission device 1322 is received. For example, a beacon is received. The smartphone 210 transmits identification information for identifying the transmission device 1322 and preference information as a user personal attribute to the content providing server 1330. The content providing server 1330 detects from the identification information that the transmitting device 1322 is installed in the No. 8 Street Culture Center (South Building 4F). Then, with reference to the preference information, the navigation to the second street culture center (south ridge 4th floor) is provided to the smartphone 210.

  In addition, since the transmission device is installed in stores other than the No. 8 Street Culture Center (South Building 4th floor), the smartphone 210 also receives those transmission signals. However, the content providing server 1330 determines whether or not to navigate by referring to the preference information as the user personal attribute, instead of navigating to the transmission source store as it is. The smartphone 210 can be guided by accurate navigation to the upper and lower floor target positions that cannot be determined by GPS or the like.

  Further, in FIG. 13B, an example of provided content when the user's language is English is shown as an English navigation 1324 in the upper right section. On the other hand, an example of provided content when the user's language is Chinese is shown as a Chinese navigation 1325 in the lower right. In the drawing, detailed portions may not correspond to the language used.

  In FIG. 13B, the user personal attribute held in the smartphone 210 is represented by preference, but it may be age or sex. In FIG. 13B, the user personal attribute is combined with the language used, which is the general attribute of the user. However, more user attributes may be combined, or content selection based on only the user personal attribute may be performed.

《Content provision server》
FIG. 14 is a block diagram showing a functional configuration of the content providing server 1330 as the information processing apparatus according to the present embodiment. In FIG. 14, the same functional components as those in FIG. 5 are denoted by the same reference numerals, and redundant description is omitted.

  The provided content database 1403 registers the target location and user attribute transmitted from the client PC 220 in association with each other. When the current location corresponding to the target location and the identification signal of the target location included in the received signal are received from the smartphone 210, the content associated with the target location and the user attribute is searched and passed to the content acquisition unit 507. In addition, the position determination unit 1406 receives from the smartphone 210 the current position calculated by the smartphone 210 or the transmission device ID based on the received signal, and determines whether or not a condition for providing content related to the target position is satisfied. Then, the position determination unit 1406 instructs the content transmission unit 508 to transmit the content acquired by the content acquisition unit 507 from the provided content database 1403 corresponding to the user attribute received by the user attribute reception unit 510.

(Provided content database)
FIG. 15 is a diagram showing the configuration of the provided content database 1403 according to this embodiment. The provided content database 1403 includes an association table 1510 that associates the location ID and personal attribute ID as activation information with the provided content, and a content storage unit 1520 that stores each content. In FIG. 15, the same components as those in FIG. Further, the configuration of the provided content database 1403 is not limited to FIG.

  The association table 1510 is associated with the activation information (in this example, the position ID of the target location) 1511 and the personal attribute ID 1512, the provided content ID 613, the end user guidance scenario (marketing flow line) 614, and the registered client ID 615. Remember.

  The content storage unit 1520 stores the content 623 and the external content ID 624 in association with the content ID 621 and the personal attribute 1522.

(Content provision processing procedure)
FIG. 16 is a flowchart showing a procedure of content providing processing (S1035) of the content providing server 1330 according to this embodiment. In FIG. 16, the same steps as those in FIG. 10C are denoted by the same step numbers, and redundant description is omitted. Further, in FIG. 16, one flowchart illustrates the activation of the content providing process by receiving a signal from the transmitting device and the activation of the content providing process when the current position is within a predetermined distance from the target position. These may be implemented separately by separate flowcharts.

  In step S1641, the content providing server 1330 determines whether or not the transmission device ID is received from the smartphone 210. If the transmission device ID is received, the content providing server 1330 acquires a target position (registered position where the transmission device is installed) corresponding to the transmission device ID in step S1642. Thereafter, the content providing server 1330 executes Steps S1065 to S1073.

  On the other hand, when the transmitting device ID is not received, the content providing server 1330 receives the position information calculated by the smartphone 210 from the GPS or the like in step S1643. Then, in step S1644, the content providing server 1330 determines whether the distance to the target position is equal to or less than the threshold value Dm. When the distance is equal to or less than the threshold value Dm, the content providing server 1330 executes steps S1065 to S1073. If the distance exceeds the threshold Dm, the process returns.

《Functional configuration of smartphone》
FIG. 17A is a block diagram illustrating a functional configuration of a smartphone 210 as a mobile terminal device according to the present embodiment. In FIG. 17A, the same functional components as those in FIG. 7 are denoted by the same reference numerals, and redundant description is omitted.

  The application execution unit 704 includes a position information transmission unit 1741 and a position information acquisition unit 1742. The position information transmission unit 1741 transmits the current position of the smartphone 210 calculated by the GPS position calculation unit 1161 to the content providing server 1330. In addition, the position information transmission unit 1741 transmits the transmission device ID included in the signal (beacon) received by the short distance signal reception unit 1705 to the content providing server 1330. The position information acquisition unit 1742 acquires the current position of the smartphone 210 calculated by the GPS position calculation unit 1161. In addition, the position information acquisition unit 1742 acquires a transmission device ID included in a signal (for example, a beacon) received by the short distance signal reception unit 1705.

  The GPS position calculation unit 1161 calculates the current position of the smartphone 210 based on the GPS. The short-range signal receiving unit 1705 receives a short-range communication signal (for example, a beacon) including a transmission device ID from the transmission device. The user attribute holding unit 1706 holds attributes specific to individual users in addition to general user attributes.

(User attribute holding part)
FIG. 17B is a diagram showing a configuration of the user attribute holding unit 1706 according to this embodiment. In FIG. 17B, the same components as those in FIG. 8 are denoted by the same reference numerals, and redundant description is omitted.

  The user attribute holding unit 1706 stores an individual user attribute 1714 in association with the device ID 801 and the user ID 802. The user's individual attribute 1714 includes gender, age, name, address, history (for example, action history), preference, and the like.

(Application execution process)
FIG. 18 is a flowchart showing a procedure of application execution processing (S1223) of the smartphone 210 according to the present embodiment. In FIG. 18, the same steps as those in FIG. 12B are denoted by the same step numbers, and redundant description is omitted.

  In step S1841, the smartphone 210 determines whether a short-range communication signal (for example, a beacon) has been received. If a signal (for example, a beacon) is received, the smartphone 210 extracts the transmission device ID that has transmitted the short-range signal in step S1842.

  On the other hand, when the signal (for example, beacon) is not received, the smartphone 210 acquires the current position of the smartphone 210 calculated based on the GPS in step S1843. If the smartphone 210 has a content provision condition determination function, it is determined in step S1844 whether the distance to the target is equal to or less than Dm. If the smartphone 210 does not have a content provision condition determination function, the process goes through step S1844.

  In step S1845, the smartphone 210 acquires a user attribute (in this embodiment, a user personal attribute) from the user attribute holding unit 1706. Then, in step S <b> 1846, the smartphone 210 transmits the current information of the smartphone 210 or the transmission device ID for identifying the transmission device and the user attribute information to the content providing server 1330. The subsequent processing is the same as in FIG. 12B.

  According to the present embodiment, the mobile terminal device provides the content for guiding the user in response to the position information of the own device or the transmission device ID, and the user information that the mobile terminal device has. It is possible to provide an appropriate service corresponding to the user attributes of the device, for example, the age, sex, history (for example, behavior history) or preference of the user.

[Fourth Embodiment]
Next, an information processing system including an information processing apparatus according to the fourth embodiment of the present invention will be described. In the information processing system according to the present embodiment, compared to the second and third embodiments, the application processing start in the mobile terminal device is not a captured image or position detection, but other date / time information, environment information ( It differs in that it relates to weather information) and biological information. When other date / time information, environment information (weather information), or biological information is used as activation information, a user attribute for selecting provided content is associated with the activation information. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the present embodiment, when the current date and time detected by the time counting unit of the mobile terminal device is close to the target date and time, the processing of the application is started and the target date and time and related user attributes (in this example, Content associated with the user's schedule information) is provided. For example, the target date / time includes the date / time of an event registered in the information processing apparatus, the date / time of a user's schedule table held in the mobile terminal device, and the like. In the present embodiment, in the case of an event, the example is 30 minutes before the start time, but the present invention is not limited to this. When the target date and time approaches, schedule information as user attributes held by the mobile terminal device is sent, and contents are provided in consideration of the contents of the event, schedule, or implementation location. Also in the present embodiment, the provided content is selected and registered in advance according to a scenario along a flow line for guiding the user to the target date and time or a place related to the target date and time.

  From the current time detected by the time measuring unit by the portable terminal device carried by the user, for example, an image or video related to the current time and the schedule information held by the portable terminal device is reproduced. Subsequently, navigation to a destination related to the image or video is performed. The user is intrigued by the reproduction of images and videos and is more strongly guided to the destination by subsequent navigation. The destination may be a sightseeing spot or a sightseeing facility with an event after the current date and time, a company, a public facility, a store, or the like. According to this example, users can be gathered to a destination related to the current date and time and a user attribute held by the mobile terminal device by stronger guidance, and guidance can be made without hesitation by way guidance of the mobile terminal device.

  The content is not limited to the promotion video and the navigation, but according to the scenario along the flow line for guiding the user to the destination related to the current time and the user attribute held by the mobile terminal device. By creating and registering content provided by a business owner who is also a client of the information processing system of the embodiment, it becomes a powerful marketing weapon. In addition, here, an example of providing content corresponding to date and time information as activation information and schedule information as user attributes has been shown, but the activation information is similar in the case of weather information and biological information as environment information. In order to avoid duplication, explanation here is omitted.

《Information processing system》
Hereinafter, the configuration and operation of an information processing system including the information processing apparatus of this embodiment will be described with reference to FIGS. 19A and 19B.

(Operation concept)
FIG. 19A is a diagram illustrating an operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In FIG. 19A, the target date and time is “10:00 on June 24, X”, the first content is an information screen of an event, and the next content is a commercial video of the event or a live video of the venue. The next content is navigation to the venue. In FIG. 19A, the same components as those in FIGS. 2B, 2C, 13A, and 13B are denoted by the same reference numerals, and redundant description is omitted. That is, after the application (“BR bonus”) 211 of the present embodiment is started.

  While the application of the present embodiment is being activated, the smartphone 210 calculates the current date and time 1912 at the time measuring unit. If the smartphone 210 does not have the activation determination function, the calculated current date and time is transmitted to the content providing server 1930, and the time difference from the target date and time 1613 of the current date and time is calculated. Three contents associated with the schedule information held in 1913 and the smartphone 210 are searched and transmitted to the smartphone 210. On the other hand, when the smartphone 210 has the activation determination function, the time difference from the target date 1913 of the schedule table acquired and held is calculated, and if it is less than 30 minutes, the schedule held in the target date 1913 and the smartphone 210 is calculated. It requests the content providing server 1930 to search for and provide the three contents associated with the information.

  Based on the schedule information, the smartphone 210 or the content providing server 1930 displays a display image of an event “Manufacturing ...” or a venue “Big Sight” to be held from “10:00 on June 24, X” that is the target date and time. 1616 is provided and played. Next, when the reproduction of the first content ends or when the user gives a reproduction skip instruction, a live video 1914 of the event venue entrance, the venue, and the guidance booth is provided and reproduced as the next content. Then, when the reproduction of the next content ends or when the user gives a reproduction skip instruction, the navigation 1915 to the booth in the venue, which is the guide location related to the target date and time and schedule information, is further executed as the next content. . The smartphone 210 can be guided by accurate navigation to a target position that does not require the user's position determination.

  In FIG. 19A, although the language used is not considered as the user attribute, it is possible to provide content suitable for the user by combining these languages.

  FIG. 19B is a diagram illustrating another operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In FIG. 19B, the activation information is weather information as environmental information, the first content is a screen of current weather information, the next content is weather-related real-time news, and the next content is a typhoon. Navigation to the evacuation site in case of rain or heavy rain. In FIG. 19B, the same components as those in FIGS. 2B, 2C, 13A, 13B, and 19A are denoted by the same reference numerals, and redundant description is omitted. That is, after the application (“BR bonus”) 211 of the present embodiment is started.

  During the activation of the application of the present embodiment, the smartphone 210 acquires weather information as environment information. For example, weather information is acquired from a thermometer, a hygrometer, an anemometer, a rain gauge, or the like, which is a measuring device included in the smartphone 210 or a measuring device installed in a range where the smartphone 210 can receive a short distance (display screen) 1922). Or you may acquire the seismic intensity information installed in the range which can be received short distance as environmental information. The smartphone 210 transmits the acquired environment information and location information of the user as a user attribute to the content providing server 1930. The content providing server 1930 searches the three pieces of content associated with the weather information and the location information held in the smartphone 210 and provides the retrieved information to the smartphone 210.

  The content providing server 1930 provides and reproduces a display image 1923 such as weather information necessary for the user based on the received weather information and location information. Next, when the reproduction of the first content is completed or when the user gives a reproduction skip instruction, the related real-time weather news is provided as the next content 1924 for reproduction. Then, when the reproduction of the next content is completed or when the user instructs to skip reproduction, if necessary, navigation 1925 to the evacuation site is further executed as the next content in relation to the weather information and the location information. .

  In FIG. 19B, although the language used is not considered as the user attribute, it is possible to provide a content suitable for the user by combining these languages.

  FIG. 19C is a diagram illustrating still another operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In FIG. 19C, the activation information is each piece of measurement information as biometric information, and the user's medical history information and language used held in the smartphone 210 as user attributes are transmitted to the content providing server 1930. The first content provided from the content providing server 1930 corresponding to the user's biometric information, medical history information, and language used is the current medical condition report screen, and the next content is content for navigation to a nearby hospital. In addition, although the smart phone 210 is shown as a portable terminal device in FIG. 19C, it is preferably a wearable device in which an information processing device is mounted on a wristwatch or glasses. In FIG. 19C, the same components as those in FIGS. 2B, 2C, 13A, 13B, 19A, and 19B are denoted by the same reference numerals, and redundant description is omitted. That is, after the application (“BR bonus”) 211 of the present embodiment is started.

  While the application of the present embodiment is activated, the smartphone 210 acquires each piece of measurement information as biological information. For example, biometric information is acquired from a thermometer, a blood pressure monitor, a pulse meter, or the like, which is a measurement device included in the smartphone 210 or the wearable device (see display screen 1932). When the smartphone 210 compares the acquired biometric information with the user's standard data and determines that there is an abnormality or a sign thereof, the smartphone 210 transmits the biometric information, the user's medical history information as the user attribute, and the language used to the content providing server 1930. To do. The content providing server 1930 searches the biometric information, the user's medical history information held in the smartphone 210, and the content associated with the language used, and provides the smartphone 210 with the content. The example of FIG. 19C is a case where the user's language is Korean. The determination of abnormality or sign may be performed by the content providing server 1930.

  The content providing server 1930 provides and reproduces the content necessary for the user based on the received biometric information, the user's medical history information, and the language used. In FIG. 19C, a medical condition report display image 1933 is displayed first. Next, when the reproduction of the first content is completed or when the user skips reproduction, the navigation content 1934 for guidance to a nearby hospital that can cope with the user's symptoms is provided and reproduced.

  Although not shown in FIG. 19C, for example, the content may be content for transmitting biological information to a related doctor or receiving advice from a doctor, instead of content for navigation to a nearby hospital. Alternatively, the content of navigation to the hospital may be biometric information transmission to the doctor who is involved, the content of navigation to the hospital recommended by the doctor, etc.

(Provided content database)
FIG. 20 is a diagram showing a configuration of the provided content database 2003 according to the present embodiment. The provided content database 2003 includes an association table 2010 that associates date and time information as schedule information and schedule information with provided content, and a content storage unit 2020 that stores each content. In FIG. 20, the same components as those in FIG. 6 are denoted by the same reference numerals, and description thereof is omitted. Further, the configuration of the provided content database 2003 is not limited to FIG. 20 shows the configuration of the provided content database 2003 corresponding to FIG. 19A, but the configuration of the provided content database 2003 corresponding to FIG. 19B and FIG. 19C is similar. Omitted.

  The association table 2010 stores provided content ID 613, end user guidance scenario (marketing flow line) 614, and registered client ID 615 in association with activation information (in this example, date and time) 2011 and schedule information 2012.

  The content storage unit 2020 stores a content 623 and an external content ID 624 in association with the content ID 621 and the schedule information 2022.

《Functional configuration of smartphone》
FIG. 21 is a block diagram illustrating a functional configuration of the smartphone 210 as the mobile terminal device according to the present embodiment. In FIG. 21, the same functional components as those in FIG. 7 are denoted by the same reference numerals, and redundant description is omitted. 21 shows the functional configuration of the smartphone 210 corresponding to FIG. 19A, but the functional configuration of the smartphone 210 corresponding to FIG. 19B and FIG. 19C is also similar, so illustration and description are omitted to avoid duplication. .

  The application execution unit 704 includes a date / time information transmission unit 2141 and a date / time information acquisition unit 2142. The date / time information transmission unit 2141 transmits the date / time information measured by the date / time measurement unit (timer) 2105 to the content providing server 1330. The date / time information acquisition unit 2142 acquires the date / time measured by the date / time measurement unit 2105. The date / time measuring unit 2105 measures the date / time using a timer. The user attribute holding unit 2106 holds user attributes such as schedule information.

(User attribute holding part)
FIG. 22 is a diagram showing a configuration of the user attribute holding unit 2106 according to the present embodiment. In FIG. 22, the same reference numerals are given to the same components as those in FIG. 8 or FIG.

  The user attribute holding unit 2106 stores user holding information 2205 as a user attribute in association with the device ID 801 and the user ID 802. The user holding information 2205 includes schedule information and the like.

(Application execution process)
FIG. 23 is a flowchart showing a procedure of application execution processing (S1223) of the smartphone 210 according to the present embodiment. In FIG. 23, steps similar to those in FIG. 12B are denoted by the same step numbers, and redundant description is omitted. FIG. 23 shows the processing procedure of the smartphone 210 corresponding to FIG. 19A, but the processing procedure of the smartphone 210 corresponding to FIG. 19B and FIG. 19C is also similar, so illustration and description are omitted to avoid duplication. .

  At an arbitrary timing after the application is activated, the smartphone 210 acquires date / time information from the date / time measurement unit 2105 in step S2341. In step S2343, the smartphone 210 determines whether the date / time condition is satisfied. If the date / time condition is satisfied, the smartphone 210 acquires schedule information as a user attribute from the user attribute holding unit 2106 in step S2345. Then, in step S2346, the smartphone 210 transmits the acquired date information and schedule information that is user attribute information to the content providing server 1930. The following procedure is the same as FIG. 12B.

  According to the present embodiment, the user of the portable terminal device provides the content for guiding the user in correspondence with the date / time information or the environment information (weather information) and the user information of the portable terminal device. It is possible to provide an appropriate service corresponding to the attribute, for example, the user's schedule information and whereabouts.

[Fifth Embodiment]
Next, an information processing system including an information processing apparatus according to the fifth embodiment of the present invention will be described. In the information processing system according to the present embodiment, compared with the second to fourth embodiments, the user can be guided seamlessly from a place far from the target position to the target position, and the target position having a different number of floors in the vertical direction can be obtained. Also differ in that it can be accurately guided. Since other configurations and operations are the same as those in the second to fourth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the information processing system according to the present embodiment, it is determined that a video or an image captured by a camera that is an imaging unit of the mobile terminal device corresponds to an image registered in advance. If the captured image corresponds to the registered image, the first navigation content associated with the registered image and the user attribute acquired from the mobile terminal device is provided to the mobile terminal device and reproduced. This first navigation content is preferably selected and registered in advance according to a scenario along the flow line for guiding the user to the location indicated by the registered image. The video or image captured by the camera may be a building or landscape that can be captured from the position of the user, or may be an image including a photograph printed or drawn on a medium. For example, the first navigation content is user-guided navigation using a transportation facility that looks far away or is directed to a target location printed on printed matter or the like.

  When the user approaches the location indicated by the registered image or print image, detailed navigation content in the vicinity of the target position is triggered by the current position calculated by the mobile terminal device based on GPS being less than a predetermined distance from the target position. provide.

  When the user arrives at the target building or the like, a short-range communication signal is received from a specific position (for example, a store) in the building or the venue, the communication device ID is acquired from the signal, and the specific position is Provide navigation content. The specific position by this communication apparatus ID can recognize the up-down direction in the same GPS position, such as a different floor in a building.

  In this way, it is possible to seamlessly perform navigation without different operations: traffic movement from a far place to the target position → approach movement to a detailed target position in the vicinity of the target position → arrival at the target position including the top and bottom (floor). The user can be guided to the target position. That is, by creating and registering the content provided by the business owner who is also the client of the information processing system of this embodiment, according to the scenario along the flow line for guiding the user based on the activation information and the user attribute, It becomes a powerful weapon for marketing.

  Hereinafter, the configuration and operation of this embodiment in an example in which the language used is set as the user attribute will be described.

《Information processing system》
Hereinafter, with reference to FIG. 24A thru | or FIG. 24C, the structure and operation | movement of an information processing system including the information processing apparatus of this embodiment are demonstrated. 24A to 24C, the same reference numerals are assigned to the same components as in FIGS. 2B, 2C, 13A, and 13B, and duplicate descriptions are omitted.

(Operation concept)
FIG. 24A is a diagram illustrating an operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In addition, in the smart phone 210, the content provision application of this embodiment shall already be started.

  The user holds the smartphone 210 at Haneda Airport and captures a target tree, the Sekai tree. A captured image including a sekai tree is transmitted from the smartphone 210 to a content providing server (not shown).

  The content providing server determines that the target of the captured image is the Sekai Tree, and is the content for transportation navigation from Haneda Airport to Oshiage Station nearest to the Sekai Tree, and the English received as the user's language from the smartphone 210 Content 2412 is provided to the smartphone 210. The user moves based on English content 2412 for transportation navigation to Oshiage Station nearest to the Sekai Tree.

  When the user arrives around Oshiage Station, the smartphone 210 transmits the current position calculated based on the GPS to the content providing server.

  The content providing server determines that the distance between the current position of the smartphone 210 and the Sekai tree is equal to or less than the threshold value Dm, and is content for walking navigation from the vicinity of Oshiage Station to the elevator exit for the observation deck of Sekai Tree Town 2410. And the English content 2413 received as a user's language from the smart phone 210 is provided to the smart phone 210. The user moves based on English content 2413 for walking navigation from the vicinity of Oshiage Station to the elevator exit for the observation deck.

  When the user enters the building with the elevator exit for the observatory, the smartphone 210 receives a signal (including a beacon) from the transmitting device installed at the elevator exit, and transmits the transmitting device ID to the content providing server. To do.

  The content providing server recognizes that it is an elevator exit from the transmitting device ID received from the smartphone 210, and is content for navigation in the building from the entrance of the location where the elevator exit is located to the elevator to the observation deck, and The English content 2414 received from the smartphone 210 as the user's language is provided to the smartphone 210. The user moves based on the English content 2414 for in-building navigation from the entrance to the observatory elevator.

  In this way, content for transportation navigation from Haneda Airport to around Oshiage Station, content for walking navigation from around Oshiage Station to the place with the elevator exit for the observation deck, and from the entrance to the elevator in front of the observation deck The content for navigation in the building can be seamlessly shifted without any user operation, and can be guided to the front of the elevator to the observation deck of the Sekai Tree that captured the user.

  FIG. 24B is a diagram illustrating another operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In addition, in the smart phone 210, the content provision application of this embodiment shall already be started.

  The user images a ticket 2421 that is a target image with the camera of the smartphone 210 at an arbitrary place. A captured image of the ticket 2421 including the venue and seat number is transmitted from the smartphone 210 to a content providing server (not shown).

  The content providing server is the content for transportation navigation from the current position to the nearest international stadium station (or Sendagaya Station, Shinanomachi Station, etc.), assuming that the target of the captured image is an international stadium, and The English content 2422 received from the smartphone 210 as the user's language is provided to the smartphone 210. The user travels based on English content 2422 for transportation navigation to the nearest international stadium station.

  When the user arrives around the international stadium station, the smartphone 210 transmits the current position calculated based on the GPS to the content providing server.

  The content providing server determines that the distance between the current position of the smartphone 210 and the international stadium is equal to or less than the threshold value Dm, and is content for walking navigation from around the international stadium station to the international stadium entrance, and The English content 2423 received from the smartphone 210 as the user's language is provided to the smartphone 210. The user moves based on English content 2423 for walking navigation from around the international stadium station to the international stadium entrance.

  When the user enters from the international stadium entrance, the smartphone 210 receives a signal (including a beacon) from a transmitting device installed in the seat, and transmits the transmitting device ID to the content providing server.

  The content providing server recognizes the seat position from the transmission device ID received from the smartphone 210, is a content for navigation in the international stadium from the international stadium entrance to the reserved seat, and the language used by the user from the smart phone 210 The English content 2424 received as is provided to the smartphone 210. The user moves based on the English content 2424 for navigation within the international stadium from the international stadium entrance to the reserved seat.

  In this way, content for transportation navigation from any location to the international stadium, content for walking navigation from the international stadium to the international stadium entrance, and inside the building from the international stadium entrance to the reserved seats. The navigation content can be seamlessly shifted without user operation, and the user can be guided to the reserved seat of the ticket 2421.

  FIG. 24C is a diagram illustrating still another operation of the smartphone 210 as the mobile terminal device in the information processing system according to the present embodiment. In addition, in the smart phone 210, the content provision application of this embodiment shall already be started.

  The user images a brochure 2431 that is a target image with the camera of the smartphone 210 at an arbitrary location. The captured image 2432 of the pamphlet 2431 is transmitted from the smartphone 210 to a content providing server (not shown).

  The content providing server determines that the target of the captured image 2432 is the culture center (4th floor of South Street) of Ichiban-gai and is for transportation navigation from the current position to the nearest Takamatsu Station (or Takamatsu Airport, Takamatsu Port, etc.) And the English content 2433 received as the user's language from the smartphone 210 is provided to the smartphone 210. The user moves based on English content 2433 for transportation navigation to the nearest Takamatsu station.

  When the user arrives around Takamatsu Station, the smartphone 210 transmits the current position calculated based on the GPS to the content providing server.

  The content providing server determines that the distance between the current position of the smartphone 210 and the second street is equal to or less than the threshold value Dm, and is content for walking navigation from around Takamatsu Station to the first street, and from the smartphone 210 to the user The English content 2434 received as the language used is provided to the smartphone 210. The user moves based on the English content 2434 for walking navigation from around Takamatsu Station to Ichiban Street Exit.

  When the user enters from the second street entrance, the smartphone 210 receives a signal (including a beacon) from a transmitting device installed in the culture center, and transmits the transmitting device ID to the content providing server.

  The content providing server recognizes that the culture center is on the 4th floor of the south street from the transmission device ID received from the smartphone 210, and is the content for navigation in the second street from the second street entrance to the culture center, and the smartphone The English content 2435 received as the user's language from 210 is provided to the smartphone 210. The user moves based on the English content 2435 for navigation in the No. 1 street from the No. 2 street entrance to the culture center.

  In this way, content for transportation navigation from any location to around Takamatsu Station, content for walking navigation from around Takamatsu Station to Number 1 Street Exit, and navigation for Number 1 Street from Number 1 Street Exit to Culture Center The content can be seamlessly shifted without user operation, and the user can be guided to the culture center advertised in the brochure 2431.

(Content provision sequence)
FIG. 25 is a sequence diagram showing a procedure of content providing processing in the information processing system according to the present embodiment. In FIG. 25, steps are given the same step numbers as in FIG. 4B, and redundant descriptions are omitted.

  When the images match as a result of the image matching, the content providing server 2530 according to the present embodiment provides the smartphone 210 with the language content (transportation navigation) up to the target position corresponding to the image in step S2537.

  In addition, when the current position information is transmitted from the smartphone 210 to the content providing server 2530 in step S2543, the content providing server 2530 determines whether the distance between the target position and the current position is within the threshold Dm in step S2545. . If the distance between the target position and the current position is within the threshold value Dm, the content providing server 2530 provides the use language content (walking navigation) up to the target position to the smartphone 210 in step S2547.

  In addition, when the short-range communication device ID is transmitted from the smartphone 210 to the content providing server 2530 in step S2553, the content providing server 2530 analyzes the device ID in step S2555 and specifies the position of the transmitting device. In step S2557, the content providing server 2530 provides the use language content (in-place navigation) up to the installation position of the transmitting device to the smartphone 210.

《Functional configuration of content providing server》
FIG. 26 is a block diagram showing a functional configuration of the content providing server 2530 as the information processing apparatus according to the present embodiment. In FIG. 26, the same functional components as those in FIG. 5 or FIG. 14 are denoted by the same reference numerals, and redundant description is omitted.

  The content providing server 2530 has a configuration in which the functional configurations in FIG. 5 or FIG. 14 are combined. The provided content database 2603 of the content providing server 2530 stores content using the captured image as activation information and content using the position information as activation information. In addition, the content acquisition unit 2607 acquires the content associated with the captured image and the user attribute or the content associated with the position information and the user attribute from the provided content database 2603. Then, the content transmission unit 2608 takes into account the user attribute held by the content acquisition unit 2607 in the smartphone 210 using the image matching result by the image feature matching unit 506 or the position determination result by the position determination unit 1406 as a trigger. The acquired content is provided to the smartphone 210.

(Provided content database)
FIG. 27 is a diagram showing a configuration of the provided content database 2603 according to the present embodiment. In FIG. 27, the same components as those in FIG. 6 or FIG.

  The provided content database 2603 provides the content corresponding to the user attribute with the captured image content table 2710 for providing the content corresponding to the user attribute using the captured image as the activation information, and the current position information as the activation information. A content table for current position 2720, and a signal reception content table 2730 for providing content corresponding to user attributes using signal reception as activation information. In this embodiment, a common target place ID 2711 indicating a target place is set in each table, and each provided content is content that guides the user to the same target position. Further, a common language ID 612 is set as a user attribute in each table, and each provided content has the same language. The target position ID may be set so that the target location of each table is divided into the nearest station → the entrance of the venue → the seat or the store.

  The captured image content table 2710 is associated with the activation information (image ID) 611, the target place ID 2711, and the language ID 612, the transportation navigation content ID 2713, the guidance scenario 2714 that associates the three navigations, the client ID 615, Remember.

  The current position content table 2720 stores a walking navigation content ID 2723 in association with the activation information (position ID) 1511, the target place ID 2711, and the language used 612.

  The signal reception content table 2730 stores the on-site navigation content ID 2733 in association with the activation information (transmission signal ID) 2731, the target place ID 2711, and the language used 612.

  These three navigation contents do not require any user operation by seamlessly shifting according to the guidance scenario 2714 as indicated by the arrows shown at the left end of FIG. Note that the migration of navigation content is not limited to three, and may be two or four or more.

《Functional configuration of smartphone》
FIG. 28 is a block diagram illustrating a functional configuration of the smartphone 210 as the mobile terminal device according to the present embodiment. In FIG. 28, the same reference numerals are assigned to the same functional components as those in FIG. 7 or FIG. 17A, and duplicate descriptions are omitted.

  The functional configuration of the smartphone 210 is the position information (of the smartphone 210) that receives the image information and the content corresponding to the user attribute corresponding to the user attribute and provides them to the user, and the position shown in FIG. (Including the current position or the installation position of the transmission device) and the reception of the content corresponding to the user information and the provision to the user. Therefore, a functional configuration is obtained by adding the functional configuration of FIG. 7 and the functional configuration of FIG. 17A.

  According to the present embodiment, when a user is guided to a predetermined target position, the user can be guided seamlessly from a location far from the target position to the target position in accordance with the user attribute. In particular, it is possible to accurately guide to target positions having different floors in the vertical direction.

[Sixth Embodiment]
Next, an information processing system including an information processing apparatus according to the sixth embodiment of the present invention will be described. The information processing system according to the present embodiment is different from the second to fifth embodiments in that user attributes set in the mobile terminal device based on history information that cannot be accumulated in the mobile terminal device are used. . Since other configurations and operations are the same as those in the second to fifth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

(Content provision sequence)
FIG. 29 is a sequence diagram showing a procedure of content providing processing in the information processing system according to the present embodiment. In FIG. 29, steps similar to those in FIG. 4B are denoted by the same step numbers, and redundant description is omitted.

  In step 2932, user attributes held by the smartphone 210 are transmitted from the content providing server 230 or the external provider 350. In the content providing server 230 or the external provider 350, the history (for example, behavior history) of each user is accumulated, and various user attributes are generated based on the accumulated data and provided to the smartphone 210. The smartphone 210 holds user attributes received from the content providing server 230 or the external provider 350 in addition to the user attributes set at the time of contract or set by the user.

  According to the present embodiment, content suitable for the user can be provided using the user attribute set in the mobile terminal device based on the history information that cannot be accumulated in the mobile terminal device.

[Seventh Embodiment]
Next, an information processing system including an information processing apparatus according to the seventh embodiment of the present invention will be described. In the information processing system according to the present embodiment, compared with the second to sixth embodiments, the application processing start in the mobile terminal device is performed with various information or a combination thereof, and an appropriate user is selected. It is different in that attributes can be notified and content suitable for the user can be provided. Since other configurations and operations are the same as those in the second to sixth embodiments, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

(Provided content database)
FIG. 30 is a diagram showing a configuration of the provided content database according to the present embodiment. The contents of the trigger (activation information), user attribute information, and content are not limited to those in FIG.

  In the present embodiment, color image information, position information, date and time information, audio information, direction information, acceleration information, speed information, illuminance information, environment, which can be acquired by a mobile terminal device such as a smartphone as a trigger (startup information) 3010 Any one or a combination of information, biological information, and received signal information is registered. The received signal information is particularly preferably a beacon including a transmission device ID used for short-range (proximity) communication. Environmental information includes information such as temperature and humidity, and biological information includes body temperature and blood pressure. A thermometer, a hygrometer, etc. are incorporated in the acquisition of environmental information. In addition, a wearable portable terminal device is suitable for obtaining biometric information, in which a thermometer, a hygrometer, or the like is incorporated.

  The general attributes 3020 of the users included in the user attributes include country-specific regions, language used, weights and measures, currency, race, ethnicity, and the like. The user attributes 3030 included in the user attributes include age, gender, physique, history (for example, behavior history), preferences, assets, bloodlines, schedules, related place information, and the like.

  The content 3040 to be provided is selected from text, image, sound, moving image, 3D display, navigation, web link (URL), and the like, selected based on the guidance scenario, and registered in a plurality of cases in order.

  According to the present embodiment, various types of information detected by the mobile terminal device can be used as triggers to refer to user attributes adapted to the information and provide content suitable for the user. The user can be actively guided to a predetermined location according to a scenario along the line.

[Other Embodiments]
The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

  In addition, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed in the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

Claims (13)

Content holding means for associating and holding identification information of a near field communication signal as activation information for activating content provision processing, the first content, and the second content;
Identification information determination means for determining that the identification information has been received from the mobile terminal device;
When the identification information determination unit determines that the identification information is received, the first content is provided to the portable terminal device and played, and then the second content is provided to the portable terminal device sequentially. Content providing means,
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. , and the second content, Oh Ru information processing apparatus in the navigation content that guides the user to the location. The content holding unit further holds an attribute of a user who requests provision of content in association with the content holding unit,
  User attribute receiving means for receiving the attribute of the user transmitted from the mobile terminal device and held in the mobile terminal device,
  2. The information according to claim 1, wherein the content providing unit provides the first content and the second content corresponding to the received attribute of the user to the portable terminal device with reference to the content holding unit. Processing equipment. The attribute of the user, including language of the user, belongs to the country or region of the user, metrology used of the user, and, at least one of the currency used by the user, as a general attribute of the user See
The information processing apparatus according to claim 2 , wherein the content providing unit provides the first content and the second content corresponding to a general attribute of the user to the mobile terminal device. The user attribute includes at least one of the user's gender, the user's age, the user's history, and the user's preference information as the user's personal attribute,
  The information processing apparatus according to claim 2, wherein the content providing unit provides the first content and the second content corresponding to the user's personal attribute to the mobile terminal device. The attribute of the user includes information held by the user held in the mobile terminal device,
  5. The information processing apparatus according to claim 2, wherein the content providing unit provides the first content and the second content corresponding to information held by the user to the mobile terminal device. 6. The content providing means, in response to changes in the identification information, provides the first content to induce the user and the second content to the portable terminal apparatus, any one of claims 1 to 5 The information processing apparatus described in 1. The content holding means further comprises content registration means for registering the first content and the second content for guiding the user in accordance with an instruction from a client who wants to guide the user to the location. The information processing apparatus according to any one of 1 to 6. When the content providing means receives an instruction to stop content reproduction from the portable terminal device, the content providing means proceeds to provide the second content when reproducing the first content, and reproduces the second content when reproducing the second content. The information processing apparatus according to any one of claims 1 to 7, wherein the information processing apparatus ends. An identification information determination step for determining that identification information of a short-range communication signal as activation information for activating content providing processing is received from the mobile terminal device;
If it is determined that it has received the identification information in the identification information determination step, with reference to the content storage means for storing in association with the identification information and the first content and the second content, said first content A content providing step of sequentially providing the second content to the mobile terminal device after being provided to the mobile terminal device and played ;
Only including,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. And the second content is a navigation content for guiding the user to the place . An identification information determination step for determining that identification information of a short-range communication signal as activation information for activating content providing processing is received from the mobile terminal device;
If it is determined that it has received the identification information in the identification information determination step, with reference to the content storage means for storing in association with the identification information and the first content and the second content, said first content A content providing step of sequentially providing the second content to the mobile terminal device after being provided to the mobile terminal device and played ;
An information processing program for causing a computer to execute the,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. The information processing program is a navigation content for guiding the user to the place . Attribute holding means for holding user attributes;
Detection means for detecting identification information of a near field communication signal as an activation condition for activating the content providing process;
A user attribute transmission unit that transmits the identification information and the attribute of the user held in the attribute holding unit to an information processing apparatus that performs the content providing process when the detection unit detects the identification information ;
Content receiving means for receiving second content from the information processing device sequentially after receiving and reproducing the first content from the information processing device in accordance with the identification information and the attribute of the user;
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. Yes, the second content, Ru Oh in the navigation content that guides the user to the location the mobile terminal device. A detection step of detecting identification information of a short-range communication signal as an activation condition for activating content provision processing;
When the identification information is detected in the detection step, the identification information and the user attribute held in the attribute holding means for holding the user attribute are transmitted to the information processing apparatus that performs the content providing process. A user attribute sending step;
A content receiving step of receiving the second content sequentially from the information processing device after receiving and playing back the first content according to the identification information and the attribute of the user;
A control program of a mobile terminal device to execute the computer,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. And the second content is a navigation terminal control program for guiding the user to the place . Content holding means for associating and holding attributes of a user who requests content provision, identification information of a near field communication signal as activation information for activating content provision processing, first content, and second content When,
In the portable terminal device, when the identification information is detected, the identification information and the user's attribute held in the attribute holding means for holding the user's attribute are processed to provide the content from the portable terminal device. User attribute transmission means for transmitting to the processing device;
Referring to the content holding means, the first content corresponding to the identification information and the user attribute is provided from the information processing device to the mobile terminal device and played back, and then the second content is sequentially received. Content providing means provided from the information processing device to the mobile terminal device;
Equipped with a,
The first content and the second content are content for guiding a user carrying the mobile terminal device to a location related to the identification information, and the first content is video content introducing the location. , and the second content, Oh Ru information processing system in the navigation content that guides the user to the location.

Images