JP6731605B2 - Information presenting device, information presenting system, information presenting method, and information presenting program - Google Patents

Description

The present invention relates to an information presentation device, an information presentation system, an information presentation method, and an information presentation program.

In recent years, as a technology for providing augmented reality (AR), there are some application programs that superimpose a three-dimensional image that does not exist in the real space on a video in the real space and display it on a screen of a smartphone or the like. It is provided by companies as an advertising/promotional tool, and is attracting a great deal of attention and interest. With respect to such an AR technology which has a high interest for the user, a device for further attracting the interest of the user and continuing the interest has been devised. One of them is to display different AR contents depending on the combination of the markers when a plurality of markers are imaged. There is disclosed a technique for giving or bonus points (see Patent Document 1).

JP, 2014-127148, A

However, in general, AR technology requires enormous cost and time to create AR content data and a program for processing the data, and a burden on a company that intends to use the AR technology is heavy. Further, in the AR technology including the technology described in Patent Document 1, since AR content is generally displayed by imaging a marker, only a few users who have acquired the marker can execute the AR content. , It was difficult to spread the content of advertisement contained in the AR content to many users.

The present invention has been made in view of the above, and is capable of using the AR technology while suppressing the cost and the burden of work, and the information presenting apparatus and the information that can spread the AR content to many users. An object of the present invention is to provide a presentation system, an information presentation method, and an information presentation program.

In order to solve the above-described problems, in the present invention, the server device stores the origin content that causes the reproduction of the virtual content that does not exist in the physical space and the virtual content as the promotion information in association with each other. , An augmented reality information storage unit that stores one or more pieces of recommended promotion information associated with the promotion information, the information terminal device captures an image of the real space, and causes the content that exists in the real space. Is transmitted, the acquired data is transmitted to the server device, the server device receives the data transmitted from the information terminal device, and the promotion information associated with the cause content included in the received data is expanded. Acquired from the reality information storage means, transmits the acquired promotion information to the information terminal device, the information terminal device receives the promotion information from the server device, generates a promotion screen including virtual content of the received promotion information, and Select to select the recommended promotion information associated with the promotion information after controlling the generated promotion screen to be displayed on the display unit by superimposing it on the video of the space and playing the virtual content included in the promotion screen. It is characterized in that a screen is generated, the generated selection screen is displayed on the display unit, and the recommended promotion information selected from the selection screen is displayed .

Further, according to another aspect of the present invention, the server device stores augmented reality information storage means that associates the origin content causing the reproduction of the virtual content that does not exist in the physical space with the virtual content as the promotion information in association with each other. , The information terminal device captures an image of the physical space, acquires data including the origin content existing in the physical space, transmits the acquired data to the server device, and the server device transmits from the information terminal device. The promotion data associated with the origin content included in the received data is acquired from the augmented reality information storage means, and the acquired promotion information is transmitted to the information terminal device. Control to receive information from the server device, generate a promotion screen including the virtual content of the received promotion information, and a share menu, superimpose it on the image in the real space, and display the generated promotion screen on the display unit. Then, the instruction of the share application program selected from the share menu is received, and when the instruction of the share application program is received, the promotion instruction for generating the promotion page including the cause content is transmitted to the server device, and the server device displays the information. When the promotion page generation instruction is received from the terminal device, the promotion page is generated, the generated promotion page is stored in the storage unit, the URL of the promotion page that is the storage destination of the stored promotion page is transmitted, and the information terminal The device is characterized by receiving the URL of the promotion page and transmitting the share information including the received URL of the promotion page to the sharing application program . Here, the sharing application refers to an application that can be used to transmit the link information of the promotion page to another person.

Further, according to another aspect of the present invention, in the information terminal device that has received the share information, the promotion page including the image data of the origin content is displayed by designating the URL of the promotion page, and the cause included in the displayed promotion page. It is characterized in that a promotion screen including virtual content corresponding to the origin content is displayed by instructing image data of the content .
Another aspect of the present invention is characterized in that a button or a text is used instead of the image data of the origin content included in the promotion page.

In another aspect of the present invention, the sharing application program is a social media, a message application, or a mail application .
In another aspect of the present invention, the augmented reality information storage means further stores at least one of an introduction page, a coupon page, a form page, an external link or an external link menu corresponding to the external link page as the promotion information. , A promotion screen including at least one of an introduction page, a coupon page, a form page, and an external link menu is generated.

Further, in another aspect of the present invention, the origin content is one or a combination of a flat object, a solid object, a motion, a moving image, a sound, and position information, and the acquired data is still image data, It is characterized by being moving image data, audio data, and position information data .
In another aspect of the present invention, the information terminal device includes a history information storage unit that stores promotion information including the virtual content when the virtual content included in the promotion screen is reproduced, and the history information storage unit includes the history information storage unit. It is characterized by generating a selection screen for selecting the stored promotion information and controlling the generated selection screen to be displayed on the display unit.

According to the present invention configured as described above, there is an effect that the AR technology can be used while suppressing the cost and work burden, and that the AR content can be diffused to many users.

It is a block diagram which shows the structure of the information presentation system 10 of embodiment. 6 is an explanatory diagram showing an example of a data configuration of the augmented reality information storage unit 210. FIG. FIG. 6 is an explanatory diagram showing an example of a situation in which the origin content is acquired by the information terminal device 100. 7 is an explanatory diagram showing an example of a display screen displayed on the information terminal device 100. FIG. 6 is a flowchart showing an information presentation processing procedure executed by the information terminal device 100 and the server device 200. 7 is an explanatory diagram showing an example of a recommended content selection screen displayed on the information terminal device 100. FIG. 6 is a flowchart showing an information presentation processing procedure executed by the information terminal device 100. 7 is an explanatory diagram showing an example of a history information selection screen displayed on the information terminal device 100. FIG. 6 is a flowchart showing a share information generation processing procedure executed by the information terminal device 100 and the server device 200. 9 is an explanatory diagram showing an example of a promotion page generated by the server device 200. FIG. 6 is an explanatory diagram showing an example of a promotion page including virtual contents generated by the server device 200. FIG.

Hereinafter, embodiments of an information presentation device, an information presentation system, an information presentation method, and an information presentation program according to the present application will be described in detail with reference to the drawings. It should be noted that the information presenting apparatus, the information presenting system, the information presenting method, and the information presenting program according to the present application are not limited by this embodiment.

FIG. 1 is a block diagram showing the configuration of the information presentation system 10 of the embodiment. As shown in FIG. 1, the information presentation system 10 connects an information terminal device 100 and a server device 200 via a network N. The network N is the Internet and other communication lines for the information terminal device 100 and the server device 200 to mutually transmit and receive information.

The information terminal device 100 may be any device such as a smartphone, a tablet computer, a personal computer, or any other terminal device that can access the server device 200 via the network N. The server device 200 is a so-called web server that sends responses in response to various requests sent by the information terminal device 100.

First, the function and configuration of the server device 200 will be described. The server device 200 includes an augmented reality information storage unit 210, a promotion page storage unit 220, a transmission/reception unit 201, a promotion information acquisition unit 202, and a promotion page generation unit 203.

FIG. 2 is an explanatory diagram showing an example of the data configuration of the augmented reality information storage unit 210. The augmented reality information storage unit 210 stores the origin content 22 and the promotion information 23 in association with each other. Promotion information 23 includes a virtual content, the introductory page, a coupon page, form page, an external link or an external link page. Further, the recommended promotion information 24, which is the promotion information for displaying the recommended content after reproducing the virtual content, is stored in association with the promotion information 23. The augmented reality information storage unit 210 stores a plurality of augmented reality information 21 having the above-mentioned data structure. Each piece of promotion information of the recommended promotion information 24 includes a virtual content, an introduction page, a coupon page, a form page, an external link or an external link page.

Here, the origin content is content that serves as an opportunity (so-called marker) for reproducing the virtual content, and is, for example, a flat object such as a poster, a business card, a card, a card, a card, a symbol, a mark, or the like. It is a three-dimensional article, a three-dimensional object such as a building, a gesture, a motion like a sign language, a moving picture like a television program, a sound, position information, or a combination thereof. The virtual content is a content that does not exist in the physical space in which the information terminal device 100 exists, and is a content that is reproduced by the output device of the information terminal device 100 when the origin content is acquired. Specifically, it is a two-dimensional still image, moving image, three-dimensional computer graphic image, voice, character information, or the like. In addition, the introduction page is a page that introduces information related to virtual content or information that you want to advertise, the coupon page is a page that displays discount information, benefits, application qualifications, etc., the form page is an inquiry form, a questionnaire form, A page displaying an application form, a registration form, etc., an external link is a link to a web page or an external application program (for example, Facebook (registered trademark) application), and an external link page is a page linking to an external application program.

The promotion page storage unit 220 stores the cause content and the promotion page generated from the promotion information stored in association with the cause content. The promotion page is a web page generated to share the attributed content by using the sharing function of social media.

The transmission/reception unit 201 transmits/receives data to/from the information terminal device 100. Specifically, the transmitting/receiving unit 201 receives the data including the causal content transmitted from the information terminal device 100 (hereinafter referred to as causal data). The transmission/reception unit 201 transmits the promotion information corresponding to the origin content included in the origin data to the information terminal device 100.

The promotion information acquisition unit 202 searches the augmented reality information storage unit 210 for the causal content included in the causal data transmitted from the information terminal device 100. When the causal content is searched, the promotion information acquisition unit 202 is associated with the searched causal content. The promotion information and recommended promotion information associated with the promotion information are acquired from the augmented reality information storage unit 210.

The promotion page generation unit 203 generates a promotion page from the promotion information according to the page generation condition and stores it in the promotion page storage unit 220.

Next, the function and configuration of the information terminal device 100 will be described. The information terminal device 100 includes a history information storage unit 110, a transmission/reception unit 101, a screen generation unit 102, a display control unit 103, a display unit 104, an input unit 105, an imaging unit 106, a position information acquisition unit 107, a speaker 108, and a microphone 109. Prepare

The transmission/reception unit 101 transmits/receives data to/from the server device 200. Specifically, the transmitting/receiving unit 101 transmits the cause data to the server 200. Further, the transmission/reception unit 101 receives the promotion information transmitted from the server 200.

The image capturing unit 106 captures an image by using an image sensor such as CCD or CMOS. Specifically, the image capturing unit 106 captures a video in the physical space. The image capturing unit 106 captures an image including the origin content according to a user's instruction or automatic scanning, and converts the image into image (still image or moving image) data.

FIG. 3 is an explanatory diagram showing an example of a situation where the information terminal device 100 acquires the origin content. In the example shown in FIG. 3, the cause content 32 existing in the physical space 31 is captured by the image capturing unit 106 of the information terminal device 100, and the captured image is displayed on the display screen 33. The image capturing unit 106 scans the image displayed on the display screen 33 when the image capturing mode menu 34 is instructed or at an arbitrary timing, and converts the image into still image data. Note that the origin content may be a three-dimensional object, a motion, a moving image, a sound, position information, or a combination thereof in addition to a flat object such as the poster shown in FIG. 3, so that still image data acquired by the image capturing unit 106, The moving image data, the audio data acquired by the microphone 109, the position information acquired by the position information acquisition unit 107, or a combination thereof may be used as the cause data. The history menu 35 displays history information when instructed, details of which will be described later.

The screen generation unit 102 generates a promotion screen according to the promotion information transmitted from the server device 200. The promotion screen displays virtual content, an introduction menu that describes a link to an introduction page, a coupon menu that describes a link to a coupon page, a form menu that describes a link to a form page, an external link or a link to an external page. It includes the described external link menu and the share menu that describes the selection menu of the social media type. It should be noted that the promotion screen, in addition to the virtual content, introduction menu, coupon menu, the Form menu, external link menu, may also do at least 1 Tsuo含of the share menu, also, virtual content, introduction menu, coupon menu, the Form menu, The display position of the external link menu and share menu is not fixed.

The display control unit 103 controls to display the video imaged by the imaging unit 106 on the display unit 104. Further, the display control unit 103 controls to display the promotion screen generated by the screen generation unit 102 and the image captured by the image capturing unit 106 on the display unit 104 in a superimposed manner. FIG. 4 is an explanatory diagram showing an example of a display screen displayed on the information terminal device 100. The display screen 43 of the information terminal device 100 includes a virtual content 44, a coupon menu 45, a form menu 46, an external link menu 47, a share menu 48, and an introduction menu 49, which are promotion screens superimposed on a video imaged of the physical space 31. indicate.

The display unit 104 is a display such as a liquid crystal display or an organic EL panel, and displays various kinds of information under the control of the display control unit 103.

In the case of a smartphone or a tablet computer, the input unit 105 is a touch sensor that is superimposed on the display, and detects an input made in a predetermined area such as an icon, a button, or a character input area displayed on the display. If it is a personal computer, it is a keyboard, a mouse, a touch pad, etc., and receives input from the keyboard, mouse, touch pad, etc.

The position information acquisition unit 107 receives position information from a GPS (Global Positioning System) satellite and acquires the position information of the information terminal device 100. GPS is generally used as a method for acquiring position information, but the method is not limited to this.

The speaker 108 outputs audio when the virtual content is audio data. The microphone 109 converts a voice existing in the physical space into voice data and acquires the voice data. Specifically, when the originating content is voice, the voice recorded by the microphone 109 is converted into voice data and acquired.

The history information storage unit 110 stores, as history information, promotion information that reproduces the virtual content. The history information storage unit 110 may store reproduction date and time, reproduction position information, and the like, in addition to the promotion information.

An information presentation process that is executed by the information presentation system 10 configured as described above and that reproduces virtual content by using the origin content existing in the physical space as a cause will be described. FIG. 5 is a flowchart showing an information presentation processing procedure executed by the information terminal device 100 and the server device 200.

The imaging unit 106 of the information terminal device 100 acquires the cause data including the cause content (step S501). Note that when the causal content is a flat object, a three-dimensional object, a motion, or a moving image, the image capturing unit 106 acquires still image data or video data as causal data including the causal content. Audio data is acquired as the cause data, and if the cause content is position information, the position information acquisition unit 107 acquires the position information as the cause data. The transmitting/receiving unit 101 transmits the acquired cause data to the server device 200 (step S502).

In the server device 200, the transmission/reception unit 201 receives the cause data (step S503). The promotion information acquisition unit 202 acquires promotion information corresponding to the origin content included in the origin data from the augmented reality information storage unit 210 (step S504). Specifically, the cause content (more specifically, still image data, moving image data, audio data, position information of the cause content) in which a part or all of the cause data transmitted from the information terminal device 100 matches is expanded. A search is performed from the reality information storage unit 210, and promotion information associated with the searched origin content is acquired from the augmented reality information storage unit 210. The transmission/reception unit 201 transmits the promotion information to the information terminal device 100 (step S505).

In the information terminal device 100, the transmission/reception unit 101 receives the promotion information (step S506). The screen generation unit 102 generates a promotion screen from the promotion information (step S507). The display control unit 103 superimposes the promotion screen on the video imaged by the imaging unit 106 and displays the promotion screen on the display unit 104 (step S508). When the virtual content is a two-dimensional moving image, the virtual content is displayed by being superimposed on the image in the physical space as shown on the display screen 43 of FIG. Further, the virtual content may be displayed with a play/stop/enlarge button.

The display control unit 103 reproduces the virtual content (step S509). It should be noted that the virtual content is played back even when the video taken in the real space does not include the origin content, and does not stop, but it is determined whether or not the origin content is included in the video captured. In addition, the reproduction may be stopped or the virtual content may be controlled to disappear when the causal content is no longer included in the captured image. Alternatively, the virtual content may be changed according to the distance and the orientation by determining the distance of the content originating from the information terminal apparatus 100 and the orientation of the content originating from the information terminal apparatus 100 from the captured image.

The display control unit 103 determines whether to end the virtual content (step S510). Whether to end the virtual content is determined based on the end of the reproduction of the moving image, the instruction of the button to end the execution of the program of the virtual content, the instruction of another menu such as the introduction menu, and the like. When it is determined that the virtual content is not ended (step S510: No), the process proceeds to step S509. When the display control unit 103 determines to end the virtual content (step S510: Yes), the display control unit 103 stores the promotion information in the history information storage unit 110 (step S511). The screen generation unit 102 generates a recommended content selection screen from the recommended promotion information associated with the promotion information (step S512). The recommended promotion information associated with the promotion information is acquired together with the promotion information corresponding to the origin content in step S502 and is received together with the promotion information in step S506, but even if the virtual content ends, the augmented reality of the server device 200 is obtained. The information storage unit 210 may be searched and received.

The display control unit 103 displays a recommended content selection screen (step S513). FIG. 6 is an explanatory diagram showing an example of a recommended content selection screen displayed on the information terminal device 100. As shown in FIG. 6, the recommended content 64 is displayed on the display screen 63 so as to be superimposed on the video in the physical space. The recommended content 64 may display the title and the description when the promotion information includes the title and the description. As shown in FIG. 2, the recommended content 64 is generated from the recommended promotion information associated with the promotion information stored in the augmented reality information storage unit 210.

As described above, when the promotion information including the virtual content is managed by the database on the server device and the origin content is acquired by the information terminal device 100, the promotion information corresponding to the origin content is transmitted to the information terminal device 100 to generate the virtual content. The menu suitable for advertisement and information gathering is displayed on the screen as well as the information is reproduced. Therefore, the company can easily carry out the advertisement and information gathering using AR technology only by preparing predetermined data in the database. be able to.

In addition, since the recommended promotion information associated with the promotion information to be reproduced is presented after the virtual content is reproduced, the provider of the virtual content can sequentially present the desired promotion information to the user. , More effective advertising will be possible.

An information presentation process using history information executed by the information presentation system 10 will be described. FIG. 7 is a flowchart showing an information presentation processing procedure executed by the information terminal device 100.

The input unit 105 receives the input of the history menu displayed on the screen (step S701). Specifically, when the user instructs the history menu 35 shown in FIG. 3, the input unit 105 receives the input of the history menu. The screen generation unit 102 acquires history information, that is, promotion information including the virtual content reproduced by the user in the past from the history information storage unit 110 (step S702). The screen generation unit 102 generates a selection screen from the promotion information acquired from the history information storage unit 110 (step S703). The display control unit 103 displays the selection screen on the display unit 104 (step S704). FIG. 8 is an explanatory diagram showing an example of a history information selection screen displayed on the information terminal device 100. As shown in FIG. 8, the history information 84 generated from the promotion information is displayed on the display screen 83. When the promotion information includes a title and a description, the history information 84 may display the title and the description. The input unit 105 receives a history information instruction from the selection screen (step S705).

The screen generation unit 102 generates a promotion screen from the instructed history information (step S706). The display control unit 103 superimposes the promotion screen on the video imaged by the imaging unit 106 and displays the promotion screen on the display unit 104 (step S707). Since the processing of the following steps S708 to S711 is the same as the processing of steps S509 to S513 shown in FIG. 5, description thereof will be omitted, and the description of steps S509 to S513 will be referred to.

In the above-described process, the screen for selecting history information is generated from the promotion information stored in the history information storage unit 110 of the information terminal device 100. However, the history information storage unit 110 is provided in the server device 200, and the input of the history menu is accepted. At this time, the promotion information stored as history information for each user may be acquired from the history information storage unit of the server device 200, and a screen for selecting history information may be generated. Further, the history information selection screen shown in FIG. 8 may be added with a function of adding a bookmark to the history information or a function of searching with a keyword or the like.

In the conventional AR technology, the origin content exists in the physical space, and the virtual content cannot be reproduced unless the origin content is acquired by the information terminal device 100. However, in the present embodiment, the history information storage unit 110 stores the promotion information including the virtual content obtained by reproducing the origin content. As a result, the promotion information including the virtual content once acquired and reproduced can be reproduced at any time the user likes without needing the causal content, without the trouble of acquiring the causal content again.

Next, a share information generation process for sharing promotion information executed by the information presentation system 10 on social media will be described. FIG. 9 is a flowchart showing a share information generation processing procedure executed by the information terminal device 100 and the server device 200.

The input unit 105 accepts the share menu instruction displayed on the display screen (step S901). Specifically, when the instruction of the share menu 48 shown in FIG. 4 is accepted, the type of social media is displayed in a pull-down menu. The input unit 105 receives an input of the social media type from the pull-down menu displayed on the display screen (step S902). Specifically, one of Facebook (registered trademark), Twitter (registered trademark), LINE (registered trademark), and other social media is selected. The transmission/reception unit 101 transmits a promotion page generation instruction to the server device 200 (step S903).

In the server device 200, the transmission/reception unit 201 receives the promotion page generation instruction transmitted from the information terminal device 100 (step S904). The promotion page generation unit 203 generates a promotion page based on the promotion information instructed to generate the promotion page (step S905). FIG. 10 is an explanatory diagram showing an example of a promotion page generated by the server device 200. As shown in FIG. 10, the promotion page 11 includes the cause content 12 and the recommended content 13, and if any area of the cause content 12 and the recommended content 13 is indicated on the web page, the promotion page 11 includes the corresponding virtual content. The promotion screen is generated, and the program to display operates. When the title and description are included in the promotion information that is the source of generation of the promotion page 11 and the promotion information corresponding to the recommended content 13, the title and description may be displayed respectively. Although the origin content 12 on the promotion page 11 is a mark for operating the program for generating and displaying the promotion screen, it is a button or text instead of the thumbnail of the origin content as shown in FIG. May be. Also, the recommended content 13 does not necessarily have to be displayed on the promotion page, and it is not necessary to include even one.

In addition, a promotion page including virtual content may be generated according to a preset promotion page generation condition. FIG. 11 is an explanatory diagram showing an example of a promotion page including virtual contents generated by the server device 200. The promotion page 11 of FIG. 11 includes virtual content 14 in addition to the origin content 12 and the recommended promotion information 13. If the area of the virtual content 14 is indicated on the web page, the virtual content is reproduced on the web page. Like the promotion page of FIG. 10, the promotion page 11 of FIG. 11 is also a mark for operating the program for generating and displaying the promotion screen, and the cause content 12 on the promotion page 11 is a thumbnail of the cause content. It may be a button or text. Also, the recommended content 13 does not necessarily have to be displayed on the promotion page, and it is not necessary to include even one.

The promotion page generation unit 203 stores the generated promotion page in the promotion page storage unit 220 (step S906). The transmission/reception unit 201 transmits the URL of the promotion page, which is the storage location of the promotion page, to the information terminal device 100 (step S907).

In the information terminal device 100, the transmission/reception unit 101 receives the URL of the promotion page transmitted from the server device 200 (step S908). The transmission/reception unit 101 transmits the share information including the URL of the promotion page to the social media (step S909). As share information, a comment entered by the user may be added and sent together with the URL of the promotion page.

As another example, the promotion page stored in the promotion page storage unit 220 may be generated according to generation conditions when the promotion information is input. In that case, in the processing of steps S903 to S906, the information terminal device 100 transmits a request for the URL of the promotion page corresponding to the promotion information to the server device 200, and the server device 200 displays the promotion page corresponding to the promotion information. The URL of the promotion page acquired from the promotion page storage unit 220 is transmitted to the information terminal device 100.

When acquiring the cause data including the cause content as image data or sound data, instead of the image data or sound data, the data representing the feature points extracted from the image or sound (hereinafter referred to as feature point data) is acquired. You may. In this case, the causal content stored in the augmented reality information storage unit 210 is also used as the feature point data, and the causal content is searched by comparing the causal data with the feature point data of the causal content.

As described above, when the user likes the reproduced virtual content and shares it on social media, the user generates a promotion page including the cause content or acquires the promotion page stored in the promotion page storage unit 220, and generates or acquires the promotion. By transmitting the URL of the page to the social media, it is possible to reproduce the virtual content from the origin content of the web page even if the origin content is not at hand of another user who has shared. As a result, it is possible to widely disseminate the content of advertisement/promotion by utilizing the sharing function of social media.

In the case where the program for executing the above-described information presentation process is provided as a downloadable application program (hereinafter referred to as an AR application), and the AR application is downloaded to the information terminal device displaying the share information. If there is not, the causal content displayed on the screen is imaged by the information terminal device 100 in which the AR application is downloaded to generate a promotion screen corresponding to the causal content in the information terminal device 100 in which the AR application is downloaded. And can be displayed. Further, the information terminal device to which the AR application has not been downloaded may be prompted to download the AR application.

Further, as shown in FIG. 11, virtual content can be reproduced more easily by including virtual content in the promotion page without the trouble of acquiring the cause content and the time of downloading the AR application. The contents of can be diffused.

As another example, a program that includes image data of a causal content on a web page, and that image data is instructed to display a promotion screen that includes virtual content corresponding to the causal content may be activated. The image data of the causal content is a mark for operating the program for generating and displaying the promotion screen, but it may be a button, a text, or the like instead of the image data of the causal content. Further, the virtual content corresponding to the origination content may be posted as it is on the web page so that it can be played back. As a result, it is possible to carry out the advertisement using the AR technology even on the website of the company. When the program for executing the above information presentation process is provided as an AR application, and the AR application is not downloaded to the information terminal device that displays the web page, the reason why the AR application is displayed on the screen is displayed. Capturing image data of the content with the information terminal device 100 in which another AR application has been downloaded to generate and display a promotion screen corresponding to the content originated in the information terminal device 100 in which the AR application has been downloaded. You can Further, the information terminal device for which the AR application has not been downloaded may be prompted to download the AR application.

The information terminal device 100 and the server device 200 are ordinary computers including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and operate programs stored in the ROM and the RAM. By doing so, the configurations and functions described above are realized. Alternatively, it may be realized as hardware by wired logic.

The programs operating on the information terminal device 100 and the server device 200 are stored in a computer connected to a communication network such as the Internet and provided by being downloaded via the network, SaaS (Software as a Service), or the like. Such a cloud computing service may be provided or an API (Application Programming Interface) may be provided. Alternatively, the file may be provided in an installable format or an executable format by being recorded on a computer-readable recording medium such as a CD-ROM or a DVD.

It should be noted that each component of each of the above-described devices is functionally conceptual, and does not necessarily have to be physically configured as illustrated. In other words, the specific implementation of each device is not limited to that shown in the drawings, and all or part of the device may be functionally or physically distributed/integrated in arbitrary units according to the load or the usage status. it can.

Further, each component of each of the above-described devices can be modified and embodied at the stage of implementation without departing from the spirit of the invention. A plurality of constituent elements disclosed in the above-described embodiments may be combined as appropriate, and some constituent elements may be deleted from the constituent elements shown in the above-described embodiments. Although the sharing function of the social media is applied as the sharing application in the above embodiment, a message application or a mail application may be applied instead.

N... Network, 10... Information presentation system, 100... Information terminal device, 101... Transmitting/receiving unit, 102... Screen generating unit, 103... Display control unit, 104... Display unit, 105... Input unit, 106... Imaging unit, 107... Position information acquisition unit, 108... Speaker, 109... Microphone, 110... History information storage unit, 200... Server device, 201... Transceiver unit, 202... Promotion information acquisition unit, 203... Promotion page generation unit, 210... Extended realization information storage 220, promotion page storage

Claims (11)

An information presentation system comprising a server device and an information terminal device connected to the server device via a communication network,
The server device is
One or a plurality of recommended promotions in which the origin content that causes the reproduction of the virtual content that does not exist in the physical space and the virtual content as the promotion information are stored in association with each other and are associated with the promotion information. Augmented reality information storage means for storing information, comprising a,
The information terminal device,
Image pickup means for picking up an image of the physical space,
Data acquisition means for acquiring data including the origin content existing in the physical space,
And a data transmitting means for transmitting the data to the server device acquired by the data acquisition unit,
The server device is
Data receiving means for receiving the data transmitted from the information terminal device,
Promotion information acquisition means for acquiring, from the augmented reality information storage means, promotion information associated with the cause content included in the data received by the data reception means,
And a promotion information transmitting unit for transmitting the promotion information acquired by the promotion information acquiring unit to the information terminal device,
The information terminal device,
Promotion information receiving means for receiving the promotion information from the server device,
Promotions screen generating means for generating a promotion screen including the virtual content of the promotional information received by the promotion information receiving means,
Display control means for then superimposed on the video of the real space to image, controls to display the promotional screen generated by the promotion screen generating unit to the display unit by the image pickup means,
After reproducing the virtual content included in the promotion screen, a selection screen generation unit for generating a selection screen for selecting the recommended promotion information associated with the promotion information,
The display control unit displays the selection screen generated by the selection screen generation unit on the display unit, and controls to display the recommended promotion information selected from the selection screen. information presentation system.
An information presentation system comprising a server device and an information terminal device connected to the server device via a communication network,
The server device is
With a resulting content to be caused by the reproduction of the virtual content that does not exist in real space, as promotion information, augmented reality information storage means for storing in association with each other, and the virtual content and,
The information terminal device,
Image pickup means for picking up an image of the physical space,
Data acquisition means for acquiring data including the origin content existing in the physical space,
And a data transmitting means for transmitting the data to the server device acquired by the data acquisition unit,
The server device is
Data receiving means for receiving the data transmitted from the information terminal device,
Promotion information acquisition means for acquiring, from the augmented reality information storage means, promotion information associated with the cause content included in the data received by the data reception means,
And a promotion information transmitting unit for transmitting the promotion information acquired by the promotion information acquiring unit to the information terminal device,
The information terminal device,
Promotion information receiving means for receiving the promotion information from the server device,
Said virtual content of the promotional information received by the promotion information receiving means, and promotion screen generating means for generating a promotion screen including a share menu, a,
Display control means for then superimposed on the video of the real space to image, controls to display the promotional screen generated by the promotion screen generating unit to the display unit by the image pickup means,
Receiving means for receiving instructions of the sharing application program selected from the sharing menu,
And a generation instruction transmission unit that transmits an instruction to generate a promotion page including the origin content to the server device when the instruction of the sharing application program is received by the reception unit,
The server device is
When a promotion page generation instruction is received from the information terminal device, a promotion page generation unit that generates the promotion page and stores the generated promotion page in a storage unit,
URL transmitting means for transmitting the URL of the promotion page, which is the storage destination of the promotion page stored by the promotion page generating means,
The information terminal device,
URL receiving means for receiving the URL of the promotion page,
Share information transmitting means for transmitting share information including the URL of the promotion page received by the URL receiving means to the share application program;
An information presentation system comprising:
In the information terminal device that has received the share information, a promotion page including image data of the origin content is displayed by designating the URL of the promotion page, and the image data of the origin content included in the displayed promotion page is displayed. The information presentation system according to claim 2, wherein a promotion screen including virtual content corresponding to the origin content is displayed by giving an instruction.
The information presentation system according to claim 3, wherein a button or a text is used instead of the image data of the origin content included in the promotion page.
The information presenting system according to claim 2, wherein the sharing application program is a social media, a message application, or a mail application.
The augmented reality information storage means further stores, as the promotion information, at least one of an introduction page, a coupon page, a form page, an external link or an external link menu corresponding to the external link page,
6. The promotion screen generation means further generates a promotion screen including at least one of the introduction page, the coupon page, the form page, and the external link menu. Information presentation system described in section 3.
The origin content is one of a two-dimensional object, a three-dimensional object, a motion, a moving image, a sound, and positional information, or a combination thereof,
The data is still image data, moving image data, audio data, information presentation system according to one of claims 1 to 6, characterized in that the positional information data acquired by the data acquisition means.
The information terminal device,
History information storage means for storing promotion information including the virtual content when the virtual content included in the promotion screen is reproduced,
Screen generating means for generating a selection screen for selecting the promotion information stored in the history information storage means,
Wherein the display control unit, information presentation system according to one of claims 1-7, characterized by controlling so as to display the selection screen generated by the screen generating unit to the display unit.
One or a plurality of recommended promotions in which the origin content that causes the reproduction of the virtual content that does not exist in the physical space and the virtual content as the promotion information are stored in association with each other and are associated with the promotion information. a augmented reality information and the server device including a storage unit, and the information terminal apparatus connected via a communication network with the server device, in an information presentation method executed for storing information,
The information terminal device,
An image capturing step of capturing an image of the physical space,
A data acquisition step of acquiring data including the origin content existing in the physical space,
Anda data transmitting step of transmitting the data to the server device acquired by the data acquisition step,
The server device is
A data receiving step of receiving the data transmitted from the information terminal device,
A promotion information acquisition step of acquiring, from the augmented reality information storage, promotion information associated with the origin content included in the data received by the data receiving step;
A promotion information transmitting step of transmitting the promotion information acquired by the promotion information acquiring step to the information terminal device,
The information terminal device,
A promotion information receiving step of receiving the promotion information from the server device;
Promotions screen generation step of generating a promotion screen including the virtual content of the promotional information received by the promotion information receiving step,
Superimposed on the video of the real space captured by the imaging step, and a display control step of controlling to display the promotional screen generated by the promotion screen generating step on the display unit,
A selection screen generating step of generating a selection screen for selecting the recommended promotion information associated with the promotion information after reproducing the virtual content included in the promotion screen,
The display control step displays the selection screen generated by the selection screen generation step on the display unit and controls to display the recommended promotion information selected from the selection screen. How to present information.
A server apparatus including an augmented reality information storage unit that stores the origin content that causes the reproduction of virtual content that does not exist in the physical space and the virtual content as promotion information in association with each other, and the server apparatus and the communication network. An information presentation method executed by an information terminal device connected via
The information terminal device,
An image capturing step of capturing an image of the physical space,
A data acquisition step of acquiring data including the origin content existing in the physical space,
A data transmission step of transmitting the data acquired by the data acquisition step to the server device,
The server device is
A data receiving step of receiving the data transmitted from the information terminal device,
A promotion information acquisition step of acquiring, from the augmented reality information storage, promotion information associated with the origin content included in the data received by the data receiving step;
A promotion information transmitting step of transmitting the promotion information acquired by the promotion information acquiring step to the information terminal device,
The information terminal device,
A promotion information receiving step of receiving the promotion information from the server device;
A promotion screen generation step of generating a promotion screen including the virtual content of the promotion information received by the promotion information reception step and a share menu;
A display control step of controlling the promotion screen generated in the promotion screen generation step to be displayed on a display unit by being superimposed on the image of the physical space imaged in the imaging step;
A receiving step of receiving instructions of the sharing application program selected from the sharing menu,
A generation instruction transmitting step of transmitting a generation instruction of a promotion page including the origin content to the server device when the instruction of the sharing application program is received by the receiving step,
The server device is
When a promotion page generation instruction is received from the information terminal device, the promotion page generation step of generating the promotion page and storing the generated promotion page in a storage unit,
A URL transmitting step of transmitting the URL of the promotion page that is the storage destination of the promotion page stored by the promotion page generating step,
The information terminal device,
A URL receiving step of receiving the URL of the promotion page,
A share information transmitting step of transmitting share information including the URL of the promotion page received by the URL receiving step to the share application program;
An information presentation method comprising: An information presenting program for causing a computer to execute the information presenting method according to claim 9 or 10 .

Images