JP2021163288A - Augmented reality system - Google Patents

Abstract

To provide an advertisement in an augmented reality space.SOLUTION: An augmented reality system includes a storage unit storing content objects representing contents and advertisement information to be displayed in an augmented reality space, an input unit receiving designation of a content object, an object management unit disposing the advertisement information along with the designated content object in the augmented reality space, and a purchase processing unit performing a purchasing process of a commodity relating to the advertisement object.SELECTED DRAWING: Figure 1

Description

The present invention relates to an augmented reality system.

Guide information in an augmented reality form is provided (see Patent Document 1).

Japanese Patent No. 6100496

Advertisements cannot be displayed when using augmented reality guide information.

The present invention has been made in view of such a background, and an object of the present invention is to provide a technique capable of providing an advertisement in an augmented reality space.

The main invention of the present invention for solving the above problems is an augmented reality system, which accepts designation of a content object representing content to be displayed in the augmented reality space, a storage unit for storing advertising information, and the designation of the content object. It is characterized by including an input unit, an object management unit that arranges the advertisement information together with the designated content object in the augmented reality space, and a purchase processing unit that performs purchase processing of products related to the advertisement object. do.

Other problems disclosed in the present application and solutions thereof will be clarified in the columns and drawings of the embodiments of the invention.

According to the present invention, it is possible to provide an advertisement in an augmented reality space.

It is an overall block diagram of the augmented reality system 1 which concerns on this embodiment. It is a system block diagram of the augmented reality system 1 which concerns on this embodiment. It is a flowchart which shows the process which a user terminal 3 receives an advertisement. It is explanatory drawing about the display of the augmented reality content in the augmented reality system which concerns on this embodiment. It is explanatory drawing about the process of product purchase in the augmented reality system which concerns on this embodiment. It is a system block diagram of the augmented reality system 1 which concerns on 2nd Embodiment.

<Outline of the invention>
The contents of the embodiments of the present invention will be described in a list. The present invention includes, for example, the following configuration.
[Item 1]
A storage unit that stores content objects that represent content to be displayed in augmented reality space and advertising information,
An input unit that accepts the designation of the content object,
An object management unit that arranges the advertisement information together with the designated content object in the augmented reality space, and
A purchasing processing unit that performs purchasing processing of products related to the advertising object, and
An augmented reality system characterized by being equipped with.

A specific example of the advertisement providing system according to the embodiment of the present invention will be described below with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims. In the following description, the same elements will be designated by the same reference numerals in the description of the drawings, and duplicate description will be omitted.

FIG. 1 is an overall configuration diagram of the augmented reality system 1 according to the present embodiment. FIG. 2 is a system configuration diagram of the augmented reality system 1 according to the present embodiment. The augmented reality system 1 includes a server 2, and the server 2 is bidirectionally connected to the user terminal 3 via the Internet 4.

The server 2 has a function of providing advertisements and information related to advertisements to customers, and mainly includes a server communication unit 21, a storage unit 22, an advertisement providing unit 23, and a payment unit 24. There is.

The server communication unit 21 is a part capable of communicating with an external device such as a customer's terminal, and may be, for example, a wireless communication means.

The storage unit 22 stores a database, a program, or the like in which various information is stored. The database includes an advertisement DB 22a in which an advertisement used for reality expansion is stored, a user DB 22b in which personal information of a user is stored, and the like.

The advertisements used for augmented reality include at least advertisements for restaurants and retail stores. Further, the advertisement includes still images, moving images, visual information including virtual objects, audio information, odor information, taste information, tactile information and the like. In addition, each advertisement is associated with at least one piece of information. For example, an advertisement for a beverage latte is associated with information such as detailed product information, features, prices, and sales locations. In addition, this information may be further associated with other advertisements. For example, the sales location, which is product information, may be linked to another product advertisement.

The user DB 22b also includes information on the user's consideration payment means in addition to the user's personal information. The consideration payment means includes, for example, electronic money, tokens, points, and the like, which may be used alone or in combination.

The advertisement providing unit 23 has a function of extracting an advertisement from the advertisement DB 22a and transmitting it to the user terminal 3. Further, the advertisement providing unit 23 has a function of providing information according to the request when the user requests detailed information about the advertisement. For example, the advertisement providing unit 23 has a function of recognizing a keyword, and has a function of extracting information related to the keyword from the advertisement DB 22a based on the received keyword and transmitting the information to the user terminal. Further, the trigger for the advertisement providing unit 23 to transmit the advertisement to the user terminal 3 may be random or may be transmitted according to the user situation or the user terminal situation. The user status may include, for example, the surrounding environment status such as the location of the user, the attribute status such as the user's preference and demand, and the like. Further, the user terminal status includes, for example, the behavior and attributes of the virtual character O displayed on the user terminal 3 described later. The advertisement providing unit 23 extracts information from the advertisement DB 22a, but the present invention is not limited to this. For example, you may access the database (index) of another search engine to extract information.

The settlement unit 24 has a function of making a settlement. For example, upon receiving the payment from the user terminal 3, the settlement unit 24 accesses the user DB 22b and determines whether or not the user's consideration payment means is sufficient. The settlement unit 24 can make a settlement when it is determined that the user's consideration payment means is sufficient. In addition to the user's consideration payment means, the payment unit 24 can also make payments using a credit card or a debit card.

The user terminal 3 may be an electronic terminal such as a smartphone, a tablet, or a laptop computer, and is mainly a terminal communication unit 31, a camera 32, an input unit 33, a display unit 34, and an advertisement acquisition unit 35. It includes an information output unit 36, an object management unit 37, and a consideration payment unit 38.

The terminal communication unit 31 is a part capable of communicating with an external device, and is, for example, a wireless communication means.

The camera 32 is a part that performs a shooting operation or the like, and has an image pickup element such as a CCD or CMOS element that converts an optical image into an electric signal, and a shutter. Moreover, not only still images but also moving images can be taken.

The input unit 33 can input a keyword (search term) to be searched through a user operation, such as a touch panel or a keyboard. Further, the input unit 33 may be input not only by hand but also by voice, for example.

The display unit 34 is, for example, a liquid crystal monitor and can display various types of information. Further, the display unit 34 may be integrated with the input unit 33.

The advertisement acquisition unit 35 has a function of acquiring an advertisement and information related to the advertisement from the server 2.

The information output unit 36 has a function of outputting various information and data to the display unit 34. Further, the information output unit 36 may have a function of outputting not only video but also audio information, odor information, tactile information, taste information and the like.

The object management unit 37 has, for example, a function of generating a virtual object with a motif of a virtual character, daily necessities, or the like, and controlling the attributes and actions of the virtual object. Further, the object management unit 37 also has a function of controlling the virtual object so as to be linked with the input unit 33 and the information output unit 36. For interlocking, for example, the object management unit 37 controls the virtual character to listen to the voice input by the user, and the information output unit 36 controls the virtual character to speak when the information is output. And so on.

The purchase process 38 has a function of confirming the intention of the user to pay the consideration and a function of transmitting the payment to the settlement unit 24 via the terminal communication unit 31. Further, the purchase process 38 may be connected to the input unit 33, so that the user can input the intention to pay through the input unit 33.

FIG. 3 is a flowchart showing a process in which the user terminal 3 receives an advertisement. FIG. 4 is an explanatory diagram regarding the display of augmented reality content in the augmented reality system according to the present embodiment. FIG. 5 is an explanatory diagram of a product purchasing process in the augmented reality system according to the present embodiment.

First, as step S1, the user U activates the augmented reality mode on the user terminal 3. In the augmented reality mode, the camera 32 of the user terminal 3 is activated, the surrounding real space image P (information in the real space) taken by the camera 32, and the virtual character generated by the object management unit 37. O (virtual object) is a state displayed on the display unit 34.

Next, in step S2, when the user terminal 3 receives the advertisement from the server 2, the display unit 34 displays the advertisement. Specifically, for example, when the user terminal 3 receives the advertisement, the object management unit 37 causes the virtual character O to output to the display unit 34 via the information output unit 36 so as to have the advertisement "cafe latte".

Next, in step 3, the user U asks the virtual character O, "What are the characteristics of the latte?" Then, the object management unit 37 controls the virtual character O to make a listening action or a reply to the voice input by the user. The input unit 33 transmits to that effect to the advertisement providing unit 23 of the server 2 via the terminal communication unit 31 unit.

Next, in step S4, when the advertisement providing unit 23 of the server 2 receives the fact, it extracts information about the characteristics of the latte (for example, the taste is creamy) based on the keyword to that effect, and the user terminal 3 Send to.

Then, in step S5, the object management unit 37 controls the virtual character O to output information regarding the characteristics of the “cafe latte”. As a method of information output, for example, the object management unit 37 may output the virtual character O to the user by voice saying "It's very creamy", or may perform an operation such as showing characters or figures to the user. good.

Then, in step S6, the user performs a product purchase procedure via the virtual character. Specifically, for example, when the user talks to the virtual character O to "buy the latte" when purchasing the latte, the purchase process 38 outputs a board b confirming the intention to pay for the latte. .. The board b is composed of a column showing a product and a price and a button for deciding to purchase, and the user performs a purchase procedure by pressing the button. Then, when the purchase procedure is performed, the purchase process 38 transmits to that effect to the settlement unit 24 of the server 2.

Subsequently, in step S7, when the payment unit 24 of the server 2 receives the payment, the payment is made, and then the payment is transmitted to the user terminal 3. When the object management unit 37 receives the payment, the virtual character O is directed to the user and outputs a message necessary for purchasing "OK! I bought it!" As a line, and this process ends.

As described above, the advertisement providing system 1 in the present embodiment has the effect of making the user U highly interested in the advertisement and urging the user U to purchase the advertisement product.

Although the description of the embodiment of the present invention is completed above, the aspect of the present invention is not limited to this embodiment.

In the above embodiment, when the user U decides to purchase the product, the user U is not limited to inputting the button of the board b confirming the intention to pay, but may also make the purchase decision by voice input. good. For example, when the user U talks to the virtual character O, "Buy the cafe latte!", The purchase process 38 may proceed with the purchase procedure as it is. By doing so, the user U can purchase the advertising product without any manual operation.

Further, in the above embodiment, the user U receives the advertisement after activating the reality expansion mode on the user terminal 3, but the present invention is not limited to this. For example, the user terminal 3 may automatically activate the augmented reality mode after receiving the advertisement. Specifically, for example, when the user terminal 3 receives an advertisement from the server 2, the user terminal 3 activates the augmented reality mode. Then, the object management unit 37 informs the user U of the virtual character O that the advertisement has been received.

In the above embodiment, the virtual object, the advertisement, and the environment in the real space are displayed as a video, but the present invention is not limited to this, and audio information may be included.

FIG. 6 is a system configuration diagram of the augmented reality system 1 according to the second embodiment.

The user terminal 3 is further provided with a position measuring unit 39. The position measurement unit 39 has a function of acquiring the position information of the user terminal 3 by, for example, a beacon for positioning using satellite positioning such as GPS or short-range wireless technology. The position measurement unit 39 can also transmit the position information to the server 2 via the terminal communication unit 31.

Therefore, when the user terminal 3 receives the advertisement from the server 2, the object management unit 37 outputs information about the advertisement so as to speak to the user via the information output unit 36. Upon hearing the advertisement, the user U makes a voice input to the user terminal 3 asking "Where can I buy it?", And the user terminal 3 transmits that fact and the location information to the server 2.

After that, the server 2 transmits information on the sales location of the advertising product in the vicinity of the user's location based on the keyword and location information to that effect on the user terminal 3. Then, the user terminal 3 outputs the information of the sales place as a voice. In this way, the user U has the effect of being able to hear the information he / she wants to know about the advertisement by voice without seeing the video.

Further, the information regarding the advertisement in the above embodiment may be odor information. For example, the information output unit 36 of the user terminal 3 contains at least one odor element, and the information output unit 36 can emit one or more odor elements. The odorant may be a single chemical substance such as furaneol (strawberry scent) or 1-hexanol (forest scent), or a combination thereof. Further, for example, regardless of the composition of the chemical substance, an odor having a scent equivalent to that of jasmine as one unit may be used. That is, for example, the information output unit 36 may output an equivalent odor by combining a plurality of chemical substances using the odor of strawberry milk as an output method, or the odor of strawberry as one unit and the odor of milk. The odor may be output in combination with the odor of one unit. Then, for example, when the user U talks to the user terminal 3 that he / she wants to know the odor of the advertisement product, the information output unit 36 outputs the odor of the advertisement product.

Further, the information regarding the advertisement in the above embodiment may be taste information. For example, the information output unit 36 of the user terminal 3 contains at least one taste element, and the information output unit 36 can release one or more taste elements. The taste element may be, for example, a single chemical substance such as inosinic acid or glutamic acid, or a combination thereof. Further, for example, regardless of the composition of the chemical substance, a taste equivalent to the strawberry taste may be used as one unit. That is, for example, the information output unit 36 may output the same taste by combining a plurality of chemical substances by using the taste information of strawberry chocolate as an output method, or the taste with the strawberry taste as one unit and the chocolate taste. May be output in combination with a taste having a unit of. Then, for example, when the user U talks to the user terminal 3 that he / she wants to know the taste of the advertisement product, the information output unit 36 outputs the taste of the advertisement product.

Further, the information regarding the advertisement in the above embodiment may be tactile information.

Further, in the above embodiment, the user terminal 3 receives the advertisement discontinuously, but the present invention is not limited to this. For example, the user terminal 3 may be provided with an advertisement update unit (not shown) that can automatically receive advertisements related to the surrounding environment when the surrounding environment of the user U changes.

For example, the advertisement update unit provided in the user terminal 3 has a function of updating the advertisement according to the change of the user's location, and detects when the user U moves or the location changes, and detects the advertisement acquisition unit. It has a function to make 35 acquire a new advertisement. Further, the condition for updating the advertisement by the advertisement update unit is not limited to the change in the location of the user, but may be the change in the time zone. For example, the advertisement update unit may acquire the advertisement at a specific time zone or may acquire the advertisement at a predetermined time interval. In addition, the advertisement update unit may acquire the updated advertisement every time the advertisement related to the search result is updated. Further, the advertisement update unit may be integrated with the advertisement acquisition unit.

Further, in the augmented reality mode, the surrounding real space image P (information in the real space) captured by the camera 32 and the virtual character O (virtual object) generated by the object management unit 37 are displayed on the display unit. The state displayed in 34 is not limited to this. For example, an augmented reality draft service that recognizes the surrounding real space (buildings, roads, objects, etc.) taken by the camera based on the location information of the user terminal and the direction in which the user terminal is facing (for example, Google map). It may be a service (Live View).

Further, in the present embodiment, a virtual space based on augmented reality (AR) is assumed, but the present invention is not limited to this, and is limited to a virtual reality (VR) space or a mixed reality (MR) space. Even if there is, the advertisement providing system of this embodiment can be applied as it is.

<Second embodiment>
In the second embodiment, the storage unit 22 of the server 2 includes the object DB 22c in addition to the advertisement DB 22a.

The object DB 22c stores model information (hereinafter, also simply referred to as a virtual object) of a virtual object arranged in the augmented reality space. The model information can be, for example, data in a format such as USDZ or glTF.

In the second embodiment, the providing unit 23 provides augmented reality content. The providing unit 23 can provide augmented reality content in response to a request from the user terminal 3, for example. In the request, a virtual object (hereinafter referred to as a content object) that the user wants to view, such as a character, is specified. The providing unit 23 reads the content object specified in the request from the storage unit 22, and responds to the user terminal 3 with augmented reality content including the content object and scene information for arranging the content object in the augmented reality space. .. At this time, the providing unit 23 can respond to the user terminal 3 by including a virtual object for displaying the advertisement (hereinafter, referred to as an advertisement object) in the augmented reality content. The providing unit 23 can paste an advertising image as a texture of an advertising object, for example.

In step S2, the user terminal 3 transmits a request for augmented reality content to the server 2. The request includes the specification of a virtual object such as a character that the user wants to view.

In step S3, the server 2 creates augmented reality content in response to the request. The server 2 can create augmented reality content by reading model information corresponding to a virtual object (hereinafter referred to as a content object) such as a character specified in a request from the object DB 22b, for example. The server 2 can also generate an object such as a background set or an accessory that is not specified by the user as an advertisement object, attach the advertisement information to the texture of the advertisement object, and then include it in the augmented reality content. Further, the server 2 can include scene information in which the arrangement position and movement of the content object and the advertisement object are specified in the augmented reality content.

In step S4, the user terminal 3 receives the augmented reality content and can create an augmented reality scene based on the received augmented reality content.

As described above, according to the augmented reality system according to the second embodiment, the advertisement object can be provided in association with the content object that the user wants to browse. Therefore, the advertisement can be placed in the same augmented reality space as the content object that the user is interested in.

Further, in the second embodiment, the user can perform the purchase procedure of the product or the like as in the first embodiment.

In addition, the purchase processing unit may output information necessary for the purchase processing to the augmented reality space.

In addition, the object management unit controls the character to output the message required for the purchase document as a line when the user requests the purchase of the product.
An augmented reality system featuring.

1 Advertising provision system 2 Server 3 User terminal 21 Server communication unit
22 Storage unit 22a Advertising DB
22b user DB
22c object DB
23 Advertising section 24 Payment section 31 Terminal communication section 32 Camera 33 Input section 34 Display section 35 Advertising acquisition section 36 Information output section 37 Object management section 38 Purchasing processing section 39 Position measurement section

Claims (3)

A storage unit that stores content objects that represent content to be displayed in augmented reality space and advertising information,
An input unit that accepts the designation of the content object,
An object management unit that arranges the advertisement information together with the designated content object in the augmented reality space, and
A purchasing processing unit that performs purchasing processing of products related to the advertising object, and
An augmented reality system characterized by being equipped with. The augmented reality system according to claim 1.
The purchase processing unit outputs information necessary for the purchase processing to the augmented reality space.
An augmented reality system featuring. The augmented reality system according to claim 1.
The content object is a character
When the object management unit receives a purchase request for the product from the user, the object management unit controls the character to output a message necessary for the purchase as a line.
An augmented reality system featuring.

Images