JP2014203223A - Display device, display system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To exert a higher advertisement effect.SOLUTION: A display device comprises: a display unit; an imaging unit that captures a surrounding environment of the display unit; and a control unit that displays content concerning a game established by recognizing a motion of a hand on the display unit, captures a user's motion in the game by the imaging unit, analyzes the video to predict the user's final hand form before a result, and reflects it in the result of the game. The control unit detects the user's face from the video captured by the imaging unit, analyzes the detected face part to determine an attribute of the user, and determines a winning rate of the game on the basis of the determination result.

Description

  The present invention relates to a display device, a display system, and a program that can issue premiums such as coupons.

Conventionally, in a display device such as a digital signage device, the content of an advertisement image can be easily changed, so that an excellent advertising effect can be achieved in that the latest information can always be provided to a viewer (for example, Patent Documents). 1).
In recent years, a technology has also been developed in which a premium (for example, a coupon ticket) related to a displayed advertisement content is transferred from a display device to a mobile terminal by communicating the mobile terminal of the user with the display device.

JP2012-128210A

By the way, it is desired to further improve the advertising effect even in the premium issue type display device.
An object of the present invention is to exert a higher advertising effect.

The display device of the invention according to claim 1
A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, Determine the winning percentage.

The display system of the invention according to claim 5 is:
A display device;
A server connected to the display device via a network;
The display device
A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
A communication unit for communicating with the server;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the image captured by the imaging unit, determines the user's attribute by analyzing the detected face part, and determines the determination result from the communication unit. Output to the server,
The server
When the determination result determined by the control unit is input from the communication unit, the winning rate of the game is determined based on the determination result, and the determined winning rate is output to the display device.

The program of the invention according to claim 9 is:
Display computer,
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. Function as a control unit that predicts the shape before the result and reflects it in the result of the game,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, This is a program for determining the winning percentage.

  According to the present invention, a higher advertising effect can be exhibited.

It is a block diagram which shows schematic structure of the display system which concerns on this embodiment. It is a block diagram which shows the main control structure of the digital signage apparatus which concerns on this embodiment. It is a front view which shows schematic structure of the screen part which concerns on this embodiment. It is a table | surface which shows an example of the winning probability in the prize information which concerns on this embodiment. It is a block diagram which shows the main control structure of the portable terminal which concerns on this embodiment. It is a flowchart which shows the flow of the soap process performed with the digital signage apparatus which concerns on this embodiment.

  The best mode for carrying out the present invention will be described below with reference to the drawings. However, although various technically preferable limitations for implementing the present invention are given to the embodiments described below, the scope of the invention is not limited to the following embodiments and illustrated examples.

  FIG. 1 is a block diagram showing a schematic configuration of a display system 1 according to the present embodiment. The display system 1 includes a digital signage device 2 as a display device according to the present invention, a server 3 that can communicate with the digital signage device 2 via a network N, and a digital signage device using a short-range wireless communication technology such as NFC. 2 is provided with a portable terminal 4 that can communicate freely.

  FIG. 2 is a block diagram showing a main control configuration of the digital signage apparatus 2. The digital signage device 2 includes a projection unit 21 that emits image light of a person image, and a human-type screen unit 22 that receives the image light emitted from the projection unit 21 at the back and projects it onto the front.

  The projection unit 21 is connected to the control unit 23 that controls each unit based on content data including images and sounds, and is connected to the control unit 23. The projection unit 21 converts the video data output from the control unit 23 into video light and converts it into a screen unit. A projector 24 that irradiates toward the projector 22, a storage unit 25 that stores each content data and program, and a communication unit 26 that communicates with the server 3 via the network N are provided.

Next, the screen unit 22 will be described.
FIG. 3 is a front view illustrating a schematic configuration of the screen unit 22. As shown in FIG. 3, the screen unit 22 includes a display unit 27 on which the upper body of a person is displayed and a pedestal 28 that supports the display unit 27.
The outer shape of the display unit 27 is formed in a shape imitating the upper body of a person. The display unit 27 is formed by a single translucent plate 29 such as an acrylic plate that is substantially orthogonal to the image light irradiation direction. A film screen for rear projection is laminated on the back surface of the translucent plate 29, and a film-like Fresnel lens is laminated on the back surface of the film screen. An imaging unit 30 such as a camera is provided at a portion of the display unit 27 corresponding to the eyes of the person. The imaging unit 30 captures an image of a space facing the display unit 27 in real time. The imaging unit 30 preferably has a high-speed shooting function.
The pedestal 28 has a reader / writer unit (near field communication unit) 31 for performing near field communication with the portable terminal 4 and reading / writing information from / to the portable terminal 4, a button type operation unit 32, and an audio output such as a speaker. A unit 33 and a voice input unit 34 such as a microphone are provided.
The reader / writer unit 31, the operation unit 32, the audio output unit 33, the audio input unit 34, and the imaging unit 30 are connected to the control unit 23 as shown in FIG.

  The storage unit 25 stores premium information in addition to each content data. The premium information is information related to the Janken game executed by the digital signage device 2, and includes the winning rate of Janken, the contents of the premium provided after the victory, and the like.

The contents of the free gift information are determined based on the attributes of the user who performs the janken.
FIG. 4 is a table showing an example of the winning percentage in the premium information. In this example, when the user attribute is male, the user-side winning rate is 50%, when the user attribute is female, the user-side winning rate is 60%, and when the user attribute is child, the user-side winning rate is The winning percentage is set to 80%. In this way, the winning percentage is changed based on the attribute of the user who is playing.
In the example of FIG. 4, three types of male, female, and child are illustrated as user attributes. However, it is possible to classify the attributes more finely.

When the portable terminal 4 is held over the reader / writer unit 31, the control unit 23 reads information stored in the portable terminal 4 through the reader / writer unit 31 at the time of reading. On the other hand, at the time of writing, the control unit 23 stores the write information in the portable terminal 4 via the reader / writer unit 31.
Further, the control unit 23 reads content data related to the operation content from the storage unit 25 based on the operation signal from the operation unit 32, and controls the projector 24 and the audio output unit 33.

The control unit 23 analyzes the image obtained from the imaging unit 30 and the sound obtained from the sound input unit 34, reads out content data related to the analysis content from the storage unit 25, and outputs the projector 24 and the sound output unit. 33 is controlled.
Here, the storage unit 25 stores, as one of the content data, the janken content data that prompts the user to perform the janken. When the janken content data is read from the storage unit 25, the control unit 23 controls the projector 24 and the audio output unit 33 based on the janken content data. As a result, the user performs the janken. Before the Janken operation, the user's face is imaged by the imaging unit 30, and thus the control unit 23 performs well-known image processing on the captured user's face image to set the user's attributes. to decide. When the control unit 23 determines the attribute of the user, the control unit 23 determines the winning rate of the Janken based on the attribute. Next, the user's action in the hood is imaged in real time by the imaging unit 30. The control unit 23 performs image processing at high speed for each predetermined frame and analyzes the video input via the imaging unit 30 to identify the user's hand, and the final hand from the transition of the shape of the hand. Predict the shape before the result of Janken. Then, the control unit 23 determines the final hand shape on the digital signage apparatus 2 side based on the winning percentage determined before that, and then controls the projector 24 to determine the final hand shape. indicate.

  The control unit 23 controls the communication unit 26 to communicate with the server 3 according to information from the mobile terminal 4 and an operation signal from the operation unit 32. Information obtained by communication is stored in the storage unit 25.

FIG. 5 is a block diagram showing a main control configuration of the mobile terminal 4.
The mobile terminal 4 is a mobile device such as a mobile phone, a smartphone, or a tablet terminal. As shown in FIG. 5, for example, the mobile terminal 4 includes a display unit 41, an operation unit 42, a communication unit 43, a short-range communication unit 44, a storage unit 45, and a control unit 46 that controls them. It has been.
The display unit 41 is composed of, for example, a liquid crystal panel or an organic EL panel.
The operation unit 42 is, for example, a touch panel or an operation key.
The communication unit 43 performs communication according to standards such as 3G, LTE, and Wi-Fi.
The short-range communication unit 44 communicates with the reader / writer unit 31 of the digital signage device 2 by a short-range wireless communication technology such as NFC.
The storage unit 45 stores an application for communicating with the digital signage device 2. An application for performing communication with the digital signage device 2 includes a coupon acquisition application.
When the short-range communication unit 44 approaches the reader / writer unit 31 of the digital signage device 2, the control unit 46 activates a coupon acquisition application and communicates with the digital signage device 2 via the short-range communication unit 44 and the reader / writer unit 31. Send and receive.

Next, the operation of this embodiment will be described.
The Janken process executed by the digital signage apparatus 2 will be described. FIG. 6 is a flowchart showing the flow of the Janken process.
When the control unit 23 of the digital signage apparatus 2 is instructed to execute the soap processing by inputting information from the portable terminal 4 to the reader / writer unit 31 or an operation signal from the operation unit 32. Execute Janken processing.

In step S <b> 1, the control unit 23 determines the user's attribute by specifying the user's face from the video imaged by the imaging unit 30 and performing predetermined image processing on the face image.
In step S2, the control unit 23 determines the content of the premium information based on the user attribute determined in step S1.
In step S3, the janken content data is read from the storage unit 25, and the projector 24 and the audio output unit 33 are controlled based on the kenken content data. This starts Janken.

In step S4, the control unit 23 performs well-known image processing on the video imaged by the imaging unit 30 after the start of the soap, or detects the user's hand using a depth sensor or the like.
In step S5, the control unit 23 analyzes the image of the user's hand obtained from the imaging unit 30 by performing image processing at a high speed for each predetermined frame. Thereby, the control unit 23 recognizes the transition of the shape of the user's hand, and estimates the final hand shape before the result of the Janken.
In step S6, the control unit 23 generates a random number and compares it with the winning rate in the prize information to determine the result of the soap, and determines the final hand shape on the digital signage apparatus 2 side corresponding to the determination. After that, the final hand shape is displayed by controlling the projector 24. In addition, it is preferable to display a part of the case where it is determined that the player has lost.

In step S7, if the result of Janken is other than the user's win (losing or Aiko), the control unit 23 ends as it is, and if the user wins, the control unit 23 proceeds to Step S8.
In step S8, the control unit 23 controls the projector 24 to execute a near field communication request display.
In step S9, the control unit 23 determines whether or not the reader / writer unit 31 and the portable terminal 4 are communicable. If the communicable state is reached, the control unit 23 proceeds to step S10. The process proceeds to step S8 and waits until the portable terminal 4 is held over the reader / writer unit 31.
In step S <b> 10, the control unit 23 acquires a premium corresponding to the premium information selected in step S <b> 4 and outputs it to the portable terminal 4 via the reader / writer unit 31. Thereby, a free gift is provided to the user.

  As described above, according to the present embodiment, the user's face is detected from the video imaged by the imaging unit 30, and the user's attribute is determined by analyzing the detected face portion. Since the winning rate of Janken is determined based on this, the winning rate can be made different according to the attribute of the user, and an interesting property suitable for each attribute of the user can be provided. If interest is enhanced, it can be a factor that gives a good impression to the product displayed on the digital signage device 2 and can increase the advertising effect.

  Also, since the prize information determined by the digital signage device 2 is output from the reader / writer unit 31 to the portable terminal 4, the prize can be directly displayed on the portable terminal 4 owned by the user without being output to another medium such as paper. Can be provided.

  In addition, since the outer shape of the display unit 27 is humanoid, it is possible to create a sense of presence as if the other party is in the spot and to enhance the interest.

Note that the present invention is not limited to the above embodiment, and can be modified as appropriate.
For example, in the above-described embodiment, the projection type digital signage device 2 has been described as an example of the display device. However, a digital signage device using a liquid crystal panel or an organic EL panel can be applied as the display device.

  Moreover, in the said embodiment, since it communicates with the digital signage apparatus 2, the application for exclusive use is performed, but on the network by the internet browser mounted in the portable terminal 4 besides this It is also possible to communicate with the digital signage device 2 by executing an application.

  In the above embodiment, the case where the winning rate of the Janken, which is a part of the prize information, is changed based on the user attribute has been described as an example. It may be changed. This makes it possible to provide a prize suitable for the user's attribute.

  Further, in the above embodiment, the case where the digital signage device 2 executes Janken has been described as an example. However, as long as the game is established by recognizing the hand movement, it can be applied to other games other than Janken. The configuration of the present invention is applicable. As a game other than Janken, for example, “Turn it away”.

  In the above-described embodiment, the case where the entire Janken process is executed by the digital signage device 2 has been exemplified. However, it is also possible to execute the determination of premium information in the Janken process (Step S2) by the server 3. In this case, when the determination result determined by the control unit 23 of the digital signage device 2 is input from the communication unit 26, the server 3 determines the premium information (the winning rate of Janken or the contents of the premium) based on the determination result, The determined prize information is output to the digital signage device 2.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.

[Appendix]
<Claim 1>
A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, A display device that determines the winning percentage.
<Claim 2>
The display device according to claim 1, wherein the control unit determines the content of the premium information based on the determination result.
<Claim 3>
A short-range communication unit for short-range communication with a mobile terminal is provided.
The display device according to claim 2, wherein the control unit causes the short distance communication unit to output the determined premium information to the mobile terminal.
<Claim 4>
The display device according to claim 1, wherein the display unit is formed in a human shape.
<Claim 5>
A display device;
A server connected to the display device via a network;
The display device
A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
A communication unit for communicating with the server;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the image captured by the imaging unit, determines the user's attribute by analyzing the detected face part, and determines the determination result from the communication unit. Output to the server,
The server
When a determination result determined by the control unit is input from the communication unit, a win rate of the game is determined based on the determination result, and the determined win rate is output to the display device.
<Claim 6>
The display system according to claim 5, wherein the server determines the content of the premium information based on the determination result, and outputs the determined premium information to the display device.
<Claim 7>
The display device
A short-range communication unit for short-range communication with a mobile terminal is provided.
The display system according to claim 6, wherein the control unit outputs the premium information from the short-range communication unit to the portable terminal.
<Claim 8>
The display system according to claim 5, wherein the display unit is formed in a human shape.
<Claim 9>
Display computer,
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. Function as a control unit that predicts the shape before the result and reflects it in the result of the game,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, A program to determine the winning percentage.

DESCRIPTION OF SYMBOLS 1 Display system 2 Digital signage apparatus 3 Server 4 Portable terminal 21 Projection part 22 Screen part 23 Control part 24 Projector 25 Memory | storage part 26 Communication part 27 Display part 28 Base 29 Light transmission board 30 Imaging part 31 Reader / writer part (Near field communication part) )
32 Operation unit 33 Audio output unit 34 Audio input unit

Claims (9)

A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, A display device that determines the winning percentage.   The display device according to claim 1, wherein the control unit determines the content of the premium information based on the determination result. A short-range communication unit for short-range communication with a mobile terminal is provided.
The display device according to claim 2, wherein the control unit causes the short distance communication unit to output the determined premium information to the mobile terminal.   The display device according to claim 1, wherein the display unit is formed in a human shape. A display device;
A server connected to the display device via a network;
The display device
A display unit;
An imaging unit for imaging the surrounding environment of the display unit;
A communication unit for communicating with the server;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. A control unit that predicts the shape of the game before the result and reflects it in the game result,
The control unit detects the user's face from the image captured by the imaging unit, determines the user's attribute by analyzing the detected face part, and determines the determination result from the communication unit. Output to the server,
The server
When a determination result determined by the control unit is input from the communication unit, a win rate of the game is determined based on the determination result, and the determined win rate is output to the display device.   The display system according to claim 5, wherein the server determines the content of the premium information based on the determination result, and outputs the determined premium information to the display device. The display device
A short-range communication unit for short-range communication with a mobile terminal is provided.
The display system according to claim 6, wherein the control unit outputs the premium information from the short-range communication unit to the portable terminal.   The display system according to claim 5, wherein the display unit is formed in a human shape. Display computer,
An imaging unit for imaging the surrounding environment of the display unit;
The content related to the game established by recognizing the movement of the hand is displayed on the display unit, the movement of the game by the user is captured by the imaging unit, and the video is analyzed to analyze the final hand of the user. Function as a control unit that predicts the shape before the result and reflects it in the result of the game,
The control unit detects the user's face from the video captured by the imaging unit, determines the user's attribute by analyzing the detected face portion, and based on the determination result, A program to determine the winning percentage.

Images