JP2014089401A - Communication system and digital signage for the same and mobile terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication system capable of expecting high advertising effects without imposing any labor on a terminal user by allowing a digital signage and the user of a mobile terminal to achieve communication via a pseudo character jumping out of the digital signage and jumping into the mobile terminal.SOLUTION: When a terminal user carrying a mobile terminal 2 approaches a distance where the user can visualize the display content of a large-scale display 101 of a digital signage 1, radio connection is automatically established between them. Then, when a character 5 displayed on the large-scale display 101 of the digital signage 1 jumps out, and jumps into a terminal display 201 of the mobile terminal 2. Thus, it is possible to positively appeal the existence of the digital signage 1 to the terminal user 4.

Description

  The present invention relates to a communication system and its digital signage and mobile terminal, and more particularly, to a communication system for directing output of information pushed from digital signage to a character on a display of the mobile terminal, and the digital signage and mobile terminal.

  Patent Document 1 discloses a display device that detects a distance to a person detected by ultrasonic waves. In this apparatus, when the infrared sensor detects that a person is near the display unit, the distance to the person is detected by the ultrasonic sensor, the eye position of the person is estimated, and the eye Based on the position, the display brightness of the display device, the size of characters to be displayed, and the orientation of the display device are automatically adjusted so as to be noticed.

  Patent Document 2 discloses a display device that obtains a distance from a user to a screen based on a user's face image captured by a camera. In this apparatus, the distance from the user to the screen is obtained based on the photographed user's face image, and when the user brings the face close to the screen, the displayed document is reduced by reducing the character display size. When the user leaves the screen, the character display size can be increased, the visibility can be increased, and the user can be alerted.

JP 2006-126229 A JP 2006-023953

  In order to deliver digital signage advertisement-related information to individuals, a technology has been developed in which when a pedestrian approaches the display, the user terminal automatically wirelessly connects to the WiFi AP attached to the display at a distance where the display can be seen. On the other hand, in order to improve the advertising effect of digital signage, there is a demand for a function that attracts the interest of users who pass by.

  Patent Document 1 discloses a method for detecting a distance to a person detected by ultrasonic waves. If this method is used, the brightness of the display, the size of the characters to be displayed, and the orientation of the display device can be automatically adjusted to make adjustments that improve the visibility of the display. A function that makes you aware of However, this method cannot exchange data with each other and cannot identify the user. In addition, it cannot be applied when multiple people stay.

  In Patent Document 2, it is possible to detect that a person is approaching by using a method of detecting a user by image recognition. However, the assumed environment here is a state in which a large number of people approach the display device or move around within a range of several meters to several tens of meters. Therefore, when image recognition is used, in an environment where there are many people at the same time, it is difficult to identify each person and display customized content when people overlap or pass each other. .

  The object of the present invention is to solve the conventional technical problem, and to communicate with a user of a digital signage and a mobile terminal through a pseudo character that jumps out of the digital signage and jumps into the mobile terminal. It is an object of the present invention to provide a communication system that can expect a high advertising effect without imposing a burden on a terminal user, and its digital signage and mobile terminal.

  In order to achieve the above object, the present invention is characterized in that the following measures are taken in a communication system including a digital signage and a mobile terminal that perform wireless communication with each other.

  (1) The mobile terminal jumped out from the digital signage display, a distance measuring means for measuring the distance to the digital signage, a wireless connection means for requesting a wireless connection to a nearby digital signage and establishing a wireless connection, First animation synchronization means for producing an animation for jumping in the character on the terminal display so that the jump-out and the jump-in are synchronized, and information for causing the character jumped in on the terminal display to speak from the digital signage Information receiving means for receiving and first character effect means for causing the jumped-in character to speak the information.

  (2) Digital signage is a wireless connection means that establishes a wireless connection in response to a wireless connection request from a nearby mobile terminal, and jumps out the character displayed on the display to the terminal display of the mobile terminal. Second animation synchronization means for producing an animation to be jumped in so that the jump-in and jump-out are synchronized, and information transmission means for transmitting information to be uttered by the character jumped in on the terminal display.

According to the present invention, the following effects are achieved.
(1) The first approach from the signage side to the terminal user is carried out by jumping in a carranter that imitates a person on the terminal display. For this,

  For the signage side, it is possible to make a positive and impactful approach compared to the conventional approach that only displays information on the signage display. You will be able to appeal strongly.

  For terminal users, it is no longer possible to overlook the presence of signage as an information provider and fail to acquire information. The

  (2) Communication between the signage side and the terminal user is performed through an anthropomorphic character displayed on the terminal display. For this,

  For the signage side, the information providing method can be optimized by controlling the movement, color, facial expression and the like of the character in accordance with the priority and content of the information to be provided. For example, when important information with high priority is provided, the content of the information can be strongly appealed to the terminal user by increasing the movement of the character.

  For the terminal user, if the information provided by the signage is unnecessary for the terminal user, even if it is difficult to refuse if the other party is a human being, the other party is a character, so it can be easily refused.

  (3) For characters that jump in to the terminal display, a unique character is set on the signage side.For example, if the signage side is a fish shop, the character wears a uniform unique to the fish shop, so communication closer to the face-to-face method Is possible.

It is the figure which expressed the outline | summary of this invention typically. It is a functional block diagram of digital signage and a mobile terminal. It is operation | movement explanatory drawing which made the shopping in a supermarket an example. It is the figure which showed the example of a display of a terminal display. It is the sequence flow which showed the operation | movement of one Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram schematically showing the outline of the present invention, which is composed of a digital signage 1 and a portable information terminal (hereinafter referred to as a mobile terminal) 2 that is wirelessly connected to the digital signage 1. The digital signage 1 is mounted or mounted with a general-purpose Bluetooth (registered trademark) and / or WiFi AP (Access Point) wireless interface 3. The mobile terminal 2 also includes a wireless interface of Bluetooth (registered trademark) and / or WiFi, and can estimate the distance from the digital signage 1 by receiving RSSI (Received Signal Strength Indicator).

  In the digital signage 1, an anthropomorphic character 5 is registered in advance according to its installer, installation location, or information to be provided, and is resident on a large display on which information such as advertisements and flyers is displayed.

  When a user carrying the mobile terminal 2 (hereinafter referred to as a terminal user) approaches a distance at which the display content of the large display 101 of the digital signage 1 can be visually recognized, a wireless connection is automatically established between the two. Next, the character 5 displayed on the large display 101 of the digital signage 1 jumps out and jumps in on the terminal display 201 of the mobile terminal 2. Thereby, the presence of the digital signage 1 can be positively appealed to the terminal user 4.

  The character 5 jumped into the terminal display 201 of the mobile terminal 2 can develop a dynamic solicitation and business by acting as a virtual store clerk, a guide clerk or a customer clerk. The terminal user 4 establishes communication with the digital signage 1 through the character 5 to receive customer service and information.

  Through such anthropomorphic character 5 communication, the digital signage side can realize an active solicitation equivalent to calling or calling to the terminal user 4, while the terminal user 4 Since it is a virtual character 5, it can be ignored or refused without hesitation without needing to feel obsession, while receiving an active solicitation equivalent to calling or calling.

  FIG. 2 is a functional block diagram showing the configuration of the main parts of the digital signage 1 and the mobile terminal 2. Here, the configuration unnecessary for the description of the present invention is omitted.

  In the mobile terminal 2, the wireless communication unit 202 measures the distance from the digital signage 1 based on the Bluetooth (registered trademark) signal transmitted from the digital signage 1 or the RSSI (Received Signal Strength Indication) of the WiFi signal. A wireless connection is requested to the adjacent digital signage 1 including the unit 202a, and wireless communication is performed using the established wireless communication path. For the measurement of the relative distance, near field communication means such as ultrasonic waves, infrared rays, RFID / Felica / NFC may be used in combination.

  The character production unit 203 includes an animation synchronization unit 203a that produces an animation for jumping in the character 5 jumped out from the large display 101 of the digital signage 1 to the terminal display 201 so that the jump-out and the jump-in are synchronized. An anthropomorphic movement or utterance on the terminal display of the character 4 jumped in is produced.

  The information receiving unit 204 receives information from the digital signage 1 that causes the character 4 jumped in on the terminal display to speak and information to be statically displayed on the terminal display 201.

  In the digital signage 1, the wireless communication unit 102 establishes a wireless connection in response to a connection request from the mobile terminal 2. The character effector 103 performs an animation for causing the character displayed on the large display 101 to jump out and jumping into the terminal display 201 of the mobile terminal 2 so that the jump-in and jump-out are synchronized. It includes a synchronization unit 103a and produces anthropomorphized movements and utterances of the character 5 on the terminal display 101.

  The information transmission unit 104 transmits utterance information to be uttered by the character 5 jumped into the mobile terminal 2 and image information to be statically displayed on the terminal display 201.

  Next, a method of synchronizing characters that jump out on one display and jump in on the other display will be described.

  Each of the character presentation units 103 and 203 is an image, voice, and utterance content of the character 5 that is displayed on the terminal display of the mobile terminal 2 that is the jump-in destination by the animation synchronizer 103a on the digital signage side that causes the character 5 to jump out first. The jump-in script associated with the frame ID is transmitted to the mobile terminal 2.

  Next, the character rendering unit 103 of the digital signage 1 creates a jump-out scene of the character 5 on the large display according to the jump-out script prepared for itself in advance, and the Sync in which the current frame ID is described. Commands are sequentially transmitted to the mobile terminal 2 in units of frames.

  When the animation synchronization unit 203a of the mobile terminal 2 receives the Sync command, the animation effect associated with the frame ID corresponding to the frame ID described in the Sync command is reproduced in the jump-in script. Request to unit 203. The character presentation unit 203 refers to the jump-in script and sequentially reproduces animations and utterances associated with the frame ID corresponding to the requested frame ID.

  Here, each frame ID is associated with the terminal user 4 because the character 5 jumping out from the large display 101 of the digital signage 1 jumps in synchronization with the terminal display 201 of the mobile terminal 2. It seems that the jump-out and jump-in of the character 5 are performed in synchronization.

  In this embodiment, the animation synchronizers 103a and 203a are devised to increase the continuity and consistency of jump operations between devices. That is, since the drawing areas of the signage 1 and the mobile terminal 2 are generally handled as separate screen spaces, a simple synchronization means for jumping into the mobile terminal 2 at the moment when the character 5 jumps out of the signage 1 can be used. Good.

  However, if the sense of realism and expressiveness are increased, it will easily resonate with the user's subconscious, and it will be easier to obtain the same advertising effect as when the actual store clerk is called out. Therefore, in this embodiment, a sequential synchronization method is adopted, and the screens of the signage 1 and the mobile terminal 2 are virtually handled as one drawing area so that the jump operation can be seen continuously.

  For example, when a part (for example, the head) of the character 5 jumps out of the signage 1, only the head of the character 5 is displayed on the display 201 of the mobile terminal 2, and then the mobile body jumps out of the signage 1 from the signage 1. The body jumps into the display 201 of the terminal.

  In order to realize such a synchronization method, in this embodiment, the animation image information of the character 5 displayed on the display 201 of the mobile terminal 2 is classified into a plurality of folders associated with the signage classification ID. It is stored in the storage of each mobile terminal 2. When a wireless connection is established with the signage 1, the mobile terminal 2 reads and draws the animation image of the character 5 from the folder using “signage classification ID + frame ID” as a search condition.

  For example, in the storage of the mobile device 2, manage the animation image file of the fish shop figure in the folder “FISH” and the greengrocer figure in the folder “VEGETABLE”. Analyzes the category ID “_FISH” and decides to read the image file corresponding to the specified frame ID from the folder “_FISH”.

  Also, without saving the animation image file in the internal storage of the mobile terminal 2, necessary information (corresponding to a jump-in script) is sent to the mobile terminal 2 at once after the automatic connection with the signage 1 is established. Then, the effects may be synchronized only by sending and receiving the frame ID.

  Furthermore, if the data transfer between the signage 1 and the mobile terminal 2 is high speed and low latency, the image information may be transferred from the signage 1 to the mobile terminal 2 and displayed for each frame ID.

  Next, as shown in FIG. 3, an operation of one embodiment of the present invention is exemplified by shopping in a supermarket where two digital signage 1 a and 1 b are installed, one for each fish shop and greengrocer. Will be explained.

  The digital signage 1a installed in the fish shop corner (hereinafter referred to as “fish shop signage”) and the digital signage 1b installed in the green shop corner (hereinafter referred to as “green shop signage”) are shown in FIG. Thus, today's flyer (advertisement) is displayed, and a character 5 simulating each store clerk is displayed.

  When the terminal user 4 first approaches the fish shop corner and enters the wireless coverage of the fish shop signage 1a, a wireless connection is established between the fish shop signage 1a and the mobile terminal 2.

  Next, the character 5 jumps out from the fish shop signage 1a, and in synchronization with this, the character 5 jumps into the mobile terminal 2. FIG. 4A shows a display example of the terminal display 201 immediately after the character 5 jumps in. The jumped-in character 5 is superimposed on the image information transmitted from the fish shop signage 1a.

  According to the jump-in script, the character 5 in the shape of a fish shop who jumped in introduces today's bargain products, recommended products, etc. with animation and text in a balloon. At this time, regarding particularly recommended products and information, it is desirable to make the characters stand out by increasing the movement of the character or flashing the characters in the balloon.

  The terminal display 201 displays a check box for a product that can be purchased at the fish shop, and the terminal user 4 can place an order for the product by checking the check box for the desired product. The order result is transmitted wirelessly to the fish shop signage, and the fish shop clerk confirms and sells it.

  Next, when the terminal user 4 moves away from the fish shop corner to the greengrocer corner and the relative distance from the fish shop signage 1a increases, the character 5 in the fish shop jumps out of the terminal display 201 and wireless connection with the fish shop signage 1a is established. Disconnected. If there is no desired product, the character jumps out of the terminal display 201 and the wireless connection with the fish shop signage is disconnected if the user leaves the spot without checking the check box.

  Next, when the terminal user 4 reaches the front of the greengrocer corner, a wireless connection is established again between the greengrocer signage 1b and the mobile terminal 2. Next, the character 5 jumps out from the greengrocer signage 1b, and in synchronization with this, the character 5 jumps into the mobile terminal 2. FIG. 4B is a display example immediately after the character 5 jumps in. The jumped-in character 5 is superimposed on the image information transmitted from the greengrocer signage 1b.

  Next, the greengrocer character 5 displayed on the screen of the greengrocer signage 1b jumps in to the terminal display 201 of the user terminal 4 in the same manner, and the presently purchased product or recommended product is animated or text in a balloon. Introduce in.

  The terminal display 201 displays a check box for a product that can be purchased at the greengrocer, and the terminal user 4 can place an order for the product by checking the check box for the desired product. The result of the order is transmitted wirelessly to the greengrocer signage 1b, and the clerk of the greengrocer confirms and sells it.

  In the above embodiment, it is assumed that the jump-out timing of the character 5 jumping into the terminal display 201 is immediately before the mobile terminal 2 and the digital signage 1 are separated from each other and the wireless connection between the two is disconnected. However, the present invention is not limited to this, and may be the timing when all shopping at the store of the digital signage 1 to which the character belongs is completed.

  For example, the terminal user 4 creates a shopping list in advance before shopping. After that, when you go to the supermarket, if a character dressed as a fish shop jumps in from the fish shop signage 1a, it jumps out at the timing when the purchase of all the products handled in the fish shop is completed. You may do it. Whether or not shopping has been completed can be determined based on whether or not all the check boxes of products handled in the fish shop among the products listed in advance are checked.

  In this way, if the timing at which the character 5 is jumped out from the terminal display 201 is the timing at which purchase of all the products handled in the store among the products listed in advance is completed, the user will notice that he / she has forgotten to purchase later. It is possible to prevent waste such as returning to the store.

  Next, with reference to the sequence flow of FIG. 5, operations from the peripheral search by the mobile terminal to the establishment of the wireless connection, the character effect, and the wireless disconnection will be described.

  At time t1, the mobile terminal 2 starts a peripheral search (WiFi AP scan) for receiving an RSSI radio wave intensity signal. At time t2, digital signage 1 returns an SSID / RSSI response in response to the RSSI search request. When RSSI exceeding a predetermined threshold is received at mobile terminal 2 at time t3, the presence of the connection target is recognized. At time t4, exclusive control is performed using the intra-terminal radio suspend function in order to suppress radio interference from other applications and the terminal OS.

  At time t5, the WiFi AP connection procedure is started in the mobile terminal 2. At this time, since necessary authentication information is stored in the application of the mobile terminal 2, the connection process is executed using the authentication information related to the SSID of the WiFi AP. At time t6, the authentication information is verified in the WiFi AP. If the authentication information is approved, an IP address is assigned to the mobile terminal by DHCP.

  At time t7, a socket connection is requested from the mobile terminal 2 to the digital signage 1. At time t8, the digital signage 1 accepts the request and returns an ACK response. At time t9, an authentication request is requested again from the mobile terminal 2, and the digital signage 1 determines the validity of the authentication information. When the authentication information is stabilized, an ACK response is returned at time t10 to establish a connection. The

  At time t11, the mobile terminal 2 requests the digital signage 1 to move the character 5. In response to the movement request, the digital signage 1 produces a jump-out of the character 5 displayed on the large display 101, and also synchronizes the jump-in production of the character to the mobile terminal 2 at time t12. Is pushed to the mobile terminal 2. At time t13, the mobile terminal 2 produces a jump-in of the pushed character 5 on the terminal display.

  Thereafter, when the user terminal 2 moves away from the digital signage 1, the mobile terminal 2 requests the digital signage 1 to disconnect the socket at time t14 while performing a character jump-out effect from the terminal display 201. The digital signage 1 performs the jump-in effect of the character 5 on the large display while synchronizing with the character 5 to be jumped out before accepting the request for disconnecting the socket and disconnecting the wireless connection.

  Next, the wireless search and exclusive control during wireless connection will be described in more detail. Since the WiFi hardware of the mobile terminal 2 is a shared resource that can be used simultaneously by a plurality of processes, contention and deadlock may occur due to simultaneous access from other applications and OSs. Therefore, in the present embodiment, exclusive control is realized by the following procedure.

Step 1: Make sure that WiFi resources are not occupied by other processes.
Procedure 2: If it is occupied, set a timer, wait 1 second and check again.
Step 3: If it is still occupied, the process is temporarily suspended with reference to the occupied process ID.
Step 4: In order to prevent other processes from starting to use the WiFi resource, a sign (lock) indicating that the occupation is not permitted is set up until the end of the processing of the WiFi resource.
Procedure 5: When the processing is completed, the execution of the other processes that have been interrupted is recovered.

  DESCRIPTION OF SYMBOLS 1 ... Digital signage, 3 ... Access point, 2 ... Mobile terminal, 4 ... Character, 5 ... Character, 101, 201 ... Large display, 102, 202 ... Wireless communication part, 103, 203 ... Character effect part, 103a, 203a ... Animation synchronization unit, 104, 204 ... information transmission means, 202a ... distance measurement unit

Claims (7)

In a mobile terminal that directs the output of information received from digital signage to a character,
Means for measuring the distance from the digital signage;
Means for requesting a wireless connection to a nearby digital signage and establishing a wireless connection;
First animation synchronization means for producing an animation for jumping in a character jumped out from the display of the digital signage onto a terminal display so that the jump out and the jump in are synchronized;
Information receiving means for receiving from the digital signage information to be spoken to the character jumped in on the terminal display;
A mobile terminal comprising: first character rendering means for causing the jumped-in character to utter the information.   The animation synchronization means further provides an animation in which the character displayed on the terminal display is jumped out and jumped in on the digital signage display so that the jump-in and jump-out are synchronized. The mobile terminal according to claim 1.   The mobile terminal according to claim 1, wherein an appearance of the character is associated with content of information received from the digital signage. In digital signage that directs the output of the information sent to the mobile terminal to the character,
Wireless connection means for establishing a wireless connection in response to a wireless connection request from a nearby mobile terminal;
Second animation synchronization means for producing an animation for jumping out a character displayed on the display and jumping in on the terminal display of the mobile terminal so that the jump-in and jump-out are synchronized;
A digital signage comprising information transmitting means for transmitting information to be uttered by a character jumped in on a terminal display.   The animation synchronization means further produces an animation for jumping in a character jumped out from a terminal display of the mobile terminal onto the display so that the jump out and the jump in are synchronized. Digital signage as described.   The digital signage according to claim 1 or 2, wherein the appearance of the character is associated with the content of information transmitted by the digital signage. In a communication system composed of digital signage and mobile terminals that communicate with each other wirelessly,
The mobile terminal is
A distance measuring means for measuring the distance from the digital signage;
Wireless connection means for requesting a wireless connection to a nearby digital signage and establishing a wireless connection;
First animation synchronization means for producing an animation for jumping in a character jumped out from the display of the digital signage onto a terminal display so that the jump out and the jump in are synchronized;
Information receiving means for receiving from the digital signage information to be spoken to the character jumped in on the terminal display;
First character rendering means for causing the jumped-in character to utter the information,
The digital signage is
Wireless connection means for establishing a wireless connection in response to a wireless connection request from a nearby mobile terminal;
Second animation synchronization means for producing an animation for jumping out a character displayed on the display and jumping in on the terminal display of the mobile terminal so that the jump-in and jump-out are synchronized;
A communication system comprising information transmitting means for transmitting information to be uttered by a character jumped in on a terminal display.