WO2013151243A1

WO2013151243A1 - Synchronization method between mobile terminal and exhibition device using motion recognition apparatus

Info

Publication number: WO2013151243A1
Application number: PCT/KR2013/001901
Authority: WO
Inventors: 소수환; 최이권; 배종환; 김은진; 김남진; 이상범
Original assignee: 모젼스랩 주식회사
Priority date: 2012-04-03
Filing date: 2013-03-08
Publication date: 2013-10-10
Also published as: KR101411928B1; KR20130112188A

Abstract

The present invention relates to a synchronization method between a mobile terminal, which exists in a room having a complicated structure like a large exhibit hall, and an adjacent exhibition device. The method includes the steps of: (A) storing user information about a user terminal to a central server; (B) the central server periodically detecting the position of the user terminal and storing the detected position to a database; (C) the exhibition device sensing the user terminal located in front thereof through a motion recognition apparatus; (D) the exhibition device outputting request motion through a display device; (E) the exhibition device sensing the motion of the user terminal through the motion recognition apparatus; (F) the user terminal transmitting the sensing variation values of an accelerometer and a gyro sensor; and (G) the exhibition device determining whether the motion of the user terminal located in front of same is identical to the output request motion.

Description

Synchronization method between mobile terminal and exhibition device using motion recognition device

The present invention relates to a method of synchronizing a mobile terminal existing in a complex structure such as a large exhibition hall with an adjacent exhibition device. It is an invention about the result that is produced in carrying out the 'personalized marketer for intelligent exhibition marketing' task (task number: 10035426, period: 2010.04.01 ~ 2014.03.31) among the knowledge economy technology innovation projects of the Ministry of Knowledge Economy.

Recently, the holding of Daehyun exhibitions and fairs is becoming common, and this exhibition industry is developing into one industrial field.

As the scale of the exhibition industry increases day by day, various technologies are developed and applied for the user's convenience.

As an example, as shown in FIG. 1, Korean Laid-Open Patent Publication No. 10-2004-0057254 discloses a technology for providing convenience to a user by providing company information on an exhibition through an electronic terminal.

In addition, technology for measuring the location of the terminal in the room has also been researched and developed.

As shown in FIG. 2, Korean Patent Publication No. 10-2010-0008158 discloses a technique of calculating a position of a terminal based on a time difference between the high frequency impulse and an ultrasonic signal by transmitting a high frequency impulse and an ultrasonic signal from a plurality of fixed nodes. Is disclosed.

However, this method basically uses a calculation principle such as GPS in the principle of using the transmission time difference of a plurality of transmission signals. Therefore, accurate location calculation is possible only when there are no obstacles between the user and the fixed node in the building, and there are many obstacles (accessories in the building).

Therefore, conventionally, there is a problem in that the actual exhibition booth does not provide customized information desired by the user.

The present invention has been made to solve the above-mentioned conventional problems, the present invention by using the indoor location information of the user terminal, the exhibition device installed in the exhibition space in synchronization with the user terminal customized to meet the characteristics of the visitors The present invention provides a method for synchronizing between a mobile terminal and an exhibition device using indoor positioning coordinates to provide content.

According to a feature of the present invention for achieving the above object, the present invention comprises the steps of (A) the user information of the user terminal is stored in the central server; (B) the central server periodically detects the location of the user terminal and stores in the database; (C) the display device detecting the user terminal located in front of the motion recognition device; (D) the exhibition device outputting a request motion through a display device; (E) the exhibition device detecting the movement of the user terminal through the motion recognition device; (F) transmitting, by the user terminal, sensor change values to an acceleration sensor and a gyro sensor to a central server; (G) the display device determining whether the movement of the front user terminal coincides with the output request motion; (H) if the motion of the user terminal coincides with the request motion, requesting information of a user of the user terminal whose motion coincides with the request motion to the central server; (I) when the central server receives a request for user information from the exhibition device, specifying the user; And (J) retrieving the specified user information and transmitting the retrieved user information to the exhibition device.

(K) searching for the content corresponding to the received user information by the exhibition device; (L) The exhibition device may further perform the step of outputting the retrieved content.

In addition, the step (B), (B1) the user terminal receives a communication signal from the repeater; (B2) the user terminal transmitting a response signal to the central server in response to the received communication signal; (B3) calculating, by the central server, the primary position of the user terminal using the response signal; (B4) correcting the position of the user terminal by using the area information stored in the database by the central server; And (B5) storing the location of the calculated user terminal in the database by the central server.

The primary position calculation may be calculated as an area where communication areas of the repeaters receiving the response signal overlap.

In addition, the repeaters belonging to each of the repeater groups may be spaced apart from each other so that communication areas do not overlap each other.

The step (I) may include: (I1) searching for user terminals located within the sensing distance of the display device from the location information of the user terminals stored in the terminal location table; (I2) The method may further include specifying a user of the user terminal whose sensor change value transmitted by the step (F) matches the request motion among the searched user terminals.

In the synchronization method between the mobile terminal and the exhibition device using indoor positioning coordinates according to the present invention as described above, the following effects can be expected.

That is, in the present invention, it is possible to maximize the exhibition efficiency by allowing the exhibition device to provide customized content according to the characteristics of the user, and the viewer side also has the effect of maximizing the viewing efficiency.

1 is a flowchart illustrating a method of driving an exhibition information support system according to the related art.

Figure 2 is a block diagram showing the configuration of the indoor positioning system according to the prior art.

3 is a block diagram showing the configuration of a system of a method for synchronizing between a mobile terminal and an exhibition device using a motion recognition device according to the present invention;

4 is a flowchart illustrating a synchronization method between a mobile terminal and an exhibition device using a motion recognition device according to the present invention.

5 is a flowchart illustrating an indoor positioning method of a user terminal according to the present invention;

6 is an exemplary view showing an example of a synchronization method between a mobile terminal and an exhibition device using indoor positioning coordinates according to the present invention.

Hereinafter, a synchronization method between a mobile terminal and an exhibition device using indoor positioning coordinates according to a specific embodiment of the present invention will be described with reference to the accompanying drawings.

First, a system configuration of a synchronization method between a mobile terminal and an exhibition device using indoor positioning coordinates according to the present invention will be described.

3 is a block diagram showing the configuration of a system of a synchronization method between a mobile terminal and an exhibition device using a motion recognition apparatus according to the present invention.

As shown in the drawing, a system for synchronizing between a mobile terminal and an exhibition device using a motion recognition apparatus according to the present invention includes a user terminal 100, a central server 200, and an exhibition device 300.

The user terminal 100 detects the movement of the communication module 110 and the user terminal 100 to perform communication with the communication repeater and the acceleration sensor 120 and gyro sensor for transmitting to the central server 200 And 130.

The central server 200 includes a user database 210 for storing user characteristics for each user and a terminal location table 220 for detecting and storing a location of the user terminal 100.

The user characteristics stored in the user database 210 are data based on the personal information registered by the user when entering the exhibition space.

In addition, the terminal position data stored in the terminal position table 220 is stored by the central server 200 by periodically updating the terminal position value.

Meanwhile, a method of measuring the position of the user terminal 100 by the central server 200 will be described in detail with reference to FIG. 5.

In addition, the exhibition device 300 is configured to include a motion recognition device for detecting the user's motion 310 and the display device 320 for outputting a variety of content according to the characteristics of the user.

The sensing module 310 detects the movement of an object in front of the display device 300. Various sensing modules may be applied, but a Kinect module capable of detecting an accurate position is preferably applied.

The Kinect module is a recently commercially available sensing module, which will not be described in detail herein.

Hereinafter, a synchronization method between a mobile terminal and an exhibition device using a motion recognition apparatus according to the present invention will be described in detail with reference to the accompanying drawings.

4 is a flowchart illustrating a synchronization method between a mobile terminal and an exhibition device using a motion recognition apparatus according to the present invention, FIG. 5 is a flowchart illustrating an indoor positioning method of a user terminal according to the present invention, and FIG. It is an exemplary view showing an example of a synchronization method between the mobile terminal and the exhibition device using the indoor positioning coordinates by.

As shown in FIG. 4, the method for synchronizing between a mobile terminal and an exhibition device using a motion recognition apparatus according to the present invention begins with the user of the user terminal 100 storing user information in the central server 200 ( S110, S120).

In this case, the user information may be registered by directly connecting the user terminal 100 to the central server 200, or may be input by an administrator in a registration booth of a user.

Next, as the user terminal 100 moves inside the exhibition hall, the central server 200 periodically detects the position of the user terminal (S130).

The different central server 200 stores the detected location of the user terminal 100 in the terminal location table 220 (S140).

Looking at the position detection method of the user terminal 100 of the central server 200 in detail, a plurality of communication repeaters (not shown) are installed in the exhibition hall.

The communication repeater is configured to include two or more, the repeater is configured to include one or more repeaters using different communication methods. That is, it is divided into a repeater group using the first communication method and a repeater group using the second communication method, and each repeater group includes one or more repeaters.

In addition, repeaters belonging to each of the repeater groups are installed so that communication areas do not overlap. That is, each repeater using the same communication method is installed at a distance apart from each other so that there is no overlapping communication area.

On the other hand, the central server 200 stores a calculation unit for calculating the position of the user terminal 100, the calculated position of the user terminal 100 and area information for correcting the position of the user terminal 100.

The calculation unit receives a communication state of the user terminal through a repeater to calculate the position of the user terminal 100, and corrects the calculated position of the user terminal 100 using the area information.

In this case, the area information refers to information on the structure of the user terminal positioning target area.

The method of measuring the location of the user terminal of the central server 200 will be described with reference to FIG. 5. First, as shown in FIG. 5, the user terminal 100 starts from receiving a communication signal from a repeater (S11). .

In this case, the user terminal 100 does not receive a communication signal from two or more repeaters of the repeaters belonging to each repeater group according to the arrangement of the repeaters described above.

Thereafter, the user terminal 100 transmits a response signal to the received communication signal (S12).

In addition, the user terminal 100 calculates a moving direction of the user terminal 100 by using the measured values measured by the acceleration sensor 120 and the gyro sensor 130 to the central server through the repeater ( 200) (S13, S14).

On the other hand, the response signal is transmitted to the central server through the repeater (S21).

The central server 300 receiving the response signal calculates the primary position of the user terminal using the response signal (S22).

The primary position calculation is calculated with the repeater installation position and the communication area receiving the response signal. That is, in calculating the position of the user terminal using the communication signal, whether or not the signal is received is used but the reception strength and the reception time are not considered.

Thereafter, the central server 200 performs layout correction to correct the position of the user terminal 100 using area information (S23). That is, the layout correction refers to modifying the position of the actual user terminal 100 by excluding the region where the structure is located from the position area of the user terminal 100 measured in step 22.

In addition, the central server 200 corrects the position of the additional terminal according to the moving direction of the user terminal 100 transmitted and received from the user terminal 100 (S24 and S25).

After the terminal location table 220 is established, the exhibition device 300 detects the user terminal 100 located in front of the exhibition device 300 (S210). In this case, the detection of the user terminal 100 does not accurately detect the terminal itself, but rather a user (viewer) having the terminal.

After the exhibition device 100 detects the user terminal 100, the exhibition device 100 outputs a request motion so that the user can move the terminal in a specific form through the display apparatus 320 (S220). ).

That is, as shown in FIG. 6, when the user A or the user B is detected by the motion recognition device 310, the exhibition device 300 outputs a specific motion form to the display device 320. In this figure, the output of the vertical movement is shown.

Meanwhile, the user who recognizes the display device 320 moves the user terminal 100 in a form corresponding to the request motion.

At this time, the movement of the user terminal 100 is detected by the motion recognition device 310 (S230).

The exhibition device 300 determines whether or not the output request motion and the recognition motion recognized by the motion recognition device 310 match (S240).

If the request motion and the recognition motion do not match, step 210 of detecting the user is performed again. If the request motion and the recognition motion coincide with each other, the request server and the recognition motion correspond to the request motion. The user recognizes the matching recognition motion and requests information (S250).

In this case, the exhibition device requests user information including a corresponding request motion (or a recognition motion, which may include any of a request motion or a recognition motion, since both motions coincide).

On the other hand, when the user recognizes the display device 320 moves the user terminal 100 in a form corresponding to the request motion, the user terminal 100 by the acceleration sensor 120 and the gyro sensor 130 The movement of the user terminal 100 is detected.

Accordingly, the user terminal 100 transmits a sensor change value of the user terminal 100 sensed by the acceleration sensor 120 and the gyro sensor 130 (S310).

Of course, at this time, a unique identification number of the user terminal is assigned and transmitted.

The central server 200 receiving the sensor change value matches the sensor change value with the corresponding user terminal 100 and stores the sensor change value (S320).

On the other hand, when the central server 200 receives a request for user information from the exhibition device 300 by the step 250, the central server 200 specifies who the user is requested for the user information. (S410).

The user specific method may first search for a terminal list located within the sensing distance of the display device from the location information of the user terminal 100 stored in the terminal location table.

Further, among the first searched user terminals, the user terminal whose sensor change values transmitted in

steps

310 and 320 coincides with the request motion transmitted in step 250 is searched for and specifies a user.

After the user is specified, the central server 200 searches for the specified user information and transmits the retrieved user information to the exhibition device 300 (S420 and S430).

In this case, the user information refers to user information for selecting output content. For example, the user information may be a user's age, gender, occupation group, or the like.

Meanwhile, the exhibition device 300 that has received the user information searches for the content corresponding to the received user information and outputs the searched corresponding content (S440, S450, S460).

According to such a method, the exhibition device 300 may provide customized content according to the characteristics of the user located in front of the exhibition device 300.

The rights of the present invention are not limited to the embodiments described above, but are defined by the claims, and those skilled in the art can make various modifications and adaptations within the scope of the claims. It is self-evident.

The present invention relates to a method of synchronizing a mobile terminal existing in a complex structure such as a large exhibition hall with an adjacent exhibition device. According to the present invention, it is possible to maximize the exhibition efficiency by allowing the exhibition device to provide a customized content according to the user characteristics, the viewer side also has the effect of maximizing the viewing efficiency.

Claims

(A) storing user information of a user terminal in a central server;

(B) the central server periodically detects the location of the user terminal and stores in the database;

(C) the display device detecting the user terminal located in front of the motion recognition device;

(D) the exhibition device outputting a request motion through a display device;

(E) the exhibition device detecting the movement of the user terminal through the motion recognition device;

(F) transmitting, by the user terminal, sensor change values to an acceleration sensor and a gyro sensor to a central server;

(G) the display device determining whether the movement of the front user terminal coincides with the output request motion;

(H) if the motion of the user terminal coincides with the request motion, requesting information of a user of the user terminal whose motion coincides with the request motion to the central server;

(I) when the central server receives a request for user information from the exhibition device, specifying the user; And

(J) searching for the specific user information and transmitting the retrieved user information to the exhibition device.
The method of claim 1,

(K) searching for the content corresponding to the received user information by the exhibition device;

(L) a method of synchronizing between a mobile terminal and an exhibition device using a motion recognition device, characterized in that the display device further comprises the step of outputting the retrieved content.
The method of claim 2,

The (B) step,

(B1) the user terminal receiving a communication signal from the repeater;

(B2) the user terminal transmitting a response signal to the central server in response to the received communication signal;

(B3) calculating, by the central server, the primary position of the user terminal using the response signal;

(B4) correcting the location of the user terminal by using the area information stored in the database by the central server; And

(B5) a method of synchronizing between a mobile terminal and an exhibition device using a motion recognition device, comprising the step of storing the calculated location of the user terminal in the database by the central server.
The method of claim 3, wherein

The primary position calculation,

Method of synchronizing between the mobile terminal and the exhibition device using a motion recognition device, characterized in that the communication area of the repeaters receiving the response signal is calculated to overlap.
The method of claim 4, wherein

Repeaters belonging to each of the repeater groups,

Method of synchronizing between the mobile terminal and the exhibition device using a motion recognition device, characterized in that spaced apart so that the communication area does not overlap each other.
The method according to any one of claims 1 to 5,

The (I) step is

(I1) searching for user terminals located within the sensing distance of the display device from the position information of the user terminals stored in the terminal position table;

(I2) further comprising the step of specifying a user of the user terminal whose sensor change value transmitted in step (F) matches the request motion among the searched user terminals. Synchronization method between mobile terminal and exhibition device.