WO2015182967A1

WO2015182967A1 - Matching system and matching method

Info

Publication number: WO2015182967A1
Application number: PCT/KR2015/005263
Authority: WO
Inventors: 김석중; 유영준
Original assignee: (주)브이터치
Priority date: 2014-05-24
Filing date: 2015-05-26
Publication date: 2015-12-03
Also published as: KR101611898B1; KR20150135023A

Abstract

Disclosed are a matching system and a matching method for specifying a terminal in which a motion pattern is detected, by comparing: a motion pattern, a location, and a time of a terminal carried by a user's body (mainly hands, fingers, and the like) or the user through image photographing; with a motion pattern, a location, and a time of the terminal identified by a device such as a motion sensor built-into the terminal.

Description

Matching system and matching method

According to the present invention, the movement pattern, position, and time of a terminal identified by a device such as a user's body (mainly a hand, a finger, etc.) or a movement pattern, a position, a time, and a motion sensor built into the terminal through an image recording The present invention relates to a matching system and a matching method for identifying a terminal in which a movement pattern is detected by comparing the two.

Currently, the wireless communication market is actively being activated by the expansion of wireless terminals such as smart phones. Wireless communication terminals are expanding to mobile computing devices such as mobile phones, netbooks, tablet PCs, and e-book terminals, including smartphones. Based on this, new services and application markets are being created and numerous services and applications are provided. .

In addition to the wireless communication of the portable terminal, there is a variety of devices that can be connected by wireless communication due to the explosion of the Internet of Things (IoT) devices. However, in the era of the Internet of Things, there are different types of IoT devices that can be connected to each place, and the types are very diverse.

Therefore, research is being conducted on providing a simple and easy connection between these IoT devices and using these services.

By comparing the motion pattern, position, and time of the terminal identified by the device, such as the motion pattern, position, and time of the user's body (mainly hands, fingers, etc.) or the terminal carried by the user, the image is taken. An object of the present invention is to provide a matching system and a matching method for specifying a terminal from which a movement pattern is detected.

According to an aspect, a matching system includes a matching server and a terminal that can be connected to a matching server through a wireless communication network. The matching server may include an image acquisition unit configured to acquire an image of a user's body or a terminal carried by the user through image capturing; A position detector configured to calculate coordinate data indicating a position of a user's body or a terminal carried by the user by using the image acquired from the image acquirer, and a movement of the user detected based on the coordinate data calculated by the position detector A motion detector for detecting a pattern, a time detector for detecting a time when the motion pattern detected by the motion detector is recognized, a user body received from the position detector, a motion detector, a viewpoint detector, or a movement of a terminal carried by the user Pattern, location, time and Comparing a movement pattern, location, time of the group, and a matching processing for identifying a motion pattern is detected terminal.

At this time, the terminal, the terminal position detection unit for detecting the coordinate data indicating the current position of the terminal based on the GPS information or IPS information or the Wi-Fi network or carrier base station location information, the acceleration sensor, the gyroscope sensor included in the terminal And a terminal motion detector for detecting a user's motion pattern measured through at least one of gravity sensors, a terminal viewpoint detector for detecting a time when the motion pattern of the terminal detected by the terminal motion detector is recognized, and the terminal position. The movement pattern is detected by comparing the movement pattern, position, and time of the terminal received from the detector, the terminal movement detection unit, and the terminal view detection unit with the movement pattern, position, and time of the user's body or the terminal carried by the matching server. Terminal identifying It may include a matching processing unit.

According to another aspect of the present invention, a matching system includes a matching server and a terminal that can be connected to a matching server through a wireless communication network, wherein the terminal indicates coordinates indicating a current position of the terminal based on GPS information or IPS information or Wi-Fi network or carrier base station location information. A terminal position detector for detecting data, a terminal motion detector for detecting a user's movement pattern measured through at least one of an acceleration sensor, a gyroscope sensor, and a gravity sensor included in the terminal, and a terminal detected by the terminal motion detector A terminal viewpoint detection unit for detecting a time when a movement pattern of the mobile terminal is recognized, a movement pattern, a position, a time of the terminal received from the terminal position detection unit, a terminal movement detection unit, and a terminal viewpoint detection unit, and a user body or user received from the matching server Autumn cell And a terminal matching processing unit for identifying a terminal from which a movement pattern is detected by comparing a movement pattern, a position, and a time of the terminal.

At this time, the matching server, the image acquisition unit for acquiring an image of the user's body or the terminal carried by the user through the image, and the terminal carried by the user's body or the user using the image obtained from the image acquisition unit A position detector which calculates coordinate data indicating a position of the user, a motion detector that detects a user's movement pattern detected based on the coordinate data calculated by the position detector, and a motion pattern detected when the motion pattern detected by the motion detector is recognized. Compares the movement pattern, position, and time of the user body received from the position detection unit, the movement detection unit, and the viewpoint detection unit with the time detection unit for detecting time, and the movement pattern, position, and time of the terminal received from the terminal. Matching unit for specifying a terminal from which a movement pattern is detected It can be included.

According to another aspect, a matching method may include: generating, by a matching server, first motion information about at least one object included in a field of view; Receiving, by the matching server, second motion information about the at least one object from terminals included in the field of view; And specifying, by the matching server, an object moved among the at least one object based on the first motion information and the second motion information.

In this case, before generating the first motion information, the matching server may further include calculating respective coordinate data of the at least one object.

The first motion information may include movement pattern information, position information, and moved visual information of each of the at least one object measured by the matching server.

The second motion information may include movement pattern information, position information, and moved visual information of each of at least one object measured by the terminal.

According to another aspect, a matching method may include: generating, by a matching server, first motion information about at least one object included in a field of view; Determining whether the matching server directly specifies a moving object; When the matching server directly specifies a moving object, the second server receives second motion information about the at least one object from terminals included in the field of view, and receives the first motion information and the second motion information. Specifying an object moved among the at least one object based on the movement; And if the matching server does not directly specify the moved object, transmitting the first motion information to the terminals.

The first motion information may include motion pattern information, location information, and motion time information of each of the at least one object measured by the matching server.

The second motion information may include motion pattern information, location information, and motion time information of each of at least one object measured by the terminal.

First, select one of objects of objects, buildings, and shops located in a remote 3D space to obtain corresponding object information with the user's portable terminal or to obtain information of the user's portable terminal in the 3D space. There is an effect that can be transferred to one of the objects of the objects, buildings and shops located.

Second, in an environment where a plurality of portable terminals (smartphones, smart watches, HMD, etc.) exist, only terminals that select objects of objects, buildings, and shops located in a three-dimensional space can be specified to obtain information only from those terminals. Only the information of the terminal can be transmitted to objects of objects, buildings, and stores located in the three-dimensional space.

Third, in providing a service to a terminal from a server, the portable terminal information of the user may be stored in advance, or may be immediately and quickly provided to a portable terminal owned by the user without having to read or photograph an installed tag. .

Fourth, the object information acquisition place can be implemented anywhere, indoors and outdoors, as well as indoors such as museums, exhibition halls, art galleries, as well as amusement parks, zoos, and botanical gardens. There is an effect that can be applied.

1 shows an example of a matching system;

2 is a block diagram showing an example of a matching server and a terminal forming a matching system;

3 is a flowchart illustrating an operation of a matching server according to an example of a matching method;

4 is a flowchart illustrating an operation of a matching server according to another example of a matching method;

5 is a flowchart illustrating an operation of a terminal according to the matching method of FIG. 3;

6 is a flowchart illustrating an operation of a terminal according to another example of a matching method.

Other objects, features and advantages of the present invention will become apparent from the following detailed description of embodiments with reference to the accompanying drawings.

A preferred embodiment of the matching system according to the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, only the embodiments to complete the disclosure of the present invention and complete the scope of the invention to those skilled in the art. It is provided to inform you. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiments of the present invention and do not represent all of the technical idea of the present invention, various equivalents that may be substituted for them at the time of the present application It should be understood that there may be water and variations.

1 is a diagram illustrating an example of a matching system.

As shown in FIG. 1, the matching system includes a matching server 100 and at least one

terminal

200a, 200b, 200c.

The

terminals

200a, 200b, and 200c are connected to the matching server 100 through a communication network. In addition, FIG. 1 illustrates a case in which three

terminals

200a, 200b, and 200c are located in a field of view (FOV) of the image acquisition unit 110 of the matching server 100. However, the number of terminals located in the FOV is not limited to this.

In FIG. 1, when the user who carries the terminal 200b or the terminal 200b (collectively, the term “object” and “user carrying the terminal”) moves, the matching server 100 ) Detects the movement and time of movement of the object within the FOV. Comparing this with the movement and the time of movement of the object detected by the terminal, the moved object 200b can be specified. Therefore, the user can conveniently obtain the information of the object remotely without having to access the object. Alternatively, the user may be provided with object information quickly and easily to a portable terminal owned by the user without a separate procedure for receiving object information.

The matching system illustrated in FIG. 1 may be implemented anywhere in or outside the indoor and outdoor spaces where virtual touch devices can be installed, such as an amusement park, a zoo, a botanical garden, as well as indoors, museums, exhibition halls, and art galleries.

2 is a block diagram illustrating an example of a matching server and a terminal forming a matching system.

As shown in FIG. 2, the matching system includes a matching server 100 and at least one terminal 200. The matching server 100 and the terminal 200 are connected to each other through a communication network.

The matching server 100 further includes an image obtaining unit 110, a position detecting unit 120, a motion detecting unit 130, a viewpoint detecting unit 140, and a matching processing unit 150.

In addition, the terminal 200 further includes a terminal position detector 210, a terminal motion detector 220, a terminal viewpoint detector 230, and a terminal matching processor 240.

First, the matching server 100 will be described in detail.

The image acquisition unit 110 is a kind of camera module, and acquires an image of a user's body or a terminal carried by the user through image capturing. The area photographed by the image acquisition unit will be referred to as FOV. The image acquisition unit 110 may include a camera including an imaging sensor such as a CCD or a CMOS.

The position detector 120 calculates coordinate data indicating the position of the user's body or the terminal carried by the user by using the image acquired from the image acquisition unit 110.

The motion detector 130 detects the detected movement pattern of the user based on the coordinate data calculated by the position detector 120. At this time, the detected movement pattern is a preset pattern and transmits different functions according to the shape of the pattern.

The viewpoint detector 140 determines a time when the movement pattern detected by the movement detector 140 is recognized. This makes it possible to detect a more accurate time by detecting the time when the movement pattern is recognized based on the current time.

The matching processor 150 may include the user's body received from the position detector 120, the motion detector 130, and the viewpoint detector 140, or the movement pattern, position, time of the terminal carried by the user, and the terminal transmitted from the terminal 200. Compares a movement pattern, a position, and a time to specify a terminal from which a movement pattern is detected, or a user body received from the position detector 120, the motion detector 130, and the viewpoint detector 140, or a movement of a terminal carried by the user. The pattern, location, and time are transmitted to the terminal 200.

In this case, the matching processor 150 transfers the movement pattern, the position, and the time of the user body received from the position detector 120, the motion detector 130, and the viewpoint detector 140 to the terminal 200. The transmission is performed when the terminal 200 that identifies the terminal from which the movement pattern is detected is the terminal 200.

If the subject identifying the terminal from which the movement pattern is detected is the matching server 100, the transmission to the terminal 200 is omitted.

Next, the terminal 200 will be described in detail.

The terminal location detection unit 210 detects coordinate data indicating the current location of the terminal based on GPS information, IPS information, or Wi-Fi network or carrier base station location information. Wi-Fi network or carrier base station location information may be detected based on the Wi-Fi network location information I am currently connected to or the carrier base station location information I am currently connected to.

The terminal motion detector 220 detects a user's movement pattern measured through at least one of an acceleration sensor, a gyroscope sensor, and a gravity sensor included in the terminal. At this time, the movement of the input terminal is measured when the user moves in a preset pattern while holding his terminal 200 by hand. In addition, the terminal 200 includes a wearable terminal such as a ring 200b, a watch 200c, glasses, as well as a smart phone 200a. In the case of the wearable terminal, it is possible to prevent the user from discomfort moving while holding the terminal by hand.

The terminal viewpoint detector 230 detects a time when the movement pattern of the terminal detected by the terminal movement detector 220 is recognized. This can detect a more accurate time by detecting a time when the movement pattern is recognized based on the current time.

The terminal matching processor 240 receives the movement pattern, the position, and the time of the terminal 200 received from the terminal position detector 210, the terminal motion detector 220, and the terminal viewpoint detector 230, and received from the matching server 100. By comparing the movement pattern, the position, and the time of the user's body or the terminal carried by the user, the terminal from which the movement pattern is detected is specified, or from the terminal position detection unit 210, the terminal movement detection unit 220, and the terminal viewpoint detection unit 230. The received movement pattern, position, and time of the terminal 200 are transmitted to the matching server 100.

In this case, the terminal matching processor 240 transmits the movement pattern, the position, and the time of the terminal 200 received from the terminal position detector 210, the terminal motion detector 220, and the terminal viewpoint detector 230 to the matching server 100. The transmission is performed when the matching server 100 is a subject specifying the terminal from which the movement pattern is detected.

If the subject specifying the terminal from which the movement pattern is detected is the terminal 200, the transmission to the matching server 100 is omitted.

3 is a flowchart illustrating an operation of a matching server according to an example of a matching method. In the embodiment of Fig. 3, the matching server is a subject that specifies the terminal from which the movement pattern is detected.

In the matching method illustrated in FIG. 3, the matching server captures an image in the FOV (30). As described above, at least one object is included in the FOV, and the matching server calculates coordinate data of each object based on the captured image (31).

Next, the matching server generates first motion information when movement occurs in the image in the FOV (32). The first motion information includes motion pattern information, position information, and moved visual information of each object determined based on the coordinate data of each object.

In addition, the matching server receives the second motion information from each terminal (33). The second motion information includes movement pattern information, position information, and moved visual information of the corresponding terminal detected by each terminal.

At this time, the order of

steps

32 and 33 may be reversed, and may be performed at the same time.

Next, the matching server specifies the moved object based on the first motion information and the second motion information (34). That is, the matching server moves the movement pattern information, the position information, and the movement time information of each object in the FOV included in the first motion information, and the movement pattern information, the position information, and the movement time of each object included in the second motion information. By comparing with the information, it is possible to determine which object actually moved.

4 is a flowchart illustrating an operation of a matching server according to another example of a matching method. In the embodiment of FIG. 4, the matching server may be a subject that specifies the terminal from which the movement pattern is detected, or instead, may cause the terminal to detect the movement pattern.

In the matching method illustrated in FIG. 4, the matching server captures an image in the FOV (40). The matching server calculates coordinate data of each object based on the captured image (41).

Next, the matching server generates first motion information when motion occurs in the image in the FOV (42). The first motion information includes motion pattern information, position information, and moved visual information of each object determined based on the coordinate data of each object.

The matching server determines 43 whether to specify the object directly.

If the direct matching server specifies the object, the matching server receives second motion information from each terminal (43). The second motion information includes movement pattern information, position information, and moved visual information of the corresponding terminal detected by each terminal.

Next, the matching server specifies the moved object based on the first motion information and the second motion information (45). That is, the matching server moves the movement pattern information, the position information, and the movement time information of each object in the FOV included in the first motion information, and the movement pattern information, the position information, and the movement time of each object included in the second motion information. By comparing with the information, it is possible to determine which object actually moved.

If the matching server causes the terminal to specify the object instead of specifying the object, the matching server transmits first motion information to the respective terminals (46). The transmission method may be a method of transmitting to each terminal, a method of broadcasting to all terminals in the FOV, or any other applicable method.

5 is a flowchart illustrating an operation of a terminal according to the matching method of FIG. 3.

In the matching method illustrated in FIG. 3, the matching server directly specifies an object. In this case, the terminal generates second motion information (50), and transmits the generated second motion information to the matching server (51). As mentioned above, the second motion information includes motion pattern information, position information, and moved visual information of the corresponding terminal.

6 is a flowchart illustrating an operation of a terminal according to another example of a matching method. In the embodiment of FIG. 6, the terminal may be a subject specifying the terminal from which the movement pattern is detected, or instead, the terminal may cause the server to detect the movement pattern.

In the matching method illustrated in FIG. 6, the terminal first generates second motion information about the corresponding terminal (60).

Next, a determination is made as to whether or not to directly specify an object (61).

If the object is to be specified directly, the matching server receives first motion information generated by the matching server (62).

The terminal identifies the object as a moving object based on the first motion information received from the matching server and the second motion information generated by itself (63). Alternatively, if there is another terminal moved, the moved terminal may be specified as the moved object.

If the matching server decides to specify the object instead of specifying the object directly, the second motion information is transmitted to the matching server (64).

In this case, the object moved by the matching server is specified (65).

On the other hand, when the moving object is specified, the matching server may provide information on the specified object to at least one terminal.

Although the technical spirit of the present invention described above has been described in detail in a preferred embodiment, it should be noted that the above-described embodiment is for the purpose of description and not of limitation. In addition, those skilled in the art will understand that various embodiments are possible within the scope of the technical idea of the present invention. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims

In a matching system consisting of a matching server and a terminal connectable with a matching server and a wireless communication network,

The matching server,

An image acquisition unit for acquiring an image of a user's body or a terminal carried by the user through image capturing;

A position detector for calculating coordinate data indicating a position of a user's body or a terminal carried by the user by using the image acquired from the image acquisition unit;

A motion detector configured to detect a movement pattern of the user detected based on the coordinate data calculated by the position detector;

A time point detector for detecting a time when the motion pattern detected by the motion detector is recognized;

When the motion pattern of the user body received from the position detector, the motion detector, the viewpoint detector, or the terminal carried by the user is compared with the motion pattern, the position, and the time of the terminal received from the terminal, the terminal is detected. Matching system including a matching processing unit for specifying.
The method of claim 1,

The terminal,

A terminal location detector for detecting coordinate data indicating a current location of the terminal based on GPS information, IPS information, or Wi-Fi network or carrier base station location information;

A terminal motion detector configured to detect a movement pattern of a user measured through at least one of an acceleration sensor, a gyroscope sensor, and a gravity sensor included in the terminal;

A terminal viewpoint detector for detecting a time when the movement pattern of the terminal detected by the terminal movement detector is recognized;

The movement pattern, position, and time of the terminal received from the terminal position detector, the terminal motion detector, and the terminal viewpoint detector are compared with the movement pattern, position, and time of the user's body or the terminal carried by the matching server. And a matching terminal for specifying the detected terminal.
In a matching system consisting of a matching server and a terminal connectable with a matching server and a wireless communication network,

The terminal is

A terminal location detector for detecting coordinate data indicating a current location of the terminal based on GPS information, IPS information, or Wi-Fi network or carrier base station location information;

A terminal motion detector configured to detect a movement pattern of a user measured through at least one of an acceleration sensor, a gyroscope sensor, and a gravity sensor included in the terminal;

A terminal viewpoint detector for detecting a time when the movement pattern of the terminal detected by the terminal movement detector is recognized;

The movement pattern, position, and time of the terminal received from the terminal position detector, the terminal motion detector, and the terminal viewpoint detector are compared with the movement pattern, position, and time of the user's body or the terminal carried by the matching server. And a terminal matching processing unit for specifying the detected terminal.
The method of claim 3,

The matching server,

An image acquisition unit for acquiring an image of a user's body or a terminal carried by the user through image capturing;

A position detector for calculating coordinate data indicating a position of a user's body or a terminal carried by the user by using the image acquired from the image acquisition unit;

A motion detector configured to detect a movement pattern of the user detected based on the coordinate data calculated by the position detector;

A time point detector for detecting a time when the motion pattern detected by the motion detector is recognized;

When the motion pattern of the user body received from the position detector, the motion detector, the viewpoint detector, or the terminal carried by the user is compared with the motion pattern, the position, and the time of the terminal received from the terminal, the terminal is detected. A matching system comprising a matching processing unit for specifying.
Generating, by the matching server, first motion information for at least one object included in the field of view;

Receiving, by the matching server, second motion information about the at least one object from terminals included in the field of view; And

And matching, by the matching server, an object moved among the at least one object based on the first motion information and the second motion information.
The method of claim 5,

Before generating the first motion information,

And calculating, by the matching server, coordinate data of each of the at least one object.
The method of claim 5,

And the first motion information includes movement pattern information, position information, and moved visual information for each of the at least one object measured by the matching server.
The method of claim 5,

And the second motion information includes movement pattern information, position information, and moved visual information for each of at least one object measured by the terminal.
Generating, by the matching server, first motion information for at least one object included in the field of view;

Determining whether the matching server directly specifies a moving object;

When the matching server directly specifies a moving object, the second server receives second motion information about the at least one object from terminals included in the field of view, and receives the first motion information and the second motion information. Specifying an object moved among the at least one object based on the movement; And

And transmitting the first motion information to the terminals when the matching server does not directly specify a moving object.
The method of claim 9,

Before generating the first motion information,

And calculating, by the matching server, coordinate data of each of the at least one object.
The method of claim 9,

And the first motion information includes movement pattern information, position information, and moved visual information for each of the at least one object measured by the matching server.
The method of claim 9,

And the second motion information includes movement pattern information, position information, and moved visual information for each of at least one object measured by the terminal.