KR100701772B1 - System and method for recognizing moving of terminal - Google Patents

Abstract

The present invention relates to a system and method for recognizing a motion of a terminal, and more particularly, to a system and a method for recognizing motion information of a terminal by processing reference image information received by a camera included in the terminal. An image recognition pad composed of reference image information which is a basis for detecting motion information of the terminal, a camera unit for receiving reference image information of the image recognition pad, and collection and analysis of respective reference image information received by the camera unit, and the terminal; It characterized in that it comprises a terminal consisting of a motion processing unit for detecting the motion information of the. Therefore, in the end, without additional additional external device, it is possible to enjoy the same effect as inputting information through the external device only by moving the terminal.

Terminal, camera, video recognition

Description

System and Method for Recognizing Motion of Terminal {SYSTEM AND METHOD FOR RECOGNIZING MOVING OF TERMINAL}

1 is a block diagram of a motion recognition system of a terminal according to an embodiment of the present invention.

2 is a block diagram of a motion recognition system of a terminal according to another embodiment of the present invention.

3 is a block diagram of an image recognition pad according to an embodiment of the present invention.

4 is a configuration diagram of an image pattern constituting the image recognition pad.

5 to 7 are state diagrams showing reference image information received by a camera according to movement of a terminal according to an embodiment of the present invention.

8 is a flowchart illustrating a method of recognizing a motion of a terminal according to an embodiment of the present invention.

9 is a flowchart illustrating a motion recognition method of a terminal according to another embodiment of the present invention.

10 is a flowchart illustrating a method of analyzing collected reference image information according to an embodiment of the present invention.

*** Explanation of symbols for the main couple of drawings ***

100: image recognition pad 200: camera unit

300: motion processing unit 350: image information determination unit

400: central processing unit 500: display unit

600: storage unit 630: motion information

660: application information 700: application driver

750: screen information generator 800: transceiver

The present invention relates to a system and method for recognizing a motion of a terminal, and more particularly, to a system and a method for recognizing motion information of a terminal by processing reference image information received by a camera included in the terminal.

Recently, with the continuous development of electronic engineering and communication engineering, the functions of terminals have been gradually diversified. In particular, the mobile terminal has been able to perform functions such as Internet connection, video call and video message transmission as well as general voice call and text message transmission.

Currently, mobile terminals such as cellular phones, PDAs and smart phones have a high processing speed and a central processing unit having a high processing speed to perform the above-described functions, as well as more keypads and buttons. have.

In addition, mobile terminals equipped with cameras for the processing of video calls or moving pictures are also widely used.

 As a method of inputting data using the mobile terminal, a method of inputting letters or numbers using a keypad is generally used. However, the number of buttons that can be provided by the mobile terminal is limited by space and the like. Since the keypad can only input relatively simple information such as letters, numbers, directions, and functions, it is difficult to perform various functions provided by the mobile terminal.

In order to improve this, recently, an external input device having improved performance, such as a touch pad and a joystick, has been bonded to a mobile terminal, thereby allowing users to freely input various external information.

However, such input devices have a problem in that additional external space is required and additional costs are paid.

On the other hand, some mobile terminals have an example in which a touch pad is applied, but the mobile terminal is not activated due to inconvenience of usability.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a motion recognition system and method of a terminal for recognizing motion information of the terminal through reference image information input by a terminal equipped with a camera. In providing.

Another object of the present invention is to provide a motion recognition system and method of a terminal for displaying screen information according to the motion information by controlling screen information on which an application is displayed through motion information of the recognized terminal.

A motion recognition system of a terminal according to the present invention for achieving the above object, the image recognition pad consisting of the reference image information that is the basis of the motion information detection of the terminal and the camera unit for receiving the reference image information of the image recognition pad And a terminal configured to collect and analyze respective reference image information received by the camera unit to detect motion information of the terminal.

In addition, the method for recognizing the motion of the terminal according to the first aspect of the present invention for achieving the above object, A-1) a reference image of the image recognition pad through the camera unit of the terminal Receiving information, A-2) determining whether the received reference image information is reference image information of the image recognition pad, A-3) when the reference image information is reference image information of the image recognition pad, Collecting reference image information that is changed according to the movement of the terminal, A-4) analyzing the collected reference image information, and detecting motion information of the terminal, A-5) to the detected motion information And controlling the screen information to be displayed correspondingly and A-6) displaying the controlled screen information.

In addition, a method of recognizing a motion of a terminal according to a second aspect of the present invention for achieving the above object, in the method for recognizing the motion of the terminal, B-1) at the same time as the start of the VM application of the image recognition pad Receiving reference image information, B-2) collecting reference image information that varies according to the movement of the terminal, B-3) detecting the movement information of the terminal by analyzing the collected reference image information , B-4) controlling the screen information displayed by the VM application through the detected motion information, and B-5) displaying the controlled screen information.

Hereinafter, a system and method for recognizing a motion of a terminal according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments. Like reference numerals designate like elements throughout the drawings.

First, a motion recognition system of a terminal according to an embodiment of the present invention will be described in detail.

1 is a block diagram of a motion recognition system of a terminal according to an embodiment of the present invention, Figure 2 is a block diagram of a motion recognition system of a terminal according to another embodiment of the present invention, Figure 3 is an embodiment of the present invention 4 is a configuration diagram of an image pattern constituting the image recognition pad, and FIGS. 5 to 7 are reference images received by a camera according to a movement of a terminal according to an embodiment of the present invention. State diagram showing information.

As shown in FIG. 1, a motion recognition system of a terminal according to an exemplary embodiment of the present invention includes an image recognition pad 100, a camera unit 200, a motion processing unit 300, a central processing unit 400, and a display unit. 500.

In addition, as shown in FIG. 2, the motion recognition system of the terminal according to another embodiment of the present invention further includes a storage unit 600, an application driver 700, and a transceiver 800.

The image recognition pad is printed with a plurality of image patterns as shown in FIG. 3, and the image pattern is input as reference image information by a camera of the terminal.

On the other hand, the image recognition pad 100 may be composed of a single image pattern, it is preferable that the camera unit 200 is configured in plural in preparation for leaving the image pattern.

As illustrated in FIG. 4, the video pattern includes a specific image and a specific color so as to efficiently detect motion information of the terminal.

For example, an image such as "image pattern a", "image pattern b" and "image pattern c" shown in FIG. 4 is used rather than an image pattern such as a leaf.

In addition, the image recognition pad 100 may be configured as the image recognition pad 100 by inputting an arbitrary image pattern to the camera unit 200 as well as the image pattern.

The camera unit 200 is a means provided in the terminal and receives the reference image information of the image recognition pad 100.

The motion processor 300 further includes a reference image information determiner 350, wherein the reference image information determiner 350 includes the reference image information received from the camera unit 200 as the image recognition pad 100. It is determined whether or not the reference image information received from the.

As a result of determination, when it is determined that the reference image information is the reference image information by the image recognition pad 100, the camera unit 200 is continuously activated so that the reference image of the image recognition pad 100 according to the movement of the terminal. Keep receiving information.

In addition, each reference image information received according to the movement of the terminal is collected and analyzed to detect motion information of the terminal.

If the reference image information determiner 350 determines that the reference image information is not the reference image information by the image recognition pad 100, the camera unit 200 is deactivated to receive the reference image information. Stop it.

The motion information includes movement direction information, movement distance information, rotation information, tilt information, and the like of the terminal, and detects such information through reference image information received by the camera unit 200.

That is, the reference image information collected by the motion processor 300 is as shown in FIGS. 5 to 7.

As shown in FIG. 5, the first reference image information received through the camera unit 200 of the terminal, that is, the reference image information before moving the terminal is equal to "A". The reference image information after moving the terminal is equal to "B".

Accordingly, the motion processor 300 compares the collected two pieces of information and detects information about the direction information and the movement distance of the terminal from left to right.

In addition, as shown in Fig. 6, the reference image information "A" and "C" which is the reference image information after moving the terminal are analyzed and detected to detect the perspective movement direction information and the perspective movement distance information of the terminal. do.

In addition, as shown in FIG. 7, reference image information "A" is compared with "D" which is reference image information after moving the terminal, and information about the tilt direction and the tilt angle information of the terminal is detected. .

For example, each pixel information according to the reference image information is digitized, and information about an accurate movement direction and a movement distance of the terminal is detected according to the change of the numerical value.

In addition, according to the change of the vector value for any point of the two reference image information, information about the movement direction and the movement distance of the terminal is detected.

The central processing unit 400 receives the motion information of the terminal detected by the motion processing unit 300 as described above, and controls the screen information to be displayed.

The screen information to be displayed refers to screen information displayed by driving an application, and in particular, refers to screen information displayed when a virtual machine game (hereinafter, referred to as a “VM game”) is driven.

The storage unit 600 is a means for storing motion information detected by the motion processor 300 or storing application information. The storage unit 600 transmits previously stored motion information to the central processing unit 400, thereby transmitting the motion of the terminal. It is possible to enjoy an effect such that the movement path is the same repeatedly.

The transceiver 800 is a means for transmitting and receiving information with an external server connected through a communication network. In particular, the transceiver 800 may receive the VM game in real time through an Internet connection, and execute the VM game.

In addition, the information received by the transceiver 800 may be stored in the storage 600 and used later.

The application driver 700 is a means for driving an application through application information received from the transceiver 800 or stored in the storage 600, and includes a screen information generator 750.

 The screen information generation unit 750 generates screen information on which an application is displayed according to the motion information under the control of the central processing unit 400.

The display unit 500 displays screen information generated by the control of the central processing unit 400.

Hereinafter, a method for recognizing a motion of a terminal according to an embodiment of the present invention will be described in detail.

8 is a flowchart of a method for recognizing a motion of a terminal according to an embodiment of the present invention, and FIG. 10 is a flowchart of a method of analyzing collected reference image information according to an embodiment of the present invention.

As shown in FIG. 8, first, reference image information of the image recognition pad 100 to be the basis of motion information of the terminal is set.

That is, after receiving the reference image information through the camera unit 200 of the terminal, and stores it, and compares the first reference image information and the stored reference image information to start the movement of the terminal, the camera unit 200 ) To determine whether the image information received from the reference information is the reference image information of the image recognition pad (S110).

After the setting, at the same time pressing the terminal motion recognition start button, the camera unit 200 of the terminal receives the reference image information of the image recognition pad 100 (S120).

In operation S130, it is determined whether the received reference image information is reference image information of the image recognition pad 100.

That is, the received reference image information is compared with the set reference image information, and as a result of the comparison, it is determined whether the two pieces of information match.

If the two pieces of information do not match, the camera 200 is deactivated to stop reception of the respective reference image information which is changed according to the movement of the terminal (S135).

However, if the two pieces of information coincide with each other, the camera unit 200 continuously collects each piece of reference image information that varies according to the movement of the terminal (S140).

The collected reference image information is analyzed (S150), and motion information of the terminal is detected (S160).

That is, as shown in FIG. 10, reference points of first reference image information received before the movement variation of the terminal and second reference image information received after the movement variation of the terminal are set (S310).

In this case, two or more reference points are set, and the reference points are preferably expressed in two dimensions.

The reference point value of the first reference image information is compared with the reference point value of the second reference image information (S320).

As a result of the comparison, the moving direction and the moving distance of the second reference image information are detected (S330), and the motion information of the terminal is detected through the detected information (S340).

For example, as shown in FIG. 5, point values of the first reference image information are (5,5) and (13,5), and point values of the second reference image information are (10,5) and ( 18, 5), it can be seen that the second reference image information has moved to the left by "5" compared with the first reference image information.

In addition, it can be seen that the terminal is moved to the left by a value corresponding to the "5".

Each of the reference image information shown in FIGS. 6 and 7 can also know whether the movement of the terminal is in the perspective or tilt movement, in the same manner as the reference image information shown in FIG. 5.

 On the other hand, the detected motion information can be stored, which is used when it is necessary to repeatedly move the terminal in the same way or when the motion information of the existing terminal is to be applied.

Thereafter, the screen information to be displayed is controlled according to the detected motion information (S170).

The screen information to be displayed refers to screen information on which an application running on a terminal is displayed.

For example, in the case of a flight shooting game driven by a conventional mobile terminal, it refers to screen information on which the game situation is displayed, such as the movement of a plane and a bullet moving according to a command input through the shortcut button or an external device.

In this case, when controlling the display screen information according to the game situation by reflecting the motion information of the terminal, it is possible to move the terminal in the game by moving the terminal up, down, left and right.

That is, after controlling the screen information according to the motion information of the terminal, and displays the controlled screen information (S180).

 9 is a flowchart illustrating a motion recognition method of a terminal according to another embodiment of the present invention. That is, the case in which the movement information of the terminal is reflected in the VM application and executed in the terminal is shown.

As shown in FIG. 9, the VM application stored in the terminal or provided by the external server through the communication network provides real time (S210).

Simultaneously with the start of the VM application, the camera unit 200 of the terminal receives the reference image information of the image recognition pad 100 (S220).

In addition, it is determined whether the received reference image information is reference image information of the preset image recognition pad 100 (S230), and the determination result determines that the reference image information is image information of the image recognition pad 100. If it is, the receiver continuously receives and collects each reference image information which varies according to the movement of the terminal (S240).

If the two pieces of information do not match, the camera unit 200 is deactivated to stop reception of each piece of reference image information that varies according to the movement of the terminal (S245).

The collected reference image information is analyzed (S250) and motion information of the terminal is detected (S260).

Thereafter, after controlling the screen information displayed on the VM application through the detected motion information (S270), the controlled screen information is displayed (S280).

So far, the present invention has been described in detail with reference to preferred embodiments, but the present invention is not limited to the above-described embodiments, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the following claims. Anyone skilled in the art will have the technical idea of the present invention to the extent that various changes or modifications can be made.

As described above, according to the motion recognition system and method of the terminal of the present invention, using the reference image information input through the camera of the terminal to detect the movement information of the terminal, such as the movement direction, distance, rotation and tilt of the terminal This can be done.

In addition, by applying the detected motion information of the terminal to an application such as a VM game, there is an effect that can control the screen information displayed by the application in accordance with the movement of the terminal.

As a result, without additional additional external device, it is possible to enjoy the same effect as inputting information through the external device by simply moving the terminal.

Claims (41)

An image recognition pad including reference image information which is a basis for detecting motion information of a terminal; And A camera unit for receiving reference image information of the image recognition pad, first reference image information received before the movement change of the terminal, and reference points of the second reference image information received after the movement change of the terminal; And a terminal comprising a motion processor to detect motion information of the terminal by comparing the respective reference point values and measuring the moving direction and the moving distance of the second reference image information. delete The method of claim 2, wherein the motion processing unit And at least two reference points each. The method of claim 3, wherein the reference point is Motion recognition system of a terminal, characterized in that expressed in two dimensions. The terminal of claim 2, wherein the terminal A central processor configured to control screen information to be displayed according to the detected motion information; And And a display unit for displaying the controlled screen information. The method of claim 5, wherein the terminal Further comprising a storage for storing the detected motion information, The storage unit transmits previously stored motion information to the central processing unit according to a request of the central processing unit. The method of claim 6, wherein the storage unit Motion recognition system of the terminal, characterized in that further stores the application information of the terminal. 8. The terminal of claim 7, wherein the terminal is Transmitting and receiving unit for transmitting and receiving information with an external server; And And a driver for driving an application of the terminal through the application information received from the transceiver and stored in the storage. The method of claim 8, wherein the application driver And a screen information generator configured to generate screen information on which an application is displayed according to the motion information controlled by the central processor. 10. The method of claim 1, wherein the motion processing unit And a reference image information determination unit determining whether the reference image information received by the camera unit is the reference image information by the image recognition pad. The method of claim 10, When the reference image information is determined by the reference image information determination unit, if the reference image information is the reference image information by the image recognition pad, the motion processor starts analyzing the reference image information. Motion recognition system. The method of claim 11, And as a result of the determination of the reference image information by the reference image information determining unit, when the reference image information is not the reference image information by the image recognition pad, deactivating the camera unit. The method according to any one of claims 1 to 9, The image recognition pad is a movement recognition system of a terminal, characterized in that it comprises a plurality of image patterns. delete The method according to any one of claims 1 to 9, The motion information includes movement direction information and movement distance information of the terminal. The method of claim 15, wherein the motion information is Motion recognition system of the terminal further comprises the rotation information and the tilt information of the terminal. The method according to any one of claims 7 to 9, The application information comprises a game information movement recognition system of the terminal. The method of claim 17, wherein the game information is Virtual machine (VM) motion recognition system of the terminal comprising a game information. In the method for recognizing the movement of the terminal, A-1) receiving reference image information of the image recognition pad through the camera unit of the terminal; A-2) determining whether the received reference image information is reference image information of the image recognition pad; A-3) when the reference image information is the reference image information of the image recognition pad, collecting the reference image information that changes according to the movement of the terminal; A-4) detecting the motion information of the terminal by analyzing the collected reference image information; A-5) controlling the screen information to be displayed in accordance with the detected motion information; And A-6) A method for recognizing a motion of a terminal, comprising displaying the controlled screen information. 20. The method of claim 19, wherein step A-4) A-4-1) setting a reference point of the first reference image information received before the movement change of the terminal and the second reference image information received after the movement change of the terminal; A-4-2) comparing the reference point value of the first reference image information with the reference point value of the second reference image information; A-4-3) measuring the moving direction and the moving distance of the second reference image information as a result of the comparison; And A-4-4) detecting the motion information of the terminal based on the detected information. The method of claim 20, wherein in A-4-1) And at least two reference points are set. The method of claim 21, wherein in A-4-2) The reference point is a motion recognition method of the terminal, characterized in that represented in two dimensions. The method of claim 19, wherein step A-5) And generating screen information on which an application is displayed according to the detected motion information. 21. The method of claim 19 or 20, wherein the application is Motion recognition method of a terminal, characterized in that the application received from an external server through a communication network or the terminal is stored in advance. The method of claim 24, wherein the application is Motion recognition method of the terminal comprising the game information. The method of claim 19 or 20, wherein the step A-1) is performed before And setting reference image information of the image recognition pad. The method of claim 26, wherein step A-2) A-2-1) comparing the received reference image information with the set reference image information; And A-2-2) a result of the comparison, determining whether the two pieces of information coincide. The method of claim 27, wherein after step A-3) And storing the collected reference image information, and detecting the motion information through the stored reference image information. delete The method of claim 19 or 20, wherein the image recognition pad is Motion recognition method of a terminal comprising a plurality of image patterns. 21. The method of claim 19 or 20, wherein the motion information is Movement recognition method of the terminal comprising the movement direction information and the movement distance information. The method of claim 31, wherein the motion information Motion recognition method of the terminal further comprises the rotation information and the tilt information of the terminal. In the method for recognizing the movement of the terminal, B-1) receiving the reference image information of the image recognition pad at the same time as the start of the VM application; B-2) collecting reference image information that changes according to the movement of the terminal; B-3) detecting the motion information of the terminal by analyzing the collected reference image information; B-4) controlling the screen information displayed by the VM application through the detected motion information; And B-5) displaying the controlled screen information. The method of claim 33, wherein the step B-3) B-3-1) setting a reference point of the first reference image information received before the movement change of the terminal and the second reference image information received after the movement change of the terminal; B-3-2) comparing a reference point value of the first reference image information with a reference point value of the second reference image information; B-3-3) detecting a movement direction and a movement distance of the second reference image information as a result of the comparison; And B-3-4) detecting the motion information of the terminal through the detected information. The method of claim 34, wherein in B-3-1) And at least two reference points are set. The method of claim 35, wherein in B-3-2) The reference point is a motion recognition method of the terminal, characterized in that represented in two dimensions. 35. The method of claim 33 or 34, wherein after step B-1), Determining whether the received reference image information is reference image information of the image recognition pad; If it is determined that the reference image information is the reference image information of the image recognition pad, step B-2) is performed. The method of claim 33 or 34, The screen information on which the VM application is displayed is information received in real time from an external server through a communication network. 35. The apparatus of claim 33 or 34, wherein the image recognition pad is Motion recognition method of a terminal comprising a plurality of image patterns. 35. The method of claim 33 or 34, wherein the motion information is And a movement distance information and movement direction information of the terminal. The method of claim 40, wherein the motion information is Motion recognition method of the terminal further comprises the rotation information and the tilt information of the terminal.

Images