KR101621171B1 - Apparatus for motion-tracked speed dialing of mobile communication terminal and method thereof - Google Patents

Abstract

The present invention relates to a motion recognition dialing device of a mobile communication terminal and a method thereof. The device comprises: a key input unit with a start button and an end button; a display unit configured to display a motion shape per a number by a diagram; an acceleration server configured to generate acceleration data of each axis of a mobile communication terminal; a memory buffer configured to temporarily store the acceleration data; a control unit configured to determine a corresponding number through a pattern matching process; and a communication unit configured to perform call connection. Therefore, the device recognizes a motion by one hand to conveniently and accurately input a phone number.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a motion recognition dialing apparatus for a mobile communication terminal,

The present invention relates to a motion recognition dialing apparatus and method for a mobile communication terminal, and more particularly, to a motion recognition dialing apparatus and method for a mobile communication terminal that recognize a motion operated by a single hand and input a phone number conveniently and accurately, The present invention relates to a recognition dialing apparatus and a method thereof.

BACKGROUND ART [0002] In recent mobile communication terminals, the size of a display device is becoming increasingly larger, so that it becomes more difficult to use a smartphone with one hand than ever before.

In a previous study on digit recognition using a smartphone accelerometer in general, we used the accelerometer values of each motion directly to match the model pattern.

Motion tracking using accelerometers in smartphones has also been analyzed in recent research, mainly for large-scale applications such as urban street behavior, motion pattern recognition, or map tracking. It is also analyzed that the sensor platform recognizes the driving method by using the smartphone. In addition, the use of smartphones as 3D input devices has been proposed and the concept of 3D navigation has been investigated. However, it has been difficult to find an application that recognizes these behaviors as a basic feature, apart from dialing the destination's abbreviated number. From the point of view of number recognition, much research has been carried out on recognizing the numbers entered by pen or typewriter. Techniques such as fuzzy logic or neural networks have been applied to recognize pen or typed input numbers. These studies have assumed that they will be used primarily for specific purposes, such as vehicle identification. Although these studies have shown good results in recognition rates, there has been little research on numerical recognition resulting from user behavior. The authors have already analyzed the possibility of using accelerometers for motion tracking in smartphone games.

As a related patent, Korean Patent Registration No. 10-1108771 discloses a mobile communication terminal for transmitting a DTMF signal through motion recognition and a control method thereof. A method of controlling a mobile communication terminal for transmitting a DTMF signal through motion recognition includes the steps of: (a) determining whether a command to switch to a motion recognition mode is input; (b) switching the mobile communication terminal to a motion recognition mode in which the mobile communication terminal recognizes motion of the mobile communication terminal, when a command to switch to the motion recognition mode is input; (c) when the motion recognition mode is switched to, the motion recognition sensor recognizes a pattern of motion of the mobile communication terminal, recognizes a number corresponding to the pattern of the motion, and outputs a DTMF (Dual Tone Multi Frequency) Generating a signal; And (d) transmitting the DTMF signal through a mobile communication network.

However, such a conventional art discloses only a comprehensive description of generating a DTMF signal by recognizing motion, and there is a problem in that it does not provide a concrete method for accurate motion recognition and a solution for motion recognition error.

In addition, due to the growing size of display devices, the use of smartphones with one hand is becoming more difficult than ever, and people are more likely to use a smartphone to talk to a smartphone when they have a handicap or other object It is difficult to input the telephone number more accurately.

Korean Registered Patent No. 10-1108771 (Jan. 16, 2012)

Disclosure of Invention Technical Problem [8] The present invention has been made to overcome the above-described problems of the related art, and it is an object of the present invention to provide a mobile terminal capable of recognizing a motion that operates with one hand, And an object of the present invention is to provide an apparatus and method for motion recognition of a mobile communication terminal.

According to an aspect of the present invention, there is provided a motion recognition apparatus comprising: a key input unit for inputting a motion recognition start command and having a start button and an end button; A display unit for displaying each of the numbered motion shapes pre-stored in the memory on a screen in a graphic form; An acceleration sensor for sensing the acceleration of each axis of the mobile communication terminal according to a motion operated by a user between the start button and the end button, and generating acceleration data of each axis; A memory buffer for temporarily storing acceleration data of each axis generated by the acceleration sensor; Only the acceleration data of the two axes excluding one of the three axes out of the acceleration data of each axis stored in the memory buffer is used in order to process in real time by minimizing the processing load such as pre-processing calculation, A movement trajectory on the two-dimensional plane is traced by tracing a movement pattern between the immediately preceding position and the current position using the acceleration data of the two axes so that the position and the movement direction of each coordinate are determined, A pattern matching process for comparing the model number with a model pattern of motion stored in the memory; And a communication unit for recognizing and combining the numbers determined by the control unit and performing a telephone connection. The current location of the mobile communication terminal is represented by x, y, z values in a three-dimensional space, The position is fixed to the starting point of the x, y, z coordinates, and the control unit performs the pattern matching process according to the basic pattern consisting of the fixed starting point and only the moving direction such as left, right, Dialing device.

The memory may pre-store a specific number and a motion corresponding to each number through input of a user.

The acceleration sensor senses the acceleration of each axis of the mobile communication terminal according to the motion of the user between the input of the start button and the end button, Wherein the controller temporarily stores acceleration data of each axis generated by the acceleration sensor in the memory buffer and stores only acceleration data of two axes excluding one axis among three acceleration data stored in the memory buffer A moving trajectory on a two-dimensional plane is traced by tracing a movement pattern between a previous position and a current position using acceleration data of two axes so that the position and the moving direction of each coordinate are determined, And a pattern matching procedure for comparing the motion pattern with the model pattern of the motion stored in the memory It is possible to determine the corresponding number by detecting the movement trajectory of the determined motions and determining whether or not the motion trajectory is within the error range.

delete

According to another aspect of the present invention, there is provided a motion recognition method including: a motion recognition start step of inputting a motion recognition start command to a key input unit; A motion guidance screen display step of displaying, on a screen of a display unit, a motion shape for each number stored in advance in a memory; A data generation step of sensing acceleration of each axis of the mobile communication terminal through an acceleration sensor and generating acceleration data of each axis between a start button and an end button input; A data storage step of temporarily storing acceleration data of each axis generated by the acceleration sensor; The control unit may use the acceleration data of two axes excluding one axis of three axes stored in the data storing step to process the same in real time by minimizing a processing load such as a preprocessing calculation, A trajectory detection step of tracking a movement pattern between a previous position and a current position using acceleration data of two axes so as to determine a position and a moving direction of each coordinate to detect a moving trajectory on the two-dimensional plane; A motion determination step of determining a corresponding number through a pattern matching procedure for comparing the movement trajectory detected in the trajectory detection step with a model pattern of a stored motion; And a telephone connection step of allowing the communication unit to recognize and combine the numbers determined in the motion determination step and to perform a telephone connection, wherein the current position of the mobile communication terminal is represented by x, y, z values in a three- The first position of the mobile communication terminal is fixed to the starting point of the x, y, z coordinates, and the controller performs a pattern matching procedure according to the basic pattern consisting of the fixed starting point and the moving directions such as left, right, A motion recognition dialing method of a mobile communication terminal is provided.

The method may further include a motion registration step of inputting a motion corresponding to a specific number and each number through a user input and storing the motion in advance in the memory.

A motion training start step of inputting a motion training start command to the key input unit; A training data generation step of generating acceleration data of each axis by sensing acceleration of each axis of the mobile communication terminal through an acceleration sensor while displaying a motion guidance screen and inputting a start button and an ending button; A training data storage step of temporarily storing acceleration data of each axis generated in the training data generation step; The control unit is operable in a situation in which the Internet is not connected and processing processing such as preprocessing calculation is minimized so that the acceleration data of each axis stored in the training data storage step, Using only the data, tracking the movement pattern between the previous position and the current position by using the acceleration data of the two axes so as to determine the position and the movement direction of each coordinate, detects the movement locus on the two- A training motion determination step of determining a corresponding number through a pattern matching procedure for comparing a trajectory with a model pattern of a previously stored motion; And determining whether or not the trajectory of the training motions determined in the training motion determination step is within an error range.

delete

According to the motion recognition dialing apparatus and method of the mobile communication terminal according to the present invention configured as described above, when the mobile communication terminal is used, it is difficult to accurately press a telephone number to make a call when there is a handicap or another hand holding another hand The present invention is advantageous in that it can conveniently and accurately input telephone numbers and perform telephone connection by recognizing a motion operated by one hand.

Also, it is possible to input a telephone number more conveniently and accurately through a user registration, a training menu, and perform a telephone connection, and the voice recognition feature can also be applied to speed dialing. In addition, It is possible to provide customized services for people with disabilities.

1 is a block diagram illustrating a motion recognition dialing device of a mobile communication terminal according to a preferred embodiment of the present invention.
FIG. 2 is a flowchart illustrating a motion recognition dialing method of a mobile communication terminal according to an exemplary embodiment of the present invention.
4 is a diagram illustrating possible directions of operation of a smartphone device in a three-dimensional space of the present invention.
5 is a diagram showing a result of operation tracking by applying the number 2 of the present invention;
Figure 6 shows number model matching motion of the present invention.
7 to 10 are views for explaining a more preferred embodiment of the present invention for each terminal screen display.

The present invention may have various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an apparatus for motion recognition dialing of a mobile communication terminal according to a preferred embodiment of the present invention.

1, the motion recognition dialing device of the mobile communication terminal according to the present invention includes a motion sensor 10, a key input unit 20, a control unit 30, a memory 40, a display unit 50, 60).

The mobile communication terminal of the present invention may be a smart phone capable of performing normal voice communication and data communication. The control unit 30 may be a conventional microprocessor, a central processing unit (CPU), or the like having functions such as operation, determination, and control.

The key input unit 20 inputs a motion recognition start command, and has separate start and end buttons not shown.

The display unit 50 displays a motion shape for each number stored in advance in the memory 40 on a screen.

The motion sensor 10 inputs motion to be operated by the user between the start button and the end button.

The control unit 30 compares the motion input from the motion sensor 10 with the motion stored in the memory 40 to determine the corresponding number.

The communication unit 60 recognizes the numbers determined by the controller 30 and combines them to perform a telephone connection.

The memory 40 inputs a specific number and a motion corresponding to each number through a user's input and stores it in advance.

The motion sensor 10 inputs a motion to be started by the user between the start button and the end button, and the control unit 30 controls the key input unit 20 A motion number input from the motion sensor 10 is compared with the motion stored in the memory 40 to determine a corresponding number, and a movement trajectory of the determined motions is detected to determine whether or not the motion is within an error range.

delete

2 is a flowchart illustrating a motion recognition dialing method of a mobile communication terminal according to a preferred embodiment of the present invention.

As shown in the figure, the motion recognition dialing method of the mobile communication terminal according to the present invention includes a motion recognition start step (S111) of inputting a motion recognition start command to the key input unit 20; A motion guidance screen display step (S112) of displaying, on a screen of the display unit (50), a motion shape for each number stored in advance in the memory (40); A motion input step (S113 to S115) for inputting a motion, which is operated by the user, between the start button and the end button through the motion sensor; A motion judgment step (S116) of comparing the motion inputted in the motion input step (S113 to S115) with the motion stored in the memory (40) and judging the corresponding number by the control part (30); And a telephone connection step (S117 to S119) in which the communication unit (60) recognizes and combines the numbers determined in the motion determination step (S116) to perform telephone connection.

In addition, the method further includes a motion registration step (S101 to S105) of inputting a motion corresponding to a specific number and each number through a user input and storing the motion in the memory 40 in advance.

A motion training start step (S121) of inputting a motion training start command to the key input unit 20; A motion input step (S122 to S125) for displaying a motion guidance screen and inputting a motion, which is operated by a user, between the start button and the end button through the motion sensor; A motion determination step (S126) of comparing the motion input in the motion input step (S122 to S125) with the motion stored in the memory (40) to determine a corresponding number; (S127) for detecting a movement trajectory of the motions determined in the motion determination step (S126) and determining coincidence within an error range (S127).

delete

4 to 10 are diagrams for explaining a more preferred embodiment of the present invention in a process. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to FIGS. 4 to 10. FIG.

In a previous study on digit recognition using a smartphone accelerometer in general, we used the accelerometer values of each motion directly to match the model pattern. In the present invention, a preprocessing technique has been proposed in order to reduce errors in matching, which requires difficult calculations.

For the successful implementation of the technique intended in the present invention, the basic principle must first be clarified. The present invention mainly deals with three parts of the proposed plan for the purpose: motion tracking of sensor values, prior to motion tracking, and decision making.

First, it is required to track the operation of the smartphone device in real time. The current location coordinates of the smartphone device may be referred to for motion tracking. The current position of the device can be represented by the values of x, y, z in three-dimensional space. For reference, the first position needs to be fixed at the starting point of the x, y, z coordinates.

Second, the load on the location tracking process must be reduced to avoid Internet communication with the server, which is especially required in future network environments without IP connectivity. Much of the processing load is spent on preprocessing to match the model pattern of previous studies, which leads to the use of Internet communication with the server to assist with smartphone dialing, which is particularly useful in Internet- Ultimately, they make limits. Therefore, the present invention needs to reduce this load in order to include all the functions required for application as a future network application for a smart phone in a smart phone.

The smartphone according to the present invention includes various functions such as a communication with a sensor. In this paper, we propose an acceleration sensor for motion tracking and communication to establish a connection with a user through a smartphone.

Considering the possible directions of operation of FIG. 4, one of the three axes must be excluded in order to track the operation of the device, since only two axes are required to clarify one of the numbers for dialing. For ease of execution, we select the values of the x and z axes and exclude the y axis values to specify the dial number.

The operation tracking result after applying the number " 2 " in the present invention is shown in Fig. According to the results, the number "2" is difficult to determine the diversity is shown. This leads to difficulties in trying pattern matching methods that are widely used in general number or character recognition systems. Therefore, a different approach is needed for the purposes of the present invention.

The present invention provides a more detailed approach for number recognition for dialing motion tracked numbers.

Acceleration sensors of smartphone devices should be considered for practical implementation. The acceleration sensor derives the sensed value of each axis. The position and velocity of the device are then calculated from the acceleration data as described above. A number model matching motion for matching is proposed for simple and more efficient execution as shown in FIG. 6 to reduce the preprocessing load leading to the use of Internet communication with the server.

 It is generally inappropriate to use Java as a programming language for developing applications on Android smartphones for real-time processing. Therefore, more careful attention is required in reading the sensor data and tracking the operation of the smartphone device in real time. The prior art utilizes a server connected to a smartphone call over an Internet connection to avoid real-time calculations in devices that ultimately limit free usage when the internet connection is not available. On the other hand, since the thin line data is temporarily stored in the memory buffer in order to avoid processing such as computation which makes real-time processing difficult while touching or temporarily fixing the screen, the technique proposed in the present invention is limited in use none. After the screen is not touched, the stored data is calculated and processed to determine the position and orientation of each coordinate.

The present invention operates on the assumption of several events, including motion registration, motion recognition, and training, as shown in FIG. You can also add help menus. If one of these events occurs after the first screen, it is first categorized into one of three: the motion registration menu, the motion recognition menu, and the training menu. In the case of help menu, it can be used for users who are using this application for the first time. When the registration menu is executed, a screen showing the registration number is displayed and the telephone number entered by the user is registered as one of the shortcut numbers. The registering operation causes all the data of the acceleration sensor to be sequentially stored in the memory buffer. The motion recognition operation activates the main characteristics of the proposed technique: motion detection, pattern generation / matching, and call.

After the motion detection and the pattern generation, the occurrence pattern is matched with the model pattern shown in Fig. To perform the matching procedure, the basic pattern may be in the left, right, top, and bottom directions. Deviation patterns that are caused by unintentional habits that result in small vibrations or misperceptions of the hands to experiment with running software have been found and therefore, after several attempts more patterns can be empirically added to reduce false recognition rates .

When a match between the output pattern stored in the memory of the present invention and the matching pattern is found, the call to the registration number is started. If not found, a "Failed" message appears.

In one embodiment, after the application is installed and executed, a screen is displayed as shown in FIG. 7 on the first screen.

For the user who wants to know how to use the application, the usage selection button on the left side displays the help menu screen as shown in Fig.

The registration selection button on the right side performs menu screen registration as shown in Fig.

The operation menu on the upper left of either the screen of Fig. 8 or Fig. 9 calls up the start screen of Fig.

The user can then continue to touch and keep the screen until the derivation is complete, except that the selection menu draws the intended number to the action. When the registration number of the detected abbreviated number is 000-0000-0000, it shows a call connection screen of the image as shown in Fig.

In order to confirm the instability of the present invention, it is required to check the ratio of accurate dialing to check its usefulness. First, the test is run only after the help screen is displayed to the user, and the test is executed after repeating the operation of each character for training. Numbers of simple or unusual patterns showed better results, while similar patterns showed lower recognition rates. This indicates that for numbers with low recognition rates, more delicate selection rules are needed to get better results. In the case of trained users, the average of the results is 87%, indicating that the proposed technique can be applied to general use in everyday Internet connections.

In the present invention, a new technique for motion-tracked speed dialing for smartphones has been proposed and an implementation method including algorithms and considerations for practical applications has been studied. In contrast to the prior art, since the sensor data is temporarily stored in the memory buffer to avoid processing loads such as preprocessing calculations that make real-time processing difficult while touching or pinning the screen, the present invention can be used even when no internet connection is available no limits. In addition, the present invention minimizes processing load by simplifying motion recognition mechanism by only orientation determination and model matching. Experiments of both general users and trained users have proven the utility of the present invention. There appears to be a trade-off between recognition rate and processing load, but a more sophisticated mechanism for numerical determination can provide more successful and accurate dialing to overcome this trade-off.

The embodiments of the present invention described in the present specification and the configurations shown in the drawings relate to the most preferred embodiments of the present invention and are not intended to encompass all of the technical ideas of the present invention so that various equivalents It should be understood that water and variations may be present. Therefore, it is to be understood that the present invention is not limited to the above-described embodiments, and that various modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims. , Such changes shall be within the scope of the claims set forth in the claims.

10: motion sensor 20: key input unit
30: control unit 40: memory
50: display section 60:

Claims (8)

A key input unit for inputting a motion recognition start command and having a separate start button and end button;
A display unit for displaying each of the numbered motion shapes pre-stored in the memory on a screen in a graphic form;
An acceleration sensor for sensing the acceleration of each axis of the mobile communication terminal according to a motion operated by a user between the start button and the end button, and generating acceleration data of each axis;
A memory buffer for temporarily storing acceleration data of each axis generated by the acceleration sensor;
Only the acceleration data of the two axes excluding one of the three axes out of the acceleration data of each axis stored in the memory buffer is used in order to process in real time by minimizing the processing load such as pre-processing calculation, A movement trajectory on the two-dimensional plane is traced by tracing a movement pattern between the immediately preceding position and the current position using the acceleration data of the two axes so that the position and the movement direction of each coordinate are determined, A pattern matching process for comparing the model number with a model pattern of motion stored in the memory; And
And a communication unit for recognizing and combining the numbers determined by the control unit to perform telephone connection,
Wherein the current position of the mobile communication terminal is represented by x, y, and z in a three-dimensional space, the first position of the mobile communication terminal is fixed to a start point of x, y, and z coordinates, And performs a pattern matching procedure according to a basic pattern consisting of only moving directions such as left, right, up, and down. The method according to claim 1,
Wherein the memory stores a predetermined number and a motion corresponding to each number through a user input, and stores the motion in advance. The method according to claim 1,
Inputting a motion training start command to the key input unit,
The acceleration sensor generates acceleration data of each axis by sensing the acceleration of each axis of the mobile communication terminal according to the motion operated by the user between the start button and the end button,
Wherein the controller temporarily stores acceleration data of each axis generated by the acceleration sensor in the memory buffer and uses only acceleration data of two axes excluding one axis among three acceleration data stored in the memory buffer, A movement trajectory on a two-dimensional plane is traced by tracing a movement pattern between a previous position and a current position using acceleration data of two axes so that the position of the coordinate and the movement direction are determined, and the detected trajectory is stored in the memory Wherein the mobile communication terminal determines a corresponding number through a pattern matching procedure comparing with a model pattern of the motion, and detects a movement trajectory of the determined motions to determine whether the number matches within an error range. delete A motion recognition start step of inputting a motion recognition start command to the key input unit;
A motion guidance screen display step of displaying, on a screen of a display unit, a motion shape for each number stored in advance in a memory;
A data generation step of sensing acceleration of each axis of the mobile communication terminal through an acceleration sensor and generating acceleration data of each axis between a start button and an end button input;
A data storage step of temporarily storing acceleration data of each axis generated by the acceleration sensor;
The control unit may use the acceleration data of two axes excluding one axis of three axes stored in the data storing step to process the same in real time by minimizing a processing load such as a preprocessing calculation, A trajectory detection step of tracking a movement pattern between a previous position and a current position using acceleration data of two axes so as to determine a position and a moving direction of each coordinate to detect a moving trajectory on the two-dimensional plane;
A motion determination step of determining a corresponding number through a pattern matching procedure for comparing the movement trajectory detected in the trajectory detection step with a model pattern of a stored motion;
And a telephone connection step of allowing the communication unit to recognize and combine the numbers determined in the motion determination step to perform telephone connection,
Wherein the current position of the mobile communication terminal is represented by x, y, and z in a three-dimensional space, the first position of the mobile communication terminal is fixed to a start point of x, y, and z coordinates, And performing a pattern matching procedure according to a basic pattern consisting of only moving directions such as left, right, up, and down. 6. The method of claim 5,
And a motion registration step of inputting a motion corresponding to a specific number and each number through a user's input and storing the motion in advance in the memory. 6. The method of claim 5,
A motion training start step of inputting a motion training start command to a key input unit;
A training data generation step of generating acceleration data of each axis by sensing acceleration of each axis of the mobile communication terminal through an acceleration sensor while displaying a motion guidance screen and inputting a start button and an ending button;
A training data storage step of temporarily storing acceleration data of each axis generated in the training data generation step;
The control unit is operable in a situation in which the Internet is not connected and processing processing such as preprocessing calculation is minimized so that the acceleration data of each axis stored in the training data storage step, Using only the data, tracking the movement pattern between the previous position and the current position by using the acceleration data of the two axes so as to determine the position and the movement direction of each coordinate, detects the movement locus on the two- A training motion determination step of determining a corresponding number through a pattern matching procedure for comparing a trajectory with a model pattern of a previously stored motion;
The method of claim 1, further comprising the step of determining whether or not the trajectory of the training motions determined in the training motion determination step is within an error range. delete

Images