KR20040104011A - Multi mode data input device and method thereof - Google Patents

Abstract

PURPOSE: A portable multimode input device and a method thereof are provided to complexly process various modes such as text, pointing, and gestures for inputting user's intention with use convenience not restricting portability and user's activity by making a sensing part held in the hand recognize the user's intention and enabling one tool to process various modes. CONSTITUTION: An input part(100) generates a key input signal inputted from the user by equipping with the first input group formed with external input keys, the second input group formed with a rotating lever key, and the third input group sensing a rotation motion of the wrist. The sensing part(104) recognizes the key input signal of each group. A state transition analyzer(200) judges a multimode input mode by analyzing an input signal combination and an input order pattern of each group, and generates corresponding multimode key data by analyzing the input signal combination of other group for each input mode. An input signal transmitter(300) generates key input of corresponding mode by transmitting the corresponding key data of each multimode input mode to a host(500).

Description

MULTI MODE DATA INPUT DEVICE AND METHOD THEREOF

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data input device, and in particular, is applied to various application devices such as a computer, a PDA, a mobile phone, a tablet PC, a wearable computer, etc. The present invention relates to a portable multi-format input device and a method implemented to handle various modes such as pointing and gesture input.

Living in the flood of amazing information devices called the information age, countless information devices in the home or office require input of various information. Therefore, the important issue is how efficiently or intelligently people can input specific data that they want to input. Therefore, HCI or wearable computing consider this an important issue. There are already a lot of input devices, and a lot of input devices such as keyboards, mice, scanners, microphones, cameras, etc. are used as a means for storing and inputting information. It can be defined as sensing through any physical characteristic such as motion, sound, image, etc., and recognizing it as a command or data signal of a machine.

When looking at the data entry needs of computers and other information devices, several types can be categorized. First of all, there is a text input mode for inputting characters in charge of a keyboard, a graphic user interface using a mouse, a digitizer, a pointing input mode, and a gesture mode such as a joystick used in a game or remote control. That's it.

Meanwhile, despite the presence of various input devices with various shapes and concepts, the importance of the user-machine interface is increasing. As a result, many people are working on creating a new, appropriate concept of input devices, and there are several trends.

For example, there is an alternative keyboard to study how to make a text input device keyboard new. Augmented Reality Keyboard is also a research direction focused on replacing text input currently used.

Second, the trend of developing an input device for the purpose of the system. Wearable computing is trying to improve the mobility of the input device and develop it into a form that can be operated with one hand. Half Keyboard, Sequential Multi Button Type Input Device, etc.

Thirdly, it is a tendency that is mainly shown in Human Computer Interaction (HCI), and it is a tendency to implement intelligent input that interacts with input of still image or video itself by using voice and motion itself. This tendency is developing toward inputting what we want to input in the state of not contacting human beings as input devices.

However, these approaches are still separate for each mode, such as text and pointing gestures. Increasingly portable devices such as mobile phones, PDAs, tablet PCs, wearable computers, etc., and in all applications, there is a need to simultaneously digest multiple modes of input through a single input device in the context of using a GUI interface with basic text input. In other words, it is necessary to recognize the pointing input and the text input function together in one input device, and sometimes the gesture.

Accordingly, a compromise method such as pointing a keyboard on the screen using a mouse or a digitizer, which is an existing graphic input device, has been attempted, but this is inefficient due to inconvenience of use and excessive operation time.

In addition, the keyboard and mouse are designed to be integrated, but the keyboard typed from the typewriter is the most common text-based input device, but due to the structure of using a large number of switch buttons corresponding to many individual symbols, The user's posture, such as the need to memorize or find a location, and use a fixed device such as a desk, can cause physical injuries such as VDT syndrome. There were many structural problems in the environment.

Accordingly, an object of the present invention is to recognize the user's intention through the sensing unit which can be held in the hand in the input device of various application devices such as a computer, PDA, mobile phone, tablet PC, wearable computer, etc. It allows you to handle multiple modes of text, pointing, gestures, etc. within the same mechanism, by using groups of keys, using continuous key manipulation, and by mixing permutations and combinations appropriately, thereby increasing portability and user activity. It provides a multi-format input device and method that has a structure that provides unconstrained ease of use, and can handle various modes such as text, pointing, and gesture in inputting the user's will such as data symbols and commands. have.

In order to achieve the above object, the present invention provides a multi-format data input apparatus and method, comprising: a first group input unit composed of a plurality of external input keys for a user's key input and a second group input unit composed of a lever key, the device is tilted or rotated A key input unit configured to generate a key input signal input by a user, the third group input unit including a third group input unit configured as a sensor for sensing a second group, and a fourth group input unit configured as a sensor for sensing up and down, left and right movements and speed of the apparatus; A sensing unit for recognizing a key input signal for each group generated from the key input unit; The key input mode combination and the input order pattern between groups recognized by the sensing unit are analyzed to determine the key input mode, and the corresponding key data is analyzed by analyzing the input signal combination of the other group input key for each key input mode. A state transition analyzer to generate; An input signal transmitter for transmitting the corresponding key data for each key input mode generated by the state transition analyzer to the connected host device, and implements a portable multi-format data input device comprising: (a) Detecting key input from a plurality of groups of external input sensors; (b) determining a key input mode by analyzing key input signal combinations and input sequence patterns from the sensed external group input keys; (c) generating a corresponding key data value preset in correspondence with each of the selected modes by combining input signals from other group input keys after setting to the determined key input mode; and (d) transmitting the generated key data value to the connected host device to perform key input.

1A to 1C are diagrams illustrating an example of a data input device according to an embodiment of the present invention;

2 is a block diagram illustrating an internal block of the data input device of FIG. 1;

3A to 3C are flowcharts illustrating a text input mode according to an embodiment of the present invention;

4A to 4E are exemplary views of a display according to the processing flow of FIG. 3;

5A through 5C are flowcharts illustrating processing in a pointing input mode according to an embodiment of the present invention;

6A-6D illustrate display according to the processing flow of FIG.

Hereinafter, with reference to the accompanying drawings will be described in detail the operation of the preferred embodiment according to the present invention.

1A to 1C illustrate a configuration example of a portable multi-format data input device according to an embodiment of the present invention. The data input device 104 of the present invention can be gripped by a user's hand as shown in FIG. 1A. A group input unit 101 having a push button input key is installed to correspond to the four fingers of the two to five fingers to enable the user's key input through the two to five fingers, A group B input unit 102, which is installed at a position operable by a thumb as shown in FIG. 1B and has a rotary lever key implemented to receive a key input such as a direction movement and a pressing action by the thumb, in FIG. 1C As the C group input unit 103 to detect the rotation, movement of the mechanism according to the movement of the wrist and arm as described above to enable the user's key input through the rotation or movement of the input device. It becomes bait. Therefore, all the input units used and the user's body are constantly in contact with each other, so that the input signal can be transmitted only by the manipulation operation or movement of the body corresponding to each input unit without having to worry about the position of the manipulation unit.

FIG. 2 illustrates an internal block configuration of the portable multi-format data input device of FIG. 1. Referring to FIG. 2, the multi-format data input device of the present invention includes a key input unit 100 reflecting a user's key input intention and a sensing unit for recognizing key input signals for each group generated from the key input unit 100. And a state transition analyzer 200 for analyzing a user's operation intention and an input signal transmitter 300 for transmitting a command or data to the corresponding host device 500 using a wired or wireless path. For the convenience of the user, the display unit 400 may be added, but in the portable device, the user's recognition is shown on the input device front surface 401 as shown in FIG. A separate display 400 may be provided at an easy position. In this case, since the key input unit 100 is held by the user's hand, the key input unit 100 may be provided in the portable unit, but the analysis unit 200, the input signal transmission unit 300, and the display unit 400 may be properly positioned according to the system configuration. .

Hereinafter, the operation of each unit in more detail, first, the key input unit 100 is a part for applying the user's key input will to the state transition analysis unit 200 according to the operation of the user's fingers and wrists. A group input unit 101 composed of four push button keys respectively installed corresponding to up to five fingers, and a rotation lever key installed corresponding to the thumb. The group B may be divided into three groups, such as the group B input unit 102 and the group C input unit 103 which detects the rotation and movement of the device to enable the user's key input through the rotation and movement of the device. In this case, the method of interpreting the user's intention is to follow the procedure of tracing the sequential state transition process of determining the signal combination state of another group from the specific signal combination state of one of these groups. It is to make various meanings according to the order of state and state decision between groups. This combination of combinations and permutations allows for much more input processing than the actual number of manipulation detectors.

Hereinafter, for convenience of description, an example of using only two groups A and B will be described in order to make it easy to understand the operation flow of interpreting the user's will of the present invention. This process is illustrated in FIGS. 3A to 3C and 5A to 5C. FIGS. 3A to 3C illustrate text input such as a keyboard, and FIGS. 5A to 5C illustrate a case of a GUI input such as a mouse and a special command code input. For example. Group A can be assumed to be a combination of four switch inputs 101 as shown in Figure 1a has a total of 2 ⁴ -1 = 15 states, group B reflects the degree of freedom of the thumb to rotate the rotary lever key 102 The direction can be freely indicated, but as a method of selecting a specific symbol, it is divided into eight direction areas and includes nine directions including a downward direction.

Referring to the state transition diagram shown in FIG. 3A, in the circle notation representing each state, the signal group A is displayed at the rear and B is at the front, and the meaning A or B means that the group A or B is specified. "#" Means don't care even if the state of the group changes, and the "/" notation on the moving line between states states that The selectable value of the step is shown on the display 400, and “” denotes an operation of transmitting an input value to the device through the input signal transmitter 300. Fig. 3b shows the corresponding signal according to the number indicating the movement of each state, which will be "0" when none of the push button keys of group A is pressed and "#" when any type of signal (key combination) occurs. It is shown.

Accordingly, the step of accepting the key input will be described as the state transition of FIG. 3A follows the flow on the diagram. Both groups define an initial state when there is no keystroke (or a specific initial state that has been agreed upon) and mark it as "00". At this time, if the signal of the group A finger is determined through the switch operation, the signal state is determined by moving to ① and enters "0A" state, and the signal is output from group A only as shown in ① of FIG. The lever key is motionless.

In this case, the type of input value that may be selected as the thumb direction selection for the B group rotation lever key according to the corresponding A signal combination may be expressed through the display 400 as shown in FIG. 4A. This allows the user to double check and manipulate the desired input values. If the B group symbol group according to the selected A group signal combination does not contain the desired input value, you can change the A group signal combination in step ②. According to the change of the state of the rotation lever key 102 by the thumb, the B group combination corresponding input value corresponding to each case is shown (FIGS. 4A and 4B), and the direction input of the B group rotation lever key is The setting is established in the group A combination state held at the time of entry. In other words, the moment when the group B input is inputted, the group A selection is decided. In this state, the A group state combination becomes irrelevant ("#") and the B group state selection determines the desired input value.

This can also change the B box state combination by the same path as ④ and can help the user to recognize by displaying the input target value according to the B group key input as shown in FIG. 4C. 4D and 4E, the selected symbol is changed as the direction is changed. If it is set to the desired input value, proceed to step ⑤ of releasing B group rotation lever key to “0”. At this point, the selected text symbol is input. If the user goes to the “0A” state through this step ⑤, the user can designate a new input value within the group through step ② and ③ and return to the initial state “00”. have. At this time, a special return path can be added selectively. If the user's intention is changed while entering the B group selection step, the input operation is executed when the B group rotation lever key is moved back to that point. ⑥ Invalidate the existing operation through the specific operation path ⑦ which is initialized through the specific code after group A is released (“0”) or when the B lever is pressed (⑧ → ⑨). You can also perform special procedures, such as letting.

In the above description, the text input is performed as an example. In this case, a special situation can be set. For example, when a user presses a key input of another mode such as a mouse button input for convenience of the user, it may include a method of processing a mouse button input when a specific button is pressed and released immediately, that is, following a path such as ⑩. do. When assigning a mouse button, it is generally used 2 and 3, so the group A buttons 0 and 1 can be set.

If so, let's look at an example of digesting GUI input. This forms a permutation in the opposite direction and performs the mouse function when the input of the direction B group (state setting) is started first. Group B is a lever type that can indicate the direction with the thumb can naturally indicate the position of the pointer (Pointer) movement. This operation can be applied by taking only a simple group B state change as shown in FIG. 5A. According to the change of the direction of the lever 102, the input value is generated according to each state (direction) change of ① and ②.

In this procedure, however, it is possible to generate another type of input signal through an input procedure that does not only indicate the pointer position movement but also sets the state combination of the group B. This flow is shown in Figure 5b. The basic concept is the same as in Fig. 3 except that the flow direction is different. In addition, when the B group rotation lever key operates, a group of possible commands is displayed as shown in Fig. 6A and the group A button is operated. You can specify the value and select the value through ④ and ⑤ similarly as described above. In this case, display operations corresponding to FIGS. 4C and 4D are illustrated in FIGS. 5C and 5D.

As described above, the text input and the mouse operation corresponding to the keyboard can be performed by combining five key inputs using the combination of the state combination and the order. In addition, the user can check and readjust the operation at each group step, and it becomes easy to memorize according to the type of each operation.

The example using the two groups A and B described above is for ease of understanding, and the combination of the group C and the group 103 that detects the rotation and movement of the device and the group A and B can handle the gesture mode such as the joystick. In addition, as described in FIGS. 5A to 5C, 3! = 6 input procedures may be configured by a permutation combination between three groups, thereby facilitating more symbols and commands.

Therefore, depending on the implementation of the input device, it is possible to integrate various types of inputs such as symbolic, spatial and temporal such as keyboard, mouse, and joystick. Also, if you use this type of device with both hands and use it in combination, you can process a huge number of input signals such as 6! = 720 kinds of signals and commands so that you can integrate many existing input devices. In addition, since the input device of the present invention uses a key input corresponding to 1: 1 for each movement part of a person, the inconvenience of having to find the position of the operation unit of the input device for the operation is prevented.

Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the invention should be determined by the claims rather than by the described embodiments.

As described above, in the input device of various application devices such as a computer, a PDA, a mobile phone, a tablet PC, a wearable computer, and the like, an input device key input unit and an operation part for key input such as a finger and a wrist are provided. One-to-one arrangement allows the user to operate without worrying about the location of the input unit, thereby limiting portability and user's activities, and allowing the user to freely pose in the form of a hand held in the hand, thus preventing physical injuries such as VDT syndrome. There is an advantage to that.

In addition, various types of input functions such as a text input mode for inputting characters in charge of the keyboard, a GUI using a mouse and a digitizer, a mode for pointing input, and a gesture mode such as a joystick used in a game or remote control Can be processed in the input device has the advantage of greatly improving the convenience of use.

Claims (23)

In a multi-format input device, A first group input unit configured with a plurality of external input keys for a user's key input, a second group input unit configured with a rotary lever key, a third group input unit for detecting a rotational movement of a wrist, a fourth group input unit for detecting a position movement of a hand, etc. An input unit having a key to generate a key input signal input by the user; A detection unit for recognizing a key input signal for each group generated from the input unit; Analyzes the input signal combination and input order pattern of each group recognized by the sensing unit to determine the multi-format input mode of text, pointing or gesture, and analyzes the input signal combination of other groups for the corresponding input mode to correspond to the multi-format. A state transition analyzer for generating key data, And an input signal transmitter configured to transmit corresponding key data for each of the multi-format input modes generated from the state transition analyzer to a connected host device to generate a corresponding format key input. The method of claim 1, And the first group input unit is formed of four push button keys. The method of claim 2, Each push button key of the first group input unit may be installed to correspond to two to five fingers so as to be operated by the fingers other than the thumb. The method of claim 1, And the state transition analyzing unit analyzes the text input when the input of the push button key is preceded and generates text mode key data corresponding to a combination of input signals of another group. The method of claim 4, wherein And the state transition analyzing unit analyzes in a text input mode when an input of a push button key corresponding to two to four fingers of the push button keys is preceded. The method of claim 4, wherein If necessary, the state transition analysis unit analyzes a specific command execution signal such as a mouse button function when a single input of a push button key corresponding to a specific finger such as 2 to 3 of the push button keys is performed. Multi-format input device. The method of claim 4, wherein The state transition analysis unit, if necessary, when the direction input input of the second input unit is performed in the activation state of the push button key corresponding to a specific finger, such as two to three of the push button keys, drag the mouse instead of the text input. A multi-format input device characterized in that it is analyzed by a specific command execution signal such as an end drop function. The method of claim 1, The second group input unit is installed to correspond to the thumb to be adjustable by the user's thumb, and recognizes the rotation of the thumb as a continuous value and at the same time the key input value can be distinguished for each preset direction section according to the rotation and A multi-type input device, characterized in that formed by a rotary lever key that is implemented to generate a key input value according to the push up / down. The method of claim 8, The state transition analyzing unit may determine a pointing input mode when a signal input of the rotary lever key, which is the second group input unit is preceded, and perform a pointer movement operation in a direction corresponding to a direction indication operation of the rotary lever key. Multi-format input device. The method of claim 9, The state transition analysis unit recognizes a command input to a connected device when the input signal of another group input key is generated while a signal change occurs according to the direction indication operation of the rotary lever key, and corresponds to another group input signal combination. Multi-format input device, characterized in that for indicating the operation. The method of claim 1, The detection unit, the multi-format input device, characterized in that for detecting the position change of the input device according to the rotation or movement of the wrist by the user and apply to the state transition analysis unit. The method of claim 11, The state transition analyzer detects a position change of the input device according to the rotation or movement of the wrist through the detection unit, and the gesture command mode when the position change precedes the generation of the input signals of the first and second groups. And gesture mode key data corresponding to the combination of the input signals of the first and second groups. The method of claim 1, And a display unit for displaying a mode-specific key data generation process according to the input signal combination analyzed by the state transition from the state transition analyzer so as to be identified by the user. The method of claim 1, The input device is a multi-format input device, characterized in that it is produced in a form that can be gripped in the hand to be manipulated by the user's finger. The method of claim 1, The input device is a multi-format input device, characterized in that the signal is manufactured in a form that can be gripped on both hands so that each movement of the user's hands can be used together. The method of claim 1, And the input signal transmitter converts the key input data signal analyzed by the state transition analyzer into an electrical signal that can be recognized by the connected host device. In a multi-format input method in a multi-format input device, (a) detecting key input from a plurality of group-specific external input units provided in the input device; (b) determining a multi-format key input mode of text, pointing, or gesture by analyzing the detected key input signal combination and input sequence pattern from the external input unit for each of the plurality of groups; (c) generating a multi-format key data value corresponding to each of the selected modes by combining input signals from other group input units after being set to the determined key input mode; and performing multi-format key input by transmitting the generated corresponding key data value for each multi-format key input mode to a connected host device. The method of claim 17, And the external input unit for each of the plurality of groups comprises a first group input unit including four push button keys and a second group input unit including rotary lever keys. The method of claim 18, The rotary lever key is a multi-format input method characterized in that the eight input values and the push input value of the up / down direction is set in accordance with the rotation direction is implemented to be possible. The method of claim 17, The step (b) may include: (b1) grouping input signals from external input units for each group sensed by each detector to specify a change in signal combination of each group input unit; (b2) determining a multi-format key input mode of text, pointing, or gesture by analyzing a sequential pattern of signal combination generation between each group input unit. The method of claim 20, The step (b2) may include: (b21) determining that the text input mode is in a case where an input of a push button key of a first group precedes an input signal of another group as a result of the key input pattern analysis; (b22) determining the pointing input mode when the signal input according to the direction indicating operation of the rotation lever key of the second group precedes the input signal of the other group; (b23) detecting a change in the position of the input device before the first and second group input signals are generated, and determining a gesture input mode. The method of claim 21, In the step (b21), if the input of the push button key corresponding to two to five fingers of the four push button keys is preceded, the multi-format input method characterized in that it is determined. The method of claim 17, Step (c) may include: (c1) generating text mode key data of a corresponding key combination according to a change of another group input signal when the determined mode is a text input mode; (c2) when the determined mode is the pointing input mode, the pointer movement operation is performed in the direction indicated by the rotary lever input key, and the pointing mode key of the corresponding key combination is changed according to the change of another group input signal at the moved position. Generating data; (c3) if the determined mode is a gesture input mode, generating gesture mode key data of a corresponding key combination according to a change of the first and second group input signals; Input method.