KR20120031564A - Computer control method and device using keyboard, and recording medium of program language for the same - Google Patents

Abstract

PURPOSE: A computer controlling method using a keyboard, an apparatus thereof, and recording medium are provided to rapidly perform a command by key operation of a keyboard by determining various commands as a gesture about a keyboard. CONSTITUTION: A sound detecting unit(810) is included in a keyboard and detects sound which is generated from the keyboard. An operation unit(820) determines a pattern of sound. A controlling unit(830) performs a command corresponding to the pattern. A memory unit(840) stores a command signal corresponding to a touch panel of the keyboard. The controlling unit compares the touch pattern with a touch pattern in the memory unit.

Description

Computer control method and device using keyboard, and recording medium of program language for the same}

The present invention relates to a computer control method using a keyboard, a control device and a recording medium on which program instructions are recorded. Based on a method of recognizing a gesture, the present invention can determine various commands as gestures to a keyboard, and thus can perform a quick command as compared to a key operation of a separate keyboard. And a recording medium having recorded therein program instructions therefor.

According to information and communication technology, various interaction methods between an electronic device and a human are disclosed. However, unlike a mobile device having various input sensors such as a touch screen, an acoustic sensor, and an acceleration sensor, the input operation through the manipulation of the keyboard or the mouse is still dominant in a computer in which a keyboard or a mouse is a general input method.

However, in this case, it is inconvenient to perform separate control operations with one mouse and keyboard in various multitasking environments. In addition, in order to solve this problem, it is not economical to provide a separate sensing module in the personal computer.

Therefore, there is a need for a new method and apparatus for controlling a computer using an existing input device.

Accordingly, an object of the present invention is to provide a computer control method capable of more effective input operation using a conventional keyboard and a recording medium on which program instructions are recorded.

Another problem to be solved by the present invention is to provide a computer control device capable of computer control in a new way using an existing keyboard and a recording medium on which program instructions are recorded.

In order to solve the above problems, the present invention is a computer control method using a keyboard, the method is provided in the keyboard, through the sound detection unit for detecting a sound generated from the user touch on the keyboard, the user performed on the keyboard Provided is a computer control method using a keyboard, which is a method of controlling a computer through a gesture.

In one embodiment of the invention the sound detector is provided on the biased side of the keyboard.

In one embodiment of the present invention, the method controls the computer by dividing the continuous touch direction of the user with respect to the plurality of keys provided in the keyboard by the sound intensity detected from the keyboard.

In an embodiment of the present invention, the method divides and detects sound generated from a user's touch on the keyboard into a frequency domain.

In one embodiment of the present invention, the sound generated from the user touch on the keyboard has a higher frequency than other sounds.

In one embodiment of the present invention, the user touch is a sweeping touch in which a plurality of keys of the keyboard are touched within a predetermined time.

In order to solve the another problem, the present invention is a computer control device having a keyboard, the device is provided in the keyboard, the sound detection unit for detecting a sound generated from the keyboard; An operation unit for determining whether the sound detected by the sound detection unit is a sound generated from a user touch on a keyboard and a pattern thereof; And a controller configured to perform a command corresponding to the user touch pattern detected by the calculator.

In one embodiment of the present invention, the computer control apparatus further includes a memory unit in which a touch pattern for a keyboard and a command signal corresponding thereto are stored, wherein the controller is configured to store the detected user touch pattern with the touch pattern stored in the memory unit. In comparison, a command signal corresponding to the matched touch pattern is generated.

In one embodiment of the invention the sound detector is provided on the biased side of the keyboard.

In one embodiment of the present invention, the touch pattern is determined according to the direction in which the touch is performed, and the calculator determines whether the sound is from a user touch on the keyboard based on the frequency domain.

In one embodiment of the present invention, the user touch is a sweeping touch in which a plurality of keys are touched within a predetermined time.

The present invention also provides a computer including the computer control apparatus described above. Also provided is a computer-readable recording medium having recorded thereon computer program instructions for driving the above-described control apparatus and control method.

The present invention is based on a method of recognizing various user gestures by recognizing a high frequency sound change generated through a sweeping gesture that sweeps the surface of the keyboard, and according to the present invention, various commands can be determined as gestures to the keyboard. It is possible to perform quick command as compared to key operation of a separate keyboard. Furthermore, since the input using the gesture at the upper end of the keyboard is possible, the input switching time is minimized, which enables faster command execution than in the prior art.

1 and 2 are diagrams illustrating a case in which the microphone 110 is provided on the left side of the keyboard 100 and a sweeping touch of the keyboard is performed in a left and right direction by a human hand.
3 is a diagram illustrating a sound pattern detected for each keyboard region when a microphone is provided on the left side.
4 is a flowchart of a method of controlling a computer with sound detected from a keyboard according to an embodiment of the present invention.
FIG. 5 is a graph showing a frequency difference between a typical keyboard typing and a keyboard sweep, and FIG. 6 is a graph showing a frequency difference when a human sweeps a voice and a keyboard.
FIG. 7 illustrates a case where the detected sound from the microphone provided on the left side of the keyboard is increased according to an embodiment of the present invention (that is, the keyboard sweeps in the direction in which the microphone is provided (left)) and when the sound is reduced (that is, provided by the microphone). (Sweeping the keyboard in the un-directed direction (right)) (graph below), and thus a graph showing an example of operation control of the application program.
8 is a block diagram of a computer control apparatus according to an embodiment of the present invention.

In order to fully understand the present invention, the operational advantages of the present invention, and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings which illustrate preferred embodiments of the present invention and the contents described in the accompanying drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In addition, in order to clearly describe the present invention, parts irrelevant to the description are omitted, and the same reference numerals in the drawings indicate the same members.

Throughout the specification, when an element is referred to as " including " an element, it does not exclude other elements unless specifically stated to the contrary. The terms "part", "unit", "module", "block", and the like described in the specification mean units for processing at least one function or operation, And a combination of software.

The present invention noted that when a user touches a key of a conventional keyboard, the sound frequency has a high frequency range that is clearly distinguishable from an external sound. Accordingly, the present invention provides a control method for controlling a computer according to a sound generated from a keyboard and detected.

In an embodiment of the present invention, a person controls a computer by using a gesture of discontinuously inputting and touching a keyboard to input characters and another keyboard touch pattern, which continuously touches a plurality of keys within a predetermined time. It is a so-called "sweeping" touch. That is, in the case of the swept touch, the continuous touch direction with respect to the keyboard can be detected by sound detection means such as a microphone, and the present invention controls the computer according to the continuous direction of the keyboard touch.

The computer control method according to another embodiment of the present invention distinguishes the direction of the swept touch by its strength through a microphone that is biased (ie, provided on one side) with continuous keyboard touch directionality. That is, when the sound detected by the microphone is gradually increased, the sweeping touch proceeds in the direction in which the microphone is provided, and when the vice versa, the sweeping touch is performed in the direction in which the microphone is not provided.

1 and 2 are diagrams illustrating a case in which the microphone 110 is provided on the left side of the keyboard 100 and a sweeping touch of the keyboard is performed in a left and right direction by a human hand.

Referring to FIG. 1, when a person sweeps the keyboard, the volume of the sound detected by the microphone 110 has a pattern that increases even at a very short time, and vice versa. Has

3 is a diagram illustrating a sound pattern detected for each keyboard region when a microphone is provided on the left side.

Referring to FIG. 3, it can be seen that the volume pattern of the sound detected by the microphone is different for each keyboard region, and the sweeping direction may be determined according to a combination thereof.

4 is a flowchart of a method of controlling a computer with sound detected from a keyboard according to an embodiment of the present invention.

Referring to FIG. 4, first, a sound is detected by a microphone, which is a sound detection unit provided in a keyboard (S100). At this time, the sound is filtered based on the frequency (S110). At this time, the sound generated when the user touches (inputs) a key of the keyboard has a high frequency range from a normal external sound, and thus has a low frequency range. The sound of is filtered.

For example, the human voice is 90 to 300 Hz, the mechanical vibration is 50 or 60 Hz, but the frequency of the sound generated from the keystrokes of the keyboard is higher than this, especially when a plurality of keys are continuously swept within a predetermined time. This high frequency characteristic is further enhanced.

For example, FIG. 5 is a graph showing a frequency difference between a typical keyboard typing and a keyboard sweep, and FIG. 6 is a graph showing a frequency difference when a human sweeps a voice and a keyboard. As described above, the present invention executes various computer control commands based on the fact that a very high high frequency characteristic appears when the sweeping gesture sweeps the keyboard in a short time.

Referring back to FIG. 4, after the frequency filtering (S110), the filtered keyboard touch pattern (eg, the sweeping direction) is recognized (S120). For example, the keyboard sweeping direction may be determined according to the increase or decrease of the sound based on the biased microphone. Thereafter, a computer control command corresponding to the recognized pattern is performed (S130).

The computer control command may be various kinds of commands. For example, the volume increase or decrease of the actual sound can be controlled by such keyboard sweeping. Alternatively, selective movement of various applications can be performed in this manner.

FIG. 7 illustrates a case where the detected sound from the microphone provided on the left side of the keyboard is increased according to an embodiment of the present invention (that is, the keyboard sweeps in the direction in which the microphone is provided (left)) and when the sound is reduced (that is, provided by the microphone). Keyboard sweep in the non-directed direction (right)) (graph below), and thus an example of controlling the application program operation. More specifically, it allows you to select tasks on either side of the taskbar you are currently using through the direction of the sweeping gesture. In other words, if the left gesture, the left task is selected, the right task is selected to increase the efficiency of the task.

The present invention provides a computer control device having a keyboard to solve the above another problem, Figure 8 is a block diagram of a computer control device according to an embodiment of the present invention.

Referring to FIG. 8, a computer control apparatus according to the present invention includes a sound detection unit 810 provided in a keyboard and configured to detect a sound generated from the keyboard; An operation unit 820 for determining whether the sound detected by the sound detection unit is a sound generated from a user touch on a keyboard and a pattern thereof; And a controller 830 that performs a command corresponding to the user touch pattern detected by the calculator. The sound detection unit 810 is preferably provided on the biased side of the keyboard, through which the sweeping direction can be detected. In addition, the operation unit 820 determines whether the user touches the keyboard, in particular, the sweeping touch, according to the detected frequency of the sound, and the controller 830 controls the computer according to the detected sweeping touch pattern.

The computer control apparatus according to another embodiment of the present invention may further include a memory unit 840 in which each of touch patterns (eg, sweeping patterns and directions) and command signals corresponding thereto are stored, wherein the controller The detected user touch pattern is compared with the touch patterns stored in the memory unit to generate a command signal corresponding to the matched touch pattern.

In one embodiment of the present invention, the touch pattern is determined according to the direction in which the touch is performed, and in one embodiment of the present invention, the keyboard touch is a swept touch in which a plurality of keys are continuously input within a predetermined time. The sound generated from this has high frequency characteristics. Accordingly, the calculator 820 determines whether the sound is from a user touch on the keyboard based on the frequency domain.

The above-described computer control apparatus according to the present invention is capable of gesture-based fast computer control since no physical interface movement is required during keyboard input. Therefore, the computer control apparatus according to the present invention can be provided in the computer, thereby maximizing user convenience. Furthermore, since the computer control method according to the present invention utilizes an existing keyboard, there is no need to install expensive interface hardware in the computer, and there is an advantage in that the computer can be controlled using software.

The apparatus and method according to the present invention can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also include a carrier wave (for example, transmission through the Internet). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

Claims (15)

Computer control method using a keyboard, the method is
The computer control method using a keyboard, characterized in that the computer control method through a user gesture performed on the keyboard through a sound detection unit for detecting a sound generated from the user touch on the keyboard.
The method of claim 1,
And the sound detector is provided on the biased side of the keyboard.
The method of claim 2,
And the method controls the computer by dividing a continuous touch direction of a user with respect to a plurality of keys provided in the keyboard by the sound intensity detected from the keyboard.
The method of claim 3, wherein
The method as claimed in claim 1, wherein the sound generated from the user's touch on the keyboard is divided into frequency domains to detect the sound.
The method of claim 4, wherein
And a sound generated from a user touch on the keyboard has a higher frequency than other sounds.
The method of claim 3, wherein
And the user touch is a sweeping touch in which a plurality of keys of the keyboard are touched within a predetermined time.
A computer-readable recording medium having recorded thereon program instructions for carrying out the method according to any one of claims 1 to 6.
A computer control device having a keyboard, the device comprising
A sound detector provided in the keyboard and configured to detect a sound generated from the keyboard;
An operation unit for determining whether the sound detected by the sound detection unit is a sound generated from a user touch on a keyboard and a pattern thereof; And
And a controller configured to perform a command corresponding to the user touch pattern detected by the calculator.
The method of claim 8,
The computer control apparatus further includes a memory unit in which a touch pattern for a keyboard and a command signal corresponding thereto are stored.
Wherein the controller is configured to generate a command signal corresponding to the matched touch pattern by comparing the detected user touch pattern with the touch pattern stored in the memory unit.
The method of claim 9,
And the sound detector is provided on the biased side of the keyboard.
The method of claim 10,
And the touch pattern is determined according to a direction in which the touch is performed.
The method of claim 9,
And the calculator determines whether the sound is from a user touch on the keyboard based on the frequency domain.
12. The method of claim 11,
And the user touch is a sweeping touch in which a plurality of keys are touched within a predetermined time.
A computer comprising the computer control device according to claim 8.
A computer-readable recording medium having recorded thereon computer program instructions for driving a computer control device according to any one of claims 8 to 13.

Images