KR20110121169A - Mouse pointer control method using voice - Google Patents

Mouse pointer control method using voice Download PDF

Info

Publication number
KR20110121169A
KR20110121169A KR1020100040641A KR20100040641A KR20110121169A KR 20110121169 A KR20110121169 A KR 20110121169A KR 1020100040641 A KR1020100040641 A KR 1020100040641A KR 20100040641 A KR20100040641 A KR 20100040641A KR 20110121169 A KR20110121169 A KR 20110121169A
Authority
KR
South Korea
Prior art keywords
voice signal
voice
mouse pointer
input
user
Prior art date
Application number
KR1020100040641A
Other languages
Korean (ko)
Inventor
류재호
Original Assignee
주식회사 인프라웨어
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 인프라웨어 filed Critical 주식회사 인프라웨어
Priority to KR1020100040641A priority Critical patent/KR20110121169A/en
Publication of KR20110121169A publication Critical patent/KR20110121169A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Position Input By Displaying (AREA)

Abstract

PURPOSE: A mouse pointer control method using voice is provided to enable a user to easily control a mouse pointer by controlling the speed and location of a mouse pointer through the voice. CONSTITUTION: A memory unit store data patterns corresponding to the voice signal of a user. The voice signal is inputted to a voice signal recognition module(S110). The voice signal recognition module recognizes and determines the voice signal. The voice signal recognition module transmits the voice signal to a voice signal processing module(S130). The voice signal processing module changes the voice signal into a digital signal(S140). The voice signal processing module creates a control signal based on the matched digital signal by matching the digital signal with a data pattern in which is established by a memory unit(S150).

Description

Mouse pointer control method using voice

The present invention relates to a method of controlling a mouse pointer using a voice, and in detail, even when a user utters a voice signal with relatively easy pronunciation, the mouse pointer embodied in the display unit can be simply moved in conjunction with the voice signal, and the high / low voice signal can be realized. The present invention relates to a mouse pointer control technique using a voice for controlling the movement speed of a pointer through.

Most devices similar to computers use an input device called a mouse to control the pointer. However, because there are people who are difficult to use the mouse due to physical limitations, there is a need for them to easily control the pointer of the mouse without using the mouse. As an alternative, the snow fuselage may be used, but such equipment is expensive and economically burdensome to use.

In addition, when the pointer is moved using a voice, there is a problem in that the pronunciation must be corrected. When the pronunciation is difficult to accurately pronounce or a difference in pronunciation is not accurately distinguished by a person, a pointer embodied in the computer display unit is used. There is a problem that is difficult to move to.

In order to solve the above problems, there is a demand for a mouse pointer control technique using a voice capable of moving a mouse pointer of a display unit to a desired position with a relatively easy pronunciation and also adjusting a moving speed.

SUMMARY OF THE INVENTION An object of the present invention is to provide a mouse pointer control technique using a voice that allows a user to move a mouse pointer of a display unit to a desired position even with relatively easy pronunciation, and also adjusts a moving speed.

In order to achieve the above object, a method of controlling a mouse pointer using voice according to the present invention includes: (a) storing data corresponding to a voice signal of a user for each pattern in a memory unit; (b) inputting a user's voice signal into a voice signal recognition module; (c) the voice signal recognition module recognizing, determining and transmitting the received voice signal to a voice signal processing module; (d) converting the voice signal transmitted from the voice signal recognition module into a digital signal by the voice signal processing module; (e) the voice signal processing module matching and determining the converted digital signal with a data pattern preset in the memory unit; (f) the voice signal processing module generating a control signal based on the matched digital signal; (g) transmitting a control signal generated by the voice signal processing module to a display unit to move the mouse pointer implemented in the display unit; It is configured to include.

In the step (a) of the present invention, when a certain vowel is input from the user's voice signal, the patterned data is stored so that the mouse pointer in the step (g) corresponds to the constant vowel in the memory unit so that the mouse pointer can move in the up, down, left, and right directions.

In the step (f) of the present invention, if a certain vowel of the user's voice signal is synthesized and input into one syllable, the voice signal processing module synthesizes the mouse pointer of the step (g) to move in a diagonal direction corresponding to the input vowel. The control signal corresponding to the input vowel of syllables is generated.

In the step (a) of the present invention, when the decibel of the sound wave increases from the beginning to the last of one syllable of the user's voice signal, the moving speed of the mouse pointer in the step (g) is relatively faster, and one of the user's voice signals is increased. When the decibels of sound waves fall from the beginning to the end of the syllable, the patterned data corresponding to the decibels of the syllable is stored in the memory unit so that the movement speed of the mouse pointer in step (g) is relatively slow.

In step (b) of the present invention, when a vowel of one syllable among the voice signals of the user input to the voice signal recognition module is inputted, the mouse pointer of step (g) moves to the right side, and the voice signal recognition module When a syllable vowel of the user's voice signal is input 'ㅓ', the mouse pointer in step (g) moves to the left, and the syllable vowel of the user's voice signal input to the voice signal recognition module is set to '이'. Is inputted, the mouse pointer in step (g) moves upwards, and when a vowel of one syllable among user's voice signals input to the voice signal recognition module is inputted with 'TT', the mouse pointer in step (g) moves downwards. In the memory unit of step (a), the data patterned to correspond to the respective 'ㅏ, ㅓ, ㅗ, TT' vowels is stored.

In the step (f) of the present invention, when the respective 'ㅏ, ㅏ, ㅗ, TT' vowels of the user's voice signals are synthesized and input into one syllable, the mouse pointer of (g) is diagonally corresponding to the synthesized input vowel. The voice signal processing module generates a control signal corresponding to a vowel of a syllable synthesized and input so as to be movable in the direction.

Mouse pointer control method using the voice according to the present invention,

First, since the user can adjust the position and speed of the mouse pointer in a very simple manner through relatively easy pronunciation, the user can easily control the mouse pointer using only voice.

Second, the present invention is particularly useful for physically inconvenient users.

Third, since the voice signal receiver of the present invention can be used through a microphone which can be easily purchased on the market, there is no need to purchase expensive equipment separately.

1 is a schematic block diagram showing a mouse pointer control system using voice according to an embodiment of the present invention;
2 is a block diagram showing a voice signal recognition module according to an embodiment of the present invention;
3 is a block diagram showing a voice signal processing module according to an embodiment of the present invention;
4 is a flowchart illustrating a method of controlling a mouse pointer using voice according to an embodiment of the present invention.
5 is a state in which the mouse pointer moves up, down, left, and right in the display unit according to an embodiment of the present invention;
6 is a state diagram in which a mouse pointer moves in a diagonal direction on a display unit according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram showing a mouse pointer control system using voice according to an embodiment of the present invention. The present embodiment is a voice signal recognition module 100, a voice signal processing module 200, and And a memory unit 300, a display unit 400, and a controller 500.

The voice signal recognition module 100 receives, recognizes, and determines a voice signal spoken by a user. The voice signal processing module 200 converts the voice signal, generates a control signal, and transmits the control signal to the display unit.

The memory unit 300 stores data corresponding to the voice signal of the user for each pattern. The display unit 400 implements the mouse pointer 410 and represents a monitor of a computer.

2 is a block diagram illustrating a voice signal recognition module according to an embodiment of the present invention, wherein the voice signal recognition module 100 includes a voice signal receiver 110, a voice signal determiner 120, and a voice. It includes a signal transmitter 130.

The voice signal receiver 110 receives a voice signal spoken by a user, and the voice signal determiner 120 recognizes the received voice signal.

The voice signal transmitter 130 transmits the recognized voice signal to the voice signal processing module 200.

3 is a block diagram illustrating a voice signal processing module according to an exemplary embodiment of the present invention, wherein the voice signal processing module 200 includes a filter 210, a signal converter 220, and a signal analyzer 230, a signal classifier 240, and a signal transmitter 250.

The filter unit 210 filters the received voice signal appropriately for the desired effective transmission frequency band.

The signal converter 220 is preferably configured as an A / D converter to convert analog voice signals into digital signals.

The signal analyzer 230 analyzes and determines whether the converted digital signal corresponds to data stored for each pattern in the memory unit 300. The signal classifier 240 classifies and generates control signals corresponding to data stored for each pattern in the memory unit 300.

The display unit 400 transmits a control signal generated by classification of the signal transmitter 250.

4 is a flowchart illustrating a method of controlling a mouse pointer using voice according to an exemplary embodiment of the present invention. A process of moving the mouse pointer implemented in the display unit from a voice signal spoken by a user will be described in detail as follows.

First, a voice signal spoken by a user is input to a voice signal receiver of a voice signal recognition module (S110). The voice signal determination unit determines whether the input voice signal corresponds to a data pattern preset in the memory unit to recognize a valid voice signal (S120).

The validly recognized voice signal is transmitted to the voice signal processing module by the voice signal transmitter (S130). The transmitted voice signal is filtered to the effective transmission frequency band by the filter unit of the voice signal processing module, and the analog voice signal is converted into a digital signal by the signal converter (S140).

The signal analyzer of the voice signal processing module analyzes and determines whether the converted digital signal corresponds to the data stored in the memory unit by pattern, and then controls the signal classification unit corresponding to the data stored in the memory unit by the pattern from the analyzed digital signal. The signal is classified and generated (S150).

The signal transmitter of the voice signal processing module transmits the classification-generated control signal to the display unit, and the mouse pointer implemented in the display unit is moved by the control signal transmitted to the display unit (S160).

FIG. 5 is a state diagram in which a mouse pointer moves up, down, left, and right in a display unit according to an embodiment of the present invention. When data corresponding to a user's voice signal is stored for each pattern in a memory unit, a certain collection of voice signals of the user is collected. This input causes the mouse pointer to move up, down, left and right.

In addition, when the data patterned to correspond to the decibel of the syllable is stored in the memory unit, when the decibel of the sound wave increases from the beginning to the end of one syllable of the user's voice signal, the moving speed of the mouse pointer 410 is relatively increased. When the decibels of sound waves fall from the beginning to the end of one syllable of the user's voice signal, the movement speed of the mouse pointer becomes relatively slow.

For example, when data patterned to correspond to each 'ㅏ, ㅓ, ㅗ, TT' vowel is stored in the memory unit, the vowel of one syllable among the user's voice signals input to the voice signal recognition module is set to 'ㅏ'. When input, the mouse pointer 410 moves to the right, and when a vowel of one syllable among the user's voice signals input to the voice signal recognition module is input, the mouse pointer moves to the left and inputs to the voice signal recognition module. The mouse pointer moves upward when one syllable vowel is input, and the mouse pointer is input when one syllable vowel is input to the voice signal recognition module. Will move downward.

6 is a state diagram in which a mouse pointer moves diagonally on a display unit according to an exemplary embodiment of the present invention. When a certain vowel of voice signals of a user is synthesized and input into one syllable, the mouse pointer 410 is input to the synthesized vowel. Correspondingly, the voice signal processing module may generate a control signal corresponding to a vowel of a syllable synthesized to be shifted in a diagonal direction.

For example, when the 'ㅏ, ㅓ, ㅗ, TT' vowels of the user's voice signals are synthesized and input into one syllable, the mouse pointer 410 may move the voice signal in a diagonal direction corresponding to the synthesized input vowels. The module generates a control signal corresponding to the vowel of one syllable input.

100: voice signal recognition module 110: voice signal receiver
120: voice signal determination unit 130: voice signal transmission unit
200: voice signal processing module 210: filter unit
220: signal conversion unit 230: signal analysis unit
240: signal classification unit 250: signal transmission unit
300: memory 400: display
410: mouse pointer 500: control unit

Claims (6)

(a) storing data corresponding to a voice signal of a user for each pattern in the memory unit;
(b) inputting a user's voice signal into a voice signal recognition module;
(c) the voice signal recognition module recognizing, determining and transmitting the received voice signal to a voice signal processing module;
(d) converting the voice signal transmitted from the voice signal recognition module into a digital signal by the voice signal processing module;
(e) the voice signal processing module matching and determining the converted digital signal with a data pattern preset in the memory unit;
(f) the voice signal processing module generating a control signal based on the matched digital signal;
(g) transmitting a control signal generated by the voice signal processing module to a display unit to move the mouse pointer implemented in the display unit;
Mouse pointer control method using a voice, characterized in that configured to include. The method according to claim 1,
In the step (a),
When a certain vowel is input from the user's voice signal, patterned data is stored so as to correspond to the predetermined vowel in the memory unit such that the mouse pointer of the step (g) is movable in the up, down, left, and right directions. How to control the mouse pointer. The method according to claim 1,
In the step (f),
If a certain vowel of the user's voice signal is synthesized and input into one syllable, the voice signal processing module may synthesize the synthesized input syllable such that the mouse pointer of the step (g) moves diagonally in correspondence to the synthesized input vowel. Mouse control method using a voice, characterized in that for generating a control signal corresponding to the. The method according to claim 1,
In the step (a),
When the decibel of sound waves rises from the beginning of one syllable to the last of the user's voice signal, the movement speed of the mouse pointer in step (g) is relatively faster, and from the beginning to the last of one syllable of the user's voice signal. When the decibel of sound waves falls, the mouse pointer control using voice is characterized in that the data stored in the memory unit is patterned to correspond to the decibel of the syllable so that the movement speed of the mouse pointer in step (g) is relatively slow. Way. The method according to any one of claims 2 to 4,
In step (b),
When a vowel of one syllable among the user's voice signals input to the voice signal recognition module is input, the mouse pointer of step (g) moves to the right, and the user's voice signal input to the voice signal recognition module If the vowel of one syllable is input 'ㅓ', the mouse pointer of step (g) moves to the left side, and if the vowel of one syllable among the user's voice signals input to the voice signal recognition module is input The mouse pointer of step (g) moves upwards, and when TT is input to one syllable of the user's voice signals input to the voice signal recognition module, the mouse pointer of step (g) moves downward. The mouse using the voice, characterized in that for storing the patterned data corresponding to each of the '', ',', ' Inter controlled manner. The method according to claim 5,
In the step (f),
When the 'ㅏ, ㅓ, ㅜ, TT' vowels of the user's voice signals are synthesized and input into one syllable, the mouse pointer of the step (g) moves in a diagonal direction corresponding to the synthesized input vowels. And a processing module generates a control signal corresponding to the vowel of the synthesized input syllable.
KR1020100040641A 2010-04-30 2010-04-30 Mouse pointer control method using voice KR20110121169A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100040641A KR20110121169A (en) 2010-04-30 2010-04-30 Mouse pointer control method using voice

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100040641A KR20110121169A (en) 2010-04-30 2010-04-30 Mouse pointer control method using voice

Publications (1)

Publication Number Publication Date
KR20110121169A true KR20110121169A (en) 2011-11-07

Family

ID=45392090

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100040641A KR20110121169A (en) 2010-04-30 2010-04-30 Mouse pointer control method using voice

Country Status (1)

Country Link
KR (1) KR20110121169A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101486875B1 (en) * 2013-10-07 2015-01-29 금오공과대학교 산학협력단 A voice recognition mouse circuit and a method of operating the same
CN110874252A (en) * 2018-08-30 2020-03-10 Tcl集团股份有限公司 Focus control method, device and equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101486875B1 (en) * 2013-10-07 2015-01-29 금오공과대학교 산학협력단 A voice recognition mouse circuit and a method of operating the same
CN110874252A (en) * 2018-08-30 2020-03-10 Tcl集团股份有限公司 Focus control method, device and equipment

Similar Documents

Publication Publication Date Title
US8280732B2 (en) System and method for multidimensional gesture analysis
US10748542B2 (en) System and method of correlating mouth images to input commands
KR102069237B1 (en) Terminal and handsfree device for servicing handsfree automatic interpretation, and method thereof
CN114127665B (en) Multimodal user interface
CN108735219B (en) Voice recognition control method and device
US8762144B2 (en) Method and apparatus for voice activity detection
US9958950B2 (en) Detector
US8223589B2 (en) Gesture recognition apparatus and method
JP5529844B2 (en) Gesture multi-dimensional analysis system and method
WO2018194884A1 (en) Haptic communication system using cutaneous actuators for simulation of continuous human touch
CN101772750A (en) Mobile communication device and input device for the same
JPH11502953A (en) Speech recognition method and device in harsh environment
CN105919591A (en) Surface myoelectrical signal based sign language recognition vocal system and method
CN101930747A (en) Method and device for converting voice into mouth shape image
KR20160025301A (en) Apparatus and method for recognizing voiceof speech
Peixoto et al. Voice controlled wheelchairs: Fine control by humming
US20180081621A1 (en) Assistive apparatus having accelerometer-based accessibility
KR101704510B1 (en) Method for enhancement of speech of interest, an apparatus for enhancement of speech of interest and a vehicle equipped with the apparatus
JP2005352154A (en) Device of reactively operating to feeling condition
JP7405093B2 (en) Information processing device and information processing method
KR20110121169A (en) Mouse pointer control method using voice
US9269352B2 (en) Speech recognition with a plurality of microphones
WO2020079918A1 (en) Information processing device and information processing method
JP2018206073A (en) Remote operation system
KR102355713B1 (en) Multimedia control method and system for artificial intelligence type

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination