KR20230051919A - Mouse control apparatus and method for the same - Google Patents

Abstract

The present invention relates to a lip mouse and a method of controlling the lip mouse. The lip mouse of the present invention comprises: a main body (110, 120) formed such that the vertical length thereof is longer than the horizontal width thereof; a mouthpiece (130) positioned above the front surface of the main body and protruding to the front surface of the main body; a link member (180) connected to the lower side of the main body to vertically and horizontally move the position of the main body; an LED positioned on a side of the main body; and a speaker provided in the main body. Accordingly, a user can overcome the physical problem of the user and freely use a computer by feeding back a motion performed or controlled through a mouse while using the breathing motion of the user to click or move the cursor of the computer.

Description

Lip mouse control device and its control method {MOUSE CONTROL APPARATUS AND METHOD FOR THE SAME}

The present invention relates to a device related to a mouse and a method for controlling the same, which enables a cursor to be moved or executed on a monitor, like manipulating a computer mouse using lips.

A computer is operated using a wired/wireless mouse, and since it is very difficult to operate a computer without a mouse, most people use a mouse when using a computer.

However, if the movements of the hands or feet are not natural due to congenital or accidental physical disabilities, the mouse cannot be used. For those who cannot use a mouse due to physical disabilities, a technology has been developed to move or click the cursor using the pupils, but this detects the movements of the pupils in detail and calculates them to move the cursor. It is quite expensive and generally difficult to use, and at the same time, it cannot be used for people with disabilities who frequently move their face, so it is currently very difficult for people who cannot use a mouse with their hands or feet to use a computer mouse.

1 is a conceptual view of using the lip mouse 10 according to the existing technology. In the case of the existing lip mouse, it is located on the front of the user's face and covers the monitor screen, which is very inconvenient when viewed from the user's field of view. In particular, the conventional lip mouse has a problem of further blocking the user's field of view due to its horizontal structure.

The present invention is intended to solve the above problems, so that a computer cursor can be moved or clicked using lip and breathing motions, so that even when hands or feet cannot be moved freely, physical problems can be overcome and the computer can be used freely. is to allow

The present invention relates to a lip mouse and a method for controlling the lip mouse. The lip mouse of the present invention includes main bodies 110 and 120 having a vertical length longer than a horizontal width; a mouthpiece 130 located on the upper front of the main body and protruding from the front of the main body; A link member 180 connected to the lower part of the main body to move the position of the main body vertically and horizontally; and an LED positioned on a side surface of the main body and a speaker provided inside the main body.

In addition, the method for controlling the lip mouse according to the present invention activates the lip mouse function according to the inhalation and exhalation of the user's breath and uses the lighting of the LED and the sound of the speaker as feedback thereto, The function of the lip mouse controlled according to the exhalation and exhalation can be fed back to the user using the color of the LED, the length and length of the sound emitted from the speaker, and the number of sounds emitted. In addition, the color of the cursor on the monitor screen is changed in association with the color of the LED and the sound emitted from the speaker, so that the lip mouse operation function can be fed back to the user. In addition to using the mouse function with breathing, the cursor on the monitor screen moves according to the user's lip movement. In addition, a microphone is further provided in the main body, so that the user can use the computer and mobile device according to the user's convenience in three ways: mouse cursor click, movement, and voice. If you blow while blowing, the link member can be operated to move the main body from the front side of the user's face to the side to move it out of the user's field of view, and when a predetermined time elapses after the mouthpiece is moved out of the field of view, the link member operates. By this, the main body can be controlled to return to the front of the user's face. A distance sensor or camera is further provided on the front of the body, and when the user moves the face in the first direction on the side of the lip mouse body, the body moves from the front of the user's face to the side in the first direction by the operation of the link member. It is moved out of the user's field of view by moving in the opposite side second direction and the front first direction, and when the user approaches the body to use the lip mouse, the distance sensor detects this, and the operation of the link member Thus, the main body can be returned to the front of the user's face. A luer lock tubing connector structure is provided at the mouthpiece connection part of the lip mouse to prevent the user's saliva from passing inside. Since breathing is used, it has a structure that prevents moisture or liquid, which is vulnerable to the control unit, from passing over to the control unit, increasing durability, and responding in software in addition to these structural responses. The software response refers to calibration with simple missions and error detection by measuring respiratory volume.

The software of the lip mouse is software for other usage patterns, such as cursor speed, commonly used functions, mouse cursor movement direction setting, and sensor direction setting according to the use position of the product, depending on the context of use such as document work and Internet search. Save personalized features and select and use them according to the situation.

In addition, when the lip mouse is used by attaching it to the electric wheelchair, it is linked to the electric wheelchair controller to enable the movement of the electric wheelchair by the movement of the mouthpiece and the use of the electric wheelchair function by breathing.

Through the above configuration, the present invention allows the user to overcome his or her physical problems by allowing the user to move or click the cursor of the computer by utilizing the user's breathing motion and to provide feedback on the motion being controlled or performed through the mouse. You will be able to use your computer freely.

1 is a conceptual diagram of using a lip mouse according to an existing technology;
2 is a conceptual view of using a lip mouse according to the present invention;
Figure 3 is a front view and a side view of the lip mouse according to the present invention,
Figure 4 is an exploded perspective view of the lip mouse according to the present invention,
5 to 9 are conceptual views of controlling the movement of the lip mouse according to the present invention in directions such as left and right or back and forth.
10 is a configuration diagram of a lip mouse.
11 is a calibration flowchart.
12 is a personalized use setting menu.
13 is a flow chart of a lip mouse control method.
14 is a link member operation flow chart.
15 is an error detection flowchart.
16 is a calibration flowchart including missions.
17 is a directional cursor movement support function.
18 is a sensor direction setting function according to the use position of the product.

Objects, specific advantages and novel features of the present invention will become more apparent from the following detailed description and preferred embodiments taken in conjunction with the accompanying drawings. In addition, the terms used are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of the user operator. Therefore, definitions of these terms should be made based on the content throughout the present specification.

Figure 2 is a conceptual view of the use of the lip mouse according to the present invention, Figure 3 is a front view and side view of the lip mouse according to the present invention, Figure 4 is an exploded perspective view of the lip mouse according to the present invention, Figures 5 to 10 is the present invention It is a conceptual view of controlling the movement of the lip mouse according to the invention in the left and right or forward and backward directions.

Referring to Figures 2 to 4, the lip mouse 100 according to the present invention, the main body (110, 120) formed longer than the width in the vertical direction than the length in the vertical direction; a mouthpiece 130 located on the upper front of the main body and protruding from the front of the main body; A link member 180 connected to the lower part of the main body to move the position of the main body vertically and horizontally; and an LED positioned on a side surface of the main body and a speaker (not shown) provided inside the main body. In addition, the present invention includes a luer lock tubing connector (T) that prevents the user's needle from passing inside when using the mouthpiece while biting. Reference numerals 140 and 150 shown in FIG. 4 are members that sense the direction of the user's breathing as the user inhales or exhales with the mouthpiece held in his/her mouth, and thus activates the function of the mouse.

And, as shown in Figs. 3 and 4, the lip mouse 100 of the present invention forms a schematic oval formed long in the vertical direction. This is to solve the problem of covering the monitor in front of the user while maintaining the height of the mouthpiece in contact with the user and securing a space for arranging internal parts. Comparing FIG. 1, which is the prior art, and FIG. 2, which is the present invention, the blue dots indicate the field of view during computer operation, and the red color indicates the lip mouse. In the conventional horizontal structure shown in FIG. 1, the lip mouse (10 ) is located, but when the lip mouse 100 is improved in a vertical structure as in the present invention, it can be seen that the area of the lip mouse located within the user's field of view is minimized.

As in the present invention, the structure in which the body of the lip mouse is formed vertically is convenient to operate due to a small space occupancy when the user sits close to the monitor, and the lip mouse can be used even if it is not located in front of the user's lips, and at this time it is connected to the mouthpiece. The advantage is that the position of the housing can be adjusted so that it does not obstruct the view.

In addition, the present invention improves the user's convenience by controlling the lip mouse having the above structure. Specifically, the user performs an operation similar to that of controlling the mouse while holding the mouthpiece 130 and breathing. . As shown in FIG. 11 , functions such as moving a mouse cursor using lips, using a mouse function using breathing, and typing through a voice recognition function can be performed using a lip mouse. Through the mouthpiece 130, the user's breath is transmitted to the pressure sensor, and the user's voice is collected and transmitted to the microphone. Since the mouthpiece of the lip mouse is located in front of the user's mouth, it is easy to move the lips, breathe, and transmit voice. Determine the appropriate size and shape according to the user's lip movement intensity, breathing volume, and pronunciation intensity.

The function of the lip mouse is activated using inhalation and exhalation of breath, and it is necessary to give feedback on the operation to the user. That is, the operation is performed by the expiration and intake of respiration, but the user using the lighting of the LED and the sound of the speaker can grasp whether or not the operation is performed. In addition, the function of the operating lip mouse can be fed back to the user by using various operations such as the color of the LED, the length and length of the sound emitted from the speaker, and the number of sounds emitted, and FIG. 14 shows one of them. This is an exemplary operation method. As an example, in the uppermost part of the table, when the lip mouse is exhaled for 1 second, the function of clicking the left side of a normal mouse is performed, the LED color blinks green, and the sound sounds 1 time. it will beep briefly. In this way, various feedback functions are provided to increase usability.

In addition, the color of the cursor on the monitor screen is changed in association with the color of the LED and the sound emitted from the speaker, so that the lip mouse operation function can be fed back to the user.

A specific combination of breathing and using the mouse with the lips makes it easier to mount the lip mouse on a wheelchair and perform other activities such as moving and eating. Only when the lip mouse is needed, the user can independently bring the lip mouse in front of the face and use it (Move the mouse to the side of the face with a specific lip movement, and then return the mouse to the front of the face after a preset time).

As shown in FIG. 14, when breathing is blown into the mouthpiece for a predetermined time, the link member is operated to move the main body from the front to the side of the user's face to move it out of the user's field of view, and the mouthpiece is moved out of the field of view. After a predetermined time has elapsed, the main body can be controlled to return to the front of the user's face by the operation of the link member. In addition, the moving operation of the lip mouse can be manually pushed or brought by the user. , In the present invention, since it is for users who have difficulty using their hands and feet, 1) If you breathe for 7 seconds, the holder moves out of the field of view and then returns to its original position after a certain period of time set by an app or software, or 2) Using the distance sensor, when the user moves the face to the side of the lip mouse, the holder moves out of the field of view in the opposite direction, then the distance sensor detects that the user sticks out his or her head to use the lip mouse and returns to the original position. method, etc. was used.

5 to 9 are conceptual views of controlling the movement of the lip mouse according to the present invention in left and right or forward and backward directions. In the case of the prior art, since the lip mouse is always located in front of the user's face, it interferes with the user's other activities in daily life, causing inconvenience in other daily life. The present invention is to move the lip mouse according to the user's setting to solve this problem. For example, a distance sensor or a camera (not shown) provided on the front of the main body is provided, and when the user moves his/her face in a first direction on the side surface of the lip mouse main body, the control unit operates the link member 180 to The main body moves from the front of the user's face to the second direction opposite to the first side direction, and as a result, the lip mouse moves out of the user's field of view.

In addition, when the user intends to use the lip mouse, when the user approaches the body of the lip mouse, the distance sensor or camera detects this and returns the body to the front of the user's face by the operation of the link member. can In addition, the mouthpiece connection part of the lip mouse of the present invention is provided with a luer lock tubing connector structure to prevent the user's saliva from passing inside. Since the luer lock connector structure itself is a structure commonly used in other fields, a detailed description thereof will be omitted. FIG. 11 is a luer used to make a leak-free connection between parts by combining with a medical injection needle to reduce the occurrence of errors due to use. A structural method of preventing a user's needle from passing to a control unit using a lock tubing connector as well as a software response will be described. The software response refers to calibration with simple missions and error detection by measuring respiratory volume.

For example, when the rate of trying the same function using respiratory volume multiple times (error occurrence rate) increases by a certain amount, the user is notified that confirmation or replacement is required. If the occurrence of errors due to use increases, it is recommended to re-calibrate the software, and if the accuracy of the calibration decreases, it informs that the control unit needs to be checked or replaced (see FIG. 15). To search the accuracy of calibration, a method of evaluating performance by giving a mission like a simple game is used (see FIG. 16).

12 shows functions available in the software for different usage patterns, such as cursor speed, commonly used functions, mouse cursor moving direction setting, and sensor direction setting according to the usage position of the product, depending on the usage context such as document work and internet search. show The user stores the personalized function of FIG. 12 and selects it according to the situation. An example of a function setting that is mainly used is matching a mouse function corresponding to breathing, such as setting one time of breathing and exhalation with a left click of the mouse cursor.

An example of using the setting of the mouse cursor movement direction is to move the mouse cursor only in the direction in which the user's movement function is possible when the user's lip and head movement function does not come out to the left and only the right side is possible. That is, when the mouse cursor moves out of the right side of the screen area, the mouse cursor appears on the left side of the screen (see FIG. 17). An example of setting the direction of the sensor according to the usage position of the product is to set the sensor to move the cursor in the left/right/up/down direction, which is the default setting when the product is tilted horizontally, and move the cursor in the up/down/left/right direction. It can be set as a sensor for moving (see FIG. 18).

In addition, when the lip mouse is used by attaching it to the electric wheelchair, it is linked to the electric wheelchair controller to enable the movement of the electric wheelchair by the movement of the mouthpiece and the use of the electric wheelchair function by breathing. This is to link the controller into one for the convenience of users who use the electric wheelchair with a mobile device. When the user uses the residual function on the neck to use a power wheelchair or mobile device, it reduces the inconvenience of having multiple controllers located in front and behind the user's face, and learns only one controller to use various functions. do.

Although the preferred embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also made according to the present invention. falls within the scope of the rights of

Claims (12)

Main bodies 110 and 120 having a vertical length longer than a horizontal width; a mouthpiece 130 located on the upper front of the main body and protruding from the front of the main body; A method for controlling a lip mouse comprising a; link member 180 connected to the lower part of the main body to move the position of the main body up, down, left and right,
Further comprising an LED positioned on the side of the main body and a speaker provided inside the main body,
A method for controlling the lip mouse, characterized in that providing feedback on the activation of the lip mouse function according to the inhalation and expiration of the user's breath by using the lighting of the LED and the sound of the speaker. According to claim 1,
Lip mouse, characterized in that the function of the lip mouse controlled according to the inhalation and exhalation of the user's breath is fed back to the user using the color of the LED, the length and shortness of the sound emitted from the speaker, and the number of sounds emitted control method. According to claim 2,
The lip mouse control method characterized in that by changing the color of the cursor on the monitor screen in conjunction with the color of the LED and the sound emitted from the speaker to feed back the operation function of the lip mouse to the user. According to claim 1,
When breathing is blown into the mouthpiece for a predetermined time, the link member is operated to move the main body from the front of the user's face to the side to move it out of the user's field of view. According to claim 4,
When a predetermined time elapses after the mouthpiece is moved out of the field of view, the lip mouse control method characterized in that the body returns to the front of the user's face by the operation of the link member. According to claim 1,
A distance sensor or a camera is further provided on the front of the main body,
When the user moves the face in the first direction on the side of the lip mouse body, by the operation of the link member, the body moves from the front of the user's face to the second direction on the side opposite to the first side direction to move out of the user's field of view Lip mouse control method, characterized in that. According to claim 6,
The method of controlling the lip mouse, characterized in that when the user approaches the body to use the lip mouse, the distance sensor detects this and returns the body to the front of the user's face by the operation of the link member. According to claim 7,
When the function using the respiratory volume of the mouthpiece needs to be attempted more than a predetermined number of times, it is guided that the calibration function needs to be performed,
The calibration function is a lip mouse control method, characterized in that the method of evaluating the performance by giving a specific mission. According to claim 1,
Characterized in that when performing document work or internet search using the lip mouse, a personalized function for performing a specific operation in response to the speed of the cursor or the usage pattern of the mouse cursor moving direction is stored and used. Mouse control method. According to claim 1,
When the lip mouse is used by attaching it to the electric wheelchair, the lip mouse control method characterized in that the electric wheelchair function can be used by breathing and moving the mouthpiece in conjunction with the controller of the electric wheelchair. According to claim 1,
The lip mouse control method, characterized in that the mouthpiece connection portion of the lip mouse is provided with a luer lock tubing connector structure to prevent the user's saliva from passing inside. A lip mouse control device incorporating the control method according to any one of claims 1 to 11.

Images