TWI483150B - Method for simulating mouse and touch controls and electronic device - Google Patents

Description

Analog mouse and touch function control method and electronic device

The present invention is primarily directed to a method of using a keyboard to simulate a mouse and touch function.

Existing human interface devices, such as keyboards, mice, and touch screens, provide a user with a signal to operate the computer system. However, when the user uses the above device, it is necessary to exchange the keyboard and the mouse from time to time, which may cause inconvenience in use. When using a large touch screen, the user needs to lift the hand for a long time to touch the screen, which is easy to cause pain to the user's hand muscles, and thus is likely to cause trouble for the user. Therefore, a method is needed to solve the above problem.

The present invention provides a method for controlling a mouse and a touch function, comprising: displaying a plurality of ruled lines on a screen for displaying a plurality of links and a plurality of options to divide the screen into a plurality of squares having a first predetermined number , wherein the link and the option are located at different positions on the screen; the plurality of marked points are displayed on the screen, wherein the marked points are divided into a plurality of first marked points having a first predetermined number and a plural second indicating having a second predetermined number Point, the first marked point is respectively located in the square, and the second marked point is on the grid line; the name of the plurality of keys having the first predetermined number on a keyboard is respectively marked into the corresponding square; and when the button is pressed When at least one of the buttons is pressed, one of the screens is determined according to the square corresponding to the pressed button. Move the location and perform a link or option on the launch location.

The present invention provides an electronic device comprising: a keyboard; a display for displaying a plurality of ruled lines on a screen for displaying a plurality of links and a plurality of options, wherein the grid lines divide the screen into a first predetermined a plurality of squares of numbers, links and options are located at different positions on the screen; a plurality of marked points are displayed on the screen, wherein the marked points are divided into a plurality of first marked points having a first predetermined number and having a second predetermined number a plurality of second marked points, wherein the first marked points are respectively located within the square, and the second marked points are located on the above-mentioned grid lines, wherein the corresponding squares are respectively marked with the names of the plurality of keys having the first predetermined number on the keyboard And a processing unit, when at least one of the buttons is pressed, determines a starting position on the screen according to the square corresponding to the pressed button, and executes a link or option at the starting position.

In order to make the invention, the method, the objects and the advantages of the present invention more obvious, the following detailed description of the preferred embodiments and the accompanying drawings. The scope of the invention is defined by the scope of the appended claims.

Figure 1 is a schematic illustration of an electronic device in accordance with an embodiment of the present invention. As shown in FIG. 1, the electronic device 100 includes a processing unit 102, a storage unit 104, a keyboard 106, and a display 108. For example, the electronic device 100 can be a desktop computer, a notebook computer, or an ultra mobile personal computer (UMPC). For example, the processing unit 102 can include a single central processing unit (central-processing unit, The CPU) is a plurality of parallel processing units associated with a parallel processing environment for executing operating systems, modules, and applications. The storage unit 104 includes a read only memory (ROM), a flash ROM, a random access memory (RAM), an erasable programmable read only memory, and an electronic Programmable read-only memory, scratchpad, hard disk, and/or computer readable storage medium in any other type known in the art to be used to store programs executable by processing unit 102 Module. Generally, a program module includes a routine, a program, an object, a component, or a web service. The display 108 may include a display device such as a liquid crystal display screen, a touch screen, an electro-optical display, or an organic light-emitting diode display. In the embodiment, the keyboard 106 is a qwerty keyboard, but is not limited thereto.

2 is a flow chart of a control method 200 for simulating a mouse and touch function according to an embodiment of the present invention. When a first function key on the keyboard 106 is pressed, a control signal for starting the screen keyboard mapping function is generated. After receiving the control signal, the processing unit 102 reads an application in the storage unit 104 to A control method 200 for simulating a mouse and touch function is performed. In step S202, after performing the control method 200 for simulating the mouse and the touch function, a complex ruled line as shown in FIG. 3 is displayed on the screen of the display (L1 indicating the horizontal ruled line and L2 indicating the vertical ruled line). ) and plural points (such as P1, P2, etc.). As shown in Fig. 3, the ruled lines (L1 and L2) form a complex square (S1) having a first predetermined number to divide the screen, and the marked points are divided into a plurality of first marked points having the first predetermined number (P1). ) And a second predetermined number (P2) having a second predetermined number, each of the first marked points being located in each of the above squares (ie, only one first marked point in each square, so a first indication The points can only correspond to one square, and each second marked point is respectively located on the grid between the square and the square. In an embodiment, each first marked point is located in each of the above squares. central. For example, after the processing unit 102 performs the screen keyboard mapping function, the processing unit 102 displays a plurality of ruled lines and a plurality of marked points on the screen of the display 108.

In step S204, the name corresponding to each button on the keyboard is marked in each square, and each of the first marked points P1 corresponds to a position on the screen (for example, in each square). For example, processing unit 102 labels each first marker point P1 with a name that corresponds to each button on keyboard 106. In this embodiment, as shown in FIG. 3, the first marked point P1 in the center of the first column of cells corresponds to the first column of buttons F1, F2, F3, ..., F10 on the keyboard 106, and the second The first marked point P1 in the center of the column square corresponds to the second column button 1, 2, 3, ..., 0 on the keyboard 106, and the first marked point P1 in the center of the third column square corresponds to the keyboard 106. The third column button Q, W, E, ..., P, the first marker point P1 in the center of the fourth column grid corresponds to the fourth column button A, S, D, ... on the keyboard 106. The symbol ";", the first marked point P1 in the center of the fifth column square corresponds to the fifth column button Z, X, C, ..., the symbol "/, on the keyboard 106. Pressing the above columns The button determines a starting position corresponding to the button M in the screen square, and executes an option or a link corresponding to the starting position, that is, the same as the first marked point P1 in the square corresponding to the button. Press the left button of the mouse or touch the position directly on the touch screen. For example, when the above button When at least one of the buttons is pressed, the processing unit determines a start position on the screen based on the square corresponding to the pressed button, and executes a link or option at the start position. As shown in Figure 3, pressing the "M" in the fifth column of the button is equivalent to moving the mouse to the "Windows Live Hotmail/Messenger" link and pressing the left button. In other words, press the button "M" to click the link "Windows Live Hotmail/Messenger".

In another embodiment, when there is only one link or option in the square but the first marked point P1 in the center of the square does not correspond to the link or option, pressing the button corresponding to the square selects the link or option. . For example, as shown in FIG. 3, when the fifth column button "Z" is pressed, the downloaded PDF file displayed at the lower end of the Z grid is selected. When the link or option to be selected is on the grid line, the two buttons can be pressed simultaneously to select the link or option to be selected. For example, when the number of pressed buttons is two, the processing unit 102 is located at the boundary of the square corresponding to the pressed button and is located between the first marked point of the corresponding square. The second marked point serves as the starting position and performs a link or option located below the second marked point. As shown in Fig. 3, when the first column buttons "F3" and "F4" are simultaneously pressed (that is, the second marker point (P2) on the grid line between the pressed square F3 and the square F4 is equivalent to Move the mouse to the "Do not need" option and press the left button. In other words, press the first column buttons "F3" and "F4" at the same time to select the option "No" between the square F3 and the square F4. The processing unit 102, when the number of pressed buttons is two, uses one of the two marked points at the boundary of the two squares corresponding to the pressed button as the starting position, and executes the second position. Mark the link or option below the point. As shown in Figure 4. As shown, when the buttons "3" and "W" are simultaneously pressed (that is, equivalent to pressing the second marked point (P2) on the line between the two squares corresponding to the buttons "3" and "W", the point can be Select the picture in the middle of the two squares.

When there are too many links or options in a square and you cannot specify any specific link or option in the selected square, you can press a second function key and the corresponding square button to enlarge the square and re-pair The enlarged squares are marked with complex grid lines and complex numbers, as shown in Figure 5. In this embodiment the second function key is the "shif" key. In the enlarged square, for example, pressing the button Y can click the icon of "Gmail", and pressing the button H can click the icon of "Windows Live Hotmail/Messenger". If the link or option in the single square after enlargement is still too much and it is still impossible to specify any particular link or option in the selected square, the square can continue to be enlarged, and the number of times of enlargement is not limited in the present invention. In another embodiment, when the function of the right mouse button is to be executed on the option or link in the square, a third function key and a button corresponding to the square may be pressed to perform the function of the right mouse button. In another embodiment, when the file or file on the desktop is to be dragged on the desktop, the button corresponding to the file or file box may be pressed for a long time and the direction keys on the keyboard 106 (ie, up, down, left and left) may be pressed. Right) to drag files or files.

In step S206, when an input signal from the keyboard is received, that is, an input signal of at least one button, a plurality of buttons, or a combination of a button and a function button is received, it is determined whether the input signal is an input signal for performing an amplification function (ie, A button corresponding to the square plus a second function key). For example, the processing unit 102 receives an input signal from the keyboard 106, and determines whether the input signal is an input signal for performing an amplification function (ie, determining whether to press Press any button corresponding to the square and the second function key). If the input signal is the input signal for performing the amplification function, the process proceeds to step S208. If the input signal of the input signal is not the amplification function, the process proceeds to step S210.

In step S208, as shown in FIG. 5, the square of the corresponding button is enlarged and the enlarged square is marked with a plurality of ruled lines and a plurality of marked points, wherein the above-mentioned ruled lines form a plurality of sub-squares, in the above-mentioned marked points The third marker point P3 (corresponding to the first marker point) is included, and the third marker point is located in the child square (ie, only one third marker point P3 in each child square, so one The three marker points P3 can only correspond to a sub-square, and the names of the plurality of persons on the keyboard 106 located near the pressed button are respectively indicated in the corresponding sub-squares. For example, the processing unit 102 receives an input signal of the button N and the second function key (ie, an input signal for performing an amplification function), and the processing unit 102 enlarges the square of the corresponding button N and re-marks the enlarged square with a plurality of squares. The grid lines and the complex numbers indicate points, wherein the above grid lines form a plurality of sub-squares. The processing unit 102 assigns the names of the plurality of persons located on the keyboard 106 near the pressed button to the corresponding sub-squares, respectively, and then returns to step S206.

In step S210, the above-mentioned ruled line and the above-mentioned marked point are removed, and the link, option or function corresponding to the pressed button is executed. For example, as shown in FIG. 3, when the button "M" is pressed, the processing unit 102 receives the input signal of the corresponding button M, and then the processing unit 102 executes the link or option corresponding to the button M (ie, the link "Windows Live Hotmail/Messenger"); when the buttons "F3" and "F4" are pressed, the processing unit 102 receives the input signals of the corresponding buttons "F3" and "F4", and then the processing unit 102 executes the button M. Link or option to (ie the link "not required"). For example, when a button and a third function button are pressed, the processing unit 102 receives an input signal corresponding to the button and the third function button, and then the processing unit 102 performs a corresponding function, such as implementing a right button of the mouse. Function or drag function (described above).

Figure 6 is a flow chart showing a method 600 for controlling a mouse and touch function in accordance with an embodiment of the present invention. When a first function key on the keyboard 106 is pressed, a control signal for starting the screen keyboard mapping function is generated, and after receiving the first control signal, the processing unit 102 reads an application in the storage unit 104. A method 600 for simulating the control of the mouse and the touch function. In step S602, after the control method 600 for simulating the mouse and touch function is executed, a complex ruled line (L1 indicating the horizontal ruled line and L2 indicating the vertical ruled line) and a plurality of marked points are displayed on the screen of the display 108 ( For example, P1, P2, etc., wherein the above-mentioned ruled lines (L1 and L2) form a complex square (S1) having a first predetermined number to divide the screen, and the marked points are divided into a plurality of first marked points having a first predetermined number ( P1) and a second predetermined point (P2) having a second predetermined number, each first marked point P1 is located in the center of each square and each second marked point P2 is in the square and square Between the grid lines. In step S604, the system (processing unit) of the electronic device automatically detects the position of the option that the mouse can now click on the screen.

In step S606, it is determined whether there is only one mouse clickable option in each square. If there is only one mouse clickable option in one of the squares, the process proceeds to step S608. If there is only one mouse clickable option in the cell, proceed to step S610. The above determination operation is performed by the processing unit 102. In step S608, when there is only one mouse clickable option in the square, the first marked point P1 in the square is moved to the square. Above the option. For example, when there is only one mouse clickable option in the square, the processing unit 102 moves the first marked point in the square above the option. In step S610, when there is only one mouse clickable option in the one cell, the first marked point P1 is still displayed in the center of the square. For example, when there are more than two links or options in a cell or no links and options, the processing unit 102 still displays the first marker point P1 in the center of the cell. In step S612, a name corresponding to each button on the keyboard is marked in each square, and each first marked point P1 corresponds to a position on the screen. The next step S614 may correspond to step S206 of FIG. 2, step S616 may correspond to step S208 of FIG. 2, and step S618 may correspond to step S210 of FIG.

The screen keyboard mapping method provided by the invention enables the user to more efficiently select the links or objects on the screen when using the computer system device. The user can directly select the link or object on the screen through the keyboard keyboard mapping method without moving the hand to control the mouse, thereby saving the trouble of switching between the keyboard and the mouse. In the touch screen application, it is possible to avoid having to lift the hand and touch the screen all the time, so that the muscles of the user's hands are not pained by lifting for a long time, and can be highlighted on the large-sized touch screen. The benefits of the screen keyboard mapping method of the present invention. The invention can greatly increase the efficiency of the user selecting the objects on the screen for the user who is already familiar with the position of the keyboard keys.

The above paragraphs are described in various levels. Obviously, the teachings herein can be implemented in a variety of ways, and any particular architecture or function disclosed in the examples is merely representative. In light of the teachings herein, anyone skilled in the art should understand that the various aspects disclosed herein can be implemented independently or in two or more. The level can be combined and implemented. By way of example, a certain device or a method may be implemented or implemented in a manner that is in any number of ways as referred to in the foregoing. In addition, implementation of a device or implementation of a method may be added to or different from one or more of the layers discussed above in any other architecture, or functionality, or architecture and functionality.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

102‧‧‧Processing unit

104‧‧‧ storage unit

106‧‧‧ keyboard

108‧‧‧ display

P1‧‧‧ first marked point

P2‧‧‧ second marked point

P3‧‧‧ Third Marking Point

L1, L2‧‧ ‧ grid

S1‧‧‧ square

1 is an electronic device according to an embodiment of the present invention; FIG. 2 is a flow chart for simulating a mouse and a touch function by a screen keyboard mapping method according to an embodiment of the present invention; A screen diagram according to a screen keyboard mapping method according to an embodiment of the present invention; FIG. 4 is a screen diagram according to a screen keyboard mapping method according to another embodiment of the present invention; FIG. 5 is a diagram according to another aspect of the present invention. A schematic diagram of a screen according to a screen keyboard mapping method of an embodiment; and FIG. 6 is a flow chart of a method for simulating a mouse and a touch function by a method of screen keyboard mapping according to another embodiment of the present invention.

Claims (18)

A method for controlling a mouse and a touch function includes: displaying a plurality of ruled lines on a screen for displaying a plurality of links and a plurality of options to divide the screen into a plurality of squares having a first predetermined number, wherein The link and the option are located at different positions of the screen; displaying a plurality of marked points on the screen, wherein the marked points are divided into a plurality of first marked points having the first predetermined number and having a second predetermined number a plurality of second marked points, wherein the first marked points are respectively located in the square, and the second marked points are located on the grid; and the names of the plurality of keys having the first predetermined number on the keyboard are respectively indicated to Corresponding to the above-mentioned square; and when at least one of the above-mentioned buttons is pressed, determining a starting position on the screen according to the square corresponding to the pressed button, and executing the above-mentioned starting position Link or the above option; when the number of the above pressed keys is two, the middle of the second marked point is at the pressed button The junction box of the above-described one of those as the start position, and executes the above options, or the connection is located below the point of the second indicator. The method for controlling the analog mouse and the touch function according to the first aspect of the patent application, further comprising: before the name of the button having the first predetermined number on the keyboard is respectively marked into the corresponding square. Determine if each of the above squares has only one link or one option. The method for controlling the analog mouse and the touch function as described in claim 2 of the patent application, further includes when at least one of the first squares in the square is only When a link or an option is selected, the first marked point corresponding to the first square is moved to the above link of the first square or above the above option. The method for controlling the analog mouse and the touch function described in claim 1 further includes: determining whether the pressed button is pressed simultaneously with a first function button; when the button is pressed When the first function key is pressed at the same time, the square corresponding to the pressed key is enlarged, and the enlarged square is divided into N sub-squares, where N is a positive integer, in the above-mentioned sub-square Displaying N third marked points respectively, and respectively marking the names of the Ns on the keyboard near the pressed keys to the corresponding sub-squares; and when at least one of the N keys When pressed, the start position is determined according to the square corresponding to the pressed button among the N buttons, and the connection or the option at the start position is executed, wherein N is smaller than the first predetermined number. The method for controlling the analog mouse and the touch function according to the first aspect of the patent application, further comprising: when the number of the pressed buttons is one, corresponding to the foregoing in the square of the pressed button A marked point is used as the starting position, and the above link or the above option located below the first marked point is executed. The method for controlling the analog mouse and the touch function as described in claim 1 further includes, when the number of the pressed buttons is two, in the above-mentioned square corresponding to the pressed button. The second marked point at the junction between the first marked points of the corresponding squares As the above-mentioned activation position, the above-mentioned connection or the above-mentioned option located below the second indication point is executed. For example, the method for controlling the analog mouse and the touch function described in claim 1 further includes determining whether the pressed button is pressed simultaneously with a second function button. The method for controlling the analog mouse and the touch function as described in claim 7 further includes: when the pressed button and the second function button are simultaneously pressed, corresponding to the pressed button The first marked point in the square is used as the starting position, and the right button function of the mouse is executed on the link or the option located below the first marked point. The method for controlling the analog mouse and the touch function as described in claim 7 further includes: when the pressed button and the second function button are simultaneously pressed, corresponding to the pressed button The first marked point in the square is used as the starting position, and the drag function is performed on the option located below the first marked point. An electronic device comprising: a keyboard; a display for displaying a plurality of grid lines on a screen of the display for displaying a plurality of links and a plurality of options, wherein the grid lines divide the screen into a first predetermined a plurality of squares of numbers, the links and the options are located at different positions of the screen; and displaying a plurality of marked points on the screen, wherein the marked points are divided into a plurality of first marking points having the first predetermined number and Having a second predetermined number of second plurality of marked points, the first marked points are respectively located on Within the square, and the second marking point is on the grid line, wherein the corresponding squares are respectively marked with the names of the plurality of keys having the first predetermined number on the keyboard; and a processing unit, when When at least one of the buttons is pressed, determining a starting position on the screen according to the square corresponding to the pressed button, and executing the above connection or the above option at the starting position, when pressed When the number of the above-mentioned buttons is two, one of the above-mentioned second marked points at the boundary of the square corresponding to the pressed button is used as the starting position, and is executed below the second marked point. The above link or the above options. The electronic device of claim 10, wherein the processing unit determines each of the squares before the names of the plurality of keys having the first predetermined number on the keyboard are respectively indicated in the corresponding squares. Whether one has only one link or one option. The electronic device of claim 11, wherein the processing unit corresponds to the first indication of the first square when at least one of the first squares of the square has only one connection or one option. The point moves to the above link of the first square above or above the above option. The electronic device of claim 10, wherein the processing unit is configured to: determine whether the pressed button is pressed simultaneously with a first function key; and when the pressed button is pressed with the first When the function key is pressed at the same time, the above-mentioned square corresponding to the pressed button is enlarged, and the enlarged square is divided into N sub-squares, where N is a positive integer and will be The names of the Ns on the keyboard located near the pressed keys are respectively indicated in the corresponding sub-squares, wherein the display displays N third marked points in the sub-squares respectively; and when the N When at least one of the buttons is pressed, the activation position is determined according to a square corresponding to the pressed button of the N buttons, and the connection or the option at the activation position is executed, wherein N is smaller than the above An established quantity. The electronic device of claim 10, wherein the processing unit is configured to use the first marked point in the square corresponding to the pressed button when the number of the pressed buttons is one Start the position and execute the above link or the above option located below the first marked point above. The electronic device of claim 10, wherein the processing unit is located at a boundary of the square corresponding to the pressed button when the number of the pressed buttons is two The second marked point between the first marked points of the corresponding squares is used as the starting position, and the connection or the option located below the second marked point is executed. The electronic device of claim 10, wherein the processing unit determines whether the pressed button is pressed simultaneously with a second function button. The electronic device of claim 16, wherein the processing unit is pressed in the square corresponding to the pressed button when the pressed button and the second function button are simultaneously pressed Above first The marked point is used as the starting position, and the right button function of the mouse is executed on the link or the option located below the first marked point. The electronic device of claim 16, wherein the processing unit is pressed in the square corresponding to the pressed button when the pressed button and the second function button are simultaneously pressed The first marked point is used as the starting position, and the drag function is performed on the option located below the first marked point.