TWI547862B - Multi - point handwriting input control system and method - Google Patents

Description

Multi-point handwriting input control system and method

The invention relates to the technical field of electronic devices, and in particular to a multi-point handwriting input control system and method.

Nowadays, more and more people use handheld electronic devices such as smart phones to connect platforms such as smart TVs or computers, and turn platforms or computers into multimedia entertainment functions. This demand also leads to "wireless" keyboards and slides. The concept of the mouse is used together, so the smart phone is used to control the platform or the computer, that is, the smart phone can easily send commands to control the platform or the computer like mouse movement, keyboard input, multimedia control and the like.

In addition, there are many technologies related to multi-touch, and users can use their own fingers to control smart phones equipped with touch panels. However, when the mobile phone is used in the above application, when the user wants to send a control command to control the platform or the computer through the smart phone, the user needs to simultaneously look at the two screens of the smart phone and the platform or the computer, resulting in operation. difficult.

In view of the above problems, the present invention aims to provide a multi-point handwriting input control system and method, and a computer program product. By means of a multi-point handwriting input control method, a user of a handheld electronic device can directly view a screen of a platform or a computer. Control the platform or computer to avoid using the handheld electronic device to simulate mouse movement or key The operation of the disk input operation is difficult.

A first aspect of the present invention provides a multi-point handwriting input control system in which a handheld electronic device simulates a mouse to transmit coordinate data or commands to an electronic device, and the handheld electronic device includes: a touch screen, Sensing a finger click or slide operation and a corresponding position of the operation thereof to generate an operation signal and a position signal; and a microprocessor receiving the touch screen to generate the operation signal and the position signals to generate the coordinate data or And a transmission interface, the microprocessor sends the coordinate data or command to the electronic device via the transmission interface; wherein the operation of the finger on the touch screen comprises a single finger pressing and pressing the touch screen and sliding freely Clicking on the touch screen, clicking on the touch screen with two fingers, long-pressing the touch screen with two fingers, swiping left and right, long-pressing the touch screen and sliding up and down, and pressing the button on the touch screen Long press or click on one of the areas.

A second aspect of the present invention provides a multi-point handwriting input control system, wherein an electronic device receives coordinate data or commands transmitted by a handheld electronic device that simulates a mouse, the electronic device comprising: a transmission interface, receiving The coordinate data or command sent by the handheld electronic device; a microprocessor, the coordinate data or command received by the transmission interface is converted into a corresponding mouse according to a control mode of an operating system of the electronic device a signal and a command; and a screen, according to the corresponding signal and command of the mouse converted by the microprocessor to display the operation behavior of the mouse.

The third aspect of the present invention provides a multi-point handwriting input control method for simulating a mouse by a handheld electronic device to transmit coordinate data or commands to an electronic device. The method includes the following steps: in the handheld electronic device The operation of sensing a finger click or slide on the touch screen and the corresponding position of the operation thereof to generate an operation signal and a position signal; and receiving, by the microprocessor of the handheld electronic device, the touch screen to generate the operation signal And the position signals to generate the coordinate data or commands, and send the coordinate data or commands to the electronic device via one of the handheld electronic devices; wherein the operation of the finger on the touch screen includes a single finger Press and hold the touch screen and slide freely, click the touch screen with one finger, click the touch screen with one finger, press the touch screen with both fingers, slide left and right, press the touch screen with both fingers Slide up and down, and press or click on one or a combination of the button areas of the touch screen.

10‧‧‧Multi-point handwriting input control system

12‧‧‧ Platform or computer

14‧‧‧Handheld electronic devices

16‧‧‧Microprocessor

18‧‧‧ screen

20‧‧‧Transport interface

22‧‧‧Microprocessor

24‧‧‧ touch screen

26‧‧‧Transport interface

28‧‧‧First button area

30‧‧‧Second button area

32‧‧‧ keyboard

1 is a block diagram of a multi-point handwriting input control system of the present invention; FIG. 2 and FIG. 3 are front views of the operation of the hand-held electronic device simulating the mouse of the present invention; FIG. 4 is a schematic diagram of the handheld electronic device analog keyboard of the present invention; FIG. 5 is a schematic diagram of a finger operation of a user on a touch screen according to the present invention; and FIG. 6 is a flowchart of a multi-point handwriting input control method according to the present invention.

The present invention will be further understood by those of ordinary skill in the art to which this invention pertains. The composition of the present invention and the effects to be achieved are described in detail.

1 is a block diagram of a multi-point handwriting input control system of the present invention. In FIG. 1, the multi-point handwriting input control system 10 includes a platform or computer 12 and a handheld electronic device 14 that are electronic devices. The platform or computer 12 includes a microprocessor 16, a screen 18, and a transmission interface 20. The handheld electronic device 14 includes a microprocessor 22, a touch screen 24, and a transmission interface 26.

2 and FIG. 3 are schematic diagrams showing the operation of the hand-held electronic device simulating the mouse according to the present invention, and FIG. 4 is a front view showing the operation of the analog keyboard of the handheld electronic device of the present invention. In FIG. 2 and FIG. 3, in the case where the handheld electronic device 14 is an analog mouse operation, the user can click or slide with the finger on the touch screen 24 of the handheld electronic device 14. In FIG. 4, in the case where the handheld electronic device 14 is an analog keyboard operation, the user can input a string using a finger on the keyboard 32 below the touch screen 24 of the handheld electronic device 14.

In FIG. 2, a first button area 28 and a second button area 30 are formed in the lower left corner of the touch screen 24, the first button area 28 simulates the function of the left button of the mouse, and the second button area 30 simulates the mouse. The function of the right button allows the left thumb to press the first button region 28 or the second button region 30 when the handheld electronic device 14 is held by the left hand. In addition, in the embodiment of the present invention, in order to facilitate the use of the right-handed user, the right-handed user has a higher probability of pressing the left mouse button than the right mouse button. Therefore, the first button area 28 can be the second button. The area 30 is twice as large. In addition, the present invention also provides a setting function (not shown in the figure), and the user can set the area of the first button area 28 and the second button area 30 and the first button area 28 and the second via the setting function. The button area 30 is located at the position of the touch screen 24.

Therefore, in another embodiment of the present invention, as shown in FIG. 3, in touch The lower right corner of the control screen 24 forms a first button area 28 and a second button area 30. The first button area 28 simulates the function of the left button of the mouse, and the second button area 30 simulates the function of the right button of the mouse to facilitate the right hand. The right thumb can press the first button region 28 or the second button region 30 while holding the handheld electronic device 14.

FIG. 5 is a schematic diagram of finger operation of a user on the touch screen of the present invention. In FIG. 5, in the case where the handheld electronic device 14 is used to simulate the operation of the mouse, the single finger presses the touch screen 24 and slides freely as the operation of moving the object, and the single finger clicks the touch screen 24 as if clicking The operation of the image or the window, the single-touch two-touch screen 24 is like clicking the file or executing the application operation, the two-finger long-pressing the touch screen 24 and sliding left and right is like moving the page left and right, and the two fingers are long pressed. The touch screen 24 is slid up and down as an operation of moving the page up and down, and the first button area 28 and the second button area 30 of the touch screen 24 are long pressed or clicked as the left and right buttons of the mouse.

Referring again to FIG. 1, the transmission interface 20 of the platform or computer 12 receives the coordinate data or commands transmitted by the handheld electronic device 14, and the microprocessor 16 of the platform or computer 12 transmits according to the control mode of the operating system of the platform or computer 12. The coordinate data or command or string data received by the interface 20 is converted into a corresponding mouse signal or command or a corresponding keyboard string data, and the screen 18 of the platform or computer 12 is converted according to the corresponding mouse signal of the microprocessor 16 or The command is to display the operation behavior of the corresponding mouse, or to display the string according to the string data of the corresponding keyboard converted by the microprocessor 16.

Since the platform or the computer 12 can be equipped with different operating systems, and the control modes and control commands of different operating systems are not the same, various control modes need to be pre-established in the platform or the computer 12 (for example, sliding in the Windows operating system) Mouse control signal), control commands included in each control mode, and operating system control signals corresponding to this control command.

The touch screen 24 of the handheld electronic device 14 senses the operation of the user's finger click or slide and the corresponding position of the operation to generate an operation signal and a position signal, and the finger click or slide operation is as shown in FIG. 5, and the touch is performed. The screen 24 can display a keyboard (as shown in FIG. 4) or a handwriting input area, and the user's finger inputs a string in the keyboard or handwriting input area.

The microprocessor 22 of the handheld electronic device 14 receives the touch screen 24 to generate an operation signal and a position signal to generate coordinate data or commands, or to receive the string data input on the touch screen 24. The microprocessor 22 transmits coordinate data or commands, or string data to the platform or computer 12 via the transmission interface 26 of the handheld electronic device 14.

The manner in which the handheld electronic device 14 transmits coordinate data or commands or string data to the platform or computer 12 includes a hotspot mode of the handheld electronic device 14, a wireless network, or a hotspot mode of the platform or computer 12.

6 is a flow chart of a multi-point handwriting input control method of the present invention. The components and operations of FIGS. 1 through 5 are referred to in the description of the process steps of FIG.

In FIG. 6, the handheld electronic device 14 is controlled to be connected to the platform or computer 12, and the handheld electronic device 14 first sends a connection connection control request (step S40). After receiving the connection control request, the platform or computer 12 sends a reply connection control request to the handheld electronic device 14 to wait for the handheld electronic device 14 to connect to the control platform or the computer 12 (step S42). The connection mode between the handheld electronic device 14 and the platform or the computer 12 includes a hotspot mode of the handheld electronic device 14, a wireless network, or a hotspot mode of the platform or the computer 12. After the connection is completed, the handheld electronic device 14 can be Send coordinate data or commands, or string data to the platform or computer 12.

After the handheld electronic device 14 receives the reply connection control request and determines to connect with the platform or the computer 12, the touch screen 24 senses the user's finger click or The sliding operation and the corresponding position of the operation to generate an operation signal and a position signal, the finger click or slide operation is as shown in FIG. 5, or the touch screen 24 displays the keyboard (as shown in FIG. 4) or the handwriting input area. The user's finger inputs a string in the keyboard or handwriting input area (step S44).

In FIG. 5, in the case where the handheld electronic device 14 is an operation of simulating a mouse, the single finger presses the touch screen 24 and slides freely as if the position of the object is moved on the screen 18, and the single finger clicks on the touch screen. 24, like clicking on an image or window on the screen 18, clicking on the touch screen 24 as if clicking on the screen 18 or performing an application operation, pressing the touch screen 24 with two fingers and sliding left and right As with the operation of moving the page in the screen 18 to the left or right, the two fingers pressing the touch screen 24 and sliding up and down as the operation of moving the page in the screen 18 up and down, the first button area 28 and the second button of the touch screen 24 Area 30 long press or click the same as the left and right mouse buttons.

Then, the touch screen 24 is received by the microprocessor 22 of the handheld electronic device 14 to generate an operation signal and a position signal to generate coordinate data or commands, or to receive the string data input on the touch screen 24. The microprocessor 22 transmits coordinate data or commands, or string data to the platform or computer 12 via the transmission interface 26 of the handheld electronic device 14 (step S46).

The coordinate data or command sent by the handheld electronic device 14 is received by the transmission interface 20 of the platform or computer 12, and the microprocessor 16 of the platform or computer 12 transmits the coordinates received by the transmission interface 20 according to the control mode of the operating system of the platform or computer 12. The data or command or string data is converted into a signal or command of the corresponding mouse or a string data of the corresponding keyboard (step S48).

Since the platform or computer 12 can carry different operating systems, and the control modes and control commands of different operating systems are not the same, in the platform or computer 12 It is necessary to pre-establish a variety of control modes (for example, mouse control signals in the Windows operating system), control commands included in each control mode, and operating system control signals corresponding to the control commands.

Secondly, the screen 18 of the platform or computer 12 displays the operation behavior of the corresponding mouse according to the signal or command of the corresponding mouse converted by the microprocessor 16, or displays the string according to the string data of the corresponding keyboard converted by the microprocessor 16. (Step S50). In this manner, the user of the handheld electronic device 14 can directly control the platform or the computer 12 by viewing the screen 18 of the platform or the computer 12, thereby avoiding the operational difficulty of using the handheld electronic device 14 during the operation of simulating mouse movement or keyboard input.

The invention provides a multi-point handwriting input control system and method, which has the advantages that the user of the handheld electronic device can directly control the platform or the computer by using the multi-point handwriting input control method to avoid the use of the handheld by viewing the screen of the platform or the computer. The electronic device is difficult to operate when simulating mouse movement or keyboard input operation.

The present invention has been described above with reference to the preferred embodiments and the accompanying drawings, and should not be considered as limiting. Various modifications, omissions and changes may be made without departing from the scope of the invention.

10‧‧‧Multi-point handwriting input control system

12‧‧‧ Platform or computer

14‧‧‧Handheld electronic devices

16‧‧‧Microprocessor

18‧‧‧ screen

20‧‧‧Transport interface

22‧‧‧Microprocessor

24‧‧‧ touch screen

26‧‧‧Transport interface

Claims (8)

A multi-point handwriting input control system, wherein a handheld electronic device simulates a mouse to transmit coordinate data or commands to an electronic device, the handheld electronic device includes: a touch screen, sensing a finger click or slide operation and a corresponding position of the operation to generate an operation signal and a position signal; a microprocessor receiving the touch screen to generate the operation signal and the position signals to generate the coordinate data or commands; and a transmission interface, the micro The processor sends the coordinate data or command to the electronic device via the transmission interface; wherein the operation of the finger on the touch screen includes long-pressing the touch screen and sliding freely, and clicking the touch screen with a single finger Clicking on the touch screen twice, long-pressing the touch screen and sliding left and right, long-pressing the touch screen and sliding up and down, and long-pressing or clicking on the button area of the touch screen Or a combination, wherein the first button area of one of the button areas of the touch screen simulates a function of a left button of the mouse, and a second button area simulates Right One function of the handheld electronic device further comprises a setting function to set the first region and the key size of the second area and the key area of the touch screen is located. The multi-point handwriting input control system of claim 1, wherein the touch screen displays a keyboard or a handwriting input area, and the microprocessor receives a string data of the keyboard or the handwriting input area input, and The string data is sent to the electronic device via the transmission interface. A multi-point handwriting input control system, wherein an electronic device receives a coordinate data or command sent by a handheld electronic device that simulates a mouse, the electronic device includes: a transmission interface, and receiving the transmission by the handheld electronic device Coordinate data or life a microprocessor, the coordinate data or command received by the transmission interface is converted into a signal and a command corresponding to the mouse according to a control mode of an operating system of the electronic device; and a screen according to the micro processing The device converts the signal and command corresponding to the mouse to display the corresponding mouse operating behavior. The multi-point handwriting input control system of claim 3, wherein the microprocessor receives the string data sent by the handheld electronic device via the transmission interface, and displays the microprocessor receiving the data on the screen. The string of the string data. A multi-point handwriting input control method, the method comprising the steps of: sensing a finger click or slide operation on a touch screen of a handheld electronic device and a corresponding position of the operation thereof to generate an operation signal and a position signal; Receiving, by the microprocessor of the handheld electronic device, the touch screen generates the operation signal and the position signals to generate the coordinate data or commands, and transmitting the coordinates via one of the transmission interfaces of the handheld electronic device Data or command to an electronic device; wherein the operation of the finger on the touch screen includes long-pressing the touch screen and sliding freely, clicking the touch screen with a single finger, clicking the touch screen with a single finger, and double a long press of the touch screen and sliding left and right, two fingers long pressing the touch screen and sliding up and down, and one or a combination of long press or click on the button area of the touch screen, wherein the touch screen Setting a first button area to simulate a function of one of the left buttons of the mouse and a function of a second button area to simulate a right button of the mouse, and setting the first Size of the area key and the second key region and a region located in the position of the touch screen. For example, the multi-point handwriting input control method of claim 5, wherein In the step of sensing the finger click or slide operation on the touch screen and the corresponding position of the operation, a keyboard or a handwriting input area is displayed on the touch screen, and the keyboard or the handwriting input area input is received by the microprocessor. One string of data, and the string data is sent to the electronic device via the transmission interface. The multi-point handwriting input control method of claim 5, further comprising the steps of: receiving, by the microprocessor of one of the electronic devices, the coordinate information sent by the handheld electronic device via a transmission interface of the electronic device or Commanding and converting the coordinate data or command according to a control mode of an operating system of the electronic device to a signal and a command corresponding to the mouse; and corresponding signals and commands of the mouse according to the microprocessor conversion The operation behavior of the mouse is displayed on one of the screens of the electronic device. The multi-point handwriting input control method of claim 7, wherein the step of receiving the coordinate data or command sent by the handheld electronic device by the transmission interface is received by the microprocessor via the transmission interface The handheld electronic device transmits a string of data and displays a string of the string data received by the microprocessor on the screen.