WO2011032381A1 - Method, system for controlling computer, and mobile terminal - Google Patents

Method, system for controlling computer, and mobile terminal Download PDF

Info

Publication number
WO2011032381A1
WO2011032381A1 PCT/CN2010/071846 CN2010071846W WO2011032381A1 WO 2011032381 A1 WO2011032381 A1 WO 2011032381A1 CN 2010071846 W CN2010071846 W CN 2010071846W WO 2011032381 A1 WO2011032381 A1 WO 2011032381A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch screen
touch
signal
display
function
Prior art date
Application number
PCT/CN2010/071846
Other languages
French (fr)
Chinese (zh)
Inventor
屈胜
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2011032381A1 publication Critical patent/WO2011032381A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers

Definitions

  • the present invention relates to the field of communications, and in particular, to the field of mobile terminal applications.
  • the technical problem to be solved by the present invention is to provide a method, system and mobile terminal for controlling a computer, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick.
  • the present invention provides a method for controlling a computer (PC), which uses a mobile terminal (UE) and a PC, and the UE loads an application supporting a touch screen to control a PC function and supports a touch screen to control a PC function.
  • the UE of the driver includes: the UE running the application to activate the touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then running the driver,
  • the digital touch signal is converted into an operation control signal that the PC can recognize and process, and sent to the PC to control the operation of the PC by a touch operation on the UE touch screen.
  • the step of converting the digital touch signal into an operation control signal that the PC can recognize and process includes: obtaining a resolution X 2 * Y 2 of the display of the PC and a width of the touch screen of the UE and a height of the touch screen;
  • the UE converts each touch position on the touch screen of the digital touch signal into a corresponding position on the PC display through the position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC.
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
  • the method further includes: establishing a physical connection channel between the UE and the PC;
  • the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC
  • the communication transmission channel of the PC is used to transmit data between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: the touch screen sensor module is configured to: send the terminal platform module to receive After the instruction of the touch screen control computer (PC) function is activated, the touch operation of the user on the touch screen is sensed to generate an analog touch signal; the touch screen controller module is configured to: the analog touch generated by the touch screen sensor module The signal is converted into a digital touch signal and sent to the terminal platform module; and the terminal platform module includes an application unit that supports the touch screen to control the PC function and a driving unit that supports the touch screen to control the PC function; the application unit is configured to: start the touch screen control The PC function and sends an indication to the touch screen sensor module to activate the touch screen control PC function, and The driving unit is configured to: convert the digital touch signal provided by the touch screen controller module into an operation control signal that can be recognized and processed by the PC, and then send the operation control signal to the PC to control the operation of the
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC as follows: acquire the resolution of the display of the PC X 2 * Y 2 , and acquire the width of the touch screen of the UE and the touch screen The height Y l converts the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by the position conversion algorithm to obtain an operation control signal that the PC can recognize and process.
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operation
  • the application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE according to a protocol corresponding to the physical connection between the UE and the PC. a communication transmission channel of the PC, the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen is automatically exited to control the PC function
  • the present invention further provides a system for controlling a computer (PC), comprising a UE and a PC as described above, wherein: the PC is configured to: perform an operation according to an operation control signal sent by the UE and display.
  • PC computer
  • the present invention also proposes another method of controlling a computer (PC) using a UE loaded with an application supporting a touch screen to control a PC function, and loaded A PC supporting a touch screen to control a PC function driver, the method comprising: the UE running the application to activate a touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then The digital touch signal is sent to the PC; the PC runs the driver, converts the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and processes and displays according to the operation control signal.
  • the step of converting the digital touch signal into the operation control signal that the PC can recognize and process comprises: obtaining the resolution X 2 * Y 2 of the display of the PC and the width of the touch screen of the UE and the height of the touch screen;
  • the PC converts each touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC.
  • the conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen;
  • X 2 is the maximum number of pixels in the abscissa direction of the display;
  • Y 2 is the ordinate direction of the display The maximum number of pixels on the top;
  • ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display;
  • y2 is the ordinate value of the corresponding position of the touch position on the display;
  • "[ ]" is the rounding operator.
  • the method further includes: establishing a physical connection channel between the UE and the PC;
  • the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC
  • the communication transmission channel of the PC is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein:
  • the touch screen sensor module is configured to: after receiving the indication that the terminal platform module activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen on the touch screen, generating an analog touch signal;
  • the touch screen controller module is set to The analog touch signal generated by the touch screen sensor module is converted into a digital touch signal and sent to the terminal platform module;
  • the terminal platform module includes an application unit that supports the touch screen to control the PC function, and the application unit is set to: start The touch screen controls the PC function, sends an indication to the touch screen sensor module to activate the touch screen control PC function, and sends the digital touch signal provided by the touch screen controller module to the PC to control the operation of the PC by touching the touch screen of the UE.
  • the application unit is further configured to: determine whether a physical connection is established between the UE and the PC, and if established, establish a communication transmission between the UE and the PC according to a protocol corresponding to a physical connection between the UE and the PC. Channel to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a computer (PC), which is configured to: cooperate with the mobile terminal (UE) to implement a touch screen control PC function, and the PC includes a driving unit that supports a touch screen to control a PC function. among them:
  • the driving unit is configured to: receive a digital touch signal sent by the UE, convert the digital touch signal into an operation control signal that can be recognized and processed by the PC, and process and display according to the operation control signal.
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution X 2 * Y 2 of the display of the PC, and acquiring the UE Touching the width X of the touch screen and the height of the touch screen, and then converting the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm to obtain an operation control signal recognizable and processed by the PC , the location conversion algorithm is as follows: Where ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top;
  • the present invention further provides a system for controlling a computer (PC), comprising a UE as described above, and a PC as described above, wherein a physical connection and a communication transmission channel are established between the UE and the PC.
  • the UE is configured to run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, convert the touch operation of the user on the touch screen to the digital touch signal, and send the digital touch signal to the
  • the PC is configured to run a driver that supports the function of the touch screen to control the PC, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process the signal according to the operation control signal. display.
  • the invention provides a method, a system and a mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.
  • FIG. 1 is a flow chart of a method for detecting a computer controlled by a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 2 is a flow chart of a data processing method for controlling a computer by a touch screen of a mobile terminal according to a first embodiment of the present invention
  • 3 is a block diagram showing the structure of a mobile terminal according to a first embodiment of the present invention
  • FIG. 4 is a block diagram showing a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 5 is a second embodiment of the present invention.
  • FIG. 6 is a flow chart showing a data processing method for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 7 is a block diagram showing a configuration of a mobile terminal according to a first embodiment of the present invention
  • FIG. 8 is a computer according to a first embodiment of the present invention
  • FIG. 9 is a block diagram of a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention.
  • a mobile terminal User Equipment , UE
  • touch screen function a mobile terminal with touch screen function
  • a physical connection is established between the UE and the PC.
  • the physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared.
  • the UE runs an application supporting the touch screen control PC function to activate the touch screen control PC function of the present invention, and then performs channel detection to ensure that the UE and the PC can communicate normally.
  • an application and a driver that support the touch screen control PC function of the present invention are all loaded to the UE side.
  • the UE runs an application that supports the touch screen to control the PC function, and after the touch screen control PC function of the present invention is started, the UE performs channel detection.
  • the specific method is as shown in FIG. 1 , including the following steps: Step S101 : The UE runs an application that supports the touch screen to control the PC function. , start the touch screen Controlling the PC function; Step S102: The UE determines whether it has successfully established a physical connection with the PC.
  • Step S103 The UE establishes its a communication transmission channel with the PC, if the communication transmission channel is successfully established, proceeding to step S104; if not, automatically exiting the function and ending;
  • the UE selects the corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol.
  • Step S104 The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, runs a driver supporting the touch screen control PC function, and converts the digital touch signal into The operation control signal that can be recognized and processed by the PC is sent to the PC to implement control of the PC by the UE. While performing step S104, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal. When the physical connection or the communication transmission channel is disconnected, the touch screen control PC function is automatically exited, and the process ends; Step S105: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
  • Step S201 After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC. Touch operations, such as clicking, swiping, etc., to generate an analog touch signal, for example, to generate a voltage or signal change; the UE senses the user's operation of the UE according to a conventional method when the touch screen control PC function is not activated. After starting the touch screen to control the PC function, the user's operation on the PC is perceived.
  • the UE may perform a touch screen control PC function interface after starting the touch screen control PC function, and the user is in the The control of the PC is realized by a touch operation on the interface.
  • Step S202 The UE converts the analog touch signal into a digital touch signal; the existing UE with the touch screen function obtains the touch position ( Xl , yi) and the touch by performing coordinate analysis and speed analysis on the digital touch signal. Control actions, such as swiping, clicking, double-clicking, etc.
  • the touch signal generated by the touch screen of the UE can be considered to control the PC operation, thereby proposing a new PC control scheme, and with the popularity of the touch screen mobile terminal and people
  • This solution has great market value for the improvement of PC portability requirements.
  • the position coordinates generated on the touch screen are in units of lengths such as meters, decimeters, centimeters, and millimeters
  • the display is displayed in units of pixels, that is, the touch position unit on the touch screen and the display.
  • the display unit is different.
  • the current PC cannot recognize the touch signal of the mobile terminal.
  • Step S203 The UE runs a driver that supports the touch screen control PC function, and communicates with the PC. Establishing a communication transmission channel to obtain a resolution ( ⁇ 2 * ⁇ 2 ) of the display of the PC, and acquiring a width and a height of the touch screen of the UE;
  • Step S204 the UE processes the digital touch signal by using a position conversion algorithm of the driver, Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
  • ⁇ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit; X 2 is the maximum number of pixels in the horizontal direction of the display; Y 2 is the maximum number of pixels in the ordinate direction of the display; ⁇ 2 is the touch
  • the absc issa value of the corresponding position of the control position on the display, which is in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is like Prime is the unit; "[ ]" is the rounding operator.
  • Step S205 The UE sends the operation control signal to the PC through the communication transmission channel established by the UE and the PC.
  • the PC when the PC is operated by the mouse, the PC performs coordinate and speed analysis by the operation control signal generated by the mouse movement, thereby obtaining the operation position and the operation action, and then performing corresponding operations and displaying according to the analysis result.
  • the touch signal is generated by the touch screen of the UE, and is converted into an operation control signal recognizable by the PC, and then the control signal of the mouse is replaced by the operation control signal generated by the mouse, enriching the PC.
  • the control scheme has no special requirements for the PC, and it is simple and convenient to implement.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module 31, a touch screen controller module 32, and a terminal platform module 33, wherein: the touch screen sensor module 31
  • UE mobile terminal
  • the touch screen sensor module 31 The method is as follows: after the terminal platform module 33 activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example, generating a Voltage or signal change.
  • PC touch screen control computer
  • the touch screen controller module 32 includes: a ⁇ / ⁇ converter 321 and a data transfer controller 322, wherein: the A/D converter 321 is configured to: acquire an analog touch signal generated by the touch screen sensor module 31, and convert the same into a digital Touch signal.
  • the data transmission controller 322 is configured to: transmit the digital touch signal to the terminal platform module 33 through a transmission interface such as a serial port.
  • the terminal platform module 33 includes: an application unit supporting a touch screen control PC function and a driving unit supporting a touch screen control PC function, wherein the application unit is configured to: activate a touch screen control PC function and send a start touch screen control to the touch screen sensor module PC function indication to And the driving unit is configured to: convert the digital touch signal provided by the touch screen controller module 32 into an operation control signal that can be recognized and processed by the PC, and then send the signal to the PC to control the operation of the PC by touching the touch screen of the UE.
  • the application unit and the drive unit can be implemented by software, hardware or firmware.
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution (X 2 * Y 2 ) of the display of the PC, and a width of the touch screen of the UE ( ⁇ 0 and height ( ), then the digital touch signal is processed by the position conversion algorithm, and the touch position on the touch screen is converted into a corresponding position on the PC display to obtain an operation control signal recognizable and processed by the PC, the position conversion algorithm as follows:
  • the application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE and the PC according to a protocol corresponding to the physical connection between the UE and the PC.
  • the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a system for controlling a computer through a touch screen of a mobile terminal, comprising a UE and a PC shown in FIG. 3, the PC comprising a control processor 41 and a display 42, wherein:
  • the UE establishes a physical connection with the PC.
  • the physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared.
  • the UE and the PC also establish a communication transmission channel, and the communication transmission channel is based on the UE
  • the type of physical connection between PCs is established using the corresponding transport protocol. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol.
  • the function of implementing the touch screen control PC in the first embodiment of the present invention is mainly implemented by the mobile terminal side, and there is no additional requirement for the PC.
  • the control processor 41 of the PC After receiving the operation control signal sent by the UE side, the control processor 41 of the PC follows the mouse. The operation control signal generated by the action is analyzed and processed in the same processing manner, and then the display 42 is controlled to be displayed, which is simple and convenient to implement.
  • an application supporting the touch screen control PC function of the present invention is loaded to the UE side, and a driver supporting the touch screen control PC function of the present invention is loaded to the PC side.
  • the second embodiment of the present invention differs from the above-described first embodiment mainly in that the processing position for converting the digital touch signal generated by the user to the touch operation of the PC into the PC-identifiable operation control signal is moved from the UE side to the PC side.
  • the channel detection flowchart is as shown in FIG.
  • Step S501 The UE runs an application that supports the touch screen to control the PC function, and starts the touch screen to control the PC function;
  • S502 The UE determines whether it has successfully established a physical connection with the PC, if the determination result is yes, then proceeds to step S503; if not, automatically exits the function, and ends;
  • step S503 the UE establishes a communication transmission channel with the PC, if If the communication transmission channel is successfully established, the process proceeds to step S504; if not, the function is automatically exited and ends;
  • the UE selects a corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then Established between the two using the Bluetooth protocol Communication transmission channel.
  • Step S504 The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, and sends the digital touch signal to the PC, and the digital touch is performed by the PC.
  • the signal is converted to an operation control signal that the PC can recognize and process, and then processed and displayed.
  • the UE side is only responsible for generating a digital touch signal according to the user's touch operation on the touch screen on the touch screen and transmitting it to the PC, and correspondingly converting the digital touch signal into a PC identifiable operation.
  • the task of the control signal is completed by the PC side; while performing step S504, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal, and if the physical connection or the communication transmission channel is disconnected, the touch screen is automatically exited. Controlling the PC function, ending; Step S505: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
  • Step S601 After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC.
  • Step S602 The UE converts the analog touch signal into a digital touch signal and transmits the same
  • the unit of position coordinates generated on the touch screen is a unit of length measurement such as meters, decimeters, centimeters, millimeters, so the width X and height Yi of the touch screen are obtained here.
  • the display is displayed in units of pixels, so the position coordinates on the display are in pixels.
  • Step S604 The PC processes the digital touch signal by using a position conversion algorithm of the driver. Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
  • ⁇ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit;
  • X 2 is the maximum number of pixels in the horizontal direction of the display;
  • Y 2 is the maximum number of pixels in the ordinate direction of the display;
  • ⁇ 2 is the touch
  • the absc issa value of the corresponding position of the control position on the display, in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is in pixels; "[ ]" is the rounding operator .
  • Step S605 The PC performs a corresponding operation according to the operation control signal, and displays.
  • the difference between the solution in FIG. 6 and the solution in FIG. 2 in the first embodiment is that, in the second embodiment, the UE side is only responsible for generating a digital touch signal according to a user's touch operation on the touch screen on the PC and The task is sent to the PC, and the corresponding task of converting the digital touch signal into the operation control signal recognizable by the PC is performed by the PC side, and the remaining steps are the same as those in the embodiment of FIG. 2, and details are not described herein again.
  • an embodiment of the present invention further provides a terminal, as shown in FIG. 7, including a touch screen sensor module 71, a touch screen controller module 72, and a terminal platform module 73, wherein: the touch screen sensor
  • the module 71 is configured to: after the terminal platform module 73 activates the touch screen control computer (PC) function, sense a user touch operation on the touch screen on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example Generate a voltage or signal change.
  • PC touch screen control computer
  • the touch screen controller module 72 includes: an A/D converter 721 and a data transmission controller 722, wherein: the A/D converter 721 is configured to: acquire an analog touch signal generated by the touch screen sensor module 71, And it is converted into a digital touch signal.
  • the data transmission controller 722 is configured to: transmit the digital touch signal to the terminal platform module 73 through a transmission interface such as a serial port.
  • the terminal platform module 73 includes an application unit that supports a touch screen control PC function, and the application unit is configured to: activate a touch screen to control a PC function, and display a digital touch signal provided by the touch screen controller module 72 after the touch screen control PC function is activated. Send to the PC to control the operation of the PC.
  • the application unit of the terminal platform module 73 is further configured to: after starting the touch screen control PC function, first determine whether a physical connection is established between the UE and the PC, and if established, according to the physical between the UE and the PC The corresponding protocol is connected to establish a communication transmission channel between the UE and the PC, and the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • an embodiment of the present invention further provides a computer
  • the PC includes a control processor 81 and a display 82.
  • the PC cooperates with the UE shown in FIG. 7 to implement a touch screen control PC function
  • the control processor 81 of the PC includes a a driving unit that supports a touch screen control PC function, wherein: the driving unit of the control processor 81 is configured to: convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and control according to the operation The signal is processed and the display 82 is controlled to display.
  • the driving unit of the control processor 81 is configured to convert the digital touch signal into an operation control signal that the PC can recognize and process by: obtaining the resolution of the display of the PC ( ⁇ 2 * ⁇ 2 ), and acquiring The width of the touch screen of the UE ( ⁇ 0 and height (Y, then the digital touch signal sent by the UE is processed by the position conversion algorithm of the driver, and the touch position on the touch screen is converted into a corresponding position on the PC display,
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X is the width value of the touch screen; the height value of the touch screen; x 2 is the display The maximum number of pixels in the direction of the abscissa; Y 2 is the maximum number of pixels in the ordinate direction of the display; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the position of the touch on the display The ordinate value of the corresponding position; "[ ]" is the rounding operator.
  • the application unit and the drive unit can be implemented by software, hardware or firmware.
  • an embodiment of the present invention further provides a system for controlling a computer (PC) through a mobile terminal (UE), as shown in FIG. 9, including the above-mentioned second embodiment of the present invention.
  • the UE and the PC, the UE and the PC establish a physical connection and a communication transmission channel, wherein: the UE is set to: run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, and place the user on the touch screen.
  • the touch operation of the PC is converted into a digital touch signal, and the digital touch signal is transmitted to the PC.
  • the PC is configured to: run a driver that supports the touch screen control PC function, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process and display according to the operation control signal.
  • the present invention provides a method, system and mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.

Abstract

A method for controlling a computer uses a mobile terminal and a computer. The mobile terminal is loaded with an application supporting the function that a touch screen controls a computer and a driver supporting that a touch screen controls a computer. The method comprises: the mobile terminal operates the application for starting the function that the touch screen controls the computer, converts the touch operation to the computer on the touch screen of the mobile terminal by a user into a digital touch control signal, operates the driver, converts the digital touch control signal into an operation control signal which can be identified and processed by the computer, and sends the signal to the computer to control the operation of the computer by the touch operation on the touch screen of the mobile terminal. A system for controlling a computer and a mobile terminal are also provided. The method, system and mobile terminal can control the actions of a computer by the operations on a touch screen of a mobile terminal in stead of a mouse. The solution is convenient and fast, and enriches computer control solutions.

Description

控制计算机的方法、 系统及移动终端  Method, system and mobile terminal for controlling computer
技术领域 本发明涉及通信领域， 尤其涉及移动终端应用领域。 TECHNICAL FIELD The present invention relates to the field of communications, and in particular, to the field of mobile terminal applications.
背景技术 目前， 为了实现对计算机的操作， 必须要配置鼠标和键盘这类的输入装 置。 随着移动通讯技术的进步， 触摸屏技术得到了广泛应用。 触摸屏的分辨 率越来越高， 精度越来越准确， 从而为触摸屏的应用创造了条件。 如果能应 用触摸屏技术， 利用移动终端的触摸屏来实现对计算机的控制， 将进一步丰 富对计算机的控制方案。 Background Art Currently, in order to realize operation of a computer, an input device such as a mouse and a keyboard must be configured. With the advancement of mobile communication technology, touch screen technology has been widely used. The resolution of the touch screen is getting higher and higher, and the accuracy is more and more accurate, thus creating conditions for the application of the touch screen. If the touch screen technology can be applied, the control of the computer can be realized by using the touch screen of the mobile terminal, and the control scheme for the computer will be further enriched.
发明内容 本发明要解决的技术问题是， 提出一种通过控制计算机的方法、 系统及 移动终端，可以替代鼠标，通过在移动终端触摸屏上操作来控制计算机动作， 方便快捷。 为解决上述技术问题， 本发明提出一种控制计算机（PC )的方法， 所述 方法使用移动终端（ UE )和 PC, 所述 UE加载了支持触摸屏控制 PC功能的 应用程序和支持触摸屏控制 PC功能的驱动程序的 UE, 该方法包括： 该 UE运行该应用程序以启动触摸屏控制 PC功能，将用户在 UE的触摸 屏上对 PC的触摸操作转换为数字触控信号， 然后运行该驱动程序， 将该数 字触控信号转换为 PC能够识别和处理的操作控制信号， 并发送给 PC , 以通 过对 UE触摸屏触摸操作控制 PC的操作。 将数字触控信号转换为 PC能够识别和处理的操作控制信号的步骤包括： 获取 PC的显示器的分辨率 X2* Y2和该 UE的触摸屏的宽度 和触摸屏 的高度 ; 该 UE通过该驱动程序的位置转化算法将数字触控信号中触摸屏上的各 触控位置转换成 PC显示器上对应的位置，以得到 PC能够识别和处理的操作 控制信号， 该位置转化算法如下：
Figure imgf000004_0001
SUMMARY OF THE INVENTION The technical problem to be solved by the present invention is to provide a method, system and mobile terminal for controlling a computer, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick. In order to solve the above technical problem, the present invention provides a method for controlling a computer (PC), which uses a mobile terminal (UE) and a PC, and the UE loads an application supporting a touch screen to control a PC function and supports a touch screen to control a PC function. The UE of the driver, the method includes: the UE running the application to activate the touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then running the driver, The digital touch signal is converted into an operation control signal that the PC can recognize and process, and sent to the PC to control the operation of the PC by a touch operation on the UE touch screen. The step of converting the digital touch signal into an operation control signal that the PC can recognize and process includes: obtaining a resolution X 2 * Y 2 of the display of the PC and a width of the touch screen of the UE and a height of the touch screen; The UE converts each touch position on the touch screen of the digital touch signal into a corresponding position on the PC display through the position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC. The position conversion algorithm is as follows:
Figure imgf000004_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的 纵坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐 标值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]" 为取整运算 符。 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
UE运行所述应用程序的步骤之前还包括： 建立该 UE与该 PC之间的物 理连接通道； Before the step of running the application by the UE, the method further includes: establishing a physical connection channel between the UE and the PC;
UE运行所述应用程序的步骤之后还包括： 判断该 UE与该 PC之间是否 建立了物理连接， 如果已建立， 则根据该 UE与该 PC之间的物理连接对应 的协议建立该 UE与该 PC的通信传输通道， 以传输该 UE与该 PC之间的数 据； 如果未建立， 则自动退出该触摸屏控制 PC功能。 为解决上述技术问题， 本发明还提出一种移动终端（UE ) , 包括触摸屏 传感器模块、 触摸屏控制器模块， 以及终端平台模块， 其中： 该触摸屏传感器模块设置为： 在接收到终端平台模块发送的启动触摸屏 控制计算机（PC )功能的指示后， 感测用户在触摸屏上对 PC的触摸操作， 产生一模拟触控信号； 该触摸屏控制器模块设置为： 将该触摸屏传感器模块产生的该模拟触控 信号转换为数字触控信号后发送给终端平台模块； 以及 该终端平台模块包括一支持触摸屏控制 PC功能的应用单元和一支持触 摸屏控制 PC功能的驱动单元； 所述应用单元设置为： 启动触摸屏控制 PC功能并向所述触摸屏传 感器模块发送启动触摸屏控制 PC功能的指示， 以及 所述驱动单元设置为： 将该触摸屏控制器模块提供的该数字触控信 号转换成 PC 能够识别和处理的操作控制信号后发送给 PC, 以通过对 UE触摸屏触摸操作控制 PC的操作。 所述驱动单元是设置为按如下方式将数字触控信号转换成 PC能够识别 和处理的操作控制信号： 获取 PC的显示器的分辨率 X2* Y2, 以及获取该 UE的触摸屏的宽度 和触摸屏的高度 Yl 通过位置转化算法将数字触控信号中触摸屏上的触控位 置转换成 PC显示器上对应的位置，以得到 PC能够识别和处理的操作控制信 号， 该位置转化算法如下：
Figure imgf000005_0001
After the step of running the application by the UE, the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC The communication transmission channel of the PC is used to transmit data between the UE and the PC; if not established, the touch screen control PC function is automatically exited. To solve the above technical problem, the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: the touch screen sensor module is configured to: send the terminal platform module to receive After the instruction of the touch screen control computer (PC) function is activated, the touch operation of the user on the touch screen is sensed to generate an analog touch signal; the touch screen controller module is configured to: the analog touch generated by the touch screen sensor module The signal is converted into a digital touch signal and sent to the terminal platform module; and the terminal platform module includes an application unit that supports the touch screen to control the PC function and a driving unit that supports the touch screen to control the PC function; the application unit is configured to: start the touch screen control The PC function and sends an indication to the touch screen sensor module to activate the touch screen control PC function, and The driving unit is configured to: convert the digital touch signal provided by the touch screen controller module into an operation control signal that can be recognized and processed by the PC, and then send the operation control signal to the PC to control the operation of the PC by touching the touch screen of the UE. The driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC as follows: acquire the resolution of the display of the PC X 2 * Y 2 , and acquire the width of the touch screen of the UE and the touch screen The height Y l converts the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by the position conversion algorithm to obtain an operation control signal that the PC can recognize and process. The position conversion algorithm is as follows:
Figure imgf000005_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的 纵坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐 标值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]" 为取整运算 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operation
所述应用单元还设置为： 启动触摸屏控制 PC功能后， 判断该 UE与 PC 之间是否建立了物理连接， 如果已建立， 则根据该 UE与 PC之间的物理连 接对应的协议建立该 UE与 PC的通信传输通道， 该通信传输通道用以实现 该 UE与 PC之间的数据传输； 如果未建立， 则自动退出该触摸屏控制 PC功 The application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE according to a protocol corresponding to the physical connection between the UE and the PC. a communication transmission channel of the PC, the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen is automatically exited to control the PC function
为解决上述技术问题， 本发明还提出一种控制计算机（PC )的系统， 包 括一如上所述的 UE和一 PC, 其中： 该 PC设置为： 根据该 UE发送来的操作控制信号执行操作并显示。 In order to solve the above technical problem, the present invention further provides a system for controlling a computer (PC), comprising a UE and a PC as described above, wherein: the PC is configured to: perform an operation according to an operation control signal sent by the UE and display.
为解决上述技术问题， 本发明还提出另一种控制计算机（PC ) 的方法， 所述方法使用加载了支持触摸屏控制 PC功能的应用程序的 UE, 以及加载了 支持触摸屏控制 PC功能的驱动程序的 PC , 该方法包括： 该 UE运行该应用程序以启动触摸屏控制 PC功能，将用户在 UE的触摸 屏上对 PC的触摸操作转换为数字触控信号， 然后将该数字触控信号发送给 该 PC; 该 PC运行该驱动程序， 将该 UE发送来的该数字触控信号转换为该 PC 能够识别和处理的操作控制信号， 并根据该操作控制信号进行处理及显示。 将数字触控信号转换为所述 PC能够识别和处理的操作控制信号步骤包 括： 获取该 PC的显示器的分辨率 X2* Y2和该 UE的触摸屏的宽度 和触摸 屏的高度 ; In order to solve the above technical problem, the present invention also proposes another method of controlling a computer (PC) using a UE loaded with an application supporting a touch screen to control a PC function, and loaded A PC supporting a touch screen to control a PC function driver, the method comprising: the UE running the application to activate a touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then The digital touch signal is sent to the PC; the PC runs the driver, converts the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and processes and displays according to the operation control signal. . The step of converting the digital touch signal into the operation control signal that the PC can recognize and process comprises: obtaining the resolution X 2 * Y 2 of the display of the PC and the width of the touch screen of the UE and the height of the touch screen;
该 PC通过该驱动程序的位置转化算法将所述数字触控信号中触摸屏上 的各触控位置转换成该 PC显示器上对应的位置，以得到该 PC能够识别和处 理的操作控制信号， 该位置转化算法如下：
Figure imgf000006_0001
The PC converts each touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC. The conversion algorithm is as follows:
Figure imgf000006_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 UE运行所述应用程序的步骤之前还包括： 建立该 UE与该 PC之间的物 理连接通道； Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator. Before the step of running the application by the UE, the method further includes: establishing a physical connection channel between the UE and the PC;
UE运行所述应用程序的步骤之后还包括： 判断该 UE与该 PC之间是否 建立了物理连接， 如果已建立， 则根据该 UE与该 PC之间的物理连接对应 的协议建立该 UE与该 PC的通信传输通道， 以实现该 UE与该 PC之间的数 据传输； 如果未建立， 则自动退出该触摸屏控制 PC功能。 为解决上述技术问题， 本发明还提出一种移动终端（UE ) , 包括触摸屏 传感器模块、 触摸屏控制器模块， 以及终端平台模块， 其中： 该触摸屏传感器模块设置为： 在接收到终端平台模块启动触摸屏控制计 算机（PC )功能的指示后， 感测用户在触摸屏上对 PC的触摸操作， 产生模 拟触控信号； 该触摸屏控制器模块设置为： 将该触摸屏传感器模块产生的模拟触控信 号转换为数字触控信号后发送给该终端平台模块； 以及 该终端平台模块包括一支持触摸屏控制 PC功能的应用单元， 所述应用单元设置为： 启动触摸屏控制 PC功能， 向所述触摸屏传感器 模块发送启动触摸屏控制 PC功能的指示， 以及将该触摸屏控制器模块提供 的数字触控信号发送给 PC, 以通过对 UE触摸屏触摸操作控制 PC的操作。 所述应用单元还设置为： 判断该 UE与该 PC之间是否建立了物理连接， 如果已建立，则根据该 UE与该 PC之间的物理连接对应的协议建立该 UE与 该 PC的通信传输通道，以实现该 UE与该 PC之间的数据传输；如果未建立， 则自动退出该触摸屏控制 PC功能。 为解决上述技术问题， 本发明还提出一种计算机（PC ) , 其设置为： 与 上述移动终端 （UE )相配合以实现触摸屏控制 PC功能， 该 PC包含一支持 触摸屏控制 PC功能的驱动单元， 其中： After the step of running the application by the UE, the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC The communication transmission channel of the PC is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited. To solve the above technical problem, the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: The touch screen sensor module is configured to: after receiving the indication that the terminal platform module activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen on the touch screen, generating an analog touch signal; the touch screen controller module is set to The analog touch signal generated by the touch screen sensor module is converted into a digital touch signal and sent to the terminal platform module; and the terminal platform module includes an application unit that supports the touch screen to control the PC function, and the application unit is set to: start The touch screen controls the PC function, sends an indication to the touch screen sensor module to activate the touch screen control PC function, and sends the digital touch signal provided by the touch screen controller module to the PC to control the operation of the PC by touching the touch screen of the UE. The application unit is further configured to: determine whether a physical connection is established between the UE and the PC, and if established, establish a communication transmission between the UE and the PC according to a protocol corresponding to a physical connection between the UE and the PC. Channel to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited. In order to solve the above technical problem, the present invention further provides a computer (PC), which is configured to: cooperate with the mobile terminal (UE) to implement a touch screen control PC function, and the PC includes a driving unit that supports a touch screen to control a PC function. among them:
该驱动单元设置为： 接收所述 UE发送来的数字触摸信号， 将数字触控 信号转换为该 PC能够识别和处理的操作控制信号， 并根据该操作控制信号 进行处理及显示。 所述驱动单元是设置为按如下方式将所述数字触控信号转换为所述 PC 能够识别和处理的操作控制信号： 获取该 PC的显示器的分辨率 X2* Y2, 以及获取该 UE的触摸屏的宽度 X和触摸屏的高度 ，然后通过位置转化算法将所述数字触控信号中触摸屏 上的触控位置转换成该 PC显示器上对应的位置，以得到该 PC可识别和处理 的操作控制信号， 该位置转化算法如下：
Figure imgf000007_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 为解决上述技术问题， 本发明还提出一种控制计算机（PC )的系统， 包 括一如上所述 UE, 以及一如上所述 PC, 该 UE与该 PC之间建立有物理连 接和通信传输通道， 其中： 该 UE, 用以运行支持触摸屏控制 PC功能的应用程序， 启动触摸屏控制 PC功能， 将用户在触摸屏上对 PC的触摸操作转换为数字触控信号， 并将该 数字触控信号发送给该 PC; 该 PC, 用以运行支持触摸屏控制 PC功能的驱动程序， 将该 UE发送来 的该数字触控信号转换为该 PC能够识别和处理的操作控制信号， 并根据该 操作控制信号进行处理及显示。 本发明提出的一种通过移动终端触摸屏控制计算机的方法、 系统及移动 终端， 可以替代鼠标， 通过在移动终端触摸屏上操作来控制计算机动作， 方 便快捷， 丰富了计算机控制方案。 The driving unit is configured to: receive a digital touch signal sent by the UE, convert the digital touch signal into an operation control signal that can be recognized and processed by the PC, and process and display according to the operation control signal. The driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution X 2 * Y 2 of the display of the PC, and acquiring the UE Touching the width X of the touch screen and the height of the touch screen, and then converting the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm to obtain an operation control signal recognizable and processed by the PC , the location conversion algorithm is as follows:
Figure imgf000007_0001
Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator. In order to solve the above technical problem, the present invention further provides a system for controlling a computer (PC), comprising a UE as described above, and a PC as described above, wherein a physical connection and a communication transmission channel are established between the UE and the PC. The UE is configured to run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, convert the touch operation of the user on the touch screen to the digital touch signal, and send the digital touch signal to the The PC is configured to run a driver that supports the function of the touch screen to control the PC, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process the signal according to the operation control signal. display. The invention provides a method, a system and a mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.
附图概述 图 1是本发明第一实施例一种通过移动终端触摸屏控制计算机的检测方 法流程图； 图 2是本发明第一实施例一种通过移动终端触摸屏控制计算机的数据处 理方法流程图； 图 3是本发明第一实施例一种移动终端的结构方框图； 图 4是本发明第一实施例一种通过移动终端触摸屏控制计算机的系统方 框图； 图 5是本发明第二实施例一种通过移动终端触摸屏控制计算机的检测方 法流程图； 图 6是本发明第 实施例一种通过移动终端触摸屏控制计算机的数据处 理方法流程图； 图 7是本发明第 实施例一种移动终端的结构方框图； 图 8是本发明第 实施例一种计算机的结构方框图； 图 9是本发明第 实施例一种通过移动终端触摸屏控制计算机的系统方 框图。 1 is a flow chart of a method for detecting a computer controlled by a touch screen of a mobile terminal according to a first embodiment of the present invention; FIG. 2 is a flow chart of a data processing method for controlling a computer by a touch screen of a mobile terminal according to a first embodiment of the present invention; 3 is a block diagram showing the structure of a mobile terminal according to a first embodiment of the present invention; FIG. 4 is a block diagram showing a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention; FIG. 5 is a second embodiment of the present invention. Flow chart of detection method of mobile terminal touch screen control computer; 6 is a flow chart showing a data processing method for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention; FIG. 7 is a block diagram showing a configuration of a mobile terminal according to a first embodiment of the present invention; FIG. 8 is a computer according to a first embodiment of the present invention; FIG. 9 is a block diagram of a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention.
本发明的较佳实施方式 下面将结合附图对本发明实施方案进行详细说明。 实现本发明技术方案首先需要： BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. To achieve the technical solution of the present invention, it is first required:
1 , 一具备触摸屏功能的移动终端 （ User Equipment, UE ) ； 1 , a mobile terminal ( User Equipment , UE ) with touch screen function;
2, 提供一支持本发明的触摸屏控制 PC功能的应用程序和驱动程序， 将 该应用程序加载到具备触摸屏功能的 UE,将该驱动程序加载到该 UE或者该 UE欲控制的 PC; 2, 在该 UE与 PC之间建立物理连接， 所述物理连接可以是有线连接， 例如通过 USB数据线将 UE与 PC连接起来， 也可以是无线连接， 例如通过 蓝牙或红外等将 UE与 PC连接起来。 在具备上述配置后， 所述 UE运行支持触摸屏控制 PC功能的应用程序 以启动本发明的触摸屏控制 PC功能，之后进行通道检测以确保 UE与 PC可 正常通信。 第一实施例： 在第一实施例中， 将支持本发明的触摸屏控制 PC功能的应用程序和驱 动程序全部加载到 UE侧。 2, providing an application and a driver supporting the touch screen control PC function of the present invention, loading the application to a UE with a touch screen function, loading the driver to the UE or the PC to be controlled by the UE; A physical connection is established between the UE and the PC. The physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared. After having the above configuration, the UE runs an application supporting the touch screen control PC function to activate the touch screen control PC function of the present invention, and then performs channel detection to ensure that the UE and the PC can communicate normally. First Embodiment: In the first embodiment, an application and a driver that support the touch screen control PC function of the present invention are all loaded to the UE side.
UE运行支持触摸屏控制 PC功能的应用程序，启动本发明的触摸屏控制 PC功能后， UE进行通道检测， 具体方法如图 1所示， 包括步骤： 步骤 S101 : UE运行支持触摸屏控制 PC功能的应用程序， 启动触摸屏 控制 PC功能； 步骤 S102: UE判断其是否已与 PC成功建立起物理连接， 如果判断结 果为是， 则进入步骤 S103; 如果判断结果为否， 自动退出该功能， 结束； 步骤 S103: UE建立其与 PC的通信传输通道， 如果该通信传输通道建 立成功， 则进入步骤 S104; 如果不成功， 自动退出该功能， 结束； The UE runs an application that supports the touch screen to control the PC function, and after the touch screen control PC function of the present invention is started, the UE performs channel detection. The specific method is as shown in FIG. 1 , including the following steps: Step S101 : The UE runs an application that supports the touch screen to control the PC function. , start the touch screen Controlling the PC function; Step S102: The UE determines whether it has successfully established a physical connection with the PC. If the determination result is yes, the process goes to step S103; if the determination result is no, the function is automatically exited, and the process ends; Step S103: The UE establishes its a communication transmission channel with the PC, if the communication transmission channel is successfully established, proceeding to step S104; if not, automatically exiting the function and ending;
UE根据其与 PC之间的物理连接的类型， 选用相应的传输协议， 建立起 其与 PC之间的通信传输通道。例如， UE与 PC之间通过 USB数据线建立起 物理连接， 则釆用 USB传输协议建立起二者之间的通信传输通道； 又例如， UE与 PC之间通过蓝牙建立起物理连接，则釆用蓝牙协议建立起二者之间的 通信传输通道。 步骤 S104: UE进入触摸屏控制 PC功能的操作界面， 接收和识别用户 在触摸屏上对 PC的触摸操作， 产生数字触控信号， 运行支持触摸屏控制 PC 功能的驱动程序， 将该数字触控信号转换为 PC能够识别和处理的操作控制 信号后发送给 PC, 以实现 UE对 PC的控制； 在执行步骤 S 104的同时， 还可以持续判断 UE与 PC之间的物理连接和 通信传输通道是否正常， 如果物理连接或者通信传输通道断开， 则自动退出 触摸屏控制 PC功能， 结束； 步骤 S105: UE在关闭触摸屏控制 PC功能后， 自动退出该功能， 结束。 The UE selects the corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol. Step S104: The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, runs a driver supporting the touch screen control PC function, and converts the digital touch signal into The operation control signal that can be recognized and processed by the PC is sent to the PC to implement control of the PC by the UE. While performing step S104, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal. When the physical connection or the communication transmission channel is disconnected, the touch screen control PC function is automatically exited, and the process ends; Step S105: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
下面参考图 2, 该图示出了实现上述步骤 S104的具体数据处理过程， 包 括步骤： 步骤 S201 : UE在启动触摸屏控制 PC功能后， 进入触摸屏控制 PC的操 作界面， 感知用户在触摸屏上对 PC的触摸操作， 例如点击、 划动等操作， 以产生一模拟触控信号， 例如产生一个电压或信号的变化； UE在未启动触摸屏控制 PC功能时， 按照常规的方法感知用户对该 UE 的操作；在启动触摸屏控制 PC功能后，感知的是用户对 PC的操作。可以是， UE在启动触摸屏控制 PC功能后， 进行触摸屏控制 PC功能界面， 用户在该 界面上通过触摸操作实现对 PC的控制。 步骤 S202: UE将模拟触控信号转换为数字触控信号; 现有的具备触摸屏功能的 UE是通过对数字触控信号进行坐标分析和速 度分析， 从而获取触控位置 （Xl , yi )和触控动作， 例如划动、 单击、 双击 等动作。 本发明申请人正是通过仔细观察和深入研究， 发现可以考虑利用 UE的 触摸屏产生的触控信号来控制 PC操作，从而提出一种新的 PC控制方案，且 随着触摸屏移动终端的普及以及人们对 PC机便携性要求的提高， 该方案具 有很大的市场价值。 但是， 由于触摸屏上产生的位置坐标的单位是米、 分米、 厘米和毫米这 类的长度计量单位， 而显示器则是以像素为单位进行显示， 即触摸屏上的触 控位置单位与显示器上的显示单位不同， 目前的 PC机是无法识别移动终端 的触控信号的， 因此， 本发明申请人提出下述解决方案： 步骤 S203 : UE运行支持触摸屏控制 PC功能的驱动程序， 通过与 PC之 间建立的通信传输通道获取 PC 的显示器的分辨率 ( Χ2* Υ2 ) , 以及获取该 UE的触摸屏的宽度 和高度 ; 步骤 S204: UE通过该驱动程序的位置转化算法处理该数字触控信号， 将触摸屏上的触控位置（ Xl , yi )转换成该 PC显示器上对应的位置 ( x2 , y2 ) , 以得到该 PC可识别和处理的操作控制信号， 该位置转化算法如下：
Figure imgf000011_0001
Referring to FIG. 2, the figure shows a specific data processing process for implementing the above step S104, including the following steps: Step S201: After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC. Touch operations, such as clicking, swiping, etc., to generate an analog touch signal, for example, to generate a voltage or signal change; the UE senses the user's operation of the UE according to a conventional method when the touch screen control PC function is not activated. After starting the touch screen to control the PC function, the user's operation on the PC is perceived. The UE may perform a touch screen control PC function interface after starting the touch screen control PC function, and the user is in the The control of the PC is realized by a touch operation on the interface. Step S202: The UE converts the analog touch signal into a digital touch signal; the existing UE with the touch screen function obtains the touch position ( Xl , yi) and the touch by performing coordinate analysis and speed analysis on the digital touch signal. Control actions, such as swiping, clicking, double-clicking, etc. The applicant of the present invention has discovered through careful observation and in-depth study that the touch signal generated by the touch screen of the UE can be considered to control the PC operation, thereby proposing a new PC control scheme, and with the popularity of the touch screen mobile terminal and people This solution has great market value for the improvement of PC portability requirements. However, since the position coordinates generated on the touch screen are in units of lengths such as meters, decimeters, centimeters, and millimeters, the display is displayed in units of pixels, that is, the touch position unit on the touch screen and the display. The display unit is different. The current PC cannot recognize the touch signal of the mobile terminal. Therefore, the applicant of the present invention proposes the following solution: Step S203: The UE runs a driver that supports the touch screen control PC function, and communicates with the PC. Establishing a communication transmission channel to obtain a resolution ( Χ 2 * Υ 2 ) of the display of the PC, and acquiring a width and a height of the touch screen of the UE; Step S204: the UE processes the digital touch signal by using a position conversion algorithm of the driver, Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
Figure imgf000011_0001
其中， ^为触控位置在触摸屏上的横坐标值， 其单位为长度计量单位； 为触控位置在触摸屏上的纵坐标值， 其单位为长度计量单位； 为触摸屏 的宽度值， 其单位为长度计量单位； 为触摸屏的高度值， 其单位为长度计 量单位； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵坐标 方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标值， 其以像素为单位； y2为触控位置在显示器上的对应位置的纵坐标值， 其以像 素为单位； "[ ]" 为取整运算符。 由于显示器上以像素为单位进行显示，显示器上的位置都是整数， 因此， 在上述公式中需要进行取整运算。 步骤 S205: UE将该操作控制信号通过 UE与 PC建立的通信传输通道发 送给 PC; 步骤 S206: PC接收到 UE发送来的操作控制信号后， 根据该操作控制 信号执行相应的操作， 并显示。 现有技术中通过鼠标来操作 PC时， PC是通过对鼠标移动产生的操作控 制信号进行坐标以及速度分析， 从而获知操作位置和操作动作， 继而根据分 析结果执行相应的操作并显示。 相应地， 在本发明中， 是釆用 UE的触摸屏 产生触控信号， 并将其转化为 PC可识别的操作控制信号， 继而替代鼠产生 的操作控制信号实现对 PC的控制， 丰富了对 PC的控制方案， 且对 PC没有 特殊要求， 实现起来简单方便。 Where ^ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit; X 2 is the maximum number of pixels in the horizontal direction of the display; Y 2 is the maximum number of pixels in the ordinate direction of the display; χ 2 is the touch The abscissa value of the corresponding position of the control position on the display, which is in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is like Prime is the unit; "[ ]" is the rounding operator. Since the display is displayed in units of pixels on the display, the positions on the display are integers, and therefore, the rounding operation is required in the above formula. Step S205: The UE sends the operation control signal to the PC through the communication transmission channel established by the UE and the PC. Step S206: After receiving the operation control signal sent by the UE, the PC performs a corresponding operation according to the operation control signal, and displays. In the prior art, when the PC is operated by the mouse, the PC performs coordinate and speed analysis by the operation control signal generated by the mouse movement, thereby obtaining the operation position and the operation action, and then performing corresponding operations and displaying according to the analysis result. Correspondingly, in the present invention, the touch signal is generated by the touch screen of the UE, and is converted into an operation control signal recognizable by the PC, and then the control signal of the mouse is replaced by the operation control signal generated by the mouse, enriching the PC. The control scheme has no special requirements for the PC, and it is simple and convenient to implement.
为了实现上述通过移动终端触摸屏控制计算机的方法， 本发明还提供了 一种移动终端 （UE ) , 包括触摸屏传感器模块 31、 触摸屏控制器模块 32, 以及终端平台模块 33 , 其中： 该触摸屏传感器模块 31设置为： 在该终端平台模块 33启动触摸屏控制 计算机（PC )功能后， 感测用户在触摸屏上对 PC的触摸操作， 例如点击、 划动等操作， 以产生一模拟触控信号， 例如产生一个电压或信号的变化。 触摸屏控制器模块 32 ,其包括： Α/Ό转换器 321和数据传输控制器 322, 其中： A/D转换器 321设置为： 获取触摸屏传感器模块 31产生的模拟触控信 号， 并其转换为数字触控信号。 数据传输控制器 322设置为： 通过串口等传 输接口将数字触控信号传递给终端平台模块 33。 该终端平台模块 33包括： 一支持触摸屏控制 PC功能的应用单元和一支 持触摸屏控制 PC功能的驱动单元， 所述应用单元设置为： 启动触摸屏控制 PC功能并向所述触摸屏传感器模块发送启动触摸屏控制 PC功能的指示， 以 及驱动单元设置为：将该触摸屏控制器模块 32提供的该数字触控信号转换成 PC能够识别和处理的操作控制信号后发送给 PC, 以通过对 UE触摸屏触摸 操作控制 PC的操作。 其中， 应用单元和驱动单元可以通过软件、 硬件或固件实现。 In order to implement the above method for controlling a computer through a touch screen of a mobile terminal, the present invention further provides a mobile terminal (UE), including a touch screen sensor module 31, a touch screen controller module 32, and a terminal platform module 33, wherein: the touch screen sensor module 31 The method is as follows: after the terminal platform module 33 activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example, generating a Voltage or signal change. The touch screen controller module 32 includes: a Α/Ό converter 321 and a data transfer controller 322, wherein: the A/D converter 321 is configured to: acquire an analog touch signal generated by the touch screen sensor module 31, and convert the same into a digital Touch signal. The data transmission controller 322 is configured to: transmit the digital touch signal to the terminal platform module 33 through a transmission interface such as a serial port. The terminal platform module 33 includes: an application unit supporting a touch screen control PC function and a driving unit supporting a touch screen control PC function, wherein the application unit is configured to: activate a touch screen control PC function and send a start touch screen control to the touch screen sensor module PC function indication to And the driving unit is configured to: convert the digital touch signal provided by the touch screen controller module 32 into an operation control signal that can be recognized and processed by the PC, and then send the signal to the PC to control the operation of the PC by touching the touch screen of the UE. The application unit and the drive unit can be implemented by software, hardware or firmware.
该驱动单元是设置为通过以下方式将数字触控信号转换为该 PC能够识 别和处理的操作控制信号： 获取 PC 的显示器的分辨率 ( X2* Y2 ) ， 以及该 UE的触摸屏的宽度 (Χ0和高度（ ) , 然后通过位置转化算法处理该数字触 控信号， 将触摸屏上的触控位置转换成 PC显示器上对应的位置， 以得到 PC 可识别和处理的操作控制信号， 该位置转化算法如下：
Figure imgf000013_0001
The driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution (X 2 * Y 2 ) of the display of the PC, and a width of the touch screen of the UE ( Χ0 and height ( ), then the digital touch signal is processed by the position conversion algorithm, and the touch position on the touch screen is converted into a corresponding position on the PC display to obtain an operation control signal recognizable and processed by the PC, the position conversion algorithm as follows:
Figure imgf000013_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X 为触摸屏的宽度值； 为触摸屏的高度值； x2为显示器的 横坐标方向上的最大像素个数； Y2为显示器的纵坐标方向上的最大像素个 数； χ2为触控位置在显示器上的对应位置的横坐标值； y2为触控位置在显示 器上的对应位置的纵坐标值； "[ ]" 为取整运算符。 应用单元还设置为： 启动触摸屏控制 PC功能后， 判断该 UE与 PC之间 是否建立了物理连接， 如果已建立， 则根据该 UE与 PC之间的物理连接对 应的协议建立该 UE与 PC的通信传输通道， 该通信传输通道用以实现该 UE 与 PC之间的数据传输； 如果未建立， 则自动退出该触摸屏控制 PC功能。 参见图 4 ,本发明还提供了一种通过移动终端触摸屏控制计算机的系统， 包括一图 3所示 UE和一 PC , 该 PC包括一控制处理器 41和一显示器 42 , 其中： Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X is the width value of the touch screen; the height value of the touch screen; x 2 is the direction of the horizontal axis of the display The maximum number of pixels; Y 2 is the maximum number of pixels in the ordinate direction of the display; χ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate of the corresponding position of the touch position on the display Value; "[ ]" is the rounding operator. The application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE and the PC according to a protocol corresponding to the physical connection between the UE and the PC. The communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited. Referring to FIG. 4, the present invention further provides a system for controlling a computer through a touch screen of a mobile terminal, comprising a UE and a PC shown in FIG. 3, the PC comprising a control processor 41 and a display 42, wherein:
该 UE与该 PC建立有物理连接， 所述物理连接可以是有线连接， 例如 通过 USB数据线将 UE与 PC连接起来， 也可以是无线连接， 例如通过蓝牙 或红外等将 UE与 PC连接起来。 该 UE与该 PC还建立有通信传输通道，该通信传输通道是 UE根据其与 PC之间的物理连接的类型， 选用相应的传输协议， 建立起来的。 例如， UE 与 PC之间通过 USB数据线建立起物理连接， 则釆用 USB传输协议建立起 二者之间的通信传输通道；又例如， UE与 PC之间通过蓝牙建立起物理连接， 则釆用蓝牙协议建立起二者之间的通信传输通道。 本发明第一实施例中实现触摸屏控制 PC的功能主要是由移动终端侧实 现的， 对 PC没有额外要求， PC的控制处理器 41在接收到 UE侧发送来的 操作控制信号后 , 按照对鼠标动作产生的操作控制信号相同的处理方式进行 分析和处理， 然后控制显示器 42进行显示即可， 实现起来简单方便。 The UE establishes a physical connection with the PC. The physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared. The UE and the PC also establish a communication transmission channel, and the communication transmission channel is based on the UE The type of physical connection between PCs is established using the corresponding transport protocol. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol. The function of implementing the touch screen control PC in the first embodiment of the present invention is mainly implemented by the mobile terminal side, and there is no additional requirement for the PC. After receiving the operation control signal sent by the UE side, the control processor 41 of the PC follows the mouse. The operation control signal generated by the action is analyzed and processed in the same processing manner, and then the display 42 is controlled to be displayed, which is simple and convenient to implement.
第二实施例： 在第二实施例中， 将支持本发明的触摸屏控制 PC功能的应用程序加载 到 UE侧， 将支持本发明的触摸屏控制 PC功能的驱动程序加载到 PC侧。 本发明第二实施例与上述的第一实施例的区别主要在于将用户对 PC进 行触摸操作产生的数字触控信号转换为 PC可识别的操作控制信号的处理位 置从 UE侧移到了 PC侧。 本发明第二实施例中， 在启动触摸屏控制 PC功能后， 通道检测流程图 如图 5所示， 包括步骤： 步骤 S501 : UE运行支持触摸屏控制 PC功能的应用程序， 启动触摸屏 控制 PC功能； 步骤 S502: UE判断其是否已与 PC成功建立起物理连接， 如果判断结 果为是， 则进入步骤 S503; 如果不是， 自动退出该功能， 结束； 步骤 S503: UE建立其与 PC的通信传输通道， 如果该通信传输通道建 立成功， 则进入步骤 S504; 如果不成功， 自动退出该功能， 结束； Second Embodiment: In the second embodiment, an application supporting the touch screen control PC function of the present invention is loaded to the UE side, and a driver supporting the touch screen control PC function of the present invention is loaded to the PC side. The second embodiment of the present invention differs from the above-described first embodiment mainly in that the processing position for converting the digital touch signal generated by the user to the touch operation of the PC into the PC-identifiable operation control signal is moved from the UE side to the PC side. In the second embodiment of the present invention, after the touch screen control PC function is started, the channel detection flowchart is as shown in FIG. 5, including the following steps: Step S501: The UE runs an application that supports the touch screen to control the PC function, and starts the touch screen to control the PC function; S502: The UE determines whether it has successfully established a physical connection with the PC, if the determination result is yes, then proceeds to step S503; if not, automatically exits the function, and ends; step S503: the UE establishes a communication transmission channel with the PC, if If the communication transmission channel is successfully established, the process proceeds to step S504; if not, the function is automatically exited and ends;
UE根据其与 PC之间的物理连接的类型， 选用相应的传输协议， 建立起 其与 PC之间的通信传输通道。例如， UE与 PC之间通过 USB数据线建立起 物理连接， 则釆用 USB传输协议建立起二者之间的通信传输通道； 又例如， UE与 PC之间通过蓝牙建立起物理连接，则釆用蓝牙协议建立起二者之间的 通信传输通道。 步骤 S504: UE进入触摸屏控制 PC功能的操作界面， 接收和识别用户 在触摸屏上对 PC的触摸操作， 产生数字触控信号， 并将该数字触控信号发 送给 PC, 由 PC将该数字触控信号转换为 PC能够识别和处理的操作控制信 号后， 进行处理和显示。 与图 1所示方法不同的， UE侧只负责根据用户在触摸屏上对 PC的触摸 操作产生数字触控信号并将其发送给 PC, 而相应的将数字触控信号转化为 PC可识别的操作控制信号的任务由 PC侧来完成； 在执行步骤 S504的同时， 还可以持续判断 UE与 PC之间的物理连接和 通信传输通道是否正常， 如果物理连接或者通信传输通道断开， 则自动退出 触摸屏控制 PC功能， 结束； 步骤 S505: UE在关闭触摸屏控制 PC功能后， 自动退出该功能， 结束。 The UE selects a corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then Established between the two using the Bluetooth protocol Communication transmission channel. Step S504: The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, and sends the digital touch signal to the PC, and the digital touch is performed by the PC. The signal is converted to an operation control signal that the PC can recognize and process, and then processed and displayed. Different from the method shown in FIG. 1 , the UE side is only responsible for generating a digital touch signal according to the user's touch operation on the touch screen on the touch screen and transmitting it to the PC, and correspondingly converting the digital touch signal into a PC identifiable operation. The task of the control signal is completed by the PC side; while performing step S504, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal, and if the physical connection or the communication transmission channel is disconnected, the touch screen is automatically exited. Controlling the PC function, ending; Step S505: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
下面参考图 6 , 该图示出了实现上述步骤 S504的具体数据处理过程， 包 括步骤： 步骤 S601 : UE在启动触摸屏控制 PC功能后， 进入触摸屏控制 PC的操 作界面， 感知用户在触摸屏上对 PC的触摸操作， 例如点击、 划动等操作， 以产生一模拟触控信号， 例如产生一个电压或信号的变化； 步骤 S602: UE将该模拟触控信号转换为数字触控信号， 并将其发送给 PC; 步骤 S603: PC运行支持触摸屏控制 PC功能的驱动程序， 获取 PC的显 示器的分辨率（ X2* Y2 ) 以及通过与 UE之间建立的通信传输通道获取该 UE 的触摸屏的宽度 和高度 ; Referring to FIG. 6, the figure shows a specific data processing process for implementing the foregoing step S504, including the following steps: Step S601: After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC. Touch operation, such as clicking, swiping, etc., to generate an analog touch signal, for example, generating a voltage or signal change; Step S602: The UE converts the analog touch signal into a digital touch signal and transmits the same Step S603: The PC runs a driver supporting the touch screen control PC function, acquires the resolution of the display of the PC (X 2 * Y 2 ), and acquires the width of the touch screen of the UE through a communication transmission channel established with the UE. height;
触摸屏上产生的位置坐标的单位是米、 分米、 厘米、 毫米这类的长度计 量单位， 因此这里获取的是触摸屏的宽度 X和高度 Yi。 而显示器则是以像 素为单位进行显示， 因此， 显示器上的位置坐标是以像素为单位的。 步骤 S604: PC通过该驱动程序的位置转化算法处理该数字触控信号， 将触摸屏上的触控位置（ Xl , yi )转换成该 PC显示器上对应的位置（ x2, y2 ) , 以得到该 PC可识别和处理的操作控制信号， 该位置转化算法如下：
Figure imgf000016_0001
The unit of position coordinates generated on the touch screen is a unit of length measurement such as meters, decimeters, centimeters, millimeters, so the width X and height Yi of the touch screen are obtained here. The display is displayed in units of pixels, so the position coordinates on the display are in pixels. Step S604: The PC processes the digital touch signal by using a position conversion algorithm of the driver. Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
Figure imgf000016_0001
其中， ^为触控位置在触摸屏上的横坐标值， 其单位为长度计量单位； 为触控位置在触摸屏上的纵坐标值， 其单位为长度计量单位； 为触摸屏 的宽度值， 其单位为长度计量单位； 为触摸屏的高度值， 其单位为长度计 量单位； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵坐标 方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标值， 其以像素为单位； y2为触控位置在显示器上的对应位置的纵坐标值， 其以像 素为单位； "[ ]" 为取整运算符。 由于显示器上以像素为单位进行显示， 其位置都是整数， 因此， 在上述 公式中需要进行取整运算。 步骤 S605: PC根据该操作控制信号执行相应的操作， 并显示。 图 6所述方案与第一实施例中的图 2所述方案的区别在于， 在第二实施 例中， UE侧只负责根据用户在触摸屏上对 PC的触摸操作产生数字触控信号 并将其发送给 PC,而相应的将数字触控信号转化为 PC可识别的操作控制信 号的任务由 PC侧来完成， 其余步骤与图 2方案相同， 这里不再赘述。 Where ^ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit; X 2 is the maximum number of pixels in the horizontal direction of the display; Y 2 is the maximum number of pixels in the ordinate direction of the display; χ 2 is the touch The abscissa value of the corresponding position of the control position on the display, in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is in pixels; "[ ]" is the rounding operator . Since the display is displayed in units of pixels on the display, the positions are integers, and therefore, the rounding operation is required in the above formula. Step S605: The PC performs a corresponding operation according to the operation control signal, and displays. The difference between the solution in FIG. 6 and the solution in FIG. 2 in the first embodiment is that, in the second embodiment, the UE side is only responsible for generating a digital touch signal according to a user's touch operation on the touch screen on the PC and The task is sent to the PC, and the corresponding task of converting the digital touch signal into the operation control signal recognizable by the PC is performed by the PC side, and the remaining steps are the same as those in the embodiment of FIG. 2, and details are not described herein again.
为了实现本发明第二实施例上述方法， 本发明实施例还提出一种终端， 如图 7所示， 包括触摸屏传感器模块 71、触摸屏控制器模块 72 , 以及终端平 台模块 73 , 其中： 该触摸屏传感器模块 71设置为： 在该终端平台模块 73启动触摸屏控制 计算机（PC )功能后， 感测用户在触摸屏上对 PC的触摸操作， 例如点击、 划动等操作， 以产生一模拟触控信号， 例如产生一个电压或信号的变化。 触摸屏控制器模块 72包括： A/D转换器 721和数据传输控制器 722, 其 中： A/D转换器 721设置为：获取触摸屏传感器模块 71产生的模拟触控信号， 并其转换为数字触控信号。 数据传输控制器 722设置为： 通过串口等传输接 口将数字触控信号传递给终端平台模块 73。 该终端平台模块 73包含一支持触摸屏控制 PC功能的应用单元，该应用 单元设置为： 启动触摸屏控制 PC功能， 以及在启动触摸屏控制 PC功能后， 将该触摸屏控制器模块 72提供的数字触控信号发送给 PC, 以控制 PC的操 作。 该终端平台模块 73的应用单元还设置为；在启动触摸屏控制 PC功能后 , 先判断该 UE与该 PC之间是否建立了物理连接， 如果已建立， 则根据该 UE 与该 PC之间的物理连接对应的协议建立该 UE与该 PC的通信传输通道，该 通信传输通道用以实现该 UE与该 PC之间的数据传输； 如果未建立， 则自 动退出该触摸屏控制 PC功能。 为了实现本发明第二实施例上述方法， 本发明实施例还提出一种计算机In order to implement the foregoing method of the second embodiment of the present invention, an embodiment of the present invention further provides a terminal, as shown in FIG. 7, including a touch screen sensor module 71, a touch screen controller module 72, and a terminal platform module 73, wherein: the touch screen sensor The module 71 is configured to: after the terminal platform module 73 activates the touch screen control computer (PC) function, sense a user touch operation on the touch screen on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example Generate a voltage or signal change. The touch screen controller module 72 includes: an A/D converter 721 and a data transmission controller 722, wherein: the A/D converter 721 is configured to: acquire an analog touch signal generated by the touch screen sensor module 71, And it is converted into a digital touch signal. The data transmission controller 722 is configured to: transmit the digital touch signal to the terminal platform module 73 through a transmission interface such as a serial port. The terminal platform module 73 includes an application unit that supports a touch screen control PC function, and the application unit is configured to: activate a touch screen to control a PC function, and display a digital touch signal provided by the touch screen controller module 72 after the touch screen control PC function is activated. Send to the PC to control the operation of the PC. The application unit of the terminal platform module 73 is further configured to: after starting the touch screen control PC function, first determine whether a physical connection is established between the UE and the PC, and if established, according to the physical between the UE and the PC The corresponding protocol is connected to establish a communication transmission channel between the UE and the PC, and the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited. In order to implement the above method of the second embodiment of the present invention, an embodiment of the present invention further provides a computer
( PC ) , 如图 8所示， 该 PC包括一控制处理器 81和一显示器 82, 该 PC与 图 7所示 UE相配合以实现触摸屏控制 PC功能， 该 PC的控制处理器 81中 包含一支持触摸屏控制 PC功能的驱动单元， 其中： 该控制处理器 81的驱动单元设置为：将该 UE发送来的数字触控信号转 换为该 PC能够识别和处理的操作控制信号， 并根据该操作控制信号进行处 理并控制显示器 82显示。 该控制处理器 81 的驱动单元是设置为通过以下方式将数字触控信号转 换为该 PC能够识别和处理的操作控制信号： 获取该 PC的显示器的分辨率 ( Χ2* Υ2 ) , 以及获取该 UE的触摸屏的宽度 (Χ0和高度（Y , 然后通过该 驱动程序的位置转化算法处理该 UE发送来的数字触控信号， 将触摸屏上的 触控位置转换成该 PC显示器上对应的位置，以得到该 PC可识别和处理的操 作控制信号， 该位置转化算法如下：
Figure imgf000017_0001
(PC), as shown in FIG. 8, the PC includes a control processor 81 and a display 82. The PC cooperates with the UE shown in FIG. 7 to implement a touch screen control PC function, and the control processor 81 of the PC includes a a driving unit that supports a touch screen control PC function, wherein: the driving unit of the control processor 81 is configured to: convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and control according to the operation The signal is processed and the display 82 is controlled to display. The driving unit of the control processor 81 is configured to convert the digital touch signal into an operation control signal that the PC can recognize and process by: obtaining the resolution of the display of the PC ( Χ 2 * Υ 2 ), and acquiring The width of the touch screen of the UE (Χ0 and height (Y, then the digital touch signal sent by the UE is processed by the position conversion algorithm of the driver, and the touch position on the touch screen is converted into a corresponding position on the PC display, In order to obtain an operation control signal recognizable and processed by the PC, the position conversion algorithm is as follows:
Figure imgf000017_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X 为触摸屏的宽度值； 为触摸屏的高度值； x2为显示器的 横坐标方向上的最大像素个数； Y2为显示器的纵坐标方向上的最大像素个 数； χ2为触控位置在显示器上的对应位置的横坐标值； y2为触控位置在显示 器上的对应位置的纵坐标值； "[ ]" 为取整运算符。 其中， 应用单元和驱动单元可以通过软件、 硬件或固件实现。 为了实现本发明第二实施例上述方法， 本发明实施例还提出一种通过移 动终端 （UE )触摸屏控制计算机（PC ) 的系统， 如图 9 所示， 包括本发明 第二实施例中的上述 UE和上述 PC, 该 UE与该 PC之间建立有物理连接和 通信传输通道， 其中： 该 UE设置为： 运行支持触摸屏控制 PC功能的应用程序， 启动触摸屏 控制 PC功能，将用户在触摸屏上对 PC的触摸操作转换为数字触控信号，并 将该数字触控信号发送给该 PC。 该 PC设置为： 运行支持触摸屏控制 PC功 能的驱动程序， 将该 UE发送来的该数字触控信号转换为该 PC能够识别和 处理的操作控制信号， 并根据该操作控制信号进行处理及显示。 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X is the width value of the touch screen; the height value of the touch screen; x 2 is the display The maximum number of pixels in the direction of the abscissa; Y 2 is the maximum number of pixels in the ordinate direction of the display; χ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the position of the touch on the display The ordinate value of the corresponding position; "[ ]" is the rounding operator. The application unit and the drive unit can be implemented by software, hardware or firmware. In order to implement the foregoing method of the second embodiment of the present invention, an embodiment of the present invention further provides a system for controlling a computer (PC) through a mobile terminal (UE), as shown in FIG. 9, including the above-mentioned second embodiment of the present invention. The UE and the PC, the UE and the PC establish a physical connection and a communication transmission channel, wherein: the UE is set to: run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, and place the user on the touch screen. The touch operation of the PC is converted into a digital touch signal, and the digital touch signal is transmitted to the PC. The PC is configured to: run a driver that supports the touch screen control PC function, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process and display according to the operation control signal.
当然， 本发明还可有其他多种实施例， 在不背离本发明精神及其实质的 些相应的改变和变形都应属于本发明所附的权利要求的保护范围。 The invention may, of course, be embodied in various other forms and modifications without departing from the spirit and scope of the invention.
工业实用性 本发明提出的一种通过移动终端触摸屏控制计算机的方法、 系统及移动 终端， 可以替代鼠标， 通过在移动终端触摸屏上操作来控制计算机动作， 方 便快捷， 丰富了计算机控制方案。 Industrial Applicability The present invention provides a method, system and mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.

Claims

权 利 要 求 书 Claim
1、 一种控制计算机（PC ) 的方法， 其特征在于， 所述方法使用移动终 端（UE )和 PC, 所述 UE加载了支持触摸屏控制 PC功能的应用程序和支持 触摸屏控制 PC功能的驱动程序， 所述方法包括： A method for controlling a computer (PC), characterized in that the method uses a mobile terminal (UE) and a PC, and the UE loads an application supporting a touch screen control PC function and a driver supporting a touch screen control PC function. , the method includes:
所述 UE运行所述应用程序以启动触摸屏控制 PC功能，将用户在 UE的 触摸屏上对 PC的触摸操作转换为数字触控信号， 然后运行所述驱动程序， 将所述数字触控信号转换为 PC能够识别和处理的操作控制信号， 并发送给 PC, 以通过对 UE触摸屏触摸操作控制 PC的操作。  The UE runs the application to activate a touch screen control PC function, converts a user's touch operation on the touch screen of the UE into a digital touch signal, and then runs the driver to convert the digital touch signal into An operation control signal that the PC can recognize and process is sent to the PC to control the operation of the PC by a touch operation on the UE touch screen.
2、 如权利要求 1所述的方法， 其中， 将所述数字触控信号转换为 PC能 够识别和处理的操作控制信号的步骤包括： 获取 PC的显示器的分辨率 X2* Y2和所述 UE的触摸屏的宽度 X和触摸 屏的高度 Yi; 2. The method according to claim 1, wherein the step of converting the digital touch signal into an operation control signal that the PC can recognize and process comprises: acquiring a resolution X 2 * Y 2 of the display of the PC and the The width X of the touch screen of the UE and the height Yi of the touch screen;
所述 UE通过所述驱动程序的位置转化算法将数字触控信号中触摸屏上 的各触控位置转换成 PC显示器上对应的位置，以得到 PC能够识别和处理的 操作控制信号， 所述位置转化算法如下：
Figure imgf000019_0001
The UE converts each touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm of the driver to obtain an operation control signal that the PC can recognize and process, and the position conversion The algorithm is as follows:
Figure imgf000019_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
3、 如权利要求 1所述的方法， 其中： 3. The method of claim 1 wherein:
UE运行所述应用程序的步骤之前还包括： 所述 UE建立所述 UE与所述 PC之间的物理连接通道； UE运行所述应用程序的步骤之后还包括： 判断所述 UE与所述 PC之间 是否建立了物理连接， 如果已建立， 则根据所述 UE与所述 PC之间的物理 连接对应的协议建立所述 UE与所述 PC的通信传输通道以实现所述 UE与所 述 PC之间的数据传输； 如果未建立， 则自动退出该触摸屏控制 PC功能。 Before the step of the UE running the application, the method further includes: the UE establishing a physical connection channel between the UE and the PC; after the step of the UE running the application, the method further includes: determining the UE and the PC Between Whether a physical connection is established, if established, establishing a communication transmission channel between the UE and the PC according to a protocol corresponding to the physical connection between the UE and the PC, to implement between the UE and the PC Data transmission; if not established, the touch screen control PC function is automatically quit.
4、 一种移动终端 （UE ) , 其包括触摸屏传感器模块、 触摸屏控制器模 块以及终端平台模块， 其中： 所述触摸屏传感器模块设置为： 在接收到终端平台模块发送的启动触摸 屏控制计算机（PC )功能的指示后， 感测用户在触摸屏上对 PC的触摸操作， 产生模拟触控信号； 所述触摸屏控制器模块设置为： 将所述触摸屏传感器模块产生的所述模 拟触控信号转换为数字触控信号后发送给终端平台模块； 以及 所述终端平台模块包括一支持触摸屏控制 PC功能的应用单元和一支持 触摸屏控制 PC功能的驱动单元； 所述应用单元设置为： 启动触摸屏控制 PC功能并向所述触摸屏传 感器模块发送启动触摸屏控制 PC功能的指示， 以及 所述驱动单元设置为： 将所述触摸屏控制器模块提供的所述数字触 控信号转换成 PC能够识别和处理的操作控制信号后发送给 PC, 以通过 对 UE触摸屏触摸操作控制 PC的操作。 A mobile terminal (UE), comprising a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: the touch screen sensor module is configured to: start a touch screen control computer (PC) sent by the terminal platform module After the function is instructed, the user touches the touch operation of the PC on the touch screen to generate an analog touch signal; the touch screen controller module is configured to: convert the analog touch signal generated by the touch screen sensor module into a digital touch The control signal is sent to the terminal platform module; and the terminal platform module includes an application unit that supports the touch screen to control the PC function and a driving unit that supports the touch screen to control the PC function; the application unit is configured to: start the touch screen to control the PC function and The touch screen sensor module sends an indication to activate the touch screen control PC function, and the driving unit is configured to: convert the digital touch signal provided by the touch screen controller module into an operation control signal that can be recognized and processed by the PC, and then send the Give the PC to pass The operation of the PC is controlled for the UE touch screen touch operation.
5、 如权利要求 4所述的移动终端， 其中： 所述驱动单元是设置为按如下方式将数字触控信号转换成 PC能够识别 和处理的操作控制信号： 获取 PC的显示器的分辨率 X2* Y2以及所述 UE的触摸屏的宽度 和触 摸屏的高度 Yl 通过位置转化算法将数字触控信号中触摸屏上的触控位置转 换成 PC显示器上对应的位置， 以得到 PC能够识别和处理的操作控制信号， 所述位置转化算法如下： 5. The mobile terminal of claim 4, wherein: the driving unit is configured to convert the digital touch signal into an operation control signal that the PC can recognize and process as follows: Acquire a resolution of the display of the PC X 2 * Y 2 and the width of the touch screen of the UE and the height Y l of the touch screen convert the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by the position conversion algorithm to obtain the PC capable of being recognized and processed. Operating the control signal, the position conversion algorithm is as follows:
「 x2 = [X2 * x^] 其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 " x 2 = [X 2 * x^] Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
6、 如权利要求 5所述的移动终端， 其中： 所述应用单元还设置为： 在启动触摸屏控制 PC 功能后， 判断所述 UE 与 PC之间是否建立了物理连接， 如果已建立， 则根据所述 UE与 PC之间的 物理连接对应的协议建立所述 UE与 PC的通信传输通道，以实现所述 UE与 PC之间的数据传输； 如果未建立， 则自动退出所述触摸屏控制 PC功能。 The mobile terminal according to claim 5, wherein: the application unit is further configured to: after starting the touch screen control PC function, determining whether a physical connection is established between the UE and the PC, if established, according to Establishing a communication transmission channel between the UE and the PC by using a protocol corresponding to the physical connection between the UE and the PC, so as to implement data transmission between the UE and the PC; if not, automatically exiting the touch screen to control the PC function. .
7、 一种控制计算机（PC ) 的系统， 其包括如权利要求 4~6中任何一项 所述的 UE和一 PC, 其中： 所述 PC设置为： 根据所述 UE发送来的操作控制信号执行操作并显示。 A system for controlling a computer (PC), comprising the UE and a PC according to any one of claims 4 to 6, wherein: the PC is set to: an operation control signal transmitted according to the UE Perform the operation and display it.
8、 一种控制计算机（PC ) 的方法， 其特征在于， 所述方法使用加载了 支持触摸屏控制 PC功能的应用程序的 UE, 以及加载了支持触摸屏控制 PC 功能的驱动程序的 PC, 所述方法包括： 所述 UE运行所述应用程序以启动触摸屏控制 PC功能，将用户在 UE的 触摸屏上对 PC的触摸操作转换为数字触控信号， 然后将所述数字触控信号 发送给所述 PC; 所述 PC运行所述驱动程序， 将所述 UE发送来的所述数字触控信号转 换为所述 PC能够识别和处理的操作控制信号， 并根据所述操作控制信号进 行处理及显示。 8. A method of controlling a computer (PC), the method comprising: a UE loaded with an application supporting a touch screen control PC function, and a PC loaded with a driver supporting a touch screen control PC function, the method The method includes: the UE running the application to activate a touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then transmitting the digital touch signal to the PC; The PC runs the driver, converts the digital touch signal sent by the UE into an operation control signal that can be recognized and processed by the PC, and performs processing and display according to the operation control signal.
9、 如权利要求 8所述的方法， 其中， 将数字触控信号转换为所述 PC能 够识别和处理的操作控制信号的步骤包括： 获取 PC的显示器的分辨率 X2* Y2和 UE的触摸屏的宽度 X和触摸屏的 高度 ; 所述 PC通过所述位置转化算法将所述数字触控信号中触摸屏上的各触 控位置转换成所述 PC显示器上对应的位置，以得到所述 PC能够识别和处理 的操作控制信号， 所述位置转化算法如下：
Figure imgf000022_0001
9. The method of claim 8, wherein converting the digital touch signal into an operation control signal that the PC can recognize and process comprises: obtaining a resolution of the display of the PC X 2 * Y 2 and the UE The width X of the touch screen and the height of the touch screen; The PC converts each touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using the position conversion algorithm to obtain an operation control signal that the PC can recognize and process. The location conversion algorithm is as follows:
Figure imgf000022_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
10、 如权利要求 8所述的方法， 其中: 10. The method of claim 8 wherein:
UE运行所述应用程序的步骤之前还包括： 建立所述 UE与所述 PC之间 的物理连接通道； Before the step of running the application by the UE, the method further includes: establishing a physical connection channel between the UE and the PC;
UE运行所述应用程序的步骤之后还包括： 判断所述 UE与所述 PC之间 是否建立了物理连接， 如果已建立， 则根据所述 UE与所述 PC之间的物理 连接对应的协议建立所述 UE与所述 PC的通信传输通道，以实现所述 UE与 所述 PC之间的数据传输； 如果未建立， 则自动退出该触摸屏控制 PC功能。 After the step of the UE running the application, the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing a protocol according to a physical connection between the UE and the PC. The communication transmission channel between the UE and the PC is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
11、 一种移动终端（UE ) , 其包括触摸屏传感器模块、 触摸屏控制器模 块以及终端平台模块， 其中： 所述触摸屏传感器模块设置为： 在接收到终端平台模块启动触摸屏控制 计算机（PC )功能的指示后， 感测用户在触摸屏上对 PC的触摸操作， 产生 模拟触控信号； 所述触摸屏控制器模块设置为： 将所述触摸屏传感器模块产生的所述模 拟触控信号转换为数字触控信号后发送给所述终端平台模块； 以及 所述终端平台模块包括一支持触摸屏控制 PC功能的应用单元， 所述应用单元设置为： 启动触摸屏控制 PC功能， 向所述触摸屏传 感器模块发送启动触摸屏控制 PC功能的指示， 以及将所述触摸屏控制 器模块提供的数字触控信号发送给 PC, 以通过对 UE触摸屏触摸操作控 制 PC的操作。 A mobile terminal (UE), comprising a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: the touch screen sensor module is configured to: activate a touch screen control computer (PC) function after receiving the terminal platform module After the indication, the user touches the touch operation of the PC on the touch screen to generate an analog touch signal; the touch screen controller module is configured to: convert the analog touch signal generated by the touch screen sensor module into a digital touch signal And then sent to the terminal platform module; and the terminal platform module includes an application unit that supports a touch screen control PC function, and the application unit is configured to: start a touch screen control PC function, and send a touch screen control PC to the touch screen sensor module. Function indication, and control of the touch screen The digital touch signal provided by the module is sent to the PC to control the operation of the PC by touching the touch screen of the UE.
12、 如权利要求 11所述的移动终端， 其中： 12. The mobile terminal of claim 11, wherein:
所述应用单元还设置为： 判断所述 UE与所述 PC之间是否建立了物理 连接， 如果已建立， 则根据所述 UE与所述 PC之间的物理连接对应的协议 建立所述 UE与所述 PC的通信传输通道， 以实现所述 UE与所述 PC之间的 数据传输； 如果未建立， 则自动退出该触摸屏控制 PC功能。  The application unit is further configured to: determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE according to a protocol corresponding to a physical connection between the UE and the PC The communication transmission channel of the PC is configured to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
13、 一种计算机（PC ) , 其设置为： 与权利要求 11或者 12所述的移动 终端 （UE )相配合以实现触摸屏控制 PC功能， 所述 PC包含一支持触摸屏 控制 PC功能的驱动单元， 其中： 所述驱动单元设置为： 接收所述 UE发送来的数字触摸信号， 将所述数 字触控信号转换为所述 PC能够识别和处理的操作控制信号， 并根据所述操 作控制信号进行处理及显示。 13. A computer (PC) configured to: cooperate with a mobile terminal (UE) according to claim 11 or 12 to implement a touch screen control PC function, the PC comprising a drive unit supporting a touch screen control PC function, The driving unit is configured to: receive a digital touch signal sent by the UE, convert the digital touch signal into an operation control signal that can be recognized and processed by the PC, and process according to the operation control signal And display.
14、 如权利要求 13所述的计算机， 其中： 14. The computer of claim 13 wherein:
所述驱动单元是设置为按如下方式将所述数字触控信号转换为所述 PC 能够识别和处理的操作控制信号： 获取该 PC的显示器的分辨率 X2* Y2, 以及获取该 UE的触摸屏的宽度 Χι和高度 Yl 然后通过位置转化算法将所述数字触控信号中触摸屏上的触控 位置转换成所述 PC显示器上对应的位置，以得到所述 PC能够识别和处理的 操作控制信号， 所述位置转化算法如下：
Figure imgf000023_0001
The driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution X 2 * Y 2 of the display of the PC, and acquiring the UE Χ ι touch screen width and a height position of Y l and then converted by a digital algorithm to convert the signal in the touch position of the touch on the touch screen corresponding to a position on the PC display, the PC is able to obtain identification and processing operations The control signal, the position conversion algorithm is as follows:
Figure imgf000023_0001
其中， ^为触控位置在触摸屏上的横坐标值； 为触控位置在触摸屏上 的纵坐标值； X2为显示器的横坐标方向上的最大像素个数； Y2为显示器的纵 坐标方向上的最大像素个数； χ2为触控位置在显示器上的对应位置的横坐标 值； y2为触控位置在显示器上的对应位置的纵坐标值； "[ ]"为取整运算符。 Where ^ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; χ2 is the abscissa of the corresponding position of the touch position on the display Value; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
15、 一种控制计算机（PC )的系统， 其包括一如权利要求 11或者 12所 述的 UE, 以及一如权利要求 13或者 14所述的 PC, 所述 UE与所述 PC之 间建立有物理连接和通信传输通道， 其中： A system for controlling a computer (PC), comprising a UE according to claim 11 or 12, and a PC according to claim 13 or 14, wherein the UE and the PC are established Physical connection and communication transmission channel, where:
所述 UE设置为： 运行支持触摸屏控制 PC功能的应用程序以启动触摸 屏控制 PC功能， 将用户在触摸屏上对 PC的触摸操作转换为数字触控信号， 并将所述数字触控信号发送给所述 PC; 所述 PC设置为： 运行支持触摸屏控制 PC功能的驱动程序， 将所述 UE 发送来的所述数字触控信号转换为所述 PC能够识别和处理的操作控制信号， 并根据所述操作控制信号进行处理及显示。  The UE is configured to: run an application that supports the touch screen to control the PC function to activate the touch screen to control the PC function, convert the touch operation of the user on the touch screen to the digital touch signal, and send the digital touch signal to the The PC is configured to: run a driver that supports the touch screen control PC function, and convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and according to the The operation control signal is processed and displayed.
PCT/CN2010/071846 2009-09-16 2010-04-16 Method, system for controlling computer, and mobile terminal WO2011032381A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200910174284A CN101667079A (en) 2009-09-16 2009-09-16 Method for controlling computer by touch screen of mobile terminal, system and mobile terminal
CN200910174284.5 2009-09-16

Publications (1)

Publication Number Publication Date
WO2011032381A1 true WO2011032381A1 (en) 2011-03-24

Family

ID=41803716

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/071846 WO2011032381A1 (en) 2009-09-16 2010-04-16 Method, system for controlling computer, and mobile terminal

Country Status (2)

Country Link
CN (1) CN101667079A (en)
WO (1) WO2011032381A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103280169A (en) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 Electronic touch indicating board for exhibition centers
CN103280166A (en) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 Electronic touch indicating board for exhibition centers
EP2824551A4 (en) * 2012-03-07 2015-05-06 Zte Corp Method, device, and system for controlling computer terminal

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9144648B2 (en) 2006-05-03 2015-09-29 Antares Pharma, Inc. Injector with adjustable dosing
CN101667079A (en) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 Method for controlling computer by touch screen of mobile terminal, system and mobile terminal
KR20120096787A (en) * 2011-02-23 2012-08-31 삼성전자주식회사 Method for authenticating mobile device and display apparatus, and mobile device authentication system
JP6124169B2 (en) * 2012-06-08 2017-05-10 クラリオン株式会社 Display device
FR2994738B1 (en) * 2012-08-22 2014-08-01 Seb Sa ELECTRONIC WEIGHING APPARATUS
CN103208271B (en) * 2013-02-22 2015-12-23 京东方科技集团股份有限公司 A kind of display device and display system and control method
WO2014183343A1 (en) * 2013-05-17 2014-11-20 中兴通讯股份有限公司 Apparatus for implementing touchpad function by using touchscreen, touchscreen, and electronic device
CN106227433A (en) * 2016-07-08 2016-12-14 深圳埃蒙克斯科技有限公司 A kind of based on mobile terminal the control method of PC, mobile terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470544A (en) * 2007-12-27 2009-07-01 深圳富泰宏精密工业有限公司 Analog mouse system and method
CN101667079A (en) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 Method for controlling computer by touch screen of mobile terminal, system and mobile terminal

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470544A (en) * 2007-12-27 2009-07-01 深圳富泰宏精密工业有限公司 Analog mouse system and method
CN101667079A (en) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 Method for controlling computer by touch screen of mobile terminal, system and mobile terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2824551A4 (en) * 2012-03-07 2015-05-06 Zte Corp Method, device, and system for controlling computer terminal
CN103280169A (en) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 Electronic touch indicating board for exhibition centers
CN103280166A (en) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 Electronic touch indicating board for exhibition centers

Also Published As

Publication number Publication date
CN101667079A (en) 2010-03-10

Similar Documents

Publication Publication Date Title
WO2011032381A1 (en) Method, system for controlling computer, and mobile terminal
US9729608B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
JP2018139132A5 (en)
JP2011048610A (en) Image display system and image display method
WO2015024252A1 (en) Remote controller, information processing method and system
EP2367098A3 (en) Portable device and control method thereof
JPWO2014098164A1 (en) Image display device, portable terminal device, information processing system, image display device control method, and program
WO2015024198A1 (en) Handheld device and method for adjusting position of input area thereon
WO2021121140A1 (en) Display control method, reminding method, and electronic device
TWI475421B (en) Method of touch command integration and touch system using the same
TW201447737A (en) Method and system for operating display device
WO2013162111A1 (en) System for user experience-based driving of smart tv using motion sensor, and method therefor
KR101579462B1 (en) Multi-touch screen system touch screen apparatus and method for dividing touch screen
KR20130028504A (en) Auxiliary displaying apparatus having a function of controlling a smart phone and smart phone having a function of surpporting a auxiliary displaying apparatus
JP5772669B2 (en) User terminal device, image processing device, operator terminal device, information processing system, and program
KR20110034137A (en) Image processing apparatus and method of controlling an input thereof
EP2639687A3 (en) Display apparatus and control method thereof
JP2015163930A (en) Image projection device, control method of image projection device, and control program of image projection device
CN110440825B (en) Distance display method and terminal
KR102254873B1 (en) KVM switching apparatus used in monitor with PBP function
KR100594715B1 (en) A portable information processing system providing pivot function
US8567959B2 (en) Optical sensor and projection system thereof
KR100644034B1 (en) Apparatus And Method For Two-Dimensional User Interface In The Mobile Communication Terminal
CN109240526B (en) Same-screen display system and measurement and control method thereof
KR101069015B1 (en) Apparatus And Method For Three-Dimensional User Interface In The Mobile Communication Terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10816585

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10816585

Country of ref document: EP

Kind code of ref document: A1