WO2011032381A1 - Procédé, système de commande d'un ordinateur, et terminal mobile - Google Patents

Procédé, système de commande d'un ordinateur, et terminal mobile Download PDF

Info

Publication number
WO2011032381A1
WO2011032381A1 PCT/CN2010/071846 CN2010071846W WO2011032381A1 WO 2011032381 A1 WO2011032381 A1 WO 2011032381A1 CN 2010071846 W CN2010071846 W CN 2010071846W WO 2011032381 A1 WO2011032381 A1 WO 2011032381A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch screen
touch
signal
display
function
Prior art date
Application number
PCT/CN2010/071846
Other languages
English (en)
Chinese (zh)
Inventor
屈胜
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2011032381A1 publication Critical patent/WO2011032381A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers

Definitions

  • the present invention relates to the field of communications, and in particular, to the field of mobile terminal applications.
  • the technical problem to be solved by the present invention is to provide a method, system and mobile terminal for controlling a computer, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick.
  • the present invention provides a method for controlling a computer (PC), which uses a mobile terminal (UE) and a PC, and the UE loads an application supporting a touch screen to control a PC function and supports a touch screen to control a PC function.
  • the UE of the driver includes: the UE running the application to activate the touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then running the driver,
  • the digital touch signal is converted into an operation control signal that the PC can recognize and process, and sent to the PC to control the operation of the PC by a touch operation on the UE touch screen.
  • the step of converting the digital touch signal into an operation control signal that the PC can recognize and process includes: obtaining a resolution X 2 * Y 2 of the display of the PC and a width of the touch screen of the UE and a height of the touch screen;
  • the UE converts each touch position on the touch screen of the digital touch signal into a corresponding position on the PC display through the position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC.
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operator.
  • the method further includes: establishing a physical connection channel between the UE and the PC;
  • the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC
  • the communication transmission channel of the PC is used to transmit data between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein: the touch screen sensor module is configured to: send the terminal platform module to receive After the instruction of the touch screen control computer (PC) function is activated, the touch operation of the user on the touch screen is sensed to generate an analog touch signal; the touch screen controller module is configured to: the analog touch generated by the touch screen sensor module The signal is converted into a digital touch signal and sent to the terminal platform module; and the terminal platform module includes an application unit that supports the touch screen to control the PC function and a driving unit that supports the touch screen to control the PC function; the application unit is configured to: start the touch screen control The PC function and sends an indication to the touch screen sensor module to activate the touch screen control PC function, and The driving unit is configured to: convert the digital touch signal provided by the touch screen controller module into an operation control signal that can be recognized and processed by the PC, and then send the operation control signal to the PC to control the operation of the
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC as follows: acquire the resolution of the display of the PC X 2 * Y 2 , and acquire the width of the touch screen of the UE and the touch screen The height Y l converts the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by the position conversion algorithm to obtain an operation control signal that the PC can recognize and process.
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the ordinate value of the corresponding position of the touch position on the display; "[ ]" is the rounding operation
  • the application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE according to a protocol corresponding to the physical connection between the UE and the PC. a communication transmission channel of the PC, the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen is automatically exited to control the PC function
  • the present invention further provides a system for controlling a computer (PC), comprising a UE and a PC as described above, wherein: the PC is configured to: perform an operation according to an operation control signal sent by the UE and display.
  • PC computer
  • the present invention also proposes another method of controlling a computer (PC) using a UE loaded with an application supporting a touch screen to control a PC function, and loaded A PC supporting a touch screen to control a PC function driver, the method comprising: the UE running the application to activate a touch screen control PC function, converting a touch operation of the user on the touch screen of the UE to a digital touch signal, and then The digital touch signal is sent to the PC; the PC runs the driver, converts the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and processes and displays according to the operation control signal.
  • the step of converting the digital touch signal into the operation control signal that the PC can recognize and process comprises: obtaining the resolution X 2 * Y 2 of the display of the PC and the width of the touch screen of the UE and the height of the touch screen;
  • the PC converts each touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm of the driver to obtain an operation control signal that can be recognized and processed by the PC.
  • the conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen;
  • X 2 is the maximum number of pixels in the abscissa direction of the display;
  • Y 2 is the ordinate direction of the display The maximum number of pixels on the top;
  • ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display;
  • y2 is the ordinate value of the corresponding position of the touch position on the display;
  • "[ ]" is the rounding operator.
  • the method further includes: establishing a physical connection channel between the UE and the PC;
  • the method further includes: determining whether a physical connection is established between the UE and the PC, and if yes, establishing the UE according to a protocol corresponding to the physical connection between the UE and the PC
  • the communication transmission channel of the PC is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module, a touch screen controller module, and a terminal platform module, wherein:
  • the touch screen sensor module is configured to: after receiving the indication that the terminal platform module activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen on the touch screen, generating an analog touch signal;
  • the touch screen controller module is set to The analog touch signal generated by the touch screen sensor module is converted into a digital touch signal and sent to the terminal platform module;
  • the terminal platform module includes an application unit that supports the touch screen to control the PC function, and the application unit is set to: start The touch screen controls the PC function, sends an indication to the touch screen sensor module to activate the touch screen control PC function, and sends the digital touch signal provided by the touch screen controller module to the PC to control the operation of the PC by touching the touch screen of the UE.
  • the application unit is further configured to: determine whether a physical connection is established between the UE and the PC, and if established, establish a communication transmission between the UE and the PC according to a protocol corresponding to a physical connection between the UE and the PC. Channel to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a computer (PC), which is configured to: cooperate with the mobile terminal (UE) to implement a touch screen control PC function, and the PC includes a driving unit that supports a touch screen to control a PC function. among them:
  • the driving unit is configured to: receive a digital touch signal sent by the UE, convert the digital touch signal into an operation control signal that can be recognized and processed by the PC, and process and display according to the operation control signal.
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution X 2 * Y 2 of the display of the PC, and acquiring the UE Touching the width X of the touch screen and the height of the touch screen, and then converting the touch position on the touch screen in the digital touch signal into a corresponding position on the PC display by using a position conversion algorithm to obtain an operation control signal recognizable and processed by the PC , the location conversion algorithm is as follows: Where ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X 2 is the maximum number of pixels in the abscissa direction of the display; Y 2 is the ordinate direction of the display The maximum number of pixels on the top;
  • the present invention further provides a system for controlling a computer (PC), comprising a UE as described above, and a PC as described above, wherein a physical connection and a communication transmission channel are established between the UE and the PC.
  • the UE is configured to run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, convert the touch operation of the user on the touch screen to the digital touch signal, and send the digital touch signal to the
  • the PC is configured to run a driver that supports the function of the touch screen to control the PC, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process the signal according to the operation control signal. display.
  • the invention provides a method, a system and a mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.
  • FIG. 1 is a flow chart of a method for detecting a computer controlled by a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 2 is a flow chart of a data processing method for controlling a computer by a touch screen of a mobile terminal according to a first embodiment of the present invention
  • 3 is a block diagram showing the structure of a mobile terminal according to a first embodiment of the present invention
  • FIG. 4 is a block diagram showing a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 5 is a second embodiment of the present invention.
  • FIG. 6 is a flow chart showing a data processing method for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention
  • FIG. 7 is a block diagram showing a configuration of a mobile terminal according to a first embodiment of the present invention
  • FIG. 8 is a computer according to a first embodiment of the present invention
  • FIG. 9 is a block diagram of a system for controlling a computer through a touch screen of a mobile terminal according to a first embodiment of the present invention.
  • a mobile terminal User Equipment , UE
  • touch screen function a mobile terminal with touch screen function
  • a physical connection is established between the UE and the PC.
  • the physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared.
  • the UE runs an application supporting the touch screen control PC function to activate the touch screen control PC function of the present invention, and then performs channel detection to ensure that the UE and the PC can communicate normally.
  • an application and a driver that support the touch screen control PC function of the present invention are all loaded to the UE side.
  • the UE runs an application that supports the touch screen to control the PC function, and after the touch screen control PC function of the present invention is started, the UE performs channel detection.
  • the specific method is as shown in FIG. 1 , including the following steps: Step S101 : The UE runs an application that supports the touch screen to control the PC function. , start the touch screen Controlling the PC function; Step S102: The UE determines whether it has successfully established a physical connection with the PC.
  • Step S103 The UE establishes its a communication transmission channel with the PC, if the communication transmission channel is successfully established, proceeding to step S104; if not, automatically exiting the function and ending;
  • the UE selects the corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol.
  • Step S104 The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, runs a driver supporting the touch screen control PC function, and converts the digital touch signal into The operation control signal that can be recognized and processed by the PC is sent to the PC to implement control of the PC by the UE. While performing step S104, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal. When the physical connection or the communication transmission channel is disconnected, the touch screen control PC function is automatically exited, and the process ends; Step S105: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
  • Step S201 After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC. Touch operations, such as clicking, swiping, etc., to generate an analog touch signal, for example, to generate a voltage or signal change; the UE senses the user's operation of the UE according to a conventional method when the touch screen control PC function is not activated. After starting the touch screen to control the PC function, the user's operation on the PC is perceived.
  • the UE may perform a touch screen control PC function interface after starting the touch screen control PC function, and the user is in the The control of the PC is realized by a touch operation on the interface.
  • Step S202 The UE converts the analog touch signal into a digital touch signal; the existing UE with the touch screen function obtains the touch position ( Xl , yi) and the touch by performing coordinate analysis and speed analysis on the digital touch signal. Control actions, such as swiping, clicking, double-clicking, etc.
  • the touch signal generated by the touch screen of the UE can be considered to control the PC operation, thereby proposing a new PC control scheme, and with the popularity of the touch screen mobile terminal and people
  • This solution has great market value for the improvement of PC portability requirements.
  • the position coordinates generated on the touch screen are in units of lengths such as meters, decimeters, centimeters, and millimeters
  • the display is displayed in units of pixels, that is, the touch position unit on the touch screen and the display.
  • the display unit is different.
  • the current PC cannot recognize the touch signal of the mobile terminal.
  • Step S203 The UE runs a driver that supports the touch screen control PC function, and communicates with the PC. Establishing a communication transmission channel to obtain a resolution ( ⁇ 2 * ⁇ 2 ) of the display of the PC, and acquiring a width and a height of the touch screen of the UE;
  • Step S204 the UE processes the digital touch signal by using a position conversion algorithm of the driver, Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
  • ⁇ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit; X 2 is the maximum number of pixels in the horizontal direction of the display; Y 2 is the maximum number of pixels in the ordinate direction of the display; ⁇ 2 is the touch
  • the absc issa value of the corresponding position of the control position on the display, which is in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is like Prime is the unit; "[ ]" is the rounding operator.
  • Step S205 The UE sends the operation control signal to the PC through the communication transmission channel established by the UE and the PC.
  • the PC when the PC is operated by the mouse, the PC performs coordinate and speed analysis by the operation control signal generated by the mouse movement, thereby obtaining the operation position and the operation action, and then performing corresponding operations and displaying according to the analysis result.
  • the touch signal is generated by the touch screen of the UE, and is converted into an operation control signal recognizable by the PC, and then the control signal of the mouse is replaced by the operation control signal generated by the mouse, enriching the PC.
  • the control scheme has no special requirements for the PC, and it is simple and convenient to implement.
  • the present invention further provides a mobile terminal (UE), including a touch screen sensor module 31, a touch screen controller module 32, and a terminal platform module 33, wherein: the touch screen sensor module 31
  • UE mobile terminal
  • the touch screen sensor module 31 The method is as follows: after the terminal platform module 33 activates the touch screen control computer (PC) function, sensing a touch operation of the user on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example, generating a Voltage or signal change.
  • PC touch screen control computer
  • the touch screen controller module 32 includes: a ⁇ / ⁇ converter 321 and a data transfer controller 322, wherein: the A/D converter 321 is configured to: acquire an analog touch signal generated by the touch screen sensor module 31, and convert the same into a digital Touch signal.
  • the data transmission controller 322 is configured to: transmit the digital touch signal to the terminal platform module 33 through a transmission interface such as a serial port.
  • the terminal platform module 33 includes: an application unit supporting a touch screen control PC function and a driving unit supporting a touch screen control PC function, wherein the application unit is configured to: activate a touch screen control PC function and send a start touch screen control to the touch screen sensor module PC function indication to And the driving unit is configured to: convert the digital touch signal provided by the touch screen controller module 32 into an operation control signal that can be recognized and processed by the PC, and then send the signal to the PC to control the operation of the PC by touching the touch screen of the UE.
  • the application unit and the drive unit can be implemented by software, hardware or firmware.
  • the driving unit is configured to convert the digital touch signal into an operation control signal that can be recognized and processed by the PC by: obtaining a resolution (X 2 * Y 2 ) of the display of the PC, and a width of the touch screen of the UE ( ⁇ 0 and height ( ), then the digital touch signal is processed by the position conversion algorithm, and the touch position on the touch screen is converted into a corresponding position on the PC display to obtain an operation control signal recognizable and processed by the PC, the position conversion algorithm as follows:
  • the application unit is further configured to: after starting the touch screen to control the PC function, determine whether a physical connection is established between the UE and the PC, and if yes, establish the UE and the PC according to a protocol corresponding to the physical connection between the UE and the PC.
  • the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • the present invention further provides a system for controlling a computer through a touch screen of a mobile terminal, comprising a UE and a PC shown in FIG. 3, the PC comprising a control processor 41 and a display 42, wherein:
  • the UE establishes a physical connection with the PC.
  • the physical connection may be a wired connection, for example, connecting the UE to the PC through a USB data line, or may be a wireless connection, for example, connecting the UE to the PC through Bluetooth or infrared.
  • the UE and the PC also establish a communication transmission channel, and the communication transmission channel is based on the UE
  • the type of physical connection between PCs is established using the corresponding transport protocol. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then The communication transmission channel between the two is established by using the Bluetooth protocol.
  • the function of implementing the touch screen control PC in the first embodiment of the present invention is mainly implemented by the mobile terminal side, and there is no additional requirement for the PC.
  • the control processor 41 of the PC After receiving the operation control signal sent by the UE side, the control processor 41 of the PC follows the mouse. The operation control signal generated by the action is analyzed and processed in the same processing manner, and then the display 42 is controlled to be displayed, which is simple and convenient to implement.
  • an application supporting the touch screen control PC function of the present invention is loaded to the UE side, and a driver supporting the touch screen control PC function of the present invention is loaded to the PC side.
  • the second embodiment of the present invention differs from the above-described first embodiment mainly in that the processing position for converting the digital touch signal generated by the user to the touch operation of the PC into the PC-identifiable operation control signal is moved from the UE side to the PC side.
  • the channel detection flowchart is as shown in FIG.
  • Step S501 The UE runs an application that supports the touch screen to control the PC function, and starts the touch screen to control the PC function;
  • S502 The UE determines whether it has successfully established a physical connection with the PC, if the determination result is yes, then proceeds to step S503; if not, automatically exits the function, and ends;
  • step S503 the UE establishes a communication transmission channel with the PC, if If the communication transmission channel is successfully established, the process proceeds to step S504; if not, the function is automatically exited and ends;
  • the UE selects a corresponding transmission protocol according to the type of physical connection between the UE and the PC, and establishes a communication transmission channel between the UE and the PC. For example, if a physical connection is established between the UE and the PC through the USB data line, the communication transmission channel between the UE is established by using the USB transmission protocol; for example, a physical connection is established between the UE and the PC through Bluetooth, and then Established between the two using the Bluetooth protocol Communication transmission channel.
  • Step S504 The UE enters an operation interface of the touch screen control PC function, receives and recognizes a touch operation of the user on the touch screen by the user, generates a digital touch signal, and sends the digital touch signal to the PC, and the digital touch is performed by the PC.
  • the signal is converted to an operation control signal that the PC can recognize and process, and then processed and displayed.
  • the UE side is only responsible for generating a digital touch signal according to the user's touch operation on the touch screen on the touch screen and transmitting it to the PC, and correspondingly converting the digital touch signal into a PC identifiable operation.
  • the task of the control signal is completed by the PC side; while performing step S504, it is also possible to continuously determine whether the physical connection between the UE and the PC and the communication transmission channel are normal, and if the physical connection or the communication transmission channel is disconnected, the touch screen is automatically exited. Controlling the PC function, ending; Step S505: After the UE is turned off by the touch screen to control the PC function, the UE automatically exits the function and ends.
  • Step S601 After starting the touch screen control PC function, the UE enters the operation interface of the touch screen control PC, and perceives the user on the touch screen to the PC.
  • Step S602 The UE converts the analog touch signal into a digital touch signal and transmits the same
  • the unit of position coordinates generated on the touch screen is a unit of length measurement such as meters, decimeters, centimeters, millimeters, so the width X and height Yi of the touch screen are obtained here.
  • the display is displayed in units of pixels, so the position coordinates on the display are in pixels.
  • Step S604 The PC processes the digital touch signal by using a position conversion algorithm of the driver. Converting the touch position ( Xl , yi ) on the touch screen into a corresponding position (x 2 , y 2 ) on the PC display to obtain an operation control signal recognizable and processed by the PC, and the position conversion algorithm is as follows:
  • ⁇ is the horizontal coordinate value of the touch position on the touch screen, and the unit is the length measurement unit; the vertical coordinate value of the touch position on the touch screen, the unit is the length measurement unit; the width value of the touch screen, the unit is Length measurement unit; is the height value of the touch screen, the unit is the length measurement unit;
  • X 2 is the maximum number of pixels in the horizontal direction of the display;
  • Y 2 is the maximum number of pixels in the ordinate direction of the display;
  • ⁇ 2 is the touch
  • the absc issa value of the corresponding position of the control position on the display, in pixels; y2 is the ordinate value of the corresponding position of the touch position on the display, which is in pixels; "[ ]" is the rounding operator .
  • Step S605 The PC performs a corresponding operation according to the operation control signal, and displays.
  • the difference between the solution in FIG. 6 and the solution in FIG. 2 in the first embodiment is that, in the second embodiment, the UE side is only responsible for generating a digital touch signal according to a user's touch operation on the touch screen on the PC and The task is sent to the PC, and the corresponding task of converting the digital touch signal into the operation control signal recognizable by the PC is performed by the PC side, and the remaining steps are the same as those in the embodiment of FIG. 2, and details are not described herein again.
  • an embodiment of the present invention further provides a terminal, as shown in FIG. 7, including a touch screen sensor module 71, a touch screen controller module 72, and a terminal platform module 73, wherein: the touch screen sensor
  • the module 71 is configured to: after the terminal platform module 73 activates the touch screen control computer (PC) function, sense a user touch operation on the touch screen on the touch screen, such as clicking, swiping, etc., to generate an analog touch signal, for example Generate a voltage or signal change.
  • PC touch screen control computer
  • the touch screen controller module 72 includes: an A/D converter 721 and a data transmission controller 722, wherein: the A/D converter 721 is configured to: acquire an analog touch signal generated by the touch screen sensor module 71, And it is converted into a digital touch signal.
  • the data transmission controller 722 is configured to: transmit the digital touch signal to the terminal platform module 73 through a transmission interface such as a serial port.
  • the terminal platform module 73 includes an application unit that supports a touch screen control PC function, and the application unit is configured to: activate a touch screen to control a PC function, and display a digital touch signal provided by the touch screen controller module 72 after the touch screen control PC function is activated. Send to the PC to control the operation of the PC.
  • the application unit of the terminal platform module 73 is further configured to: after starting the touch screen control PC function, first determine whether a physical connection is established between the UE and the PC, and if established, according to the physical between the UE and the PC The corresponding protocol is connected to establish a communication transmission channel between the UE and the PC, and the communication transmission channel is used to implement data transmission between the UE and the PC; if not established, the touch screen control PC function is automatically exited.
  • an embodiment of the present invention further provides a computer
  • the PC includes a control processor 81 and a display 82.
  • the PC cooperates with the UE shown in FIG. 7 to implement a touch screen control PC function
  • the control processor 81 of the PC includes a a driving unit that supports a touch screen control PC function, wherein: the driving unit of the control processor 81 is configured to: convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and control according to the operation The signal is processed and the display 82 is controlled to display.
  • the driving unit of the control processor 81 is configured to convert the digital touch signal into an operation control signal that the PC can recognize and process by: obtaining the resolution of the display of the PC ( ⁇ 2 * ⁇ 2 ), and acquiring The width of the touch screen of the UE ( ⁇ 0 and height (Y, then the digital touch signal sent by the UE is processed by the position conversion algorithm of the driver, and the touch position on the touch screen is converted into a corresponding position on the PC display,
  • the position conversion algorithm is as follows:
  • ⁇ is the abscissa value of the touch position on the touch screen; the ordinate value of the touch position on the touch screen; X is the width value of the touch screen; the height value of the touch screen; x 2 is the display The maximum number of pixels in the direction of the abscissa; Y 2 is the maximum number of pixels in the ordinate direction of the display; ⁇ 2 is the abscissa value of the corresponding position of the touch position on the display; y2 is the position of the touch on the display The ordinate value of the corresponding position; "[ ]" is the rounding operator.
  • the application unit and the drive unit can be implemented by software, hardware or firmware.
  • an embodiment of the present invention further provides a system for controlling a computer (PC) through a mobile terminal (UE), as shown in FIG. 9, including the above-mentioned second embodiment of the present invention.
  • the UE and the PC, the UE and the PC establish a physical connection and a communication transmission channel, wherein: the UE is set to: run an application that supports the touch screen to control the PC function, activate the touch screen to control the PC function, and place the user on the touch screen.
  • the touch operation of the PC is converted into a digital touch signal, and the digital touch signal is transmitted to the PC.
  • the PC is configured to: run a driver that supports the touch screen control PC function, convert the digital touch signal sent by the UE into an operation control signal that the PC can recognize and process, and process and display according to the operation control signal.
  • the present invention provides a method, system and mobile terminal for controlling a computer through a touch screen of a mobile terminal, which can replace the mouse and control the computer action by operating on the touch screen of the mobile terminal, which is convenient and quick, and enriches the computer control scheme.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un procédé de commande d'un ordinateur, lequel procédé utilise un terminal mobile et un ordinateur. Le terminal mobile est chargé par une application assistant la fonction au moyen de laquelle un écran tactile commande un ordinateur et un pilote assistant la fonction selon laquelle l'écran tactile commande l'ordinateur. Le procédé comprend les opérations suivantes : le terminal mobile agit sur l'application afin de démarrer la fonction au moyen de laquelle l'écran tactile commande l'ordinateur, convertit l'opération tactile de commande de l'ordinateur sur l'écran tactile du terminal mobile par un utilisateur en un signal numérique de commande tactile, actionne le pilote, convertit le signal numérique de commande tactile en un signal de commande d'opération pouvant être identifié et traité par l'ordinateur, et adresse le signal à l'ordinateur afin de commander le fonctionnement de l'ordinateur par l'opération tactile sur l'écran tactile du terminal mobile. L'invention concerne également un système de commande de l'ordinateur et du terminal mobile. Le procédé, le système et le terminal mobile peuvent commander les actions d'un ordinateur au moyen des opérations sur un écran tactile d'un terminal mobile au lieu d'utiliser une souris. La solution est pratique et rapide, et enrichit les solutions de commande de l'ordinateur.
PCT/CN2010/071846 2009-09-16 2010-04-16 Procédé, système de commande d'un ordinateur, et terminal mobile WO2011032381A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200910174284A CN101667079A (zh) 2009-09-16 2009-09-16 通过移动终端触摸屏控制计算机的方法、系统及移动终端
CN200910174284.5 2009-09-16

Publications (1)

Publication Number Publication Date
WO2011032381A1 true WO2011032381A1 (fr) 2011-03-24

Family

ID=41803716

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/071846 WO2011032381A1 (fr) 2009-09-16 2010-04-16 Procédé, système de commande d'un ordinateur, et terminal mobile

Country Status (2)

Country Link
CN (1) CN101667079A (fr)
WO (1) WO2011032381A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103280169A (zh) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 展览中心电子触控指示牌
CN103280166A (zh) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 展览中心电子触控指示牌
EP2824551A4 (fr) * 2012-03-07 2015-05-06 Zte Corp Procédé, dispositif et système permettant de commander un terminal informatique

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007131025A1 (fr) 2006-05-03 2007-11-15 Antares Pharma, Inc. Injecteur à dosage réglable
CN101667079A (zh) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 通过移动终端触摸屏控制计算机的方法、系统及移动终端
KR20120096787A (ko) * 2011-02-23 2012-08-31 삼성전자주식회사 모바일 장치 인증 방법 및 이를 적용한 디스플레이 장치, 그리고 모바일 장치 인증 시스템
JP6124169B2 (ja) * 2012-06-08 2017-05-10 クラリオン株式会社 表示装置
FR2994738B1 (fr) * 2012-08-22 2014-08-01 Seb Sa Appareil electronique de pesee
CN103208271B (zh) * 2013-02-22 2015-12-23 京东方科技集团股份有限公司 一种显示装置和显示系统及控制方法
WO2014183343A1 (fr) * 2013-05-17 2014-11-20 中兴通讯股份有限公司 Appareil de mise en œuvre d'une fonction de pavé tactile au moyen d'un écran tactile, écran tactile, et dispositif électronique
CN106227433A (zh) * 2016-07-08 2016-12-14 深圳埃蒙克斯科技有限公司 一种基于移动终端控制pc的方法、移动终端

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470544A (zh) * 2007-12-27 2009-07-01 深圳富泰宏精密工业有限公司 模拟鼠标系统及方法
CN101667079A (zh) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 通过移动终端触摸屏控制计算机的方法、系统及移动终端

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101470544A (zh) * 2007-12-27 2009-07-01 深圳富泰宏精密工业有限公司 模拟鼠标系统及方法
CN101667079A (zh) * 2009-09-16 2010-03-10 中兴通讯股份有限公司南京分公司 通过移动终端触摸屏控制计算机的方法、系统及移动终端

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2824551A4 (fr) * 2012-03-07 2015-05-06 Zte Corp Procédé, dispositif et système permettant de commander un terminal informatique
CN103280169A (zh) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 展览中心电子触控指示牌
CN103280166A (zh) * 2013-06-14 2013-09-04 苏州旭宇升电子有限公司 展览中心电子触控指示牌

Also Published As

Publication number Publication date
CN101667079A (zh) 2010-03-10

Similar Documents

Publication Publication Date Title
WO2011032381A1 (fr) Procédé, système de commande d'un ordinateur, et terminal mobile
US10948950B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
JP2018139132A5 (fr)
JP2011048610A (ja) 画像表示システム、及び画像表示方法
WO2015024252A1 (fr) Télécommande, procédé et système de traitement d'informations
EP2367098A3 (fr) Dispositif portable et procédé de contrôle correspondant
US20090289906A1 (en) Method and system for controlling an electronic device with an external touch panel
JP2011138039A (ja) 表示装置、表示制御方法、および表示制御プログラム
JPWO2014098164A1 (ja) 画像表示装置、携帯端末装置、情報処理システム、画像表示装置制御方法及びプログラム
CN102999284A (zh) 传输方法和电子设备
TWI475421B (zh) 觸控指令整合方法及觸控系統
TW201447737A (zh) 顯示裝置操作方法及系統
WO2013162111A1 (fr) Système de pilotage fondé sur l'expérience utilisateur d'un téléviseur intelligent utilisant un capteur de mouvement, et procédé associé
KR101579462B1 (ko) 멀티 터치 스크린 시스템과 터치 스크린 장치 및 터치 스크린 분할 방법
KR20130028504A (ko) 양방향통신을 이용하는 휴먼인터페이스상에서 상이 해상도 공조 가능한 모바일 장치
JP6349886B2 (ja) 画像投射装置、画像投射装置の制御方法、および画像投射装置の制御プログラム
JP5772669B2 (ja) ユーザー端末装置、画像処理装置、オペレータ端末装置、情報処理システムおよびプログラム
EP2639687A3 (fr) Appareil d'affichage et son procédé de commande
CN110440825B (zh) 一种距离显示方法及终端
KR100594715B1 (ko) 피봇 기능을 제공하는 휴대용 정보처리 시스템
US8567959B2 (en) Optical sensor and projection system thereof
KR100644034B1 (ko) 이동통신 단말기에서의 2차원 사용자 인터페이스 장치 및방법
CN109240526B (zh) 同屏显示系统及其测控方法
KR101069015B1 (ko) 이동통신 단말기에서의 3차원 사용자 인터페이스 장치 및방법
KR20130006172A (ko) 디스플레이 시스템과 방법 및 디스플레이 단말과 통신하는 입력 단말

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10816585

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10816585

Country of ref document: EP

Kind code of ref document: A1