CN105487856A - Method and system for controlling touch screen application in display terminal by mobile terminal - Google Patents

Method and system for controlling touch screen application in display terminal by mobile terminal Download PDF

Info

Publication number
CN105487856A
CN105487856A CN201510821593.2A CN201510821593A CN105487856A CN 105487856 A CN105487856 A CN 105487856A CN 201510821593 A CN201510821593 A CN 201510821593A CN 105487856 A CN105487856 A CN 105487856A
Authority
CN
China
Prior art keywords
display terminal
coordinate
mobile terminal
touch screen
universal button
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510821593.2A
Other languages
Chinese (zh)
Inventor
周勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Shenzhen TCL Digital Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201510821593.2A priority Critical patent/CN105487856A/en
Publication of CN105487856A publication Critical patent/CN105487856A/en
Priority to PCT/CN2016/084268 priority patent/WO2017088429A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a method for controlling a touch screen application in a display terminal by a mobile terminal. The method comprises the following steps: when detecting click operation of a user on a preset universal button, the mobile terminal obtains coordinate information corresponding to the preset universal button clicked by the user, wherein mapping relationships between different universal buttons and different coordinate information are preset in the mobile terminal; the mobile terminal sends the coordinate information to the display terminal; the display terminal identifies a click instruction in a second coordinate position of the display terminal according to the coordinate information; and the display terminal controls the touch screen application running currently according to the click instruction. The invention furthermore discloses a system for controlling the touch screen application in the display terminal by the mobile terminal. According to the method and the system, the touch screen application running in the display terminal is controlled through the mobile terminal.

Description

Mobile terminal controls the method and system of touch screen application program on display terminal
Technical field
The present invention relates to field of intelligent control technology, particularly relate to the method and system that a kind of mobile terminal controls touch screen application program on display terminal.
Background technology
Along with the development of mobile terminal, touch operation function has become the basic function of most of mobile terminal, and increasing touch screen application program can be moved terminal and use.Due to the versatility of mobile terminal and display terminal platform, much based on mobile terminal touch screen application program can directly installation and operation on display terminal, but, touch screen application program all carries out operating and controlling based on touch screen, and do not possess touch screen functionality or because carrying out the reasons such as touch operation apart from inconvenience too far away to display terminal due to the display terminal had, inconveniently when user uses touch screen application program on display terminal directly on display terminal, carry out touch control.And mutually to access with display terminal easily by household wireless LAN due to mobile terminal and control, therefore, be badly in need of a kind of by mobile terminal to control the method for the touch screen application program that display terminal runs.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of mobile terminal to control the method and system of touch screen application program on display terminal, is intended to control by mobile terminal touch screen application program that display terminal runs.
For achieving the above object, a kind of mobile terminal provided by the invention controls the method for touch screen application program on display terminal, said method comprising the steps of:
When mobile terminal detects the clicking operation of user to default universal button, obtain the coordinate information that described default universal button that user clicks is corresponding, wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information;
Described coordinate information is sent to display terminal by described mobile terminal;
Described display terminal is identified in the click commands on described display terminal second coordinate position according to described coordinate information;
Described display terminal controls according to the touch screen application program of described click commands to current operation.
Preferably, when described mobile terminal detects the clicking operation of user to default universal button, the step obtaining coordinate information corresponding to described default universal button that user clicks comprises:
When mobile terminal detects that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
Preferably, the step of click commands that described display terminal is identified on described display terminal second coordinate position according to described coordinate information comprises:
Described display terminal obtains the second coordinate position on described display terminal according to described coordinate information, and identifies the click commands to control knob on described display terminal, and described second coordinate position is in the scope of described control knob.
Preferably, when described mobile terminal detects the clicking operation of user to default universal button, also comprise before obtaining the step of coordinate information corresponding to described default universal button that user clicks:
Mobile terminal receives user to when described mobile terminal being preset the calibration command of universal button, obtains sectional drawing display terminal comprising the control knob of current operation touch screen application program;
Described mobile terminal shows described sectional drawing and obtains control knob region in the described sectional drawing that user shows described mobile terminal and carries out the coordinate points of clicking operation;
The coordinate number percent of coordinate points described in described acquisition for mobile terminal in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
Preferably, the coordinate number percent of coordinate points described in described acquisition for mobile terminal in described sectional drawing, and the step setting the corresponding relation of described coordinate number percent and described default universal button comprises:
If the resolution of described mobile terminal is W 1* H 1, the resolution of described display terminal is W 2* H 2, described coordinate points is (X 1, Y 1), then calculating the coordinate number percent of described coordinate points in described sectional drawing is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and described default universal button;
Described display terminal also comprises according to the step of the click commands that described coordinate information is identified on described display terminal second coordinate position:
Described display terminal calculates the second coordinate position obtained on described display terminal according to described coordinate number percent P, and simulation is once to the click action of described second coordinate position, be injected into system, identify the click commands to described second coordinate position, wherein, the coordinate of described second coordinate position is (X 1/ W 1* W 2, Y 1/ H 1* H 2).
In addition, for achieving the above object, the present invention also provides a kind of mobile terminal to control the system of touch screen application program on display terminal, and described system comprises: mobile terminal and display terminal, wherein,
When described mobile terminal detects the clicking operation of user to default universal button, obtain the coordinate information that described default universal button that user clicks is corresponding, wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information; Described coordinate information is sent to described display terminal;
Described display terminal is identified in the click commands on described display terminal second coordinate position according to described coordinate information; Control according to the touch screen application program of described click commands to current operation.
Preferably, described mobile terminal also for:
When detecting that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
Preferably, described display terminal also for:
Obtain the second coordinate position on described display terminal according to described coordinate information, and identify the click commands to control knob on described display terminal, described second coordinate position is in the scope of described control knob.
Preferably, described mobile terminal also for:
Receive user to when described mobile terminal being preset the calibration command of universal button, obtain sectional drawing display terminal comprising the control knob of current operation touch screen application program; Show described sectional drawing and obtain control knob region in the described sectional drawing that user shows described mobile terminal and carry out the coordinate points of clicking operation; Obtain the coordinate number percent of described coordinate points in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
Preferably, described mobile terminal also for:
If the resolution of described mobile terminal is W 1* H 1, the resolution of described display terminal is W 2* H 2, described coordinate points is (X 1, Y 1), then calculating the coordinate number percent of described coordinate points in described sectional drawing is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and described default universal button;
Described display terminal also for:
The second coordinate position obtained on described display terminal is calculated according to described coordinate number percent P, and simulation is once to the click action of described second coordinate position, is injected into system, identifies the click commands to described second coordinate position, wherein, the coordinate of described second coordinate position is (X 1/ W 1* W 2, Y 1/ H 1* H 2).
A kind of mobile terminal that the present invention proposes controls the method and system of touch screen application program on display terminal, utilize the default universal button that mobile terminal is clicked on mobile terminals to obtain user, and the coordinate information that arrange corresponding to default universal button is sent to display terminal, display terminal can obtain the second coordinate position on described display terminal according to described coordinate information, and the click commands be identified on the second coordinate position is to control the touch screen application program of operation current on described display terminal.Due to user click default universal button on mobile terminals time, it is to the click commands on described display terminal second coordinate position that display terminal can carry out conversion identification according to the coordinate information of described default universal button correspondence setting, therefore, user produces corresponding click commands by carrying out clicking operation to mobile terminal in display terminal, control touch screen application program for display terminal according to this click commands, thus realize controlling by mobile terminal touch screen application program that display terminal runs.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet that mobile terminal of the present invention controls method first embodiment of touch screen application program on display terminal;
Fig. 2 is the schematic flow sheet that mobile terminal of the present invention controls method second embodiment of touch screen application program on display terminal;
Fig. 3 is the structural representation that mobile terminal of the present invention controls system one embodiment of touch screen application program on display terminal.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The invention provides a kind of method that mobile terminal controls touch screen application program on display terminal.
It is the schematic flow sheet of method first embodiment of touch screen application program on mobile terminal of the present invention control display terminal with reference to Fig. 1, Fig. 1.
In a first embodiment, on this mobile terminal control display terminal, the method for touch screen application program comprises:
Step S10, when mobile terminal detects the clicking operation of user to default universal button, obtain coordinate information corresponding to described default universal button that user clicks, wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information;
In the present embodiment, mobile terminal is provided with universal button common in some virtual handles, as buttons such as upper and lower, left and right, impact, jumps, to meet the button support in the touch screen application program that display terminal runs.Real-time listening user contact action on mobile terminals, as the clicking operation to default universal button, when the clicking operation of user on mobile terminals to default universal button being detected, obtains the coordinate information that described default universal button that user clicks is corresponding.Wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information.This coordinate information can be the information such as specific coordinate points position, coordinate number percent, as horizontal ordinate, the width of ordinate relative to touch screen zone, the number percent etc. of length of coordinate points.It should be noted that, in the present embodiment, relevant to the position of the corresponding coordinate information preset of universal button only with the control knob of the touch screen application program of current operation on display terminal, and have nothing to do with this universal button position on mobile terminals.As for this coordinate information for coordinate points position is described, if the coordinate points position of the control objectives A of the touch screen application program of current operation on display terminal is a, user needs to utilize default universal button B on mobile terminal to manipulate control objectives A, then can pre-set universal button B and coordinate points position be the mapping relations of a on the mobile terminal.Like this, when mobile terminal detects the clicking operation of user to universal button B, coordinate information corresponding to universal button B that user clicks and coordinate points position a can be obtained.
Step S20, described coordinate information is sent to display terminal by described mobile terminal;
User is clicked the coordinate information that when default universal button operates, the described default universal button of acquisition is corresponding by household wireless LAN, UPnP protocol etc. and is sent to display terminal by described mobile terminal.The coordinate points position a that universal button B as the user of acquisition clicked is corresponding is sent to display terminal.
Step S30, described display terminal is identified in the click commands on described display terminal second coordinate position according to described coordinate information;
After described display terminal gets the coordinate information of described mobile terminal transmission, the second coordinate position obtained on described display terminal can be calculated according to this coordinate information, as as described in display terminal according to as described in the coordinate points position a that sends of mobile terminal can identify the control objectives A in the touch screen application program of display terminal current operation corresponding with coordinate points position a, this control objectives A is also the second coordinate position, and simulate according to this second coordinate position the action that a time mouse is clicked, display terminal system is input to as a touch screen event, it is also the click commands on control objectives A that display terminal can recognize at described display terminal second coordinate position.
Because described display terminal is that the coordinate information corresponding with default universal button sent according to described mobile terminal calculates the second coordinate position identified on described display terminal, therefore, the default universal button relative position in the terminal that user clicks on the mobile terminal can be completely different from described second coordinate position.Like this, the impact point that user can carry out controlling as required on described display terminal correspondingly carries out clicking operation to the different universal buttons on described mobile terminal, identifies the click commands of different control objectives on described display terminal with the coordinate information making described display terminal corresponding according to the different universal buttons clicked.
Step S40, described display terminal controls according to the touch screen application program of described click commands to current operation.
After described display terminal recognizes the click commands on described display terminal second coordinate position, the click commands identified can be responded, consistent with the clicking operation effect directly responded at described display terminal, thus respond the touch screen application program of described click commands to operation current on described display terminal and control.
The default universal button that the present embodiment utilizes mobile terminal to click on mobile terminals to obtain user, and the coordinate information that arrange corresponding to default universal button is sent to display terminal, display terminal can obtain the second coordinate position on described display terminal according to described coordinate information, and the click commands be identified on the second coordinate position is to control the touch screen application program of operation current on described display terminal.Due to user click default universal button on mobile terminals time, it is to the click commands on described display terminal second coordinate position that display terminal can carry out conversion identification according to the coordinate information of described default universal button correspondence setting, therefore, user produces corresponding click commands by carrying out clicking operation to mobile terminal in display terminal, control touch screen application program for display terminal according to this click commands, thus realize controlling by mobile terminal touch screen application program that display terminal runs.
Further, in other embodiments, above-mentioned steps S10 can comprise:
When mobile terminal detects that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
In the present embodiment, when user's clicking operation on mobile terminals being detected and obtain the first coordinate position that user clicks, if judge, described first coordinate position falls in the scope of default universal button on mobile terminal, then obtain the coordinate information preset corresponding to described default universal button.Wherein, described default universal button is preset with corresponding coordinate information, like this, as long as user on mobile terminals preset universal button scope in arbitrary coordinate points click, all can get the identical coordinate information corresponding with this default universal button, described display terminal can be identified in the click commands on described display terminal second coordinate position according to described coordinate information, and controls the touch screen application program of current operation.In the present embodiment, user only need carry out clicking and can carry out identical control to the touch screen application program of operation current on described display terminal arbitrary coordinate points in the scope of universal button default on mobile terminal, and convenient user is by the control of mobile terminal to the touch screen application program that display terminal runs.
Further, in other embodiments, above-mentioned steps S30 can comprise:
Described display terminal obtains the second coordinate position on described display terminal according to described coordinate information, and identifies the click commands to control knob on described display terminal, and described second coordinate position is in the scope of described control knob.
In the present embodiment, described display terminal obtains the second coordinate position on described display terminal according to described coordinate information after, further, if described second coordinate position falls in the scope of described control knob on described display terminal, be then identified as the click commands to control knob on described display terminal.Like this, user can not only be identified by the click commands of mobile terminal to an impact point in the touch screen application program that display terminal runs, can also identify the click commands to a button in the touch screen application program that display terminal runs, applicability is wider, more flexibly.
As shown in Figure 2, second embodiment of the invention proposes a kind of method that mobile terminal controls touch screen application program on display terminal, on the basis of above-described embodiment, also comprises before above-mentioned steps S10:
Step S50, mobile terminal receives user to when described mobile terminal being preset the calibration command of universal button, obtains sectional drawing display terminal comprising the control knob of current operation touch screen application program;
Step S60, described mobile terminal shows described sectional drawing and obtains control knob region in the described sectional drawing that user shows described mobile terminal and carries out the coordinate points of clicking operation;
Step S70, the coordinate number percent of coordinate points described in described acquisition for mobile terminal in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
The calibration operation to described mobile terminal being preset universal button is also comprised in the present embodiment, virtual handle can be set on the mobile terminal in advance, this virtual handle comprises some general pre-set button, as upper and lower, left and right arrow button, the function button such as menu, selection, the some general pre-set button in this virtual handle can meet the demand of button in most touch screen application program.When using the default universal button in mobile terminal to control the touch screen application program in display terminal, first to the default universal button in mobile terminal be calibrated, to control accurately and effectively the corresponding control knob in the touch screen application program in display terminal.
Mobile terminal is receiving user to when described mobile terminal being preset the calibration command of universal button, obtain full screen printscreen display terminal comprising the control knob of current operation touch screen application program, in this sectional drawing, comprise all control knobs that current operation touch screen application program need be used.Described mobile terminal is sectional drawing described in full screen display also, user can carry out clicking operation according to the described sectional drawing that described mobile terminal shows to control knob in described sectional drawing, obtain control knob in the described sectional drawing that user shows described mobile terminal and carry out the coordinate points of clicking operation, obtain the coordinate number percent of described coordinate points in described sectional drawing simultaneously, and set the corresponding relation of described coordinate number percent and described default universal button, preserve the corresponding relation of described coordinate number percent and described default universal button, the calibration described mobile terminal being preset universal button can be completed.
After universal button default on described mobile terminal is calibrated, in subsequent operation, if when mobile terminal detects that the first coordinate position that user clicks falls in the scope of default universal button, then can to obtain with described default universal button the corresponding coordinate information preset and coordinate number percent in calibration operation, and display terminal can select the control knob of click in described sectional drawing according to this coordinate information acquisition user in calibration operation, thus realize user when clicking default universal button on mobile terminals, display terminal identifies the click commands to the control knob that user selects in described sectional drawing, thus carry out the corresponding control knob of control operation on display terminal in current operation touch screen application program according to the default universal button on mobile terminal.
Particularly, because display terminal resolution and mobile terminal resolution may be inconsistent, therefore the coordinate points clicked is converted into coordinate information as coordinate number percent, and this coordinate number percent is mapped with the universal button on virtual handle, in subsequent operation, user clicks the default universal button on virtual handle, namely coordinate number percent corresponding for this default universal button is sent to display terminal, after display terminal receives coordinate number percent, according to self screen resolution, coordinate number percent is reverted to coordinate points, then simulate according to this coordinate points the action that a time mouse is clicked, be injected into system, namely identifiable design is to the click commands of coordinate points.Particularly when coordinate points and coordinate number percent carry out data reduction, if supposition mobile terminal resolution is W 1* H 1, display terminal resolution is W 2* H 2, when calibrating for the universal button B on mobile terminal, if user clicks the coordinate points P that on described sectional drawing, control knob A gets on mobile terminals 1for (X 1, Y 1), then coordinates computed number percent is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and universal button B.When user controls the touch screen application program on display terminal by mobile terminal, if the clicking operation of user to universal button B detected, then can obtain the coordinate number percent P corresponding with universal button B preset, and coordinate number percent P is sent to display terminal; Display terminal is getting after coordinate number percent is P, can calculate obtain the second coordinate position on described display terminal and coordinate points P according to coordinate number percent P 2(X 1/ W 1* W 2, Y 1/ H 1* H 2), and be identified in described display terminal second coordinate position and coordinate points P 2on click commands, be also namely identified in the click commands of control knob A on described display terminal, thus the touch screen application program of current operation controlled.
Further, in other embodiments, described touch screen application program is the game application operated by touch button.Because game application operates based on touchscreen button mostly, and generally there is due to display terminal relative movement terminal the characteristics such as larger screen, better stereo sound effect, therefore play games on display terminal and can bring more telepresenc and the sense of reality to player relative to mobile terminal, in the present embodiment can on display terminal running game application program and controlled by mobile terminal, the button operated in this game application, better game effect can be brought to user.
The present invention further provides the system that a kind of mobile terminal controls touch screen application program on display terminal.
It should be noted that, in the embodiment of the present invention, this mobile terminal can be the terminal that mobile phone, pad etc. have touch function, and display terminal can be TV, computer etc., in this no limit.
It is the structural representation of system one embodiment of touch screen application program on mobile terminal of the present invention control display terminal with reference to Fig. 3, Fig. 3.
In one embodiment, on this mobile terminal control display terminal, the system of touch screen application program comprises:
Mobile terminal 1 and display terminal 2, wherein,
When mobile terminal 1 detects the clicking operation of user to default universal button, obtain the coordinate information that described default universal button that user clicks is corresponding, wherein, mobile terminal 1 is preset with the mapping relations of different universal button and different coordinate information; Described coordinate information is sent to display terminal 2;
Display terminal 2 is identified in the click commands on display terminal 2 second coordinate position according to described coordinate information; Control according to the touch screen application program of described click commands to current operation.
In the present embodiment, mobile terminal 1 is provided with universal button common in some virtual handles, as buttons such as upper and lower, left and right, impact, jumps, to meet the button support in the touch screen application program that display terminal 2 runs.Real-time listening user contact action is on a mobile terminal 1 as the clicking operation to default universal button, when the clicking operation of user on a mobile terminal 1 to default universal button being detected, obtain the coordinate information that described default universal button that user clicks is corresponding.Wherein, mobile terminal 1 is preset with the mapping relations of different universal button and different coordinate information.This coordinate information can be the information such as specific coordinate points position, coordinate number percent, as horizontal ordinate, the width of ordinate relative to touch screen zone, the number percent etc. of length of coordinate points.It should be noted that, in the present embodiment, relevant to the position of the corresponding coordinate information preset of universal button only with the control knob of the touch screen application program of current operation on display terminal 2, and have nothing to do with this universal button position on a mobile terminal 1.As for this coordinate information for coordinate points position is described, if the coordinate points position of the control objectives A of the touch screen application program of current operation on display terminal 2 is a, user needs to utilize default universal button B on mobile terminal 1 to manipulate control objectives A, then can pre-set universal button B and coordinate points position be the mapping relations of a on a mobile terminal 1.Like this, when mobile terminal 1 detects the clicking operation of user to universal button B, coordinate information corresponding to universal button B that user clicks and coordinate points position a can be obtained.
User is clicked the coordinate information that when default universal button operates, the described default universal button of acquisition is corresponding by household wireless LAN, UPnP protocol etc. and is sent to display terminal 2 by mobile terminal 1.The coordinate points position a that universal button B as the user of acquisition clicked is corresponding is sent to display terminal 2.
After display terminal 2 gets the coordinate information of mobile terminal 1 transmission, the second coordinate position obtained on display terminal 2 can be calculated according to this coordinate information, as display terminal 2 can identify the control objectives A in the touch screen application program of display terminal 2 current operation corresponding with coordinate points position a according to the coordinate points position a that mobile terminal 1 sends, this control objectives A is also the second coordinate position, and simulate according to this second coordinate position the action that a time mouse is clicked, display terminal 2 system is input to as a touch screen event, it is also the click commands on control objectives A that display terminal 2 can recognize at display terminal 2 second coordinate position.
Because display terminal 2 is that the coordinate information corresponding with default universal button sent according to mobile terminal 1 calculates the second coordinate position identified on display terminal 2, therefore, the relative position of default universal button in mobile terminal 1 that user clicks on a mobile terminal 1 can be completely different from described second coordinate position.Like this, the impact point that user can carry out controlling as required on display terminal 2 correspondingly carries out clicking operation to the different universal buttons on mobile terminal 1, identifies the click commands of different control objectives on display terminal 2 with the coordinate information making display terminal 2 corresponding according to the different universal buttons clicked.
After display terminal 2 recognizes the click commands on display terminal 2 second coordinate position, the click commands identified can be responded, consistent with the clicking operation effect directly responded at display terminal 2, thus respond the touch screen application program of described click commands to operation current on display terminal 2 and control.
The default universal button that the present embodiment utilizes mobile terminal 1 to click on a mobile terminal 1 to obtain user, and the coordinate information that arrange corresponding to default universal button is sent to display terminal 2, display terminal 2 can obtain the second coordinate position on display terminal 2 according to described coordinate information, and the click commands be identified on the second coordinate position is to control the touch screen application program of operation current on display terminal 2.Due to user click default universal button on a mobile terminal 1 time, it is to the click commands on display terminal 2 second coordinate position that display terminal 2 can carry out conversion identification according to the coordinate information of described default universal button correspondence setting, therefore, user produces corresponding click commands by carrying out clicking operation to mobile terminal 1 in display terminal 2, control touch screen application program for display terminal 2 according to this click commands, thus realize the touch screen application program being controlled operation on display terminal 2 by mobile terminal 1.
Further, in other embodiments, mobile terminal 1 may be used for:
When detecting that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
In the present embodiment, when user's clicking operation on a mobile terminal 1 being detected and obtain the first coordinate position that user clicks, if judge, described first coordinate position falls in the scope of default universal button on mobile terminal 1, then obtain the coordinate information preset corresponding to described default universal button.Wherein, described default universal button is preset with corresponding coordinate information, like this, as long as user on a mobile terminal 1 preset universal button scope in arbitrary coordinate points click, all can get the identical coordinate information corresponding with this default universal button, display terminal 2 can be identified in the click commands on display terminal 2 second coordinate position according to described coordinate information, and controls the touch screen application program of current operation.In the present embodiment, user only need carry out clicking and can carry out identical control to the touch screen application program of operation current on display terminal 2 arbitrary coordinate points in the scope of universal button default on mobile terminal 1, and convenient user is by the control of the touch screen application program of operation on mobile terminal 1 pair of display terminal 2.
Further, in other embodiments, display terminal 2 may be used for:
Obtain the second coordinate position on display terminal 2 according to described coordinate information, and identify the click commands to control knob on display terminal 2, described second coordinate position is in the scope of described control knob.
In the present embodiment, after display terminal 2 obtains the second coordinate position on display terminal 2 according to described coordinate information, further, if described second coordinate position falls in the scope of described control knob on display terminal 2, then the click commands to control knob on display terminal 2 is identified as.Like this, the click commands of user by an impact point in the touch screen application program of operation on mobile terminal 1 pair of display terminal 2 can not only be identified, can also identify the click commands to a button in the touch screen application program that display terminal 2 runs, applicability is wider, more flexibly.
Further, in other embodiments, mobile terminal 1 can also be used for:
Receive user to when mobile terminal 1 being preset the calibration command of universal button, obtain sectional drawing display terminal 2 comprising the control knob of current operation touch screen application program; Show described sectional drawing and obtain control knob region in the described sectional drawing that user shows mobile terminal 1 and carry out the coordinate points of clicking operation; Obtain the coordinate number percent of described coordinate points in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
The calibration operation to mobile terminal 1 being preset universal button is also comprised in the present embodiment, virtual handle can be set on a mobile terminal 1 in advance, this virtual handle comprises some general pre-set button, as upper and lower, left and right arrow button, the function button such as menu, selection, the some general pre-set button in this virtual handle can meet the demand of button in most touch screen application program.When using the default universal button in mobile terminal 1 to control the touch screen application program in display terminal 2, first to the default universal button in mobile terminal 1 be calibrated, to control accurately and effectively the corresponding control knob in the touch screen application program in display terminal 2.
Mobile terminal 1 is receiving user to when mobile terminal 1 being preset the calibration command of universal button, obtain full screen printscreen display terminal 2 comprising the control knob of current operation touch screen application program, in this sectional drawing, comprise all control knobs that current operation touch screen application program need be used.Mobile terminal 1 is sectional drawing described in full screen display also, user can carry out clicking operation according to the described sectional drawing of display on mobile terminal 1 to control knob in described sectional drawing, obtain control knob in the described sectional drawing that user shows mobile terminal 1 and carry out the coordinate points of clicking operation, obtain the coordinate number percent of described coordinate points in described sectional drawing simultaneously, and set the corresponding relation of described coordinate number percent and described default universal button, preserve the corresponding relation of described coordinate number percent and described default universal button, calibration mobile terminal 1 being preset universal button can be completed.
After universal button default on mobile terminal 1 is calibrated, in subsequent operation, if when mobile terminal 1 detects that the first coordinate position that user clicks falls in the scope of default universal button, then can to obtain with described default universal button the corresponding coordinate information preset and coordinate number percent in calibration operation, and display terminal 2 can select the control knob of click in described sectional drawing according to this coordinate information acquisition user in calibration operation, thus realize user when clicking default universal button on a mobile terminal 1, display terminal 2 identifies the click commands to the control knob that user selects in described sectional drawing, thus carry out the corresponding control knob of control operation on display terminal 2 in current operation touch screen application program according to the default universal button on mobile terminal 1.
Particularly, because display terminal 2 resolution and mobile terminal 1 resolution may be inconsistent, therefore the coordinate points clicked is converted into coordinate information as coordinate number percent, and this coordinate number percent is mapped with the universal button on virtual handle, in subsequent operation, user clicks the default universal button on virtual handle, namely coordinate number percent corresponding for this default universal button is sent to display terminal 2, after display terminal 2 receives coordinate number percent, according to self screen resolution, coordinate number percent is reverted to coordinate points, then simulate according to this coordinate points the action that a time mouse is clicked, be injected into system, namely identifiable design is to the click commands of coordinate points.Particularly when coordinate points and coordinate number percent carry out data reduction, if supposition mobile terminal 1 resolution is W 1* H 1, display terminal 2 resolution is W 2* H 2, when calibrating for the universal button B on mobile terminal 1, if user clicks the coordinate points P that on described sectional drawing, control knob A gets on a mobile terminal 1 1for (X 1, Y 1), then coordinates computed number percent is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and universal button B.When to be controlled the touch screen application program on display terminal 2 by mobile terminal 1 as user, if the clicking operation of user to universal button B detected, then can obtain the coordinate number percent P corresponding with universal button B preset, and coordinate number percent P is sent to display terminal 2; Display terminal 2 is getting after coordinate number percent is P, can calculate obtain the second coordinate position on display terminal 2 and coordinate points P according to coordinate number percent P 2(X 1/ W 1* W 2, Y 1/ H 1* H 2), and be identified in display terminal 2 second coordinate position and coordinate points P 2on click commands, be also namely identified in the click commands of control knob A on display terminal 2, thus the touch screen application program of current operation controlled.
Further, in other embodiments, described touch screen application program is the game application operated by touch button.Because game application operates based on touchscreen button mostly, and generally there is due to display terminal 2 relative movement terminal 1 characteristics such as larger screen, better stereo sound effect, therefore play games on display terminal 2 and can bring more telepresenc and the sense of reality to player relative to mobile terminal 1, in the present embodiment can on display terminal 2 running game application program and controlled by mobile terminal 1, the button operated in this game application, better game effect can be brought to user.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computing machine, server, or the network equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.

Claims (10)

1. mobile terminal controls a method for touch screen application program on display terminal, it is characterized in that, said method comprising the steps of:
When mobile terminal detects the clicking operation of user to default universal button, obtain the coordinate information that described default universal button that user clicks is corresponding, wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information;
Described coordinate information is sent to display terminal by described mobile terminal;
Described display terminal is identified in the click commands on described display terminal second coordinate position according to described coordinate information;
Described display terminal controls according to the touch screen application program of described click commands to current operation.
2. mobile terminal as claimed in claim 1 controls the method for touch screen application program on display terminal, it is characterized in that, when described mobile terminal detects the clicking operation of user to default universal button, the step obtaining coordinate information corresponding to described default universal button that user clicks comprises:
When mobile terminal detects that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
3. mobile terminal as claimed in claim 2 controls the method for touch screen application program on display terminal, and it is characterized in that, described display terminal comprises according to the step of the click commands that described coordinate information is identified on described display terminal second coordinate position:
Described display terminal obtains the second coordinate position on described display terminal according to described coordinate information, and identifies the click commands to control knob on described display terminal, and described second coordinate position is in the scope of described control knob.
4. mobile terminal controls the method for touch screen application program on display terminal as claimed in claim 2 or claim 3, it is characterized in that, when described mobile terminal detects the clicking operation of user to default universal button, also comprise before obtaining the step of coordinate information corresponding to described default universal button that user clicks:
Mobile terminal receives user to when described mobile terminal being preset the calibration command of universal button, obtains sectional drawing display terminal comprising the control knob of current operation touch screen application program;
Described mobile terminal shows described sectional drawing and obtains control knob region in the described sectional drawing that user shows described mobile terminal and carries out the coordinate points of clicking operation;
The coordinate number percent of coordinate points described in described acquisition for mobile terminal in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
5. mobile terminal as claimed in claim 4 controls the method for touch screen application program on display terminal, it is characterized in that, the coordinate number percent of coordinate points described in described acquisition for mobile terminal in described sectional drawing, and the step setting the corresponding relation of described coordinate number percent and described default universal button comprises:
If the resolution of described mobile terminal is W 1* H 1, the resolution of described display terminal is W 2* H 2, described coordinate points is (X 1, Y 1), then calculating the coordinate number percent of described coordinate points in described sectional drawing is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and described default universal button;
Described display terminal also comprises according to the step of the click commands that described coordinate information is identified on described display terminal second coordinate position:
Described display terminal calculates the second coordinate position obtained on described display terminal according to described coordinate number percent P, and simulation is once to the click action of described second coordinate position, be injected into system, identify the click commands to described second coordinate position, wherein, the coordinate of described second coordinate position is (X 1/ W 1* W 2, Y 1/ H 1* H 2).
6. mobile terminal controls a system for touch screen application program on display terminal, and it is characterized in that, described system comprises: mobile terminal and display terminal, wherein,
When described mobile terminal detects the clicking operation of user to default universal button, obtain the coordinate information that described default universal button that user clicks is corresponding, wherein, described mobile terminal is preset with the mapping relations of different universal button and different coordinate information; Described coordinate information is sent to described display terminal;
Described display terminal is identified in the click commands on described display terminal second coordinate position according to described coordinate information; Control according to the touch screen application program of described click commands to current operation.
7. mobile terminal as claimed in claim 6 controls the system of touch screen application program on display terminal, it is characterized in that, described mobile terminal also for:
When detecting that the first coordinate position that user clicks falls in the scope of default universal button, obtain the coordinate information preset corresponding to described default universal button.
8. mobile terminal as claimed in claim 7 controls the system of touch screen application program on display terminal, it is characterized in that, described display terminal also for:
Obtain the second coordinate position on described display terminal according to described coordinate information, and identify the click commands to control knob on described display terminal, described second coordinate position is in the scope of described control knob.
9. as claimed in claim 7 or 8 mobile terminal controls the system of touch screen application program on display terminal, it is characterized in that, described mobile terminal also for:
Receive user to when described mobile terminal being preset the calibration command of universal button, obtain sectional drawing display terminal comprising the control knob of current operation touch screen application program; Show described sectional drawing and obtain control knob region in the described sectional drawing that user shows described mobile terminal and carry out the coordinate points of clicking operation; Obtain the coordinate number percent of described coordinate points in described sectional drawing, and set the corresponding relation of described coordinate number percent and described default universal button.
10. mobile terminal as claimed in claim 9 controls the system of touch screen application program on display terminal, it is characterized in that, described mobile terminal also for:
If the resolution of described mobile terminal is W 1* H 1, the resolution of described display terminal is W 2* H 2, described coordinate points is (X 1, Y 1), then calculating the coordinate number percent of described coordinate points in described sectional drawing is P (X 1/ W 1, Y 1/ H 1), and set the corresponding relation of described coordinate number percent P and described default universal button;
Described display terminal also for:
The second coordinate position obtained on described display terminal is calculated according to described coordinate number percent P, and simulation is once to the click action of described second coordinate position, is injected into system, identifies the click commands to described second coordinate position, wherein, the coordinate of described second coordinate position is (X 1/ W 1* W 2, Y 1/ H 1* H 2).
CN201510821593.2A 2015-11-23 2015-11-23 Method and system for controlling touch screen application in display terminal by mobile terminal Pending CN105487856A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510821593.2A CN105487856A (en) 2015-11-23 2015-11-23 Method and system for controlling touch screen application in display terminal by mobile terminal
PCT/CN2016/084268 WO2017088429A1 (en) 2015-11-23 2016-06-01 Method and system for controlling touchscreen application program in display terminal by mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510821593.2A CN105487856A (en) 2015-11-23 2015-11-23 Method and system for controlling touch screen application in display terminal by mobile terminal

Publications (1)

Publication Number Publication Date
CN105487856A true CN105487856A (en) 2016-04-13

Family

ID=55674856

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510821593.2A Pending CN105487856A (en) 2015-11-23 2015-11-23 Method and system for controlling touch screen application in display terminal by mobile terminal

Country Status (2)

Country Link
CN (1) CN105487856A (en)
WO (1) WO2017088429A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106658106A (en) * 2016-11-29 2017-05-10 深圳众思科技有限公司 Signal control method, system, electronic equipment and equipment to be controlled
WO2017088429A1 (en) * 2015-11-23 2017-06-01 深圳Tcl数字技术有限公司 Method and system for controlling touchscreen application program in display terminal by mobile terminal
CN108803669A (en) * 2018-07-05 2018-11-13 北京淳中科技股份有限公司 Holder rotating direction control method, device, electronic equipment and storage medium
CN113031843A (en) * 2021-04-25 2021-06-25 歌尔股份有限公司 Watch control method, display terminal and watch

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012063165A1 (en) * 2010-11-09 2012-05-18 Koninklijke Philips Electronics N.V. User interface with haptic feedback
CN103067566A (en) * 2012-04-24 2013-04-24 曾昭兴 Mouse input method and touch-screen mobile phone control device
CN103281575A (en) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 Novel control method of intelligent television
CN103530149A (en) * 2013-09-27 2014-01-22 深圳市同洲电子股份有限公司 Configuration method for gamepad simulation configuration file and terminal
CN103888801A (en) * 2012-12-21 2014-06-25 鸿富锦精密工业(深圳)有限公司 Television set, remote-control device and menu display method
US20150002390A1 (en) * 2013-06-28 2015-01-01 Samsung Electronics Co., Ltd. Display apparatus and method for controlling display apparatus thereof

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404641A (en) * 2011-12-06 2012-04-04 深圳Tcl新技术有限公司 Method and system for remotely controlling television by using smart phone
CN102625010B (en) * 2012-03-06 2014-05-14 清华大学 Eye-Free control method of television by using touch screen phone
CN103000015B (en) * 2012-12-13 2016-12-21 深圳Tcl新技术有限公司 The accurate remote control thereof of display device based on wireless screen transmission and device
CN103024457A (en) * 2012-12-20 2013-04-03 四川长虹电器股份有限公司 Method and device for controlling server touch screen
CN104185000B (en) * 2014-08-11 2016-03-09 惠州华阳通用电子有限公司 A kind of automatic calibrating method interactive across screen
CN104918073A (en) * 2015-05-27 2015-09-16 深圳市金立通信设备有限公司 Image display method and terminal
CN105487856A (en) * 2015-11-23 2016-04-13 深圳Tcl数字技术有限公司 Method and system for controlling touch screen application in display terminal by mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012063165A1 (en) * 2010-11-09 2012-05-18 Koninklijke Philips Electronics N.V. User interface with haptic feedback
CN103067566A (en) * 2012-04-24 2013-04-24 曾昭兴 Mouse input method and touch-screen mobile phone control device
CN103888801A (en) * 2012-12-21 2014-06-25 鸿富锦精密工业(深圳)有限公司 Television set, remote-control device and menu display method
CN103281575A (en) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 Novel control method of intelligent television
US20150002390A1 (en) * 2013-06-28 2015-01-01 Samsung Electronics Co., Ltd. Display apparatus and method for controlling display apparatus thereof
CN103530149A (en) * 2013-09-27 2014-01-22 深圳市同洲电子股份有限公司 Configuration method for gamepad simulation configuration file and terminal

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017088429A1 (en) * 2015-11-23 2017-06-01 深圳Tcl数字技术有限公司 Method and system for controlling touchscreen application program in display terminal by mobile terminal
CN106658106A (en) * 2016-11-29 2017-05-10 深圳众思科技有限公司 Signal control method, system, electronic equipment and equipment to be controlled
CN108803669A (en) * 2018-07-05 2018-11-13 北京淳中科技股份有限公司 Holder rotating direction control method, device, electronic equipment and storage medium
CN113031843A (en) * 2021-04-25 2021-06-25 歌尔股份有限公司 Watch control method, display terminal and watch

Also Published As

Publication number Publication date
WO2017088429A1 (en) 2017-06-01

Similar Documents

Publication Publication Date Title
CN104778001B (en) A kind of picture control method and picture control system
EP3386174B1 (en) Method for selection between front-facing camera and rear-facing camera of mobile terminal and mobile terminal
US20190026059A1 (en) System for linking and controlling terminals and user terminal used in the same
CN105487856A (en) Method and system for controlling touch screen application in display terminal by mobile terminal
KR102058976B1 (en) Application method and device
CN105828397B (en) A kind of method and mobile terminal switching wireless access point
US20120264517A1 (en) Communication game system
KR20170137913A (en) Information processing method, terminal and computer storage medium
CN107185232B (en) Virtual object motion control method and device, electronic equipment and storage medium
CN104486747A (en) Method and device for cross-terminal account login
CN105516764A (en) Configuration method and device of remote control information
CN103686281B (en) Analog mouse controls method, remote control and the mobile terminal of intelligent television
CN103530149A (en) Configuration method for gamepad simulation configuration file and terminal
WO2017076224A1 (en) User interaction method and system based on virtual reality
CN108762701A (en) A kind of throwing screen control method, user terminal and the touch one-piece machine of touch one-piece machine
CN105282587A (en) Synchronous visualized intelligent television control method based on mobile phone
CN105100850B (en) The touch screen remote control method and device of intelligent terminal
CN112419693A (en) Device control method, device, display device and computer readable storage medium
CN105159582A (en) Video region adjusting method and terminal
CN106648297A (en) Intelligent device control method and device based on VR device
CN108579077A (en) Information processing method, device, storage medium and electronic equipment
CN102695173B (en) Safety control method for accessing wireless network and terminal
CN109840201B (en) UI test method, device, electronic equipment and computer readable storage medium
CN101833421A (en) Electronic device and method for acquiring user operation
CN111880718B (en) Method and device for remotely controlling playing equipment through touch

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160413