CN105094344B - Fixed terminal control method and device - Google Patents

Fixed terminal control method and device Download PDF

Info

Publication number
CN105094344B
CN105094344B CN201510632240.8A CN201510632240A CN105094344B CN 105094344 B CN105094344 B CN 105094344B CN 201510632240 A CN201510632240 A CN 201510632240A CN 105094344 B CN105094344 B CN 105094344B
Authority
CN
China
Prior art keywords
virtual mouse
cursor
target
fixed terminal
event
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510632240.8A
Other languages
Chinese (zh)
Other versions
CN105094344A (en
Inventor
黄文文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201510632240.8A priority Critical patent/CN105094344B/en
Publication of CN105094344A publication Critical patent/CN105094344A/en
Application granted granted Critical
Publication of CN105094344B publication Critical patent/CN105094344B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention provides a fixed terminal control method and a device, wherein the method comprises the following steps: receiving target gesture operation sent by a user and aiming at a virtual mouse displayed in the handheld terminal; generating a target virtual mouse operation instruction corresponding to the target gesture operation; and sending the target virtual mouse operation instruction to the fixed terminal so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and simulating to generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, so that the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal to realize control on the fixed terminal. By applying the embodiment of the invention, the complicated operation when the intelligent remote controller is used can be avoided, and the user operation experience is good.

Description

Fixed terminal control method and device
Technical Field
The invention relates to the technical field of terminal application, in particular to a fixed terminal control method and device.
Background
With the continuous progress of scientific technology, the electronic industry has also been rapidly developed, which makes more and more intelligent terminals (such as smart televisions, etc.) more and more important in the daily life and work of users. Generally, a user can operate a smart terminal to meet his actual needs, for example, to watch a video, search information, or play a game, etc. on the smart terminal.
At present, an intelligent remote controller matched with an intelligent terminal is usually used for completing the control of the intelligent terminal. A general smart remote controller generally includes numeric keys, direction keys, a plurality of menu keys, and the like. In the prior art, when a user operates the intelligent terminal, the user needs to select a corresponding menu key and simultaneously moves a focus position on a screen of the intelligent terminal by matching with up, down, left and right direction keys so as to complete the control of the intelligent terminal.
Although the intelligent remote controller can be used to control the intelligent terminal, in practical applications, when a user operates the intelligent terminal, even a simple focus moving operation needs to be performed by pressing the direction key several times or several tens of times. Therefore, when the intelligent terminal is operated through the intelligent remote controller, the operation is complex, the speed is low, and the user experience is poor.
Disclosure of Invention
The embodiment of the invention aims to provide a fixed terminal control method and a fixed terminal control device so as to realize simple, convenient and quick operation of an intelligent terminal. The specific technical scheme is as follows:
the embodiment of the invention discloses a fixed terminal control method, which is applied to a handheld terminal with a touch screen function; the method comprises the following steps:
receiving target gesture operation sent by a user and aiming at a virtual mouse displayed in the handheld terminal; the virtual mouse and the cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the preset webpage connection carrying the communication identification of the fixed terminal;
generating a target virtual mouse operation instruction corresponding to the target gesture operation;
and sending the target virtual mouse operation instruction to the fixed terminal so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and simulating to generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, so that the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal to realize control on the fixed terminal.
Preferably, the communication connection between the handheld terminal and the fixed terminal is established based on obtaining a preset web connection carrying the communication identifier of the fixed terminal, and includes:
the handheld terminal obtains a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the handheld terminal establishes communication connection with the fixed terminal based on the communication identifier in the webpage link.
Preferably, the communication connection between the handheld terminal and the fixed terminal includes: socket communication connection.
Preferably, the operation corresponding relationship between the preset virtual mouse operation instruction and the cursor operation event includes:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out the second preset shape at the back of the virtual mouse corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
The embodiment of the invention also discloses a method for operating the terminal, which is applied to the fixed terminal; the method comprises the following steps:
receiving a target virtual mouse operation instruction sent by a handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal;
determining a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event;
and simulating to generate the target cursor operation event, responding the target cursor operation event generated by simulation to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
The embodiment of the invention discloses a fixed terminal control device which is applied to a handheld terminal with a touch screen function; the device comprises:
the target gesture receiving module is used for receiving target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and the cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established by a communication connection establishing module based on the preset webpage connection carrying the communication identification of the fixed terminal;
the target instruction generating module is used for generating a target virtual mouse operation instruction corresponding to the target gesture operation;
and the target instruction sending module is used for sending the target virtual mouse operation instruction to the fixed terminal so as to enable the fixed terminal to determine a target cursor operation event corresponding to the target virtual mouse operation instruction based on the preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event, and simulate and generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, and the action of the cursor in the fixed terminal is controlled through the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
Preferably, the communication connection establishing module includes:
the webpage link obtaining sub-module is used for obtaining a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the communication connection establishing submodule is used for establishing communication connection with the fixed terminal based on the communication identifier in the webpage link.
Preferably, the communication connection between the handheld terminal and the fixed terminal includes: socket communication connection.
Preferably, the operation corresponding relationship between the preset virtual mouse operation instruction and the cursor operation event includes:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
sliding out a virtual mouse operation instruction corresponding to the gesture operation of the second preset shape at a single point on the back of the virtual mouse, wherein the virtual mouse operation instruction corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
The embodiment of the invention also discloses a device for operating the terminal, which is applied to the fixed terminal; the device comprises:
the target instruction receiving module is used for receiving a target virtual mouse operation instruction sent by the handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal;
the target event determining module is used for determining a target cursor operation event corresponding to a target virtual mouse operation instruction based on a preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event;
and the target operation generation module is used for generating the target cursor operation event in a simulation manner, responding the target cursor operation event generated in the simulation manner to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal through the gesture operation of the virtual mouse in the handheld terminal so as to realize the control of the fixed terminal.
The fixed terminal control method and the fixed terminal control device provided by the embodiment of the invention can establish communication connection between the handheld terminal and the fixed terminal, display the virtual mouse in the handheld terminal and display the cursor matched with the virtual mouse for use in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a fixed terminal control method provided from the perspective of a handheld terminal according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a fixed terminal control method provided from the perspective of a fixed terminal according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a fixed terminal control device provided from the perspective of a handheld terminal according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a fixed terminal control device provided from the perspective of a fixed terminal according to an embodiment of the present invention;
fig. 5 is a schematic interface diagram of a virtual mouse according to an embodiment of the present invention.
Detailed Description
In order to solve the problems in the prior art, embodiments of the present invention provide a fixed terminal control method and apparatus from the perspective of a handheld terminal and a fixed terminal, respectively, so as to avoid tedious operations when using an intelligent remote controller, and improve the control speed and the user operation experience.
The handheld terminal can comprise a smart phone with a touch screen function, a tablet personal computer and other portable devices, and the fixed terminal can comprise a smart television and the like. By applying the embodiment of the invention, the virtual mouse can be displayed on the screen of the handheld terminal, and the cursor matched with the virtual mouse for use is displayed on the screen of the fixed terminal. Thus, the control for the fixed terminal can be as simple, convenient and fast as operating a computer with a mouse.
Referring to fig. 5, the virtual mouse may be divided into: a left key, a right key and a back; the back area of the virtual mouse may be further subdivided into: a back left area and a back right area. Compared with a mouse connected with a computer, the virtual mouse in the embodiment of the invention is displayed on a screen of a handheld terminal with a touch screen function, so that the clicking and touching operation of the virtual mouse can be one of gesture operations; in addition, the handheld terminal is also provided with an acceleration sensor, and the movement operation of the virtual mouse can be converted into the movement event of the cursor in the fixed terminal, so the movement operation of the virtual mouse can be one of gesture operations. Meanwhile, in order to enhance the operation experience of the user, different sound effects are set for the left button and the right button of the virtual mouse, and the user operation is more convenient and accurate.
At present, the control of the fixed terminal is usually completed by using an intelligent remote controller matched with the fixed terminal. The fixed terminal control method provided by the embodiment of the invention does not influence the user to continuously use the intelligent remote controller to control the fixed terminal, and the user can select the required operation mode according to the actual requirement.
The fixed terminal control method provided by the embodiment of the invention from the angle of the handheld terminal can comprise the following steps:
receiving target gesture operation sent by a user and aiming at a virtual mouse displayed in the handheld terminal; the virtual mouse and the cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the preset webpage connection carrying the communication identification of the fixed terminal;
generating a target virtual mouse operation instruction corresponding to the target gesture operation;
and sending the target virtual mouse operation instruction to the fixed terminal so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and simulating to generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, so that the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal to realize control on the fixed terminal.
The fixed terminal control method provided by the embodiment of the invention from the angle of the fixed terminal can comprise the following steps:
receiving a target virtual mouse operation instruction sent by a handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal;
determining a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event;
and simulating to generate the target cursor operation event, responding the target cursor operation event generated by simulation to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
The fixed terminal control method and the fixed terminal control device provided by the embodiment of the invention can establish communication connection between the handheld terminal and the fixed terminal, display the virtual mouse in the handheld terminal and display the cursor matched with the virtual mouse for use in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
In order to make those skilled in the art better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flowchart of a fixed terminal control method according to an embodiment of the present invention, applied to a handheld terminal with a touch screen function; the method may comprise the steps of:
step S101: receiving target gesture operation sent by a user and aiming at a virtual mouse displayed in the handheld terminal;
the virtual mouse and the cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the handheld terminal and the fixed terminal are in communication connection, and the communication connection between the handheld terminal and the fixed terminal is established based on the preset webpage link carrying the communication identification of the fixed terminal. Wherein, for clarity of the scheme, fig. 5 gives an exemplary form of a virtual mouse in the handheld terminal.
Before the handheld terminal establishes communication connection with the fixed terminal, a first fixed terminal control program needs to be installed and opened in the handheld terminal, and the first fixed terminal control program is functional software for realizing a fixed terminal control method on the handheld terminal side; the first fixed terminal control program can extract a communication identifier (such as an IP address) for establishing a communication connection from the obtained preset webpage link, so as to establish the communication connection between the handheld terminal and the fixed terminal. And under the condition that the first fixed terminal control program is not installed on the handheld terminal, when the handheld terminal obtains a preset webpage link carrying the communication identifier of the fixed terminal, a user can download and install the first fixed terminal control program according to a webpage guide prompt opened by a browser, and after the first fixed terminal control program is opened, the communication identifier for establishing communication connection is continuously extracted from the obtained preset webpage link to establish the communication connection between the handheld terminal and the fixed terminal.
The communication connection between the handheld terminal and the fixed terminal is established based on obtaining a preset web page connection carrying the communication identifier of the fixed terminal, and may include:
the handheld terminal obtains a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the handheld terminal establishes communication connection with the fixed terminal based on the communication identifier in the webpage link.
It should be noted that the above-mentioned manner is only one manner of manners for establishing a communication connection between the handheld terminal and the fixed terminal, and of course, the communication connection may also be established by other manners.
Specifically, the communication connection between the handheld terminal and the fixed terminal includes: socket communication connection. It should be noted that the socket communication connection is one of the communication connections established between the handheld terminal and the fixed terminal, and the present invention does not need to limit the specific manner of establishing the communication connection, and any possible implementation manner may be applied to the present invention.
Step S102: generating a target virtual mouse operation instruction corresponding to the target gesture operation;
specifically, the target gesture operation of the virtual mouse by the user at least includes one or more of the following gestures: position movement, drawing a pattern, single point, three point pointing, etc.
It should be noted that, a corresponding virtual mouse operation instruction is set in advance for each target gesture operation. In addition, after receiving the target gesture operation, in the process of generating a target virtual mouse operation instruction corresponding to the target gesture operation, there is recognition of the target gesture operation, that is, it is determined which gesture operation the target gesture operation is specifically. Specifically, when determining which gesture operation the target gesture operation is, the target gesture operation may be identified by combining a click area, a click type, and a sliding in the click area of the virtual mouse for the touch screen, and/or a position movement of the virtual mouse. For example: the method comprises the steps that a user three-point clicks the back of a virtual mouse in a handheld terminal, fingers draw a 'l' -shaped pattern on the back of the virtual mouse from top to bottom, the clicked area of a touch screen is judged to be the back of the virtual mouse, the 'l' -shaped pattern drawn by the fingers on the touch screen is obtained by combining the clicking type clicked by the three fingers on the touch screen, and the target gesture operation is a multi-finger sliding gesture operation on the back of the virtual mouse from top to bottom.
Step S103: and sending the target virtual mouse operation instruction to the fixed terminal so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and simulating to generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, so that the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal to realize control on the fixed terminal.
Specifically, the preset operation correspondence between the virtual mouse operation instruction and the cursor operation event may include:
(1) a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
(2) clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
(3) clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
(4) a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
(5) pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
(6) a virtual mouse operation instruction corresponding to the gesture operation of sliding out the second preset shape at the back of the virtual mouse corresponds to a display menu event;
(7) a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
(8) a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
(9) and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
Specifically, the gesture operation of moving the virtual mouse in (1) may be a movement operation of the virtual mouse on a horizontal plane, and a movement distance and a movement direction of a cursor on a fixed terminal used in cooperation with the virtual mouse can be obtained according to an acceleration sensor in the handheld terminal, and in addition, a corresponding relationship between the movement distance of the virtual mouse and the movement distance of the cursor and a corresponding relationship between the movement direction of the virtual mouse and the movement direction of the cursor are preset, and based on the two types of corresponding relationships and the virtual mouse operation instruction, a specific cursor operation event can be generated; the gesture operation of clicking the left key of the virtual mouse in the step (2) can be the operation of clicking the virtual mouse in the handheld terminal, and the clicking area is the left key of the virtual mouse; the gesture operation of clicking the right button of the virtual mouse in the step (3) can be the operation of clicking the virtual mouse in the handheld terminal, and the clicking area is the right button of the virtual mouse; the gesture operation of sliding out the first predetermined shape with one finger on the back of the virtual mouse in the above (4) may be a gesture operation of pressing the virtual mouse with one finger and sliding out the first predetermined shape (for example, "]" -type pattern) on the back of the virtual mouse; the gesture operation of pressing and holding the left key of the virtual mouse and dragging the virtual mouse in the step (5) may be an operation of pressing and holding the virtual mouse and moving the virtual mouse, and the click region is the left key of the virtual mouse, it should be noted that the cursor dragging event in the sliding region in the step (5) can be triggered only when the region to which the cursor in the fixed terminal screen moves is the sliding region; the gesture operation of sliding out the second predetermined shape at a single point on the back of the virtual mouse in the above (6) may be a gesture operation of pressing the virtual mouse with a single finger and sliding out the second predetermined shape (for example, a "U" shaped pattern) on the back of the virtual mouse; the multi-finger sliding gesture operation from top to bottom on the back of the virtual mouse in (7) above may be an operation in which the user simultaneously uses a plurality of fingers (for example, three fingers), clicks on the back of the virtual mouse, and slides out the pattern from top to bottom on the virtual mouse of the handheld terminal when clicking; the single-finger sliding gesture operation from top to bottom on the left side of the back of the virtual mouse in the above (8) may be an operation of sliding out a pattern from top to bottom on a left area of the back of the virtual mouse; the single-finger sliding gesture operation in the above (9) from bottom to top on the left side of the back of the virtual mouse may be an operation of sliding out a displacement from bottom to top in a region near the left of the back of the virtual mouse.
It should be noted that the above-mentioned operation corresponding relationship between the virtual mouse operation instruction and the cursor event is only an example, and certainly, a user may set the operation corresponding relationship according to actual needs in practical applications.
Specifically, after the fixed terminal receives a target virtual mouse operation instruction sent by the handheld terminal, a target cursor event corresponding to the target virtual mouse operation instruction is determined according to the preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation time.
By applying the technical scheme provided by the embodiment of the invention, the communication connection can be established between the handheld terminal and the fixed terminal, the virtual mouse is displayed in the handheld terminal, and the cursor matched with the virtual mouse for use is displayed in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
Fig. 2 is another schematic flow chart of a fixed terminal control method in an embodiment of the present invention, applied to a fixed terminal; the method may comprise the steps of:
step S201: receiving a target virtual mouse operation instruction sent by a handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the preset webpage connection carrying the communication identification of the fixed terminal. Wherein, for clarity of the scheme, fig. 5 shows an example form of a virtual mouse in the handheld terminal.
It should be noted that, the second fixed terminal control program in the fixed terminal is in a running state, and after the handheld terminal establishes a communication connection with the fixed terminal, a cursor used in cooperation with a virtual mouse in the handheld terminal is displayed on a screen of the fixed terminal, where the second fixed terminal control program is functional software for implementing a fixed terminal control method on the fixed terminal side.
The communication connection between the handheld terminal and the fixed terminal is established based on obtaining a preset web page connection carrying the communication identifier of the fixed terminal, and may include:
the handheld terminal obtains a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the handheld terminal establishes communication connection with the fixed terminal based on the communication identifier in the webpage link.
It should be noted that the above-mentioned manner is only one manner of manners for establishing a communication connection between the handheld terminal and the fixed terminal, and of course, the communication connection may also be established by other manners.
Specifically, the communication connection between the handheld terminal and the fixed terminal includes: socket communication connection. It should be noted that the socket communication connection is one of the communication connections established between the handheld terminal and the fixed terminal, and the present invention does not need to limit the specific manner of establishing the communication connection, and any possible implementation manner may be applied to the present invention.
Step S202: and determining a target cursor operation event corresponding to the target virtual mouse operation instruction based on the preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event.
Specifically, the preset operation correspondence between the virtual mouse operation instruction and the cursor operation event may include:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out the second preset shape at the back of the virtual mouse corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
Step S203: and simulating to generate the target cursor operation event, responding the target cursor operation event generated by simulation to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
It should be noted that, a user may obtain a corresponding target cursor operation event by using various target gesture operations for the handheld terminal, and after the target cursor operation event generated by the fixed terminal, the target cursor operation event may be further simulated, so that the fixed terminal may be operated by using the handheld terminal. Wherein, as will be appreciated by those skilled in the art, the generation of the determined target cursor operation event can be simulated using existing techniques.
By applying the technical scheme provided by the embodiment of the invention, the communication connection can be established between the handheld terminal and the fixed terminal, the virtual mouse is displayed in the handheld terminal, and the cursor matched with the virtual mouse for use is displayed in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
The present invention will be described in detail below with reference to a specific example.
A: a user scans a two-dimensional code image carrying a preset local area network webpage link by using a handheld terminal;
b: because the handheld terminal is not provided with the first fixed terminal control program in advance, a browser in the handheld terminal opens a webpage corresponding to the webpage link; after the webpage is opened, the user downloads and installs the first fixed terminal control program according to the webpage guide prompt;
c: continuing to execute the step A, because a first fixed terminal control program is installed, analyzing the content of the two-dimensional code image obtained by scanning, namely the webpage link, by the first fixed terminal control program, and extracting the IP address carried in the webpage link;
d: c, according to the IP address obtained in step C, establishing the communication connection between the hand-held terminal and the fixed terminal;
e: displaying a mouse-style virtual mouse on a screen of the handheld terminal, see fig. 5; displaying a cursor matched with the virtual mouse on a screen of the fixed terminal;
f: suppose that the target gesture received by the virtual mouse and sent by the user is: the U-shaped pattern slides out of the back of the virtual mouse by a single finger;
g: a first fixed terminal control program in the handheld terminal generates the acquired gesture into a corresponding target virtual mouse operation instruction;
h: and a second fixed terminal control program in the fixed terminal obtains a target gesture aiming at the virtual mouse according to the obtained target virtual mouse operation instruction, wherein the target gesture is as follows: there are patterns (slide out "U" type pattern), click type (single finger slide), click area (back);
i: determining a cursor operation event corresponding to the target gesture: returning to the menu;
j: and simulating and generating the target cursor operation event according to the cursor operation event, wherein the locally displayed cursor responds to the target cursor operation event, namely, returning to a menu, so that the fixed terminal is controlled in a mode of controlling the action of the cursor in the fixed terminal through the gesture operation of the virtual mouse in the handheld terminal.
By applying the technical scheme provided by the embodiment of the invention, the communication connection can be established between the handheld terminal and the fixed terminal, the virtual mouse is displayed in the handheld terminal, and the cursor matched with the virtual mouse for use is displayed in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
Fig. 3 is a schematic structural diagram of a fixed terminal control apparatus in an embodiment of the present invention, which corresponds to the method in fig. 1 and is applied to a handheld terminal with a touch screen function; the apparatus may include: a target gesture receiving module 310, a target instruction generating module 320 and a target instruction sending module 330; wherein the content of the first and second substances,
a target gesture receiving module 310, configured to receive a target gesture operation issued by a user and directed to a virtual mouse displayed in the handheld terminal; the virtual mouse and the cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the preset webpage connection carrying the communication identification of the fixed terminal;
a target instruction generating module 320, configured to generate a target virtual mouse operation instruction corresponding to the target gesture operation;
and the target instruction sending module 330 is configured to send the target virtual mouse operation instruction to the fixed terminal, so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and generates the target cursor operation event in a simulated manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulated manner, and the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal, so as to realize control over the fixed terminal.
Specifically, the communication connection establishing module may include: a webpage link obtaining sub-module and a communication connection establishing sub-module; wherein the content of the first and second substances,
the webpage link obtaining sub-module is used for obtaining a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the communication connection establishing submodule is used for establishing communication connection with the fixed terminal based on the communication identifier in the webpage link.
Specifically, the communication connection between the handheld terminal and the fixed terminal may include: socket communication connection.
Specifically, the operation correspondence between the preset virtual mouse operation instruction and the cursor operation event may include:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
sliding out a virtual mouse operation instruction corresponding to the gesture operation of the second preset shape at a single point on the back of the virtual mouse, wherein the virtual mouse operation instruction corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
By applying the technical scheme provided by the embodiment of the invention, the communication connection can be established between the handheld terminal and the fixed terminal, the virtual mouse is displayed in the handheld terminal, and the cursor matched with the virtual mouse for use is displayed in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
Fig. 4 is another schematic structural diagram of a fixed terminal control apparatus according to an embodiment of the present invention, which corresponds to the method shown in fig. 2 and is applied to a fixed terminal; the apparatus may include: a target instruction receiving module 410, a target event determining module 420 and a target operation generating module 430; wherein the content of the first and second substances,
a target instruction receiving module 410, configured to receive a target virtual mouse operation instruction sent by a handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal;
a target event determining module 420, configured to determine, based on a preset operation correspondence between a virtual mouse operation instruction and a cursor operation event, a target cursor operation event corresponding to the target virtual mouse operation instruction;
and a target operation generation module 430, configured to generate the target cursor operation event in a simulated manner, and respond to the locally displayed cursor with the target cursor operation event generated in the simulated manner, so as to control an action of a cursor in the fixed terminal through a gesture operation on a virtual mouse in the handheld terminal, thereby implementing control on the fixed terminal.
By applying the technical scheme provided by the embodiment of the invention, the communication connection can be established between the handheld terminal and the fixed terminal, the virtual mouse is displayed in the handheld terminal, and the cursor matched with the virtual mouse for use is displayed in the fixed terminal; after receiving a target gesture operation sent by a user to the virtual mouse, the handheld terminal sends a target virtual mouse operation instruction corresponding to the target gesture operation to the fixed terminal; and then the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction according to the received target virtual mouse operation instruction, and generates the target cursor operation event in a simulation manner, so that a locally displayed cursor responds to the target cursor operation event generated in the simulation manner. By applying the embodiment of the invention, the fixed terminal can be controlled in a mode of controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal, so that the complicated operation when the intelligent remote controller is used is avoided, the control speed is greatly improved, and the user operation experience is good.
For system or apparatus embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Those skilled in the art will appreciate that all or part of the steps in the above method embodiments may be implemented by a program to instruct relevant hardware to perform the steps, and the program may be stored in a computer-readable storage medium, which is referred to herein as a storage medium, such as: ROM/RAM, magnetic disk, optical disk, etc.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (10)

1. A fixed terminal control method is characterized by being applied to a handheld terminal with a touch screen function; the method comprises the following steps:
receiving target gesture operation sent by a user and aiming at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relationship, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, the communication connection between the handheld terminal and the fixed terminal is established based on obtaining a preset webpage connection carrying a communication identifier of the fixed terminal, and the target gesture operation comprises: the operation on the virtual mouse and the moving operation on the handheld terminal comprise the following steps: click, touch or slide operations;
generating a target virtual mouse operation instruction corresponding to the target gesture operation;
and sending the target virtual mouse operation instruction to the fixed terminal so that the fixed terminal determines a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relationship between the virtual mouse operation instruction and the cursor operation event, and simulating to generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, so that the action of the cursor in the fixed terminal is controlled through gesture operation on the virtual mouse in the handheld terminal to realize control on the fixed terminal.
2. The method according to claim 1, wherein the communication connection between the handheld terminal and the fixed terminal is established based on obtaining a preset web connection carrying the communication identifier of the fixed terminal, and comprises:
the handheld terminal obtains a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the handheld terminal establishes communication connection with the fixed terminal based on the communication identifier in the webpage link.
3. The method of claim 1, wherein the communication connection between the handheld terminal and the fixed terminal comprises: socket communication connection.
4. The method according to any one of claims 1 to 3, wherein the operation correspondence relationship between the preset virtual mouse operation command and the cursor operation event comprises:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out the second preset shape at the back of the virtual mouse corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
5. A method of operating a terminal, characterized by being applied to a fixed terminal; the method comprises the following steps:
receiving a target virtual mouse operation instruction sent by a handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, and the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal; the target gesture operation comprises: the operation on the virtual mouse and the moving operation on the handheld terminal comprise the following steps: click, touch or slide operations;
determining a target cursor operation event corresponding to the target virtual mouse operation instruction based on a preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event;
and simulating to generate the target cursor operation event, responding the target cursor operation event generated by simulation to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal by the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
6. A fixed terminal control device is characterized by being applied to a handheld terminal with a touch screen function; the device comprises:
the target gesture receiving module is used for receiving target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relationship, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, the communication connection between the handheld terminal and the fixed terminal is established by a communication connection establishment module based on obtaining a preset webpage connection carrying a communication identifier of the fixed terminal, and the target gesture operation comprises the following steps: the operation on the virtual mouse and the moving operation on the handheld terminal comprise the following steps: click, touch or slide operations;
the target instruction generating module is used for generating a target virtual mouse operation instruction corresponding to the target gesture operation;
and the target instruction sending module is used for sending the target virtual mouse operation instruction to the fixed terminal so as to enable the fixed terminal to determine a target cursor operation event corresponding to the target virtual mouse operation instruction based on the preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event, and simulate and generate the target cursor operation event so that a locally displayed cursor responds to the target cursor operation event generated by simulation, and the action of the cursor in the fixed terminal is controlled through the gesture operation of the virtual mouse in the handheld terminal to realize the control of the fixed terminal.
7. The apparatus of claim 6, wherein the communication connection establishing module comprises:
the webpage link obtaining sub-module is used for obtaining a preset webpage link based on a mode of scanning a two-dimensional code image which is displayed by the fixed terminal and contains the preset webpage link, wherein the preset webpage link contains a communication identifier of the fixed terminal;
and the communication connection establishing submodule is used for establishing communication connection with the fixed terminal based on the communication identifier in the webpage link.
8. The apparatus of claim 6, wherein the communication connection between the handheld terminal and the fixed terminal comprises: socket communication connection.
9. The apparatus according to any one of claims 6 to 8, wherein the predetermined operation correspondence relationship between the virtual mouse operation command and the cursor operation event comprises:
a virtual mouse operation instruction corresponding to the virtual mouse gesture operation corresponds to a cursor movement event;
clicking a virtual mouse operation command corresponding to the gesture operation of the left key of the virtual mouse to correspond to a click event of a cursor;
clicking a virtual mouse right button gesture operation corresponding to a virtual mouse operation instruction corresponding to a back event of a cursor;
a virtual mouse operation instruction corresponding to the gesture operation of sliding out of the first preset shape by a single finger on the back of the virtual mouse corresponds to a back event of the cursor;
pressing a left button of the virtual mouse and dragging the virtual mouse, wherein a virtual mouse operation instruction corresponding to a gesture operation of the virtual mouse corresponds to a cursor dragging event in a sliding area;
sliding out a virtual mouse operation instruction corresponding to the gesture operation of the second preset shape at a single point on the back of the virtual mouse, wherein the virtual mouse operation instruction corresponds to a display menu event;
a virtual mouse operation instruction corresponding to a gesture operation of multi-finger sliding from top to bottom on the back of the virtual mouse corresponds to a home page returning event;
a virtual mouse operation instruction corresponding to the gesture operation of sliding from the top to the bottom on the left side of the back of the virtual mouse corresponds to a volume-down event;
and a virtual mouse operation instruction corresponding to the gesture operation of single-finger sliding from bottom to top on the left side of the back of the virtual mouse corresponds to a volume-up event.
10. An apparatus for operating a terminal, characterized by being applied to a fixed terminal; the device comprises:
the target instruction receiving module is used for receiving a target virtual mouse operation instruction sent by the handheld terminal; the handheld terminal has a touch screen function; the target virtual mouse operation instruction is generated by the handheld terminal based on received target gesture operation which is sent by a user and aims at a virtual mouse displayed in the handheld terminal; the virtual mouse and a cursor displayed by the fixed terminal have a matching relation, the virtual mouse and the cursor are displayed after the communication connection between the handheld terminal and the fixed terminal is established, in addition, the communication connection between the handheld terminal and the fixed terminal is established based on the acquisition of a preset webpage connection carrying the communication identification of the fixed terminal, and the target gesture operation comprises the following steps: the operation on the virtual mouse and the moving operation on the handheld terminal comprise the following steps: click, touch or slide operations;
the target event determining module is used for determining a target cursor operation event corresponding to a target virtual mouse operation instruction based on a preset operation corresponding relation between the virtual mouse operation instruction and the cursor operation event;
and the target operation generation module is used for generating the target cursor operation event in a simulation manner, responding the target cursor operation event generated in the simulation manner to the locally displayed cursor, and controlling the action of the cursor in the fixed terminal through the gesture operation of the virtual mouse in the handheld terminal so as to realize the control of the fixed terminal.
CN201510632240.8A 2015-09-29 2015-09-29 Fixed terminal control method and device Active CN105094344B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510632240.8A CN105094344B (en) 2015-09-29 2015-09-29 Fixed terminal control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510632240.8A CN105094344B (en) 2015-09-29 2015-09-29 Fixed terminal control method and device

Publications (2)

Publication Number Publication Date
CN105094344A CN105094344A (en) 2015-11-25
CN105094344B true CN105094344B (en) 2020-01-10

Family

ID=54574978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510632240.8A Active CN105094344B (en) 2015-09-29 2015-09-29 Fixed terminal control method and device

Country Status (1)

Country Link
CN (1) CN105094344B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430468A (en) * 2015-11-30 2016-03-23 北京奇艺世纪科技有限公司 Remote control method and device for television set-top box
CN109558007B (en) * 2018-11-27 2021-08-03 英华达(上海)科技有限公司 Gesture control device and method thereof
CN112804576B (en) * 2019-11-13 2022-11-11 腾讯科技(深圳)有限公司 Operation control method, device and medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104378416A (en) * 2014-10-29 2015-02-25 乐视网信息技术(北京)股份有限公司 Method and device for main control equipment to control controlled equipment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013105784A1 (en) * 2012-06-05 2013-12-05 Beijing Lenovo Software Ltd. Terminal and control method therefor
CN104090648B (en) * 2014-05-21 2017-08-25 中兴通讯股份有限公司 Data entry method and terminal

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104378416A (en) * 2014-10-29 2015-02-25 乐视网信息技术(北京)股份有限公司 Method and device for main control equipment to control controlled equipment

Also Published As

Publication number Publication date
CN105094344A (en) 2015-11-25

Similar Documents

Publication Publication Date Title
US9158391B2 (en) Method and apparatus for controlling content on remote screen
CN108132744B (en) Method and equipment for remotely controlling intelligent equipment
CN105430468A (en) Remote control method and device for television set-top box
CN104090762A (en) Screenshot processing device and method
CN102184014A (en) Intelligent appliance interaction control method and device based on mobile equipment orientation
KR20170014353A (en) Apparatus and method for screen navigation based on voice
KR20060101071A (en) Apparatus and method for a virtual mouse based on two-hands gesture
CN104378416A (en) Method and device for main control equipment to control controlled equipment
CN107272881B (en) Information input method and device, input method keyboard and electronic equipment
CN105681859A (en) Man-machine interaction method for controlling smart TV based on human skeletal tracking
CN103631556A (en) Method, mobile terminal and system for remote control over display device
JP2019135665A (en) Element selecting apparatus, element selecting method, and program
CN105094344B (en) Fixed terminal control method and device
CN111565320A (en) Barrage-based interaction method and device, storage medium and electronic equipment
WO2022017421A1 (en) Interaction method, display device, emission device, interaction system, and storage medium
CN113569635A (en) Gesture recognition method and system
CN110333780A (en) Function triggering method, device, equipment and storage medium
CN108471549B (en) Remote control method and terminal
CN103677500A (en) Data processing method and electronic device
CN105827701B (en) Method and device for controlling controlled terminal based on Internet and Internet of things
CN112449227B (en) Interaction method and device for touch screen application compatible with remote controller operation and smart television
TWI547862B (en) Multi - point handwriting input control system and method
CN110604918B (en) Interface element adjustment method and device, storage medium and electronic equipment
CN104951223B (en) A kind of touch screen realizes the method, apparatus and host of magnifying glass
JP5449088B2 (en) Information input device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant