WO2017049947A1

WO2017049947A1 - Method and intelligent terminal for performing mouse input on display apparatus

Info

Publication number: WO2017049947A1
Application number: PCT/CN2016/084167
Authority: WO
Inventors: 刘冉; 何谦; 李跃基; 缪晶晶; 笪久周
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-09-21
Filing date: 2016-05-31
Publication date: 2017-03-30
Also published as: CN106557184A

Abstract

A method and an intelligent terminal for performing mouse input on a display apparatus. The display apparatus is connected to the intelligent terminal in a wireless manner. The method comprises: detecting state change information when an intelligent terminal changes from a first state into a second state (101); separately comparing the state change information with multiple preset movement states, and when it is determined that the state change information conforms to one of the preset movement states, determining an output control instruction corresponding to the preset movement state conforming to the state change information, wherein each preset movement state corresponds to one output control instruction (102); and outputting the output control instruction to a display apparatus, so that a cursor on the display apparatus moves according to the output control instruction (103).

Description

Method for inputting mouse to display device and intelligent terminal

Technical field

This document relates to, but is not limited to, the field of intelligent terminal control technology, and in particular to a method and a smart terminal for performing mouse input on a display device.

Background technique

With the advent of smart set-top boxes, more and more homes use smart set-top boxes, which are generally operated by remote control devices. However, when operating some applications such as browsing web pages, the remote control device operation is inconvenient, and at the same time, For the user, it is inconvenient to take the controller device operation, and the user does not get a good user experience. Of course, some flying squirrels are designed for users to use, but the use of flying squirrels increases the user's cost of use.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a method for inputting a mouse to a display device and an intelligent terminal, which can improve the user experience, and is convenient to use and reduces the use cost.

An embodiment of the present invention provides a method for performing mouse input on a display device, which is applied to a smart terminal, wherein the display device and the smart terminal are connected by using a wireless connection, and the method includes:

Detecting state change information when the smart terminal is flipped from the first state to the second state;

And comparing the state change information with the plurality of preset movement states, and determining that the state change information meets one of the preset movement states, and determining the preset movement state corresponding to the state change information Outputting a control instruction, wherein each of the preset movement states corresponds to an output control instruction;

An output control command is output to the display device to cause the cursor on the display device to move according to the output control command.

Optionally, the step of detecting state change information when the smart terminal is flipped from the first state to the second state includes:

Detecting a rotation direction and a rotation angle when the first edge of the smart terminal is turned from the first state to the second state, to obtain a first rotation direction and a first rotation angle;

The state change information is obtained according to the first rotation direction and the first rotation angle.

Optionally, the state change information is compared with the plurality of preset movement states, and when it is determined that the state change information meets one of the preset movement states, determining that the state change information conforms to the state change information The output control commands corresponding to the preset movement state include:

Determining whether the first rotation direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is within a first preset value range;

When it is determined that the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determining that the output control instruction is to move the cursor to the first coordinate direction by the first pixel distance;

When it is determined that the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within the first preset value range, determining an output control instruction is to move the cursor toward The first pixel distance is moved in a direction opposite to the first coordinate direction.

Optionally, the step of detecting the state change information when the smart terminal is flipped from the first state to the second state further includes:

Detecting a rotation direction and a rotation angle when the second edge of the smart terminal is flipped from the first state to the second state, obtaining a second rotation direction and a second rotation angle, wherein the second edge is perpendicular to the first An edge

The state change information is obtained according to the first rotation direction, the second rotation direction, the first rotation angle, and the second rotation angle.

Determining whether the first rotation angle is within a predetermined angle range, and determining whether the second rotation direction is a third preset direction or opposite to a third preset direction when the first rotation angle is within a predetermined angle range a fourth preset direction, and whether the second rotation angle is within a first preset value range;

When it is determined that the second rotation direction is the third preset direction, and the second rotation angle is within the first preset value range, determining that the output control instruction is to move the cursor to the second coordinate direction by moving the second pixel a distance, wherein the second coordinate direction is perpendicular to the first coordinate direction;

When it is determined that the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range, determining an output control instruction is to move the cursor toward The second pixel distance is moved in a direction opposite to the second coordinate direction.

Optionally, the state change information is compared with the plurality of preset movement states, and when it is determined that the state change information meets one of the preset movement states, determining that the state change information conforms to the state change information In the step of the output control command corresponding to the preset movement state:

When the first rotation angle is not within the predetermined angle range, determining whether the first rotation direction is a first preset direction or a second preset direction opposite to the first preset direction, and the first rotation Whether the angle is within the first preset value range;

When it is determined that the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determining that the movement direction of the first coordinate component of the cursor is the first coordinate direction, moving The distance is the first pixel distance;

Determining movement of the first coordinate component of the cursor when it is determined that the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within the first preset value range The direction is a direction in which the first coordinate direction is opposite, and the moving distance is a first pixel distance;

When it is determined that the second rotation direction is the third preset direction, and the second rotation angle reaches the first preset value range, determining the moving direction of the second coordinate component of the cursor is the second coordinate direction, and the moving distance Is the second pixel distance;

Determining movement of the second coordinate component of the cursor when it is determined that the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range The direction is the opposite direction of the second coordinate direction, and the moving distance is the second pixel distance;

Determining a final moving direction of the cursor according to the determined moving direction of the first coordinate component and a moving direction of the second coordinate component, and determining a final movement of the cursor according to a moving distance of the first coordinate component and a moving distance of the second coordinate component The pixel distance determines that the output control command is to move the cursor to the final moving direction by moving the final moving pixel distance.

Optionally, the method further includes:

Display mouse button display interface;

And according to the user triggering the mouse button display interface to obtain a corresponding button instruction, sending the button instruction to the display device, so that the display device operates according to the button instruction.

The embodiment of the present invention further provides an intelligent terminal, where the smart terminal is connected to the display device by using a wireless connection, and the smart terminal includes:

a state detecting module, configured to detect state change information when the smart terminal is flipped from the first state to the second state;

The command determining module is configured to compare the state change information with the plurality of preset moving states respectively, and when determining that the state change information meets one of the preset moving states, determining that the state change information is consistent with the state change information An output control command corresponding to the preset movement state, wherein each of the preset movement states corresponds to an output control instruction;

The first command output module is configured to output an output control command to the display device to cause the cursor on the display device to move according to the output control command.

Optionally, the state detection module includes:

a first detecting sub-module, configured to detect a rotation direction and a rotation angle when the first edge of the smart terminal is turned from the first state to the second state, to obtain a first rotation direction and a first rotation angle;

The first acquisition submodule is configured to obtain the state change information according to the first rotation direction and the first rotation angle.

Optionally, the instruction determining module includes:

The first determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is in the first preset Set the value range;

The first instruction sub-module is configured to: when the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determine that the output control instruction is to move the cursor toward the first Moving the first pixel distance in the coordinate direction;

a second command sub-module, configured to determine an output when the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within a first preset value range The control command is to move the first pixel distance by moving the cursor in a direction opposite to the first coordinate direction.

Optionally, the status detection module further includes:

a second detecting submodule configured to detect a rotation direction and a rotation angle when the second edge of the smart terminal is turned from the first state to the second state, to obtain a second rotation direction and a second rotation angle, wherein the a second edge perpendicular to the first edge;

The second acquisition submodule is configured to obtain the state change information according to the first rotation direction, the second rotation direction, the first rotation angle, and the second rotation angle.

Optionally, the instruction determining module further includes:

a second determining sub-module, configured to determine whether the first rotation angle is within a predetermined angle range, and when the first rotation angle is within a predetermined angle range, determining whether the second rotation direction is a third preset direction or a fourth preset direction opposite to the third preset direction, and the second rotation angle is within a first preset value range;

a third instruction sub-module, configured to: when the second rotation direction is a third preset direction, and the second rotation angle is within the first preset value range, determining that the output control instruction is to move the cursor toward the second Moving a second pixel distance in a coordinate direction, wherein the second coordinate direction is perpendicular to the first coordinate direction;

a fourth instruction sub-module, configured to determine an output when the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range The control command is to move the second pixel distance by moving the cursor in a direction opposite to the second coordinate direction.

Optionally, the instruction determining module further includes:

The third determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset opposite to the first preset direction when the first rotation angle is not within a predetermined angle range Direction, and whether the first rotation angle is within a first preset value range;

The fifth command sub-module is configured to: when the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determine a movement direction of the first coordinate component of the cursor is a first coordinate direction, the moving distance is a first pixel distance;

a sixth instruction sub-module, configured to determine a cursor when the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within a first preset value range The moving direction of the first coordinate component is a direction opposite to the first coordinate direction, and the moving distance is a first pixel distance;

a seventh command sub-module, configured to determine that a moving direction of the second coordinate component of the cursor is when the second rotation direction is a third preset direction, and the second rotation angle is within the first preset value range a second coordinate direction, the moving distance is a second pixel distance;

The eighth command sub-module is configured to determine the cursor when the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range The moving direction of the second coordinate component is a direction opposite to the second coordinate direction, and the moving distance is a second pixel distance;

The ninth instruction sub-module is configured to determine a final moving pixel distance of the cursor according to the moving distance of the first coordinate component and the moving distance of the second coordinate component, and determine that the output control instruction is to move the cursor to the final moving pixel distance in the final moving direction.

Optionally, the smart terminal further includes:

a display module configured to display a mouse button display interface;

The second instruction output module is configured to: according to the user triggering the mouse button display interface to obtain a corresponding button instruction, send the button instruction to the display device, so that the display device operates according to the button instruction.

The beneficial effects of the above technical solutions of the embodiments of the present invention are as follows:

The foregoing technical solution of the embodiment of the present invention compares the state change information of the user operation of the smart terminal and the plurality of preset movement states, and determines an output control instruction corresponding to one of the preset movement states; and outputs the output control instruction to the display device. The output control command causes the cursor on the display device to move according to the output control command, which is convenient to use, and improves the user operation experience, and does not need to purchase an additional device such as a flying squirrel, thereby saving the user's use cost.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a flow chart showing a method of performing mouse input on a display device according to an embodiment of the present invention;

2 is a block diagram showing the structure of an intelligent terminal according to an embodiment of the present invention;

3 is a schematic diagram showing the display of a smart phone according to an embodiment of the present invention;

Figure 4 is a diagram showing the determination of the coordinate movement position on the display device in an embodiment of the present invention.

Embodiments of the invention

The detailed description will be made below in conjunction with the accompanying drawings and specific embodiments.

The embodiment of the present invention provides a method for injecting mouse input to a display device and an intelligent terminal through the inconvenience of using the remote control device when the display device is operated, or the additional operation device is added to bring additional use cost. Performing, by the detected user, operating the smart terminal, comparing the state change information of the smart terminal to the plurality of preset movement states, and determining an output control instruction corresponding to the preset movement state that matches the state change information; The output control command is output to the display device to move the cursor on the display device according to the output control command, which is convenient to use, and improves the user operation experience, and does not need to purchase an additional device, thereby saving the user's use cost.

The smart terminal according to the embodiment of the present invention refers to an Android smart phone, an Android tablet computer, an iPhone, an iPad, and the like that run an intelligent operating system such as Android (Android) and IOS.

FIG. 1 is a flow diagram of a method for performing mouse input on a display device according to an embodiment of the present invention. A method for performing mouse input on a display device according to an embodiment of the present invention is applied to a smart terminal, wherein the display is The device is connected to the smart terminal by using a wireless connection, and the method includes:

Step 101: Detect state change information when the smart terminal is flipped from the first state to the second state.

The first state and the second state may be any one of the location states in which the smart terminal is located, that is, the smart terminal may be in a horizontal position, a vertical position, or any position between a relative horizontal position and a relatively vertical position.

In this step, the virtual intelligent terminal is in a first state position to establish a spatial coordinate system. The spatial coordinate system is a first edge of the touch screen of the smart terminal or a direction parallel to the first edge is an x-axis, a second edge perpendicular to the first edge of the touch screen of the smart terminal, or a direction parallel to the second edge For the y-axis, the touch screen of the vertical smart terminal is the z-axis upward direction, and the rotation of the smart terminal in the spatial coordinate system detects the rotation of the first edge of the smart terminal from the first state to the second state. Direction and rotation angle, obtaining a first rotation direction corresponding to the first edge and a first rotation angle; and then obtaining the state change information. Similarly, the rotation direction and the rotation angle when the second edge is turned from the first state to the second state can be obtained, and the corresponding second rotation direction and the second rotation angle are obtained. The first edge may be any one of the peripheral edges of the preset smart terminal or any reference line other than the peripheral edge, and the second edge is perpendicular to the peripheral edge of the first edge or perpendicular to the peripheral edge Any reference line at one edge.

The state change information includes: a first rotation direction, a first rotation angle; or a second rotation direction and a second rotation angle.

Step 102: Compare the state change information with a plurality of preset movement states, and when determining that the state change information meets one of the preset movement states, determine a preset movement that matches the state change information. The state corresponds to an output control command, wherein each of the preset movement states corresponds to an output control command.

In step 102, it is determined whether the first rotation direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is in a first preset value range. When it is determined that the first rotation direction is the first preset direction (for example, the first edge is turned upward when the first edge is opposite to the first state), and the first rotation angle is within the first preset value range, it is determined The state change information is consistent with one of the preset movement states, and the output control command is determined to move the cursor to the first coordinate direction by the first pixel distance; and when the first rotation direction is determined to be opposite to the first preset direction When the first rotation angle is within the first preset value range, it is determined that the state change information conforms to one of the preset movement states, and the output control command is determined to be opposite to the first coordinate direction. The direction moves the first pixel distance.

When the first rotation angle is the boundary of the first preset value range, it is considered that the first rotation angle is within the first preset value range, and the first rotation angle may be considered not to be within the first preset value range.

It is assumed here that the smart terminal is in the horizontal position in the first state, and the first preset direction is that the first edge is turned upside down relative to the first state, and the coordinate direction of the corresponding output control command is the display device. When the middle cursor moves downward, the second preset direction is that the first edge is turned downward with respect to the first state, and the coordinate direction of the corresponding output control command is that the cursor moves upward in the display device. In this way, when the user flips the smart terminal so that the first edge is turned upward by an angle a with respect to the horizontal position, and the angle a is within the first preset value range, the output control command is to move the cursor downward relative to the initial position by a' The pixel distance, a' corresponds to the first preset value range in which a is located; when the user flips the smart terminal to flip the first edge relative to the horizontal position downward by an angle a, the output control command is to move the cursor upward relative to the initial position a' Pixel distance.

Similarly, it is assumed that the third preset direction corresponding to the second rotation direction is that the second edge is turned upward relative to the first state, and the coordinate direction of the corresponding output control command is that the cursor moves to the right in the display device, and the third pre- The fourth preset direction opposite to the opposite direction is that the second edge is turned downward with respect to the first state, and the coordinate direction of the corresponding output control command is that the cursor moves to the left in the display device, when the user flips the smart terminal to make the second edge When the relative horizontal position is turned upward by the angle b, and the angle b is within the preset value range, the output control command is to move the cursor to the right relative to the initial position by b' pixel distance, where b' corresponds to the preset numerical range of b; When the user flips the smart terminal so that the second edge flips the angle b downward with respect to the horizontal position, the output control command is to move the cursor to the left by b' pixel distance from the initial position.

Step 103: Output an output control command to the display device, so that the cursor on the display device moves according to the output control command.

In the above embodiment, the display device and the smart terminal are connected by a wireless connection manner such as wifi or Bluetooth. When the user operates the smart terminal to flip, the smart terminal detects the state change information when the user is turned from the first state to the second state. And comparing the state change information with the plurality of preset movement states, determining an output control instruction corresponding to one of the preset movement states; and outputting the output control instruction to the display device to cause the cursor on the display device to be The output control command moves. In this way, the user can reverse the state change information of the smart terminal by flipping the smart terminal to meet the preset movement state, and can operate the cursor movement on the display device through the corresponding output control instruction, which is simple in operation and can bring a good user experience to the user.

In another embodiment of the present invention, in step 102, the step of detecting state change information when the smart terminal is flipped from the first state to the second state further includes:

Detecting rotation of the second edge of the smart terminal when flipping from the first state to the second state a direction of rotation and a second angle of rotation, wherein the second edge is perpendicular to the first edge;

And comparing the state change information with the plurality of preset movement states, and determining that the state change information meets one of the preset movement states, and determining the preset movement state corresponding to the state change information The output control instructions also include:

Determining whether the first rotation angle is within a predetermined angle range, and determining that the second rotation direction is within a predetermined angle range, determining whether the second rotation direction is a third preset direction or opposite to the third preset direction a fourth preset direction, and whether the second rotation angle is within a first preset value range;

When it is determined that the second rotation direction is the third preset direction, and the second rotation angle is within the first preset value range, determining that the state change information conforms to one of the preset movement states, determining an output Controlling the command to move the cursor to the second coordinate direction in a second coordinate direction, wherein the second coordinate direction is perpendicular to the first coordinate direction;

When it is determined that the second rotation direction is the fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range, determining that the state change information conforms to the preset movement state And determining that the output control command is to move the second pixel distance by moving the cursor in a direction opposite to the second coordinate direction.

In this embodiment, when it is detected that the smart terminal has a flip, it is first determined whether the smart terminal is flipped in a single direction. If the second edge is detected to be reversed in the embodiment, it is determined whether the first rotation angle is preset. An angle range, which is an angular error range of the smart terminal flip setting that allows the flip to exist, that is, when the first rotation angle is within a predetermined angle range, the smart terminal only has a direction with the second edge as a reference. Inverting, at this time judging the second rotation direction of the second edge inversion and the second rotation angle; referring to the assumed first state, each of the preset directions and the flip angle in the previous embodiment, when the second rotation angle b is in the When the second rotation direction is the third preset direction (for example, the second edge is turned up with respect to the horizontal position), the output control instruction corresponding to the preset movement state corresponding to the state change information is determined. To move the cursor to the right relative to the initial position by a second pixel distance b'; if the second rotation direction is the fourth preset direction (eg, For example, the second edge is flipped downward relative to the horizontal position, and the output control command corresponding to the preset movement state corresponding to the state change information is to move the cursor to the left by a second pixel distance b' relative to the initial position.

When the first rotation angle is not within the predetermined angle range, that is, the first edge and the second edge of the smart terminal are reversed relative to the first state, determining whether the first rotation direction is the first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is within a first preset value range;

Determining the state when the first rotation direction is the first preset direction (for example, the first edge is turned upward when the first edge is opposite to the first state), and the first rotation angle a is within the first preset value range The change information conforms to one of the preset movement states, and determines that the moving direction of the first coordinate component of the cursor is downward, and the moving distance is the first pixel distance a';

When the first rotation direction is a second preset direction opposite to the first preset direction (for example, the first edge is turned downward with respect to the horizontal position), and the first rotation angle a is in the first preset value range When it is determined internally, it is determined that the state change information conforms to one of the preset movement states, and the moving direction of the first coordinate component of the cursor is determined to be upward relative to the initial position, and the moving distance is the first pixel distance a';

Determining the state change information when the second rotation direction is the third preset direction (for example, the second edge is reversed with respect to the horizontal position), and the second rotation angle b is within the first preset value range Corresponding to one of the preset moving states, determining that the moving direction of the second coordinate component of the cursor is opposite to the initial position, and the moving distance is the second pixel distance b';

When the second rotation direction is a fourth preset direction opposite to the third preset direction (for example, the second edge is turned downward with respect to the horizontal position), and the second rotation angle b is in the first preset value range When the inner state is determined, the state change information is determined to be one of the preset moving states, and the moving direction of the second coordinate component of the cursor is determined to be relative to the initial position to the left, and the moving distance is the second pixel distance b';

The final moving pixel distance of the cursor is determined according to the moving distance of the first coordinate component and the moving distance of the second coordinate component, and the output control command is determined to move the cursor to the final moving pixel distance in the final moving direction. Here, it is possible to acquire the final moving direction of the cursor and the final moving pixel distance by adding the vectors corresponding to the first coordinate component and the second coordinate component.

Wherein, the first coordinate component or the second coordinate component of the cursor may be a component in an arbitrary direction.

In this embodiment, by setting a predetermined angle range, that is, the user allows a certain angular error when the smart terminal is turned over, the user has a controllable space during operation, which reduces the occurrence of the user's misoperation behavior, and the operation is more consistent. user experience.

Optionally, the method of the foregoing embodiment of the present invention further includes:

Display mouse button display interface;

The user can trigger a button of the mouse button display interface, and the button can include a left mouse button, a right mouse button, and other control buttons based on the needs of the device, and then the smart terminal obtains a corresponding button command according to the user trigger, and sends the button command to the display device. And causing the display device to perform a corresponding instruction operation according to the button instruction.

Embodiments of the present invention also provide a computer readable storage medium storing computer executable instructions for performing any of the methods described above.

FIG. 2 is a structural block diagram of an intelligent terminal according to an embodiment of the present invention. The embodiment of the present invention further provides an intelligent terminal, where the smart terminal and the display device are connected by using a wireless connection, and the smart terminal includes:

The state detecting module 21 is configured to detect state change information when the smart terminal is flipped from the first state to the second state;

The command determining module 22 is configured to compare the state change information with the plurality of preset moving states respectively, and when determining that the state change information meets one of the preset moving states, determining the pre-compliance with the state change information Setting a first output control instruction corresponding to the moving state, wherein each preset moving state corresponds to an output control instruction;

The first command output module 23 is configured to output an output control command to the display device to cause the cursor on the display device to move according to the output control command.

In the above embodiment, the display device and the smart terminal are wirelessly connected through a wireless connection manner such as wifi or Bluetooth. When the user operates the smart terminal to reverse, the state detecting module 21 of the smart terminal detects that the state is reversed from the first state to the second state. The state change information in the state, the command determining module 22 compares the state change information with a plurality of preset movement states, and determines a pre-compliance with the state change information. An output control command corresponding to the movement state is set; then the first command output module 23 outputs the output control command to the display device to cause the cursor on the display device to move according to the output control command. In this way, the user can reverse the state change information of the smart terminal by flipping the smart terminal to meet the preset movement state, and can operate the cursor movement on the display device through the corresponding output control instruction, which is simple in operation and can bring a good user experience to the user.

Optionally, the state detecting module 21 includes:

Optionally, the instruction determining module 22 includes:

The first determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is in the first preset Setting a value range, and when the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, triggering the first instruction sub-module, and when the first a second instruction sub-module is triggered when a rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within the first preset value range;

The first instruction submodule is configured to determine, according to the triggering of the first determining submodule, that the output control command is to move the cursor to the first coordinate direction by the first pixel distance;

The second instruction sub-module is configured to determine, according to the trigger of the first determining sub-module, that the output control command is to move the first pixel distance in a direction opposite to the first coordinate direction.

Optionally, the state detecting module 21 further includes:

Optionally, the instruction determining module 22 further includes:

a second determining sub-module, configured to determine whether the first rotation angle is within a predetermined angle range, and when the first rotation angle is within a predetermined angle range, determining whether the second rotation direction is a third preset direction or a fourth preset direction opposite to the third preset direction, and the second rotation angle is within a first preset value range, and when the second rotation direction is a third preset direction, and When the second rotation angle is within the first preset value range, triggering the third instruction sub-module, and when the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second When the rotation angle is within the first preset value range, triggering the fourth instruction sub-module;

The third instruction sub-module is configured to determine, according to the triggering of the second determining sub-module, that the output control command is to move the cursor to the second coordinate direction by the second pixel distance, wherein the second coordinate direction is perpendicular to the first a coordinate direction;

The fourth instruction submodule is configured to determine, according to the trigger of the second determining submodule, that the output control command is to move the second pixel distance in a direction opposite to the second coordinate direction.

Optionally, the instruction determining module 22 further includes:

The third determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset opposite to the first preset direction when the first rotation angle is not within a predetermined angle range a direction, and whether the first rotation angle is within a first preset value range, and determining whether the second rotation direction is a third preset direction or a fourth preset direction opposite to the third preset direction, And whether the second rotation angle is within a first preset value range, and when the first rotation direction is a first preset direction, and the first rotation angle is within a first preset value range, Triggering the fifth instruction sub-module, when the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within the first preset value range, triggering the sixth The command sub-module triggers the seventh command sub-module when the second rotation direction is the third preset direction, and the second rotation angle is within the first preset value range, and when the second rotation The direction is opposite to the third preset direction Four predetermined direction, and the second rotation angle is within a first predetermined range of values, to trigger an eighth sub-module command;

The fifth instruction sub-module is configured to determine, according to the triggering of the third determining sub-module, that the moving direction of the first coordinate component of the cursor is the first coordinate direction, and the moving distance is the first pixel distance;

The sixth instruction sub-module is configured to determine, according to the triggering of the third determining sub-module, that the moving direction of the first coordinate component of the cursor is a direction opposite to the first coordinate direction, and the moving distance is a first pixel distance;

The seventh instruction sub-module is configured to determine, according to the triggering of the third determining sub-module, that the moving direction of the second coordinate component of the cursor is the second coordinate direction, and the moving distance is the second pixel distance;

The eighth instruction sub-module is configured to determine, according to the triggering of the third determining sub-module, that the moving direction of the second coordinate component of the cursor is a direction opposite to the second coordinate direction, and the moving distance is a second pixel distance;

Preferably, the smart terminal further includes:

a display module configured to display a mouse button display interface;

In order to make the embodiment of the present invention more specific and detailed, the present invention provides an example of a specific embodiment, as shown in FIG. 3, a schematic diagram of a smart phone display according to an embodiment of the present invention, and a smart phone of an Android system is used as an intelligent embodiment of the present invention. terminal. In the smartphone of the specific embodiment, the state detecting module includes a direction sensor, and the first command output module and the second command output module include a timer, and for convenience of description, the direction sensor is used as an execution body of the state detecting module to time The device acts as an execution body of the first instruction output module and the second instruction output module; the timer sends a relevant instruction to the server software of the display device when timing (high frequency) or when receiving the button command and receiving the output control command.

In this embodiment, the smart phone establishes a connection with the server software on the display device through wifi in advance, and displays a mouse button display interface on the touch screen of the smart phone (the display module is disposed on the touch screen), as shown in FIG. The left button and the right button are displayed, and the user can click the left button and the right button to enable the smart terminal to obtain the corresponding button command and transmit it through the timer. To the display device, the corresponding operation is performed on the display device according to the left and right key commands. The initial position of the smartphone is placed in a horizontal position, the touch screen is facing upward, that is, the first state is horizontal, and it is assumed that the smartphone shown in FIG. 3 is placed in a horizontal position; and the lower edge of the smartphone illustrated in FIG. 3 is taken as the first An edge, with the left edge of the smartphone illustrated in FIG. 3 as the second edge; and while the imaginary smartphone is in the first state, that is, in the horizontal position in the specific embodiment, there is a spatial coordinate system, which is parallel to The axis of the first edge is the y-axis, the axis parallel to the second edge is the x-axis, and the touch screen of the vertical smartphone is facing upward (the vertical paper faces up) in the z-axis.

When the user only flips the smartphone on one side or the angle at which one side is flipped within the allowable error angle range (predetermined angle range), the direction sensor detects a one-sided flip: when detecting the first edge of the smartphone from the horizontal position If the angle a is turned up (ie, facing the paper face up), the inverted smartphone has an angle change on the xz coordinate system, and the corresponding output control command is to determine that the cursor moves downward by a' pixel distance, assuming the absolute value of a In the range of [10,20], assuming that the [10,20] range is one of the preset value ranges, the corresponding output control command is to determine that the cursor is moving downward by 5 pixels; in contrast, when detecting the first of the smartphone The edge flips the angle a from the horizontal position downward (ie, facing the paper face down), and the corresponding output control command is to determine that the cursor moves upward by a' pixel distance, and also assumes that the absolute value of a is in the range of [10, 20], corresponding to The output control command is to determine that the cursor is moved upward by 5 pixels; when the second edge of the smart phone is detected to be turned upward from the horizontal position (ie, opposite to the paper), the inverted wisdom is The mobile phone has an angular change in the yz coordinate system, and the corresponding output control command is to determine that the cursor moves to the right by b' pixel distances, assuming that the absolute value of b is in the range of [10, 20], and the corresponding output control command is the determining cursor. Moving 5 pixels to the right; in contrast, when detecting the second edge of the smartphone from the horizontal position downward (ie, facing the paper facing down), the angle b changes after the inverted smartphone changes in the yz coordinate system. The corresponding output control command is to determine that the cursor moves to the left by b' pixel distances, assuming that the absolute value of b is in the range of [10, 20], and the corresponding output control command is to determine that the cursor is moved 5 pixels to the left; Check whether the timer is turned on, start the timer when it is not turned on, and send a corresponding output control command to the display device through the timer to make the cursor move accordingly.

When the user flips the smartphone in two reference directions at the same time, and the angles of the two sides are not within the allowable error angle range (predetermined angle range), it is assumed that the first edge of the detected smartphone is from the horizontal position (ie, Detecting the second side of the smartphone by flipping the angle a relative to the paper facing down The angle is upward from the horizontal position (ie, opposite to the paper surface), and the corresponding output control command is that the first coordinate component of the cursor moves the cursor upward by a' pixel distance, and the second coordinate component moves the cursor to the right b' For the pixel distance, as shown in FIG. 4, the final moving direction of the cursor and the moving pixel distance are determined according to the first coordinate component and the second coordinate component. In addition, when the smartphone has a certain flip in two reference directions or one of the directions, but the flip angle is within the error angle range (predetermined angle range), it is still determined that the smartphone is in the horizontal position (first state), the cursor No movement occurs.

When the flip angle of the smartphone is larger, the cursor moves faster, and the flip angle is within a larger preset value range, and the corresponding cursor moving pixel distance is larger; and the moving pixel distance value of the cursor is divided and displayed. The screen of the device is automatically set, that is, the same flip angle of the smart phone. The larger the screen of the display device is, the larger the distance value of the corresponding moving pixel of the cursor is, and the screen size of the display device can be in the smart phone (smart terminal) and the display device server software. Obtained from the server software after connection.

It should be noted that, in the above specific embodiment, the selection of the smart phone in the horizontal position is the first state for the convenience of the description of the embodiment, and the location setting of the first state of the smart terminal in the present invention is not limited.

In the above embodiment of the present invention, the user can perform the cursor movement on the display device through the corresponding output control command by inverting the smart terminal to make the state change information of the smart terminal inversion conform to the preset movement state, and the operation is simple and can be brought to the user. Good user experience.

In the description of the present invention, the terms "left", "right", "upper", "lower" and the like used in the movement of the cursor are merely descriptions of the orientation of the cursor relative to its initial position for convenience of describing the present embodiment, and are not intended to be the present invention. The limitations of the corresponding technical solutions. In addition, in the embodiment of the present invention, the selection of the first edge and the second edge, the coordinate setting, and the like are described using the terms "upper", "down", and "left", and the description used in the description of the flip direction of the smartphone. The terms "upward" and "downward" are used to refer to the orientation or positional relationship shown in the drawings, and are not intended to be a particular orientation or a particular orientation of the invention, and are not to be construed as limiting the scope of the invention.

One of ordinary skill in the art will appreciate that all or part of the steps in the above methods may be performed by a program to instruct related hardware, such as a processor, which may be stored in computer readable storage. In media, such as read-only memory, disk or optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program in a storage and a memory by a processor. / instruction to achieve its corresponding function. The invention is not limited to any specific form of combination of hardware and software.

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

Industrial applicability

The above technical solution improves the user operation experience and saves the user's use cost.

Claims

A method for performing mouse input on a display device is applied to a smart terminal, wherein the display device and the smart terminal are connected by using a wireless connection, and the method includes:

Detecting state change information when the smart terminal is flipped from the first state to the second state;

And comparing the state change information with the plurality of preset movement states, and determining that the state change information meets one of the preset movement states, and determining the preset movement state corresponding to the state change information Outputting a control instruction, wherein each of the preset movement states corresponds to an output control instruction;

An output control command is output to the display device to cause the cursor on the display device to move according to the output control command.
The method of claim 1, wherein the detecting the state change information when the smart terminal is flipped from the first state to the second state comprises:

Detecting a rotation direction and a rotation angle when the first edge of the smart terminal is turned from the first state to the second state, to obtain a first rotation direction and a first rotation angle;

The state change information is obtained according to the first rotation direction and the first rotation angle.
The method of claim 2, wherein the comparing the state change information with the plurality of preset movement states respectively comprises:

Determining whether the first rotation direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is within a first preset value range;

The determining that the state change information conforms to one of the preset moving states includes:

When it is determined that the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determining that the state change information conforms to one of the preset movement states;

The output control instruction corresponding to the preset movement state that is consistent with the state change information includes:

Determining that the output control instruction is to move the cursor by the first pixel distance in the first coordinate direction;

Or,

The determining that the state change information conforms to one of the preset moving states includes:

Determining that the first rotation direction is a second preset direction opposite to the first preset direction, and when the first rotation angle is within the first preset value range, determining that the state change information conforms to the preset One of the moving states;

The determining, by the output control instruction corresponding to the preset movement state that is consistent with the state change information, determining that the output control instruction is to move the first pixel distance in a direction opposite to the first coordinate direction.
The method of claim 2, the step of detecting state change information when the smart terminal is flipped from the first state to the second state further comprises:

Detecting a rotation direction and a rotation angle when the second edge of the smart terminal is flipped from the first state to the second state, obtaining a second rotation direction and a second rotation angle, wherein the second edge is perpendicular to the first An edge

The state change information is obtained according to the first rotation direction, the second rotation direction, the first rotation angle, and the second rotation angle.
The method of claim 4, wherein the comparing the state change information with the plurality of preset movement states respectively comprises:

Determining whether the first rotation angle is within a predetermined angle range, and determining whether the second rotation direction is a third preset direction or opposite to a third preset direction when the first rotation angle is within a predetermined angle range a fourth preset direction, and whether the second rotation angle is within a first preset value range;

The determining that the state change information conforms to one of the preset moving states includes:

Determining that the second rotation direction is a third preset direction, and the second rotation angle is within a first preset value range;

The determining, by the determining, the output control instruction corresponding to the preset movement state that is consistent with the state change information includes: determining that the output control instruction is to move the cursor to the second coordinate direction by a second pixel distance, wherein the second coordinate direction Vertical to the first coordinate direction;

Alternatively, the determining that the state change information conforms to one of the preset moving states includes:

Determining that the second rotation direction is a fourth preset direction opposite to the third preset direction, and The second rotation angle is within a first preset value range;

The determining, by the output control instruction corresponding to the preset movement state that is consistent with the state change information, determining that the output control instruction is to move the second pixel distance by moving the cursor in a direction opposite to the second coordinate direction.
The method according to claim 5, wherein the comparing the state change information with the plurality of preset movement states, and determining that the state change information conforms to one of the preset movement states, determining The output control instruction corresponding to the preset movement state that is consistent with the state change information further includes:

When the first rotation angle is not within the predetermined angle range, determining whether the first rotation direction is a first preset direction or a second preset direction opposite to the first preset direction, and the first rotation Whether the angle reaches the first preset value range;

When it is determined that the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determining that the movement direction of the first coordinate component of the cursor is the first coordinate direction, moving The distance is the first pixel distance;

Determining movement of the first coordinate component of the cursor when it is determined that the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle device is within the first preset value range The direction is a direction in which the first coordinate direction is opposite, and the moving distance is a first pixel distance;

When it is determined that the second rotation direction is the third preset direction, and the second rotation angle is within the first preset value range, determining that the moving direction of the second coordinate component of the cursor is the second coordinate direction, moving The distance is the second pixel distance;

Determining movement of the second coordinate component of the cursor when it is determined that the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range The direction is the opposite direction of the second coordinate direction, and the moving distance is the second pixel distance;

The final moving pixel distance of the cursor is determined according to the moving distance of the first coordinate component and the moving distance of the second coordinate component, and the output control command is determined to move the cursor to the final moving pixel distance in the final moving direction.
The method of claim 1 further comprising:

Display mouse button display interface;

And according to the user triggering the mouse button display interface to obtain a corresponding button instruction, sending the button instruction to the display device, so that the display device operates according to the button instruction.
An intelligent terminal, the smart terminal and the display device are connected by using a wireless device, and the smart terminal includes:

a state detecting module, configured to detect state change information when the smart terminal is flipped from the first state to the second state;

The command determining module is configured to compare the state change information with the plurality of preset moving states, and determine that the state change information meets the state change information when determining that the state change information meets one of the preset moving states The output control command corresponding to the preset preset movement state, wherein each of the preset movement states corresponds to an output control instruction;

The first command output module is configured to output the output control command to the display device to cause the cursor on the display device to move according to the output control command.
The intelligent terminal of claim 8, wherein the state detecting module comprises:

a first detecting sub-module, configured to detect a rotation direction and a rotation angle when the first edge of the smart terminal is turned from the first state to the second state, to obtain a first rotation direction and a first rotation angle;

The first acquisition submodule is configured to obtain the state change information according to the first rotation direction and the first rotation angle.
The intelligent terminal of claim 9, wherein the instruction determining module comprises:

The first determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset direction opposite to the first preset direction, and whether the first rotation angle is in the first preset Set the value range;

The first instruction sub-module is configured to: when the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determine that the output control instruction is to move the cursor toward the first Moving the first pixel distance in the coordinate direction;

a second instruction sub-module, configured to determine the location when the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is within the first preset value range The output control command is to move the first pixel distance by moving the cursor in a direction opposite to the first coordinate direction.
The smart terminal according to claim 9 or 10, wherein the state detecting module further comprises:

a second detecting submodule configured to detect a rotation direction and a rotation angle when the second edge of the smart terminal is turned from the first state to the second state, to obtain a second rotation direction and a second rotation angle, wherein the a second edge perpendicular to the first edge;

The second acquisition submodule is configured to obtain the state change information according to the first rotation direction, the second rotation direction, the first rotation angle, and the second rotation angle.
The intelligent terminal of claim 11, the instruction determining module further comprising:

a second determining sub-module, configured to determine whether the first rotation angle is within a predetermined angle range, and when the first rotation angle is within a predetermined angle range, determining whether the second rotation direction is a third preset direction or a fourth preset direction opposite to the third preset direction, and the second rotation angle is within a first preset value range;

a third instruction sub-module, configured to: when the second rotation direction is a third preset direction, and the second rotation angle is within a first preset value range, determining that the output control instruction is to move the cursor toward Moving a second pixel distance in a second coordinate direction, wherein the second coordinate direction is perpendicular to the first coordinate direction;

a fourth instruction sub-module, configured to determine that when the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range An output control command is to move the second pixel distance by moving the cursor in a direction opposite to the second coordinate direction.
The intelligent terminal of claim 12, the instruction determining module further comprising:

The third determining sub-module is configured to determine whether the first rotating direction is a first preset direction or a second preset opposite to the first preset direction when the first rotation angle is not within a predetermined angle range a direction, and whether the first rotation angle reaches a first preset value range;

The fifth command sub-module is configured to: when the first rotation direction is the first preset direction, and the first rotation angle is within the first preset value range, determine a movement direction of the first coordinate component of the cursor is a first coordinate direction, the moving distance is a first pixel distance;

a sixth command sub-module, configured to determine a cursor position when the first rotation direction is a second preset direction opposite to the first preset direction, and the first rotation angle is in a first preset value range The moving direction of a coordinate component is the opposite direction of the first coordinate direction, and the moving distance is the first pixel distance;

a seventh command sub-module, configured to determine that a moving direction of the second coordinate component of the cursor is when the second rotation direction is a third preset direction, and the second rotation angle is within the first preset value range a second coordinate direction, the moving distance is a second pixel distance;

The eighth command sub-module is configured to determine the cursor when the second rotation direction is a fourth preset direction opposite to the third preset direction, and the second rotation angle is within the first preset value range The moving direction of the second coordinate component is a direction opposite to the second coordinate direction, and the moving distance is a second pixel distance;

The ninth instruction sub-module is configured to determine a final moving pixel distance of the cursor according to the moving distance of the first coordinate component and the moving distance of the second coordinate component, and determine that the output control instruction is to move the cursor to the final moving pixel distance in the final moving direction.
The smart terminal of claim 8, the smart terminal further comprising:

a display module configured to display a mouse button display interface;

The second instruction output module is configured to: according to the user triggering the mouse button display interface to obtain a corresponding button instruction, send the button instruction to the display device, so that the display device operates according to the button instruction.