CN108255317B

CN108255317B - Cursor control method and device

Info

Publication number: CN108255317B
Application number: CN201810131566.6A
Authority: CN
Inventors: 林行; 蒋露
Original assignee: Ke Technology
Current assignee: Ke Technology
Priority date: 2018-02-08
Filing date: 2018-02-08
Publication date: 2021-09-17
Anticipated expiration: 2038-02-08
Also published as: CN108255317A

Abstract

The application relates to a cursor control method and device. The method comprises the following steps: detecting a hovering operation or a touching operation of a control object on the sensing area; generating a control instruction according to the hovering operation or the touch operation, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the coordinate of the control point for the hovering operation or the touch operation, or the cursor coordinate obtained according to a preset mapping mode and the coordinate of the control point, wherein the coordinate of the control point is the coordinate of the control point in a first coordinate system, the first coordinate is the coordinate system of the sensing area, the cursor coordinate is the coordinate of the cursor in a second coordinate system, the second coordinate system is the coordinate system of the display area of the display device, and the mapping mode is the mapping mode from the first coordinate system to the second coordinate system; and sending the control instruction to the display device so that the display device acquires coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays the cursor at the position indicated by the cursor coordinates of the display area.

Description

Cursor control method and device

Technical Field

The present application relates to the field of cursor control technologies, and in particular, to a cursor control method and apparatus.

Background

In the related art, a large number of large-screen display devices similar to smart televisions exist, viewers need to watch the large-screen display devices remotely due to large screens, and the large-screen display devices are far away from the large-screen display devices, so that the movement of a cursor is not controlled directly through a touch screen.

The traditional remote controller control mode can only control the movement of the cursor through the upper key, the lower key, the left key and the right key, most of the traditional remote controller control mode needs to be operated through multiple keys, the cursor can be controlled to move to a target position, and the operation is inconvenient.

The air mouse is usually controlled by accumulating and calculating a spatial position by an acceleration sensor, determining a relative displacement, and controlling the cursor to move, and after the air mouse moves rapidly or is used for a long time, the position of the air mouse drifts due to sampling precision and the like, so that the accuracy of cursor positioning is reduced.

Disclosure of Invention

To overcome, at least to some extent, the problems in the related art, the present application provides a cursor control method and apparatus.

According to a first aspect of embodiments of the present application, there is provided a cursor control method, including:

detecting a hovering operation or a touching operation of a control object on the sensing area;

generating a control instruction according to the hovering operation or the touch operation, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the coordinates of the control point for the hovering operation or the touch operation, or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, wherein the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the cursor coordinates are coordinates of a cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

and sending the control instruction to a display device, so that the display device acquires the coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays a cursor at a position indicated by the cursor coordinates in the display area.

Preferably, when the coordinate information is the cursor coordinate, the method further includes:

acquiring a mapping mode, wherein the mapping mode is a scaling mapping mode, the scaling mapping mode comprises a scaling coefficient, and the scaling coefficient is obtained by calculation according to the maximum value of the coordinate of the display area on each axis and the maximum value of the coordinate of the induction area on each axis;

and calculating to obtain the cursor coordinate according to the zooming mapping mode and the coordinate of the control point.

Preferably, the method further comprises:

detecting touch pressing operation of the control object on the sensing area, and sending a cursor selection instruction to the display equipment after detecting the touch pressing operation; and the number of the first and second groups,

and detecting the lifting operation of the control object on the sensing area, and sending a cursor release instruction to the display equipment after detecting the lifting operation.

Preferably, the lifting operation comprises:

the control object generates a touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or,

the control object generates touch pressing operation on the sensing area, and the touch pressing operation is converted into the touch of the control object on the sensing area.

Preferably, the control comprises:

a finger, or, a stylus.

According to a second aspect of the embodiments of the present application, there is provided a cursor control method, including:

receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the steps that coordinates of a control point corresponding to hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point are obtained, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

acquiring the coordinate information from the control instruction, and determining the coordinate of the cursor according to the coordinate information;

displaying a cursor at a location of the display area indicated by the cursor coordinates.

Preferably, the determining the cursor coordinate according to the coordinate information includes:

when the coordinate information contained in the control instruction is the coordinate of a control point, determining the coordinate of the cursor according to the coordinate of the control point; or,

and when the coordinate information contained in the control command is cursor coordinates, directly determining the coordinate information as the cursor coordinates.

Preferably, determining the cursor coordinate according to the coordinate of the control point includes:

Preferably, the method further comprises:

receiving a cursor selection instruction sent by the controller, wherein the cursor selection instruction is generated after the controller senses the touch pressing operation generated by the control object on the sensing area, and controlling to select a cursor according to the cursor selection instruction; and the number of the first and second groups,

and receiving a cursor release instruction sent by the controller, wherein the cursor release instruction is generated after the controller senses the lifting operation of the control object on the sensing area, and controlling to release a cursor according to the cursor release instruction.

According to a third aspect of embodiments of the present application, there is provided a cursor control device including:

the detection module is used for detecting the hovering operation or the touch operation of a control object on the sensing area;

a generating module, configured to generate a control instruction according to the hover operation or the touch operation, where the control instruction includes coordinate information, and the coordinate information includes: the coordinates of the control point for the hovering operation or the touch operation, or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, wherein the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the cursor coordinates are coordinates of a cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

and the sending module is used for sending the control instruction to a display device so that the display device acquires the coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays a cursor at a position indicated by the cursor coordinates in the display area.

Preferably, when the coordinate information is the cursor coordinate, the generating module is further configured to:

Preferably, the detection module is further configured to: detecting a touch pressing operation of the control object on the sensing area; the sending module is further configured to send a cursor selection instruction to the display device after the detecting module detects the touch pressing operation; and the number of the first and second groups,

the detection module is also used for detecting the lifting operation of the control object on the sensing area; the sending module is further configured to send a cursor release instruction to the display device after the detection module detects the lifting operation.

Preferably, the lifting operation comprises:

Preferably, the control comprises:

a finger, or, a stylus.

According to a fourth aspect of embodiments of the present application, there is provided a cursor control device including:

a receiving module, configured to receive a control instruction sent by a controller, where the control instruction includes coordinate information, and the coordinate information includes: the method comprises the steps that coordinates of a control point corresponding to hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point are obtained, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

the determining module is used for acquiring the coordinate information from the control instruction and determining the coordinate of the cursor according to the coordinate information;

and the control module is used for displaying a cursor at the position indicated by the cursor coordinate of the display area.

Preferably, when determining the coordinate of the cursor according to the coordinate information, the determining module is specifically configured to:

Preferably, when the coordinate of the cursor is determined according to the coordinate of the control point, the determining module is specifically configured to:

Preferably, the receiving module is further configured to: receiving a cursor selection instruction sent by the controller, wherein the cursor selection instruction is generated after the controller senses the touch pressing operation generated by the control object on the sensing area; the control module is also used for controlling the selected cursor according to the cursor selection instruction; and the number of the first and second groups,

the receiving module is further configured to receive a cursor release instruction sent by the controller, where the cursor release instruction is generated by the controller after sensing a lifting operation of the control object on the sensing area; and the control module is also used for controlling the cursor to be released according to the cursor release instruction.

According to a fifth aspect of embodiments herein, there is provided a non-transitory computer-readable storage medium having instructions therein, which when executed by a processor of a controller, enable the controller side to perform a cursor control method, the method comprising:

Preferably, the method further comprises:

Preferably, the lifting operation comprises:

Preferably, the control comprises:

a finger, or, a stylus.

According to a sixth aspect of an embodiment of the present application, there is provided a cursor control device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to:

Preferably, when the coordinate information is the cursor coordinate, the processor is further configured to:

Preferably, the processor is further configured to:

Preferably, the lifting operation comprises:

Preferably, the control comprises:

a finger, or, a stylus.

According to a seventh aspect of embodiments of the present application, there is provided a non-transitory computer-readable storage medium, in which instructions, when executed by a processor of a display device, enable a display device side to perform a cursor control method, the method including: receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the steps that coordinates of a control point corresponding to hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point are obtained, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

Preferably, the method further comprises:

According to an eighth aspect of embodiments of the present application, there is provided a cursor control device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to: receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the steps that coordinates of a control point corresponding to hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point are obtained, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

Preferably, when determining the cursor coordinate according to the coordinate information, the processor is specifically configured to:

Preferably, when determining the cursor coordinate according to the coordinate of the control point, the processor is specifically configured to:

Preferably, the processor is further configured to:

The technical scheme provided by the embodiment of the application can have the following beneficial effects:

because the coordinate of the control point aimed by the hovering operation or the touch operation of the control object is the coordinate in the first coordinate system of the sensing area, the coordinate of the control point is an absolute coordinate, and because the cursor coordinate is obtained according to the preset mapping mode and the coordinate of the control point, the cursor coordinate is also an absolute coordinate because the mapping mode and the coordinate of the control point are absolute parameters, and compared with the relative positioning of an air mouse in the related art, the accuracy of cursor positioning is higher. Therefore, when the control object moves on the sensing area, correspondingly, the cursor moves from one position to another position of the display area along with the movement of the control object, and compared with the key operation positioning of the remote controller in the related technology, the cursor positioning is faster and more convenient.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic flowchart of a cursor control method according to an embodiment of the present application.

Fig. 2 is a flowchart illustrating a cursor control method according to another embodiment of the present application.

Fig. 3 is a flowchart illustrating a cursor control method according to another embodiment of the present application.

Fig. 4 is a schematic structural diagram of a cursor control device according to an embodiment of the present application.

Fig. 5 is a schematic structural diagram of a cursor control device according to another embodiment of the present application.

Fig. 6 is a schematic structural diagram of a cursor control device according to another embodiment of the present application.

Fig. 7 is a schematic structural diagram of a cursor control device according to another embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

Fig. 1 is a flowchart of a cursor control method according to an embodiment of the present application. The present embodiment takes the execution on the controller side as an example. Referring to fig. 1, the method of the present embodiment may include:

step 110, detecting a hovering operation or a touching operation of a control object on the sensing area.

Step 120, generating a control instruction according to the hovering operation or the touch operation, where the control instruction includes coordinate information, and the coordinate information includes: the coordinate of the control point for the hovering operation or the touch operation, or the cursor coordinate obtained according to a preset mapping mode and the coordinate of the control point, where the coordinate of the control point is a coordinate of the control point in a first coordinate system, the first coordinate is a coordinate system where the sensing area is located, the cursor coordinate is a coordinate of the cursor in a second coordinate system, the second coordinate system is a coordinate system where the display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system.

In this step, the control point refers to a target point on the sensing area to which the hovering operation or the touching operation of the control object is directed. The detection mode of the control point can be implemented by referring to the related technology.

Step 130, sending the control instruction to the display device, so that the display device acquires coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays the cursor at the position indicated by the cursor coordinates in the display area.

The execution main body of the cursor control method of the embodiment may be a controller, or may be a functional module in the controller.

In this embodiment, the coordinates of the control point to which the hovering operation or the touch operation of the control object is directed are coordinates in the first coordinate system in which the sensing area is located, so the coordinates of the control point are absolute coordinates, and since the cursor coordinates are obtained according to the preset mapping mode and the coordinates of the control point, the coordinates of the cursor are also absolute coordinates since the mapping mode and the coordinates of the control point are both absolute parameters, and the accuracy of cursor positioning is higher compared with the relative positioning of an air mouse in the related art. Therefore, when the control object moves on the sensing area, correspondingly, the cursor moves from one position to another position of the display area along with the movement of the control object, and compared with the key operation positioning of the remote controller in the related technology, the cursor positioning is faster and more convenient.

In addition, in this embodiment, the cursor movement may be controlled by a hovering manner or a touch manner.

Wherein, the control may include but is not limited to: a finger, or, a stylus. In the implementation, one cursor can be controlled, and correspondingly, one control object is controlled; and a plurality of cursors can be controlled, and correspondingly, a plurality of control objects are arranged, so that a plurality of operations can be simultaneously controlled.

Among them, the display device may include, but is not limited to: smart tv, or split joint large screen.

Generally, a display area refers to an area where a physical component actually existing on a display device is located, for example, a display area on a display screen of a smart television.

In an actual application scene, not only the movement of the cursor needs to be controlled, but also the selection and release of the cursor needs to be controlled. Based on this, preferably, the cursor control method provided in this embodiment may further include: detecting touch pressing operation of a control object on the sensing area, and sending a cursor selection instruction to display equipment after detecting the touch pressing operation; and detecting a lifting operation of the control object on the sensing area, and sending a cursor release instruction to the display device after detecting the lifting operation.

Wherein the lifting operation may include: the control object generates touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or the control object generates touch pressing operation on the sensing area and is converted into the control object touching the sensing area.

In this embodiment, the cursor is controlled to be selected by touching and pressing, and the cursor is controlled to be released by touching and pressing the corresponding lifting operation.

The degree of pressure of the touch-and-press operation is greater than the degree of pressure of the touch operation.

The sensing area may be provided with a touch screen, for example, a pressure type touch screen may be provided to detect touch and touch pressure of a control object. The sensing area can be provided with sensors such as infrared distance measurement or thermal sensing distance measurement and the like so as to detect the hovering of the control object. Of course, the sensing area may be provided with a sensor having both a touch detection function and a hover detection function.

When the cursor is selected and controlled to move in a touch mode through a touch pressing mode, all the control objects need to be in contact with the sensing area, only the touch pressing force is different from the touch force, and the operation is more convenient and faster in use.

When the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a hovering mode, the former needs to be contacted with the sensing area, and the latter does not need to be contacted with the sensing area.

The mapping mode may be various, for example, a zoom mapping mode, a pan mapping mode, or the like.

Taking the zoom mapping mode as an example, when the coordinate information is cursor coordinates, the cursor control method at the controller side may further include: acquiring a mapping mode, wherein the mapping mode is a scaling mapping mode, the scaling mapping mode comprises a scaling coefficient, and the scaling coefficient is obtained by calculation according to the maximum value of the coordinate of the display area on each axis and the maximum value of the coordinate of the induction area on each axis; and calculating to obtain cursor coordinates according to the zooming mapping mode and the coordinates of the control points.

Wherein the scaling factor comprises a scaling factor of each numerical axis. The scaling factor of the number axis is the ratio of the coordinates of the display area to the maximum value of the coordinates of the sensing area on the same number axis.

Assuming that the sensing area and the display area are rectangular areas, a first coordinate system xoy is established with one vertex of the sensing area as an origin o and two sides intersecting the origin o as an x-axis and a y-axis, a point in the first coordinate system is (x, y), and similarly, a vertex of the display area is an origin o ', two sides intersecting the origin o ' are an x-axis and a y-axis, and a second coordinate system x ' o ' y ' is established with a point in the second coordinate system as (x ', y ').

Accordingly, the scaling factor includes an x-axis scaling factor Dx and a y-axis scaling factor Dy.

Wherein Dx is obtained from the maximum value Xmax of the coordinates of the sensing area on the X-axis of the first coordinate system and the maximum value X' max of the coordinates of the display area on the X-axis of the second coordinate system. Where Xmax is the maximum dimension of the sensing region in the x-axis. X' max is the maximum size of the display area in the X-axis.

Wherein Dy is obtained according to the maximum value Ymax of the coordinate of the sensing area on the Y axis of the first coordinate system and the maximum value Y' max of the coordinate of the display area on the Y axis of the second coordinate system. Where Ymax is the maximum dimension of the sensing region in the y-axis. Y' max is the maximum size of the display area in the Y-axis.

Based on this, according to the coordinates (x) of the control point_s，y_s) And determining cursor coordinates according to the following formula:

x’＝x*Dx；(1)

y’＝y*Dy；(2)

Dx＝X’max/Xmax；(3)

Dy＝Y’max/Ymax；(4)

coordinate (x) of control point_s，y_s) Substituting the coordinates into the above equations (1) - (4) to obtain the cursor coordinate of (x'_s，y’_s)＝(x_s*X’max/Xmax，y_s*Y’max/Ymax)。

For a rectangular display area, the maximum dimension in the x-axis and the maximum dimension in the y-axis are the length and width of the display area. For a rectangular sensing region, the maximum dimension in the x-axis and the maximum dimension in the y-axis are the length and width of the sensing region.

The length and width of the sensing area can be directly obtained locally in a local storage of the controller. The length and width of the display area can be obtained through manual input, and can also be obtained from the display device when the controller and the display device are in communication connection, so that the controller can adapt to display devices with different sizes.

In consideration of the fact that in practical applications, the controller is usually a handheld remote control device, the structural design is simple, the memory is small, the computing capability is poor, the control efficiency of the controller may be reduced when the cursor coordinate is calculated on the controller side, and the controller generates heat, so it is preferable that the coordinate information of the control command includes the coordinate of the control point, and the coordinate is sent to the display device side, and the cursor coordinate is calculated on the display device side. Accordingly, the length and width of the sensing region may be transmitted to the display device when the controller and the display device establish a communication connection, or the length and width of the sensing region may be included in the coordinate information of the control command each time the control command is transmitted.

Fig. 2 is a flowchart illustrating a cursor control method according to another embodiment of the present application. The present embodiment takes the execution on the display device side as an example. Referring to fig. 2, the method of the present embodiment may include:

step 210, receiving a control instruction sent by the controller, where the control instruction includes coordinate information, and the coordinate information includes: the coordinate of the control point corresponding to the hovering operation or the touch operation of the control object on the sensing area of the controller, or the coordinate of a cursor obtained according to a preset mapping mode and a cursor of the control point, wherein the coordinate of the control point is the coordinate of the control point in a first coordinate system, the first coordinate system is the coordinate system where the sensing area is located, the coordinate of the cursor is the coordinate of the cursor in a second coordinate system, the second coordinate system is the coordinate system where the display area of the display device is located, and the mapping mode is the mapping mode from the first coordinate system to the second coordinate system.

And step 220, obtaining coordinate information from the control instruction, and determining the coordinate of the cursor according to the coordinate information.

Step 230, displaying the cursor at the position indicated by the cursor coordinates of the display area.

The execution main body of the cursor control method of the embodiment may be a display device, or may be a functional module in the display device.

There are various specific implementations of the step 220. Preferably, the specific implementation manner of the step 220 may be: when the coordinate information contained in the control instruction is the coordinates of the control point, determining the coordinates of the cursor according to the coordinates of the control point; or, when the coordinate information included in the control command is cursor coordinates, the coordinate information is directly determined as cursor coordinates.

The cursor coordinate is determined according to the coordinate of the control point, and the specific implementation manner may be: acquiring a mapping mode, wherein the mapping mode is a scaling mapping mode, the scaling mapping mode comprises a scaling coefficient, and the scaling coefficient is obtained by calculation according to the maximum value of the coordinate of the display area on each axis and the maximum value of the coordinate of the induction area on each axis; and calculating to obtain cursor coordinates according to the zooming mapping mode and the coordinates of the control points.

The specific implementation of the cursor coordinate obtained by calculation according to the zoom mapping mode and the coordinate of the control point may refer to the above related embodiments of the controller side, and details are not repeated here. In the implementation process, the length and the width of the related display area can be stored locally in the display device and directly acquired locally, the length and the width of the related sensing area can be acquired through manual input, or can be acquired from the controller side when the display device is in communication connection with the controller side, or the length and the width of the sensing area can be carried in a control command by the controller side and acquired from the received control command every time.

Generally, the computing power of the display device is stronger than that of the controller, and in this embodiment, the speed of calculating the cursor coordinates is faster and the control efficiency is high on the display device side.

In some embodiments, the cursor control method on the display device side may further include:

receiving a cursor selection instruction sent by a controller, wherein the cursor selection instruction is generated after the controller senses touch pressing operation generated by a control object on a sensing area, and controlling to select a cursor according to the cursor selection instruction; and the number of the first and second groups,

and receiving a cursor release instruction sent by the controller, wherein the cursor release instruction is generated after the controller senses the lifting operation of the controlled object on the sensing area, and controlling to release the cursor according to the cursor release instruction.

Fig. 3 is a flowchart illustrating a cursor control method according to another embodiment of the present application. The present embodiment is exemplified by the interaction of the controller and the display device.

Further, a specific application scenario of the present embodiment is described as follows:

in a scenario of this embodiment, a display device and a controller for controlling a cursor of the display device are included. The display device may include, but is not limited to, a large-screen display device such as a smart television, and the like, because the large-screen display device has a large display screen and needs to be viewed by a viewer at a long distance, and when the cursor needs to be moved, because the viewer is far away from the screen and is not suitable for directly moving the cursor on the display screen using a touch screen, the cursor needs to be remotely positioned by means of a controller, and because the solutions in the related art have various defects, the present embodiment provides a corresponding new cursor control scheme. In this embodiment, the controller includes a sensing area, and a touch screen, such as a pressure touch screen, may be disposed on the sensing area to detect a touch of the control object, and a sensor, such as an infrared distance measurement sensor or a thermal distance measurement sensor, may be disposed to detect hovering of the control object. The control may be embodied as a finger or a stylus or the like. Taking a finger as an example, the finger can hover in the sensing area, and the controller can detect the hovering operation of the finger in real time and obtain the coordinate of a control point to which the hovering operation is directed; or, the finger can also touch the sensing area, and the controller can detect the touch operation of the finger in real time and obtain the coordinates of the control point of the touch operation. In this embodiment, one cursor may be displayed on the display area of the display device, or more than two cursors may be displayed. Taking the example of displaying two cursors in the display area, when the device is used, the controller can be held by hands, and the thumbs of the two hands are placed above the sensing area to control the two cursors.

Referring to fig. 3, the method of the present embodiment includes:

in step 310, the controller detects a hovering operation or a touching operation of a control object on the sensing area.

Step 320, the controller generates a control instruction according to the hovering operation or the touch operation, where the control instruction includes coordinate information, and the coordinate information includes: the coordinate of the control point for the hovering operation or the touch operation, or the cursor coordinate obtained according to a preset mapping mode and the coordinate of the control point, where the coordinate of the control point is a coordinate of the control point in a first coordinate system, the first coordinate is a coordinate system where the sensing area is located, the cursor coordinate is a coordinate of the cursor in a second coordinate system, the second coordinate system is a coordinate system where the display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system.

Assuming that the sensing region is a rectangular region, the first coordinate system xoy takes the upper left corner of the sensing region as an origin o, and takes two sides intersecting the origin o as an x-axis and a y-axis. The coordinates of the point in the first coordinate system are (x, y). Based on this, the detected coordinates of the control point are (x)_s，y_s)。

In this step, when the coordinate information is a cursor coordinate, in a process that the controller generates the control instruction according to the coordinate of the control point, the cursor coordinate is further obtained according to the preset mapping mode and the coordinate of the control point according to the following steps: acquiring a mapping mode, wherein the mapping mode is a scaling mapping mode, the scaling mapping mode comprises a scaling coefficient, and the scaling coefficient is obtained by calculation according to the maximum value of the coordinate of the display area on each axis and the maximum value of the coordinate of the induction area on each axis; and calculating to obtain cursor coordinates according to the zooming mapping mode and the coordinates of the control points. The method specifically comprises the following steps:

assuming that the display area is a rectangular area, the second coordinate system x ' o ' y ' takes the upper left corner of the display area as an origin o ', and takes two sides intersecting the origin o ' as an x ' axis and a y ' axis. The coordinates of the point in the second coordinate system are (x ', y').

The scaling factors include an x-axis scaling factor Dx and a y-axis scaling factor Dy.

Wherein Dy is obtained according to the maximum value Ymax of the coordinates of the sensing area on the Y axis of the first coordinate system and the maximum value Y' max of the coordinates of the display area on the Y axis of the second coordinate system. Where Ymax is the maximum dimension of the sensing region in the y-axis. Y' max is the maximum size of the display area in the Y-axis.

For the display area, the maximum size in the x-axis and the maximum size in the y-axis, i.e., the length and width of the display area, may be obtained by manual input, or may be obtained from the display device when the controller and the display device establish a communication connection. For the sensing region, the maximum size in the x-axis and the maximum size in the y-axis, i.e., the length and width of the sensing region, can be obtained locally at the controller.

Based on this, according to the coordinates of the control point(x_s，y_s) And equations (1) to (4), the cursor coordinates are determined: coordinate (x) of control point_s，y_s) Substituting the coordinates into equations (1) - (4) to obtain cursor coordinates of (x'_s，y’_s)＝(x_s*X’max/Xmax，y_s*Y’max/Ymax)。

Step 330, the controller sends the control instruction to the display device.

And step 340, the display device receives the control instruction sent by the controller.

And step 350, the display device acquires coordinate information from the control command and determines the coordinate of the cursor according to the coordinate information.

In this step, the coordinate of the cursor is determined according to the coordinate information, which may be: when the coordinate information contained in the control instruction is the coordinates of the control point, determining the coordinates of the cursor according to the coordinates of the control point; or, when the coordinate information included in the control command is cursor coordinates, the coordinate information is directly determined as cursor coordinates.

The implementation manner of determining the cursor coordinate according to the coordinate of the control point may be: acquiring a mapping mode, wherein the mapping mode is a scaling mapping mode, the scaling mapping mode comprises a scaling coefficient, and the scaling coefficient is obtained by calculation according to the maximum value of the coordinate of the display area on each axis and the maximum value of the coordinate of the induction area on each axis; and calculating to obtain cursor coordinates according to the zooming mapping mode and the coordinates of the control points.

The specific implementation of calculating the coordinate of the cursor according to the zoom mapping mode and the coordinate of the control point may refer to the related embodiment in step 320, and is not described herein again. In the implementation process, the length and the width of the related display area can be stored locally in the display device and directly acquired locally, the length and the width of the related sensing area can be acquired through manual input, or can be acquired from the controller side when the display device is in communication connection with the controller side, or the length and the width of the sensing area can be carried in a control command by the controller side and acquired from the received control command every time.

Step 360, the display device displays the cursor at the position indicated by the cursor coordinates of the display area.

Step 370, the controller detects a touch pressing operation generated by the control object on the sensing area, and sends a cursor selection instruction to the display device after detecting the touch pressing operation.

And 380, the display equipment receives a cursor selection instruction sent by the controller.

And step 390, the display device controls the selected cursor according to the cursor selection instruction.

Step 3100, the controller detects a lifting operation of the control object on the sensing area, and sends a cursor release command to the display device after detecting the lifting operation.

In this step, the lifting operation may include: the control object generates touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or the control object generates touch pressing operation on the sensing area and is converted into the control object touching the sensing area.

Step 3110, the display device receives the cursor release command sent by the controller.

And 3120, the display device controls to release the cursor according to the cursor release instruction.

In this embodiment, the coordinates of the control point to which the hovering operation or the touch operation of the control object is directed are coordinates in the first coordinate system in which the sensing area is located, so the coordinates of the control point are absolute coordinates, and since the cursor coordinates are obtained according to the preset mapping mode and the coordinates of the control point, the coordinates of the cursor are also absolute coordinates since the mapping mode and the coordinates of the control point are both absolute parameters, and the accuracy of cursor positioning is higher compared with the relative positioning of an air mouse in the related art. Therefore, when the control object moves on the sensing area, correspondingly, the cursor moves from one position to another position of the display area along with the movement of the control object, and compared with the key operation positioning of the remote controller in the related technology, the cursor positioning is faster and more convenient. In addition, in the embodiment, the cursor movement can be controlled by detecting the hovering of the control object, and the cursor selection is controlled by detecting the touch of the control object, so that the accuracy of cursor control is higher.

Fig. 4 is a schematic structural diagram of a cursor control device according to another embodiment of the present application. Referring to fig. 4, the apparatus of the present embodiment includes a detection module 401, a generation module 402, and a transmission module 403. Wherein:

a detection module 401, configured to detect a hovering operation or a touching operation of a control object on a sensing area;

a generating module 402, configured to generate a control instruction according to a hover operation or a touch operation, where the control instruction includes coordinate information, and the coordinate information includes: the coordinate of the control point for the hovering operation or the touch operation, or the cursor coordinate obtained according to a preset mapping mode and the coordinate of the control point, wherein the coordinate of the control point is the coordinate of the control point in a first coordinate system, the first coordinate is the coordinate system of the sensing area, the cursor coordinate is the coordinate of the cursor in a second coordinate system, the second coordinate system is the coordinate system of the display area of the display device, and the mapping mode is the mapping mode from the first coordinate system to the second coordinate system;

a sending module 403, configured to send the control instruction to the display device, so that the display device obtains the coordinate information from the control instruction, determines the cursor coordinate according to the coordinate information, and displays the cursor at the position indicated by the cursor coordinate in the display area.

Preferably, when the coordinate information is cursor coordinates, the generating module 402 is further configured to:

and calculating to obtain cursor coordinates according to the zooming mapping mode and the coordinates of the control points.

Preferably, the detecting module 401 is further configured to: detecting touch pressing operation of a control object on a sensing area; the sending module 403 is further configured to send a cursor selection instruction to the display device after the detecting module detects the touch pressing operation; and the number of the first and second groups,

the detection module 401 is further configured to detect a lifting operation of the control object on the sensing area; the sending module 403 is further configured to send a cursor release instruction to the display device after the detecting module detects the lifting operation.

Preferably, the lifting operation comprises:

the control object generates touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or,

the control object generates touch pressing operation on the sensing area, and the touch pressing operation is converted into the control object touching the sensing area.

Preferably, the control comprises:

a finger, or, a stylus.

Fig. 5 is a schematic structural diagram of a cursor control device according to another embodiment of the present application. Referring to fig. 5, the apparatus of the present embodiment includes a receiving module 501, a determining module 502, and a control module 503. Wherein:

a receiving module 501, configured to receive a control instruction sent by a controller, where the control instruction includes coordinate information, and the coordinate information includes: the method comprises the following steps that coordinates of a control point aimed at hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

a determining module 502, configured to obtain coordinate information from the control instruction, and determine a cursor coordinate according to the coordinate information;

and a control module 503, configured to display the cursor at a position indicated by the cursor coordinates of the display area.

Preferably, when determining the coordinate of the cursor according to the coordinate information, the determining module 502 is specifically configured to:

when the coordinate information contained in the control instruction is the coordinates of the control point, determining the coordinates of the cursor according to the coordinates of the control point; or,

Preferably, when determining the cursor coordinate according to the coordinate of the control point, the determining module 502 is specifically configured to:

Preferably, the receiving module 501 is further configured to: receiving a cursor selection instruction sent by the controller, wherein the cursor selection instruction is generated after the controller senses the touch pressing operation generated by the controlled object on the sensing area; the control module 503 is further configured to control the selected cursor according to the cursor selection instruction; and the number of the first and second groups,

the receiving module 501 is further configured to receive a cursor release instruction sent by the controller, where the cursor release instruction is generated by the controller after the controller senses a lift-off operation generated by a controlled object in the sensing area; the control module 503 is further configured to control to release the cursor according to the cursor release instruction.

One embodiment of the present application provides a non-transitory computer-readable storage medium, where instructions in the storage medium, when executed by a processor of a controller, enable the controller side to perform a cursor control method, where the method of this embodiment includes:

generating a control instruction according to the hovering operation or the touch operation, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the coordinate of the control point for the hovering operation or the touch operation, or the cursor coordinate obtained according to a preset mapping mode and the coordinate of the control point, wherein the coordinate of the control point is the coordinate of the control point in a first coordinate system, the first coordinate is the coordinate system of the sensing area, the cursor coordinate is the coordinate of the cursor in a second coordinate system, the second coordinate system is the coordinate system of the display area of the display device, and the mapping mode is the mapping mode from the first coordinate system to the second coordinate system;

and sending the control instruction to the display device, so that the display device acquires coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays the cursor at the position indicated by the cursor coordinates of the display area.

Preferably, when the coordinate information is cursor coordinates, the method of this embodiment further includes:

Preferably, the method of the present embodiment further includes:

detecting touch pressing operation of a control object on the sensing area, and sending a cursor selection instruction to display equipment after detecting the touch pressing operation; and the number of the first and second groups,

and detecting the lifting operation of the control object on the sensing area, and sending a cursor release instruction to the display device after detecting the lifting operation.

Preferably, the lifting operation comprises:

Preferably, the control comprises:

a finger, or, a stylus.

For a specific implementation of this embodiment, reference may be made to the related description in the method embodiment at the controller side, and details are not described here.

Another embodiment of the present application provides a non-transitory computer-readable storage medium, where instructions in the storage medium, when executed by a processor of a display device, enable the display device to execute a cursor control method, where the method of this embodiment includes: receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the following steps that coordinates of a control point aimed at hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

acquiring coordinate information from the control instruction, and determining the coordinate of the cursor according to the coordinate information;

the cursor is displayed at the position indicated by the cursor coordinates of the display area.

Preferably, determining cursor coordinates according to the coordinate information includes:

Preferably, determining the cursor coordinates from the coordinates of the control point comprises:

Preferably, the method of the present embodiment further includes:

receiving a cursor selection instruction sent by the controller, wherein the cursor selection instruction is generated after the controller senses the touch pressing operation generated by the controlled object on the sensing area, and controlling the selected cursor according to the cursor selection instruction; and the number of the first and second groups,

For a specific implementation of this embodiment, reference may be made to the related description in the method embodiment on the display device side, and details are not described here.

Fig. 6 is a schematic structural diagram of a cursor control device according to another embodiment of the present application. Referring to fig. 6, the apparatus of the present embodiment includes: a processor 601; a memory 602 for storing processor-executable instructions; wherein the processor 601 is configured to:

Preferably, when the coordinate information is cursor coordinates, the processor 601 is further configured to:

Preferably, the processor 601 is further configured to:

Preferably, the lifting operation comprises:

Preferably, the control comprises:

a finger, or, a stylus.

Fig. 7 is a schematic structural diagram of a cursor control device according to another embodiment of the present application. Referring to fig. 7, the apparatus of the present embodiment includes: a processor 701; a memory 702 for storing processor-executable instructions; wherein the processor 701 is configured to: receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the following steps that coordinates of a control point aimed at hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and a cursor of the control point, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

Preferably, when determining the cursor coordinate according to the coordinate information, the processor 701 is specifically configured to:

Preferably, when determining the cursor coordinate according to the coordinate of the control point, the processor 701 is specifically configured to:

Preferably, the processor 701 is further configured to:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.

It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present application, the meaning of "a plurality" means at least two unless otherwise specified.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. A cursor control method, comprising:

generating a control instruction according to the hovering operation or the touch operation, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the coordinates of the control point for the hovering operation or the touch operation, or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, wherein the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the cursor coordinates are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

sending the control instruction to a display device, so that the display device acquires the coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays a cursor at a position indicated by the cursor coordinates in the display area;

further comprising:

detecting a lifting operation of the control object on the sensing area, and sending a cursor release instruction to the display equipment after detecting the lifting operation;

the pressure degree of the touch pressing operation is greater than that of the touch operation;

the lifting operation comprises: the control object generates a touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or the control object generates touch pressing operation on the sensing area and is converted into the control object touching the sensing area;

when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a touch mode, all the control objects need to be in contact with the sensing area, and the touch pressing force is different from the touch force; when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a hovering mode, the former needs to be contacted with the sensing area by the control object, and the latter does not need to be contacted with the sensing area.

2. The method according to claim 1, wherein when the coordinate information is the cursor coordinate, the method further comprises:

3. The method of any of claims 1-2, wherein the control comprises:

a finger, or, a stylus.

4. A cursor control method, comprising:

receiving a control instruction sent by a controller, wherein the control instruction comprises coordinate information, and the coordinate information comprises: the method comprises the steps that coordinates of a control point for hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

displaying a cursor at a location indicated by the cursor coordinates of the display area;

further comprising:

receiving a cursor release instruction sent by the controller, wherein the cursor release instruction is generated after the controller senses the lifting operation of the control object on the sensing area, and controlling to release a cursor according to the cursor release instruction;

5. The method of claim 4, wherein determining cursor coordinates from the coordinate information comprises:

6. The method of claim 5, wherein determining the cursor coordinates from the coordinates of the control point comprises:

7. A cursor control device, comprising:

a generating module, configured to generate a control instruction according to the hover operation or the touch operation, where the control instruction includes coordinate information, and the coordinate information includes: the coordinates of the control point for the hovering operation or the touch operation, or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, wherein the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the cursor coordinates are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of the display device is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

the sending module is used for sending the control instruction to a display device so that the display device acquires the coordinate information from the control instruction, determines cursor coordinates according to the coordinate information, and displays a cursor at a position indicated by the cursor coordinates in the display area;

the detection module is further used for detecting touch pressing operation of the control object on the sensing area and sending a cursor selection instruction to the display device after detecting the touch pressing operation; detecting a lifting operation of the control object on the sensing area, and sending a cursor release instruction to the display equipment after detecting the lifting operation; the pressure degree of the touch pressing operation is greater than that of the touch operation; the lifting operation comprises: the control object generates a touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or the control object generates touch pressing operation on the sensing area and is converted into the control object touching the sensing area; when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a touch mode, all the control objects need to be in contact with the sensing area, and the touch pressing force is different from the touch force; when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a hovering mode, the former needs to be contacted with the sensing area by the control object, and the latter does not need to be contacted with the sensing area.

8. A cursor control device, comprising:

a receiving module, configured to receive a control instruction sent by a controller, where the control instruction includes coordinate information, and the coordinate information includes: the method comprises the steps that coordinates of a control point for hovering operation or touch operation of a control object on a sensing area of a controller or cursor coordinates obtained according to a preset mapping mode and the coordinates of the control point, the coordinates of the control point are coordinates of the control point in a first coordinate system, the first coordinate system is a coordinate system where the sensing area is located, the coordinates of the cursor are coordinates of the cursor in a second coordinate system, the second coordinate system is a coordinate system where a display area of display equipment is located, and the mapping mode is a mapping mode from the first coordinate system to the second coordinate system;

a control module for displaying a cursor at a position indicated by the cursor coordinates of the display area;

the receiving module is further configured to receive a cursor selection instruction sent by the controller, where the cursor selection instruction is generated by the controller after the controller senses a touch pressing operation generated by the control object on the sensing area, and controls a selected cursor according to the cursor selection instruction; receiving a cursor release instruction sent by the controller, wherein the cursor release instruction is generated after the controller senses the lifting operation of the control object on the sensing area, and controlling to release a cursor according to the cursor release instruction; the pressure degree of the touch pressing operation is greater than that of the touch operation; the lifting operation comprises: the control object generates a touch pressing operation on the sensing area and is converted into the control object hovering above the sensing area; or the control object generates touch pressing operation on the sensing area and is converted into the control object touching the sensing area; when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a touch mode, all the control objects need to be in contact with the sensing area, and the touch pressing force is different from the touch force; when the cursor is controlled to be selected in a touch pressing mode and the cursor is controlled to move in a hovering mode, the former needs to be contacted with the sensing area by the control object, and the latter does not need to be contacted with the sensing area.