CN115695874A - Television terminal control method, device, system, electronic equipment and storage medium - Google Patents

Abstract

The invention discloses a television terminal control method, a device, a system, electronic equipment and a storage medium, wherein the method comprises the following steps: detecting spatial movement data of a target mobile terminal by adopting a motion sensor; converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal; and sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology. The invention solves the technical problem that the direction key on the physical remote controller needs to be clicked step by step to move the content selection box on the television display interface in the related technology, is not limited to the control of a fixed television remote controller, and is more convenient and faster.

Description

Television terminal control method, device, system, electronic equipment and storage medium

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a system, an electronic device, and a storage medium for controlling a television terminal.

Background

With the progress of society and the rapid development of internet technology, most families purchase smart televisions at present, and the traditional television controlled by using an entity remote controller cannot meet the requirements of users and various use scenes, so that a novel television terminal remote control interaction mode is necessary.

Disclosure of Invention

The embodiment of the invention provides a television terminal control method, a television terminal control device, a television terminal control system, electronic equipment and a storage medium.

According to an aspect of the embodiments of the present invention, there is provided a television terminal control method applied to a mobile terminal, including: detecting spatial movement data of a target mobile terminal by adopting a motion sensor; converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal; and sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Optionally, converting the spatial movement data into planar displacement data comprises: and converting the space movement data into rotation attitude data and rotation angle data, wherein the rotation attitude data corresponds to a displacement direction, and the rotation angle data corresponds to a displacement distance.

Optionally, after detecting the spatial movement data of the target mobile terminal, the method includes: acquiring an operation instruction triggered on the control operation interface of the target mobile terminal; searching a control instruction matched with the operation instruction; and sending the control instruction to the target television terminal so that the target television terminal performs instruction control on a display interface according to the control instruction.

According to an aspect of the embodiments of the present invention, there is provided another television terminal control method, applied to a television terminal, including: receiving plane displacement data sent by a target mobile terminal, and controlling the movement of a virtual mouse on a display interface according to the plane displacement data; receiving a control instruction sent by a target mobile terminal, and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Optionally, the controlling the movement of the virtual mouse on the display interface according to the plane displacement data includes: acquiring pixel parameters of the target television terminal, wherein the pixel parameters comprise a first total number of pixels in the horizontal direction and a second total number of pixels in the vertical direction of the display screen; determining a first unit length corresponding to the transverse unit rotation angle according to the first total number, wherein the first unit length is used for indicating the number of pixel points which move transversely on a display interface when the mobile terminal rotates transversely by the unit angle; determining a second unit length corresponding to the longitudinal unit rotation angle according to the second total number, wherein the second unit length is used for indicating the number of pixel points which move longitudinally on a display interface when the mobile terminal rotates by the unit angle in each longitudinal direction; analyzing the displacement distance and the displacement direction in the plane displacement data, and multiplying the first unit length or the second unit length by the displacement distance to obtain the movement length of the virtual mouse; and controlling the virtual mouse on the display interface to move the moving length towards the displacement direction.

Optionally, controlling the virtual mouse on the display interface to move the movement length in the displacement direction includes: rendering a floating icon of a virtual mouse on the display interface; determining a starting position of the floating icon, and calculating an ending position of the floating icon based on the starting position, the displacement direction and the movement length; moving the floating icon to the termination position on the display interface.

Optionally, before controlling the movement of the virtual mouse on the display interface according to the plane displacement data, the method includes: analyzing the displacement distance in the plane displacement data, and judging whether the displacement distance exceeds a preset threshold value; and when the displacement distance exceeds a preset threshold value, controlling the movement of the virtual mouse on the display interface according to the plane displacement data.

According to another aspect of the embodiments of the present invention, there is provided a television terminal control apparatus applied to a mobile terminal, including: the detection module is used for detecting the space movement data of the target mobile terminal by adopting the motion sensor; the conversion module is used for converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal; and the first sending module is used for sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Optionally, the conversion module comprises: the conversion unit is used for converting the space movement data into rotation attitude data and rotation angle data, wherein the rotation attitude data corresponds to a displacement direction, and the rotation angle data corresponds to a displacement distance.

Optionally, the apparatus further comprises: the acquisition module is used for acquiring an operation instruction triggered on the control operation interface of the target mobile terminal; the searching module is used for searching the control instruction matched with the operation instruction; and the second sending module is used for sending the control instruction to the target television terminal so that the target television terminal performs instruction control on a display interface according to the control instruction.

According to another aspect of the embodiments of the present invention, there is provided another television terminal control apparatus, applied to a television terminal, including: the first control module is used for receiving the plane displacement data sent by the target mobile terminal and controlling the movement of the virtual mouse on the display interface according to the plane displacement data; and the second control module is used for receiving a control instruction sent by a target mobile terminal and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Optionally, the first control module comprises: the acquisition unit is used for acquiring pixel parameters of the target television terminal, wherein the pixel parameters comprise a first total number of pixels in the horizontal direction of the display screen and a second total number of pixels in the longitudinal direction; the determining unit is used for determining a first unit length corresponding to the transverse unit rotation angle according to the first total number, wherein the first unit length is used for indicating the number of pixel points which move transversely on a display interface when the mobile terminal rotates transversely by a unit angle; determining a second unit length corresponding to the longitudinal unit rotation angle according to the second total number, wherein the second unit length is used for indicating the number of pixel points which move longitudinally on the display interface when the mobile terminal rotates for each longitudinal unit angle; the calculation unit is used for analyzing the displacement distance and the displacement direction in the plane displacement data and multiplying the first unit length or the second unit length by the displacement distance to obtain the movement length of the virtual mouse; and the control unit is used for controlling the virtual mouse on the display interface to move the moving length towards the displacement direction.

Optionally, the control unit comprises: the rendering subunit is used for rendering the floating icon of the virtual mouse on the display interface; the calculation subunit determines the starting position of the floating icon, and calculates the ending position of the floating icon based on the starting position, the displacement direction and the movement length; and the moving subunit is used for moving the floating icon to the termination position on the display interface.

Optionally, the apparatus further comprises: the judging module is used for analyzing the displacement distance in the plane displacement data and judging whether the displacement distance exceeds a preset threshold value; and when the displacement distance exceeds a preset threshold value, controlling the movement of the virtual mouse on the display interface according to the plane displacement data.

According to another aspect of the embodiments of the present invention, there is provided a television terminal control system including: the mobile terminal is in wireless communication connection with the television terminal and is used for executing the device; the television terminal is used for executing the device.

According to another aspect of the embodiments of the present invention, there is also provided an electronic device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when executed by the processor, the electronic device implements the steps of the television terminal control method as described above.

According to another aspect of the embodiments of the present invention, there is also provided a storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of the television terminal control method as described above.

Embodiments of the present invention also provide a computer program product containing instructions, which when run on a computer, cause the computer to perform the steps of the above method.

According to the invention, the target mobile terminal is connected with the target television terminal through a wireless communication technology, and the motion sensor is adopted to detect the spatial movement data of the target mobile terminal; converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the mobile terminal; and sending the plane displacement data to the target television terminal so that the target television terminal controls the movement of the virtual mouse on the display interface according to the plane displacement data, thereby realizing the remote control of the mobile terminal on the television terminal. The mobile terminal is adopted to control the television, an additional independent hardware remote controller is not needed to be added, the use cost is reduced, the control of the virtual mouse of the television terminal is controlled according to the space movement data of the detected mobile terminal, a user does not need to click the direction key on the physical remote controller step by step to move the content selection box on the display interface, and the method is more convenient and faster.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

fig. 1 is a block diagram of a hardware configuration of a television according to an embodiment of the present invention;

fig. 2 is a flowchart of a television terminal control method according to an embodiment of the present invention;

fig. 3 is a flowchart of another television terminal control method according to an embodiment of the present invention;

fig. 4 is an interaction diagram of a mobile terminal and a television terminal according to an embodiment of the present invention;

FIG. 5 is a schematic flow chart of an implementation scenario in an embodiment of the present invention;

fig. 6 is a block diagram of a configuration of a television terminal control apparatus according to an embodiment of the present invention;

fig. 7 is a block diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict.

It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

The method provided by the embodiment of the application can be executed in a mobile phone, a computer, a tablet, a server television or a similar operation device. Taking an example of the operation on a television, fig. 1 is a hardware structure block diagram of a television according to an embodiment of the present invention. As shown in fig. 1, the television set may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the television set. For example, a television may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

The memory 104 may be used to store a television program, for example, a software program and a module of application software, such as a television program corresponding to a television terminal control method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the television program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a television through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of a television set. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.

In this embodiment, a method for controlling a television terminal is provided, and fig. 2 is a flowchart of a method for controlling a television terminal according to an embodiment of the present invention, which is applied to a mobile terminal, and as shown in fig. 2, the flowchart includes the following steps:

s10, detecting space movement data of a target mobile terminal by adopting a motion sensor;

the mobile terminal refers to a computer device that can be used in mobile, and generally refers to a mobile phone and a tablet computer. In the embodiment of the invention, the target mobile terminal can be a smart phone with various application functions.

The motion sensor is equipment for detecting physical motion of a target object, is arranged in the target mobile terminal, and can detect and capture physical and dynamic motion of the target mobile terminal in real time. Common motion sensors include three-axis acceleration sensors, gyroscopes, magnetic field sensors, etc. The three-axis acceleration sensor is an electronic device capable of measuring acceleration force, comprises an angular accelerometer and a linear accelerometer, and can report the acceleration of a target mobile terminal along three sensor coordinate axes, wherein the measured acceleration comprises physical acceleration (such as speed change) and gravity acceleration; the gyroscope is an angular motion detection device, is widely applied to mobile portable equipment such as a smart phone, a smart television remote controller and the like, is based on a positioning and control system of free space movement and gestures, can report the rotation rate of a target mobile terminal around three sensor coordinate axes, and can derive the rotation angle of the target mobile terminal around the axes by measuring the rotation angular velocity around the axes; the magnetic field sensor is used for measuring the magnetic field of the earth, and can report the environmental magnetic field measured by the target mobile terminal along the three sensor coordinate axes, so as to deduce the course.

S20, converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal;

in the embodiment of the present invention, a motion sensor is adopted to detect spatial movement data of a target mobile terminal, and then the spatial movement data is used as input data and is input into a preset conversion model, and plane displacement data of the target mobile terminal is obtained through output, where the preset conversion model may be an AHRS (Attitude and Heading Reference System) model, and in other embodiments, the spatial movement data may be converted into plane displacement data through a relative displacement algorithm.

And S30, sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

The target mobile terminal is connected with the target television terminal through a wireless communication technology, the mobile terminal converts space movement data collected by the motion sensor into plane displacement data and sends the plane displacement data to the target television terminal, the target television terminal receives the plane displacement data sent by the mobile terminal and converts the plane displacement data into a movement data value adaptive to the television terminal, and then the movement of the virtual mouse on the television display interface is controlled according to the adaptive movement data value.

Through the steps, the target mobile terminal is connected with the target television terminal through a wireless communication technology, the motion sensor is adopted to detect the space movement data of the target mobile terminal, and the space movement data of the mobile terminal is converted into the plane displacement data to be sent to the target television terminal, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the mobile terminal, the target television terminal controls the movement of the virtual mouse on the display interface according to the received plane displacement data, the remote control of the mobile terminal on the television terminal is realized, the television terminal is controlled by adopting the mobile terminal, an additional independent hardware remote controller is not needed, the use cost is reduced, the control of the virtual mouse of the television terminal is controlled according to the space movement data of the detected mobile terminal, a user does not need to click a direction key on a physical remote controller to move a content selecting frame on the display interface, and the technical problem of inconvenience in remote control of the television in the related technology is solved.

In one example of the present invention, converting the spatial movement data into planar displacement data comprises: and converting the space movement data into rotation attitude data and rotation angle data, wherein the rotation attitude data corresponds to a displacement direction, and the rotation angle data corresponds to a displacement distance.

In this example, the plane displacement data obtained by the mobile terminal is the rotation attitude data and the rotation angle data of the mobile terminal. The rotation means that the target mobile terminal is rotated by a certain angle around a certain point. For example, a three-dimensional coordinate system is established by using the geometric center of the mobile terminal and the smart phone as an origin, wherein the x-axis direction is from left to right along the screen, the y-axis direction is from bottom to top along the bottom of the screen, and the z-axis direction is perpendicular to the screen of the mobile phone. The motion sensor records mobile phone space movement data, and then converts the space movement data into rotation attitude data and rotation angle data which rotate around three axes based on mobile phone coordinates, wherein the rotation attitude data comprises an axis, a rotation direction around the axis and the like, and corresponds to a displacement direction, if the mobile phone rotates clockwise around the Z axis, the displacement direction is right, if the mobile phone rotates anticlockwise around the Z axis, the displacement direction is left, the mobile phone rotates anticlockwise around the X axis, the displacement direction is upward, and the displacement direction is downward (a rotation visual angle is from top to bottom along the axis), and the like, and the specific rotation angle data corresponds to a displacement distance.

In another example of the present invention, converting the spatial movement data into planar displacement data comprises: and converting the space movement data into translation direction data and translation distance data, wherein the translation direction data corresponds to a displacement direction, and the translation distance data corresponds to a displacement distance.

In this example, the plane displacement data obtained by the mobile terminal is translation direction data and translation distance data of the mobile terminal. The translation means that the target mobile terminal moves a certain distance in a certain direction. The motion sensor records the mobile phone space movement data, and then converts the mobile phone space movement data into direction data and distance data of relative translation of the mobile phone in the horizontal direction (front/back, left/right) or the vertical direction (up/down) by referring to the geodetic reference coordinate system, such as horizontal movement to the left by 5 centimeters and the like.

In one example, before detecting spatial movement data of a target mobile terminal, the method includes: receiving a television terminal control request, wherein the control request is used for indicating control over a target television terminal; responding to the control request, opening a control operation interface on the target mobile terminal, and establishing wireless communication connection with the target television terminal; detecting whether the control operation interface is the current operation interface of the target mobile terminal; and when the control operation interface is the current operation interface of the target mobile terminal, determining the space movement data of the target mobile terminal.

In this example, before the mobile terminal controls the tv terminal, a tv control request triggered by the user through the mobile terminal interface to instruct the target tv terminal to be controlled is received, where the tv control request may be triggered by the user opening a specific software application controlled by the tv terminal, or a homepage, and when the tv terminal control request is received, the mobile terminal opens a specific control operation interface to establish a wireless communication connection with the target tv terminal, and when the control operation interface is the current operation interface of the target mobile terminal, the mobile terminal receives spatial movement data when the user waves or rotates the mobile terminal under the operation interface, or an operation instruction triggered on the operation interface, and if the operation interface is left (such as a switching page, a switching application, backing to a background, a lock screen, or the like), the control of the mobile terminal on the tv terminal is disconnected, so that the control of the mobile terminal on its own and the control on the tv terminal are distinguished, thereby avoiding confusion.

In one example, after detecting spatial movement data of a target mobile terminal, the method includes: acquiring an operation instruction triggered on the control operation interface of the target mobile terminal; searching a control instruction matched with the operation instruction; and sending the control instruction to the target television terminal so that the target television terminal performs instruction control on a display interface according to the control instruction.

In the embodiment of the invention, the user can also control the instruction of the television terminal through the control operation interface on the mobile terminal. The instruction control corresponds to a key instruction of the entity remote controller, a control operation interface similar to the entity remote controller is drawn on the display interface of the mobile terminal to perform instruction control on the display interface of the television terminal, the control operation interface on the mobile terminal can comprise instructions such as up, down, left, right, return, determination, homepage, signal source, power key, volume increase and decrease, menu and the like, an operation instruction triggered by a user on the control operation interface is obtained, the operation instruction is matched with the control instruction of the television terminal, and the operation instruction is sent to the target television terminal to perform instruction control on the display interface.

After the virtual mouse of the television terminal is subjected to movement control, the embodiment of the invention can also realize instruction control on the television terminal by controlling the operation instruction on the operation interface.

In this embodiment, another television terminal control method is provided, and fig. 3 is a flowchart of another television terminal control method according to an embodiment of the present invention, which is applied to a television terminal, and as shown in fig. 3, the flowchart includes the following steps:

s100, receiving plane displacement data sent by a target mobile terminal, and controlling the movement of a virtual mouse on a display interface according to the plane displacement data;

fig. 4 is an interaction diagram of a mobile terminal and a television terminal according to an embodiment of the present invention, referring to fig. 4, the mobile terminal is in wireless communication connection with the television terminal, the mobile terminal detects spatial movement data of the mobile terminal by using a motion sensor, and calculates current plane displacement data by using a relative displacement algorithm, where the plane displacement data is used to indicate a displacement direction and a displacement distance of the mobile terminal, and sends the plane displacement data to the television terminal, and the television terminal converts the received plane displacement data into pixel points adapted to the television terminal and draws a virtual mouse ICON (ICON) for real-time movement control.

S200, receiving a control instruction sent by a target mobile terminal, and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Meanwhile, the television terminal also receives control instructions such as return, confirmation, volume increase and decrease and the like sent by the target mobile terminal, and the control instructions are adopted to control the television terminal to respond.

In one example, controlling movement of a virtual mouse on a display interface according to the plane displacement data, S100, includes:

s101, obtaining pixel parameters of the target television terminal, wherein the pixel parameters comprise a first total number of pixels in the horizontal direction and a second total number of pixels in the longitudinal direction of the display screen;

in the embodiment of the invention, after the television terminal receives the plane displacement data sent by the mobile terminal, the plane displacement data needs to be converted into adaptive mobile data according to the display parameters of the television terminal.

The pixel parameter refers to the display resolution of the television terminal, the numerical value of the display resolution refers to the number of horizontal pixels and vertical pixels in all visible areas of the whole television terminal, for example, 1080 × 720 resolution, and the numerical value refers to displaying 1080 pixels horizontally, namely horizontally, on the whole screen, and displaying 720 pixels vertically, namely vertically, and the first total number of pixels in the horizontal direction and the second total number of pixels in the vertical direction on the display screen of the television terminal can be obtained by obtaining the resolution of the target television terminal.

S102, determining a first unit length corresponding to the transverse unit rotation angle according to the first total number, wherein the first unit length is used for indicating the number of pixel points which move transversely on a display interface when the mobile terminal rotates transversely by the unit angle; determining a second unit length corresponding to the longitudinal unit rotation angle according to the second total number, wherein the second unit length is used for indicating the number of pixel points which move longitudinally on the display interface when the mobile terminal rotates for each longitudinal unit angle;

after the first total number of the horizontal pixel points and the second total number of the vertical pixel points of the television terminal are obtained, the first unit length corresponding to the horizontal unit rotation angle is determined according to the first total number, the second unit length corresponding to the vertical unit rotation angle is determined according to the second total number,

the mode of determining the unit length corresponding to the horizontal or vertical unit rotation angle may be implemented by querying a preset length mapping table, where each resolution is set in the preset length mapping table according to experience or multiple experiments, that is, the number of pixels that move at each unit rotation angle corresponding to the total number of pixels, for example, for the total number of pixels that is 1080, the number of pixels that move at each rotation of the mobile terminal is 27, and for the total number of pixels that is 720, the number of pixels that move at each rotation of the mobile terminal is 18. In some embodiments, it may also be determined according to the maximum rotation angle of the mobile terminal, for example, generally, the comfortable angle range for the user to rotate the mobile terminal is 40 degrees, that is, the maximum rotation angle range is 40 degrees, the display screen of the television terminal is divided into 40 equal parts in the horizontal and vertical directions, if the width is 1080p, the first unit length corresponding to 1 degree in the horizontal direction is 1080/40=27 pixel number, and if the height is 720p, the second unit length corresponding to 1 degree in the vertical direction is 720/40=18 pixel number.

S103, analyzing the displacement distance and the displacement direction in the plane displacement data, and multiplying the first unit length or the second unit length by the displacement distance to obtain the movement length of the virtual mouse;

and then multiplying the displacement distance in the plane displacement data by the first unit length or the second unit length to obtain the movement length of the virtual mouse on the display interface of the television terminal, wherein the movement length is the number of pixel points moved by the virtual mouse. As above, if the resolution of the tv terminal is 1080 × 720, when the displacement direction in the plane displacement data sent by the mobile phone terminal is leftward and the displacement distance is 5 degrees, the movement length of the virtual mouse is 5 × 27=135 pixels moving leftward in the horizontal direction, or when the displacement direction is upward and the displacement distance is 5 degrees, the movement length of the virtual mouse is 5 × 18=90 pixels moving longitudinally.

And S104, controlling the virtual mouse on the display interface to move the moving length towards the displacement direction.

In one example, controlling the virtual mouse on the display interface to move the movement length to the displacement direction includes: rendering a floating icon of a virtual mouse on the display interface; determining a starting position of the floating icon, and calculating an ending position of the floating icon based on the starting position, the displacement direction and the movement length; moving the floating icon to the termination position on the display interface.

Generally, the selected content is generally determined by moving the focus frame on the display interface of the television terminal, while the present example draws a virtual mouse on the display interface of the television terminal, and the movement of the virtual mouse is controlled by the displacement data of the mobile terminal to determine the selected content. When the virtual mouse needs to be moved, a floating icon of the virtual mouse is rendered on a display interface, the initial position of the floating icon is determined, wherein the initial position can be a preset initial position, such as the center position of the display interface, when the television terminal is set to be not subjected to operations such as movement of the virtual mouse and the like after exceeding a preset time period, the floating icon of the virtual mouse is automatically hidden, the initial position is the last position before the virtual mouse is hidden last time, then the ending position of the floating icon is calculated according to the displacement direction and the movement length, and the floating icon is moved to the ending position from the initial position on the display interface, so that the virtual mouse on the display interface is moved.

In an example of the embodiment of the present invention, before controlling the movement of the virtual mouse on the display interface according to the plane displacement data, the method includes: analyzing the displacement distance in the plane displacement data, and judging whether the displacement distance exceeds a preset threshold value; and when the displacement distance exceeds a preset threshold value, controlling the movement of the virtual mouse on the display interface according to the plane displacement data.

In this example, the displacement distance in the plane displacement data is analyzed and compared with a preset threshold, when the displacement distance is smaller than the preset threshold, it is considered as micro-jitter, the display terminal does not perform virtual mouse movement processing, and when the displacement distance exceeds the preset threshold, the virtual mouse movement on the display interface is controlled according to the plane displacement data, so as to avoid the interference of the micro-jitter.

Fig. 5 is a schematic flowchart of an implementation scenario in the embodiment of the present invention, and fig. 5 is a complete explanation of the embodiment of the present invention.

As shown in fig. 5, in this implementation scenario, the target mobile terminal is a mobile phone, the target television terminal is a television, the mobile phone and the television start a display control service, and establish a communication connection, the mobile phone initializes the sensor, monitors the change of the sensor data and analyzes the change to determine whether there is movement, when the direction and the displacement of the mobile phone change, transmits the calculated change data of the direction and the displacement to the television, the television receives and analyzes the change data transmitted from the mobile phone, performs operations such as rendering an empty mouse and moving an empty mouse on the change data that does not belong to micro jitter, and receives and executes a control instruction transmitted by the mobile phone.

According to the embodiment of the invention, a separate hardware remote controller is not required to be configured, the mobile phone can be used as an air mouse to remotely control the television through the sensor principle, the operation is more convenient, blind operation can be realized, the mobile phone can be used anywhere, and the method is not limited by distance and space.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 2

In this embodiment, a television terminal control apparatus and system are further provided for implementing the foregoing embodiments and preferred embodiments, which have already been described and are not described again. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.

Fig. 6 is a block diagram of a structure of a television terminal control apparatus according to an embodiment of the present invention, as shown in fig. 6, applied to a mobile terminal, including: a detection module 1000, a conversion module 2000, a first transmission module 3000, wherein,

a detection module 1000, configured to detect spatial movement data of a target mobile terminal using a motion sensor;

a conversion module 2000, configured to convert the spatial movement data into planar displacement data, where the planar displacement data is used to indicate a displacement direction and a displacement distance of the target mobile terminal;

the first sending module 3000 is configured to send the plane displacement data to a target television terminal, so that the target television terminal controls movement of a virtual mouse on a display interface according to the plane displacement data, where the target mobile terminal is connected to the target television terminal through a wireless communication technology.

Optionally, the conversion module comprises: the conversion unit is used for converting the space movement data into rotation attitude data and rotation angle data, wherein the rotation attitude data corresponds to a displacement direction, and the rotation angle data corresponds to a displacement distance.

Optionally, the apparatus further comprises: the acquisition module is used for acquiring an operation instruction triggered on the control operation interface of the target mobile terminal; the searching module is used for searching the control instruction matched with the operation instruction; and the second sending module is used for sending the control instruction to the target television terminal so that the target television terminal performs instruction control on a display interface according to the control instruction.

The present embodiment further provides a television terminal control system, including: the mobile terminal is in wireless communication connection with the television terminal and is used for executing the device; the television terminal is used for executing the device as follows.

The embodiment also provides another television terminal control device, which is applied to a television terminal and comprises: the first control module is used for receiving the plane displacement data sent by the target mobile terminal and controlling the movement of the virtual mouse on the display interface according to the plane displacement data; and the second control module is used for receiving a control instruction sent by a target mobile terminal and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

Optionally, the first control module comprises: the acquisition unit is used for acquiring pixel parameters of the target television terminal, wherein the pixel parameters comprise a first total number of pixels in the horizontal direction of the display screen and a second total number of pixels in the longitudinal direction; the determining unit is used for determining a first unit length corresponding to the transverse unit rotation angle according to the first total number, wherein the first unit length is used for indicating the number of pixel points which move transversely on a display interface when the mobile terminal rotates transversely by a unit angle; determining a second unit length corresponding to the longitudinal unit rotation angle according to the second total number, wherein the second unit length is used for indicating the number of pixel points which move longitudinally on the display interface when the mobile terminal rotates for each longitudinal unit angle; the calculation unit is used for analyzing the displacement distance and the displacement direction in the plane displacement data and multiplying the first unit length or the second unit length by the displacement distance to obtain the movement length of the virtual mouse; and the control unit is used for controlling the virtual mouse on the display interface to move the moving length towards the displacement direction.

Optionally, the control unit comprises: the rendering subunit is used for rendering the floating icon of the virtual mouse on the display interface; the calculation subunit determines the starting position of the floating icon, and calculates the ending position of the floating icon based on the starting position, the displacement direction and the movement length; and the moving subunit is used for moving the floating icon to the termination position on the display interface.

Optionally, the apparatus further comprises: the judging module is used for analyzing the displacement distance in the plane displacement data and judging whether the displacement distance exceeds a preset threshold value; and when the displacement distance exceeds a preset threshold value, executing the movement of the virtual mouse on the display interface according to the plane displacement data control.

It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are located in different processors in any combination.

Example 3

Fig. 7 is a structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 7, the electronic device includes a processor 101, a communication interface 102, a memory 103, and a communication bus 104, where the processor 101, the communication interface 102, and the memory 103 complete communication with each other through the communication bus 104, and the memory 103 is used for storing a computer program; the processor 101 is configured to implement the following steps when executing the program stored in the memory 103:

s1, detecting spatial movement data of a target mobile terminal by adopting a motion sensor;

s2, converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal;

and S3, sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the terminal and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In another embodiment provided by the present application, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the television terminal control method in any one of the above embodiments.

In a further embodiment provided by the present application, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the television terminal control method described in any of the above embodiments.

In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

The above description is merely exemplary of the present application and is presented to enable those skilled in the art to understand and practice the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (12)

1. A television terminal control method is applied to a mobile terminal and comprises the following steps:

detecting spatial movement data of a target mobile terminal by adopting a motion sensor;

converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal;

and sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

2. The television terminal control method of claim 1, wherein converting the spatial movement data into planar displacement data comprises:

and converting the space movement data into rotation attitude data and rotation angle data, wherein the rotation attitude data corresponds to a displacement direction, and the rotation angle data corresponds to a displacement distance.

3. The television terminal control method according to claim 1, wherein after detecting the spatial movement data of the target mobile terminal, the method comprises:

acquiring an operation instruction triggered on the control operation interface of the target mobile terminal;

searching a control instruction matched with the operation instruction;

and sending the control instruction to the target television terminal so that the target television terminal performs instruction control on a display interface according to the control instruction.

4. A television terminal control method is applied to a television terminal and comprises the following steps:

receiving plane displacement data sent by a target mobile terminal, and controlling the movement of a virtual mouse on a display interface according to the plane displacement data;

receiving a control instruction sent by a target mobile terminal, and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

5. The television terminal control method of claim 4, wherein controlling movement of a virtual mouse on a display interface based on the plane displacement data comprises:

acquiring pixel parameters of the target television terminal, wherein the pixel parameters comprise a first total number of pixels in the horizontal direction and a second total number of pixels in the vertical direction of the display screen;

determining a first unit length corresponding to the transverse unit rotation angle according to the first total number, wherein the first unit length is used for indicating the number of pixel points which move transversely on a display interface when the mobile terminal rotates by the unit angle transversely; determining a second unit length corresponding to the longitudinal unit rotation angle according to the second total number, wherein the second unit length is used for indicating the number of pixel points which move longitudinally on a display interface when the mobile terminal rotates by the unit angle in each longitudinal direction;

analyzing the displacement distance and the displacement direction in the plane displacement data, and multiplying the first unit length or the second unit length by the displacement distance to obtain the movement length of the virtual mouse;

and controlling the virtual mouse on the display interface to move the moving length towards the displacement direction.

6. The method for controlling a television terminal according to claim 5, wherein controlling the virtual mouse on the display interface to move the movement length in the displacement direction comprises:

rendering a floating icon of a virtual mouse on the display interface;

determining a starting position of the floating icon, and calculating an ending position of the floating icon based on the starting position, the displacement direction and the movement length;

moving the floating icon to the termination position on the display interface.

7. The television terminal control method according to claim 4, before controlling movement of a virtual mouse on a display interface according to the plane displacement data, the method comprising:

analyzing the displacement distance in the plane displacement data, and judging whether the displacement distance exceeds a preset threshold value or not;

and when the displacement distance exceeds a preset threshold value, executing the movement of the virtual mouse on the display interface according to the plane displacement data control.

8. A television terminal control device is characterized by being applied to a mobile terminal and comprising:

the detection module is used for detecting the space movement data of the target mobile terminal by adopting the motion sensor;

the conversion module is used for converting the space movement data into plane displacement data, wherein the plane displacement data is used for indicating the displacement direction and the displacement distance of the target mobile terminal;

and the first sending module is used for sending the plane displacement data to a target television terminal so that the target television terminal controls the movement of a virtual mouse on a display interface according to the plane displacement data, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

9. A television terminal control device is applied to a television terminal and comprises the following components:

the first control module is used for receiving the plane displacement data sent by the target mobile terminal and controlling the movement of the virtual mouse on the display interface according to the plane displacement data;

and the second control module is used for receiving a control instruction sent by a target mobile terminal and controlling the target television terminal by adopting the control instruction, wherein the target mobile terminal is connected with the target television terminal through a wireless communication technology.

10. A television terminal control system, comprising: a mobile terminal and a television terminal, wherein,

the mobile terminal, connected with the television terminal in wireless communication, for executing the apparatus of claim 8;

the television terminal configured to execute the apparatus of claim 9.

11. An electronic device, characterized in that it comprises a memory, a processor and a computer program stored on said memory and executable on said processor, said computer program, when executed by said processor, implementing the steps of the television terminal control method according to any one of claims 1 to 7.

12. A storage medium, characterized in that it has stored thereon a computer program which, when executed by a processor, implements the steps of a television terminal control method according to any one of claims 1 to 7.

Images