CN105204764B - Handheld terminal with suspension screen, display device and remote control method - Google Patents
Handheld terminal with suspension screen, display device and remote control method Download PDFInfo
- Publication number
- CN105204764B CN105204764B CN201510564251.7A CN201510564251A CN105204764B CN 105204764 B CN105204764 B CN 105204764B CN 201510564251 A CN201510564251 A CN 201510564251A CN 105204764 B CN105204764 B CN 105204764B
- Authority
- CN
- China
- Prior art keywords
- floating
- touch
- screen
- information
- indication icon
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000000725 suspension Substances 0.000 title claims abstract description 78
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000009471 action Effects 0.000 claims abstract description 54
- 238000007667 floating Methods 0.000 claims description 185
- 238000004891 communication Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 10
- 230000003993 interaction Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 10
- 230000004044 response Effects 0.000 description 6
- 238000013507 mapping Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a handheld terminal with a suspension screen, a display device and a remote control method, wherein the remote control method is applied to the handheld terminal or the display device, the handheld terminal is wirelessly connected with the display device, and the remote control method is characterized in that suspension information generated by implementing suspension action on the suspension screen of the handheld terminal by acquiring a touch body or touch information generated by implementing touch action is sent to the display device, so that the display device draws a first indication icon or a second indication icon on the display screen of the display device according to the suspension information or the touch information, and selects an object specified by the second indication icon. Through the mode, the information interaction is carried out between the handheld terminal with the suspension screen and the display equipment, the display equipment is remotely controlled by the handheld terminal, and the user experience can be effectively improved.
Description
Technical Field
The invention relates to the technical field of electronic information, in particular to a handheld terminal with a suspension screen, a display device and a remote control method.
Background
In modern society, with the popularization of televisions, computers and mobile phones, various screens are matched with various operation control devices, and are independent and unrelated, so that electronic devices in families are more and more, and various remote controllers and operation handles are full of living rooms and study rooms of our families.
The current remote controller is not provided with a display screen generally, a user needs to feed back a screen of a corresponding electronic product after operation, the current electronic product is gradually intelligentized, corresponding functions of the electronic product are more and more, the current remote controller is very inconvenient for complex operations, even the current remote controller cannot be operated for complex projects, and the production cost of the electronic product can be increased by developing remote control equipment with different functions aiming at different electronic products.
Disclosure of Invention
The invention provides a handheld terminal with a suspended screen, a display device and a remote control method, which are used for realizing remote control of the display device by using the handheld terminal and effectively improving user experience.
One aspect of the present invention provides a remote control method, which is applied to a handheld terminal having a floating screen, the handheld terminal establishing a wireless connection with a display device, the remote control method including: the handheld terminal sends the effective size of the suspension screen to the display device, so that the display device can define an operation area with the same length-width ratio as the effective size on the display screen of the display device according to the effective size of the suspension screen; the method comprises the steps that a handheld terminal obtains floating information generated by a touch body performing a floating action on a floating screen or touch information generated by performing a touch action on the floating screen, wherein the floating information comprises coordinates of the touch body on the floating screen and a distance between the touch body and the floating screen, and the touch information comprises the coordinates of the touch body on the floating screen; the handheld terminal sends the suspension information or the touch information to the display device in real time, so that the display device draws and displays a first indication icon in the operation area according to the suspension information, draws and displays a second indication icon in the operation area according to the touch information, and further the display device selects an object pointed by the second indication icon when acquiring the touch information.
The suspension action is the suspension action of the two touch bodies on the suspension screen, and the suspension information comprises two coordinates of the two touch bodies on the suspension screen and two distances between the two touch bodies and the suspension screen; the touch action is the touch action of two touch bodies on the floating screen, and the touch information comprises two coordinates of the two touch bodies on the floating screen respectively.
Before the step of acquiring the floating information generated by the floating action of the touch body on the floating screen or the touch information generated by the touch action on the floating screen by the handheld terminal, the remote control method further comprises the following steps: the handheld terminal displays a gamepad icon on the floating screen so as to guide a user to perform a floating action or a touch action on the floating screen according to the gamepad icon.
The second aspect of the present invention provides a handheld terminal with a floating screen, the handheld terminal establishes a wireless connection with a display device, the handheld terminal includes a first communication module and a first processing module connected to the first communication module, the first communication module is configured to send an effective size of the floating screen of the handheld terminal to the display device, so that the display device defines an operation area having the same length-width ratio as the effective size on its display screen according to the effective size of the floating screen; the first processing module is used for acquiring floating information generated by a touch body implementing a floating action on a floating screen or touch information generated by implementing a touch action, wherein the floating information comprises coordinates of the touch body on the floating screen and a distance between the touch body and the floating screen, and the touch information comprises the coordinates of the touch body on the floating screen; the signal sending unit further sends the suspension information or the touch information to the display device in real time, so that the display device draws and displays the first indication icon in the operation area according to the suspension information, and displays the second indication icon in the operation area according to the touch information, and further the display device selects an object pointed by the second indication icon when acquiring the touch information.
A third aspect of the present invention provides a remote control method applied to a display device that establishes wireless connection with a handheld terminal having a floating screen, the remote control method including: the display equipment receives the effective size of the suspended screen sent by the handheld terminal; the display device demarcates an operation area with the same length-width ratio as the effective size on the display screen of the display device according to the effective size; the display device receives suspension information or touch information sent by the handheld terminal in real time, wherein the suspension information is generated by the handheld terminal through detecting suspension action of a touch body on a suspension screen, the touch information is generated by the handheld terminal through detecting touch action of the touch body on the suspension screen, the suspension information comprises coordinates of the touch body on the suspension screen and a distance between the touch body and the suspension screen, and the touch information comprises coordinates of the touch body on the suspension screen; the display device draws and displays a first indication icon in the operation area according to the suspension information, draws and displays a second indication icon in the operation area according to the touch information, and selects an object pointed by the second indication icon when the display device obtains the touch information.
The step of drawing and displaying the first indication icon in the operation area by the display device according to the suspension information specifically includes: the display device multiplies the coordinates in the floating information by the aspect ratio to generate first coordinates, and draws and displays a first indication icon in the operation region according to the first coordinates.
The step that the display device draws and displays the second indication icon in the operation area according to the touch information comprises the following steps: the display device multiplies the coordinates in the touch information by the aspect ratio to generate second coordinates, and draws and displays the second indication icon in the operation region according to the second coordinates.
And the display size of the first indication icon is in inverse proportion to the distance in the floating information.
The suspension action is the suspension action of the two touch bodies on the suspension screen, and the suspension information comprises two coordinates of the two touch bodies on the suspension screen and two distances between the two touch bodies and the suspension screen; the touch action is the touch action of the two touch bodies on the floating screen respectively, and the touch information comprises two coordinates of the two touch bodies on the floating screen respectively.
A fourth aspect of the present invention provides a display device that establishes wireless connection with a handheld terminal having a floating screen, the display device including: the second communication module is used for receiving the effective size of the suspended screen sent by the handheld terminal, and the second processing module is used for defining an operation area with the same length-width ratio as the effective size on a display screen of the display device according to the effective size; the second communication module is further used for receiving suspension information or touch information sent by the handheld terminal in real time, wherein the suspension information is generated by the handheld terminal through detecting suspension action of the touch body on the suspension screen, the touch information is generated by the handheld terminal through detecting touch action of the touch body on the suspension screen, the suspension information comprises coordinates of the touch body on the suspension screen and a distance between the touch body and the suspension screen, and the touch information comprises coordinates of the touch body on the suspension screen; the second processing module also draws and displays the first indication icon in the operation area according to the suspension information, draws and displays the second indication icon in the operation area according to the touch information, and selects an object pointed by the second indication icon when the display device acquires the touch information.
Through the scheme, the invention has the beneficial effects that: different from the prior art, the remote control method is applied to the handheld terminal with the suspension screen, after the handheld terminal is wirelessly connected with the display device, the handheld terminal sends the effective size of the suspension screen to the display device, so that the display device defines an operation area with the same length-width ratio as the effective size on the display screen according to the effective size of the suspension screen, the handheld terminal further obtains suspension information generated by the touch body performing the suspension action on the suspension screen or touch information generated by performing the touch action on the suspension screen, wherein the suspension information comprises the corresponding coordinates of the touch body on the suspension screen and the distance from the suspension screen, the touch information comprises the corresponding coordinates of the touch body on the suspension screen, and then the handheld terminal sends the suspension information or the touch information to the display device in real time, so that the display device draws and displays a first indication icon in the operation area according to the suspension information, and drawing and displaying the second indication icon in the operation area according to the touch information, and selecting an object designated by the second indication icon when the touch information is acquired, so that the display equipment is remotely controlled by using the handheld terminal, and the user experience can be effectively improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:
FIG. 1 is a schematic flow chart diagram of a first embodiment of the remote control method of the present invention;
FIG. 2 is a schematic diagram of the structure of the handheld terminal and the display device in FIG. 1;
fig. 3 is a schematic diagram of a mobile phone remote control smart television according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the handset of FIG. 3;
FIG. 5 is a schematic diagram of the smart television of FIG. 3;
fig. 6 is a schematic coordinate diagram of the corresponding coordinates of the floating information or the touch information on the mobile phone floating screen and the distance from the floating screen according to the first embodiment of the present invention;
fig. 7 is a schematic diagram of coordinates corresponding to floating information or touch information in an operation area of a smart television according to a first embodiment of the present invention;
FIG. 8 is a schematic diagram of an angle between an indicator icon and a rectangular plane coordinate system of a floating screen according to another embodiment of the present invention;
FIG. 9 is a schematic diagram of an indicator icon resized according to distance from the floating screen in accordance with other embodiments of the present invention;
fig. 10 is a flow chart illustrating a second embodiment of the remote control method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 and 2, fig. 1 is a schematic flow chart of a first embodiment of the remote control method of the present invention; fig. 2 is a schematic structural diagram of the handheld terminal and the display device in fig. 1. As shown in fig. 2, the handheld terminal 21 and the display device 22 establish a wireless connection, for example, the handheld terminal 21 and the display device 22 establish a wireless connection through WiFi or bluetooth. The handheld terminal 21 includes a first communication module 210 and a first processing module 211 connected to the first communication module 210. The display device 22 includes a second communication module 220 and a second processing module 221 connected to the second communication module 220, wherein the first communication module 210 of the handheld terminal 21 is connected to the second communication module 220 of the display device 22 to implement data interaction.
The remote control method of the present embodiment is applied to the handheld terminal 21 having the floating screen, and includes:
s11: the handheld terminal 21 transmits the effective size of the floating screen to the display device 22.
S12: the handheld terminal 21 displays a joystick icon on the floating screen.
S13: the handheld terminal 21 acquires floating information generated by a touch body performing a floating motion on a floating screen or touch information generated by a touch motion on the floating screen.
S14: the handheld terminal 21 transmits the hover information or the touch information to the display device 22 in real time.
The display device 22 is selected from, but not limited to, a smart tv, a computer, etc. The handheld terminal 21 is an electronic device having a floating screen, and is selected from, but not limited to, a mobile phone or a PDA (Personal Digital Assistant). The floating screen is a screen supporting a floating touch technology, and is different from a common touch screen, the common touch screen only has mutual capacitance and is used for realizing multi-point touch detection, but the electric field of the mutual capacitance sensor is very small, so that the signal intensity is very low, and very weak signals cannot be sensed. The floating screen of the embodiment at least comprises two capacitive sensors, namely at least a mutual capacitance sensor and a self-capacitance sensor, the self-capacitance can generate a signal stronger than the mutual capacitance, and the range of the detection distance of the floating screen can be up to 20mm by detecting a farther finger.
The embodiment takes a mobile phone to remotely control the smart television as an example for explanation.
Referring to fig. 3, the mobile phone 31 and the smart tv 32 of the present embodiment establish a peer-to-peer connection through bluetooth, the mobile phone 31 has a floating screen 310, and the smart tv 32 has a common display screen 320.
First, the mobile phone 31 is switched to the remote control mode, and a gamepad icon is displayed on the floating screen 310 of the mobile phone 31 to guide a user to perform a floating action or a touch action on the floating screen 310 according to the gamepad icon.
Referring to fig. 3 to 5 together, the mobile phone 31 sends the effective size of the floating screen 310 to the smart tv 32, so that the smart tv 32 defines an operation area 321 with the same aspect ratio as the effective size on the display screen 320 of the mobile phone 31 according to the effective size of the floating screen 310. Here, the mapping method for the display screen of the control end and the screen of the controlled end adopts a method with equal length-to-width ratio, which has the advantages that the image proportions displayed on the two screens are consistent, the image content is not deformed, but the content on the display screen of the controlled end is not displayed or if the content is displayed, the redundant content cannot be operated and remotely controlled through the control end; therefore, alternatively, a full mapping method may be adopted, in which the display screens of the control terminal and the controlled terminal are all aligned in the maximum sizeIt should be understood that the method is a method with different length-width ratios, so that all the contents on the display screen of the controlled end can be remotely controlled through the control end. The embodiment preferably uses an equal length-to-width ratio method for mapping, for example, the mobile phone 31 sends the length L1 and the width W1 of the floating screen 310 to the smart tv 32, where the ratio L1/W1 of the length L1 and the width W1 of the floating screen is a, so that the smart tv 32 divides the operation area 321 having the same ratio as the length L1 and the width W1 of the floating screen on the self display screen 320 according to the ratio a of the length L1 and the width W1 of the floating screen, where the length of the operation area 321 is L2, the width is W2, and the length L2/W2 is a. In this embodiment, the length L2 and the width W2 of the operation region 321 are c times the length L1 and the width W1 of the suspension screen, respectively, i.e., L2 ═ c × L1, W2 ═ c × W1,
optionally, a gamepad icon may be even displayed on the display currently displayed on the mobile phone 31 to guide the user to perform operations, where two circles shown in fig. 4 are gamepad icons to guide the user to select the circle for sliding or selecting operations.
The mobile phone 31 acquires hover information generated by a touch object performing a hover action on the hover screen 310 or touch information generated by a touch action on the hover screen 310, where the touch object refers to a finger of a user. The floating information includes coordinates of the user's finger on the floating screen 310 and a distance from the floating screen 310, and the touch information includes coordinates of the user's finger on the floating screen 310.
The hover action of the present embodiment is a hover action performed by two touch objects on the hover screen 310, and the touch action is a touch action performed by two touch objects on the hover screen 310, that is, the present invention supports the user to operate on the hover screen 310 by using both fingers of the user. For convenience of explanation, the left and right fingers of the user are used as touch objects. The floating information includes two coordinates of the left and right fingers of the user on the floating screen 310 and two distances from the floating screen 310, respectively, and the touch information includes two coordinates of the left and right fingers of the user on the floating screen 310, respectively.
In the present embodiment, when the fingers of the two hands of the user perform the floating operation on the floating screen 310, as shown in fig. 6, a coordinate system X-Y-Z is established by using the floating screen 310, wherein the coordinate system X-Y-Z uses one corner of the floating screen 310 as a coordinate origin, for example, uses a vertex at a lower left corner of the floating screen 310 as the coordinate origin, uses a length direction of the floating screen 310 as an X axis, uses a width direction as a Y axis, and the Z axis is perpendicular to the X axis and the Y axis. The floating screen 310 obtains two corresponding coordinates (x11, y11) and (x12, y12) of the left and right fingers A, B hovering over the floating screen 310, and the floating screen 310 can obtain the distances between the two fingers A, B and itself as b1 and b2 respectively. When the user's finger C, D performs a touch operation on the floating screen 310, the floating screen 310 detects a position where the finger touches the floating screen 310, thereby obtaining two coordinates (x21, y21) and (x22, y22) on the floating screen 310 where the finger C, D corresponds.
The mobile phone 31 sends the floating information or the touch information to the smart television 32 in real time, so that the smart television 32 draws and displays a first indication icon in the operation area 321 according to the floating information, the smart television 32 draws and displays a second indication icon in the operation area 321 according to the touch information, and the smart television 32 selects an object specified by the second indication icon when acquiring the touch information.
In the present embodiment, the smart tv 32 multiplies the abscissa and the ordinate of the coordinates (x11, y11) and (x12, y12) in the floating information by the same multiple, respectively, to generate the corresponding first coordinate. For example, the X-axis and Y-axis values of the coordinates (X11, Y11) and (X12, Y12) are multiplied by the multiple c, respectively, so as to obtain corresponding first coordinates (X11, Y11) and (X12, Y12) on the operation area 321 of the smart tv 32, as shown in fig. 7. Wherein, X11 ═ c × X11, Y11 ═ c × Y11, X12 ═ c × 12, and Y12 ═ c × Y12. Similarly, the smart tv 32 multiplies the abscissa and the ordinate of the coordinates (X21, Y21) and (X22, Y22) in the touch information by the same multiple c to obtain corresponding second coordinates (X21, Y21) and (X22, Y22). Thereby, the smart tv 32 draws and displays the first indication icon in the operation area 321 according to the first coordinates (X11, Y11) and (X12, Y12), and draws and displays the second indication icon in the operation area 321 according to the second coordinates (X21, Y21) and (X22, Y22). And, since the floating information further includes distances b1 and b2 between the fingers of both hands of the user and the floating screen, the smart tv 32 draws 321 the first indication icon in the operation area according to the first coordinates (X11, Y11) and (X12, Y12) and according to the distances b1 and b2 between the fingers and the floating screen 310, so that the display size of the first indication icon is inversely proportional to the distance in the floating information, that is, the larger the distance between the fingers and the floating screen 310, the smaller the first indication icon. In addition, when the first indicator icon is displayed in the operation area 321 of the smart television 32, the corresponding object in the smart television 32 is not selected, so that the user can perform a mouse-like tracking operation on the smart television 32 by performing a floating operation on the mobile phone 31. In addition, the smart tv 32 draws and displays a second indication icon in the operation area 321 according to the second coordinates (X21, Y21) and (X22, Y22), and the smart tv 32 selects an object pointed by the second indication icon, so that the user can perform a mouse-like click selection operation on the smart tv 32 by performing a touch operation on the cell phone 31. Here, fig. 4 shows a joystick guide icon, and fig. 5 shows a smart phone 32 displaying an indication icon at a position corresponding to the operation area 321 based on hover information or touch information transmitted from the cellular phone 31.
The first indication icon and the second indication icon can adopt the same or different icon shapes. In other embodiments, the first indicator icon may also adjust the shade of the icon color based on the distance in the hover message, e.g., the darker the color of the first indicator icon as the distance between the user's finger and the hover screen 310 is smaller. When the user's finger touches the floating screen 310, that is, the distance between the user's finger and the floating screen 310 is 0, a second indication icon is displayed on the floating screen 310, the second indication icon can be formed by adjusting the color of the first indication icon to the deepest color and displaying a floating ripple on the first indication icon to remind the user that the current finger has touched the floating screen 310, and an object pointed by the second indication icon is selected.
Therefore, in the embodiment, the wireless connection is established between the mobile phone 31 and the smart television 32, the smart television 32 is remotely controlled by using the mobile phone 31, the mobile phone 31 supports two-point operation and suspension operation, the position of the finger on the smart television 32 is synchronously displayed by performing the suspension operation on the mobile phone 31 without performing action response so as to avoid mistaken clicking, the corresponding object on the smart television 32 is selected by performing the touch action on the mobile phone 31, and the mobile phone 31 supports two-point operation, so that the user can remotely control the smart television 32 by using two hands by controlling the mobile phone 31 with the two hands, and the user experience is greatly improved.
In other embodiments, the angle between the indication icon and the rectangular plane coordinate system of the floating screen 310 may be determined to identify the floating operation or the touch operation performed by the finger of the user on the floating screen 310, where the rectangular plane coordinate system is formed by taking the vertex at the lower left corner of the floating screen 310 as the origin of coordinates, the length direction of the floating screen 310 as the X axis, and the width direction as the Y axis. When the finger of the user performs the hover operation on the hover screen 310, an included angle between the indication icon and the plane orthogonal coordinate system of the hover screen 310 is α, and when the finger of the user performs the touch operation on the hover screen 310, an included angle between the indication icon and the coordinate system of the hover screen 310 is β, where α > β, as shown in fig. 8. It is thereby possible to determine whether the user's finger performs a touch operation or a hover operation on the hover screen 310.
In other embodiments, the indication icon may also vary in size according to the response amount of the user's finger approaching or touching the floating screen 310, for example, when the user's finger touches the floating screen 310, the response amount is the largest, the indication icon displays the largest shape, when the user's finger is floating on the floating screen 310, the response amount is inversely proportional to the distance between the finger and the floating screen, that is, the smaller the distance between the finger and the floating screen, the larger the response amount, and thus the variation of the indication icon may be controlled according to the response amount obtained by the floating screen 310, as shown in fig. 9. Therefore, the object can be tracked or selected by judging the floating operation or touch operation of the finger of the user on the mobile phone 31 according to the size of the indication icon.
Referring to fig. 10, fig. 10 is a flowchart illustrating a remote control method according to a second embodiment of the present invention. Referring to fig. 10 in conjunction with fig. 2 to 5, the remote control method of the present embodiment is applied to the display device 22, and the display device 22 is wirelessly connected to the handheld terminal 21 having the suspension screen. The remote control method comprises the following steps:
s21: the display device 22 receives the effective size of the floating screen transmitted from the hand-held terminal 21.
S22: the display device 22 demarcates an operation area having the same aspect ratio as the effective size on its own display screen according to the effective size;
s23: the display device 22 receives the hover information or the touch information transmitted by the handheld terminal 21 in real time.
S24: the display device 22 draws and displays the first indication icon in the operation area according to the floating information, draws and displays the second indication icon in the operation area according to the touch information, and when the display device 22 acquires the touch information, selects an object pointed by the second indication icon.
The remote control method of the present embodiment is similar to the remote control method of the above embodiments, and is not described herein again.
In summary, when the remote control method is applied to a handheld terminal or a display device having a floating screen, the handheld terminal is wirelessly connected with the display device, and the effective size of the floating screen is sent to the display device through the handheld terminal, so that the display device defines an operation area having the same length-width ratio as the effective size on its display screen according to the effective size of the floating screen, and then the handheld terminal further obtains floating information generated by a touch body performing a floating action on the floating screen or touch information generated by performing a touch action on the floating screen and sends the touch information to the display device in real time, so that the display device draws a first indication icon in the operation area of its display screen according to the floating information, draws a second indication icon according to the touch information, and selects an object pointed by the second indication icon, the display device is remotely controlled by the handheld terminal, the handheld terminal supports two-point operation and suspension operation, the display device is remotely controlled by two hands, the tracking icon of the operation is displayed on the display device through the suspension operation of the handheld terminal, and user experience is improved.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A remote control method is applied to a handheld terminal with a suspended screen, the handheld terminal is in wireless connection with a display device, and the remote control method comprises the following steps:
the handheld terminal sends the effective size of the suspension screen to the display device, so that the display device delimits an operation area with the same length-width ratio as the effective size on the display screen of the display device according to the effective size of the suspension screen;
the handheld terminal acquires floating information generated by a touch body performing a floating action on the floating screen or touch information generated by performing a touch action on the floating screen, wherein the floating information comprises coordinates of the touch body on the floating screen and a distance between the touch body and the floating screen, and the touch information comprises coordinates of the touch body on the floating screen;
the handheld terminal sends the suspension information or the touch information to the display device in real time, so that the display device draws and displays a first indication icon in the operation area according to the suspension information, draws and displays a second indication icon in the operation area according to the touch information, and further, when the display device obtains the touch information, the display device selects an object pointed by the second indication icon;
the first indication icon adjusts the color depth of the icon according to the distance in the floating information, the smaller the distance between the touch body and the floating screen in the floating information is, the darker the color of the first indication icon is, when the second indication icon is displayed on the floating screen, the color of the first indication icon is adjusted to be the deepest, a user is reminded when the first indication icon displays floating waves to form the second indication icon, and an object pointed by the second indication icon is selected.
2. The remote control method according to claim 1, wherein the hover is a hover action performed by two of the touch objects on the hover screen, and the hover information includes two coordinates of the two touch objects on the hover screen and two distances from the hover screen; the touch action is the touch action of the two touch bodies on the floating screen, and the touch information comprises two coordinates of the two touch bodies on the floating screen respectively.
3. The remote control method according to any one of claims 1 to 2, wherein before the step of the handheld terminal acquiring hover information resulting from a hover action of a touch object on the hover screen or touch information resulting from a touch action on the hover screen, the remote control method further comprises:
and the handheld terminal displays a gamepad icon on the floating screen so as to guide a user to perform the floating action or the touch action on the floating screen according to the gamepad icon.
4. A handheld terminal with a suspension screen is characterized in that the handheld terminal is in wireless connection with a display device and comprises a first communication module and a first processing module connected with the first communication module, wherein the first communication module is used for sending an effective size of the suspension screen of the handheld terminal to the display device so that the display device can demarcate an operation area with the same length-width ratio as the effective size on the display screen of the display device according to the effective size of the suspension screen;
the first processing module is used for acquiring floating information generated by a touch body performing a floating action on the floating screen or touch information generated by performing a touch action, wherein the floating information comprises coordinates of the touch body on the floating screen and a distance between the touch body and the floating screen, and the touch information comprises coordinates of the touch body on the floating screen;
the signal sending unit is further used for sending the suspension information or the touch information to the display equipment in real time, so that the display equipment draws and displays a first indication icon in the operation area according to the suspension information, draws and displays a second indication icon in the operation area according to the touch information, and further enables the display equipment to select an object pointed by the second indication icon when the display equipment obtains the touch information;
the first indication icon adjusts the color depth of the icon according to the distance in the floating information, the smaller the distance between the touch body and the floating screen in the floating information is, the darker the color of the first indication icon is, when the second indication icon is displayed on the floating screen, the color of the first indication icon is adjusted to be the deepest, a user is reminded when the first indication icon displays floating waves to form the second indication icon, and an object pointed by the second indication icon is selected.
5. A remote control method is applied to a display device, the display device is in wireless connection with a handheld terminal with a suspended screen, and the remote control method comprises the following steps:
the display equipment receives the effective size of the suspended screen sent by the handheld terminal;
the display device demarcates an operation area with the same length-width ratio as the effective size on a display screen of the display device according to the effective size;
the display device receives floating information or touch information sent by the handheld terminal in real time, wherein the floating information is generated by the handheld terminal through detecting a floating action of a touch body on the floating screen, the touch information is generated by the handheld terminal through detecting a touch action of the touch body on the floating screen, the floating information comprises coordinates of the touch body on the floating screen and a distance from the floating screen, and the touch information comprises coordinates of the touch body on the floating screen;
the display device draws and displays a first indication icon in the operation area according to the suspension information, draws and displays a second indication icon in the operation area according to the touch information, and selects an object pointed by the second indication icon when the display device obtains the touch information;
the first indication icon adjusts the color depth of the icon according to the distance in the floating information, the smaller the distance between the touch body and the floating screen in the floating information is, the darker the color of the first indication icon is, when the second indication icon is displayed on the floating screen, the color of the first indication icon is adjusted to be the deepest, a user is reminded when the first indication icon displays floating waves to form the second indication icon, and an object pointed by the second indication icon is selected.
6. The remote control method according to claim 5, wherein the step of drawing and displaying the first indication icon in the operation area by the display device according to the floating information specifically comprises:
the display device multiplies the coordinates in the floating information by the length-width ratio to generate first coordinates, and draws and displays a first indication icon in the operation area according to the first coordinates.
7. The remote control method according to claim 5, wherein the step of drawing and displaying a second indication icon in the operation area by the display device according to the touch information comprises:
the display device multiplies the coordinates in the touch information by the aspect ratio to generate second coordinates, and draws and displays the second indication icon in the operation area according to the second coordinates.
8. The remote control method according to claim 6, wherein a display size of the first indication icon is inversely proportional to a distance in the floating information.
9. The remote control method according to claim 5, wherein the hover is a hover action performed by the two touch bodies on the hover screen, and the hover information includes two coordinates of the two touch bodies on the hover screen and two distances from the hover screen; the touch action is the touch action of the two touch bodies on the floating screen respectively, and the touch information comprises two coordinates of the two touch bodies on the floating screen respectively.
10. A display device that establishes a wireless connection with a handheld terminal having a floating screen, the display device comprising: the second communication module is used for receiving the effective size of the floating screen sent by the handheld terminal, and the second processing module is used for defining an operation area with the same length-width ratio as the effective size on a display screen of the display device according to the effective size;
the second communication module is further configured to receive floating information or touch information sent by the handheld terminal in real time, where the floating information is generated by the handheld terminal by detecting a floating action performed by a touch object on the floating screen, the touch information is generated by the handheld terminal by detecting a touch action performed by the touch object on the floating screen, the floating information includes coordinates of the touch object on the floating screen and a distance from the floating screen, and the touch information includes coordinates of the touch object on the floating screen;
the second processing module is further used for drawing and displaying a first indication icon in the operation area according to the suspension information, drawing and displaying a second indication icon in the operation area according to the touch information, and selecting an object pointed by the second indication icon when the display device obtains the touch information;
the first indication icon adjusts the color depth of the icon according to the distance in the floating information, the smaller the distance between the touch body and the floating screen in the floating information is, the darker the color of the first indication icon is, when the second indication icon is displayed on the floating screen, the color of the first indication icon is adjusted to be the deepest, a user is reminded when the first indication icon displays floating waves to form the second indication icon, and an object pointed by the second indication icon is selected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510564251.7A CN105204764B (en) | 2015-09-06 | 2015-09-06 | Handheld terminal with suspension screen, display device and remote control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510564251.7A CN105204764B (en) | 2015-09-06 | 2015-09-06 | Handheld terminal with suspension screen, display device and remote control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105204764A CN105204764A (en) | 2015-12-30 |
| CN105204764B true CN105204764B (en) | 2020-08-21 |
Family
ID=54952484
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510564251.7A Active CN105204764B (en) | 2015-09-06 | 2015-09-06 | Handheld terminal with suspension screen, display device and remote control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105204764B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107831922A (en) * | 2017-11-21 | 2018-03-23 | 四川长虹电器股份有限公司 | 3D touch touch handle system |
| CN110908563A (en) * | 2019-11-06 | 2020-03-24 | 成都忆光年文化传播有限公司 | Terminal display method |
| CN111880717B (en) * | 2020-07-23 | 2021-11-16 | 卡莱特云科技股份有限公司 | Method and device for suspending touch control remote control playing equipment |
| CN112835484B (en) * | 2021-02-02 | 2022-11-08 | 北京地平线机器人技术研发有限公司 | Dynamic display method and device based on operation body, storage medium and electronic equipment |
| CN112905136A (en) * | 2021-03-11 | 2021-06-04 | 北京小米移动软件有限公司 | Screen projection control method and device and storage medium |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006172423A (en) * | 2004-11-18 | 2006-06-29 | Canon Inc | Remote controlling system, remote controlling apparatus, controlled apparatus, remote controlling method, computer program, and storage medium |
| CN1782963A (en) * | 2004-11-30 | 2006-06-07 | 英业达股份有限公司 | Remote control device with touch control function and its processing method |
| CN101977796B (en) * | 2008-03-19 | 2013-05-08 | 株式会社电装 | Vehicular manipulation input apparatus |
| CN101729813A (en) * | 2008-10-29 | 2010-06-09 | 康佳集团股份有限公司 | Remote control transmitting device for television and control method |
| TW201222354A (en) * | 2010-11-23 | 2012-06-01 | Primax Electronics Ltd | Methods for mapping finger movements on a touch pad to a computer screen |
| US9354804B2 (en) * | 2010-12-29 | 2016-05-31 | Microsoft Technology Licensing, Llc | Touch event anticipation in a computing device |
| JP2012190183A (en) * | 2011-03-09 | 2012-10-04 | Sony Corp | Image processing device, method, and program |
| CN102355558A (en) * | 2011-08-17 | 2012-02-15 | 深圳市同洲电子股份有限公司 | Method and system for synchronizing mobile terminal and display device |
| CN102622182A (en) * | 2012-04-16 | 2012-08-01 | 李波 | Off-screen touch interactive system with nearly-joint sensing projection point coordinate indication |
| CN103634631B (en) * | 2012-08-22 | 2016-09-14 | 腾讯科技（深圳）有限公司 | Icon method for selecting based on remote control touch screen and system |
| CN103870195B (en) * | 2014-03-03 | 2018-04-27 | 联想(北京)有限公司 | A kind of information cuing method and electronic equipment |
| CN104598280A (en) * | 2015-02-02 | 2015-05-06 | 上海天奕达电子科技有限公司 | Method and device for remotely processing APK (Android Package) file for intelligent terminal |
| CN104661066A (en) * | 2015-02-06 | 2015-05-27 | 北京誉信优能信息科技有限公司 | Multi-point floating touch remote control device and remote control method thereof |
-
2015
- 2015-09-06 CN CN201510564251.7A patent/CN105204764B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105204764A (en) | 2015-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10055064B2 (en) | Controlling multiple devices with a wearable input device | |
| CN105204764B (en) | Handheld terminal with suspension screen, display device and remote control method | |
| US10073493B2 (en) | Device and method for controlling a display panel | |
| KR102063621B1 (en) | Display method of screen of wearable device and wearable device | |
| US10684673B2 (en) | Apparatus and control method based on motion | |
| US20170123573A1 (en) | Electronic device, information processing method, program, and electronic device system | |
| US20150062033A1 (en) | Input device, input assistance method, and program | |
| JP5572851B1 (en) | Electronics | |
| EP3716031B1 (en) | Rendering device and rendering method | |
| KR20140138189A (en) | Method, device, and system for controlling computer terminal | |
| CN108958614B (en) | Display control method and terminal | |
| CN109407949B (en) | Display control method and terminal | |
| CN103152467A (en) | Hand-held electronic device and remote control method | |
| CN108388354A (en) | A kind of display methods and mobile terminal in input method candidate area domain | |
| KR20140010593A (en) | The method and apparatus of reducing current consumption by checking e-pen inserting and picking out | |
| CN109828710B (en) | Image processing method and mobile terminal | |
| CN106201027B (en) | Display control method and device, input/output control method and device | |
| JP6411067B2 (en) | Information processing apparatus and input method | |
| CN105630315A (en) | Quantity adjustment method and apparatus | |
| CN108563376B (en) | Application program starting method and mobile terminal | |
| CN111240549B (en) | Display control method, electronic device, and medium | |
| KR101555830B1 (en) | Set-top box system and Method for providing set-top box remote controller functions | |
| WO2020158088A1 (en) | Drawing system | |
| KR20170124593A (en) | Intelligent interaction methods, equipment and systems | |
| CN106020659B (en) | Information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230508 Address after: Room 501, 85 Xiaguang Dongli, Haicang District, Xiamen City, Fujian Province, 361000 Patentee after: Xiamen reliable intellectual property service Co.,Ltd. Address before: 516006 Zhongkai hi tech Zone, Huizhou, Guangdong, 86 Chang seven Road West Patentee before: HUIZHOU TCL MOBILE COMMUNICATION Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240710 Address after: No. 19 Dapingzheng Street, Yuzhong District, Chongqing City, 400010, No. 34-8 Patentee after: Chongqing Yiyou Technology Co.,Ltd. Country or region after: China Address before: Room 501, 85 Xiaguang Dongli, Haicang District, Xiamen City, Fujian Province, 361000 Patentee before: Xiamen reliable intellectual property service Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |