CN112449227B - Interaction method and device for touch screen application compatible with remote controller operation and smart television - Google Patents
Interaction method and device for touch screen application compatible with remote controller operation and smart television Download PDFInfo
- Publication number
- CN112449227B CN112449227B CN202011153806.6A CN202011153806A CN112449227B CN 112449227 B CN112449227 B CN 112449227B CN 202011153806 A CN202011153806 A CN 202011153806A CN 112449227 B CN112449227 B CN 112449227B
- Authority
- CN
- China
- Prior art keywords
- application program
- focus
- controls
- user interface
- operation instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000003993 interaction Effects 0.000 title claims abstract description 49
- 238000001514 detection method Methods 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012790 confirmation Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42224—Touch pad or touch panel provided on the remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Details Of Television Systems (AREA)
Abstract
The application provides an interaction method and an interaction device, wherein the interaction method comprises the following steps: acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout by a smart television layout detection tool; acquiring the typesetting attributes among the controls according to the user interface layout and the identification codes of the controls in the user interface layout; acquiring the position of a focus of an application program, and determining an identification code of a control in the user interface layout corresponding to the focus; acquiring a moving operation instruction of the television remote control equipment, and determining the moving direction and the moving distance of a focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls; and generating a touch operation instruction according to the moving direction and the moving distance of the focus, and inputting the touch operation instruction to the application program, so that the application program which only supports touch screen operation on the smart television can receive an operation signal of the remote control device.
Description
Technical Field
The invention relates to the technical field of smart television application, in particular to an interaction method and device for touch screen application compatible with remote controller operation, a smart television and a storage medium.
Background
With the development of television technology, televisions have entered into thousands of households, and become one of indispensable consumer goods for life, leisure and entertainment of people. Televisions are often equipped with remote control devices, which are important tools for controlling the television.
With the development of the Android native system, the Android OS has been applied to different devices, such as a mobile phone, a tablet, a watch, and even a television, so that the Android smart television appears in the market. However, due to different interaction scenes of different devices, the Android application terminal ecosystem is also divided into a television version and a mobile phone version, that is, the third-party application program is also divided into a television application program and a mobile phone application program, the television application program adapted to the smart television generally only supports remote control input but not touch input, and the mobile phone application program adapted to the mobile phone generally only supports touch input but not remote control input.
In some occasions, a user wants to install a third-party application program only supporting touch screen manipulation on an android smart television, and in order to enable the application program only supporting touch screen manipulation installed on the android smart television to support remote control input, a commonly-used solution is as follows: and determining a sliding direction and a sliding distance value according to a key value and a key step length corresponding to a key event of the television remote control equipment, and simulating to generate a touch sliding operation instruction to be transmitted to an application program so as to enable the current application program to execute a corresponding remote control command. When the display interface of the application program is controlled to slide, because the sliding distance value is determined according to the key step length in the method, when the target content can be obtained only by sliding for a long distance, the direction key on the remote control equipment needs to be pressed for many times to obtain enough step length, the pressing times of the direction key cannot be known, the operation is very inconvenient, and poor interaction experience is brought to a user.
Disclosure of Invention
Based on this, an object of the embodiments of the present invention is to provide an interaction method and apparatus for enabling a touch screen application to be compatible with a remote controller operation, a smart television, and a storage medium, where the interaction method enables a touch screen application program to be compatible with a remote control operation of a remote controller, and has the advantages of being convenient to operate and good in user experience.
According to a first aspect of the embodiments of the present invention, there is provided an interaction method for a touch screen application to be compatible with remote controller operations, including the following steps:
acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout by a smart television layout detection tool;
acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout;
acquiring the position of a focus of an application program on the smart television, and determining an identification code of a control in the user interface layout corresponding to the focus;
acquiring a moving operation instruction of the television remote control equipment, and determining the moving direction and the moving distance of a focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls;
and generating a touch operation instruction according to the moving direction and the moving distance of the focus, and inputting the touch operation instruction to the application program.
According to the interaction method, the typesetting attributes among the controls in the user interface layout of the application program are obtained, the initial focus of the application program on the smart television is obtained, the identification codes of the controls in the user interface layout corresponding to the initial focus are confirmed, and when a moving operation instruction of the remote control device is received, the corresponding moving direction and moving distance can be obtained and transmitted to the application program, so that the application program only supporting touch screen operation can receive the remote control signal of the remote control device and execute the corresponding command, the operation is convenient, and better interaction experience is brought to a user.
In an alternative embodiment, the layout detection tool of the television android system is a view hierarchy analysis tool.
In an optional embodiment, the method for acquiring the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout by using the smart television layout detection tool comprises the following steps:
when an opened application program on the smart television enters an interface needing focus processing, connecting to each display interface of the application program through an android phone auxiliary tool;
capturing each display interface of the application program through a view hierarchical structure analysis tool to obtain the user interface layout of each display interface of the application program;
and acquiring the identification codes of the controls from the user interface layout of each display interface of the application program.
In an alternative embodiment, the layout property is a position and orientation relationship between the controls in the user interface layout of the application program.
In an optional embodiment, the method for determining the moving direction and the moving distance of the focus according to the moving operation instruction, the identification code of the control and the layout attribute among the controls includes the following steps:
acquiring an initial focus of an application program on the smart television, determining a control corresponding to the initial focus as a first control, and acquiring a first identification code of the first control;
receiving a moving operation instruction of television remote control equipment;
acquiring a key value of the television remote control equipment and the pressing times of a key corresponding to the key value according to the mobile operation instruction, and determining a second control corresponding to a new focus of an application program on the smart television according to the key value, the pressing times, a first identification code of a first control and the typesetting attributes among the controls;
and determining the moving direction and the moving distance of the focus according to the position relation between the first control and the second control.
In an alternative embodiment, the direction of movement comprises a first direction of movement; the movement distance comprises a first movement distance corresponding to the first movement direction; or, the moving direction includes a first moving direction and a second moving direction perpendicular to the first moving direction, and the moving distance includes a first moving distance corresponding to the first moving direction and a second moving distance corresponding to the second moving direction.
In an optional embodiment, a touch operation instruction is generated according to the moving direction and the moving distance of the focus, and when the touch operation instruction is input to the application program, a focus request command is executed to enable an icon of a control corresponding to the position where the current focus is located to present a focus state.
In an optional embodiment, after a touch operation instruction is generated according to the moving direction and the moving distance of the focus and is input to the application program, the method further includes the steps of:
and acquiring a click operation instruction of the television remote control equipment, acquiring a key value of the television remote control equipment according to the click operation instruction, generating a click touch operation instruction according to the key value, and inputting the click touch operation instruction to the application program.
In an optional embodiment, further comprising the step of: setting a white list of an application program supporting remote control operation, judging whether the currently opened application program is contained in the white list, and if not, updating a configuration file for the currently opened application program; and setting a typesetting attribute corresponding to the currently opened application program in the configuration file.
According to a second aspect of the embodiments of the present invention, there is provided an interaction apparatus for a touch screen application to be compatible with remote controller operations, including:
the layout detection module is used for acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout through a smart television layout detection tool;
the interactive logic relationship acquisition module is used for acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout;
the focus identification module is used for acquiring the position of a focus of an application program on the smart television and determining an identification code of a control in the user interface layout corresponding to the focus;
the focus transfer module is used for acquiring a moving operation instruction of the television remote control equipment and determining the moving direction and the moving distance of a focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls;
and the touch operation instruction generating module is used for generating a touch operation instruction according to the moving direction and the moving distance of the focus and inputting the touch operation instruction to the application program.
According to a third aspect of the embodiments of the present invention, there is provided a smart television, including a processor, a memory, and a display screen; the memory and the display screen are electrically connected with the processor through a communication bus; the memory stores a computer program, the computer program is suitable for being loaded by the processor and executing the interaction method compatible with the remote controller operation of the touch screen application, and television interface display signals are generated and transmitted to the display screen; and the display screen receives the television interface display signal and displays corresponding interface content.
According to a fourth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the interaction method for the touch screen application to be compatible with the remote controller operation as described above.
By applying the technical scheme of the application, based on the layout relation of each control of the application program, the control signal of the remote control equipment can be received, the focus of the remote control equipment is refreshed, and the corresponding touch operation instruction is transmitted to the application program, so that the application program can receive the control signal of the remote control equipment and execute the corresponding command, the operation is convenient, and better interactive experience is brought to a user.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
For a better understanding and practice, the invention is described in detail below with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic application environment diagram of a remote control interaction method according to a preferred embodiment of the present application;
fig. 2 is a flowchart of an interaction method for enabling a touch screen application to be compatible with remote controller operations according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a step S1 of an interaction method for a touch screen application compatible with remote control operation according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a step S4 of an interaction method for a touch screen application compatible with remote control operation according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a user interface of a mobile application on a smart television according to an embodiment of the present invention;
fig. 6 is a block diagram illustrating a structure of an interaction apparatus compatible with remote control operation for a touch screen application according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an intelligent television according to an embodiment of the present invention.
Detailed Description
The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown.
This invention may, however, be embodied in many different forms and should not be construed as limited to the specific embodiments set forth herein. Rather, these embodiments are provided to convey the scope of the invention to those skilled in the art.
Unless otherwise defined, terms (including technical and scientific terms) used herein should be understood to have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Moreover, it will be understood that terms used herein should be interpreted as having a meaning that is consistent with their meaning in the context of this specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The following specifically describes the scheme of the present application, taking an electronic device as an example of an intelligent electronic device based on an Android system:
please refer to fig. 1, which is a schematic diagram of an application environment of a remote control interaction method according to a preferred embodiment of the present application. In a preferred embodiment of the present application, the remote control interaction method is specifically applied to a smart television 100, and the smart television 100 is a smart television based on an Android system (Android). The smart tv 100 may be connected with a remote control device 200 (e.g., a remote control device, a mobile terminal, etc.) to receive a key signal transmitted by the remote control device. The intelligent television 100 is wirelessly controlled by the remote control device 200, and remote control technologies include infrared remote control, 2.4G remote control, Bluetooth remote control and the like. When a user presses a key of the remote control device 200, the remote control device 200 sends different remote control signals to the smart television 100. The smart television 100 generates key events according to the remote control signal, wherein the key events comprise up, down, left and right direction key events generated when a user presses up, down, left and right keys of the remote control device; also included are confirmation events, return events, and other menu selection events.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
According to one aspect of the embodiment of the invention, an interaction method for the touch screen application to be compatible with the operation of a remote controller is provided.
Please refer to fig. 2, which is a flowchart illustrating an interaction method for a touch screen application compatible with remote control operation according to an embodiment of the present invention. The method is executed by the smart television 100 shown in fig. 1. It should be noted that the method provided in the embodiments of the present application is not limited by the specific order shown in fig. 2 and described below.
The specific flow of the interaction method is as follows:
s1: acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout by a smart television layout detection tool;
the intelligent television Layout detection tool is a view hierarchical structure analysis tool, namely a Layout analyzer tool in Android Studio;
the application program is a touchscreen application program of a third party which is installed on the smart television 100 and does not support remote control, or is an android mobile phone application program which cannot process a key event;
the View is used for carrying View content, the View is a UI control, and may be a List View or a cycler View or other control, and the carried View content includes the home page content or the home page content, and other View content outside the display area of the smart television. The touch operation for the third party touch screen version application is an operation for View.
And the identification code of the control is a unique identification code for identifying each View control, or other codes or symbols playing a role of unique identification. In this embodiment, the identification code is an ID number, and the corresponding control can be determined according to the ID number of each control, so as to determine the type setting attribute between each control in the interface layout of the application program; for example, a first control corresponds to a first ID number and a second control corresponds to a second ID number.
Referring to fig. 3, fig. 3 is a flowchart illustrating a step S1 of an interaction method for enabling a touch screen application to be compatible with remote control operation according to an embodiment of the present invention.
In this embodiment, step S1 includes the following steps:
s101: when an opened application program on the smart television enters an interface needing to be focused, the application program is connected to each display interface of the application program through the android phone auxiliary tool.
It should be noted that: because the application program does not support remote controller operation, only supports touch operation, in order to enable a user to use the remote controller to operate the application program, focus processing is required; the focus processing method comprises the following steps: when the focus is in the control A, pressing the direction key of the remote controller, and the next focus is to the process of which control.
Android phone appurtenance is the ADB instrument, and the ADB saddlebag is the android phone appurtenance package that Google provided, plays the effect of debugging bridge.
S102: capturing each display interface of the application program through a view hierarchical structure analysis tool to obtain the user interface layout of each display interface of the application program;
s103: and acquiring the identification codes of the controls from the user interface layout of each display interface of the application program.
Since each control (referring to the View control inside the application) has a control attribute and/or a typesetting attribute, that is, each control has a corresponding identification code and specific position information. And the control attribute comprises a custom attribute. By way of example, the custom properties of the control include a control type and a control identification code, and the control type is a button or a dialog box, etc.; the control identification code can be used as a basis for distinguishing the controls of the same type.
Specifically, after the third-party mobile phone application is installed in the television Android system, when the application program is opened, when the application program enters an interface needing focus processing, ADB connection is performed in the Android Studio, and after the ADB connection, a display interface of a current application program of the television Android system is captured in real time through a Layout accelerator tool in the Android Studio, and the display interface is set according to a certain Layout, so that identification codes of various controls and position information of the various controls can be obtained from the Layout of the display interface, and thus, the typesetting attributes among the various controls can be conveniently determined.
The manner in which the application program is opened includes, but is not limited to, the following manners: (1) clicking an application icon in the application by the user to open the application; (2) a user opens the keyboard through an application shortcut key; (3) pulled up by another application to open the application.
Step S2: acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout; each control is all the controls in the application program.
It should be noted that: however, at a certain moment when the application program is opened, only part of the controls can be displayed, and the typesetting attributes among the controls cannot be limited to the current controls which can be seen by the user, but include all the controls in the application program; therefore, the steps are executed to obtain the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout each time the display interface of the application program is refreshed.
And the typesetting attribute is the position and direction relationship among all controls in the user interface layout (UI interface layout) of the application program. As an example, the layout properties may include the arrangement direction of the controls, the position relationship between the controls and other controls, the alignment manner between the controls and other controls, the arrangement order of the controls, and the like.
In the operation and control process of the remote control equipment, an E control, an F control and a G control are sequentially arranged in a current application interface from top to bottom; assuming that the current focus is located on the F control, based on the typesetting attribute, when a 'down' key on the remote control equipment is pressed, the current focus jumps to the G control; if the up button on the remote control device is pressed at this time, the current focus will jump to the E control.
Step S3: acquiring the position of a focus of an application program on the smart television, and determining an identification code of a control in the user interface layout corresponding to the focus; wherein the focus is the point of a remote control signal sent by the remote control equipment; the identification code of the control is the unique ID number of the control.
Step S4: and acquiring a moving operation instruction of the television remote control equipment, and determining the moving direction and the moving distance of the focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls.
Referring to fig. 4, fig. 4 is a flowchart illustrating a step S4 of an interaction method for enabling a touch screen application to be compatible with remote control operation according to an embodiment of the present invention.
In an alternative embodiment, step S4 includes the following steps:
s401: acquiring an initial focus of an application program on the smart television, determining a control corresponding to the initial focus as a first control, and acquiring a first identification code of the first control; the initial focus is a default corresponding control determined according to the UI interface design and the use habit of the user.
S402: receiving a moving operation instruction of television remote control equipment; the television remote control device can be a remote controller;
s403: acquiring a key value of the television remote control equipment and the pressing times of a key corresponding to the key value according to the mobile operation instruction, and determining a second control corresponding to a new focus of an application program on the smart television according to the key value, the pressing times, a first identification code of a first control and the typesetting attributes among the controls;
s404: and determining the moving direction and the moving distance of the focus according to the position relation between the first control and the second control.
In particular, the movement direction comprises a first movement direction; the movement distance comprises a first movement distance corresponding to the first movement direction; or, the moving direction includes a first moving direction and a second moving direction perpendicular to the first moving direction, and the moving distance includes a first moving distance corresponding to the first moving direction and a second moving distance corresponding to the second moving direction.
Each key on the remote control equipment corresponds to a key value, and the processing module can determine which key is pressed according to the key value; based on the typesetting attributes among the controls, the control view to which the focus should jump when a certain direction key of the remote control device is pressed can be determined, and the identification code of the control view is acquired. The position relationship between the first control and the second control can be determined based on the typesetting attributes among the controls of the application program, and then the moving direction and the moving distance of the focus are determined.
Step S5: and generating a touch operation instruction according to the moving direction and the moving distance of the focus, and inputting the touch operation instruction to the application program.
According to the interaction method, the typesetting attributes among the controls in the user interface layout of the application program are obtained, the initial focus of the application program on the smart television is obtained, the identification codes of the controls in the user interface layout corresponding to the initial focus are confirmed, and when the mobile operation instruction of the remote control device is received, the mobile direction and the distance corresponding to the mobile operation instruction can be obtained and transmitted to the application program, so that the application program can receive the remote control signal of the remote control device and execute the corresponding command, the operation is convenient, and better interaction experience is brought to a user.
According to the interaction method, the sliding distance is not determined according to the key step length, so that when the target content is required to be displayed only by long sliding distance, the situation that the application interface is operated to display the target content by pressing the remote controller for many times does not exist, and the direction key of the remote control device can be controlled through the predicted pressing times (for example, ten rows of posters are provided, the first row of posters is switched to the tenth row of posters, and the past direction key can be switched after 9 times of pressing the direction key is confirmed) so as to select the corresponding control, so that the operation is convenient, and better interaction experience is brought to a user.
The following description will be given taking a remote control operation of one application program in the smart television as an example.
Please refer to fig. 5, which is a schematic diagram of a user interface of an application program on an intelligent television according to an embodiment of the present invention.
For example, nine controls a, b, c, d, e, f, g, h and i are distributed in the current interface of the application program, and the nine controls have certain typesetting attributes. Assuming that the current focus is located at the a control, the length or width of the adjacent b control may be a unit distance; the length or width of the d-control can be one unit distance. Assuming that the current focus is located at the a control, when a 'down' key of the remote control device is pressed twice, determining that the moving direction jumps to a control located below the a control according to a key value of the corresponding 'down' key, and determining that the moving distance jumps to a control located below the a control according to the pressing times; similarly, when the "right" key of the remote control device is pressed once, the moving direction is determined to jump to the control located at the right side of the a control according to the key value of the corresponding "right" key, and the moving distance is determined to jump to the b control located at the right side of the a control according to the pressing times.
In an alternative embodiment, there is a partial focus that is too far away in refreshing the focus. For example: a button A is arranged at the top of the screen, a button B is arranged at the bottom of the screen, the touch event can be directly transmitted through a shortcut key (such as a menu key) of the remote control equipment (the code directly calls a requestfocus () function), and new focus calculation is carried out on a new menu; each sub-item control of the new menu is in linear arrangement, so that records are easy to load and sequential selection is easy to carry out, each time one sub-item control is selected, a focus is moved through an algorithm, and finally when a confirmation key is pressed, the position of the corresponding control of a click screen is simulated; finally, the function that the focus of the mobile phone application without the focus can be controlled by remote control is realized, and the limit of the application per se is broken.
In an optional embodiment, a touch operation instruction is generated according to the moving direction and the moving distance of the focus, and when the touch operation instruction is input to the application program, a focus request command is executed to enable a control corresponding to the position where the current focus is located to present a focus state; the touch operation instruction is an instruction for calling an onclick () function; the focus state may be a visual effect state that a user can see, such as a highlight, a color change, an added frame, or an enlarged view.
In an optional embodiment, after a touch operation instruction is generated according to the moving direction and the moving distance of the focus and is input to the application program, the method further includes the steps of:
acquiring a click operation instruction of the television remote control equipment, acquiring a key value of the television remote control equipment according to the click operation instruction, generating a click touch operation instruction according to the key value, and inputting the click touch operation instruction to the application program; the corresponding control in the application will perform the action corresponding to the click event.
In an optional embodiment, further comprising the step of: setting a white list of mobile phone applications supporting remote control operation, judging whether the currently opened mobile phone applications are contained in the white list, and if not, updating configuration files for the currently opened mobile phone applications; and setting a typesetting attribute corresponding to the currently opened mobile phone application in the configuration file.
The configuration file of the currently opened application program can be stored in an external storage device or can be stored in the cloud of the network server. And if the configuration file of the application program is stored in the external storage device, the television android system receives the insertion information of the external storage device and then automatically detects and updates the insertion information. If the configuration file of the application program is stored in the cloud of the network server, the television android system judges whether the configuration file needs to be updated or not, and if the configuration file needs to be updated, the configuration file is automatically downloaded and updated.
According to the interaction method, the typesetting attributes among the controls in the user interface layout of the application program are obtained, the initial focus of the application program on the smart television is obtained, the identification codes of the controls in the user interface layout corresponding to the initial focus are confirmed, when a moving operation instruction of the remote control device is received, the identification code of the control view corresponding to the current focus can be determined, the moving direction and the distance corresponding to the moving operation instruction are obtained and transmitted to the application program, and therefore the application program only supporting touch screen operation can receive the remote control signal of the remote control device and execute the corresponding command.
The interaction method enables the application program installed on the smart television to receive the control signal of the remote control equipment and execute the corresponding command according to the control signal, is convenient to operate and brings better interaction experience to users. In the process of operating and controlling the application program, the sliding distance is not determined according to the key step length, so that when the display interface needs to slide for a long distance to display the target content, the situation that the direction key of the remote control equipment needs to be pressed for operating and controlling for many times does not exist, the corresponding control can be selected through the predicted pressing times of the direction key of the remote control equipment, and the operation is convenient. In addition, the situation that some controls at the boundary of the application interface cannot be clicked is avoided, and the user has good interaction experience on the smart television.
According to a second aspect of the embodiments of the present invention, an interaction apparatus for a touch screen application to be compatible with remote control operation is also provided.
Please refer to fig. 6, which is a block diagram illustrating a structure of an interaction apparatus for a touch screen application compatible with remote control operation according to an embodiment of the present invention.
The interaction device comprises:
the layout detection module 1 is used for acquiring a user interface layout of the application program on the smart television and identification codes of all controls in the user interface layout through a smart television layout detection tool;
the interactive logic relationship acquisition module 2 is used for acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program and the identification codes of the controls in the user interface layout;
the focus identification module 3 is used for acquiring the position of a focus of an application program on the smart television and determining an identification code of a control in the user interface layout corresponding to the focus;
the focus transfer module 4 is used for acquiring a moving operation instruction of the television remote control equipment and determining the moving direction and the moving distance of the focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls;
and the touch operation instruction generating module 5 is configured to generate a touch operation instruction according to the moving direction and the moving distance of the focus, and input the touch operation instruction to the application program.
It should be noted that, when the interaction apparatus provided in the foregoing embodiment executes the above interaction method, only the division of the functional modules is illustrated, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the interaction device provided by the above embodiment and the interaction method embodiment in which the touch screen application is compatible with the remote controller operation belong to the same concept, and the detailed process is shown in the embodiment and is not described herein again.
According to a third aspect of the embodiment of the invention, a smart television is further provided.
Please refer to fig. 7, which is a schematic structural diagram of an intelligent television according to an embodiment of the present invention.
The intelligent television 100 comprises a processor 101, a memory 102 and a display screen 103; the memory 102 and the display screen 103 are electrically connected with the processor through a communication bus; the memory 102 stores a computer program, the computer program is suitable for being loaded by the processor 101 and executing the interaction method compatible with the remote controller operation of the touch screen application, and generates a television interface display signal to be transmitted to the display screen 103; the display screen 103 receives a television interface display signal to display corresponding interface content.
According to a fourth aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the method for interaction of touch screen application compatible remote controller operations as described above.
By applying the technical scheme, based on the interactive logic relation of the application program, the control signal of the remote control device can be received, the corresponding focus moving direction and moving distance are obtained, the corresponding touch operation instruction is transmitted to the application program according to the focus moving direction and the moving distance, and meanwhile, the position of the focus is refreshed, so that the application program only supporting touch screen control can receive the control signal of the remote control device, execute the corresponding command, is convenient to operate, and brings better interactive experience to a user.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The examples only express a few embodiments of the invention, and the description is more specific and detailed, but not understood as the limitation of the invention patent scope. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
Claims (11)
1. An interaction method for touch screen application compatible with remote controller operation is characterized in that: the method comprises the following steps:
acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout by a smart television layout detection tool;
acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout;
acquiring the position of a focus of an application program on the smart television, and determining an identification code of a control in the user interface layout corresponding to the focus;
acquiring a moving operation instruction of the television remote control equipment, and determining the moving direction and the moving distance of a focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls; the method comprises the following steps:
acquiring an initial focus of an application program on the smart television, determining a control corresponding to the initial focus as a first control, and acquiring a first identification code of the first control;
receiving a moving operation instruction of television remote control equipment;
acquiring a key value of the television remote control equipment and the pressing times of a key corresponding to the key value according to the mobile operation instruction, and determining a second control corresponding to a new focus of an application program on the smart television according to the key value, the pressing times, a first identification code of a first control and the typesetting attributes among the controls; the typesetting attributes are the position and direction relations among all controls in the user interface layout of the application program;
determining the moving direction and the moving distance of the focus according to the position relation between the first control and the second control, wherein the length or the width of the control is a unit distance;
and generating a touch operation instruction according to the moving direction and the moving distance of the focus, and inputting the touch operation instruction to the application program.
2. The method for interacting operations of a touch screen application compatible with a remote control according to claim 1, wherein: the layout detection tool of the television android system is a view hierarchical structure analysis tool.
3. The method for interacting the touch screen application compatible with the operation of the remote controller according to claim 2, wherein: the method comprises the following steps of obtaining a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout through a smart television layout detection tool, wherein the method comprises the following steps:
when an opened application program on the smart television enters an interface needing focus processing, connecting to each display interface of the application program through an android phone auxiliary tool;
capturing each display interface of the application program through a view hierarchical structure analysis tool to obtain the user interface layout of each display interface of the application program;
and acquiring the identification codes of the controls from the user interface layout of each display interface of the application program.
4. The method for interacting operations of a touch screen application compatible with a remote control according to claim 1, wherein: the typesetting attributes are the position and direction relations among all controls in the user interface layout of the application program.
5. The method for interacting the touch screen application compatible with the operation of the remote controller according to claim 1, wherein: the direction of movement comprises a first direction of movement; the movement distance comprises a first movement distance corresponding to the first movement direction; or, the moving direction includes a first moving direction and a second moving direction perpendicular to the first moving direction, and the moving distance includes a first moving distance corresponding to the first moving direction and a second moving distance corresponding to the second moving direction.
6. The method for interacting the touch screen application compatible with the operation of the remote controller according to claim 1, wherein: and generating a touch operation instruction according to the moving direction and the moving distance of the focus, and executing a focus request command to enable the icon of the control corresponding to the position of the current focus to present a focus state when the touch operation instruction is input to the application program.
7. The method for interacting the touch screen application compatible with the operation of the remote controller according to claim 1, wherein: generating a touch operation instruction according to the moving direction and the moving distance of the focus, and inputting the touch operation instruction into the application program, and further comprising the following steps:
and acquiring a click operation instruction of the television remote control equipment, acquiring a key value of the television remote control equipment according to the click operation instruction, generating a click touch operation instruction according to the key value, and inputting the click touch operation instruction to the application program.
8. The method for interacting the touch screen application compatible with the operation of the remote controller according to claim 1, wherein: further comprising the steps of: setting a white list of an application program supporting remote control operation, judging whether the currently opened application program is contained in the white list, and if not, updating a configuration file for the currently opened application program; and setting a typesetting attribute corresponding to the currently opened application program in the configuration file.
9. An interaction device compatible with remote controller operation for touch screen application is characterized in that: the method comprises the following steps:
the layout detection module is used for acquiring a user interface layout of an application program on the smart television and identification codes of all controls in the user interface layout through a smart television layout detection tool;
the interactive logic relationship acquisition module is used for acquiring the typesetting attributes among the controls in the user interface layout according to the user interface layout of the application program on the smart television and the identification codes of the controls in the user interface layout;
the focus identification module is used for acquiring the position of a focus of an application program on the smart television and determining an identification code of a control in the user interface layout corresponding to the focus;
the focus transfer module is used for acquiring a moving operation instruction of the television remote control equipment and determining the moving direction and the moving distance of a focus according to the moving operation instruction, the identification codes of the controls and the typesetting attributes among the controls; the method comprises the following steps:
acquiring an initial focus of an application program on the smart television, determining a control corresponding to the initial focus as a first control, and acquiring a first identification code of the first control;
receiving a moving operation instruction of television remote control equipment;
acquiring a key value of the television remote control equipment and the pressing times of a key corresponding to the key value according to the mobile operation instruction, and determining a second control corresponding to a new focus of an application program on the smart television according to the key value, the pressing times, a first identification code of a first control and the typesetting attributes among the controls; the typesetting attribute is the position and direction relation among all controls in the user interface layout of the application program;
determining the moving direction and the moving distance of the focus according to the position relation between the first control and the second control, wherein the length or the width of the control is a unit distance;
and the touch operation instruction generating module is used for generating a touch operation instruction according to the moving direction and the moving distance of the focus and inputting the touch operation instruction into the application program.
10. An intelligent television is characterized in that: the device comprises a processor, a memory and a display screen; the memory and the display screen are electrically connected with the processor through a communication bus; wherein the memory stores a computer program adapted to be loaded by the processor and execute the method for interaction compatible with remote control operation of a touch screen application according to any one of claims 1 to 8, and generate a television interface display signal to be transmitted to a display screen; and the display screen receives the television interface display signal and displays corresponding interface content.
11. A computer-readable storage medium characterized by: a computer program stored thereon, which when executed by a processor implements the method for interaction of touch screen application compatible remote control operations according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011153806.6A CN112449227B (en) | 2020-10-26 | 2020-10-26 | Interaction method and device for touch screen application compatible with remote controller operation and smart television |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011153806.6A CN112449227B (en) | 2020-10-26 | 2020-10-26 | Interaction method and device for touch screen application compatible with remote controller operation and smart television |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112449227A CN112449227A (en) | 2021-03-05 |
| CN112449227B true CN112449227B (en) | 2022-09-20 |
Family
ID=74736146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011153806.6A Active CN112449227B (en) | 2020-10-26 | 2020-10-26 | Interaction method and device for touch screen application compatible with remote controller operation and smart television |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112449227B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113365125A (en) * | 2021-05-31 | 2021-09-07 | 北京字节跳动网络技术有限公司 | Terminal control method and device, terminal and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110557666A (en) * | 2019-07-23 | 2019-12-10 | 广州视源电子科技股份有限公司 | remote control interaction method and device and electronic equipment |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10349109B2 (en) * | 2011-06-20 | 2019-07-09 | Enseo, Inc. | Television and system and method for providing a remote control device |
| CN102331906A (en) * | 2011-09-13 | 2012-01-25 | Tcl集团股份有限公司 | Method for operating intelligent equipment and intelligent equipment |
| CN102984569A (en) * | 2012-11-29 | 2013-03-20 | 中兴通讯股份有限公司 | Method, device and system for controlling television interface focus |
| CN104104984B (en) * | 2014-07-31 | 2015-12-30 | 合一网络技术(北京)有限公司 | Focus control method and device thereof |
| CN105451051A (en) * | 2014-08-27 | 2016-03-30 | 深圳市启望科文技术有限公司 | Key remote control and method for controlling electronic device by use of key remote control |
| CN106201155B (en) * | 2015-04-30 | 2019-09-17 | Tcl光电科技(惠州)有限公司 | Method for displaying user interface and system |
| CN107797732A (en) * | 2016-09-07 | 2018-03-13 | 中兴通讯股份有限公司 | A kind of application control method and device |
| CN109963182A (en) * | 2017-12-26 | 2019-07-02 | 深圳Tcl数字技术有限公司 | A kind of compatible input method of remote controler, system, storage medium and television set |
| CN111488109A (en) * | 2020-04-17 | 2020-08-04 | 上海闻泰信息技术有限公司 | Method, device, terminal and storage medium for acquiring control information of user interface |
-
2020
- 2020-10-26 CN CN202011153806.6A patent/CN112449227B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110557666A (en) * | 2019-07-23 | 2019-12-10 | 广州视源电子科技股份有限公司 | remote control interaction method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112449227A (en) | 2021-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108132744B (en) | Method and equipment for remotely controlling intelligent equipment | |
| CN103049190B (en) | A kind of method of mobile communication terminal and control appliance operation | |
| CN103729065A (en) | System and method for mapping touch operations to entity keys | |
| CN106201219A (en) | The quick call method of function of application and system | |
| CN111193960B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| CN101930336B (en) | Information processing apparatus, method for controlling display, and computer-readable recording medium | |
| JP2016500175A (en) | Method and apparatus for realizing floating object | |
| KR102004986B1 (en) | Method and system for executing application, device and computer readable recording medium thereof | |
| CN114157889B (en) | Display equipment and touch control assisting interaction method | |
| CN113784200A (en) | Communication terminal, display device and screen projection connection method | |
| CN112449227B (en) | Interaction method and device for touch screen application compatible with remote controller operation and smart television | |
| CN111078113A (en) | Sidebar editing method, mobile terminal and computer-readable storage medium | |
| CN111586463B (en) | Display device | |
| CN112199124B (en) | Project opening method and device and display equipment | |
| CN103473170A (en) | Test system and test method | |
| CN110719514A (en) | Equipment control method and system and terminal | |
| US20240211049A1 (en) | Remote control system | |
| CN112199560B (en) | Search method of setting items and display equipment | |
| CN113573115B (en) | Method for determining search characters and display device | |
| CN111857936B (en) | User interface display method and display device of application program | |
| CN112929717B (en) | Focus management method and display device | |
| CN109857314B (en) | Gesture control method and device for screen equipment | |
| CN107765956B (en) | User interface editing method, device, terminal and computer readable storage medium | |
| CN113835605B (en) | Dial display control method and device, wearable device and storage medium | |
| CN109542312B (en) | Signal processing method and device and touch equipment applying same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |