CN111625169B - Method for browsing webpage by remote controller and display equipment - Google Patents
Method for browsing webpage by remote controller and display equipment Download PDFInfo
- Publication number
- CN111625169B CN111625169B CN202010470875.3A CN202010470875A CN111625169B CN 111625169 B CN111625169 B CN 111625169B CN 202010470875 A CN202010470875 A CN 202010470875A CN 111625169 B CN111625169 B CN 111625169B
- Authority
- CN
- China
- Prior art keywords
- remote controller
- focusable
- key value
- controller key
- dom tree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
Abstract
The application discloses a method for browsing a webpage by using a remote controller and display equipment, which are used for achieving the purpose of controlling webpage elements by simulating a keyboard through the remote controller when a webpage which does not support a keyboard control mode is browsed in a browser of the display equipment. The method comprises the following steps: determining a display focus at a first position where a first focusable element is located in a webpage displayed based on a complete element DOM tree corresponding to the webpage file, wherein the first focusable element is an element in a self-defined focusable element DOM tree; receiving a remote controller key value input by a user, if the remote controller key value corresponds to a direction key, determining a response action corresponding to the remote controller key value according to a preset corresponding relation between the remote controller key value and the response action, wherein the response action corresponds to at least one keyboard key value, executing the response action, and switching the focus from a first position corresponding to the first focusable element to a second position corresponding to the second focusable element.
Description
Technical Field
The present application relates to the field of display technologies, and in particular, to a method for browsing a web page by using a remote controller and a display device.
Background
Generally, two methods can be adopted for browsing web pages on a computer:
one is to operate the web page using a mouse control mode. Basically, all web pages support mouse control, for example, a web page can support operations such as left click, right click, left double click, right double click, dragging, and mouse wheel scrolling. This is also the way most users typically browse web pages.
Another is to operate the web page using a keyboard control mode. Only a very small portion of the web pages can support keyboard control. For example, the web page may support up, down, left, and right directional keys of a keyboard to switch focusing on different web page elements, support an Enter key of the keyboard to trigger event responses on web page elements, and so on. Web page support of keyboard control mode requires the web page JavaScript code to have the relevant logical treatment of the keyboard keys.
Most of the smart televisions on the current market are integrated with a browser, and a user can use the browser on the television to watch a webpage. When a user operates a web page through a remote controller, most of the web pages can only support a mouse control mode to operate the web page, so that the remote controller needs to be simulated into the mouse control mode to operate the web page. However, the actual remote controller is operated in a manner different from the actual mouse operation manner, for example, the direction keys of the remote controller cannot realize continuous cursor scrolling in any direction, and accurately position the mouse operation effect of the cursor on the designated web page element. Therefore, in the web page which does not support the keyboard control mode, the operation process of browsing the web page through the remote controller is very complicated, the humanization is not enough, and the user experience is very poor. Therefore, the user can generate conflict psychology for browsing the webpage through the remote controller, and the use frequency of the television browser is reduced.
Disclosure of Invention
In view of this, the present application provides a method for browsing a web page by using a remote controller and a display device, so as to achieve the purpose of controlling web page elements by using a keyboard simulated by the remote controller when browsing a web page that does not support a keyboard control mode in a browser of the display device.
Specifically, the method is realized through the following technical scheme:
in a first aspect, the present application provides a display device comprising:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module to:
determining a focus to be displayed at a first position of a first focusable element in a pre-created self-defined focusable element DOM tree in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements which are adaptive to a keyboard control mode in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a direction key, determining a response action of the keyboard key value corresponding to the remote controller key value according to a corresponding relation between a preset remote controller key value and a response action of the keyboard key value, wherein the response action corresponds to at least one keyboard key value, executing the response action, and switching the focus from a first position corresponding to the first focusable element to a second position corresponding to a second focusable element in the user-defined focusable element DOM tree.
In a second aspect, the present application provides a display device comprising:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module to:
determining a focus to be displayed at a first position of a first focusable element in a pre-created self-defined focusable element DOM tree in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements which are adaptive to a keyboard control mode in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a confirmation key, triggering an event response bound on the first focusable element.
In a third aspect, the present application provides a display device comprising:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module to:
displaying a webpage based on a complete element DOM tree corresponding to a webpage file, and determining a first position display focus of a first focusable element in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
if the remote controller key corresponding to the remote controller key value is a direction key, determining a response action of the keyboard key value corresponding to the remote controller key value according to a preset corresponding relation between the remote controller key value and the response action of the keyboard key value;
and determining a target focusable element in the response action, wherein the target focusable element is a custom focusable element which is adapted to a keyboard control mode, and executing the response action to switch the focus from a first position corresponding to the first focusable element to a second position corresponding to the target focusable element.
In a fourth aspect, the present application provides a method for browsing a webpage by using a remote controller, where the method includes:
determining a focus to be displayed at a first position of a first focusable element in a pre-created self-defined focusable element DOM tree in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements which are adaptive to a keyboard control mode in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a direction key, determining the response action of the keyboard key value corresponding to the remote controller key value according to the corresponding relation between the preset remote controller key value and the response action of the keyboard key value, executing the response action, and switching the focus from the first position corresponding to the first focusable element to the second position corresponding to the second focusable element in the user-defined focusable element DOM tree.
In a fifth aspect, the present application provides a method for browsing a webpage by using a remote controller, where the method includes:
determining a focus to be displayed at a first position of a first focusable element in a pre-created self-defined focusable element DOM tree in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements which are adaptive to a keyboard control mode in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a confirmation key, triggering an event response bound on the first focusable element.
In a sixth aspect, the present application provides a method for browsing a webpage by using a remote controller, where the method includes:
displaying a webpage based on a complete element DOM tree corresponding to a webpage file, and determining a first position display focus of a first focusable element in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
if the remote controller key corresponding to the remote controller key value is a direction key, determining a response action of the keyboard key value corresponding to the remote controller key value according to a preset corresponding relation between the remote controller key value and the response action of the keyboard key value;
and determining a target focusable element in the response action, wherein the target focusable element is a custom focusable element which is adapted to a keyboard control mode, and executing the response action to switch the focus from a first position corresponding to the first focusable element to a second position corresponding to the target focusable element.
In the above embodiment, the display device may determine, according to a pre-stored correspondence between a preset remote controller key value and a response action of a keyboard key value, a response action corresponding to the remote controller key value input by a user, and determine, from a custom focusable element adapted to the keyboard control mode, a focusable element that needs to be responded, so as to execute the response action, that is, switch the focused element by a remote controller direction key, and trigger an event corresponding to element response by a remote controller confirmation key. Therefore, when a user uses the remote controller to browse the webpage which does not support the keyboard control mode, the remote controller can still simulate the keyboard control mode to operate the webpage, the user operation is simplified, and the user experience when the webpage is operated through the remote controller is greatly improved.
Drawings
Fig. 1A schematically illustrates an operation scenario between the display device 200 and the control 100;
fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;
fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;
a block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D.
Fig. 2 is a flowchart illustrating a remote controller browsing a web page according to a first embodiment of the present application;
FIG. 3 is a flow chart illustrating the filtering of custom focusable elements of the first embodiment;
FIG. 4 is a diagram illustrating an arrow cursor-to-hand cursor;
fig. 5A is a schematic diagram illustrating a first interface provided by the display device 200;
a schematic diagram of a second interface provided by the display device 200 is exemplarily shown in fig. 5B;
a schematic diagram of a third interface provided by the display device 200 is exemplarily shown in fig. 5C;
fig. 6 is a flowchart illustrating a remote controller browsing a web page according to a second embodiment of the present application;
fig. 7 is a specific flowchart illustrating the browsing of web pages by a remote controller according to a second embodiment of the present application;
a detailed flowchart for displaying the default focus of a web page in accordance with a second embodiment of the present application is illustrated in fig. 8.
Detailed Description
To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
The terms "comprises" and "comprising," and any variations thereof, as used herein, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.
Fig. 1A is a schematic diagram illustrating an operation scenario between the display device 200 and the control apparatus 100. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.
Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.
The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.
For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
The display apparatus 200 may be implemented as a television, and may provide an intelligent network television function of a broadcast receiving television function as well as a computer support function. Examples of the display device include a digital television, a web television, a smart television, an Internet Protocol Television (IPTV), and the like.
The display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device. The specific display device type, size, resolution, etc. are not limited.
The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.
Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.
And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.
The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.
The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.
The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.
And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.
A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may further include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio input interface 285, and a power supply 290.
The tuner demodulator 210 receives a broadcast television signal by wire or wirelessly, may perform modulation/demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate an audio/video signal and additional information (e.g., EPG data) carried in a frequency of a television channel selected by a user from a plurality of wireless or wire broadcast television signals.
The tuner demodulator 210 is responsive to the frequency of television channels selected by the user and to television signals carried thereby, as selected by the user and controlled by the controller 250.
The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.
In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.
The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.
The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include an image collector 231, such as a camera, a video camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user. A light receiver 232 may also be included to collect ambient light intensity to adapt to changes in display parameters of the display device 200, etc.
In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.
In some other exemplary embodiments, the detector 230, which may further include a sound collector, such as a microphone, may be configured to receive a sound of a user, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.
The external device interface 240 is a component for providing the controller 210 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.
The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.
The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.
The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.
A graphic processor 253 for generating screen images of various graphic objects such as icons, images, and operation menus. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.
A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.
In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.
The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.
The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to an icon. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a user uttering voice.
A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.
In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.
In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, external data (e.g., audio-visual data) received from the external device interface, or user data (e.g., key information, voice information, touch information, and the like) received from the user interface.
In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.
A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.
The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer and are responsible for direct interaction with users. The application layer may include a plurality of applications such as NETFLIX applications, setup applications, media center applications, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML, Cascading Style Sheets (CSS), and JavaScript.
Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.
CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.
JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,
the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.
The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..
A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.
Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.
The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.
Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.
And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
And a display 275 for receiving the image signal from the output of the video processor 270 and displaying video, images and menu manipulation interfaces. For example, the display may display video from a broadcast signal received by the tuner demodulator 210, may display video input from the communicator 220 or the external device interface 240, and may display an image stored in the memory 260. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.
And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.
The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.
Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.
Audio output interface 285 receives audio signals from the output of audio processor 280. For example, the audio output interface may output audio in a broadcast signal received via the tuner demodulator 210, may output audio input via the communicator 220 or the external device interface 240, and may output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287, such as an earphone output terminal, that outputs to a generating device of an external device.
In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.
And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.
And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.
In some embodiments, two ways can be generally adopted when browsing a webpage on a computer side:
first, the web page is operated using a mouse control mode. Basically, all web pages support a mouse control mode, for example, the web pages can support operations such as left click, right click, left double click, right double click, dragging, mouse wheel scrolling and the like. This is also the way most users typically browse web pages.
Second, the web page is operated using the keyboard control mode. Only a very small portion of the web pages can support the keyboard control mode. For example, the web page may support up, down, left, and right directional keys of a keyboard to switch focusing on different web page elements, support an Enter key of the keyboard to trigger event responses bound to the web page elements, and the like. Web page support of keyboard control mode requires the web page JavaScript code to have the relevant logical treatment of the keyboard keys.
When a user operates a web page through a remote controller, the remote controller needs to be simulated into a mouse control mode or a keyboard control mode to operate the web page, wherein:
if so, the remote controller simulates a mouse control mode to operate the webpage. The up, down, left and right direction keys of the remote controller are mapped to the movement operation of the mouse, the OK key of the remote controller is mapped to the left mouse key, and the web page is operated by simulating the movement of the mouse. The actual remote controller operation mode is different from the actual mouse operation mode, so that the experience of simulating the mouse operation by the remote controller is poor.
For example, when the user actually operates the mouse, the mouse can be continuously scrolled in any direction, so that the cursor can be accurately positioned on a certain webpage element. However, when the direction keys of the remote controller are used for simulating the mouse, the movement of the mouse in four directions, namely up, down, left and right, can be simulated. In addition, each time the direction key is pressed, the cursor can only move for a short fixed distance, and the direction key is required to be continuously pressed for many times when the cursor moves to the specified position, and elements in the webpage cannot be accurately positioned. Therefore, the operation mode of simulating the mouse by the remote controller is very complicated and clumsy when browsing a webpage, is not humanized enough, and has poor user experience.
If the remote controller simulates the keyboard control mode to operate the webpage. When a user operates the webpage by using the remote controller, the remote controller can be used for conveniently switching and focusing different webpage elements to operate the webpage only by mapping the up, down, left and right direction keys of the remote controller into the up, down, left and right direction keys of the keyboard and mapping the OK key of the remote controller into the Enter key of the keyboard. When the remote controller simulates a keyboard control mode to operate the webpage, the user experience is good, and the operation is humanized. However, since only a few web pages support the keyboard control mode, this operation mode can only be applied to individual web pages, and cannot form a general solution.
In view of the above-mentioned problems, the present application provides a method for browsing a webpage by using a remote controller and a display device, so that when a user browses a webpage which does not support a keyboard control mode by using the remote controller, the remote controller can still simulate the keyboard control mode to operate the webpage, and user experience when the webpage is operated by using the remote controller is greatly improved. See the following examples for specific embodiments.
In a first embodiment, the present application provides a display device, and in particular, some components in the display device may further specifically perform the following operations:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module, configured to perform the operation steps shown in fig. 2:
in the present embodiment, a web page file (e.g., HTML file) is composed of many different types of web page elements (hereinafter, referred to as elements) which form a DOM (Document Object Model) tree according to a certain nesting relationship. Each element is a node on the DOM tree. The browser module of the display device may parse the web page file to obtain a DOM tree of complete elements corresponding to the web page file, where the complete elements refer to all web page elements in the web page file. The current web page is then displayed based on the DOM tree of the complete element.
It should be noted that there are many types of elements in the DOM tree of the complete element. Elements can be classified into two categories according to whether the element can focus or not: focusable elements and non-focusable elements.
Focus-enabled web page elements include < input > elements, < a > elements, and elements with a tabindex attribute, etc.
The unfocused web page elements include a < div > element, a < span > element, and a < title > element, etc.
Generally, the focusable element must be responsive to a mouse click event or a keyboard event. For example, the < input > element may respond to a keyboard entry event and the < a > element may respond to a mouse click event.
The non-focusable elements are generally not responsive to keyboard events. But possibly in response to a mouse event. Whether an unfocused element can respond to a mouse click event is related to whether the web page JavaScript code corresponding to the element supports mouse click events. For example, the < div > element is unfocusable, but if the user clicks the area where the < div > element is located through a mouse, if the web page JavaScript code judges that the mouse click position of the user is in the area where the < div > element is located, the JavaScript code can still trigger a mouse click event response.
Therefore, when the browser module displays the web page, the browser module may parse the web page file to obtain parameter information of all elements in the web page file, that is, the parameter information of all elements including the focusable element and the unfocusable element, where the parameter information may include position coordinates, sizes, and other attribute parameters of the elements.
And then screening out custom focusable elements from all the elements based on the parameter information of the elements, wherein the custom focusable elements at least comprise: an element having a focusable function and a specified element.
The elements having a focusable function, that is, the focusable elements described above, such as < input > element, < a > element, and an element having a tabindex attribute, and the like.
The specified element is a visible element that has no focusable function, but has a mouse arrow cursor switching to a hand cursor function, and the position and size are the first appearing elements.
The specific process of determining the above-mentioned custom focusable element is shown in fig. 3, which includes:
such as < input > elements, < a > elements, and elements having a tabindex attribute, etc., may be used as focusable elements.
if the element is a webpage element with a style attribute of cursor pointer, the element is an element with a function of switching a mouse arrow cursor into a hand cursor. As shown in fig. 4, when the arrow cursor is at a certain distance from the element, the certain distance is guaranteed not to trigger the event that the arrow cursor becomes a hand cursor, so this time it is displayed as the arrow cursor on the left side of fig. 4. When the cursor focus hovers over this element, an event that the arrow cursor becomes a hand cursor is triggered, and thus the arrow cursor becomes a hand cursor, prompting the user that a mouse left click action can be performed, as shown on the right side of fig. 4. It is stated that web page elements with style ═ cursor pointer attribute have JavaScript code associated therewith to handle response to mouse click events.
the attribute feature of the invisible web page element is an element with a hidden-attribute.
if the web page element has no hidden attribute, but the height or width of the element is 0, the element still belongs to the invisible element and needs to be removed.
307, judging whether the coordinates and the sizes of the current elements appear for the first time, if so, turning to 303; if not, go to step 308;
And in the screened custom focusable elements, elements with the same coordinate and size need to be rejected, and only one element is reserved. This is to prevent repeated triggering of a click event.
The above-mentioned screening process is an exemplary screening process for screening out elements responding to keyboard control patterns, and is only one of screening schemes, and the actual screening mechanism may depend on actual situations.
The original focusable elements and the elements which cannot be focused but can respond to the mouse click event are screened out by the self-defined screening method, and combined together to construct a self-defined focusable element DOM tree responding to the keyboard control mode, so that the focusable elements in the self-defined focusable element DOM tree responding to the keyboard control mode can support the keyboard control mode.
If the webpage is displayed for the first time, a default focus can be displayed in the webpage, and the default focus is located at a specific focusable element in the DOM tree of the custom focusable element, for example, the specific focusable element can be a focusable element in the upper left corner of the webpage, and the specific focusable element is the first focusable element. And if the webpage is not displayed for the first time, directly acquiring the focusable element corresponding to the current focus as the first focusable element.
in this embodiment, the browser module may monitor a remote control key value input by a user through a user interface, and then determine a remote control key corresponding to the remote control key value in a correspondence between the locally stored remote control key value and the remote control key, for example, a direction key corresponding to the remote control key value 19 is an up key.
because the direction key of the remote controller is different from the key value of the remote controller corresponding to the confirmation key, whether the remote controller key triggered by the user is the direction key or the confirmation key can be determined based on the key value of the remote controller.
And 204, if the user equipment is a direction key, determining a response action of a keyboard key value corresponding to a remote controller key value according to a preset corresponding relation between the remote controller key value and the response action of the keyboard key value, executing the response action, and switching the focus from a first position corresponding to the first focusable element to a second position corresponding to a second focusable element in the user-defined focusable element DOM tree.
The browser module may preset a corresponding relationship between a remote controller key value and a response action of a keyboard key value, for example, the keyboard ASCII code value corresponding to the remote controller key value 19 is 38, and the corresponding keyboard key value response action is to switch the focus to the above closest focusable element.
And the browser module executes the response action and switches the focus from a first position corresponding to the first focusable element to a second position corresponding to a second focusable element in the self-defined focusable element DOM tree. The method specifically comprises the following steps: and determining the indication direction of a direction key corresponding to the remote controller key value, and then determining that the second position is the position of an element which is next to the first position in the indication direction and belongs to a self-defined focusable element DOM tree. And finally, switching the focus in the webpage from a first position corresponding to the first focusable element to a second position corresponding to the second focusable element.
For example, as shown in FIG. 5A, the current display interface displays a web page, which includes a plurality of focusable elements, such as elements 1-5. The focus is shown at element 1, i.e. the grey-colored wire frame outside element 1, then element 1 is the first focusable element. When a user presses an upward direction key through a remote controller, the browser module receives a remote controller key value 19 corresponding to the upward direction key, and then switches the focus to the nearest focusable element according to the corresponding relation between the remote controller key value and the response action of the keyboard key value, namely the keyboard ASCII code value corresponding to the remote controller key value 19 is 38, and the corresponding response action is to determine that the focus is switched to the nearest focusable element.
Based on the DOM tree of custom focusable elements responsive to the keyboard control schema, it is determined that the next focusable element closest in an upward direction to the first focusable element (i.e., element 1) is element 2, and thus element 2 can be determined to be the second focusable element. Thereby switching the focus in the web page from the first focusable element (i.e., element 1) to the location of the target focusable element (i.e., element 2), as shown in fig. 5B.
As shown in fig. 5C, if the existing web page supporting the mouse control mode is configured such that the element where the focus (the arrow pointer at position 1) of the mouse is located is the first focusable element, for example, element 1, and also receives the up direction key of the remote controller, that is, the remote controller key value 19, according to the mouse control mode, the focus at element 1 is moved up by a small fixed distance, and the moved focus (that is, the arrow pointer at position 2) is located at a position between element 1 and element 2, so that the focus cannot be directly switched to element 2.
Compared with the prior art, the method and the device have the advantages that when the webpage does not support the keyboard control mode, the remote controller can simulate the keyboard to control the webpage, and the focus can be quickly switched through the direction keys.
And step 205, if the button is a confirmation button, triggering an event response bound on the first focusable element.
If it is a confirmation key, also called remote control OK key, an event response bound on said first focusable element is triggered. Specifically, an event bound by the first focusable element may be acquired; if the first event is triggered by clicking the left mouse button, triggering a first focusable element to respond to the first event; the first event may be triggered by a mouse click event "onclick"; and if the second event is triggered by the Enter key of the keyboard, triggering the first focusable element to respond to the second event, wherein the second event can be triggered by the key pressing event 'onkeydown'.
In a second embodiment, the present application provides another display device, and specifically, some components in the display device may further specifically perform the following operations:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module, configured to perform the operation steps shown in fig. 6:
601, displaying a webpage based on a complete element DOM tree corresponding to a webpage file, and determining a first position display focus of a first focusable element in the complete element DOM tree;
in this embodiment, the browser module may display a web page based on a DOM tree of a complete element corresponding to the web page file, and determine that a display focus is located at a first position of a first focusable element in the DOM tree of the complete element. And the user-defined focusable elements do not need to be screened, and a DOM tree of the user-defined focusable elements does not need to be created.
in this embodiment, the determining of the target focusable element in the response action corresponding to the remote controller key value specifically includes first determining that a next element closest to the first focusable element in the direction of the direction key corresponding to the remote controller key value is a target element. As shown in fig. 5A, if the user presses the remote controller up direction key, the browser module may determine, according to the remote controller key value, that the next element closest to the first focusable element (i.e., element 1) in the up direction is element 2, and thus may determine that element 2 is the target element.
Then, judging whether the target element is a custom focusable element, wherein the custom focusable element at least comprises: an element having a focusable function and a specified element which is a visible element having no focusable function but having a mouse arrow cursor function switched to a hand cursor function, and whose position and size are elements appearing for the first time; if yes, determining the target element as a target focusable element; if not, determining that the next element of the target elements is a new target element, for example, searching the element with the closest distance above the element 2, and repeatedly executing the operation of judging whether the target element is the user-defined focusable element until the target focusable element is determined.
And 605, if the button is a confirmation button, triggering an event response bound on the first focusable element.
Specifically, the browser module may obtain an event to which the first focusable element binds; if the first event is triggered by clicking the left mouse button, triggering a first focusable element to respond to the first event; and if the second event is triggered by the Enter key of the keyboard, triggering the first focusable element to respond to the second event.
For example, a specific processing procedure of the second embodiment is shown in fig. 7, which includes:
the parameter information includes, but is not limited to, position coordinates, width, height, attribute information, etc. of the element.
it should be noted that, when a web page is displayed for the first time, a default focus may be displayed in the web page, and methods for displaying the default focus may include the following two methods:
first, a specific focusable element is determined in the DOM tree of the complete element, for example, the focusable element at the upper left corner in the DOM tree of the complete element is designated as the element corresponding to the default focus, and the default focus is displayed at the position of the focusable element.
And secondly, selecting any element in the DOM tree of the complete element as an element corresponding to the undetermined default focus, and then determining whether the element can be used as the element corresponding to the default focus by judging whether the element belongs to a self-defined focusable element. The specific determination process is shown in fig. 8, which includes:
for example, the element in the top left corner of the DOM tree specifying the complete element.
step 808, the next element closest to the element is filtered, and step 802 is executed.
Through the above process, the element position corresponding to the default focus can be further determined based on the standard of the custom focusable element, so that the default focus of the webpage is located on the custom focusable element.
step 715, triggering the current focusable element to respond to the keyboard Enter event;
In the above embodiment, the display device may determine, according to a preset correspondence between a remote controller key value and a keyboard key value and a response action, a response action corresponding to the remote controller key value input by the user, and determine, from the user-defined focusable elements responding to the keyboard control mode, a focusable element that needs to be responded, so as to execute the response action, that is, switch the focused element by using a remote controller direction key, and trigger an event corresponding to element response by using a remote controller confirmation key. Therefore, when a user uses the remote controller to browse the webpage which does not support the keyboard control mode, the remote controller can still simulate the keyboard control mode to operate the webpage, the user operation is simplified, and the user experience when the webpage is operated through the remote controller is greatly improved.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include such modifications and variations.
Claims (7)
1. A display device, comprising:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module to perform:
in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, determining a first position of a first focusable element in a pre-created self-defined focusable element DOM tree to display a focus, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements in the complete element DOM tree which are adapted to a keyboard control mode, and at least comprises: an element having a focusable function and a specified element which is a visible element having no focusable function but having a mouse arrow cursor function switched to a hand cursor function, and whose position and size are elements appearing for the first time;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a direction key, determining the response action of the keyboard key value corresponding to the remote controller key value according to the corresponding relation between the preset remote controller key value and the response action of the keyboard key value, executing the response action, and switching the focus from the first position corresponding to the first focusable element to the second position corresponding to the second focusable element in the user-defined focusable element DOM tree.
2. The display device of claim 1, wherein the method of creating a custom focusable element (DOM) tree comprises:
acquiring parameter information of all elements in a DOM tree of a complete element in a webpage file;
screening the self-defined focusable elements from all the elements based on the parameter information of all the elements;
and creating the DOM tree based on the custom focusable element.
3. The display device of claim 1, wherein said performing the responsive action to switch the focus from a first position corresponding to the first focusable element to a second position corresponding to a second focusable element in the custom focusable element DOM tree, comprises:
determining the indication direction of a direction key corresponding to the key value of the remote controller;
the second position is the position of the next focusable element of the first position in the indicated direction.
4. A display device, comprising:
a display;
a user interface for receiving user input;
the network module is used for downloading the webpage file;
a browser module to:
in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, determining a first position of a first focusable element in a pre-created self-defined focusable element DOM tree to display a focus, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements in the complete element DOM tree which are adapted to a keyboard control mode, and at least comprises: an element having a focusable function and a specified element which is a visible element having no focusable function but having a mouse arrow cursor function switched to a hand cursor function, and whose position and size are elements appearing for the first time;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a confirmation key, triggering an event response bound on the first focusable element.
5. The display device of claim 4, wherein the triggering of the event response bound to the first focusable element specifically comprises:
acquiring an event bound by the first focusable element;
if the first event is triggered by clicking the left mouse button, triggering a first focusable element to respond to the first event;
and if the keyboard Enter key triggers a second event, triggering the first focusable element to respond to the second event.
6. A method for browsing web pages by a remote controller, the method comprising:
determining a focus to be displayed at a first position of a first focusable element in a pre-created self-defined focusable element DOM tree in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements which are adaptive to a keyboard control mode in the complete element DOM tree;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
if the remote controller key corresponding to the remote controller key value is a direction key, determining a response action of the keyboard key value corresponding to the remote controller key value according to a corresponding relation between a preset remote controller key value and a response action of the keyboard key value, executing the response action, and switching the focus from a first position corresponding to the first focusable element to a second position corresponding to a second focusable element in the user-defined focusable element DOM tree, wherein the user-defined focusable element at least comprises: an element having a focusable function and a specified element which is a visible element having no focusable function but having a mouse arrow cursor switching to a hand cursor function, and the position and size are elements that appear for the first time.
7. A method for browsing web pages by a remote controller, the method comprising:
in a webpage displayed based on a complete element DOM tree corresponding to a webpage file, determining a first position of a first focusable element in a pre-created self-defined focusable element DOM tree to display a focus, wherein the self-defined focusable element in the self-defined focusable element DOM tree is composed of focusable elements in the complete element DOM tree which are adapted to a keyboard control mode, and at least comprises: an element having a focusable function and a specified element which is a visible element having no focusable function but having a mouse arrow cursor function switched to a hand cursor function, and whose position and size are elements appearing for the first time;
receiving a remote controller key value input by a user, and determining a remote controller key corresponding to the remote controller key value in a corresponding relation between the locally stored remote controller key value and the remote controller key;
and if the remote controller key corresponding to the remote controller key value is a confirmation key, triggering an event response bound on the first focusable element.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010470875.3A CN111625169B (en) | 2020-05-28 | 2020-05-28 | Method for browsing webpage by remote controller and display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010470875.3A CN111625169B (en) | 2020-05-28 | 2020-05-28 | Method for browsing webpage by remote controller and display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111625169A CN111625169A (en) | 2020-09-04 |
| CN111625169B true CN111625169B (en) | 2022-04-15 |
Family
ID=72259260
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010470875.3A Active CN111625169B (en) | 2020-05-28 | 2020-05-28 | Method for browsing webpage by remote controller and display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111625169B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112150781A (en) * | 2020-10-27 | 2020-12-29 | 中图云创智能科技(北京)有限公司 | Method for conveniently controlling display screen |
| CN113076046B (en) * | 2021-03-24 | 2023-03-14 | 中国邮政储蓄银行股份有限公司 | Setting method and device of operation page and processor |
| CN113645489A (en) * | 2021-08-26 | 2021-11-12 | 帕科视讯科技(杭州)股份有限公司 | IPTV platform EPG dynamic focus configuration and moving method |
| CN114679616A (en) * | 2022-03-28 | 2022-06-28 | 京东方科技集团股份有限公司 | Method for controlling display device and related device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103916710A (en) * | 2014-03-31 | 2014-07-09 | 优视科技有限公司 | Focal point switching method and system |
| CN106155644A (en) * | 2015-03-27 | 2016-11-23 | 中国科学院声学研究所 | It is applicable to the webpage focal point control implementation method of intelligent television browser |
| CN107306308A (en) * | 2016-04-20 | 2017-10-31 | 中兴通讯股份有限公司 | Page response method and device |
| CN109963182A (en) * | 2017-12-26 | 2019-07-02 | 深圳Tcl数字技术有限公司 | A kind of compatible input method of remote controler, system, storage medium and television set |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102088639B (en) * | 2011-01-21 | 2013-05-22 | 烽火通信科技股份有限公司 | Navigation control method of browser page for IPTV (Internet protocol television) set-top box |
| CN102609521B (en) * | 2012-02-10 | 2016-12-14 | 深圳创维数字技术有限公司 | The changing method of a kind of webpage focus element and receiving terminal for digital television |
| CN104808920A (en) * | 2015-04-30 | 2015-07-29 | 青岛海信电器股份有限公司 | Focal point control method and focal point control device |
| EP3507765A4 (en) * | 2016-09-01 | 2020-01-01 | Duelight LLC | Systems and methods for adjusting focus based on focus target information |
| US10552236B2 (en) * | 2017-06-28 | 2020-02-04 | Microsoft Technology Licensing, Llc | Serialization of focus movement between elements in web applications |
-
2020
- 2020-05-28 CN CN202010470875.3A patent/CN111625169B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103916710A (en) * | 2014-03-31 | 2014-07-09 | 优视科技有限公司 | Focal point switching method and system |
| CN106155644A (en) * | 2015-03-27 | 2016-11-23 | 中国科学院声学研究所 | It is applicable to the webpage focal point control implementation method of intelligent television browser |
| CN107306308A (en) * | 2016-04-20 | 2017-10-31 | 中兴通讯股份有限公司 | Page response method and device |
| CN109963182A (en) * | 2017-12-26 | 2019-07-02 | 深圳Tcl数字技术有限公司 | A kind of compatible input method of remote controler, system, storage medium and television set |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111625169A (en) | 2020-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111625169B (en) | Method for browsing webpage by remote controller and display equipment | |
| CN111182345B (en) | Display method and display equipment of control | |
| CN112969084A (en) | User interface display method, storage medium and display device | |
| CN111654739A (en) | Content display method and display equipment | |
| CN111427643A (en) | Display device and display method of operation guide based on display device | |
| CN109960556B (en) | Display device | |
| CN111414216A (en) | Display device and display method of operation guide based on display device | |
| CN111726673B (en) | Channel switching method and display device | |
| CN111479155A (en) | Display device and user interface display method | |
| CN111045557A (en) | Moving method of focus object and display device | |
| CN111104020A (en) | User interface setting method, storage medium and display device | |
| CN111225262A (en) | Function setting method of display equipment and display equipment | |
| CN111901653B (en) | Configuration method of external sound equipment of display equipment and display equipment | |
| CN113115092B (en) | Display device and detail page display method | |
| CN111757154A (en) | Method for controlling webpage cursor by remote controller and display equipment | |
| CN109922364B (en) | Display device | |
| CN112004126A (en) | Search result display method and display device | |
| CN111857363A (en) | Input method interaction method and display equipment | |
| CN112040308A (en) | HDMI channel switching method and display device | |
| CN111601143A (en) | Eye protection mode service starting method and display device | |
| CN111541929A (en) | Multimedia data display method and display equipment | |
| CN113115093B (en) | Display device and detail page display method | |
| CN113010074A (en) | Webpage Video control bar display method and display equipment | |
| CN111601147A (en) | Content display method and display equipment | |
| CN111614995A (en) | Menu display method and display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221026 Address after: 83 Intekte Street, Devon, Netherlands Patentee after: VIDAA (Netherlands) International Holdings Ltd. Address before: 9 / F, Hisense south building, 1777 Chuangye Road, Yuehai street, Nanshan District, Shenzhen, Guangdong 518054 Patentee before: HISENSE ELECTRONIC TECHNOLOGY (SHENZHEN) Co.,Ltd. |