CN109600644B

CN109600644B - Method for remotely controlling television browser, related equipment and computer program product

Info

Publication number: CN109600644B
Application number: CN201710941087.6A
Authority: CN
Inventors: 朱培; 张海波; 王宁; 刘亮; 曾夏飞; 蔡春花
Original assignee: Huawei Device Co Ltd
Current assignee: Huawei Device Co Ltd
Priority date: 2017-09-30
Filing date: 2017-09-30
Publication date: 2021-08-13
Anticipated expiration: 2037-09-30
Also published as: CN109600644A

Abstract

The embodiment of the application provides a method for remotely controlling a television browser, which comprises the following steps: the method comprises the steps of obtaining a synchronous page provided by a television browser, configuring the resolution and a user agent identifier of a mobile equipment browser, then accessing the synchronous page, redirecting the synchronous page to a currently accessed page of the television browser when the synchronous page is accessed, finally generating a remote control instruction according to an operation triggered by a user on the page, and sending the remote control instruction to the television browser. Because the user implements the operation on the mobile equipment, the controllability is better, the operation is very convenient, and the operation habit of the user is also met, so that compared with the television remote controller used for remotely controlling the television browser in the prior art, the television browser is remotely controlled by the mobile equipment, the controllability is better, and the accuracy is better. The embodiment of the application also provides corresponding equipment and a computer program product.

Description

Method for remotely controlling television browser, related equipment and computer program product

Technical Field

The present application relates to the field of intelligent device technologies, and in particular, to a method for remotely controlling a television browser, and related device and computer program product.

Background

The intelligent television is a television which is based on a network application technology, has an open operating system and a chip, can realize a human-computer interaction function, integrates various functions such as audio and video, entertainment, data and the like into a whole and meets the diversified and personalized requirements of users. The television browser is a special browser suitable for the smart television, and can enable a user to see network content on the television. The television browser conducts aggregation and page conversion on live broadcast, videos, gallery and news according to the characteristics of the smart television, and is suitable for television users to access and watch through a television remote controller.

When a user operates a television browser by using a television remote controller, the cursor on a page of the television browser can be controlled only by operating keys on the television remote controller, the cursor moves once when the user performs touch key operation once, and because the content of a webpage is dense, the user can complete the operation of the webpage only by frequently touching the keys, which is very inconvenient in practical application, and because the layout of the keys on the television controller is very dense, the user is easy to have operation errors during the operation.

Disclosure of Invention

The embodiment of the application provides a method and a device for remotely controlling a television browser and related equipment, and provides a mode for a user to synchronously control the television browser through a mobile equipment browser installed on the mobile equipment so as to improve the convenience and accuracy of operation.

A first aspect of the present application provides a method for remotely controlling a television browser, which is applied to a mobile device, and includes:

acquiring a synchronous page provided by a television browser; the synchronous page carries the resolution of the television browser and the user agent identification;

configuring the resolution and the user agent identifier of the mobile equipment browser according to the resolution and the user agent identifier of the television browser;

accessing the synchronous page, and redirecting the synchronous page to a page currently accessed by the television browser when the synchronous page is accessed;

generating a remote control instruction according to the operation triggered by the user on the page; the remote control instruction comprises: operation type identification and operation parameters;

and sending the remote control instruction to the television browser, wherein the remote control instruction is used for indicating the television browser to control a page according to the operation type identifier and the operation parameter.

With reference to the first aspect, in a first possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

monitoring the operation of a user on the page, responding to the click operation triggered by the user, and generating a remote control instruction, wherein the remote control instruction comprises: and clicking the operation identifier and clicking the position.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the monitoring an operation of a user on the page, responding to a click operation triggered by the user, and generating a remote control instruction includes:

monitoring nodes of a document object model of the page;

and when a certain node is monitored to be clicked, acquiring the layer position and the layer position of the clicked node in the document object model, responding to click operation triggered by a user, and generating a remote control instruction, wherein the remote control instruction comprises a click type identifier, the layer position and the layer position of the clicked node.

With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner, the monitoring a node of a document object model of the page includes:

monitoring effective nodes in a document object model of the page; the effective node refers to a node supporting click operation.

With reference to the first possible implementation manner of the first aspect, in a fourth possible implementation manner, the monitoring a node of a document object model of the page includes:

and traversing and monitoring the nodes of the document object model of the page in a depth-first traversal mode.

With reference to the first aspect, in a fifth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

when the fact that a user triggers sliding operation on the page is monitored, calculating the absolute page sliding position according to the relative page sliding position and the resolution of the television browser;

responding to a sliding operation triggered by a user, and generating a remote control instruction according to the absolute page sliding position, wherein the remote control instruction comprises: the sliding operation identifier and the page sliding absolute position.

With reference to the first aspect, in a sixth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

monitoring that a user triggers zooming operation on the page, and calculating a page zooming absolute position according to the page zooming relative position and the resolution of the television browser;

responding to a zooming operation triggered by a user, and generating a remote control instruction according to the page zooming absolute position, wherein the remote control instruction comprises: the zoom operation identifies a zoom ratio, and a page zoom absolute position.

With reference to the first aspect, in a seventh possible implementation manner, the generating a remote control instruction according to an operation triggered by a user includes:

acquiring a playing operation on the page, and popping up a dialog box containing a first control and a second control on the page, wherein the first control is used for indicating to play a video on the mobile equipment when being touched, and the second control is used for indicating to play the video on a television when being touched;

when the second control is monitored to be touched, a remote control instruction is generated, wherein the remote control instruction comprises: video playing operation identification and video linkage.

With reference to the seventh possible implementation manner of the first aspect, in an eighth possible implementation manner, the method further includes:

and displaying a video playing control interface, wherein the video playing control interface bears related controls for controlling the video played by the television browser.

With reference to the first aspect, in a ninth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user includes:

when a user is monitored to trigger a search operation, a remote control instruction is generated according to a search word input by the user in a search box, the position of a touched search box and the position of a touched search control, and the remote control instruction comprises: the search type identification, the search word, the node position of the search box and the node position of the search control.

With reference to the first aspect, in a tenth possible implementation manner, the sending the remote control instruction to the television browser includes:

and packaging the remote control command into a JSON format, and sending the JSON format to the television browser in a POST mode.

With reference to the first aspect, in an eleventh possible implementation manner, the acquiring a synchronization page provided by a television browser includes:

scanning a two-dimensional code generated by the television browser, wherein the two-dimensional code is generated by the television browser based on http service and contains information of an address of an http server, and the http server is used for generating the synchronous page;

and analyzing the two-dimensional code to obtain the http server address, and accessing the http server address to obtain the synchronous page.

A second aspect of the present application provides a mobile device comprising:

the acquisition module is used for acquiring a synchronous page provided by a television browser; the synchronous page carries resolution and user agent identification;

the configuration module is used for configuring the resolution and the user agent identification of the mobile equipment browser according to the resolution and the user agent identification;

the access module is used for accessing the synchronous page, and the synchronous page is redirected to the currently accessed page when being accessed;

the generating module is used for generating a remote control instruction according to the operation triggered by the user on the page; the remote control instruction comprises: operation type identification and operation parameters;

and the remote control module is used for sending the remote control instruction, and the remote control instruction is used for indicating a control page according to the operation type identifier and the operation parameter.

A third aspect of the present application provides a mobile device comprising:

a processor and a memory; the memory stores computer instructions, wherein the processor is configured to perform the following steps when the computer instructions in the memory are executed:

With reference to the third aspect, in a first possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

With reference to the third aspect, in a first possible implementation manner, in a second possible implementation manner, the monitoring an operation of a user on the page, responding to a click operation triggered by the user, and generating a remote control instruction includes:

monitoring nodes of a document object model of the page;

With reference to the third aspect, in a first possible implementation manner, in a third possible implementation manner, the monitoring a node of a document object model of the page includes:

With reference to the third aspect, in a first possible implementation manner, in a fourth possible implementation manner, the monitoring a node of a document object model of the page includes:

With reference to the third aspect, in a fifth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

With reference to the third aspect, in a sixth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user on the page includes:

With reference to the third aspect, in a seventh possible implementation manner, the generating a remote control instruction according to an operation triggered by a user includes:

With reference to the seventh possible implementation manner of the third aspect, in an eighth possible implementation manner, the method further includes:

With reference to the third aspect, in a ninth possible implementation manner, the generating a remote control instruction according to an operation triggered by a user includes:

With reference to the third aspect, in a tenth possible implementation manner, the sending the remote control instruction to the television browser includes:

With reference to the third aspect, in an eleventh possible implementation manner, the acquiring a synchronization page provided by a television browser includes:

A fourth aspect of the present application provides a method for remotely controlling a television browser, which is applied to a television, and includes:

receiving a remote control instruction sent by a mobile equipment browser; the remote control instruction comprises an operation type identifier and operation parameters;

and analyzing the remote control command, and controlling a page according to the operation type identifier and the operation parameter.

With reference to the fourth aspect, in a first possible implementation manner, the method further includes:

and generating a two-dimensional code containing an http server address based on the http service, and displaying the two-dimensional code on the current access page.

With reference to the first possible implementation manner of the fourth aspect, in a second possible implementation manner, the method further includes:

and detecting that the television is connected with the mobile equipment through an http server, and hiding the two-dimensional code.

A fifth aspect of the present application provides a television comprising:

the receiving module is used for receiving a remote control instruction sent by a mobile equipment browser; the remote control instruction comprises an operation type identifier and operation parameters;

and the response module is used for analyzing the remote control command and controlling a page according to the operation type identifier and the operation parameter.

A sixth aspect of the present application provides a television comprising:

With reference to the fifth aspect, in a first possible implementation manner, the method further includes:

With reference to the first possible implementation manner of the fifth aspect, in a second possible implementation manner, the method further includes:

A sixth aspect of the present application provides a computer-readable storage medium, characterized in that it comprises instructions which, when run on a mobile device, cause the mobile device to perform the method of remotely controlling a television browser as provided in the first aspect of the present application.

A sixth aspect of the present application provides another computer-readable storage medium, characterized by instructions that, when run on a television, cause the television to perform the method for remotely controlling a television browser provided in the fourth aspect of the present application.

According to the technical scheme, the embodiment of the application has the following advantages:

acquiring a synchronous page provided by a television browser, wherein the synchronous page carries the resolution and a user agent identifier of the television browser, then configuring the resolution and the user agent identifier of a mobile equipment browser according to the resolution and the user agent identifier, then accessing the synchronous page by the mobile equipment browser, and redirecting to the page currently accessed by the television browser when the synchronous page is accessed; the mobile equipment configures the resolution ratio of a mobile equipment browser and the user agent identifier, so that the content of a page acquired by the mobile equipment browser is completely consistent with that of a page acquired by a television browser, and a user can see and obtain the content; the method comprises the steps that a user carries out operation on a current page of a mobile equipment browser, the mobile equipment browser generates a remote control instruction according to operation triggered by the user on the page, and the remote control instruction is sent to a television browser, so that the television browser controls the page according to the remote control instruction. Therefore, the user implements operation on the mobile equipment browser, the mobile equipment browser transmits the operation to the television browser in real time in a remote control instruction mode, and the television browser immediately responds according to the remote control instruction.

When a user wants to use a television browser, the user can implement operation on the browser of the mobile equipment browser, the mobile equipment browser transmits the operation implemented by the user to the television browser in real time, and the television browser controls a page; because the user implements the operation on the mobile equipment browser, the controllability is good, the operation is very convenient, and the operation habit of the user is also met, so that the television browser is remotely controlled through the mobile equipment browser.

Drawings

Fig. 1 is a flowchart of a method for remotely controlling a television browser according to an embodiment of the present application;

FIG. 2 is a diagram of an example implementation of a television browser providing a synchronized page provided by an embodiment of the present application;

FIG. 3 is a diagram illustrating an effect of adjusting a resolution of a browser of a mobile device according to an embodiment of the present application;

FIG. 4 is an exemplary diagram of a DOM tree node listening manner provided in an embodiment of the present application;

FIG. 5 is a diagram of an example of a process of a mobile device browser responding to a swipe operation according to an embodiment of the present application;

FIG. 6 is a diagram of an example of a process of a mobile device browser responding to a zoom operation according to an embodiment of the present application;

FIG. 7 is a diagram of an example of a process of a mobile device browser responding to a video viewing operation according to an embodiment of the present application;

FIG. 8 is a diagram of an example of a process for a mobile device browser to respond to a search operation according to an embodiment of the present application;

fig. 9 is a flowchart of a method for remotely controlling a television browser on a television browser side according to an embodiment of the present application;

fig. 10 is a schematic diagram of a mobile device provided in an embodiment of the present application;

fig. 11 is another schematic diagram of a mobile device provided in an embodiment of the present application;

fig. 12 is a schematic diagram of a television provided in the embodiment of the present application;

fig. 13 is another schematic diagram of a television provided in the embodiment of the present application.

Detailed Description

Embodiments of the present application are described below with reference to the accompanying drawings.

In the conventional technology, when a user wants to use a television browser, the user operates a cursor of a page on a television through a television remote controller, and moves to a position of a link or other control element to be clicked at a time by clicking up, down, left and right keys on the television remote controller, and then implements specific operation to browse the webpage. Because the contents of the web pages are relatively dense, the user utilizes the television remote controller to remotely control the television browser, the operation is very inconvenient, and misoperation is easy to occur.

According to the method for remotely controlling the television browser, the page is synchronously controlled by remotely controlling the television browser through the browser operation performed by the user on the mobile equipment browser, the user performs operation on the mobile equipment browser, controllability and operability are good, and operation habits of the user are met, so that the television browser is remotely controlled through the mobile equipment browser.

A method for remotely controlling a television browser according to an embodiment of the present application is described below with reference to fig. 1.

Referring to fig. 1, fig. 1 is a flowchart of a method for remotely controlling a television browser according to an embodiment of the present application, and as shown in fig. 1, the method is applied to a mobile device, and the method may be loaded in the mobile device in the form of a client, and the mobile device runs the client to implement the method, and specifically, the client may be installed in the mobile device in the form of a mobile device browser, and the method includes the following steps:

101, acquiring a synchronous page provided by a television browser; the synchronization page carries the resolution of the television browser and the user agent identification.

In the embodiment of the application, the mobile device browser is a browser which is specially used for the mobile device and installed and operated on the mobile device; the mobile device refers to a terminal hardware device such as a mobile phone, a tablet computer, a personal digital assistant, an electronic book, and the like, which has an operating system and can support the operation of a browser. Any type of operating system may be employed in the hardware device, such as Android, iphoneOS, windows systems, and the like. The browser is a software capable of displaying the content of HTML files of a page server or a file system and enabling a user to interact with the files, and is a client program used for displaying characters, images, videos or other information in a network, wherein the information can be hyperlinks connected with other websites, and the user can browse various information quickly and easily. The user can download the browser by himself, install in the mobile device, and control the TV browser by operating the mobile device browser synchronously.

The television browser is a special browser suitable for the smart television, and a user can see network content on the television. The television browser conducts aggregation and page conversion on live broadcast, videos, gallery and news according to the characteristics of the smart television, and is suitable for television users to access and watch through a television remote controller.

In the embodiment of the application, the television browser is installed in the smart television, when a user starts the smart television to start the television browser, the television browser automatically generates a synchronous page, the synchronous page carries the resolution and the user agent identifier of the television browser, and the synchronous page generated by the television browser has the function of realizing real page synchronization between the browser of the mobile device and the television browser.

The resolution of the television browser is X1 × Y1, that is, the window size of the television browser is X1 × Y1, and the window size can be characterized by the actual length and width size of the television browser window, or by the horizontal and vertical pixels of the display screen, for example, when the television browser is displayed on a full screen of a television, the resolution of the television browser is the same as the resolution of the television display screen, for example, the resolution of the television display is 1680 × 1050, and the resolution of the television browser running on the television is 1680 × 1050; the resolution of some television displays is 1920 × 1080, and the resolution of a television browser running on the television is 1920 × 1080; the User Agent identification of the television browser, also called UA (User-Agent) identification, includes: the type and version of the browser, the operating system and version, the kernel of the browser, and the like. The UA identifier is used for informing a website server accessed by a user, which browser the user client is, and information of an operating system; because the website server can provide pages with different formats aiming at different UA identifications, the website accessed by the user provides the page with the corresponding format for the browser according to the UA identification of the browser through the UA identification, so that the display effect of the page on the browser is better, and better page experience is provided for the user.

The embodiment of the present application does not limit the manner of obtaining the synchronization webpage, for example, the mobile device may automatically obtain the synchronization webpage provided by a television browser on a television through peer-to-peer communication.

However, in order to improve the user's master control performance on the television browser, an embodiment of the present application provides an alternative manner, which includes:

scanning a two-dimensional code generated by a television browser, wherein the two-dimensional code is generated by the television browser based on http service and contains information of an address of an http server, and the http server is used for generating the synchronous page;

For example, as shown in fig. 2, fig. 2 is an exemplary diagram for providing a synchronized page for a television browser provided in the embodiment of the present application, a page of the television browser shown in fig. 2 is only an example, and the page layout and the page carrying specific content of the television browser in the embodiment of the present application are not limited. For a television browser, a two-dimensional code may be generated through an http service, and the generated two-dimensional code is displayed on a currently accessed page. The following description will be made about specific processes and effects of a television browser, and in this embodiment, the processes of a mobile device browser are mainly described.

In the above optional manner, when the user needs to remotely control the television browser, the user scans the two-dimensional code generated by the television browser by using the code scanning control in the mobile device browser in the mobile device, and the user may also scan the two-dimensional code generated by the television browser by using the scanning function of other software in the mobile terminal.

And 102, configuring the resolution and the user agent identification of the mobile equipment browser according to the resolution and the user agent identification of the television browser.

In this embodiment, the mobile device browser obtains the resolution of the television browser, that is, the length and width of the window size of the television browser is X1 × Y1, and because the resolution of the mobile device browser is far from the resolution of the television browser, the mobile device browser needs to adjust the length and width of the window to X2 × Y2, and ensure that X2/X1 is Y2/Y1, that is, the mobile device browser adjusts the size of the window size of the mobile device browser in the same proportion as the window size of the television browser, so that the adjusted window size is in the same proportion as the length and width of the window size of the television browser.

Referring to fig. 3, the configuration of the resolution of the mobile device browser in step 102 is graphically illustrated with fig. 3 as an example, in fig. 3, the left diagram is a window diagram of the mobile device browser shown by way of example in a mobile phone after browser adjustment, and the right diagram is a window diagram of the television browser.

In the embodiment of the application, the mobile device browser acquires the UA identifier of the television browser, resets the UA identifier of the browser on the mobile device browser, and changes the UA identifier of the browser on the mobile device browser into the UA identifier of the television browser, so that the UA identifier is consistent with the UA identifier of the television browser, and the mobile device browser and the television browser acquire pages of the same format when accessing the same website, thereby realizing real page synchronization.

103, accessing the synchronous page, and redirecting the synchronous page to the page currently accessed by the television browser when the synchronous page is accessed.

After step 102, the mobile device resets the resolution and the user agent identifier of the device itself in the mobile device browser, and after configuration, the mobile device browser accesses the synchronization page, and since the synchronization page has a redirection function, the synchronization device, when accessed, redirects to the page currently accessed by the television browser.

Page redirection refers to turning a page requested by a user to another page position, that is, when the user accesses a certain page a, the page a is automatically directed to a page B, so that the user sees the page B. The implementation modes of page redirection are various, for example, the page redirection is carried out through a javascript script; the specific implementation manner of the page redirection in the embodiment of the present application is not limited.

And synchronously displaying the page contents by the mobile equipment browser and the television browser, wherein the contents seen by the user on the mobile equipment browser, namely the contents displayed by the television browser, are what the user sees and what the user sees are what the user obtains. Based on the method, the user can accurately correspond to the page displayed by the television browser by performing operation on the page displayed by the browser of the mobile equipment.

In a specific implementation, when the user wants to remotely control the tv browser, the relevant operations can be directly performed on the page displayed by the mobile device browser, and then the mobile device browser executes step 104.

104, generating a remote control instruction according to the operation triggered by the user on the page; the remote control instruction comprises: an operation type identification and an operation parameter.

In the embodiment of the application, the mobile device browser receives an operation triggered by a user on a page, and normally responds to the operation triggered by the user, that is, the mobile device browser controls the page to find a corresponding change according to the user operation, and at the same time, the mobile device browser generates a remote control instruction according to the operation triggered by the user, wherein the remote control instruction at least comprises an operation type identifier and an operation parameter.

The operation types that the user can implement on the page are various, so the mobile device browser sets a corresponding operation type identifier for each operation, and in addition, for each type of operation, a corresponding related operation parameter also needs to be set, the television browser is instructed by the operation type identifier to identify the operation implemented by the user, and the operation parameter is used for instructing the television browser to respond according to a specific parameter when responding to the operation.

105, sending the remote control instruction to the television browser, where the remote control instruction is used to instruct the television browser to control a page according to the operation type identifier and the operation parameter.

The mobile equipment sends a remote control instruction to a television browser on a television, the remote control instruction can be packaged into a JSON format, and the remote control instruction is sent to the television browser through a POST mode. The specific manner in which the mobile device browser sends the remote control command to the television browser is not limited in this application.

The JSON (JSON Object Notation) is a lightweight data interaction format, adopts a text format completely independent of a programming language to store and represent data, is easy for machine analysis and generation, and effectively improves transmission efficiency. The POST method is a data transmission method specified by the hypertext transfer protocol (HTTP protocol).

The mobile equipment sends a remote control instruction to the television in a wireless communication mode, wherein the wireless communication mode comprises the following steps: any one of WiFi, Bluetooth, infrared or other close range communication modes.

It can be seen that: when a user wants to use the television browser, the user can implement operation on the mobile equipment browser, the mobile equipment browser transmits the operation implemented by the user to the television browser in real time, and the television browser is instructed to control a page in real time through a remote control instruction; because the user implements the operation on the mobile equipment browser, the controllability is good, the operation is very convenient, and the operation habit of the user is also met, so that the television browser is remotely controlled through the mobile equipment browser, the controllability is better, and the accuracy is better.

Next, the mobile device browser generates remote control commands according to user-triggered operations on the page, i.e. 104, according to a specific operation or application scenario.

First implementation

After the mobile device browser and the television browser page are synchronized, a user clicks a link to be opened on the mobile device browser or clicks a certain control, and then the user triggers a clicking operation. In this implementation manner, the mobile device browser monitors an operation of a user on a page, responds to a click operation triggered by the user, and generates a remote control instruction, where the remote control instruction includes: and clicking the operation identifier and clicking the position.

In this implementation manner, how the mobile device browser monitors the user to trigger the click operation is not limited, but in order to improve the accuracy of monitoring the click operation and the operation parameters, the present application further provides an alternative implementation manner, which includes:

monitoring nodes of a document object model of the page;

Among them, the Document Object model (Document Object model Tree), also called DOM Tree, is a kind of node organization structure of web page. In specific implementation, when the mobile device browser monitors that a certain node is clicked, the number of layers X of the node in the DOM tree and the position Y of the node in the layers are obtained. According to the acquired information, generating a remote control instruction, wherein the remote control instruction comprises: the type of click operation identifies, for example, tap, and the location X, Y where the click operation occurred.

Referring to fig. 4, the left side of fig. 4 shows a page display diagram, where the page has 7 nodes, each identified by a rectangular area. The DOM tree of the page on the left side of FIG. 4 is shown in the tree structure on the right side of FIG. 4. As shown in the DOM tree structure, it is a three-level tree structure, the first level containing node 1, the second level containing node 2 and node 3, and the third level containing node 4, node 5, node 6 and node 7; assuming that the user clicks the rectangular region position of the node 7, the third level of the node 7 in the DOM tree is obtained according to the DOM structure, and the 4 th position point in the third level, namely the level X is 3, and the position Y in the level is 5.

In addition, in the above alternative implementation, the mobile device browser may monitor all nodes of the DOM tree, but in order to effectively and quickly monitor the click action, the mobile device browser may monitor only the valid nodes in the DOM tree, where the valid nodes refer to nodes that support the click operation, for example: the active node includes: links, pictures, buttons, input boxes, etc. that can be clicked.

In the application, when a mobile device browser renders a page, the page is rendered according to a DOM structure through a rendering engine, elements of each node are identified by a rectangular area, and if a click position is in the rectangular area formed by rendering the node, the click position indicates that the node is clicked. Based on this, the mobile device browser adopts a depth-first traversal method for the DOM tree while monitoring the DOM, which is explained below by taking fig. 4 as an example.

Referring to fig. 4, the left side of fig. 4 shows a page display diagram, where the page has 7 nodes, each identified by a rectangular area. The DOM tree of the page on the left side of FIG. 4 is shown in the tree structure on the right side of FIG. 4. Firstly, judging the node No. 1 in the first layer by adopting a depth-first algorithm, if the node No. 1 is hit, carrying out recursion judgment on the sub-node in the next layer from left to right, if the node No. 2 is not hit, abandoning the node No. 2 and the sub-node thereof, judging the node No. 3, and so on until the node meeting the following conditions is found:

condition 1, the rectangular area of the node hits the click position; condition 2, the node has no child node or the child node does not hit the click position; condition 3, the node is in a clickable state; and 4, the z-axis coordinate of the node in all the nodes meeting the requirement is at the uppermost layer.

For the example page on the left side of fig. 4, when the clicked position is within the rectangular area of the node 7, the clicked node is the node No. 7, and the whole calculation flow is shown by an arrow in the right tree diagram of fig. 4.

It can be seen that: the mobile device browser can accurately and effectively monitor click operation and click positions in a mode of monitoring the DOM tree, so that a remote control instruction is generated.

The second implementation mode comprises the following steps:

after the mobile equipment browser and the television browser are synchronized, a user can slide a page up and down on the mobile equipment browser to browse page contents, and the sliding operation is carried out on the user; the mobile equipment browser responds to sliding operation triggered by a user and generates a remote control instruction according to the page sliding absolute position, wherein the remote control instruction comprises the following steps: the sliding operation identifier and the page sliding absolute position.

Referring to fig. 5, the implementation manner will be described by taking the schematic diagram of the user performing a sliding operation on the mobile phone browser shown in fig. 5 as an example. In (5a) in fig. 5, a user may perform a sliding operation in any direction from top to bottom, from left to right, on a page of a mobile browser to view corresponding web page content, where only a first piece of news and a second piece of news in a web page a are displayed on the current page of the mobile browser, and if the user slides the page upwards, the mobile browser responds to the upward sliding operation of the user, and the page is changed to be shown in a right-side view, where only the second piece of news and the third piece of news in the web page a are displayed on the mobile browser at this time, as shown in (5b) in fig. 5.

And after the mobile phone browser monitors the sliding operation, the page sliding relative position of the page on the mobile phone browser is calculated first, if the user performs the sliding operation up or down, the page sliding relative position is recorded as dy1, dy1 refers to the ordinate distance between the vertex of the upper left corner of the mobile phone screen and the vertex coordinate corresponding to the page, as shown in (5b) in fig. 5, the user performs the sliding operation up, and dy1 may be the distance between the vertex of the upper left corner of the mobile phone screen and the ordinate of the vertex of the upper left corner of the page.

If the user performs left sliding or right sliding, the page sliding relative position is recorded as dx1, and dx1 is the abscissa distance from the vertex at the upper left corner of the mobile phone screen to the vertex coordinate corresponding to the page.

In this application, (5b) in fig. 5 is only an example, the calculation method of the page sliding relative position in this application is not limited, but in the specific implementation, the tv browser must measure the page sliding absolute position according to the same physical meaning to ensure the page synchronous change.

If the user performs the up-slide or down-slide, the page slide absolute position dy 2-dy 1 (Y1/Y2); that is, the absolute position of page sliding refers to the vertical distance that the page should actually slide on the television browser relative to the origin (the top left corner of the screen coincides with the top left corner of the page).

If the user performs left sliding or right sliding, the page sliding absolute position dx2 ═ dx1 ═ X1/X2; that is, the absolute position of page sliding refers to the lateral distance that the page should actually slide on the television browser relative to the origin (the top left corner of the screen coincides with the top left corner of the page).

Taking fig. 5 as an example, the mobile phone browser calculates the page sliding absolute position dy2 according to dy1, the mobile phone browser resolution (X2, Y2) and the television browser resolution (X1, Y1), where the page sliding absolute position dy2 refers to the actual sliding distance dy2 of the page on the television browser, and the page sliding distance dy2 × dy1 (Y1/Y2). The mobile phone browser generates a remote control instruction according to the calculated actual sliding distance dy2, sends the remote control instruction to the television browser, and the television browser controls the page according to the remote control instruction, so that the control page slides upwards, as shown in (5d) in fig. 5.

The third implementation mode comprises the following steps:

when a user watches a page on a mobile equipment browser, the content of the page can be amplified or reduced, and the user carries out amplification or reduction operation according to actual requirements; meanwhile, the mobile equipment browser responds to zooming operation triggered by a user and generates a remote control instruction according to the page zooming absolute position, wherein the remote control instruction comprises the following steps: the zoom operation identifies a zoom ratio, and a page zoom absolute position.

Referring to fig. 6, the implementation manner is described by taking the schematic diagram of the zoom operation performed by the user on the mobile phone browser shown in fig. 6 as an example. In (6a) in fig. 6, a user may slide a page up, down, left, and right on a page of a mobile browser to view corresponding web content, where only one picture in a web page B is displayed on a current page of the mobile browser, and if the user performs an enlargement operation, the mobile browser responds to the enlargement operation of the user, and the page becomes as shown in (6B) in fig. 6, and at the same time, the mobile browser calculates a zoom ratio and an absolute page zoom position, where the zoom ratio is a ratio between a page size after the user performs zooming and an original page size, which is denoted as S, and S is a numerical value greater than 1 when the user performs the enlargement operation, and is a numerical value less than 1 when the user performs the reduction operation; assuming that the user zooms in the picture by 1.5 times, S becomes 1.5.

When a user performs zooming action, a page can be scrolled, and in order to ensure that the pages of the television browser and the mobile phone browser are completely synchronous and the contents are completely consistent, the mobile phone browser also calculates the absolute zooming position of the page, wherein the absolute zooming position of the page refers to the absolute position of the page which should slide when the page is zoomed on the television browser; the page zooming absolute position is obtained by calculation according to the relative position change condition of a page when the page is zoomed on a mobile phone browser and the resolution of a television browser; and recording the page zooming relative position of the page on the mobile phone browser as (dx1, dy1), wherein dx1 and dy1 refer to the horizontal and vertical coordinate distance between the vertex of the mobile phone screen and the page after the page is zoomed. For example, dx1 is the distance between the abscissa of the top left vertex of the mobile phone screen and the abscissa of the top left vertex of the page, and dy1 is the distance between the top left vertex of the mobile phone screen and the ordinate of the top left vertex of the page; it will also be understood that dx1 is the distance from the left edge of the cell phone screen to the left edge of the page, and dy1 may be the distance from the top of the cell phone screen to the top of the page.

While (6b) in fig. 6 is only an example, the calculation manner of the page scaling relative position is not limited in the present application, but in a specific implementation, the television browser must measure the page scaling absolute position according to the same physical meaning to ensure that the page synchronously changes.

The mobile phone browser calculates page scaling absolute positions (dx2 and dy2) according to (dx1 and dy1), wherein dx2 is dx1 (x2/x1), and dy2 is dy1 (Y2/Y1); and the mobile phone browser generates a remote control instruction according to the calculated (dx2, dy2), sends the remote control instruction to the television browser, the television browser controls the page according to the remote control instruction, sends a zooming instruction to the page, controls the page to zoom, controls the page to be zoomed by a multiple of 1.5, controls the page to scroll according to dx2 and dy2, and ensures that the scrolled page and the mobile phone browser reach the same position so as to ensure synchronous display of the page.

Fourth mode of implementation

When a user watches a page on a mobile equipment browser, when the page has a video and the user triggers the operation of watching the video, and when the mobile equipment browser monitors that the user triggers the operation of playing the video on the displayed page, a dialog box containing a first control and a second control pops up on the page, wherein the first control is used for indicating that the video is played on the mobile equipment when being touched; when the second control is touched, the second control is used for indicating that the video is played on the television; then, when the browser of the mobile device monitors that the second control is touched, a remote control instruction is generated, wherein the remote control instruction comprises: video playing operation identification and video linkage. In addition, in order to facilitate a user to control video playing by using a mobile device, a video playing control interface may be displayed by using a browser of the mobile device, where the video playing control interface carries related controls for controlling video played by the television browser, where the related controls at least include functional controls for playing, pausing, fast forwarding, fast rewinding, playing, refreshing, recording video, and the like, and in this embodiment, the number and specific functions of the related controls are not limited, and the specific display form of the related controls is not limited. Thus, the user performs relevant operations on the mobile device, such as playing, pausing, fast-forwarding, fast-rewinding, voice control, refreshing, video recording and the like, and the operations are transmitted to the television browser through remote control commands, and the television browser responds to the operations of the user.

Referring to fig. 7, fig. 7 is a schematic view showing an operation performed by a user to view a video on a mobile phone browser, in (7a) of fig. 7, in a web page C shown on the mobile phone browser, the web page C bears a first video, and when the user clicks to view the first video, the mobile phone browser pops up a dialog box to prompt the user to select whether to view the video on the mobile phone or view the video on the television, if the user selects to view the video on the television, the mobile device browser generates a remote control instruction, the remote control instruction carries a video playing operation identifier and a network link of the current first video, and the television browser plays the first video after receiving the remote control instruction. In addition, as shown in (7b) of fig. 7, the mobile phone browser also displays a video playing control interface, and the user can perform operations on the video playing control interface to control the video to be played by the television browser to be played, such as playing, pausing, dragging, exiting, and the like. And the mobile phone browser generates a remote control instruction according to the relevant operation implemented by the user on the video playing control interface, sends the remote control instruction to the television browser, and the television browser controls the page according to the remote control instruction.

Fifth implementation

When a user wants to search information on a mobile device browser, for example, a television drama "western memory" is searched, the user inputs a search word "western memory" in a page search box of the mobile device browser, and clicks a search button to search, the mobile device browser responds to a search operation of the user, and meanwhile, when the mobile device browser monitors that the user triggers the search operation, a remote control instruction is generated according to the search word input by the user in the search box, the position of a touched search box and the position of a touched search control, and the remote control instruction includes: the search type identification, the search word, the node position of the search box and the node position of the search control. Then, the mobile device browser sends the remote control instruction to the television browser, and the television browser fills the search box node with the search word according to the remote control instruction and the method described in the first implementation manner, and sends the click action to the search control node, so that the search operation is implemented, and the search result is displayed for the user.

Referring to fig. 8, fig. 8 shows a schematic diagram of a user performing a search operation on a mobile phone browser, in (8a) of fig. 8, a search word "western characters" is input in a search box of the mobile phone browser of the user, and the mobile phone browser displays a search result for the user, as shown in (8b) of fig. 8, when the mobile phone browser monitors that the user triggers the search operation, the mobile phone browser generates a remote control instruction to instruct the television browser to synchronously respond to the search operation of the user, as shown in (8c) of fig. 8, the search operation performed by the user on the mobile phone browser is synchronized to the television browser through the remote control instruction, and the television browser responds to the search operation of the user according to the remote control instruction, and displays the search result for the user, as shown in (8d) of fig. 8.

It should be noted that, in practical application, the mobile device browser may generate a corresponding remote control instruction according to any one of the above five implementation manners, or any several manners, according to an actual operation of a user, so as to remotely control the television browser to control the page according to the remote control instruction.

For example, a user first opens a web page by using a mobile device browser, slides the page through a sliding operation to browse the content of the page, the mobile device browser responds to the operation of the user, generates a remote control instruction according to a second implementation mode, and synchronously controls the page to slide according to the remote control instruction by the television browser; and then, when the user clicks a link on the page, the mobile equipment browser responds to the operation of the user, and generates a remote control instruction according to a first implementation mode, the television browser synchronously controls the page to jump to the page corresponding to the link according to the remote control instruction, and if the page corresponding to the link is a video page, the user clicks to view the video, the mobile equipment browser generates a remote control instruction according to a fourth implementation mode, the television browser plays the video according to the remote control instruction, and the user controls the playing of the video on the mobile equipment browser. After the user views the video, the related video is searched on the mobile equipment browser, the mobile equipment browser responds to the operation of the user, a remote control instruction is generated according to a fifth implementation mode, and then the television browser responds to the search operation of the user according to the remote control instruction.

The above is a description of a method for remotely controlling a television browser on the mobile device side of the present application, and the following is a description of the method on the television browser side.

Referring to fig. 9, fig. 9 is a flowchart illustrating a method for remotely controlling a television browser according to an embodiment of the present application, where the method is applied to a television, and the method may be loaded in the television in the form of a client, and the television runs the client to implement the method, and specifically, the client may be installed in a mobile device in the form of a television browser, and the method includes:

901, receiving a remote control instruction sent by a mobile device browser; the remote control instruction comprises an operation type identifier and operation parameters;

and 902, analyzing the remote control command, and controlling a page according to the operation type identifier and the operation parameter.

Different from a television browser in the prior art, in the embodiment of the application, the television browser has a function of providing a synchronous page, the synchronous page is provided for the mobile device browser, the mobile device browser and the television browser can conveniently realize page synchronization, in addition, the television browser receives a remote control instruction of the mobile device through network communication, and accurate operation on the page is realized according to a remote control instruction mode, so that the user operation is facilitated, and the page is timely controlled according to the user operation.

In the embodiment of the present application, an optional implementation manner is provided for how to provide a synchronized page, and the method further includes:

In specific implementation, a user opens a television, a television browser is started, the television browser generates a two-dimensional code based on http service, an http server address is carried in the two-dimensional code, the http server is used for providing a synchronous page for a mobile device browser, when the mobile device browser scans the two-dimensional code and logs in the http server, the http server provides the synchronous page for the mobile device browser, and when the synchronous page is accessed, the synchronous page is redirected to a current access page of the television browser.

In a specific implementation, in order not to affect the user to watch the television, the television browser does not need to display the two-dimensional code all the time, and optionally, the method may further include: and the television browser detects that the mobile equipment browser is connected with the television browser through the http server, and the television browser hides the two-dimensional code.

Corresponding to the method shown in fig. 1, the embodiment of the present application further provides a mobile device, and the mobile device 100 is described below with reference to fig. 10.

Referring to fig. 10, fig. 10 is a block diagram illustrating a mobile device provided in an embodiment of the present application, and as shown in fig. 10, the mobile device 100 includes:

an obtaining module 1001, configured to obtain a synchronization page provided by a television browser; the synchronous page carries the resolution of the television browser and the user agent identification;

a configuration module 1002, configured to configure the resolution and the user agent identifier of the mobile device browser according to the resolution and the user agent identifier of the television browser;

an accessing module 1003, configured to access the synchronous page, where the synchronous page is redirected to a page currently accessed by the television browser when being accessed;

a generating module 1004, configured to generate a remote control instruction according to an operation triggered by a user on the page; the remote control instruction comprises: operation type identification and operation parameters;

a remote control module 1005, configured to send the remote control instruction to the television browser, where the remote control instruction is used to instruct the television browser to control a page according to the operation type identifier and the operation parameter.

Optionally, the generating module 1004 may include:

the first generation submodule is used for monitoring the operation of a user on the page, responding to the click operation triggered by the user and generating a remote control instruction, and the remote control instruction comprises: and clicking the operation identifier and clicking the position.

Optionally, the first generation sub-module may further include:

the monitoring submodule is used for monitoring nodes of a document object model of the page;

and the generation submodule is used for monitoring that when a certain node is clicked, acquiring the layer position and the position in the layer of the clicked node in the document object model, responding to the click operation triggered by a user, and generating a remote control instruction, wherein the remote control instruction comprises a click type identifier, the layer position and the layer position of the clicked node.

Optionally, the monitoring sub-module is specifically configured to monitor an effective node in a document object model of the page; the effective node refers to a node supporting click operation.

Optionally, the monitoring sub-module is specifically configured to perform traversal monitoring on the nodes of the document object model of the page in a depth-first traversal manner.

Optionally, the generating module 1004 may include:

the second monitoring submodule is used for monitoring that when a user triggers sliding operation on the page, the absolute page sliding position is calculated according to the relative page sliding position and the resolution of the television browser;

the second generation submodule is used for responding to sliding operation triggered by a user and generating a remote control instruction according to the absolute page sliding position, and the remote control instruction comprises: the sliding operation identifier and the page sliding absolute position.

Optionally, the generating module 1004 may include:

the third monitoring submodule is used for monitoring that when a user triggers zooming operation on the page, the page zooming absolute position is calculated according to the page zooming relative position and the resolution of the television browser;

a third generation submodule, configured to respond to a zoom operation triggered by a user and generate a remote control instruction according to the page zoom absolute position, where the remote control instruction includes: the zoom operation identifies a zoom ratio, and a page zoom absolute position.

Optionally, the generating module 1004 may include:

a fourth monitoring sub-module, configured to monitor that a dialog box including a first control and a second control pops up on the page when a user triggers a video playing operation on the page, where the first control is used to instruct a mobile device to play a video when being touched, and the second control is used to instruct a television to play a video when being touched;

a fourth generation submodule, configured to generate a remote control instruction when the second control is monitored to be touched, where the remote control instruction includes: video playing operation identification and video linkage.

Optionally, the generating module 1004 may further include:

and the display sub-module is used for displaying a video playing control interface, and the video playing control interface bears related controls for controlling the video played by the television browser.

Optionally, the generating module 1004 may include:

a fifth generating sub-module, configured to, when it is monitored that a user triggers a search operation, generate a remote control instruction according to a search word input by the user in the search box, a position of the touched search box, and a position of the touched search control, where the remote control instruction includes: the search control comprises a search type identifier, the search word, a node position of the search frame and a node position of the search control.

Optionally, the remote control module 1005 is specifically configured to encapsulate the remote control instruction into a JSON format, and send the JSON format to the television browser in a POST manner.

Optionally, the obtaining module 1001 may include:

the scanning submodule is used for scanning a two-dimensional code generated by the television browser, the two-dimensional code is generated by the television browser based on http service and contains information of an address of an http server, and the http server is used for generating the synchronous page;

and the obtaining submodule is used for analyzing the two-dimensional code to obtain the http server address, and accessing the http server address to obtain the synchronous page.

It should be noted that the functions of each functional module of the mobile device in the embodiment of the present application may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the relevant description of the foregoing method embodiment, which is not described herein again.

In addition, fig. 11 of the present application is a block diagram illustrating a partial structure of a mobile device 100 according to an embodiment of the present invention. Referring to fig. 11, the mobile device includes: radio Frequency (RF) circuitry 1110, memory 1120, input unit 1130, display unit 1140, sensors 1150, audio circuitry 1160, WiFi module 1170, processor 1180, and power supply 1190. Those skilled in the art will appreciate that the mobile device configuration shown in fig. 11 does not constitute a limitation of the mobile device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The following describes the components of the mobile device in detail with reference to fig. 11:

RF circuitry 1110 may be used to transmit or receive data;

the memory 1120 may be used to store software programs and modules, and the processor 1180 may execute various functional applications and data processing of the mobile device by operating the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the mobile device, and the like. Further, the memory 1120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1130 may be used to receive an operation instruction of a user and generate a key signal input related to user setting and function control of the mobile device 110. Specifically, the input unit 1230 may include a touch panel 1131 and other input devices 1132. The touch panel 1131, which may also be referred to as a touch screen, may collect touch operations (e.g., operations of a user on or near the touch panel 1131 using any suitable object or accessory such as a finger or a stylus pen) of a user in contact or non-contact operation thereon or nearby, and drive a corresponding connection terminal according to a preset program. Alternatively, the touch panel 1131 may include two parts, namely a touch detection terminal and a touch controller. The touch detection terminal detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing terminal, converts the touch information into touch point coordinates, and then sends the touch point coordinates to the processor 1180, and can receive and execute commands sent by the processor 1180. In addition, the touch panel 1131 can be implemented by using various types, such as resistive, capacitive, infrared, and surface acoustic wave. Optionally, the input unit 1230 may further include other input devices 1132. Other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1140 may be used to display an interface. The Display unit 1240 may include a Display panel 1141, and optionally, the Display panel 1141 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-emitting diode (OLED), or the like. Further, touch panel 1131 can cover display panel 1141, and when touch panel 1131 detects a touch operation thereon or nearby, the touch operation is transmitted to processor 1180 to determine the type of the touch event, and then processor 1280 provides a corresponding visual output on display panel 1141 according to the type of the touch event. Although in fig. 11, touch panel 1131 and display panel 1141 are shown as two separate components to implement the input and output functions of the mobile device, in some embodiments, touch panel 1131 and display panel 1141 may be integrated to implement the input and output functions of the mobile device.

The mobile device 100 may also include at least one sensor 1150.

Audio circuitry 1160, speaker 1161, and microphone 1162 may provide an audio interface between a user and the mobile device. The audio circuit 1260 can transmit the electrical signal converted from the received audio data to the speaker 1161, and convert the electrical signal into a sound signal by the speaker 1261 for outputting; on the other hand, the microphone 1162 converts the collected sound signals into electrical signals, which are received by the audio circuit 1160 and converted into audio data, which are then processed by the audio data output processor 1180, and then transmitted to another mobile device via the camera 1110, or output to the memory 1120 for further processing.

The WiFi module 1170 may be used for communication.

The processor 1180 is a control center of the mobile device, connects various parts of the entire mobile device by using various interfaces and lines, and performs various functions of the mobile device and processes data by running or executing software programs and/or modules stored in the memory 1120 and calling data stored in the memory 1120, thereby monitoring the entire mobile device. Optionally, processor 1180 may include one or more processing units; preferably, the processor 1180 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated within processor 1180. Optionally, the processor 1180 may further include a display control function module.

The mobile device 100 also includes a power supply 1190 (e.g., a battery) for providing power to various components, which may be logically coupled to the processor 1180 via a power management system that may be configured to manage charging, discharging, and power consumption.

Although not shown, the mobile device 110 may further include a camera, a bluetooth module, and the like, which will not be described herein.

In this embodiment of the present invention, the processor 1180 included in the mobile device further has the following functions:

Optionally, generating a remote control instruction according to an operation triggered by the user on the page includes:

Optionally, monitoring an operation of the user on the page, responding to a click operation triggered by the user, and generating a remote control instruction, including:

monitoring nodes of a document object model of the page;

Optionally, the monitoring the nodes of the document object model of the page includes:

Optionally, the generating a remote control instruction according to an operation triggered by a user includes:

Optionally, the processor is further configured to implement:

Optionally, sending the remote control instruction to the television browser includes:

Optionally, acquiring a synchronization page provided by a television browser includes:

In this embodiment, the description of the mobile device 100 can be understood by referring to the description in each embodiment of the method for remotely controlling a television browser, and the description is not repeated here.

In accordance with the method shown in fig. 9, a television 1200 is described below with reference to fig. 12.

Referring to fig. 12, fig. 12 shows a structural diagram of a television according to an embodiment of the present application, and as shown in fig. 12, the television 1200 includes:

a receiving module 1201, configured to receive a remote control instruction sent by a mobile device browser; the remote control instruction comprises an operation type identifier and operation parameters;

and the response module 1202 is configured to parse the remote control instruction and control a page according to the operation type identifier and the operation parameter.

In addition, fig. 13 of the present application is a block diagram illustrating a partial structure of a television 1200 according to an embodiment of the present invention. Referring to fig. 13, the television includes: radio Frequency (RF) circuitry 1310, memory 1320, input unit 1330, display unit 1340, sensors 1350, audio circuitry 1360, WiFi module 1370, processor 1380, and power supply 1390. Those skilled in the art will appreciate that the mobile device configuration shown in fig. 13 does not constitute a limitation of the mobile device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The following describes the components of the mobile device in detail with reference to fig. 13:

RF circuitry 1310 may be used to transmit or receive data;

the memory 1320 may be used to store software programs and modules, and the processor 1380 executes various functional applications and data processing of the television by executing the software programs and modules stored in the memory 1320. The memory 1320 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the television, and the like. Further, the memory 1320 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1330 may be used to receive an operation instruction of a user and generate a key signal input related to user setting and function control of the mobile device 110. Specifically, the input unit 1330 may include a touch panel 1331 and other input devices 1332. Touch panel 1331, which may also be referred to as a touch screen, can collect touch operations (e.g., operations performed by a user on or near touch panel 1331 using any suitable object or accessory such as a finger, a stylus, etc.) by the user in contact or in non-contact with the touch panel 1331, and drive the corresponding connection terminal according to a preset program. Alternatively, the touch panel 1331 may include two portions of a touch detection terminal and a touch controller. The touch detection terminal detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing terminal, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 1380, and can receive and execute commands sent from the processor 1380. In addition, the touch panel 1331 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. Optionally, input unit 1330 may also include other input devices 1332. Other input devices 1332 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1340 may be used to display an interface. The Display unit 13240 may include a Display panel 1341, and the Display panel 1341 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-emitting diode (OLED), or the like. Further, touch panel 1131 can overlay display panel 1341, and when touch panel 1331 detects a touch operation thereon or nearby, the touch panel can transmit the touch operation to processor 1380 to determine the type of touch event, and processor 1380 can then provide a corresponding visual output on display panel 1341 according to the type of touch event. Although in fig. 13, the touch panel 1331 and the display panel 1341 are implemented as two separate components to implement the input and output functions of the television, in some embodiments, the touch panel 1331 and the display panel 1341 may be integrated to implement the input and output functions of the television.

The television 1200 may also include at least one sensor 1350.

Audio circuitry 1360, speakers 1361, microphone 1362 may provide an audio interface between the user and the television. The audio circuit 1360 may transmit the electrical signal converted from the received audio data to the speaker 1361, and the electrical signal is converted into a sound signal by the speaker 1361 and output; on the other hand, the microphone 1362 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 1360, and then outputs the audio data to the processor 1380 for processing, and then transmits the audio data to another terminal through the camera 1310, or outputs the audio data to the memory 1320 for further processing.

The WiFi module 1370 may be used for communication.

The processor 1380 is a control center of the tv, connects various parts of the entire tv using various interfaces and lines, and performs various functions of the tv and processes data by operating or executing software programs and/or modules stored in the memory 1320 and calling data stored in the memory 1320, thereby monitoring the whole tv. Optionally, processor 1380 may include one or more processing units; preferably, the processor 1380 may integrate an application processor, which handles primarily operating systems, user interfaces, application programs, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated within processor 1380. Optionally, the processor 1380 may further include a function module such as a display control module.

The television 1200 also includes a power supply 1390 (e.g., a battery) to supply power to various components, which may preferably be logically coupled to the processor 1380 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown, the television 1200 may further include a camera, a bluetooth module, etc., which will not be described herein.

In an embodiment of the present invention, the processor 1380 included in the mobile device further has the following functions:

Optionally, the processor is further configured to perform the following steps:

It should be noted that the functions of each functional module of the television according to the embodiment of the present application may be specifically implemented according to the method in the embodiment of the method shown in fig. 9, and the specific implementation process may refer to the description related to the embodiment of the method, which is not described herein again.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and functional modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A method for remotely controlling a television browser, applied to a mobile device, comprising:

configuring the resolution and the user agent identifier of the mobile equipment browser according to the resolution and the user agent identifier of the television browser; wherein configuring the user agent identification of the mobile device browser comprises: configuring the user agent identification of the mobile device browser to be consistent with the user agent identification of the television browser;

accessing the synchronous page, and redirecting the synchronous page to a page currently accessed by the television browser when the synchronous page is accessed; the synchronous page has a redirection function, and the initiation of the redirection function is triggered by the operation of accessing the synchronous page;

2. The method according to claim 1, wherein the generating a remote control instruction according to an operation triggered by a user on the page comprises:

3. The method of claim 2, wherein the monitoring user operations on the page, responding to user-triggered click operations, and generating remote control instructions comprises:

monitoring nodes of a document object model of the page;

4. The method of claim 2, wherein the listening to the nodes of the document object model of the page comprises:

5. The method of claim 2, wherein the listening to the nodes of the document object model of the page comprises:

6. The method according to claim 1, wherein the generating a remote control instruction according to an operation triggered by a user on the page comprises:

7. The method according to claim 1, wherein the generating a remote control instruction according to an operation triggered by a user on the page comprises:

8. The method of claim 1, wherein generating remote control instructions based on user-triggered operations comprises:

9. The method of claim 8, further comprising:

10. The method of claim 1, wherein generating remote control instructions based on user-triggered operations comprises:

11. The method of claim 1, wherein said sending said remote control command to said television browser comprises:

12. The method of claim 1, wherein obtaining synchronized pages provided by a television browser comprises:

13. A mobile device, comprising:

the configuration module is used for configuring the resolution and the user agent identification of the mobile equipment browser according to the resolution and the user agent identification; wherein configuring the user agent identification of the mobile device browser comprises: configuring the user agent identification of the mobile device browser to be consistent with the user agent identification of the television browser;

the access module is used for accessing the synchronous page, and the synchronous page is redirected to the currently accessed page when being accessed; the synchronous page has a redirection function, and the initiation of the redirection function is triggered by the operation of accessing the synchronous page;

14. A mobile device, comprising:

15. The mobile device of claim 14, wherein the generating of the remote control command according to the operation triggered by the user on the page comprises:

16. The mobile device of claim 15, wherein the monitoring user operations on the page, responding to user-triggered click operations, and generating remote control instructions comprises:

monitoring nodes of a document object model of the page;

17. The mobile device of claim 15, wherein the node listening to the document object model of the page comprises:

18. The mobile device of claim 15, wherein the node listening to the document object model of the page comprises:

19. The mobile device of claim 14, wherein the generating of the remote control command according to the operation triggered by the user on the page comprises:

20. The mobile device of claim 14, wherein the generating of the remote control command according to the operation triggered by the user on the page comprises:

21. The mobile device of claim 14, wherein the generating a remote control instruction according to a user-triggered operation comprises:

22. The mobile device of claim 20, wherein the processor is further configured to perform the steps of:

23. The mobile device of claim 14, wherein the generating a remote control instruction according to a user-triggered operation comprises:

24. The mobile device of claim 14, wherein the sending the remote control instruction to the television browser comprises:

25. The mobile device of claim 14, wherein the obtaining of the synchronized page provided by the television browser comprises:

26. A method for remotely controlling a television browser, applied to a television, comprising:

receiving a remote control instruction sent by a mobile equipment browser; the remote control instruction comprises an operation type identifier and operation parameters; the remote control instruction is generated according to the method for remotely controlling the television browser of any one of claims 1-12;

27. The method of claim 26, further comprising:

28. The method of claim 27, further comprising:

29. A television, comprising:

the receiving module is used for receiving a remote control instruction sent by a mobile equipment browser; the remote control instruction comprises an operation type identifier and operation parameters; the remote control instruction is generated according to the method for remotely controlling the television browser of any one of claims 1-12;

30. A television, comprising:

31. The television of claim 30, wherein the processor is further configured to perform the steps of:

32. The television of claim 31, wherein the processor is further configured to perform the steps of:

33. A computer-readable storage medium comprising instructions that, when executed on a mobile device, cause the mobile device to perform the method of remotely controlling a television browser of any of claims 1-12.

34. A computer-readable storage medium comprising instructions which, when run on a television, cause the television to perform the method of remotely controlling a television browser of any of claims 26 to 28.