WO2017121180A1

WO2017121180A1 - Multi-screen interaction method, device, server and non-transitory machine-readable storage medium

Info

Publication number: WO2017121180A1
Application number: PCT/CN2016/105454
Authority: WO
Inventors: 周文永
Original assignee: 优视科技（中国）有限公司
Priority date: 2016-01-15
Filing date: 2016-11-11
Publication date: 2017-07-20
Also published as: CN106980479B; CN106980479A

Abstract

A multi-screen interaction method, device, server (104) and non-transitory machine-readable storage medium, wherein, the method comprises: a first client acquires first data of a second client (S202); wherein, the first data is used to instruct the second client to perform a first operation; the first client performs the first operation instructed by the first data (S204). The above method resolves a technical issue in which a terminal receiving shared content cannot operate on the shared content.

Description

Multi-screen interactive method, device, server and non-transitory machine readable storage medium

Technical field

The present invention relates to the field of the Internet, and in particular to a method, apparatus, server, and non-transitory machine readable storage medium for multi-screen interaction.

Background technique

With the continuous development of technology, individuals may have electronic products such as mobile phones, computers, televisions and pads. Based on the purpose of sharing, the prior art can screen the content displayed on the display screen of the mobile phone to a television or a computer screen. Screening, as the name implies, is what is displayed on the display of the terminal that actively shares, and what is displayed on the screen of the terminal that accepts sharing, the essence of which is the operation of the terminal actively sharing, and the content displayed on the screen of the terminal that accepts the sharing. It is just a mapping of the screen of the terminal that actively shares. In other words, the screen of the terminal accepting the sharing is only a display device of the actively shared terminal, and the terminal accepting the sharing cannot operate the displayed interface. For example, the video played by the browser on the mobile phone is projected onto the television, and the mobile phone operates to play or pause the video, and the video can only display the playback or pause state of the video, and cannot control the playback or pause of the video.

In response to the above problems, no effective solution has been proposed yet.

Summary of the invention

The embodiments of the present invention provide a method, an apparatus, a server, and a non-transitory machine-readable storage medium for multi-screen interaction, so as to at least solve the technical problem that the terminal that accepts sharing cannot operate on the content shared by the actively shared terminal.

According to an aspect of the embodiments of the present invention, a method for multi-screen interaction is provided, including: acquiring, by a first client, first data of a second client, where the first data is used to instruct the second client to perform the first operation The first client performs the first operation indicated by the first data.

According to another aspect of the embodiments of the present invention, a method for multi-screen interaction includes: acquiring first data of a second client; the server forwarding the first data to a first client, so that The first client performs a first operation indicated by the first data.

According to another aspect of the present invention, an apparatus for multi-screen interaction is provided, including: an obtaining unit, configured to acquire first data sent by the second client to the first client, where the A data is used to instruct the second client to perform a first operation; and an execution unit is configured to execute the first operation indicated by the first data.

According to another aspect of the present invention, a server is provided, including: a data acquiring unit, configured to acquire first data of a second client, and a forwarding unit, configured to forward the first data to the first client Ending, so that the first client performs the first operation indicated by the first data.

According to another aspect of an embodiment of the present invention, there is also provided a non-transitory machine readable storage medium having stored thereon executable code that, when executed by a processor, causes the processor to perform the above The multi-screen interactive approach.

In the embodiment of the present invention, the first client acquires the first data of the second client, where the first data is used to instruct the second client to perform the first operation; the first client performs the The first operation indicated by the first data, each client is subordinate to the terminal where the client is located, and while receiving the content shared by the other client, the terminal can be controlled by the terminal where the client is located, essentially It is a separate control of the two clients, which solves the technical problem that the terminal that accepts sharing cannot operate on the content shared by the actively shared terminal, and achieves the technology that the terminal that accepts sharing can operate on the content shared by the actively shared terminal. effect.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present invention, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.

1 is a structural diagram of a hardware environment according to an embodiment of the present invention;

2 is a flow chart of a method of multi-screen interaction according to Embodiment 1 of the present invention;

3 is a flow chart of a method for multi-screen interaction according to Embodiment 2 of the present invention;

4 is a schematic diagram of a bidirectional link between a client and a server according to an embodiment of the present invention;

5 is a schematic diagram of the same link pool stored in a server by a link of the same account according to an embodiment of the present invention;

6 is a link of different accounts stored in the same link of the server according to an embodiment of the present invention Pool schematic

7 is a schematic diagram of an apparatus for multi-screen interaction in accordance with an embodiment of the present invention;

Figure 8 is a schematic illustration of a server in accordance with an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the invention described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

Example 1

In accordance with an embodiment of the present invention, an embodiment of a method of multi-screen interaction is also provided, it being noted that the steps illustrated in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions. Also, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

Optionally, in the embodiment, the method for multi-screen interaction described above may be applied to a hardware environment formed by the terminal (including the terminal 1022, the terminal 1024, and the terminal 1026) and the server 104 as shown in FIG. 1. As shown in FIG. 1 , the terminal is connected to the server 104 through a network, and the terminal is provided with a client. The network includes but is not limited to: a mobile communication network, a wide area network, a metropolitan area network, or a local area network. The terminal may be a mobile terminal, or may be PC terminal, notebook terminal, tablet terminal or television terminal. The server 104 described above includes a pool of links that store communication links for clients on multiple terminals.

The main working principle of the hardware environment system shown in FIG. 1 is: terminal 1022 (mobile phone), The respective communication links of the terminal 1024 (computer) and the terminal 1026 (television) are stored in the same link pool of the server 104. When any one of the above three terminals transmits data to the server 104, the server can receive the received data. Forward to the other two terminals. For example, the terminal 1022 performs the first operation and transmits the first data to the server 104, the server 104 forwards the first data to the terminal 1024 and the terminal 1026, and the terminal 1024 and the terminal 1026 also perform the first operation after receiving the first data. Similarly, the terminal 1024 can also send the second data generated by the second operation performed by the terminal 1024 to the server 104. After the server 104 forwards the second data to the terminal 1022 and the terminal 1026, the second operation is performed, thereby causing the three terminals. It is also possible to control other terminals to perform the same action in the case of realizing their own actions.

It should be noted that the actions performed by the terminal described herein can be understood as actions performed by the client set on the terminal, and the clients set on multiple terminals are the same client. The server 104 described above may be a device provided on the terminal, and can implement the functions of the server.

In the above hardware environment, the present application provides a method for multi-screen interaction as shown in FIG. 2, which can be executed in a client on a certain terminal. 2 is a flow chart of a method of multi-screen interaction in accordance with Embodiment 1 of the present invention.

As shown in FIG. 2, in step S202, the first client acquires the first data of the second client, where the first data is used to instruct the second client to perform the first operation.

In step S204, the first client executes the first operation indicated by the first data.

The first client may be a client set on any one of the hardware environments shown in FIG. 1. The first client and the second client are on different terminals and belong to the same client. The first client and the second client can perform the same function. For example, the first client and the second client can be browsers respectively installed on a mobile phone, a computer, and a television.

The first data may be data corresponding to the action performed by the second client, for example, data corresponding to the action of opening the webpage, data corresponding to the action of inputting the search content in the search bar, and the like. The first data is received by the first client, and the first client performs the first operation indicated by the first data, so that the first client and the second client perform the same action, and the display is performed on different clients. The same content, perform the same action.

Alternatively, the first data can be forwarded by the server to the first client. The server can be a device set on a terminal that can store and forward data.

According to the above embodiment, compared with the prior art projection screen (the projection of another terminal is displayed on one terminal, the content of the projection cannot be controlled), the client on the two terminals is divided. Do not perform the same action to achieve the same content displayed on the two terminals. Each client is subordinate to the terminal it is in. When receiving the content shared by another client, it can also be performed through the terminal where the client is located. Control is essentially the separate control of the two clients, which solves the technical problem that the terminal that accepts the sharing cannot operate on the content shared by the actively shared terminal, and achieves the content that the terminal that accepts sharing can share with the actively shared terminal. The technical effect of the operation.

At the same time, since the client can perform independent control without relying on other clients, each client can be controlled according to the characteristics of the terminal in which it is located, thereby improving the convenience of controlling the client.

For example, when playing a video with a TV version of a video player, it is easy to operate with a mobile phone or pad, playing a video on the phone/pad, entering a video name, and selecting a video to play. It is quite difficult to operate the TV version of the video player through the TV remote control. However, with the method provided in this embodiment, it is possible to search for video on a mobile phone or a pad, control video playback, play video on a television, or use a television remote control to control pause or resume playback of a video played on a television.

For example, browsing a page with a computer, but the operation of the mobile phone/pad slide is more convenient. At this time, the mobile phone is equivalent to a touch screen of the computer. When searching, use the computer to enter keywords. The results of the search can be browsed by sliding the phone/pad. Since the sliding on the mobile phone/pad also acts on the computer, the search result on the computer also moves with the sliding on the mobile phone/pad, so the search result can also be browsed from the computer. Multi-screen interaction can combine the convenience of the large screen and input of the computer with the ease of use of the mobile phone/pad operation, which improves the convenience of operation.

For example, the first client is a video player on the TV, the second client is a video player on the mobile phone, and the communication link between the video player on the TV and the video player on the mobile phone is stored in the same link pool of the server. in. After the video player on the mobile phone performs the action of “playing A video” (ie, the first operation), the video is played. The video player on the mobile phone generates an action of "playing A video" as the first data, and sends the first instruction to the server. The server forwards the first data received by the communication link of the video player on the mobile phone to other communication links in the same link pool, wherein one communication link is a communication link of the video player on the television, thereby the television The video player on the top can receive the first data. The video player on the TV acquires the "Play A Video" action corresponding to the first data, and then plays the video of the video player on the TV.

Optionally, the first operation indicated by the first client to execute the first data includes: the first guest The client parses the execution code and the execution object from the first data, wherein the operation performed on the execution object by the execution code is the first operation; the first client operates the execution object by using the execution code.

The execution code is a unified execution code that each client can recognize, and each execution code corresponds to an action, and the execution object may be an object that acts on the action corresponding to the execution code, and when the execution code operates on the execution object, The first operation is obtained, that is, the first operation includes performing an action corresponding to the code and an object corresponding to the execution object. Then, the client invokes the execution code to perform an operation on the execution object, and the first operation is implemented.

For example, in the above example, the first client is a video player on the TV and the second client is a video player on the phone. The video player on the mobile phone generates the first data according to "Play A Video". After the video player on the TV obtains the first data, the execution code is "play" and the execution object is "A video", and the video player on the television performs the operation of playing the A video.

The first client may perform a corresponding first operation according to the first data sent by the second client, and the first client may also perform a corresponding action according to the instruction received by the first client. For example, a video player on a television receives a "pause" signal from the remote control and pauses playback of the A video.

That is to say, the first client can perform the same operation according to the first data sent by the second client, and can also perform its own control separately, without being controlled by the second client, in the first client and the second. While the client displays the same content, it can also be individually controlled, thereby improving the flexibility of control of the first client and the second client.

Optionally, before the first client acquires the first data of the second client, the method further includes: determining, by the first client, whether the first instruction and the second instruction are received, where the first instruction is used to indicate that the first instruction is allowed The client sends the second data to the second client, where the second command is used to indicate that the first client is not allowed to send the second data to the second client, and the second data is used to indicate that the first client performs the second operation; And if the first client determines that the first instruction is received, monitoring the first data and the second operation performed by the first client, wherein, when the second operation is detected, generating the second data and reporting to the second client The second data is sent to enable the second client to perform the second operation; if the first client determines that the second command is received, the first data sent by the second client is monitored.

The first instruction and the second instruction may be a function on the first client, for example, the first instruction is a screen sharing and the second instruction is a follow-up browsing. When the first instruction of the first client is triggered, the first client may not only receive the first data of the second client to perform the first operation, but also The second operation performed is sent to the second client, thereby controlling the second client to perform the second operation; when the second instruction of the first client is triggered, the first client can only send the second client The first data is responsive to perform the first operation, and the second client does not send the second data to the second client even if the first client performs the second operation, and does not control the second client to perform the second operation.

For example, in the process of waiting for a car in winter, it is necessary to browse the news using a browser or a news application (first client), but the first client is not controlled by hand because the weather is too cold. At this point, the user can turn on the following browsing function of the first client and follow the browsing of the friend. That is, what content is displayed by the second client of the friend, what action is performed, the corresponding content is displayed on the first client, and the corresponding action is performed. The friend is a friend in the first client, requests the second client to follow the browsing, and if the second client agrees, receives the first data of the second client.

In the process of following the browsing, the first client only receives the first data of the second client, and performs the first operation corresponding to the first data. It should be noted that, whether it is following browsing or screen sharing, the first client only receives the first operation, and does not obtain the execution result after performing the first operation from the second client, which is equivalent to each client. They all execute their own logic independently, indicating that the received instruction is obtained from another client, not from the terminal it is on. For example, when the first operation is to open www.aaaa.com, the first client requests the content of www.aaaa.com from the server of www.aaaa.com instead of obtaining www.aaaa.com from the second client. Content.

The first client can perform the first operation corresponding to the first data sent by the second client, and can also perform the second operation performed by the terminal where the first client is located, and then, when In the second operation, the second data is generated, and the second data is sent to the second client, so that the second client also performs the second operation. Since the action performed by the first client is performed on the second client, the action performed by the second client is also executed on the first client, and the synchronization between the first client and the second client is implemented. On this basis, The first client executes the action performed by the second client, the second client performs the action performed by the first client, and the actions performed by the first client and the second client are not caused by the two clients. The confusion of the display content solves the technical problem that the receiving terminal cannot operate the content shared by the actively shared terminal, and at the same time ensures that the two clients display and run normally.

Optionally, in the case that the second operation is detected, generating the second data and sending the second data to the second client includes: the first client acquiring the execution code of the second operation and the execution object; the first client The execution code and the execution object are encapsulated into second data, wherein the execution code can be The second client executes, and the execution object can be operated by the second client by executing the code.

For example, after the video player on the mobile phone (ie, the first client) performs the "play A video" action (ie, the second operation), the video player on the mobile phone converts the "play" action into an execution code (such as 0001). Convert "A video" to an execution object (such as the name of the A video), and package the "play" action together with "A video" as the second data, and send it to the second client.

The process of generating the second data by the second client is similar to the process of generating the first data by the first client, and the first client and the second client adopt the same execution code and corresponding actions. After the second client receives the second data, the process of obtaining the second operation from the second data is similar to the process of obtaining the first operation from the first data by the first client.

Optionally, the first operation indicated by the first client to execute the first data includes: at least one operation indicated by the first client executing the first data includes: opening a window, opening a page, scrolling a page, inputting text , change focus, play and pause.

The second operation performed by the first client may also be any one or more of the foregoing first operations. Open the window, open the web page, scroll the page, etc. can be used in the browser (the first client or the second client), the play and pause can be applied in the video player, and the actions corresponding to other applications can also be used as the first operation. Executed in the corresponding application, not listed here.

If the first operation is complicated, not only needs to change the focus, but also input text, and also performs selection, then the first client splits the first operation into a combination of multiple actions, and sequentially performs multiple actions, thereby completing the completeness. The first operation.

In a specific example, the above multi-screen interaction method can also be used to push advertisements. For example, the second client performs an action of opening the advertisement A (ie, the first operation), then the server sends an action of opening the advertisement A to the first client, and the first client also performs an action of opening the advertisement A, thereby Realized the push of advertising.

With the above embodiment, the two clients on the two terminals can perform the actions performed by the other party, and can also receive the control of the terminal where the client is located. Therefore, the terminal that accepts the sharing cannot solve the terminal that is actively shared. The technical problem of the shared content being operated, and the technical effect that the terminal that accepts sharing can operate on the content shared by the actively shared terminal is obtained.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because in accordance with the present invention, certain steps may be in other orders Or at the same time. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Example 2

According to an embodiment of the invention, a method of multi-screen interaction is also provided. The method of multi-screen interaction is performed on a server, and FIG. 3 is a flowchart of a method of multi-screen interaction according to Embodiment 2 of the present invention.

As shown in FIG. 3, in step S302, the first data of the second client is acquired.

In step S304, the first data is forwarded to the first client, so that the first client performs the first operation indicated by the first data, where the first data is used to instruct the second client to perform the first operation. The first client may be a client set on any one of the hardware environments shown in FIG. 1. The first client and the second client are on different terminals and belong to the same client. The first client and the second client can perform the same functions, for example, browsers installed on mobile phones, computers, and televisions. Optionally, the first data is forwarded by the server from the second client to the first client.

As shown in Figure 4, each client (computer, mobile, tablet, and TV) has a two-way link with the server (ie, link A, link B, link C, and link D), that is, each client can send to the server. The data can also receive data sent by the server. Each client in FIG. 4 can be used as the first client or the second client. The server receives the first data in the link of any one client and forwards it to the client corresponding to the other link.

The first data may be data corresponding to an action performed by the second client, for example, data corresponding to an action of opening a web page, data corresponding to an action of inputting a search content in the search field, and the like. The first data is received by the first client by the forwarding of the server, and the first client performs the first operation indicated by the first data, so that the first client and the second client perform the same action. It is implemented to display the same content on different clients and perform the same actions.

It can be seen from the above embodiment that compared with the prior art projection screen (the projection of another terminal is displayed on one terminal, the projected content cannot be controlled), the clients on the two terminals respectively perform the same action to realize two The content displayed on each terminal is the same. Each client belongs to the terminal where it is located. When receiving the content shared by another client, it can also be controlled by the terminal where the client is located. In essence, it is two clients. The separate control of the terminal solves the technical problem that the terminal that accepts the sharing cannot operate on the content shared by the actively shared terminal, and achieves the technical effect that the terminal that accepts the sharing can operate the content shared by the actively shared terminal.

Optionally, the server forwarding the first data to the first client includes: the server storing the first communication link of the first client and the second communication link of the at least one second client in the same link pool; the server will pass one The data received by the second communication link is forwarded to the first communication link and the second communication link of the other second client of the at least one second client, wherein the data includes the first data.

As shown in FIG. 5, the server stores the four links shown in FIG. 4 (ie, link A, link B, link C, and link D) in the same link pool, and the computer executes the browser (ie, the first client). After the operation (ie, the first operation), the first operation to be executed is translated into the execution code and the execution object (ie, the first data is generated) is sent to the server through the first communication link (ie, link A), and the server will receive the first The data is sent to the browser on the phone, the browser on the tablet, and the browser on the TV (ie the second client and other second clients) via three second communication links (ie, link B, link C, and link D). End), the browser that obtains the first data translates the first data into execution code and parameters to perform the first operation. Links placed in the same link pool can be subordinate to the same login account user1.

When the server forwards the first data, it can also carry other data, for example, an advertisement that is pushed to a browser on the mobile phone, a browser on the tablet, and a browser on the television, a browser on the mobile phone, and a browser on the tablet. And the browser on the TV performs the first operation while loading the advertisement pushed by the server.

Optionally, the server storing the first communication link of the first client and the second communication link of the at least one second client in the same link pool includes: determining, by the server, whether the prompt information sent by the first client is received, the prompt information For prompting the first client to receive the first instruction or the second instruction, the first instruction is for indicating that the first client is allowed to send to the at least one second client Sending second data, the second instruction is for indicating that the first client is not allowed to send the second data to the at least one second client, and the second data is used to indicate that the first client performs the second operation; the server determines that the second operation is received After prompting the information, the first communication link of the first client and the second communication link of the at least one second client are stored in the same link pool.

The first instruction and the second instruction may be a function on the first client, for example, the first instruction is a screen sharing and the second instruction is a follow-up browsing. When the first instruction of the first client is triggered, the first client may not only receive the first data of the second client to perform the first operation, but also send the second operation performed by the first client to the second client, thereby controlling the first The second client performs the second operation; when the second instruction of the first client is triggered, the first client can only perform the first operation in response to the first data sent by the second client, even if the first client Performing the second operation also does not send the second data to the second client, and does not control the second client to perform the second operation.

The first client can perform the first operation corresponding to the first data sent by the second client, and can also perform the second operation performed by the terminal where the first client is located, and then, when In the second operation, the second data is generated, and the second data is sent to the second client, so that the second client also performs the second operation. Since the action performed by the first client is performed on the second client, the action performed by the second client is also executed on the first client, and the synchronization between the first client and the second client is implemented. On this basis, The first client executes the second client The actions that have been performed, the actions performed by the second client to execute the first client, and the actions performed by the first client and the second client respectively do not cause confusion of the display content on the two clients, and the acceptance is resolved. The shared terminal cannot solve the technical problem of the content shared by the actively shared terminal, and can also ensure that the two clients display and run normally.

Optionally, the first client and the second client corresponding to the communication link stored in the same link pool are subordinate to the same or different accounts.

In the example shown in FIG. 5, the clients corresponding to the links in the same link pool belong to the same account, that is, the clients of one user on multiple terminals log in with the same account, then multiple The links established between the client and the server are stored in the same link pool.

In the example shown in FIG. 6, the client requesting login account 1 (ie, user1) follows the content displayed on the client browsing another login account 2 (ie, user2), and logs in the browser user1 to the browser on the computer. The operation (ie, the first operation) is performed, and the browser on the computer translates the first operation into the execution code and the execution object (ie, the first data), and then sends it to the server through the link A.

The server's link pool not only stores the link A, but also stores the link E, the link F, and the link G of the client belonging to the login account 2 (user2), wherein the link E corresponds to the user's computer browser, and the link F corresponds to the user2's mobile browser. The link G corresponds to the TV browser of user2. That is, the clients corresponding to the links in the same link pool belong to different accounts, that is, the links established by the client and the server that are logged in with different accounts are stored in the same link pool by the server. Different accounts may be a friend relationship. Specifically, when the client of the login account 1 requests to follow the content displayed on the client browsing another login account 2, the account 2 may be one of the account 1 on the client. The friend, after issuing the follow-up request to the client of the login account 1, the server stores the link established by the client of the account 1 with the server and the link established by the client of the login account 2 with the server in the same link pool. Based on this, the client of the login account 2 can also implement the action performed by the client of the login account 1 to execute the client of the login account 2.

With the above embodiment, the two clients on the two terminals can perform the actions performed by the other party, and can also receive the control of the terminal where the client is located. Therefore, the terminal that accepts the sharing cannot solve the terminal that is actively shared. The technical problem of the shared content to operate, and the technical effect that the terminal that accepts sharing can operate the content shared by the actively shared terminal fruit.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

Example 3

According to an embodiment of the present invention, there is also provided an embodiment of a multi-screen interactive device, which can perform the multi-screen interaction method of Embodiment 1. As shown in FIG. 7, the multi-screen interactive device is provided with a first client, and the device includes an acquisition unit 70 and an execution unit 72.

The obtaining unit is configured to obtain first data that is sent by the second client to the first client, where the first data is used to indicate that the second client performs the first operation.

An execution unit, configured to acquire a first operation indicated by the first data, and perform a first operation of obtaining, where the first data is forwarded by the server from the second client to the first client, the first client, and the second The client is the same client set up on a different device terminal.

The first client may be a client set on any one of the hardware environments shown in FIG. 1. The first client and the second client are on different terminals and belong to the same client. The first client and the second client can perform the same functions, for example, browsers installed on mobile phones, computers, and televisions.

The first data may be data corresponding to an action performed by the second client, for example, data corresponding to an action of opening a web page, data corresponding to an action of inputting a search content in the search field, and the like. Receiving, by the server, the first data is received by the first client, the first client acquires the first operation indicated by the first data, and performs the first operation, so that the first client and the second client The client performs the same action, which enables the same content to be displayed on different clients and performs the same action.

For example, when playing a video with a TV version of a video player, it is easy to operate with a mobile phone or pad, playing a video on the phone/pad, entering a video name, and selecting a video to play. It is quite difficult to operate the TV version of the video player through the TV remote control. However, with the device provided in this embodiment, it is possible to search for video on a mobile phone or a pad, control video playback, play video on a television, or use a television remote control to control pause or resume playback of a video played on a television.

For example, browsing a page with a computer, but the operation of sliding the phone is more convenient, at this time, the mobile phone is equivalent to a touch screen of the computer. When searching, use the computer to enter keywords. The results of the search can be viewed by swiping the phone. Since the sliding on the mobile phone also acts on the computer, the search result on the computer also moves with the sliding on the mobile phone, so the search result can also be browsed from the computer. Multi-screen interaction can combine the convenience of the large screen and input of the computer with the ease of use of the mobile phone/pad operation, which improves the convenience of operation.

For example, the first client is a video player on the TV, the second client is a video player on the mobile phone, and the communication link between the video player on the TV and the video player on the mobile phone is stored in the same link pool of the server. in. After the video player on the mobile phone performs the action of “playing A video” (ie, the first operation), the video is played. The video player on the mobile phone generates an action of "playing A video" as the first data, and sends the first instruction to the server. The server forwards the first data received by the communication link of the video player on the mobile phone to other communications in the same link pool A link, one of which is a communication link of a video player on a television such that a video player on the television can receive the first data. The video player on the TV acquires the "Play A Video" action corresponding to the first data, and then plays the video of the video player on the TV.

Optionally, the execution unit includes: a parsing module, configured to parse the execution code and the execution object from the first data, wherein the operation performed on the execution object by using the execution code is a first operation; and the operation module is configured to utilize the execution code Operate the execution object.

Example 4

According to an embodiment of the present invention, there is also provided an embodiment of a server that can perform the method of multi-screen interaction of Embodiment 2. As shown in FIG. 8, the multi-screen interactive device is provided with a first client, and the device includes: a data acquisition unit 80 and a forwarding unit 82.

The data obtaining unit 80 is configured to acquire first data of the second client.

The forwarding unit 82 is configured to forward the first data to the first client, so that the first client acquires the first operation indicated by the first data, and performs the first operation of the obtaining, where the first data is used to indicate the first The second client performs the first operation, and the first data is forwarded by the server from the second client to The first client, the first client and the second client are the same client set on different device terminals.

The first data may be data corresponding to the action performed by the second client, for example, data corresponding to the action of opening the webpage, data corresponding to the action of inputting the search content in the search bar, and the like. Receiving, by the server, the first data is received by the first client, the first client acquires the first operation indicated by the first data, and performs the first operation, so that the first client and the second client perform the same The action is to display the same content on different clients and perform the same action.

Optionally, the forwarding unit includes: a storage module, configured to store the first communication link of the first client and the second communication link of the at least one second client in the same link pool; and the forwarding module is configured to pass the first The data received by the second communication link is forwarded to the first communication link and the second communication link of the other second client of the at least one second client, wherein the received data includes the first data.

As shown in Figure 5, the server will have four links as shown in Figure 4 (ie, link A, link B, chain). C and link D) are stored in the same link pool, and after the computer performs an operation (ie, the first operation) on the browser (ie, the first client), the first operation performed is translated into the execution code and the execution object (ie, Generating the first data) sent to the server through the first communication link (ie, link A), and the server sends the received first data to the mobile phone through three second communication links (ie, link B, link C, and link D) a browser, a browser on the tablet, and a browser on the television (ie, the second client and the other second client), the browser that obtains the first data translates the first data into execution code and parameters to perform the first An operation.

Optionally, the storage module includes: a determining submodule, configured to determine whether the prompt information sent by the first client is received, and the prompt information is used to prompt the first client to receive the first instruction or the second instruction, where the first instruction is used Instructing to allow the first client to send the second data to the at least one second client, the second instruction is for indicating that the first client is not allowed to send the second data to the at least one second client, where the second data is used to indicate a client performs a second operation; and the storage submodule is configured to store the first communication link of the first client and the second communication link of the at least one second client in the same link pool after determining that the prompt information is received in.

The server's link pool not only stores link A, but also stores link E, link F, and link G of the client belonging to login account 2 (user2), where link E corresponds to user2's computer browser. The link F corresponds to the mobile browser of user2, and the link G corresponds to the TV browser of user2. That is, the clients corresponding to the links in the same link pool belong to different accounts, that is, the links established by the client and the server that are logged in with different accounts are stored in the same link pool by the server. Different accounts may be a friend relationship. Specifically, when the client of the login account 1 requests to follow the content displayed on the client browsing another login account 2, the account 2 may be one of the account 1 on the client. The friend, after issuing the follow-up request to the client of the login account 1, the server stores the link established by the client of the account 1 with the server and the link established by the client of the login account 2 with the server in the same link pool. Based on this, the client of the login account 2 can also implement the action performed by the client of the login account 1 to execute the client of the login account 2.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

In the above-mentioned embodiments of the present invention, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed technical contents may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated in In a unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .

Accordingly, the above technical concept of the present invention can also be embodied as a non-transitory machine readable storage medium having executable code stored thereon. When the executable code is executed by the processor, the processor is caused to perform the method described above.

In another aspect, the above technical concept of the present invention can also be embodied as a computing device including a processor and a non-transitory machine readable storage medium. The non-transitory machine readable storage medium stores executable code thereon. When the executable code is executed by the processor, the processor is caused to perform the method described above.

Further, the above technical idea of the present invention can also be embodied as a computer program product including executable code. When the executable code is executed by the processor, the processor is caused to perform the method described above.

The above description is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

Claims

A method for multi-screen interaction, characterized in that it comprises:

The first client acquires the first data of the second client, where the first data is used to instruct the second client to perform the first operation;

The first client performs the first operation indicated by the first data.
The method according to claim 1, wherein the first operation indicated by the first client to perform the first data comprises:

The first client parses an execution code and an execution object from the first data, wherein an operation performed on the execution object by using the execution code is the first operation;

The first client operates the execution object with the execution code.
The method according to claim 1, wherein before the first client acquires the first data of the second client, the method further includes:

Determining, by the first client, whether the first instruction and the second instruction are received, where the first instruction is used to indicate that the first client is allowed to send second data to the second client, where the The second instruction is configured to indicate that the first client is not allowed to send the second data to the second client, and the second data is used to indicate that the first client performs a second operation;

And if the first client determines that the first instruction is received, monitoring the first data and the second operation performed by the first client, where the second operation is monitored In case, the second data is generated and sent to the second client, so that the second client performs the second operation;

And if the first client determines that the second instruction is received, monitoring the first data sent by the second client.
The method according to claim 3, wherein, in the case that the second operation is detected, generating the second data and transmitting the second data to the second client comprises:

The first client acquires an execution code and an execution object of the second operation;

The first client encapsulates the execution code and the execution object into the second data, wherein the execution code can be executed by the second client, and the execution object can be the second The client operates through the execution code.
The method according to claim 1, wherein the first operation indicated by the first client to perform the first data comprises:

The first operation indicated by the first client to execute the first data includes at least one of the following operations: opening a window, opening a page, scrolling a page, entering text, changing focus, playing, and pausing.
The method of claim 1 wherein said first data is forwarded by said server from said second client to said first client.
A method for multi-screen interaction, characterized in that it comprises:

Obtaining the first data of the second client;

Forwarding the first data to the first client, so that the first client performs a first operation indicated by the first data, where the first data is used to indicate the second client Perform the first operation.
The method of claim 7, wherein forwarding the first data to the first client comprises:

Depositing the first communication link of the first client and the second communication link of the at least one second client in the same link pool;

Forwarding data received through one of the second communication links to the second communication link of the first communication link and the other of the at least one of the second clients, wherein The received data includes the first data.
The method according to claim 8, wherein storing the first communication link of the first client and the second communication link of the at least one second client in the same link pool comprises:

Determining whether the prompt information sent by the first client is received, the prompt information is used to prompt the first client to receive a first instruction or a second instruction, where the first instruction is used to indicate that the first instruction is allowed a client transmitting second data to at least one of the second clients, the second instruction being used to refer to The first client is not allowed to send the second data to at least one of the second clients, and the second data is used to instruct the first client to perform a second operation;

After determining that the prompt information is received, storing the first communication link of the first client and the second communication link of at least one of the second clients in the same link pool.
The method according to claim 8 or 9, wherein the first client and the second client corresponding to the communication link stored in the same link pool are subordinate to the same or different accounts.
A device for multi-screen interaction, characterized in that a first client is provided, and the device comprises:

An acquiring unit, configured to acquire first data that is sent by the second client to the first client, where the first data is used to instruct the second client to perform a first operation;

And an execution unit, configured to execute the first operation indicated by the first data.
The apparatus according to claim 11, wherein the execution unit comprises:

a parsing module, configured to parse the execution code and the execution object from the first data, wherein the operation performed on the execution object by using the execution code is the first operation;

An operation module, configured to operate the execution object by using the execution code.
A server, comprising:

a data obtaining unit, configured to acquire first data of the second client;

a forwarding unit, configured to forward the first data to the first client, to enable the first client to perform a first operation indicated by the first data, where the first data is used to indicate The second client performs the first operation.
The server according to claim 13, wherein the forwarding unit comprises:

a storage module, configured to store the first communication link of the first client and the second communication link of the at least one second client in a same link pool;

a forwarding module, configured to forward data received through one of the second communication links to the first communication link and the second of the at least one of the other second clients of the second client In the communication link, wherein the received data includes the first data.
The server according to claim 14, wherein the storage module comprises:

a determining sub-module, configured to determine whether the prompt information sent by the first client is received, where the prompt information is used to prompt the first client to receive a first instruction or a second instruction, where the first instruction is used Instructing to allow the first client to send second data to at least one of the second clients, the second instruction to indicate that the first client is not allowed to send to the at least one of the second clients The second data is used to indicate that the first client performs a second operation;

a storage submodule, configured to store the first communication link of the first client and the second communication link of the at least one second client in the same after determining that the prompt information is received In a link pool.
The server according to claim 14 or 15, wherein the first client and the second client corresponding to the communication link stored in the same link pool are subordinate to the same or different accounts.
A non-transitory machine readable storage medium having stored thereon executable code that, when executed by a processor, causes the processor to perform the method of any one of claims 1 to 10. method.