CN102821143B

CN102821143B - Terminal cooperation method, equipment and system

Info

Publication number: CN102821143B
Application number: CN201210257049.6A
Authority: CN
Inventors: 加雄伟
Original assignee: China United Network Communications Group Co Ltd
Current assignee: China United Network Communications Group Co Ltd
Priority date: 2012-07-23
Filing date: 2012-07-23
Publication date: 2015-09-16
Anticipated expiration: 2032-07-23
Also published as: CN102821143A

Abstract

The invention provides a kind of terminal cooperation method, equipment and system.This terminal cooperation method comprises: receive the operation requests message that first terminal sends, described operation requests message carries the mark of the second terminal; Judge whether described operation requests message meets preset standard; Know that described operation requests message meets preset standard if judge, then according to the mark of described second terminal, the operational notification message corresponding with described operation requests message is sent, to make described second terminal according to the process of described operational notification message executable operations to described second terminal.Terminal cooperation method provided by the invention, equipment and system achieve the co-operation between different terminals.

Description

Terminal cooperative operation method, device and system

Technical Field

The invention relates to a terminal control technology, in particular to a terminal cooperative operation method, device and system, and belongs to the technical field of communication.

Background

With the development of intelligent terminals and the internet, various intelligent terminals play an extremely important role in the daily life of people. The number of users of the terminal is increasingly huge, and the same user often owns a plurality of terminals, such as a smart phone, an internet television, a computer, and the like. A user can watch internet television (IPTV), browse multimedia information on an internet community, and the like using the terminal.

At present, the operation of each terminal is independent, which includes the mutual independence between terminals of different users, for example, computers of different users respectively play independent videos; the method also includes mutual independence between different terminals of the same user, for example, when the user needs to use a certain terminal, the user needs to directly perform corresponding operations on the terminal, for example, when media content is watched through an internet television, the user needs to directly select playing content on the internet television and click to play the content.

It can be seen that in the prior art, the cooperative operation between different terminals is not implemented.

Disclosure of Invention

Aiming at the defects in the prior art, the terminal cooperative operation method, the terminal cooperative operation equipment and the terminal cooperative operation system provided by the invention realize the cooperative operation among different terminals.

According to an aspect of the present invention, there is provided a peer cooperative operation method including:

receiving an operation request message sent by a first terminal, wherein the operation request message carries an identifier of a second terminal;

judging whether the operation request message meets a preset standard or not;

and if the operation request message is judged to meet the preset standard, sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal, so that the second terminal executes operation processing according to the operation notification message.

According to another aspect of the present invention, there is provided a terminal cooperative operation apparatus including:

the request receiving module is used for receiving an operation request message sent by a first terminal, wherein the operation request message carries an identifier of a second terminal;

the judging module is used for judging whether the operation request message meets a preset standard or not;

and the request processing module is used for sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal if the operation request message is judged to meet the preset standard, so that the second terminal executes operation processing according to the operation notification message.

According to another aspect of the present invention, there is provided a terminal cooperation system, comprising the terminal cooperation apparatus provided by the present invention, and a first terminal and a second terminal connected to the terminal cooperation apparatus.

According to the terminal cooperative operation method, device and system provided by the invention, after the operation request message sent by the first terminal is received, the operation notification message used for indicating the second terminal to execute the corresponding operation is sent to the second terminal according to the identifier of the second terminal carried in the operation request message, so that a user can control the second terminal to execute the required operation through the first terminal, and the cooperative operation of multiple terminals is realized.

Drawings

Fig. 1 is a diagram of a media playback synchronization system architecture.

Fig. 2 is a flowchart illustrating a terminal cooperation method according to an embodiment of the present invention.

Fig. 3 is a signaling diagram of the synchronization management client initiating play sharing.

Fig. 4 is a signaling diagram of the synchronization management client terminating the broadcast sharing.

Fig. 5 is a signaling diagram of a user initiating a media play status synchronization invitation.

Fig. 6 is a signaling diagram illustrating a user applying for media playing status synchronization.

Fig. 7 is a diagram illustrating task management performed by the state management server.

Fig. 8 is a schematic structural diagram of a terminal cooperative operation apparatus according to an embodiment of the present invention.

Detailed Description

Fig. 1 is a diagram of a media playback synchronization system architecture. As shown in fig. 1, the system includes a state management server 11, a synchronization management client 12, and a media playback client 13. The state management server 11 is configured to support synchronized media playing in a multi-device environment, and manage connection state information, media playing information, playing synchronization information, and the like of the synchronization management client 12 and the media playing client 13. The synchronous management client 12 is deployed at a user terminal and used for managing user information, registering and/or canceling users, managing media playing programs played by the media playing client 13, remotely managing synchronous playing state information of the media playing client 13, inviting other users to synchronize with own playing states, applying for synchronizing with the playing states of other users, checking synchronous applications of the playing states of other users, and the like. The media playing client 13 is deployed at a user terminal, and selects and plays media programs, shares playing state information, synchronizes with playing states of other users, and the like according to user operations.

In the system architecture shown in fig. 1, only one state management server 11 is taken as an example for explanation, but those skilled in the art will understand that there may be a plurality of state management servers, and the plurality of state management servers cooperate with each other to provide services for users in different areas. The following embodiments will be described with reference to the example that the synchronization management client 12 and the media playing client 13 are deployed on different terminals (the synchronization management client is deployed on a first terminal, and the media playing client is deployed on a second terminal). However, in actual deployment, the synchronization management client 12 and the media playing client 13 may be distributed to different terminals or may coexist in the same terminal. The technical solution of the embodiment of the present invention is described in detail below by taking the technical solution of implementing the embodiment of the present invention in the above system architecture as an example.

Example one

The terminal cooperation method of the present embodiment will be described below from the perspective of the status management server.

Fig. 2 is a flowchart illustrating a terminal cooperation method according to an embodiment of the present invention. As shown in fig. 2, the terminal cooperation method includes the steps of:

step S101, receiving an operation request message sent by a first terminal, wherein the operation request message carries an identifier of a second terminal;

step S102, judging whether the operation request message meets a preset standard or not;

step S103, if the operation request message is judged to meet the preset standard, an operation notification message corresponding to the operation request message is sent to the second terminal according to the identifier of the second terminal, so that the second terminal executes operation processing according to the operation notification message.

Specifically, taking an example in which a first user has both a first terminal and a second terminal, when the first user wishes to control the second terminal to perform a certain operation by operating the first terminal, the first user transmits an operation request message to the state management server through the first terminal. After receiving the operation request message from the first terminal, the state management server checks whether the operation request is legal according to a preset standard, more specifically, for example, detects whether a second terminal identifier in the operation request message is legal for the state management server, or determines whether the second terminal supports an operation type corresponding to the operation request message according to a performance corresponding to each terminal identifier stored in the state management server; in addition, when the operation request message also carries a first terminal identifier, the state management server can also detect whether the first terminal has the authority to initiate the operation request message or not according to the first terminal identifier.

And if the state management server detects that the operation request message is illegal, returning the feedback-unsupported information to the first terminal, and terminating the subsequent operation. And if the operation request message is legal, sending the feedback information waiting for processing to the first terminal, and sending an operation notification message corresponding to the operation request message to the second terminal.

After receiving the operation notification message, the second terminal executes corresponding operation processing according to the operation notification message, and if the operation is successful, sends feedback information of successful operation to the state management server; and if the operation fails, sending feedback information of the operation failure to the state management server. If the state management server receives the feedback information of successful operation, the state management server sends notification information of successful operation execution of the second terminal to the first terminal; and if the state management server receives the feedback information of the operation failure, or does not receive the feedback information returned by the second terminal within a certain preset time, sending the feedback information of the operation failure of the second terminal to the first terminal.

According to the terminal cooperative operation method of the embodiment, after receiving the operation request message sent by the first terminal, the state management server sends the operation notification message for instructing the second terminal to execute the corresponding operation to the second terminal according to the identifier of the second terminal carried in the operation request message, so that the user can control the second terminal to execute the required operation through the first terminal, and the cooperative operation of multiple terminals is realized.

In the above embodiment, the first terminal and the second terminal may be different terminals of the same user, or may be terminals of different users. Specific application scenarios are, for example: the first terminal and the second terminal are respectively a mobile phone and an internet television of the same user, and through the terminal cooperation method of the embodiment, the user can remotely control the internet television to play the multimedia program by operating the mobile phone. For another example: in different rooms, a plurality of second terminals are respectively arranged, and through the terminal cooperation method of the embodiment, one first terminal can be used for controlling the plurality of second terminals, so that unified management and control of the terminals are realized.

Example two

In this embodiment, an application scenario in which a first terminal controls a second terminal to play a media program is taken as an example to perform an extended description on the terminal cooperation method of the present invention.

In this application scenario, the receiving an operation request message sent by a first terminal in the first embodiment, where the operation request message carries an identifier of a second terminal specifically includes:

receiving a play request message sent by the first terminal, wherein the play request message carries an identifier and a play parameter of the second terminal;

correspondingly, the sending, according to the identifier of the second terminal, an operation notification message corresponding to the operation request message to the second terminal, so that the second terminal performs operation processing according to the operation notification message specifically includes:

and sending a playing notification message to the second terminal according to the identifier of the second terminal, wherein the playing notification message carries the playing parameter, so that the second terminal executes playing operation according to the playing parameter.

Specifically, the steps of selecting a media program through a first terminal and controlling a second terminal to play the media program include:

step S201, a user selects a media program by using a synchronous management client (a first terminal) and sends a play request message to a state management server so as to inform the media play client (a second terminal) to play the selected media program through the state management server;

the play request message sent by the synchronization management client to the state management server includes, for example: an identifier of the media playing client (when the user only has one media playing client and the state management server stores the mapping relationship between the user and the media playing client, the identifier of the user may be included); in addition, the identification of the synchronization management client, when the user selects a media program which is specifically desired to be played on the synchronization management client, the identification of the media program, and the playing attribute (such as the starting time, the ending time, whether to loop, etc.) may also be included.

Step S202, the state management server checks the playing request message sent by the synchronous management client, if the request is supported, the feedback information waiting for processing is sent to the synchronous management client, otherwise, the feedback information not supported is sent to the synchronous management client, and the subsequent operation is terminated;

step S203, the state management server sends a play notification message to the media playing client, and notifies the media playing client to play the media program selected by the user on the first terminal, where the play notification message includes: an identifier of a media playing client (an identifier of a user), an identifier of a synchronous management client, an identifier of a media program, playing attributes (starting time, ending time, whether to loop or not, and the like), an identifier of a state management server, and the like;

and after the state management server sends a playing notification message to the media playing client, the state management server waits for the feedback of the media playing client. If the feedback of the media playing client is not received within the preset time, or the selected media program refusing to be played is received, the state management server sends a message that the playing of the media program fails to the synchronous management client, and terminates the subsequent operation process. The state management server may send the play notification message to the media playing client using a message protocol such as Short Message Service (SMS) or PUSH message service (PUSH).

Step S204, the media playing client plays the selected media program. And if the playing fails, sending feedback information of the playing failure to the state management server. And if the playing is successful, sending feedback information of successful playing to the state management server.

In step S205, the status management server confirms the status feedback information uploaded by the media playing client, and at the same time, the status management server sends the actual status of the playing media (for example, success or failure) to the synchronization management client according to the feedback information of the media playing client.

According to the terminal cooperative operation method of the embodiment, when a user has a plurality of terminals, the terminal integrated with the synchronous management client is used for selecting the media program, and the state management server informs the terminal integrated with the media playing client to play the selected media program, so that terminal cooperative operation is realized.

In the terminal cooperation method in the above embodiment, the synchronization management client controls the media playing client to play the media program, which is taken as an example, for explanation. But the user can also directly use the media playing client to select and play the media program, and the media playing client sends a corresponding notification at the synchronous management client, so that the synchronous management client can know the working state of the media playing client. The specific process comprises the following steps:

step S201', the user selects and plays a media program using the media playing client, and sends playing status information to the status management server, where the playing status information includes: the system comprises a user identification, a media program identification, a media playing client identification, a request for notifying a synchronous management client by a request state management server and the like.

Step S202', the state management server confirms the playing state information of the media playing client, and meanwhile, responds to the request of the request state management server carried by the playing state information to notify the synchronous management client of the request state management server, and sends a corresponding notification message to the synchronous management client to notify the user that the media playing client has been used to play the media program. The notification message includes, for example: the identification of the user, the identification of the media playing client, the identification of the media program currently being played, and the like.

Wherein, the state management server can use message protocol such as SMS or PUSH to send the notification message to the synchronization management client. The synchronous management client end receives the notification message to know that the media playing client end plays the media program, the identifier of the played media program and the like, so that the synchronous management client end realizes the monitoring of the media playing client end and can control the media playing client end based on the obtained notification message. The specific application scenario is that, for example, a parent monitors a media program watched by a child through a media playing client through a synchronous management client.

EXAMPLE III

In this embodiment, an application scenario in which a first terminal integrated with a synchronization management client initiates a playing and sharing request to enable a second terminal integrated with a media playing client to synchronously share a played media program is taken as an example, and the terminal cooperation method of the present invention is explained in an expanded manner.

receiving a play sharing request message sent by the first terminal, wherein the play sharing request message carries an identifier and sharing authority information of the second terminal;

sending a broadcast sharing enabling notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the broadcast sharing enabling notification message and feeds back a broadcast sharing enabling request message;

receiving the play sharing enabling request message, and sending a play sharing enabling confirmation message carrying a session identifier to the second terminal, so that the second terminal uploads media play state information according to the session identifier;

and receiving the media playing state information to finish playing sharing.

Specifically, in this application scenario, a user may initiate a play state sharing operation using a synchronization management client. The synchronous management client sends the playing and sharing request of the user to the state management server, the state management server audits the playing and sharing request of the user, and if the playing and sharing request of the user is supported, the media playing client of the user is informed to upload the media playing state. And after obtaining the notification, the media playing client establishes a session process with the state management server and continuously uploads the media playing state. The state management server maintains the online state of the user, the online state of the user client, the media playing state of the user and the like.

More specifically, fig. 3 is a signaling diagram of a synchronization management client initiating play sharing, and as shown in fig. 3, the synchronization management client initiating play sharing includes the following steps:

step S301, a user uses a synchronous management client to send a play sharing request to a state management server so as to request to share the own media play state to other users (terminals);

the playing and sharing request includes an identifier of the user, and may further include information such as sharing authority setting (whether other users can see or not, whether other users can synchronize or not, and the like).

Step S302, the state management server confirms the playing sharing request of the user;

specifically, the state management server checks the play sharing request sent by the synchronous management client, and determines whether the play sharing request of the user is supported. If not, the unsupported information is fed back to the synchronization management client, and then the subsequent processing procedure is closed. If yes, feeding back the play sharing request of the supporting user to the synchronization management client, and executing step S303. The information fed back to the synchronization management client only includes whether the relevant request is supported or not, and does not indicate that the playing sharing of the user is successfully supported currently.

Step S303, the state management server sends a broadcast sharing enabling notification message to the media broadcast client of the user, notifies the media broadcast client of starting the media broadcast state sharing process, and if the media broadcast client successfully obtains the notification message, step S304 is executed.

Wherein the notification process may be asynchronous. The state management server can send a broadcast sharing enabling notification message to the media broadcast client through PUSH, SMS and other message protocols. The content enabling to play the sharing notification message includes, for example: user identification, state management server identification, sharing authority setting and the like.

After sending a broadcast sharing enabling notification message to the media broadcast client, the state management server waits for the media broadcast client to request to start a shared media broadcast state process (broadcast sharing enabling request message). If the broadcast sharing enabling request message is not received within a predetermined time (e.g., 1 hour), step S307 is executed to notify the synchronization manager that the broadcast sharing cannot be successfully enabled, and then the subsequent processing procedure is closed.

In step S304, the media playing client sends a play sharing enabling request message to the state management server to request to start the process of sharing the media playing state.

The broadcast sharing request message is enabled to include, for example, a decryption password for protecting the media broadcast state information. When the media playing client sends the media playing state information to the state management server after playing sharing is started, the media playing state information can be encrypted by using the encryption password corresponding to the decryption password, and correspondingly, the state management server decrypts by using the decryption password to obtain actual media playing state data. Through the encrypted communication of the media playing state information, the data security and the privacy of the user are guaranteed. The media playing client generates the encryption password and the decryption password for protecting the media playing state information by using a common symmetric algorithm (for example, an elliptic curve algorithm) and the like, for example.

Step S305, the state management server checks a play sharing enabling request message sent by the media play client, and if the request message is supported, feeds back a process that can start a shared media play state to the media play client, otherwise, feeds back that the related operation is not supported.

Specifically, for example, if the state management server does not support the broadcast state, it is determined that the broadcast sharing is not supported, and feedback information carrying an identifier indicating that the broadcast state is not supported is fed back to the media playing client, the media playing client ends the corresponding operation process, and step S307 is executed.

If the state management server supports the playing sharing, a related session is established, and the feedback information returned to the media playing client carries the identification information of the session, so that the media playing client uses the session to upload the media playing state information to the state management server.

Step S306, the media playing client uploads its own media playing status information to the status management server.

The media playing client can upload the media playing state information in real time or according to a preset period according to the setting. When the media playing client side uploads the media playing state information, the media playing client side encrypts the playing state information by using the encryption password, and the state management server decrypts the encrypted playing state information by using the decryption password.

In step S307, the state management server sends the processing result of the shared media playing state to the synchronization management client.

The processing result is information such as successful establishment of the process of sharing the media playing state, or establishment failure (including the reason of failure when the process fails), and the like. And the synchronous management client can acquire whether the playing state of the media playing client is in the sharing state according to the received processing result.

Through the steps, the synchronous management client uploads the media playing state of the media playing client to the state management server, namely, the media playing state which can be shared by other terminals is provided. After the synchronous management client obtains the media playing state of the media playing client, the media playing state is provided for the terminals conforming to the sharing authority, and therefore media playing state sharing among different terminals can be achieved. For example, the media playing client that enables the media playing state sharing is an internet television, and uploads the identifier and the playing progress (i.e., the media playing state) of the currently played media content to the state management server, and the state management server provides the media playing state to another terminal that meets the sharing authority, so that the terminal plays the same media content according to the same playing progress, thereby realizing the synchronization of the media playing state.

According to the terminal cooperative operation method of the embodiment, the media playing state sharing of the terminal is realized, so that people can share with family or friends and the like located at different places when watching multimedia programs, and the users synchronously watch the same multimedia information by using different terminals (mobile phones, televisions, computers and the like).

Example four

In this embodiment, an application scenario in which a first terminal integrated with a synchronous management client initiates a request for stopping playing sharing in a playing sharing state, so that a second terminal integrated with a media playing client stops playing sharing state is taken as an example, and the terminal cooperation method of the present invention is explained in an expanded manner.

receiving a play sharing suspension request message sent by the first terminal, wherein the play sharing suspension request message carries an identifier of the second terminal and a task identifier of a play sharing task requested to be suspended;

sending a playing sharing suspension notification message to the second terminal according to the identifier of the second terminal, wherein the playing sharing notification message carries the task identifier of the playing sharing task requested to be suspended, so that the second terminal responds to the playing sharing suspension notification message to feed back an uploading media playing state information suspension request message, and the uploading media playing state information suspension request message carries the task identifier of the playing sharing task requested to be suspended;

and receiving the request message for stopping uploading the media playing state information, releasing the session corresponding to the task identifier, and sending a confirmation message for stopping uploading the media playing state information to the second terminal, so that the second terminal responds to the confirmation message for stopping uploading the media playing state information and stops uploading the media playing state information.

Specifically, fig. 4 is a signaling diagram of the synchronization management client terminating the broadcast sharing. As shown in fig. 4, the process of suspending the play sharing state by the synchronization management client includes the following steps:

step S401, the synchronization management client sends a request message for stopping playing and sharing to the state management server, and applies for stopping the playing state of the shared media.

Wherein, the request message for suspending playing and sharing includes: user identification, task identification of sharing media playing state, identification of synchronous management client and the like.

Step S402, the state management server feeds back a confirmation acceptance application to the synchronization management client, and prepares to suspend the shared media playing state.

In step S403, the state management server sends a play sharing suspension notification message to the media playing client, and requests the media playing client to suspend uploading the media playing state.

Step S404, the media playing client sends a request message for suspending uploading the media playing status information to the status management server.

Wherein, the request message for suspending uploading the media playing status information includes, for example: the media playing system comprises a user identifier, a task identifier for sharing a media playing state, a media playing client identifier, a notification identifier of a state management server and the like.

In step S405, the state management server responds to the media playing client request to determine whether the suspension of the uploading of the media playing state is supported. If the state management server agrees, the media playing client ends the media playing state uploading. And if the state management server does not agree, the media playing client continues to upload the media playing state.

In step S406, the state management server sends a request processing result for stopping the playing state of the shared media to the synchronization management client. If the process of the related shared media playing state is successfully stopped, the state management server sends a result of successfully stopping the shared media playing state to the synchronous management client, otherwise, the state management server sends an unsuccessful result and simultaneously feeds back the reason of the failure.

In step S407, the state management server sends a notification of the end of the shared media playing state to the clients (including the media playing client and the synchronization management client) of the other users who synchronize the playing state (not shown in fig. 4). And if a plurality of users synchronously share the media playing state, respectively sending a notice of the end of the shared media playing state to the client of each user. The notification of the end of the shared media playing state includes, for example: an identifier of the shared media playing state, a reason for terminating the sharing of the media playing state, and the like.

According to the terminal cooperative operation method of the embodiment, the user initiates the play sharing suspension request by using the first terminal integrated with the synchronous management client in the play sharing state, so that the second terminal integrated with the media play client terminates the play sharing state, and the play sharing is flexibly controlled through terminal cooperative operation.

Further, in addition to the application scenario in which the first terminal integrated with the synchronous management client initiates the request for suspending the playing and sharing so that the second terminal integrated with the media playing client terminates the playing and sharing state, the second terminal integrated with the media playing client may also initiate the request for suspending the playing and sharing by the state management server.

Specifically, the user may suspend sharing the media playing status through the media playing client. In addition, when the media in the shared playing state is played completely or the media playing client is closed, a request for stopping the shared media playing state may be sent to the state management server. More specifically, the suspending of the playing sharing state by the media playing client includes the following steps:

the media playing client sends a request message for stopping uploading the media playing state information to the state management server. Wherein, the request message for suspending uploading the media playing status information includes, for example: the method comprises the steps of identifying a user, a task identifier for sharing a media playing state and an identifier of a media playing client;

the state management server responds to the request of the media playing client, and if the state management server checks and confirms that the request message for stopping uploading the media playing state information is legal and returns the agreed feedback information, the media playing client stops uploading the media playing state. If the state management server checks and confirms that the request message for stopping uploading the media playing state information is illegal and returns the feedback information which is not agreed, the media playing client continues to upload the media playing state;

the state management server informs the synchronous management client that the playing and sharing are terminated;

and the state management server sends a notice of the end of the shared media playing state to the clients (including the media playing client and the synchronization management client) of other users synchronizing the playing state. And if a plurality of users synchronously share the media playing state, respectively sending a notice of the end of the shared media playing state to the client of each user. The notification of the end of the shared media playing state includes, for example: an identifier of the shared media playing state, a reason for terminating the sharing of the media playing state, and the like.

Specifically, the state management server may actively close a process of sharing a media playing state according to a system operating condition or an operation policy. More specifically, the step of suspending the play sharing state by the state management server includes the steps of:

and the state management server sends a notice of the end of the shared media playing state to the clients (including the media playing client and the synchronization management client) of other users synchronizing the playing state. And if a plurality of users synchronously share the media playing state, respectively sending a notice of the end of the shared media playing state to the client of each user. The notification of the end of the shared media playing state comprises: an identifier of the shared media playing state, a reason for terminating the sharing of the media playing state, and the like.

And the state management server informs the synchronous management client that the playing sharing is terminated.

The state management server sends a message of stopping playing and sharing to the media playing client, and the media playing client directly stops uploading the media playing state after receiving the notification.

EXAMPLE five

In this embodiment, an application scenario in which a user (referred to as a first user in this embodiment) invites another user (referred to as a second user in this embodiment) to synchronize with a media playing state of the user is taken as an example to expand the terminal cooperation method of the present invention.

In this embodiment, it is assumed that a first user has a first terminal and a second terminal, and a second user has a third terminal and a fourth terminal, where the first terminal is integrated with a first synchronous management client, the third terminal is integrated with a second synchronous management client, the second terminal is integrated with a first media playing client, the fourth terminal is integrated with a second media playing client, and the first terminal, the second terminal, the third terminal, and the fourth terminal are all connected to a same status management server, and the status management server stores a corresponding relationship and an identifier between each user and its terminal.

Specifically, fig. 5 is a signaling diagram of a user initiating a media playing state synchronization invitation. As shown in fig. 5, the process of the first user inviting the second user to synchronize with the own media playing status includes:

step S501, the first user sends a synchronization invitation to the second user through the status management server using the first synchronization management client.

Specifically, before sending out the invitation, the first user may use the first synchronization management client to find the status information (e.g., whether online, etc.) of the second user through the status management server.

The invitation information mainly includes: the identifier of the first user, the identifier of the second user, the identifier of the media program currently played by the first user, and the like.

Step S502, the state management server processes the request of the first synchronization management client, and returns a feedback message to the first synchronization management client.

The state management server checks the request of the first synchronization management client, for example, whether the second user exists, whether the clients of the second user (the second synchronization management client and the second media playing client) are online, whether the second user supports media playing synchronization, and the like. And if the result of the verification is that the request of the first user is supported, sending confirmation information to the first synchronous management client, otherwise, sending request information which does not support the first user.

Step S503, the state management server sends a first invitation notification message to the second synchronization management client, and notifies the first user to invite the second user to synchronize the media playing state with the first user.

After receiving the first invitation notification message, the second synchronization management client may display a relevant notification message to the second user, and determine whether to initiate a media playing state synchronization process with the first user according to a policy (e.g., automatic acceptance, manual confirmation, etc.) of the second user.

If the second user does not accept the relevant invitation, the second synchronization management client may ignore the relevant notification message, or may feed back information that the relevant operation is not supported to the state management server.

After sending the notification message to the second synchronization management client, the state management server waits for the confirmation message of the second synchronization management client, and if the confirmation message is not received within a predetermined time or the confirmation message sent by the second synchronization management client indicates that the synchronization operation is not supported, step S511 is executed to send a message of invitation failure to the first synchronization management client, and terminate the subsequent operation process.

In step S504, the second synchronization management client requests to synchronize with the media playing status of the first user according to the first invitation notification message of the status management server.

In step S505, the state management server checks the request information of the second synchronization management client. If yes, feeding back confirmation information to the second synchronization management client (this case is taken as an example in the figure), where the confirmation information mainly includes: the identifier of the first user, the identifier of the second user, the task identifier of the synchronous playing state and the like. If not, step S511 is executed to notify the first synchronization management client that the related invitation is failed, and terminate the subsequent operation.

Step S506, the state management server sends a second invitation notification message to the second media playing client, and notifies the first user to invite the second user to the synchronous playing state of the second user, where the second invitation notification message mainly includes: the identifier of the first user, the identifier of the second user, the task identifier of the play state synchronization, and the like, and further includes information that the second synchronization management client (the second user) has accepted the relevant invitation.

After sending the second invitation notification message to the second media playing client, the state management server waits for the confirmation message of the second media playing client, if the confirmation message of the second media playing client is not received within a predetermined time, or the confirmation message indicates that the operation is not supported, step S510 is executed to notify the second synchronous management client that the operation for synchronizing the playing state fails, step S511 is executed to notify the first synchronous management client that the related invitation fails, and then the subsequent operation is terminated.

In step S507, the second media playing client processes the second invitation notification message to determine whether to start a synchronization operation process. If so, the state management server is requested to synchronize the playing state of the first user (this case is taken as an example in fig. 5), otherwise, the state management server is fed back that the playing state synchronization invitation is not supported.

Step S508, the state management server processes the request of the second media playing client, and feeds back the processing result.

If the state management server determines that the synchronization request supporting the synchronization of the second media playing client request and the playing state of the first user is synchronous, the information required for the synchronization of the playing state is fed back, which includes, for example: and playing the identification of the state synchronization task.

If the second media playing client does not support the media playing state synchronization in the feedback mode, step S510 is executed after the confirmation information is fed back.

In step S509, the second media playing client starts a session process synchronized with the playing state of the state management server, so that the second media playing client obtains the current media playing state of the first user from the state management server through the session process. The current media play state comprises: an identification of the currently playing media of the first user, a current media playing status (normal, pause, stop, etc.), a current playing time, etc.

Step S510, the state management server sends feedback information to the second synchronization management client, and feeds back whether the playing state synchronization process of the second media playing client is started normally.

Step S511, the state management server sends feedback information to the first synchronization management client, and feeds back whether the playing state synchronization process of the second user is started normally.

Step S512, the state management server sends feedback information to the first media playing client to feed back whether the playing state synchronization process of the second user is started normally.

Step S513, if the first media playing client learns that the second user has started the synchronous operation process with the media playing state of the first media playing client, the state sharing session with the state management server is started, and through the session, the first media playing client continuously uploads the media playing state of the first media playing client.

Through the transfer of the state management server, the second media playing client can continuously obtain the current media playing state of the first media playing client, so that the synchronization process of the playing state is realized.

According to the terminal cooperation method of the embodiment, the media playing states of different users are synchronized through cooperation between terminals of different users.

EXAMPLE six

In this embodiment, an application scenario in which the second user applies for synchronization with the media playing status of the first user is taken as an example to expand the terminal cooperation method of the present invention.

Specifically, fig. 6 is a signaling diagram illustrating a user applying for media playing state synchronization. As shown in fig. 6, the process of the second user applying for synchronization with the first user media playing status includes:

in step S601, the second user uses the second synchronization management client to view the current state of the first user.

The current state of the first user is a state shared by the first user, and may include: whether online, a play task identifier (for indicating a program currently being played by the first user), whether a synchronized media play state is supported, etc.

Step S602, the state management server processes the request of the second synchronization management client, and returns the current state of the first user. If the second user does not subscribe to the status of the first user, the status management server may not feed back the current status of the first user, and the related process ends.

Step S603, the second user applies for synchronization with the media playing status of the first user by using the second synchronization management client.

If the first user supports the media playing state synchronization, the second user can apply for the media playing state synchronization with the first user, otherwise, the second user cannot apply for the media playing state synchronization with the first user.

The request information sent by the second synchronization management client at least comprises: the identifier of the first user, the identifier of the playing task of the first user, the identifier of the second synchronous management client and the like.

In step S604, the state management server confirms the request of the second user.

And if the first user does not allow other users to synchronize the media playing state, the state management server feeds back that the related operation is not supported to the second synchronization management client side, and terminates the subsequent operation process.

After receiving the synchronization request of the second user, the state management server may send a notification message to the first synchronization management client of the first user to inquire whether the play state synchronization request of the second user is supported, and if the first user agrees, perform further operation, otherwise, feedback to the second synchronization management client that the first user does not support the related operation.

If the state management server and the first user support the synchronous media playing state request of the second user, the state management server feeds back media playing state information to the second synchronous management client, wherein the information at least comprises: the identification of the first user, the identification of the current playing task of the first user, the identification of the current playing media of the first user, the identification of the task of the synchronous playing state of the second user and the like.

Step S605, the state management server sends a notification to the second media playing client, and notifies the second media playing client to start the synchronous operation with the media playing state of the first user.

The notification information includes: the identification of the first user, the identification of the current playing task of the first user, the identification of the current playing media of the first user, the identification of the task of the synchronous playing state of the second user and the like.

After sending the notification message to the second media playing client, the state management server waits for further operation of the second media playing client, and if no feedback is given by the second media playing client within the appointed time or the second media playing client does not support the relevant operation, step S609 is executed to notify the second synchronous management client that the synchronous operation fails, and the subsequent process is ended.

Step S606, after receiving the notification message sent by the state management server, the second media playing client requests to start the synchronization with the playing state of the first user, where the request message includes: an identification of the second user, an identification of the second media playing client, a task identification of the synchronized playing state, a synchronization method (e.g., synchronization by time, etc.), and so on.

In step S607, the state management server processes the request information of the second media playing client, and returns the processing result. If the request of the second media playing client is supported, the confirmation information is returned (the case is taken as an example in fig. 6), otherwise, the unsupported information is returned.

If the unsupported information is returned, step S609 is executed to notify the second synchronization management client that the synchronization operation has failed, and the subsequent process is ended.

Step S608, the second media playing client analyzes the feedback information of the state management server, and if the feedback information supports the synchronization operation (i.e., the confirmation information), the media playing state synchronization session process is started, and the playing state of the first user is continuously obtained and synchronized with the first user until the first user or the state management server finishes the playing state sharing process, or the state management server or the second user finishes the playing state synchronization operation process.

Step S609, after the second media playing client successfully establishes the session of the synchronous playing state with the state management server, or the state management server determines that the synchronous playing process is not successfully established, notify the second synchronous management client of the actual processing result of the current playing state synchronization request.

When the broadcast synchronization session is successfully established or the broadcast synchronization operation process fails (or ends), the state management server needs to send a state result to the first user.

In the application scenarios of the third to sixth embodiments, when the user logs in the state management server, the state management server may create a state management task for the user. Specifically, fig. 7 is a schematic diagram of the state management server performing task management. As shown in fig. 7, when a first user and a second user log in to a state management server, the state management server may respectively establish a first state management task (state management of the first user) and a second state management task (state management of the second user) for the first user and the second user, and in the state management tasks, respectively maintain a state of the first user and a state of the second user. The state information of the user includes: the method comprises the steps of synchronously managing whether a client is online and relevant information (identification, version, connection address, connection port and the like), whether a media playing client is online and relevant information (identification, version, connection address, connection port and the like), whether a user shares a current playing state and relevant information (share task identification, a current playing program, current playing time and the like), and allowing other users to be synchronous with the user.

Before the second user synchronizes the current playing state of the first user, or before the second user is invited to synchronize with the first user, the first user is required to share the current media playing state of the first user.

The first user uses the first synchronous management client to apply for sharing the current media playing state of the first user from the state management server. At this time, the state management server establishes a state synchronization session in the first state management task, and the first media playing client can continuously upload its own media playing state through the state synchronization session.

After the first user establishes the task of sharing the playing state on the state management server, the first synchronization management client can search the state of the second user, so that the second user is invited to synchronize with the playing state of the second user. At this time, the state management server establishes a state image of the second user in the first state management task. When the state of the second user changes, the state management server mirrors the state information of the second user in the second state management task to the state mirror storage space of the second user in the first state management task. In this way, the clients of the first user (the first synchronization management client and the first media playing client) can obtain the current state of the second user from the first state management task.

Similarly, the second user may use the second synchronization management client and the second media playing client to obtain the current state of the first user from the second state management task.

When the second user synchronizes the current playing state of the first user, the first media playing client continuously uploads the playing state of the first media playing client to the first state management task of the state management server, the related state information is synchronized to the second state management task, and the second media playing client continuously acquires the current media playing state of the first media playing client from the second state management task, so that the synchronization of the media playing states of the second user and the first user is realized.

EXAMPLE seven

Fig. 8 is a schematic structural diagram of a terminal cooperative operation apparatus according to an embodiment of the present invention. As shown in fig. 8, the terminal cooperative operation apparatus includes:

a request receiving module 81, configured to receive an operation request message sent by a first terminal, where the operation request message carries an identifier of a second terminal;

a judging module 82, configured to judge whether the operation request message meets a preset standard;

and the request processing module 83 is configured to, if it is determined that the operation request message meets a preset standard, send an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal, so that the second terminal executes operation processing according to the operation notification message.

The terminal cooperation apparatus of the present embodiment is used to execute the terminal cooperation method of any one of the above embodiments, and is, for example, a state management server shown in fig. 1. The specific process of the terminal cooperation device executing the terminal cooperation operation in this embodiment is the same as the terminal cooperation method in any of the embodiments described above, and therefore, the detailed description thereof is omitted here.

According to the terminal cooperative operation device of the embodiment, after receiving the operation request message sent by the first terminal, the operation notification message for instructing the second terminal to execute the corresponding operation is sent to the second terminal according to the identifier of the second terminal carried in the operation request message, so that the user can control the second terminal to execute the required operation through the first terminal, and the cooperative operation of multiple terminals is realized.

Further, the terminal cooperative operation apparatus of the above embodiment further includes:

and the result feedback module is used for receiving the operation processing state information returned by the second terminal and sending the operation processing state information to the first terminal.

Further, in the terminal cooperative operation apparatus in the foregoing embodiment, the request processing module is specifically configured to: and encrypting the operation request message according to an encryption algorithm agreed in advance with the second terminal, and sending the encrypted operation request message to the second terminal.

Further, in the terminal cooperative operation apparatus in the above embodiment, the operation request message is a play request message, and the play request message carries an identifier of the second terminal and a play parameter;

correspondingly, the request processing module is specifically configured to: and sending a playing notification message to the second terminal according to the identifier of the second terminal, wherein the playing notification message carries the playing parameter, so that the second terminal executes playing operation according to the playing parameter.

Further, in the terminal cooperative operation device in the embodiment, the operation request message is a broadcast sharing request message, and the broadcast sharing request message carries the identifier and the sharing right of the second terminal;

correspondingly, the request processing module is specifically configured to: sending a broadcast sharing enabling notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the broadcast sharing enabling notification message and feeds back a broadcast sharing enabling request message;

receiving the play sharing starting request message, establishing a play sharing task and a session corresponding to the play sharing task, and sending a task identifier carrying the play sharing task and a play sharing starting confirmation message of the session identifier to the second terminal, so that the second terminal uploads media play state information according to the session identifier and the task identifier;

and receiving the media playing state information, and providing the media playing state information to a terminal conforming to the sharing authority according to the sharing authority to finish playing and sharing.

Further, in the terminal cooperative operation device in the above embodiment, the operation request message is a play sharing suspension request message, and the play sharing suspension request message carries an identifier of the second terminal and a task identifier of a play sharing task requested to be suspended;

correspondingly, the request processing module is specifically configured to: sending a playing sharing suspension notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the playing sharing suspension notification message and feeds back an uploading media playing state information suspension request message, wherein the playing sharing notification message and the uploading media playing state information suspension request message carry the task identifier of the playing sharing task requested to be suspended;

receiving the request message for stopping uploading the media playing state information, releasing the session corresponding to the task identifier, and sending a confirmation message for stopping uploading the media playing state information to the second terminal, so that the second terminal responds to the confirmation message for stopping uploading the media playing state information and stops uploading the media playing state information;

and sending a notification message that the playing and sharing are stopped to the terminal which accords with the sharing authority of the stopped playing and sharing task.

Further, in the terminal cooperation apparatus in the above embodiment, the first terminal and the second terminal are terminals of a first user, respectively; the operation request message is a synchronization invitation message used for requesting a second user to synchronize with the playing state of the second terminal, and the synchronization invitation message carries a second user identifier and an identifier of the second terminal;

correspondingly, the request processing module is specifically configured to: if the operation request message is judged to meet the preset standard, sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal, specifically comprising:

notifying the second user of the synchronization invitation message according to the second user identification;

if the terminal of the second user is known to respond to the synchronous invitation message to start a playing state synchronization process, the second terminal is informed to upload the media playing state information of the second terminal;

and receiving the media playing state information, and providing the media playing state information to the terminal of the second user so that the terminal of the second user executes playing state synchronization according to the media playing state information.

Example eight

The embodiment provides a terminal cooperation system, which includes the terminal cooperation apparatus of the above embodiment, and a first terminal and a second terminal connected to the terminal cooperation apparatus.

The terminal cooperation apparatus is, for example, the state management server shown in fig. 1, the first terminal is, for example, a terminal in which the synchronization management client shown in fig. 1 is deployed, and the second terminal is, for example, a terminal in which the media playing client shown in fig. 1 is deployed.

Furthermore, the terminal cooperation apparatus may be connected with other terminals of any of the same user and/or terminals of different users.

The process of the terminal cooperation system executing the terminal cooperation operation in this embodiment is the same as the terminal cooperation method in any of the embodiments described above, and therefore, the description thereof is omitted here.

According to the terminal cooperative operation system of the embodiment, after receiving the operation request message sent by the first terminal, the terminal cooperative operation device sends the operation notification message for instructing the second terminal to execute the corresponding operation to the second terminal according to the identifier of the second terminal carried in the operation request message, so that the user can control the second terminal to execute the required operation through the first terminal, and the cooperative operation of multiple terminals is realized.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A terminal cooperation method is characterized by comprising the following steps:

judging whether the operation request message meets a preset standard or not;

if the operation request message is judged to meet the preset standard, sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal so that the second terminal executes operation processing according to the operation notification message,

wherein the judging whether the operation request message meets a preset standard comprises: detecting whether the identifier of the second terminal in the operation request message is legal or not, or judging whether the second terminal supports the operation type corresponding to the operation request message or not according to the performance corresponding to each terminal identifier stored by the state management server;

the first terminal and the second terminal are terminals of a first user respectively; the operation request message comprises a synchronous invitation message for requesting a second user to synchronize with the playing state of the second terminal, and the synchronous invitation message carries a second user identifier and an identifier of the second terminal;

correspondingly, if it is determined that the operation request message meets the preset standard, sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal, specifically including:

receiving the media playing state information and providing the media playing state information to the terminal of the second user so as to enable the terminal of the second user to execute playing state synchronization according to the media playing state information,

or,

the first terminal and the second terminal are terminals of a first user respectively; the operation request message comprises a synchronous application message for requesting to synchronize the playing state of the second terminal to the terminal of the second user, and the synchronous application message carries a second user identifier and an identifier of the second terminal;

notifying the second user of the synchronous application message according to the second user identification;

and if the terminal of the second user is known to respond to the synchronous application message to start a playing state synchronization process and receive the media playing state information uploaded by the terminal of the second user, providing the media playing state information to the second terminal so that the second terminal executes playing state synchronization according to the media playing state information.

2. The method according to claim 1, wherein the sending an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal, further comprises:

and receiving operation processing state information returned by the second terminal, and sending the operation processing state information to the first terminal.

3. The method according to claim 1, wherein the sending the operation notification message corresponding to the operation request message to the second terminal comprises:

and encrypting the operation request message according to an encryption algorithm agreed in advance with the second terminal, and sending the encrypted operation request message to the second terminal.

4. The terminal cooperation method according to any one of claims 1 to 3, wherein the operation request message further includes a play request message, and the play request message carries an identifier of the second terminal and a play parameter;

correspondingly, the sending, according to the identifier of the second terminal, the operation notification message corresponding to the operation request message to the second terminal further specifically includes:

5. The terminal cooperative operation method according to any one of claims 1 to 3, wherein the operation request message further includes a broadcast sharing request message, and the broadcast sharing request message carries an identifier and a sharing right of the second terminal;

6. The terminal cooperative operation method according to any one of claims 1 to 3, wherein the operation request message further includes a play sharing suspension request message, and the play sharing suspension request message carries an identifier of the second terminal and a task identifier of a play sharing task requested to be suspended;

sending a playing sharing suspension notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the playing sharing suspension notification message and feeds back an uploading media playing state information suspension request message, wherein the playing sharing notification message and the uploading media playing state information suspension request message carry the task identifier of the playing sharing task requested to be suspended;

7. A terminal cooperative operation apparatus, comprising:

a request processing module, configured to send an operation notification message corresponding to the operation request message to the second terminal according to the identifier of the second terminal if it is determined that the operation request message meets a preset standard, so that the second terminal performs operation processing according to the operation notification message,

the judging module is specifically configured to detect whether an identifier of the second terminal in the operation request message is legal, or the judging module is specifically configured to judge whether the second terminal supports an operation type corresponding to the operation request message according to a performance corresponding to each terminal identifier stored by the state management server;

correspondingly, the request processing module is specifically configured to: notifying the second user of the synchronization invitation message according to the second user identification;

or,

correspondingly, the request processing module is specifically configured to:

8. The terminal cooperation apparatus according to claim 7, further comprising:

9. The terminal cooperation apparatus according to claim 7, wherein the request processing module is specifically configured to: and encrypting the operation request message according to an encryption algorithm agreed in advance with the second terminal, and sending the encrypted operation request message to the second terminal.

10. The terminal cooperative operation device according to any one of claims 7 to 9, wherein the operation request message further includes a play request message, and the play request message carries an identifier of the second terminal and a play parameter;

correspondingly, the request processing module is further specifically configured to: and sending a playing notification message to the second terminal according to the identifier of the second terminal, wherein the playing notification message carries the playing parameter, so that the second terminal executes playing operation according to the playing parameter.

11. The terminal cooperative operation device according to any one of claims 7 to 9, wherein the operation request message further includes a broadcast sharing request message, and the broadcast sharing request message carries an identifier and a sharing right of the second terminal;

correspondingly, the request processing module is further specifically configured to: sending a broadcast sharing enabling notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the broadcast sharing enabling notification message and feeds back a broadcast sharing enabling request message;

12. The terminal cooperative operation device according to any one of claims 7 to 9, wherein the operation request message further includes a play sharing suspension request message, and the play sharing suspension request message carries an identifier of the second terminal and a task identifier of a play sharing task requested to be suspended;

correspondingly, the request processing module is further specifically configured to: sending a playing sharing suspension notification message to the second terminal according to the identifier of the second terminal, so that the second terminal responds to the playing sharing suspension notification message and feeds back an uploading media playing state information suspension request message, wherein the playing sharing notification message and the uploading media playing state information suspension request message carry the task identifier of the playing sharing task requested to be suspended;

13. A terminal cooperation system comprising the terminal cooperation apparatus according to any one of claims 7 to 12, and a first terminal and a second terminal connected to the terminal cooperation apparatus.