CN107846382B

CN107846382B - Multi-screen sharing method, server, terminal and system in converged communication

Info

Publication number: CN107846382B
Application number: CN201610832048.8A
Authority: CN
Inventors: 丁元欣; 梁昕; 李春雷
Original assignee: ZTE Corp
Current assignee: ZTE Corp
Priority date: 2016-09-19
Filing date: 2016-09-19
Publication date: 2022-09-13
Anticipated expiration: 2036-09-19
Also published as: CN107846382A

Abstract

The invention provides a method, a server, a terminal and a system for multi-screen sharing in converged communication, wherein the method comprises the following steps: the method comprises the steps that a server side for converged communication establishes a cooperation relationship for performing function division between a first terminal and a second terminal, wherein the cooperation relationship comprises an incidence relationship between the first terminal and the second terminal and division of client functions on the first terminal and the second terminal in the current converged communication service; and sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relation. The scheme associates different terminals together to provide various services of different types for a certain user, and brings greater flexibility to the use of services in converged communication.

Description

Multi-screen sharing method, server, terminal and system in converged communication

Technical Field

The invention relates to the technical field of communication, in particular to a method, a server, a terminal and a system for multi-screen sharing in converged communication.

Background

Traditional voice and short message services are the most basic mobile communication services, but the functions are relatively single, the experience is limited, and the increasing communication requirements of users cannot be met more and more. Based on this background, a converged Communication technology has appeared, in which RCS (Rich media Communication), also called converged Communication and unified Communication, is a Communication service based on an address book and integrating multiple Communication modes such as voice, instant message, file transfer, content sharing, presentation, location service, and the like. The technology can well meet the multifunctional requirements of users, and a plurality of operators begin to participate in the field of converged communication.

However, the converged communication system of the operator aims at personal communication, and communication with an enterprise still has a certain difference in demand, for example, in enterprise communication and collaboration, a better conference effect and more collaboration (for example, in a conference, message collaboration, file sharing, document sharing, and the like are performed simultaneously) are generally required, when solving such experience difficulty in the converged communication technology, a multi-screen sharing scheme is generally adopted to solve, and the current multi-screen sharing generally has the following two schemes:

the first scheme is as follows: by adopting a scheme similar to Digital Living Network Alliance (DLNA) or wireless video Display standard (WIFI Display) proposed by WIFI Alliance, one terminal directly provides shared content for another terminal, and the multi-screen sharing realized by the scheme is that a sharing party locally shares the content directly to a shared party through a Network, so that the experience of the shared party is necessarily limited to the sharing party to a certain extent.

Scheme II: according to the scheme, the client establishes the association with the multiple terminals, and after the association of the multiple terminals is completed, the services on the first terminal are usually all switched to the second terminal, so that the multi-screen sharing process is realized.

Disclosure of Invention

The embodiment of the invention provides a method, a server, a terminal and a system for multi-screen sharing in converged communication, which aim to solve the problems that the experience of a shared party is limited by a sharing party, good functions of multiple terminals cannot be well allocated and used, and the flexibility of multi-screen sharing in converged communication is reduced.

In order to solve the technical problem, the embodiment of the invention adopts the following technical scheme:

in one aspect, an embodiment of the present invention provides a method for multi-screen sharing in converged communication, including:

the method comprises the steps that a server side for converged communication establishes a cooperation relationship for performing function division between a first terminal and a second terminal, wherein the cooperation relationship comprises an incidence relationship between the first terminal and the second terminal and division of client functions on the first terminal and the second terminal in the current converged communication service;

and sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division work in the cooperation relation.

Optionally, the step of establishing, by the service end in converged communication, a cooperative relationship for performing function division between the first terminal and the second terminal includes:

obtaining a relationship establishment request for establishing a cooperation relationship between the first terminal and the second terminal, wherein the relationship establishment request comprises: first identification information for uniquely identifying the first terminal, second identification information for uniquely identifying the second terminal;

acquiring function division information for dividing the client functions related to the current converged communication service, wherein the function division information is contained in the relation establishment request or is pre-configured in the server;

and establishing a cooperation relationship for performing function division between the first terminal and the second terminal according to the relationship establishment request and the function division appointed in the function division information.

Optionally, the method further comprises:

sending a function control instruction of a client function in a first service to one of a first terminal and a second terminal according to an acquired trigger instruction of the first service in the converged communication service;

acquiring a function switching request sent by a corresponding terminal after receiving the function control instruction, wherein the function switching request comprises: rejecting response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the first terminal and the second terminal;

and entering the service end of the converged communication to establish a cooperative relationship of function division between the first terminal and the second terminal according to the function switching request.

On the other hand, an embodiment of the present invention further provides a method for multi-screen sharing in converged communication applications, including:

the method comprises the steps that a first terminal establishes a cooperation relationship for performing function division with a second terminal through a converged communication server, wherein the cooperation relationship comprises an incidence relationship between the first terminal and the second terminal and division of client functions on the first terminal and the second terminal in the current converged communication service;

and when a corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship is acquired, executing corresponding function operation according to the function control instruction.

Optionally, the step of establishing, by the first terminal, a cooperative relationship for performing function division with the second terminal through the converged communication server in the converged communication service includes:

the first terminal acquires second identification information for uniquely identifying the second terminal, or further acquires function division information for dividing the client functions related to the current converged communication service;

sending a relationship establishment request to the server side of the converged communication, wherein the relationship establishment request comprises: the second identification information and the first identification information used for uniquely identifying the first terminal, or further comprises the function division information.

Optionally, the method further comprises:

acquiring a function control instruction of a client function in a first service of the converged communication service sent by the converged communication server;

after the function control instruction is acquired, sending a function switching request to the converged communication server, wherein the function switching request comprises: rejecting response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the first terminal and the second terminal;

and entering a service end of the first terminal through converged communication according to the function switching request, and establishing a cooperative relationship of function division with the second terminal.

On the other hand, an embodiment of the present invention further provides a server for converged communication, including:

the system comprises a first establishing module, a second establishing module and a third establishing module, wherein the first establishing module is used for establishing a cooperation relationship for performing function division between a first terminal and a second terminal, the cooperation relationship comprises an incidence relationship between the first terminal and the second terminal, and division of client functions on the first terminal and the second terminal in the current converged communication service;

and the first sending module is used for sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relationship.

Optionally, the first establishing module includes:

a first obtaining sub-module, configured to obtain a relationship establishment request for establishing a cooperative relationship between the first terminal and the second terminal, where the relationship establishment request includes: first identification information for uniquely identifying the first terminal, second identification information for uniquely identifying the second terminal;

a second obtaining sub-module, configured to obtain function division information for dividing a client function involved in a current converged communication service, where the function division information is included in the relationship establishment request or is preconfigured in the server;

and the establishing submodule is used for establishing a cooperation relationship for performing function division between the first terminal and the second terminal according to the relation establishing request and the function division appointed in the function division information.

Optionally, the server further comprises:

a second sending module, configured to send a function control instruction of a client function in a first service to one of the first terminal and the second terminal according to an obtained trigger instruction of the first service in the converged communication service;

a first obtaining module, configured to obtain a function switching request sent by a corresponding terminal after receiving the function control instruction, where the function switching request includes: rejecting the response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the first terminal and the second terminal;

and the first step entering module is used for entering the step of establishing the cooperation relationship of function division between the first terminal and the second terminal according to the function switching request.

On the other hand, an embodiment of the present invention further provides a terminal, including:

the second establishing module is used for establishing a cooperation relationship for performing function division with a second terminal through a converged communication server, wherein the cooperation relationship comprises an incidence relationship between the terminal and the second terminal and division of client functions on the terminal and the second terminal in the current converged communication service;

and the execution module is used for executing corresponding function operation according to the function control instruction when the corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship is acquired.

Optionally, the second establishing module includes:

a third obtaining submodule, configured to obtain second identification information for uniquely identifying the second terminal, or further obtain function division information for dividing a client function involved in the current converged communication service;

a sending submodule, configured to send a relationship establishment request to the converged communication server, where the relationship establishment request includes: the second identification information and the first identification information used for uniquely identifying the terminal, or further comprises the function division information.

Optionally, the terminal further includes:

a second obtaining module, configured to obtain a function control instruction of a client function in a first service of the converged communication service sent by the converged communication server;

a third sending module, configured to send a function switching request to the converged communication server after the function control instruction is obtained, where the function switching request includes: rejecting response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the terminal and the second terminal;

and a second step entering module, configured to enter the service end through converged communication according to the function switching request, and establish a step of performing function division cooperation with a second terminal.

On the other hand, an embodiment of the present invention further provides a converged communication system, including: the server for converged communication and the terminal are provided.

One or more embodiments of the present invention have the following advantageous effects:

according to the method for multi-screen sharing in converged communication provided by the embodiment of the invention, a server side of converged communication is established in converged communication service, a cooperation relation of function division is carried out between a first terminal and a second terminal, and a corresponding function control instruction is sent to at least one of the first terminal and the second terminal according to the function division in the cooperation relation.

Drawings

FIG. 1 shows a flow chart of a method in a first embodiment of the invention;

FIG. 2 shows a first flow chart of a method according to a second embodiment of the invention;

FIG. 3 shows a second flow chart of a method according to a second embodiment of the invention;

FIG. 4 shows a flow chart of a method according to a third embodiment of the invention;

fig. 5 shows a first interaction diagram of a converged communication server and a client when an audio/video conference is performed in the embodiment of the present invention;

fig. 6 shows a second schematic interaction diagram of a converged communication server and a client during an audio/video conference in the embodiment of the present invention;

fig. 7 shows a third schematic interaction diagram of a converged communication server and a client during an audio/video conference in the embodiment of the present invention;

fig. 8 is an interaction diagram illustrating registration and authentication performed by a converged communication client at a server in an embodiment of the present invention;

FIG. 9 is a block diagram showing the construction of a fourth embodiment of the present invention;

FIG. 10 is a block diagram showing the structure of a fifth embodiment of the present invention;

fig. 11 is a schematic structural diagram of a converged communication system in an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

First embodiment

The embodiment of the invention discloses a method for multi-screen sharing in converged communication, which is shown in a combined figure 1 and comprises the following steps:

step 101: the server side fusing communication establishes a cooperation relation for performing function division between the first terminal and the second terminal.

The cooperation relationship comprises an incidence relationship between a first terminal and a second terminal, and the division of the client functions on the first terminal and the second terminal in the current converged communication service.

In the converged communication technology, a plurality of communication services are converged into a whole, and when a service is triggered in the converged communication, the first terminal and the second terminal divide the work of the client function involved in the service included in the current converged communication, specifically, the division of the function is associated with the device function of the terminal as the shared party in the first terminal and the second terminal, and in combination with the practical application requirement, when the device function of the shared party is various, more function division allocation can be transferred to the shared party by converging the service end setting of communication, when the shared party has a single device function, it can set to transfer less function division assignment to the shared party, and when the server side carries out function call control on the shared party, the shared party directly executes the appointed function to complete the multi-screen sharing process.

The cooperation relationship for performing function division between the first terminal and the second terminal comprises: and in the converged communication service, the client functions related in the same service are subjected to the cooperation relationship of division of labor, and/or the client functions related among different services are subjected to the cooperation relationship of division of labor.

When the triggered current converged communication service is a service, the client functions related to the same service perform division cooperation between a first terminal and a second terminal which are used as clients; when the triggered current converged communication service is a plurality of services, the client functions related to different services perform division cooperation between a first terminal and a second terminal serving as clients. The client function may be: a service control function, a service media output function, etc. Specifically, before establishing the cooperation relationship between the first terminal and the second terminal, the first terminal and the second terminal may perform account registration and authentication on the converged communication server, the converged communication server obtains registration requests of the first terminal and the second terminal, performs account registration according to the registration requests, grants corresponding permissions, establishes a correspondence relationship between the converged communication server and the first terminal and the second terminal serving as the client, and enables the server to perform operations such as management and charging on the terminals better.

In this step, for the characteristics of converged communication, in order to fully exert the respective advantages of multiple terminals, the functions of the clients involved in converged communication are allocated to different terminals as needed, where the terminals of the first terminal and the second terminal as the sharing party may be a mobile phone, a computer, a tablet device, etc., and the terminals of the first terminal and the second terminal as the shared party are terminals with good experience in some aspect, such as terminals with better video input and output functions (e.g., having a better display screen and a better camera) and audio input and output functions (e.g., having a better microphone and a better speaker, etc.), specifically, such as a mobile phone, a computer, a tablet device, a projector, a network box, a video conference terminal, etc., which are referred to as enterprise terminals, and for convenience of description, the two terminals are described by taking a mobile phone terminal and an enterprise terminal as examples, respectively.

In the process of establishing a cooperation relationship between client terminals, the cooperation of function division in the cooperation relationship is, for example: the mobile phone terminal realizes related functions in the converged communication service, including service content processing, service control, media output and the like, part of functions in the converged communication service are switched and transferred to the enterprise terminal for processing through establishment of a cooperation relationship, and the mobile phone terminal and the enterprise terminal are matched to jointly complete the complete functions of the converged communication service, and vice versa.

Specifically, a scene of an audio/video conference is described with reference to the application of converged communication. Based on typical configuration in the audio and video conference service, i.e. division of work between the first terminal and the second terminal, in the multi-screen sharing process of the enterprise terminal and the mobile phone terminal, which is implemented in the embodiment of the present invention, for example, the following steps are performed:

typical configuration a: the mobile phone terminal is responsible for processing instant messages on the client, and carrying out audio and video conference process control and other related functions; the enterprise terminal is responsible for developing the audio and video conference, and comprises the following steps: and controlling signaling and audio and video conference media processing and the like. The matching mode can bring the advantages of convenient operation of the mobile phone terminal and better display and communication effects of the enterprise terminal video conference into play.

Typical configuration B: based on the typical configuration A, the client functions for developing the audio and video conference are separated: the mobile phone terminal is further responsible for processing control signaling of the audio and video conference, and the enterprise terminal is responsible for processing audio and video media.

Typical configuration C: based on the typical configuration B, the functions of the client for developing the audio and video conference are further separated, the mobile phone terminal is responsible for processing control signaling and partial video and audio (such as main video and main audio) of the audio and video conference, and the enterprise terminal is responsible for processing other video and audio (such as auxiliary video and auxiliary audio). The main video and the main audio are usually used for bearing moving images, sounds and the like of each meeting place in an audio-video conference; the auxiliary video and the auxiliary audio are generally used to transmit images, sounds, and the like output by a server in an audio/video conference. The functions of the two are divided and can be freely defined.

For the audio and video conference, it can be defined that the enterprise terminal processes the audio and video media and conference control, and the mobile phone terminal can process the conference cooperation function (such as message cooperation, file transmission among conference members, etc., and other service functions except the audio and video conference service of the converged communication, such as the transmission of instant messages, etc.) at the same time of the conference cooperation function; or the enterprise terminal processes audio and video media, and the mobile phone terminal processes conference control, conference cooperation functions and the like; or the mobile phone terminal processes one path of video and audio, conference control, conference cooperation and the like, and the enterprise terminal processes the other path of video and audio. After a cooperation relationship is established between the mobile phone terminal and the enterprise terminal, the mobile phone terminal and the enterprise terminal cooperate to jointly complete the complete terminal function.

When multi-screen sharing is carried out, different client functions corresponding to various services or services in the converged communication are flexibly distributed and processed on different terminals as required, so that flexible multi-screen sharing is realized, and the user experience of the converged communication system is improved.

For convenience of description, the following description will be made with reference to a mobile phone terminal and an enterprise terminal.

Step 102: and sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relation.

According to the function division in the cooperation relationship, corresponding function control instructions are sent to shared terminals in the first terminal and the second terminal with the cooperation relationship, so that function switching is realized, and a multi-screen sharing process is completed; specifically, it is determined whether a function call instruction needs to be sent to one of the terminals or to both terminals according to the specific function division between the first terminal and the second terminal, for example, when the function division of the first terminal is a conference control function and the function division of the second terminal is a function of processing a control signaling and a conference media, the first terminal is responsible for sending a conference control instruction to the service end of the converged communication, the service end of the converged communication sends a corresponding function control instruction to the second terminal according to the conference control instruction, a media transmission channel between the second terminal and the first terminal is established, the second terminal further processes the control signaling and performs audio or video media display output, and the service end of the converged communication does not send the function control instruction to the first terminal; correspondingly, if the function division of the first terminal further includes processing of a part of videos and audios or includes a processing function of an instant message, the server side in the converged communication sends a function control instruction corresponding to the respective function division to both the first terminal and the second terminal having a cooperative relationship, so as to call a function appointed in the cooperative relationship between the client terminals, and realize multi-screen sharing in the converged communication.

The first terminal and the second terminal, namely the converged communication client terminal, related in the embodiment of the invention are relatively independent terminals, access networks of the terminals can also be independent, the terminals directly interact with the server side, no code stream transmission or transcoding operation exists between the terminals, and the types of the terminals can be different between different terminals.

Specifically, the following further describes the main scheme of the embodiment of the present invention in combination with the audio and video conference function:

for an audio-video conference in converged communication application, for example, in client devices in a converged communication system, corresponding mobile phone terminals include a1, a2 and A3, and enterprise terminals include E1 and E2.

Corresponding to the division of labor function in the collaboration relationship, E1 can be defined to process audio and video media, conference control and the like in the audio and video conference, and A1 can process conference collaboration function (such as message collaboration among conference members, file transmission and the like) and the like; or E1 handles audio and video media while a1 handles conference control, conference collaboration functions, etc.; or E1 handles secondary video and secondary audio functions, while a1 handles primary video and primary audio, as well as conference control and conference collaboration functions.

And dividing the audio and video conference of the client terminal into a conference call, a conference control, a conference media and the like according to functions. The functions can be cooperatively implemented between the mobile phone terminal and the enterprise terminal. When the enterprise terminal is used as a cooperative terminal of the mobile phone terminal, the enterprise terminal can divide labor according to functions to replace the mobile phone terminal to provide well-appointed functions in the audio and video conference.

The main steps in the embodiment of the invention are as follows:

firstly, a registration authentication process is performed, and no matter the mobile phone terminal or the enterprise terminal can perform registration authentication on the server, and with reference to fig. 8, a specific implementation process of performing registration authentication on the mobile phone terminals a1 and a2 and the enterprise terminals E1 and E2 on the server in converged communication is as follows: the mobile phone client A1 registers and authenticates to the server; the enterprise terminal E1 registers and authenticates to the server; the mobile phone client A2 registers and authenticates to the server; and the enterprise terminal E2 registers and authenticates with the server.

When the converged communication server establishes a cooperative relationship between the mobile phone terminal and the enterprise terminal, specifically, the converged communication server establishes a cooperative relationship between E1 and a1, and between E2 and a2 in advance.

For convenience, functions of processing call signaling, primary video, primary audio, secondary video (if any), and secondary audio (if any) are generally distributed to be implemented on the enterprise terminal, and conference control functions are distributed to be implemented on the mobile phone terminal. This allocation of functions is explained below.

Wherein, the mobile phone terminal a1 initiates an audio and video conference. Suppose that the conference members include handset terminals a1, a2 and A3. The converged communication server sends out call invitations to E1, E2 and A3 according to function division in the cooperation relationship, at the moment, A1, A2 and A3 join in the conference, which is virtually E1, E2 and A3 conference, E1 serves as a cooperation terminal of A1 to realize corresponding audio and video conference functions, E2 serves as a cooperation terminal of A2 to realize corresponding audio and video conference functions, and A3 processes all functional operations in the audio and video conference. Correspondingly, the conference member list needs to expose a1, a2, and A3. Alternatively, E1 (as a cooperative terminal of a 1) and E2 (as a cooperative terminal of a 2) may be presented.

Conference control after meeting: after joining the conference, the conference needs to be processed according to the prior function division: if E1 is used as the collaboration terminal of A1 to process audio and video, E2 is used as the collaboration terminal of A2 to process audio and video, and A3 processes conference audio and video, the mobile phone terminal sends a control instruction to the service end of converged communication when performing conference control, and the service end of converged communication sends a function control instruction to E1 and E2 which have a collaboration relation with the mobile phone terminal.

When the conference control function of the mobile phone terminal relates to a media processing part (such as voice control and video control of the terminal), the service end fusing communication directly sends a function control instruction to the terminal bearing the voice or video media functions, and the functions are called to realize function switching and content sharing.

When the conference control of the collaboration terminal is operations such as disconnecting and quitting the terminal from the conference, the control of the converged communication server on the mobile phone terminal is the conference control of both the mobile phone terminal and the associated enterprise terminal, such as: when the conference control wants to withdraw terminal a1 from the conference, E1 is actually withdrawn from the conference, but at the same time a1, E1 (if any) need to be deleted from the conference terminal list (or list of participants).

When the terminal control of the associated terminal is audio control, video control, peripheral control (such as microphone, sound box, camera, display and the like) and the like of the terminal, the server side integrating communication sends a function control command to the E1 which has a cooperative relation with the mobile phone terminal, and the implementation of the E1 terminal function is controlled. The cooperation relation between the mobile phone terminal and the corresponding cooperation terminal can be changed in real time. Changes include, but are not limited to, dismissing collaboration relationships, function retraction, function re-partitioning, and the like.

Second embodiment

On one hand, the embodiment discloses a method for multi-screen sharing in converged communication, which is shown in fig. 2 and includes:

step 201: and acquiring a relation establishment request for establishing the cooperation relation between the first terminal and the second terminal.

Wherein, the relationship establishment request includes: first identification information for uniquely identifying the first terminal, and second identification information for uniquely identifying the second terminal.

The cooperative relationship establishing request can be sent by a first terminal, or sent by a second terminal, or autonomously generated by a server, the cooperative relationship between the two terminals is established by the server for converged communication, so that the business functions of the different terminals in the converged communication can be completed in a cooperative manner through the direct interaction between the different terminals and the server, in the process, the cooperative relationship is established between the first terminal and the second terminal to jointly provide the terminal functions of the converged communication client, and further, the multi-screen sharing is realized in the process. Specifically, before the cooperative relationship between the first terminal and the second terminal is established, the first terminal and the second terminal may perform account registration and authentication on the converged communication service end, so as to determine an object terminal to be established with the cooperative relationship when acquiring the identification information of the first terminal and the second terminal.

Step 202: and acquiring function division information for dividing the client function involved in the current converged communication service, wherein the function division information is contained in the relation establishment request or is pre-configured in the server.

The function division information of division of the client functions involved in the current converged communication service is also required to be acquired, so as to implement function distribution switching and calling between terminals establishing a cooperation relationship. The function division information may be included in the relationship establishment request, or may be configured in the server in advance, and when the server acquires the identification information of the first terminal and the second terminal, the function division information may be read and called.

When the triggered current converged communication service is a service, the client functions related to the same service perform division cooperation between a first terminal and a second terminal which are used as clients; when the triggered current converged communication service is a plurality of services, the client functions related to different services perform division cooperation between a first terminal and a second terminal serving as clients. The client function may be: a service control function, a service media output function, etc. Step 203: and establishing a cooperation relationship for performing function division between the first terminal and the second terminal according to the relationship establishment request and the function division appointed in the function division information.

The server side fusing communication identifies the first terminal and the second terminal according to the first identification information and the second identification information in the cooperation relation establishment request, wherein the first identification information and the second identification information can be address information of the first terminal and the second terminal in a network or terminal number information with uniqueness, so as to successfully identify the first terminal and the second terminal which are connected, and establish cooperation association relation between the first terminal and the second terminal according to function division appointed in the function division information.

Step 204: and sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division work in the cooperation relation.

After the cooperative relationship is established, for example, the second terminal has a larger display screen and better sound equipment, and can support better video experience and audio experience, and when the second terminal has better media performance or other functions, the function division appointed in the function division information can allocate the media functions to the second terminal to be executed according to the advantages of the second terminal, so as to bring better conference experience.

The process aims at the characteristics of converged communication, and in order to fully exert the respective advantages of multiple terminals, the multi-screen sharing mode distributes the overall functions of the converged communication terminals to different terminals as required, so that flexible multi-screen sharing is realized, and the user experience of the converged communication system is improved.

Specifically, the main scheme of the embodiment of the present invention is described in combination with an audio and video conference function, and the main steps in the embodiment of the present invention are as follows:

as shown in fig. 5, when the association relationship between the mobile phone terminal and the enterprise terminal in the converged communication service is established before the audio/video conference is held, the service end in converged communication may directly call the enterprise terminal having the cooperation relationship. The specific implementation mode is as follows: A1/E1/A2/E2 respectively carry out registration authentication with a service end; a1 transmits the identification information of the second terminal and the function division information for dividing the client service function related to the current converged communication service to the server by scanning the identification code (such as two-dimensional code) related to E1 or inputting the information related to E1, and requests the server to establish the association and cooperation relationship between A1 and E1; similarly, the A2 requests the server to establish the association and cooperation relationship between the A2 and the E2 by scanning the two-dimensional code related to the E2 or inputting the information related to the E1; when a conference member is selected by a1 and a conference is initiated; the server side invites A1 to enter the meeting, namely, the server side invites A1 to enter the meeting by calling the E1 terminal; the server side invites A2 to enter the meeting, namely, the E2 terminal is called to enter the meeting, the E1 and the E2 answer the call, a media channel is established, the server side fusing communication successfully calls the media functions distributed on the enterprise terminal, and the conference communication is started.

On the other hand, the embodiment also discloses a method for multi-screen sharing in converged communication, which is shown in fig. 3 and includes:

step 301: and sending a function control instruction of a client function in the first service to one of the first terminal and the second terminal according to the acquired trigger instruction of the first service in the converged communication service.

In this step, the first terminal and the second terminal have not established a cooperative relationship yet, and the sender of the trigger instruction of the converged communication service may be the first terminal or the second terminal, for example, to trigger the holding of an audio/video conference, and if the first terminal or the second terminal is a participant of the audio/video conference, when the service end of the converged communication receives the trigger instruction of the audio/video conference service in the converged communication service, the service end of the converged communication service needs to send a function control instruction of a client function in the audio/video conference service to one of the first terminal and the second terminal, call the first terminal or the second terminal to enter a meeting, and call the audio/video conference function of the first terminal or the second terminal; the sender of the converged communication service triggering instruction can also be other terminal users, for example, other terminals trigger the holding of an audio and video conference, if the first terminal or the second terminal is a participant of the audio and video conference, the converged communication service end receives the triggering instruction of the audio and video conference function, and needs to send a function control instruction to one of the first terminal and the second terminal, call the first terminal or the second terminal to enter a conference, and call the audio and video conference function of the first terminal or the second terminal.

Step 302: and acquiring a function switching request sent by the corresponding terminal after receiving the function control instruction.

Wherein the function switching request includes: rejecting the response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the first terminal and the second terminal.

Specifically, the cooperative relationship includes an association relationship between the first terminal and the second terminal, and a division of the client function on the first terminal and the second terminal in the current converged communication service. The corresponding terminal is the terminal which acquires the function control instruction after the converged communication server sends the function control instruction of the client function in the first service to one of the first terminal and the second terminal.

The function switching request can be acquired at a conference joining stage of inviting participants in the audio and video conference or a stage in the conference after the audio and video conference is held, and the establishment of the cooperation relationship between the terminals has flexibility in time.

The function switching request comprises a response message for rejecting the function control instruction, rejects the function call of the converged communication service terminal to the client terminal function in the first service, and simultaneously requests to establish a cooperation relationship between the first terminal and the second terminal, so that after the cooperation relationship is established, the function switching is realized, and multi-screen sharing is performed.

Specifically, when the function switching request is obtained in a stage of inviting a participant to enter a conference in an audio and video conference or in a stage in progress after the conference is held, and when the function switching request sent by the corresponding terminal after receiving the function control instruction is obtained, a response message for rejecting the function control instruction sent by the corresponding terminal is obtained at the same time, and the function corresponding to the function call instruction is rejected to be executed, so that the switching of the function operation is realized through the establishment of the cooperation relation.

Step 303: and according to the function switching request, the server side fusing communication establishes a cooperation relation for performing function division between the first terminal and the second terminal.

The cooperation relationship comprises the incidence relationship between the first terminal and the second terminal and the division of the client functions on the first terminal and the second terminal in the current converged communication service.

In the converged communication technology, a plurality of communication services are converged into a whole, a first terminal and a second terminal perform function division on services included in converged communication, specifically, the division of the function is associated with functions of terminals, serving as shared parties, in the first terminal and the second terminal, and according to practical application requirements, when the functions of the shared parties are various, more function division allocation can be set to be transferred to the shared parties, when the functions of the shared parties are single, less function division allocation can be set to be transferred to the shared parties, and then when a service end calls the functions of the shared parties, the shared parties directly execute appointed functions, and a multi-screen sharing process is completed.

Specifically, before establishing the cooperation relationship between the first terminal and the second terminal, the first terminal and the second terminal are required to perform account registration and authentication on the converged communication server. The cooperative relationship for performing function division between the first terminal and the second terminal includes: and in the converged communication service, the client functions related in the same service are subjected to the cooperative relationship of division of labor, and/or the client functions related among different services are subjected to the cooperative relationship of division of labor.

Step 304: and sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relation.

At this time, after the server side of the converged communication receives the function switching request, and establishes the cooperative relationship between the first terminal and the second terminal according to the received cooperative relationship establishment request, it is necessary to perform function call to another terminal serving as a cooperative terminal according to function division in the established cooperative relationship, so as to implement function switching during the service progress of the converged communication, and transfer part or all of the function operations that need to be executed by one terminal to other terminals according to the function division, thereby implementing multi-screen sharing.

The functions between the mobile phone terminal and the enterprise terminal are divided, and can be carried out at any time. Aiming at the audio and video conference, the functional division of labor between the mobile phone terminal and the enterprise terminal can be carried out before the mobile phone terminal and the enterprise terminal join in the conference, and when the cooperative relationship between the first terminal and the second terminal is not established in advance at the server side integrating communication, the client terminal can establish the cooperative relationship between the mobile phone terminal and the enterprise terminal in the process of joining in the conference or in the process of joining in the audio and video conference in real time.

As shown in connection with fig. 6, the first case: and performing calling operation on conference members at the server side of the converged communication according to the acquired triggering instruction of the audio and video conference, wherein in the calling operation, switching and transferring of service functions are realized, and the process of performing multi-screen sharing is as follows.

A1/E1/A2/E2 respectively register and authenticate the service end, A1 selects a conference member to initiate a conference, the service end calls A1 to enter the conference, and the mobile phone terminal A1 receives the conference call but rejects the service end of the converged communication to call the conference function calling instruction of the conference; selecting a proper answering terminal to replace A1 to carry out an audio and video conference in real time in a mode of scanning two-dimensional codes of the answering terminal or manually inputting information of the answering terminal, and the like, wherein A1 selects to establish a cooperation relationship with E1, sends a cooperation relationship establishment request to a server and requests the server to call E1; the server calls the E1 according to the request of A1, and after the E1 answers, a media channel with the server is established, and corresponding functions are executed for division of labor, so that multi-screen sharing is realized. The two terminals which are cooperative with each other can support and complete the converged communication service by utilizing the advantages of each other, have better media performance or function, and bring better conference experience.

In connection with fig. 7, the second case: after the audio and video conference is held, the switching and transfer of the service functions are realized during the conference, and the process of realizing multi-screen sharing is as follows.

A1/E1/A2/E2 respectively register and authenticate a server, A1 selects a conference member to initiate a conference, the server calls an A1 conference, a cell phone terminal A1 receives the conference call, A1 answers the conference, a media channel with the server is established, after the A1 enters the conference, a proper other terminal is selected to replace A1 to conduct an audio and video conference in a mode of scanning an answering terminal two-dimensional code or manually inputting answering terminal information and the like in real time, at the moment, the A1 selects to establish a cooperative relationship with E1, the A1 hangs up the call, a function calling process corresponding to a function calling instruction is terminated, a cooperative relationship establishment request is sent to the server, a cooperative relationship between A1 and E1 is requested to be established, and the server calls E1; the server calls E1 according to the request of A1, after E1 answers, a media channel with the server is established, and corresponding function division work is executed to realize multi-screen sharing, and the two terminals which are cooperative with each other can support and complete a converged communication service by using the advantages of each other, so that the server has better media performance or function, and better conference experience is brought.

Third embodiment

The embodiment discloses a method for multi-screen sharing in converged communication, which is shown in fig. 4 and includes:

step 401: the first terminal establishes a cooperation relation for performing function division with the second terminal through the server side fusing communication.

The cooperation relationship comprises the incidence relationship between the first terminal and the second terminal, and the division of the client functions on the first terminal and the second terminal in the current converged communication service.

When the first terminal carries out multi-screen sharing in the converged communication, the first terminal directly interacts with a server side of the converged communication, and a cooperation relationship between the first terminal and other terminals is established through the server side of the converged communication. When the first terminal establishes the cooperation relationship with the second terminal for function division through the converged communication server, the corresponding cooperation relationship establishment request may be sent by the first terminal to the converged communication server, or sent by the second terminal, or the server directly establishes the cooperation relationship between the first terminal and the converged communication server.

Specifically, the division of the function is associated with the device functions of the terminals of the first terminal and the second terminal as the shared party, and in combination with the actual application requirements, when the device functions of the shared party are various, more function division allocations can be transferred to the shared party through the server setting of the converged communication, when the device functions of the shared party are single, less function division allocations can be transferred to the shared party, and then when the server performs function call control on the shared party, the shared party directly executes the appointed function, thereby completing the multi-screen sharing process.

Specifically, before establishing a cooperation relationship between a first terminal and a second terminal, the first terminal and the second terminal are required to perform account registration and authentication on a converged communication server, the first terminal and the second terminal send registration requests to the converged communication server to obtain corresponding permissions, and a correspondence relationship between the first terminal and the second terminal serving as clients and the converged communication server is established.

The terminals of the first terminal and the second terminal as the sharing party can be a mobile phone, a computer, a tablet device and the like, and the terminals of the first terminal and the second terminal as the shared party are terminals with good experience in some aspect and can be terminals of a mobile phone, a computer, a tablet device, a projector, a network box, a conference television and the like.

The cooperative relationship for performing function division includes: the cooperative relationship for performing function division between the first terminal and the second terminal includes: and in the converged communication service, the client functions related in the same service are subjected to the cooperation relationship of division of labor, and/or the client functions related among different services are subjected to the cooperation relationship of division of labor.

Step 402: and when a corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship is acquired, executing corresponding function operation according to the function control instruction.

After the cooperative relationship is established, the server side of the converged communication sends a function control instruction to an implementation terminal of a function appointed in the function division according to the function division in the cooperative relationship, when the first terminal and the second terminal receive the corresponding function control instruction, corresponding function operation is executed according to the function control instruction, and multi-screen sharing in the converged communication is realized through cooperation between the terminals.

According to the method for multi-screen sharing in converged communication provided by the embodiment of the invention, a first terminal establishes a cooperative relationship for performing function division with a second terminal through a service end of converged communication, and executes function operation according to the function division in the cooperative relationship when receiving a corresponding function control instruction.

Specifically, the step of establishing, by the first terminal, a cooperative relationship of function division with the second terminal through the converged communication server in the converged communication service includes:

the first terminal acquires second identification information for uniquely identifying the second terminal, or further acquires function division information for dividing the client functions involved in the current converged communication service;

sending a relationship establishment request to the server side of the converged communication, wherein the relationship establishment request comprises: the first identification information and the second identification information are used for uniquely identifying the first terminal, or the function division information is further included.

The first identification information and the second identification information may be address information of the first terminal and the second terminal in the network, or terminal number information with uniqueness, so that the server side fusing communication successfully matches the first terminal and the second terminal, associates the first terminal and the second terminal, and establishes a cooperation relationship between the first terminal and the second terminal according to the function division appointed in the function division information.

The content acquired by the first terminal may include: second identification information for uniquely identifying the second terminal. Correspondingly, a relationship establishing request is sent to the server side of the converged communication, wherein the relationship establishing request comprises: first identification information and the second identification information for uniquely identifying the first terminal.

Alternatively, the content acquired by the first terminal may include: and the second identification information is used for uniquely identifying the second terminal and the function division information is used for dividing the client functions related to the current converged communication service. Correspondingly, a relationship establishing request is sent to the server side of the converged communication, and the relationship establishing request comprises: the first identification information is used for uniquely identifying the first terminal, the second identification information is used for uniquely identifying the second terminal, and the function division information is used for the function division information.

When the function division information is configured in the server side in advance, the first terminal only needs to acquire second identification information for uniquely identifying the second terminal, the function division information does not need to be acquired, the function division information does not need to be sent to the server side for converged communication, and only the identification information of the first terminal and the second terminal needs to be sent to the server side, so that when the server side acquires the identification information of the first terminal and the second terminal, the preconfigured function division information is read and called; when the function division information is not configured in the server in advance, the terminal is required to acquire the function division information and send the function division information to the server so as to realize function switching and a cooperation relationship between the function division information and the server.

Specifically, when the first terminal obtains the second identifier information of the second terminal and the function division information between the two terminals, the second identifier information and the function division information may be obtained by obtaining a terminal identifier and a function division which are input by a user, or the first terminal scans the two-dimensional code of the second terminal to obtain the terminal identifier information and the cooperation function information which can be provided by the second terminal, so as to obtain the function division between the two terminals.

Specifically, in the process, the first terminal and the second terminal form a cooperative terminal, and the mobile phone terminal scans the two-dimensional code provided by the second terminal to obtain information of the second terminal, specifically, identification information of the second terminal, device function information of the second terminal, and the like, so as to obtain division work information on how to divide work on functions in the converged communication service; or acquiring information about the second terminal input by the user on the first terminal, including identification information of the second terminal and function division information how to divide functions between the first terminal and the second terminal, wherein the function division can be realized by checking related items, and the function division of the first terminal and the second terminal can be dynamically defined. The division of labor cooperation of the terminal functions on the two terminals can be realized no matter before or in the conference, and multi-screen sharing is realized.

Specifically, the audio/video conference function is specifically set forth herein, and for convenience of description, a mobile phone terminal and an enterprise terminal are described below.

Establishing a cooperative relationship between the mobile phone terminal and the enterprise terminal: the cooperative relationship is mainly established in one of the following two ways:

in the first mode, an identification code (such as a two-dimensional code) is displayed on the enterprise terminals E1 and E2, respectively, and the two-dimensional code at least contains the terminal numbers or address information of E1 and E2. The A1 respectively establishes the cooperation relationship by scanning the two-dimensional code on the E1 and scanning the two-dimensional code on the E2 through A2.

In the second mode, the cooperation relations between A1 and E1 and between A2 and E2 are respectively established by respectively acquiring the information of E1 or E2 input by the user.

When the cooperation relationship is established before the audio and video conference starts, and when a terminal initiates the audio and video conference, the service end fusing communication sends a corresponding function control instruction to a corresponding terminal according to the established cooperation relationship between E1 and A1, E2 and A2, and at the moment, the first terminal or the second terminal acquires the corresponding function control instruction and performs corresponding function operation according to the instruction.

Further, for a case that the collaboration relationship is not established before the audio-video conference is started, the method further includes:

acquiring a function control instruction of a client function in a first service of converged communication service sent by a converged communication server;

Specifically, the cooperation relationship includes an association relationship between the first terminal and the second terminal, and the division of work of the client function on the first terminal and the second terminal in the current converged communication service.

As shown in fig. 6, when the first terminal does not establish a cooperation relationship of function division in the converged communication service with other terminals, if a participant enters a conference in a call in an audio/video conference, when the first terminal acquires a call from a service end of the converged communication, the audio/video conference function of the first terminal is called, and at this time, if the first terminal needs to use another terminal as a cooperative terminal to replace the participant to enter the conference, after acquiring a function control instruction, a function switching request is sent to the service end of the converged communication, a response message for rejecting the function control instruction can be carried in the function switching request, the call instruction of the service end is rejected, the cooperation relationship between the first terminal and the second terminal is requested to be established, and on the basis of establishment of the cooperation relationship, the cooperative terminal executes an agreed function operation, thereby implementing function switching and completing a multi-screen sharing process.

As shown in fig. 7, if an audio/video conference is in progress, when a first terminal acquires a call from a converged communication server, an audio/video conference function of the first terminal is invoked, the first terminal establishes a media transmission channel with the converged communication server, and at this time, if the first terminal needs to perform function switching, other terminals are used as cooperative terminals to replace the cooperative terminals to perform corresponding functions, a response message rejecting a function control instruction can be carried in a function switching request, the call instruction of the server is rejected, a call is hung up, a function control and invocation process is ended, a cooperative relationship between the first terminal and a second terminal is requested to be established, so that on the basis of establishment of the cooperative relationship, a function operation appointed by the cooperative terminals is performed, so that function switching is achieved, and a multi-screen sharing process is completed. In the process in this embodiment, by establishing a labor division cooperative relationship between different terminals for functions in the converged communication service, the different terminals are associated together to provide multiple services of different types for a certain user, and by means of cooperative operation between the terminals, multiple service capabilities included in the converged communication are provided for the user, and the terminals are directly connected with the service end of the converged communication for interaction, thereby providing greater flexibility for the use of the service in the converged communication.

Fourth embodiment

The present embodiment discloses a server fusing communication, which is shown in fig. 9 and includes: a first establishing module 501 and a first sending module 502.

A first establishing module 501, configured to establish a cooperation relationship between a first terminal and a second terminal for performing function division, where the cooperation relationship includes an association relationship between the first terminal and the second terminal, and division of a client function in a current converged communication service between the first terminal and the second terminal;

a first sending module 502, configured to send a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relationship.

The first establishing module 501 includes:

Wherein the server further comprises:

the second sending module is used for sending a function control instruction of a client function in the first service to one of the first terminal and the second terminal according to the acquired trigger instruction of the first service in the converged communication service;

a first obtaining module, configured to obtain a function switching request sent by a corresponding terminal after receiving the function control instruction, where the function switching request includes: rejecting response information of the function control instruction, and establishing a relation establishment request for performing function division cooperation between the first terminal and the second terminal;

The server for converged communication provided by the embodiment of the invention establishes a cooperation relationship for performing function division between a first terminal and a second terminal in converged communication service, and sends a corresponding function control instruction to at least one of the first terminal and the second terminal according to the function division in the cooperation relationship.

Fifth embodiment

In this embodiment, a terminal is disclosed, which is shown in fig. 10 and includes: a second establishing module 601 and an executing module 602.

A second establishing module 601, configured to establish, through a converged communication server, a cooperation relationship for performing function division between the terminal and a second terminal, where the cooperation relationship includes an association relationship between the terminal and the second terminal, and division of client functions in the terminal and the second terminal in a current converged communication service;

an executing module 602, configured to, when a corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship is acquired, execute a corresponding function operation according to the function control instruction.

The second establishing module 601 includes:

a third obtaining sub-module, configured to obtain second identification information for uniquely identifying the second terminal, or further obtain function division information for dividing a client function involved in the current converged communication service;

Wherein, the terminal further includes:

the second acquisition module is used for acquiring a function control instruction of a client function in the first service of the converged communication service sent by the converged communication server;

and a second step entering module, configured to enter the service end through converged communication according to the function switching request, and establish a cooperative relationship with a second terminal for function division.

According to the terminal provided by the embodiment of the invention, the first terminal establishes a cooperative relationship for performing function division with the second terminal through the service end of the converged communication, and executes the function operation when receiving the corresponding function control instruction according to the function division in the cooperative relationship.

The embodiment further discloses a converged communication system, which includes: the server fusing communication and the terminal are as described above.

As shown in fig. 11, a converged communication client formed by terminals such as a mobile phone directly interacts with a server provided by a server, functional cooperation is realized between the terminals through the server, and a user completes communication with other users through the terminal.

While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.

Claims

1. A method for multi-screen sharing in converged communication is characterized by comprising the following steps:

sending a corresponding function control instruction to at least one of the first terminal and the second terminal according to function division in the cooperation relationship, wherein the function division is associated with equipment functions of a terminal which is a shared party in the first terminal and the second terminal;

the division of the client functions in the current converged communication service between the first terminal and the second terminal comprises:

when the triggered current converged communication service is a service, the client functions related to the same service perform division cooperation between a first terminal and a second terminal which are used as clients;

when the triggered current converged communication service is a plurality of services, the client functions related to different services perform division cooperation between a first terminal and a second terminal which are used as clients;

wherein the method further comprises:

2. The method according to claim 1, wherein the step of establishing, by the converged communication server, a cooperative relationship for performing function division between the first terminal and the second terminal includes:

3. A method for multi-screen sharing in converged communication application is characterized by comprising the following steps:

when acquiring a corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship, executing corresponding function operation according to the function control instruction;

wherein the method further comprises:

after the function control instruction is acquired, sending a function switching request to the converged communication server, wherein the function switching request comprises: rejecting response information of the function control instruction, and establishing a relationship establishment request for performing a cooperative relationship of function division between the first terminal and the second terminal, wherein the function division is associated with a device function of a terminal which is a shared party in the first terminal and the second terminal;

4. The method according to claim 3, wherein the step of establishing, by the first terminal, a cooperative relationship of function division with the second terminal through the converged communication service end in the converged communication service includes:

5. A converged communication server, comprising:

the system comprises a first establishing module, a second establishing module and a third establishing module, wherein the first establishing module is used for establishing a cooperation relationship for performing function division between a first terminal and a second terminal, the cooperation relationship comprises an association relationship between the first terminal and the second terminal, and division of client functions on the first terminal and the second terminal in the current converged communication service;

a first sending module, configured to send a corresponding function control instruction to at least one of the first terminal and the second terminal according to function division in the cooperation relationship, where the function division is associated with a device function of a terminal that is a shared party in the first terminal and the second terminal;

wherein the server further comprises:

6. The server according to claim 5, wherein the first establishing module comprises:

7. A terminal, comprising:

the second establishing module is used for establishing a cooperation relationship for performing function division between the second terminal and the server side fusing communication, wherein the cooperation relationship comprises an association relationship between the terminal and the second terminal and division of client functions on the terminal and the second terminal in the current fusing communication service, and the function division is associated with equipment functions of terminals which are shared parties in the first terminal and the second terminal;

the execution module is used for executing corresponding function operation according to the function control instruction when the corresponding function control instruction sent by the converged communication server according to the function division in the cooperation relationship is acquired;

the division of the client functions in the current converged communication service between the first terminal and the second terminal includes:

wherein, the terminal further includes:

8. The terminal of claim 7, wherein the second establishing module comprises:

9. A converged communication system, comprising: the server converged communication according to claim 5 or 6 and the terminal according to claim 7 or 8.