CN111935540B

CN111935540B - Desktop sharing method and system between commanding and scheduling terminals

Info

Publication number: CN111935540B
Application number: CN202010790166.3A
Authority: CN
Inventors: 吴雨
Original assignee: Beijing Feixun Digital Technology Co ltd
Current assignee: Beijing Feixun Digital Technology Co ltd
Priority date: 2020-08-07
Filing date: 2020-08-07
Publication date: 2022-06-28
Anticipated expiration: 2040-08-07
Also published as: CN111935540A

Abstract

The embodiment of the invention discloses a method and a system for sharing a desktop between command and dispatch terminals. The method is executed by an external codec connected with a sharing terminal, and the external codec is used for binding at least one video acquisition device, and the method comprises the following steps: receiving a desktop sharing request initiated by an initiating terminal and sent by a server; feeding back a desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the method comprises the steps that a desktop video coding stream of a shared terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the shared terminal and a video coding stream of video acquisition equipment currently monitored by the shared terminal; the method comprises the steps that a desktop video coding stream of a sharing terminal is sent to an external coder-decoder of an initiating terminal through a server to be decoded, and then the decoded desktop video coding stream is provided for the initiating terminal to be displayed in a sharing mode. The method can realize desktop sharing between the commanding and dispatching terminals, and meanwhile, the operating efficiency of the occupied chip and the operating system is low, and no burden is brought to the commanding and dispatching terminals.

Description

Desktop sharing method and system between command and scheduling terminals

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a method and a system for desktop sharing between commanding and scheduling terminals.

Background

The network video and audio command and dispatch platform mainly takes video monitoring, video and audio conferences and command and dispatch as the main points. With the abundant service requirements, desktop sharing becomes one of the urgent requirements of users for using the network video and audio command and scheduling platform.

In the prior art, a command and dispatch terminal runs on an X86 platform, a Windows operating system is adopted, and the running efficiency of hardware and the operating system is high. Fig. 1 is a schematic connection diagram of a network video and audio command and dispatch platform in the prior art, and as shown in fig. 1, command terminal software may directly include a desktop coding service, the desktop coding service may register with a network video and audio command and dispatch server separately, and when other terminals in the network video and audio command and dispatch platform request a command and dispatch terminal with the desktop coding service, the desktop coding service may stream the desktop of the command and dispatch terminal, thereby implementing desktop sharing.

However, when the operation performance of the network video and audio command and dispatch platform is low, the scheme in the prior art is adopted to embed the desktop coding service into the command terminal software, which has the following disadvantages: on one hand, computer resources are occupied, and the burden of the command scheduling terminal is increased. On the other hand, the desktop coding service can only perform coding streaming aiming at the running desktop of the computer or commanding and scheduling terminal software, and cannot acquire video and audio streams decoded by the encoder, so that desktop sharing is incomplete, and the problem of missing items exists.

Disclosure of Invention

The embodiment of the invention provides a method and a system for sharing a desktop between commanding and dispatching terminals, which can occupy lower running efficiency of a chip and an operating system of a commanding and dispatching platform and realize desktop sharing between the commanding and dispatching terminals.

In a first aspect, an embodiment of the present invention provides a method for sharing a desktop between commanding and scheduling terminals, where the method is performed by an external codec connected to a sharing terminal, and the external codec is used to bind at least one video capture device, and the method includes:

receiving a desktop sharing request initiated by an initiating terminal and sent by a server;

feeding back a sharing terminal desktop video coding stream to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of a video acquisition device currently monitored by the sharing terminal;

and after the desktop video coding stream of the sharing terminal is sent to the external coder-decoder of the initiating terminal by the server for decoding, the desktop video coding stream of the sharing terminal is provided for the initiating terminal for sharing display.

In a second aspect, an embodiment of the present invention further provides a method for desktop sharing between commanding and scheduling terminals, where the method is performed by an external codec connected to an initiating terminal, and the external codec is configured to bind at least one video capture device, and the method includes:

Sending a desktop sharing request aiming at a sharing terminal to a server;

the desktop sharing request is used for indicating an external coder-decoder connected with a sharing terminal by a server to generate a sharing terminal desktop video coding stream and feeding back the sharing terminal desktop video coding stream to the server;

receiving the shared terminal desktop video coding stream sent by the server, and splicing the shared terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream;

and decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display.

In a third aspect, an embodiment of the present invention further provides a method for desktop sharing between commanding and scheduling terminals, where the method includes:

the method comprises the steps that an external coder-decoder connected with an initiating terminal sends a desktop sharing request aiming at a sharing terminal to a server;

the desktop sharing request is used for the server to indicate an external coder-decoder connected with the sharing terminal to generate a sharing terminal desktop video coding stream, and the sharing terminal desktop video coding stream is fed back to the external coder-decoder connected with the initiating terminal through the server;

an external codec connected with a sharing terminal receives a desktop sharing request of an initiating terminal sent by a server;

An external coder-decoder connected with the sharing terminal feeds back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of video acquisition equipment currently monitored by the sharing terminal;

an external codec connected with the initiating terminal receives the shared terminal desktop video coding stream sent by the server, and splices the shared terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream;

and the external coder-decoder connected with the initiating terminal decodes the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sends the combined desktop video decoding stream to the initiating terminal for shared display.

In a fourth aspect, an embodiment of the present invention further provides a system for desktop sharing between commanding and scheduling terminals, where the system includes: the system comprises an initiating terminal, an external coder-decoder connected with the initiating terminal, a shared terminal, an external coder-decoder connected with the shared terminal and a server;

The initiating terminal, the external coder-decoder connected with the initiating terminal, the sharing terminal and the external coder-decoder connected with the sharing terminal are respectively connected with the server;

the external coder-decoder connected with the initiating terminal and the external coder-decoder connected with the sharing terminal are respectively bound with at least one video acquisition device;

the initiating terminal is used for sending a desktop sharing request aiming at the sharing terminal to a server through an external coder-decoder connected with the initiating terminal;

the external codec connected with the sharing terminal is used for receiving a desktop sharing request of the initiating terminal sent by a server and feeding back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of a video acquisition device currently monitored by the sharing terminal;

The external codec connected with the initiating terminal is used for receiving the desktop video coding stream of the sharing terminal sent by the server and splicing the desktop video coding stream of the sharing terminal and the desktop video coding stream of the initiating terminal to generate a combined desktop video coding stream;

and the external coder-decoder connected with the initiating terminal is used for decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display.

In a fifth aspect, an embodiment of the present invention further provides a desktop sharing device between commanding and scheduling terminals, where the device may be configured in an external codec connected to a sharing terminal, and the external codec is configured to bind at least one video capture device, and the device includes:

the desktop sharing request receiving module is used for receiving a desktop sharing request sent by the server and initiated by the initiating terminal;

the sharing terminal desktop video coding stream feedback module is used for feeding back the sharing terminal desktop video coding stream to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of a video acquisition device currently monitored by the sharing terminal;

And the shared terminal desktop video coding stream is sent to the external coder-decoder of the initiating terminal by the server for decoding and then is provided for the initiating terminal for sharing display.

In a sixth aspect, an embodiment of the present invention further provides a desktop sharing apparatus between commanding and scheduling terminals, where the apparatus may be configured in an external codec connected to an initiating terminal, and the external codec is configured to bind at least one video capture device, and the apparatus includes:

the desktop sharing request sending module is used for sending a desktop sharing request aiming at the sharing terminal to the server;

the combined desktop video coding stream generating module is used for receiving the shared terminal desktop video coding stream sent by the server and splicing the shared terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream;

and the combined desktop video decoding stream sending module is used for decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display.

In a seventh aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:

one or more processors;

a storage device for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement a method for desktop sharing between orchestration and dispatch terminals according to any embodiment of the present invention.

In an eighth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for desktop sharing between commanding and scheduling terminals according to any embodiment of the present invention.

According to the technical scheme of the embodiment of the invention, the desktop sharing request of the initiating terminal sent by the server is received; feeding back a desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the method comprises the steps that a desktop video coding stream of a shared terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the shared terminal and a video coding stream of video acquisition equipment currently monitored by the shared terminal; the method comprises the steps that a shared terminal desktop video coding stream is sent to an external coder-decoder of an initiating terminal through a server to be decoded and then provided for the initiating terminal to be shared and displayed, the desktop sharing problem among command and dispatch terminals is solved, the shared terminal desktop video coding stream generated by splicing the video coding stream and an interface coding stream is fed back to the server through the external coder-decoder to solve the desktop sharing problem among the command and dispatch terminals, coding service does not need to be embedded in software of the command and dispatch terminals, the running efficiency of a chip and an operating system of a command and dispatch platform occupying a low space is achieved, the desktop sharing among the command and dispatch terminals is achieved, and the effect of burden on the command and dispatch terminals is avoided.

Drawings

FIG. 1 is a schematic diagram of a network video and audio command and dispatch platform in the prior art;

fig. 2a is a flowchart of a method for directing desktop sharing between scheduling terminals according to an embodiment of the present invention;

fig. 2b is a schematic connection diagram of a network audio/video command and dispatch platform according to a first embodiment of the present invention;

fig. 2c is a schematic diagram illustrating a user interface splicing of a command and dispatch terminal according to an embodiment of the present invention;

fig. 3 is a flowchart of a method for commanding desktop sharing between scheduling terminals according to a second embodiment of the present invention;

fig. 4a is a flowchart of a method for directing desktop sharing between scheduling terminals according to a third embodiment of the present invention;

fig. 4b is a schematic diagram of an audio/video call between command and dispatch terminals according to a third embodiment of the present invention;

fig. 5a is a flowchart of a method for directing desktop sharing between scheduling terminals according to a fourth embodiment of the present invention;

fig. 5b is a flowchart of a method for commanding desktop sharing between scheduling terminals according to a fourth embodiment of the present invention;

fig. 6 is a schematic structural diagram of a desktop sharing device between command and dispatch terminals according to a fifth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a desktop sharing device between commanding and scheduling terminals according to a sixth embodiment of the present invention;

Fig. 8 is a schematic structural diagram of a desktop sharing system between commanding and scheduling terminals according to a seventh embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device according to an eighth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Example one

Fig. 2a is a flowchart of a method for desktop sharing between commanding and scheduling terminals according to an embodiment of the present invention, where this embodiment is applicable to a situation where desktop sharing is performed between commanding and scheduling terminals in an audio/video call, and the method may be performed by a desktop sharing device between commanding and scheduling terminals, where the device may be implemented in a software and/or hardware manner, and the device may be integrated in an external codec, as shown in fig. 2a, and the method may be performed by an external codec connected to a sharing terminal, where the method specifically includes:

and step 110, receiving a desktop sharing request initiated by an initiating terminal and sent by a server.

The desktop sharing request may be initiated from a command scheduling terminal serving as an initiating terminal to a command scheduling terminal serving as a sharing terminal, for example, the desktop sharing request may be initiated from one or more command scheduling terminals to another one or more command scheduling terminals during audio/video communication performed by at least two command scheduling terminals. The command scheduling terminal initiating the desktop sharing request can be used as an initiating terminal, and the command scheduling terminal initiated with the desktop sharing request can be used as a sharing terminal.

The desktop sharing request of the initiating terminal can be transmitted to the sharing terminal through the server, for example, a network audio and video command scheduling server. Fig. 2b is a schematic connection diagram of a network audio and video command and dispatch platform according to an embodiment of the present invention. As shown in fig. 2b, the commanding and dispatching terminal may operate in software and hardware with relatively low operation performance, for example, the commanding and dispatching terminal employs a chip and an operating system which are not enough to support the embedded codec service. The command scheduling terminal may be provided with a program, for example, the program of the initiating terminal may send a desktop sharing request to the network audio/video command scheduling server, and the sharing terminal may receive the desktop sharing request sent by the server through a built-in program.

However, in order to reduce the burden of commanding and scheduling the terminals, the initiating terminal may send the desktop sharing request to the server through the connected external codec, and the sharing terminal may receive the desktop sharing request sent by the server through the connected external codec.

In an implementation manner of the embodiment of the present invention, optionally, the receiving a desktop sharing request of an initiating terminal sent by a server includes: and receiving a video channel, a video coding parameter and an SIP stream parameter of the initiating terminal, which are sent by the server.

The video channel may be a video that is specified to be desktop-shared, for example, the video channel may be a first video, that is, a video of a video capture device that is being monitored by the sharing terminal; or the video channel can be a second video, namely a video of a human-computer interaction interface in the shared terminal and the video acquisition device being monitored. In order to achieve a better desktop sharing effect and facilitate commanding communication among the scheduling terminals, the video channel may be a second video.

The video coding parameters may be coding parameters for setting a video for desktop sharing, such as h.264 coding parameters, and may include video channel coding parameters, video input source, video source resolution, coding resolution, width, height, rate type, video rate, algorithm level, frame rate, I-frame interval, and I-frame quality.

Illustratively, the video coding parameters sent by the server are: the video channel coding parameters are fusion h264 coding, the video input source is fusion picture, the video source resolution is 1080P60, the coding resolution is self-defined, the width is 1920, the height is 1080, the code rate type is transcoding stream, the video code rate is 3M (the optional range is 64K-8192K), the algorithm level is HighProfile (high definition), the frame rate is 30, the I frame interval is 30 (the optional range is 1-1000), and the I frame quality is 10 (the optional range is 10-45).

Session Initiation Protocol (SIP) stream parameters may be Session Protocol parameters shared by the initiating terminal and the desktop of the sharing terminal, and may include, for example, Protocol type, encoding and decoding type, user name, authorization name, password, display name, source, IP of the registration server, port of the registration server, local port, and refresh status.

Illustratively, the SIP flow parameters sent by the server may be: the protocol type is a standard number, the encoding and decoding type is encoding and decoding, the user name and the authorization name can be a string of characters (which can represent the sharing terminal and can be consistent) composed of numbers, letters, symbols and the like of the sharing terminal, the password can be a connection password of the sharing terminal (the password can be connected to the sharing terminal only when the password is correct, or the password can be hidden and displayed), the display name may be the name used by the shared terminal for display (which may be consistent with the user name), the source may be the IP address of the originating terminal, the registration server IP may be the IP address of the network audiovisual command dispatch server, the registration server port may be the communication port of the network audiovisual command dispatch server, such as 5060, the local port may be the communication port of the shared terminal, such as 50170, and the refresh status may be registered, the channel is idle.

The desktop sharing request can be a request initiated by the initiating terminal to the sharing terminal through the network audio and video command scheduling server. The desktop sharing request may include parameter information of the initiating terminal, the server, the sharing terminal, and the desktop-shared video.

And step 120, feeding back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request.

The desktop video coding stream of the sharing terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the sharing terminal and a video coding stream of video acquisition equipment currently monitored by the sharing terminal. And the shared terminal desktop video coding stream is sent to the external coder-decoder of the initiating terminal through the server for decoding and then is provided for the initiating terminal for shared display.

In order to achieve a better desktop sharing effect and facilitate commanding communication among the scheduling terminals, the video channel may be a second video. Fig. 2c is a schematic diagram of a user interface splicing of a command and dispatch terminal according to an embodiment of the present invention. As shown in fig. 2c, the desktop shared video may be a shared terminal desktop video encoded stream generated by splicing an interface encoded stream of a human-computer interaction interface in the shared terminal with a video encoded stream of a video capture device currently monitored by the shared terminal. The video coding stream of the video capture device currently monitored by the shared terminal may be the video coding stream of one or more video capture devices. The video capture device may be a video camera, video recorder, etc., such as an HD-SDI camera (real-time no compression). Each video acquisition device can be bound with an external codec, and the currently monitored video acquisition device can be updated according to the selection of a user in the command scheduling terminal.

In order to achieve convenient and intuitive monitoring of the commanding and dispatching terminal, the commanding and dispatching terminal can send a video stream of built-in commanding and dispatching terminal software (such as a software video stream for achieving interface display and operation functions of the commanding and dispatching terminal) to a connected external codec. The external codec can splice the video stream of the commanding and scheduling terminal software and the video coding stream of the currently monitored video acquisition equipment to generate a desktop video coding stream of the commanding and scheduling terminal, and decode the desktop video coding stream to generate a desktop video decoding stream of the commanding and scheduling terminal. The external codec can send the desktop video decoding stream of the commanding and dispatching terminal to a display of the commanding and dispatching terminal for displaying. For example, the external codec outputs the desktop video decoding stream of the command and dispatch terminal to a display (e.g., a human-computer Interface) through a High-Definition Multimedia Interface (HDMI). The process is applicable to desktop display before a desktop sharing request of a terminal or a sharing terminal is initiated. When the external codec connected with the sharing terminal receives the desktop sharing request of the initiating terminal sent by the server, the external codec can directly encode the desktop video decoding stream of the commanding and scheduling terminal serving as the sharing terminal to generate a desktop video encoding stream of the sharing terminal and feed the desktop video encoding stream back to the server.

After receiving the shared terminal desktop video encoding stream, the server may send the shared terminal desktop video encoding stream to the external codec of the initiating terminal for decoding, so as to obtain a shared terminal desktop video decoding stream. And the external coder-decoder of the initiating terminal can decode the desktop video of the shared terminal and provide the decoded video to the initiating terminal for shared display.

The shared display of the initiating terminal may be that an external codec connected to the initiating terminal splices the desktop video decoded stream of the commanding and scheduling terminal serving as the initiating terminal with the desktop video decoded stream of the shared terminal to generate a combined desktop video decoded stream, and sends the combined desktop video decoded stream to a human-computer interaction interface of the initiating terminal for display, for example, the combined desktop video decoded stream is output to the human-computer interaction interface of the initiating terminal through an HDMI interface for display. Or, the shared display of the initiating terminal may be that a desktop video encoded stream of a command scheduling terminal serving as the initiating terminal and a desktop video encoded stream of a shared terminal) are combined with the desktop video encoded stream, and the combined desktop video encoded stream is generated by decoding and is sent to a human-computer interaction interface of the initiating terminal for display.

In an implementation manner of the embodiment of the present invention, optionally, feeding back the desktop video encoded stream of the shared terminal to the server according to the desktop sharing request includes: and according to the desktop sharing request, feeding back the desktop video coding stream of the sharing terminal, which corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters, to the server.

When the video channel is the second video, the external codec connected to the sharing terminal can feed back the desktop video coding stream of the sharing terminal to the server. The shared terminal desktop video coding stream can be registered according to the video coding parameters and the SIP stream parameters.

Illustratively, the external codec connected to the shared terminal satisfying the user name, the authorized name and the password feeds back the desktop video coding stream of the shared terminal satisfying the video coding parameters to the external codec connected to the originating terminal corresponding to the source through the local port when the refresh state is registered and the channel is idle. Desktop sharing can be realized by means of an external coder-decoder without occupying resources of the commanding and dispatching terminal, and the burden of the commanding and dispatching terminal can not be increased. Meanwhile, the desktop is shared comprehensively, and the user can conveniently communicate through the command and dispatching platform without missing items.

According to the technical scheme of the embodiment, a desktop sharing request of an initiating terminal sent by a server is received; feeding back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the method comprises the steps that a desktop video coding stream of a shared terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the shared terminal and a video coding stream of video acquisition equipment currently monitored by the shared terminal; the shared terminal desktop video coding stream is sent to the external codec of the initiating terminal through the server to be decoded and then provided for the initiating terminal to be shared and displayed, so that the problem of desktop sharing among the commanding and dispatching terminals is solved, the running efficiency of a chip and an operating system occupying a lower commanding and dispatching platform is realized, the desktop sharing among the commanding and dispatching terminals is realized, and the effect of burden on the commanding and dispatching terminals is avoided.

Example two

Fig. 3 is a flowchart of a method for directing desktop sharing between scheduling terminals according to a second embodiment of the present invention, where this embodiment is a further refinement of the foregoing technical solution, and the technical solution in this embodiment may be combined with each alternative in one or more embodiments described above. As shown in fig. 3, the method is performed by an external codec connected to a shared terminal, and the method includes:

and 210, establishing audio and video call connection with the initiating terminal through the server.

In an embodiment of the present invention, optionally, establishing an audio/video call connection with the initiating terminal through the server includes: if a confirmed call response aiming at the audio and video call request sent by the sharing terminal is received, establishing audio and video call connection with the initiating terminal through the server, wherein the audio and video call request can be the audio and video call request of the initiating terminal sent to the sharing terminal by the server; alternatively, the first and second liquid crystal display panels may be,

and if a confirmed call response of the initiating terminal to the audio and video call request is received, establishing audio and video call connection with the initiating terminal through the server, wherein the audio and video call request can be an audio and video call request of the sharing terminal sent to the initiating terminal by the server.

The initiator of the audio/video call connection may be an initiating terminal or a sharing terminal of the desktop sharing request. In other words, any one of the commanding and dispatching terminals can initiate an audio and video call, and after the audio and video call is established, any one of the commanding and dispatching terminals in the audio and video call can initiate a desktop sharing request to other commanding and dispatching terminals in other audio and video calls. The command scheduling terminal which initiates the desktop sharing request is used as an initiating terminal, and the command scheduling terminal which is initiated with the desktop sharing request is used as a sharing terminal.

The audio-video call between the initiating terminal and the sharing terminal can be established before desktop sharing. When the audio and video call is established, a corresponding program can be embedded in the initiating terminal and the sharing terminal, and the audio and video call can be established with the sharing terminal through the initiating terminal and the embedded program. In order to reduce the occupation of software and hardware when the initiating terminal and the sharing terminal establish audio and video communication and not bring burden to the command terminal software, when the audio and video communication is established, the audio and video communication can be established through the external codec connected with the initiating terminal and the external codec connected with the sharing terminal.

Illustratively, the audio-video call establishment procedure may be: and the initiating terminal initiates an audio and video call request to the sharing terminal. The initiating terminal can receive the audio and video call request through the connected external coder-decoder, and registers SIP service to the server according to the audio and video call request, and the server requests the sharing terminal to establish the audio and video call according to the registered SIP service. If the sharing terminal confirms the call response, the sharing terminal sends the call response confirmation to the connected external coder-decoder; and when the external codec receives the confirmed call response, the corresponding sharing desktop video coding stream is sent to the connected sharing terminal according to the SIP service, so that the video display of the sharing terminal in the audio and video call is realized.

Or, the audio and video call establishment process may be: the sharing terminal can initiate an audio and video call request to the initiating terminal. The sharing terminal can receive the audio and video call request through the connected external coder-decoder, and registers SIP service to the server according to the audio and video call request, and the server requests the initiating terminal to establish the audio and video call according to the registered SIP service. If the initiating terminal confirms the call response, the initiating terminal sends the confirmed call response to the connected external codec; and when the external codec receives the confirmed call response, the corresponding desktop video coding stream of the initiating terminal is sent to the connected initiating terminal according to the SIP service, so that the video display of the initiating terminal in the audio and video call is realized.

If the sharing terminal confirms the call response, the confirmed call response is sent to the initiating terminal through the server or the connected external codec and the server so as to inform the external codec connected with the initiating terminal to send the corresponding desktop video coding stream of the initiating terminal to the connected initiating terminal, and the video display of the initiating terminal in the audio and video call is realized.

Or if the initiating terminal confirms the call response, the confirmed call response is sent to the sharing terminal through the server or the connected external codec and the server so as to inform the external codec connected with the sharing terminal to send the corresponding sharing desktop video coding stream to the connected sharing terminal, and the video display of the sharing terminal in the audio and video call is realized.

It should be noted that, in the above audio/video call request, the video display of the initiating terminal shows the initiating terminal desktop video decoding stream, and the video display of the sharing terminal shows the sharing desktop video decoding stream. Namely, in the audio and video call request, the videos displayed between the initiating terminal and the sharing terminal are different. On the basis of the audio and video call request, the initiating terminal initiates a desktop sharing request, and after desktop sharing is successfully established, the initiating terminal displays a combined desktop video decoding stream, and the sharing terminal displays a shared desktop video decoding stream. After the desktop sharing is successfully established, the video displayed by the initiating terminal changes, and is a combined desktop video decoding stream generated by splicing the desktop video decoding stream of the initiating terminal and the shared desktop video decoding stream; and the video displayed by the sharing terminal is not changed. The video presented between the originating terminal and the sharing terminal is still different. According to the requirement, the sharing terminal initiates a desktop sharing request to the initiating terminal so that the videos displayed by the two terminals are the same, and the specific process can be similar to the process of initiating the desktop display request to the sharing terminal by the initiating terminal and is not repeated.

It should be further noted that, in the video display, the initiating terminal and the sharing terminal may also establish an audio call in the audio and video call according to the SIP service through the server and the network, and the specific process is not specifically limited in the embodiment of the present invention. The SIP service in the audio/video call may be similar to the SIP service in the desktop sharing, and is not described herein again.

Step 220, receiving an equipment identifier of the video acquisition equipment sent by the sharing terminal, wherein the video acquisition equipment selects monitored equipment for the user.

The video of the video acquisition equipment selected to be monitored by the user can be displayed in the displays of the sharing terminal and the initiating terminal. Taking the shared terminal as an example, the description is made (the initiating terminal may have a similar process): for example, after the audio/video call is successfully connected, the shared terminal may receive a device identifier of the video capture device selected by the user for monitoring, for example, the user may select different device identifiers in a human-computer interaction interface of the shared terminal, and each device identifier may uniquely correspond to the video capture device. The sharing terminal may send the device identifier selected by the user to the connected external codec.

And step 230, acquiring a video coding stream of the video acquisition device matched with the device identifier, and an interface coding stream of a human-computer interaction interface in the shared terminal.

The external codec can bind different video acquisition devices, and when receiving a device identifier selected by a user, the external codec can receive a video coding stream of the video acquisition device corresponding to the device identifier. Moreover, the external codec may receive an interface encoding stream of a display of the shared terminal, which is sent by the connected shared terminal, for example, an interface encoding stream of a human-computer interaction interface in the shared terminal. In order to realize the accuracy of the display in time, the external coder-decoder can acquire the video coding stream and the interface coding stream in real time.

And step 240, splicing the video coding stream and the interface coding stream to generate a shared terminal desktop video coding stream, and decoding the shared terminal desktop video coding stream to provide the shared terminal desktop video coding stream for audio and video call display.

For example, the shared terminal desktop video encoded stream generated by splicing may display an interface corresponding to the interface encoded stream at an appointed position of a human-computer interaction interface, display videos corresponding to the video encoded streams at preset video display positions, and the videos corresponding to the video encoded streams may be arranged in a sequence from left to right and from top to bottom. The external coder-decoder can decode the desktop video coding stream of the sharing terminal, generate a desktop video decoding stream of the sharing terminal and send the desktop video decoding stream to the sharing terminal, and the sharing terminal can display the video of the audio-video call in a man-machine interaction interface according to the desktop video decoding stream of the sharing terminal and a mode corresponding to the splicing of the coding streams.

It should be noted that the video display process in the audio and video call of the shared terminal is also applicable to the originating terminal. That is, the process corresponding to step 210 to step 240 may be implemented by the initiating terminal and an external codec connected to the initiating terminal.

And step 250, receiving the video channel, the video coding parameter and the SIP streaming parameter of the initiating terminal sent by the server.

And step 260, sending the desktop sharing state of the sharing terminal to a server.

The desktop sharing state of the sharing terminal may be a state indicating whether the shared desktop allows desktop sharing. For example, the desktop sharing state may be enabled or disabled. When the desktop sharing state is started, the sharing terminal allows other command and dispatch terminals to be used as initiating terminals to order and acquire videos displayed on the desktop. And when the desktop sharing state is not started, other command and dispatch terminals are not allowed to be used as initiating terminals to order and acquire the video displayed on the desktop. The external codec connected to the sharing terminal may send the desktop sharing status of the sharing terminal to the server when the sharing terminal obtains the initiated desktop sharing request, and may indicate whether the server or the initiating terminal may establish desktop sharing. Or, when the sharing terminal acquires the initiated desktop sharing request, the sharing terminal sends the desktop sharing state of the sharing terminal to the server.

In order to facilitate a user to obtain a desktop sharing state of the sharing terminal in time, an icon of the desktop sharing state may be set, for example, when the desktop sharing state is enabled, the icon may be displayed; when the desktop sharing state is not enabled, the icon may not be displayed or may be displayed in a color such as gray to indicate non-enabled. The icon may be displayed in a resource list of a display interface of the shared terminal. The user can change the desktop sharing state of the sharing terminal by clicking or touching the icon or the setting interface of the sharing terminal. The desktop sharing state of the sharing terminal can be sent to the initiating terminal through the server, and the sharing terminal and the desktop sharing state of the sharing terminal can be displayed in a resource list of the initiating terminal.

And step 270, when the desktop sharing state is enabled, according to the desktop sharing request, feeding back the shared terminal desktop video coding stream which corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters to the server.

The method comprises the steps that a desktop video coding stream of a sharing terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the sharing terminal and a video coding stream of video acquisition equipment currently monitored by the sharing terminal; and after the desktop video coding stream of the sharing terminal is sent to an external coder-decoder of the initiating terminal through the server for decoding, the desktop video coding stream of the sharing terminal is provided for the initiating terminal for sharing display.

According to the technical scheme of the embodiment, audio and video call connection is established with the initiating terminal through the server; receiving an equipment identifier of a video acquisition equipment which is sent by a sharing terminal and selected to be monitored by a user; acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier and an interface coding stream of a human-computer interaction interface in the shared terminal; splicing the video coding stream and the interface coding stream to generate a sharing terminal desktop video coding stream, and decoding the sharing terminal desktop video coding stream to provide the sharing terminal with an audio and video call display; receiving a video channel, a video coding parameter and a Session Initiation Protocol (SIP) stream parameter of an initiating terminal sent by a server; sending the desktop sharing state of the sharing terminal to a server; when the desktop sharing state is enabled, the desktop video coding stream of the sharing terminal, which corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters, is fed back to the server according to the desktop sharing request of the desktop sharing terminal, so that the desktop sharing problem among the commanding and dispatching terminals is solved, the lower running efficiency of a chip and an operating system of a commanding and dispatching platform is occupied according to the desktop sharing request and the desktop sharing state in audio and video communication, the desktop sharing among the commanding and dispatching terminals is realized, and the effect of burden is not brought to the commanding and dispatching terminals.

EXAMPLE III

Fig. 4a is a flowchart of a method for directing desktop sharing between scheduling terminals according to a third embodiment of the present invention, where the method may be executed by an external codec connected to an initiating terminal, and the external codec is used to bind at least one video capture device. As shown in fig. 4a, the method specifically includes:

and 310, establishing audio and video call connection with the sharing terminal through the server.

The initiator of the audio/video call connection may be an initiating terminal or a sharing terminal of the desktop sharing request.

And step 320, receiving an equipment identifier of the video acquisition equipment sent by the initiating terminal, wherein the video acquisition equipment selects monitored equipment for a user.

And step 330, acquiring a video coding stream of the video acquisition device matched with the device identifier, and initiating an interface coding stream of a human-computer interaction interface in the terminal.

And 340, splicing the video coding stream and the interface coding stream to generate an initiating terminal desktop video coding stream, and decoding the initiating terminal desktop video coding stream to provide the initiating terminal for audio and video call display.

It should be noted that the processes corresponding to steps 310 to 340 may be similar to the processes corresponding to steps 210 and 240, and are not described herein again. Fig. 4b is a schematic diagram of an audio/video call performed between commanding and scheduling terminals according to a third embodiment of the present invention, and as shown in fig. 4b, through steps 210 to 240 and steps 310 to 340, an audio/video call may be established between an initiating terminal and a sharing terminal, and video capture devices monitored by the initiating terminal and the sharing terminal are respectively displayed in respective human-computer interaction interfaces.

And step 350, sending a desktop sharing request aiming at the sharing terminal to the server.

The desktop sharing request is used for the server to indicate an external coder-decoder connected with the sharing terminal to generate a sharing terminal desktop video coding stream, and the sharing terminal desktop video coding stream is fed back to the server. The initiating terminal may initiate a desktop sharing request to the sharing terminal, and the specific process may be that the initiating terminal sends the desktop sharing request for the sharing terminal to an external codec connected to the initiating terminal. The external codec may send the desktop sharing request to the server to implement SIP service registration. The server can send the desktop sharing request to an external codec connected with the sharing terminal to acquire the desktop video coding stream of the sharing terminal.

In an implementation manner of the embodiment of the present invention, optionally, sending a desktop sharing request for a shared terminal to a server includes: and sending the video channel, the video coding parameters and the SIP streaming parameters aiming at the shared terminal to a server.

The initiating terminal can send the parameters related to the desktop sharing request to the server through the connected external codec. Determining a shared video which is expected to be acquired through a video channel in parameters related to the desktop sharing request, for example, when the video channel is a first video, it may be an expected video which is acquired by a video acquisition device which is being monitored by a sharing terminal; when the video channel is the second video, the video channel can be a video which is expected to acquire a human-computer interaction interface in the sharing terminal and the video acquisition equipment which is monitoring. The shared video desired to be acquired may be set by video coding parameters. The shared terminal desired to be connected to and the server used can be set by the SIP flow parameter.

And step 360, receiving the desktop sharing state of the sharing terminal sent by the server.

In order for the external codec to know whether video is received, the desktop sharing status may be sent to the external codec.

When the desktop sharing state of the sharing terminal is started, the initiating terminal and the sharing terminal can establish desktop sharing. The user of the initiating terminal and the user of the sharing terminal can agree whether to initiate the desktop sharing request in the audio and video call. If the desktop sharing state of the sharing terminal is started after the desktop sharing request is initiated, desktop sharing can be established; if the desktop sharing state of the sharing terminal is not started after the desktop sharing request is initiated, the initiating terminal can prompt the sharing terminal to change the desktop sharing state to be started through audio and video communication so as to share the desktop.

The sharing terminal can send the desktop sharing state of the sharing terminal to the server, or can send the desktop sharing state through the connected external codec. The server may send the desktop sharing state to the originating terminal, so that a user of the originating terminal knows whether desktop sharing is possible under the current situation. The server may also send the desktop sharing state to the external codec connected to the initiating terminal to indicate whether the external codec receives the shared terminal desktop video encoding stream.

And step 370, when the desktop sharing state is enabled, receiving the shared terminal desktop video coding stream sent by the server, and splicing the shared terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream.

The desktop video coding stream of the sharing terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the sharing terminal and a video coding stream of video acquisition equipment currently monitored by the sharing terminal. The initiating terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in the initiating terminal with a video coding stream of a video acquisition device currently monitored by the initiating terminal. The video capture devices monitored by the sharing terminal and the initiating terminal may be one or more, or there may be no video capture device being monitored. The video capture devices monitored by the shared terminal and the initiating terminal may be the same, different, or partially the same.

And the external codec connected with the initiating terminal splices the shared terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream. For example, by combining the desktop video coding streams, the human-computer interaction interface of the initiating terminal may display a video corresponding to the interface coding stream of the human-computer interaction interface in the initiating terminal at a specified position, display a video corresponding to the video coding stream of the video capture device currently monitored by the initiating terminal at a preset first display position, and display a video corresponding to the desktop video coding stream of the sharing terminal at a preset second display position.

In an implementation manner of the embodiment of the present invention, optionally, the receiving a shared terminal desktop video encoding stream sent by a server includes: and receiving the sharing terminal desktop video coding stream which is sent by the server, corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters.

And 380, decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display.

The external codec connected with the initiating terminal can decode the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sends the combined desktop video decoding stream to the initiating terminal. The initiating terminal can display the desktop sharing in the human-computer interaction interface according to the combined desktop video decoding stream and the coding stream splicing corresponding mode. The external codec can send the combined desktop video decoding stream to the initiating terminal, and then the initiating terminal sends the combined desktop video decoding stream to the human-computer interaction interface for display. In order to reduce the burden on the commanding and scheduling terminal, the external codec can also directly send the combined desktop video decoding stream to the human-computer interaction interface for display. The transmission of video may be achieved through an HDMI interface.

According to the technical scheme of the embodiment, audio and video call connection is established with the sharing terminal through the server; receiving an equipment identifier of a video acquisition equipment which is sent by an initiating terminal and selected to be monitored by a user; acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier, and initiating an interface coding stream of a human-computer interaction interface in the terminal; splicing the video coding stream and the interface coding stream to generate an initiating terminal desktop video coding stream, and decoding the initiating terminal desktop video coding stream to provide the initiating terminal desktop video coding stream for audio and video call display; sending a desktop sharing request aiming at a sharing terminal to a server; receiving a desktop sharing state of a sharing terminal sent by a server; when the desktop sharing state is started, receiving a sharing terminal desktop video coding stream sent by a server, and splicing the sharing terminal desktop video coding stream and an initiating terminal desktop video coding stream to generate a combined desktop video coding stream; the combined desktop video coding stream is decoded to obtain a combined desktop video decoding stream, and the combined desktop video decoding stream is sent to the initiating terminal for sharing display, so that the desktop sharing problem among the commanding and dispatching terminals is solved, the lower running efficiency of a chip and an operating system of a commanding and dispatching platform is occupied according to a desktop sharing request and a desktop sharing state in audio and video conversation, the desktop sharing among the commanding and dispatching terminals is realized, and the effect of bringing burden to the commanding and dispatching terminals is avoided.

Example four

Fig. 5a is a flowchart of a method for directing desktop sharing between scheduling terminals according to a fourth embodiment of the present invention, and as shown in fig. 5a, the method includes:

and step 410, the external codec connected with the initiating terminal sends a desktop sharing request aiming at the sharing terminal to the server.

The desktop sharing request is used for the server to indicate an external coder-decoder connected with the sharing terminal to generate a sharing terminal desktop video coding stream, and the sharing terminal desktop video coding stream is fed back to the external coder-decoder connected with the initiating terminal through the server.

In an implementation manner of the embodiment of the present invention, optionally, sending, by an external codec connected to the initiating terminal, a desktop sharing request for a sharing terminal to a server includes: and the external codec connected with the initiating terminal sends the video channel, the video coding parameters and the SIP streaming parameters aiming at the shared terminal to the server.

Step 420, the external codec connected to the sharing terminal receives the desktop sharing request of the initiating terminal sent by the server.

In an implementation manner of the embodiment of the present invention, optionally, the receiving, by an external codec connected to the sharing terminal, the desktop sharing request of the initiating terminal sent by the server includes: and the external codec connected with the sharing terminal receives the video channel, the video coding parameter and the SIP stream parameter of the initiating terminal sent by the server.

And step 430, the external codec connected with the sharing terminal feeds back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request.

The desktop video coding stream of the sharing terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the sharing terminal and a video coding stream of video acquisition equipment currently monitored by the sharing terminal.

In an implementation manner of the embodiment of the present invention, optionally, before the external codec connected to the sharing terminal feeds back the desktop video encoding stream of the sharing terminal to the server according to the desktop sharing request, the method further includes: and the external codec connected with the sharing terminal sends the desktop sharing state of the sharing terminal to the server.

In an implementation manner of the embodiment of the present invention, optionally, when the desktop sharing state is enabled, the external codec connected to the sharing terminal feeds back, according to the desktop sharing request, the desktop video encoding stream of the sharing terminal, which corresponds to the video channel and is registered according to the video encoding parameter and the SIP stream parameter, to the server.

Step 440, the external codec connected to the initiating terminal receives the shared terminal desktop video encoded stream sent by the server, and splices the shared terminal desktop video encoded stream and the initiating terminal desktop video encoded stream to generate a combined desktop video encoded stream.

And 450, decoding the combined desktop video coding stream by the external coder-decoder connected with the initiating terminal to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display.

According to the technical scheme of the embodiment of the invention, the external codec connected with the initiating terminal sends a desktop sharing request aiming at the sharing terminal to the server; an external codec connected with a sharing terminal receives a desktop sharing request of an initiating terminal sent by a server; the external coder-decoder connected with the sharing terminal feeds back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; an external codec connected with the initiating terminal receives a sharing terminal desktop video coding stream sent by the server, and the sharing terminal desktop video coding stream and the initiating terminal desktop video coding stream are spliced to generate a combined desktop video coding stream; the external codec connected with the initiating terminal decodes the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sends the combined desktop video decoding stream to the initiating terminal for sharing display, so that the desktop sharing problem among the commanding and dispatching terminals is solved, the operating efficiency of a chip and an operating system occupying a lower commanding and dispatching platform is realized according to a desktop sharing request and a desktop sharing state in audio and video conversation, the desktop sharing among the commanding and dispatching terminals is realized, and the effect of bringing no burden to the commanding and dispatching terminals is achieved.

On the basis of the foregoing embodiment, optionally, before the external codec connected to the initiating terminal sends a desktop sharing request for the sharing terminal to the server, the method further includes: and the external coder-decoder connected with the initiating terminal establishes audio-video call connection with the sharing terminal through the server. Or the external codec connected with the sharing terminal establishes audio and video call connection with the initiating terminal through the server.

Optionally, the method further includes: an external codec connected with an initiating terminal receives an equipment identifier of a video acquisition equipment which is sent by the initiating terminal and is selected by a user for monitoring; acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier and initiating an interface coding stream of a human-computer interaction interface in the terminal; and splicing the video coding stream and the interface coding stream to generate an initiating terminal desktop video coding stream, and decoding the initiating terminal desktop video coding stream to provide the initiating terminal for audio and video call display.

Or the external codec connected with the sharing terminal receives the equipment identifier of the video acquisition equipment which is sent by the sharing terminal and selected by the user for monitoring; acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier and an interface coding stream of a human-computer interaction interface in the shared terminal; and splicing the video coding stream and the interface coding stream to generate a sharing terminal desktop video coding stream, and decoding the sharing terminal desktop video coding stream to provide the sharing terminal with the sharing terminal for audio and video call display.

Fig. 5b is a flowchart of a desktop sharing method between the commanding and scheduling terminals according to the fourth embodiment of the present invention, and as shown in fig. 5b, the initiating terminal and the sharing terminal may first establish an audio/video call. In the audio and video call, videos of the video acquisition equipment bound by the external codec selected by the corresponding user and corresponding human-computer interaction interface videos can be respectively displayed in human-computer interaction interfaces of the initiating terminal and the sharing terminal.

In the audio and video call, the initiating terminal and the sharing terminal can agree whether desktop sharing is needed or not, and if the desktop sharing is not executed, the audio and video call can be continued until the audio and video call is finished. If desktop sharing is performed, the external codec to which the originating terminal is connected may register with the server for SIP services (e.g., including registration of video channels, video encoding parameters, and SIP streaming parameters).

According to SIP service registration, the external codec connected with the sharing terminal can encode the sharing terminal desktop video decoding stream output to the sharing terminal man-machine interaction interface through the HDMI interface to generate a sharing terminal desktop video encoding stream, and the sharing terminal desktop video encoding stream is fed back to the external codec connected with the initiating terminal through the server.

The external codec connected with the initiating terminal can splice the shared terminal desktop video coding stream with the initiating terminal desktop video decoding stream output to the initiating terminal human-computer interaction interface through the HDMI interface to generate a combined desktop video decoding stream, and the combined desktop video decoding stream is sent to the human-computer interaction interface of the initiating terminal through the HDMI interface to be displayed, so that desktop sharing is realized.

When the audio and video call is finished, the audio and video call and the desktop sharing can be finished. Or, when the desktop sharing is finished, the desktop sharing can be finished; and when the audio and video call is finished, finishing the audio and video call.

EXAMPLE five

Fig. 6 is a schematic structural diagram of a desktop sharing device between director and dispatcher terminals according to a fifth embodiment of the present invention. The device can be arranged on an external coder-decoder connected with the sharing terminal, and the external coder-decoder is used for binding at least one video acquisition device. With reference to fig. 6, the apparatus comprises: a desktop sharing request receiving module 610 and a sharing terminal desktop video coding stream feedback module 620.

A desktop sharing request receiving module 610, configured to receive a desktop sharing request initiated by an initiating terminal and sent by a server;

a shared terminal desktop video encoded stream feedback module 620, configured to feed back a shared terminal desktop video encoded stream to the server according to the desktop sharing request; the method comprises the steps that a desktop video coding stream of a shared terminal is generated by splicing an interface coding stream of a human-computer interaction interface in the shared terminal and a video coding stream of video acquisition equipment currently monitored by the shared terminal;

The method comprises the steps that a desktop video coding stream of a sharing terminal is sent to an external coder-decoder of an initiating terminal through a server to be decoded, and then the decoded desktop video coding stream is provided for the initiating terminal to be displayed in a sharing mode.

Optionally, the apparatus further includes:

the audio and video call connection establishing module is used for establishing audio and video call connection with the initiating terminal through the server before receiving a desktop sharing request of the initiating terminal sent by the server;

the device identification receiving module is used for receiving the device identification of the video acquisition device sent by the sharing terminal, and the video acquisition device selects a monitoring device for a user;

the device comprises a coding stream acquisition module, a video acquisition module and a sharing terminal, wherein the coding stream acquisition module is used for acquiring a video coding stream of the video acquisition device matched with the device identifier and an interface coding stream of a human-computer interaction interface in the sharing terminal;

and the coding stream splicing module is used for splicing the video coding stream and the interface coding stream to generate a sharing terminal desktop video coding stream, and decoding the sharing terminal desktop video coding stream and providing the sharing terminal desktop video coding stream to a sharing terminal for audio and video call display.

Optionally, the desktop sharing request receiving module 610 includes:

and the parameter receiving unit is used for receiving the video channel, the video coding parameter and the SIP stream parameter of the initiating terminal, which are sent by the server.

Optionally, the shared terminal desktop video encoding stream feedback module 620 includes:

and the shared terminal desktop video coding stream feedback unit is used for feeding back the shared terminal desktop video coding stream which corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters to the server according to the desktop sharing request.

Optionally, the apparatus further includes:

the sharing state sending module is used for sending the desktop sharing state of the sharing terminal to the server after receiving the desktop sharing request of the initiating terminal sent by the server;

and the sharing terminal desktop video coding stream feedback module is used for feeding back the sharing terminal desktop video coding stream to the server according to the desktop sharing request when the desktop sharing state is enabled.

The desktop sharing device between the commanding and scheduling terminals provided by the embodiment of the invention can execute the desktop sharing method between the commanding and scheduling terminals provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

EXAMPLE six

Fig. 7 is a schematic structural diagram of a desktop sharing device between commanding and scheduling terminals according to a sixth embodiment of the present invention. The device can be configured in an external codec connected with the initiating terminal, and the external codec is used for binding at least one video acquisition device. With reference to fig. 7, the apparatus comprises: a desktop sharing request sending module 710, a combined desktop video coding stream generating module 720 and a combined desktop video decoding stream sending module 730.

The desktop sharing request sending module 710 is configured to send a desktop sharing request for a sharing terminal to a server;

the desktop sharing request is used for the server to indicate an external coder-decoder connected with the sharing terminal to generate a sharing terminal desktop video coding stream and feed back the sharing terminal desktop video coding stream to the server;

the combined desktop video coding stream generating module 720 is configured to receive a shared terminal desktop video coding stream sent by the server, and splice the shared terminal desktop video coding stream and the originating terminal desktop video coding stream to generate a combined desktop video coding stream;

and the combined desktop video decoding stream sending module 730 is configured to decode the combined desktop video coding stream to obtain a combined desktop video decoding stream, and send the combined desktop video decoding stream to the initiating terminal for shared display.

Optionally, the apparatus further includes:

the audio and video call connection establishing module is used for establishing audio and video call connection with the sharing terminal through the server before sending a desktop sharing request aiming at the sharing terminal to the server;

the device identification receiving module is used for receiving the device identification of the video acquisition device sent by the initiating terminal, and the video acquisition device selects a monitoring device for a user;

The encoding stream acquisition module is used for acquiring a video encoding stream of the video acquisition equipment matched with the equipment identifier and initiating an interface encoding stream of a human-computer interaction interface in the terminal;

and the coded stream splicing module is used for splicing the video coded stream and the interface coded stream to generate an initiating terminal desktop video coded stream, and decoding the initiating terminal desktop video coded stream to provide the initiating terminal with audio and video call display.

Optionally, the desktop sharing request sending module 710 includes:

and the parameter sending unit is used for sending the video channel, the video coding parameters and the session initiation protocol SIP stream parameters aiming at the shared terminal to the server.

Optionally, the combined desktop video coding stream generating module 720 includes:

and the shared terminal desktop video coding stream receiving unit is used for receiving the shared terminal desktop video coding stream which is sent by the server, corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters.

Optionally, the apparatus further includes:

the desktop sharing state receiving module is used for receiving the desktop sharing state of the sharing terminal sent by the server after sending the desktop sharing request aiming at the sharing terminal to the server;

And the sharing terminal desktop video coding stream receiving module is used for receiving the sharing terminal desktop video coding stream sent by the server when the desktop sharing state is started.

EXAMPLE seven

Fig. 8 is a schematic structural diagram of a system for sharing desktops between orchestration terminals according to a seventh embodiment of the present invention, and as shown in fig. 8, the system includes: an originating terminal 810, an external codec 820 to which the originating terminal is connected, a shared terminal 830, an external codec 840 to which the shared terminal is connected, and a server 850.

The initiating terminal 810, the external codec 820 connected with the initiating terminal, the shared terminal 830 and the external codec 840 connected with the shared terminal are respectively connected with the server 850;

the external codec 820 connected with the initiating terminal and the external codec 840 connected with the sharing terminal are respectively bound with at least one video acquisition device;

the initiating terminal is used for sending a desktop sharing request aiming at the sharing terminal 830 to the server 850 through the external codec 820 connected with the initiating terminal;

The desktop sharing request is used for the server 850 to instruct the external codec 840 connected to the sharing terminal to generate a sharing terminal desktop video encoding stream, and the sharing terminal desktop video encoding stream is fed back to the external codec 820 connected to the initiating terminal through the server 850;

the external codec 840 connected to the sharing terminal is configured to receive a desktop sharing request of the initiating terminal 810 sent by the server 850, and feed back a desktop video coding stream of the sharing terminal to the server 850 according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing the interface coding stream of the human-computer interaction interface in the sharing terminal 830 with the video coding stream of the video acquisition device currently monitored by the sharing terminal;

the external codec 820 connected to the initiating terminal is configured to generate a combined desktop video encoded stream by receiving the shared terminal desktop video encoded stream sent by the server 850 and splicing the shared terminal desktop video encoded stream and the initiating terminal desktop video encoded stream;

and the external codec 820 connected to the initiating terminal is configured to decode the combined desktop video encoded stream to obtain a combined desktop video decoded stream, and send the combined desktop video decoded stream to the initiating terminal 810 for shared display.

On the basis of the foregoing embodiment, optionally, the system includes: the external codec 820 connected to the initiating terminal (or the external codec 840 connected to the sharing terminal) is further configured to establish an audio/video call connection with the sharing terminal 830 (or the initiating terminal 810) through the server 850 before the external codec 820 connected to the initiating terminal sends a desktop sharing request for the sharing terminal 830 to the server 850.

Optionally, the system further includes: the external codec 820 connected to the initiating terminal (or the external codec 840 connected to the sharing terminal) is further configured to receive the device identifier of the video capture device that the user selects to monitor, which is sent by the initiating terminal 810 (or the sharing terminal 830); acquiring a video coding stream of the video acquisition device matched with the device identifier, and an interface coding stream of a human-computer interaction interface in the initiating terminal 810 (or the sharing terminal 830); and splicing the video coding stream and the interface coding stream to generate an initiating terminal desktop video coding stream (or a shared terminal desktop video coding stream), and decoding the initiating terminal desktop video coding stream (or the shared terminal desktop video coding stream) and providing the decoded initiating terminal desktop video coding stream (or the shared terminal desktop video coding stream) to the initiating terminal 810 (or the shared terminal 830) for audio and video call display.

Example eight

Fig. 9 is a schematic structural diagram of an electronic device according to an eighth embodiment of the present invention, and as shown in fig. 9, the electronic device includes:

one or more processors 910, one processor 910 being illustrated in FIG. 9;

a memory 920;

the apparatus may further include: an input device 930 and an output device 940.

The processor 910, the memory 920, the input device 930, and the output device 940 in the apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 9.

The memory 920 is used as a non-transitory computer-readable storage medium, and may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a method for directing desktop sharing between scheduling terminals in an embodiment of the present invention (for example, the plane sharing request receiving module 610 and the sharing terminal desktop video encoded stream feedback module 620 shown in fig. 6, or the desktop sharing request sending module 710, the combined desktop video encoded stream generating module 720, and the combined desktop video decoded stream sending module 730 shown in fig. 7). The processor 910 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 920, that is, implementing a method for desktop sharing between the commanding and scheduling terminals in the above method embodiments, that is:

and after the desktop video coding stream of the sharing terminal is sent to the external coder-decoder of the initiating terminal by the server for decoding, the desktop video coding stream of the sharing terminal is provided for the initiating terminal for sharing display. Alternatively, the first and second liquid crystal display panels may be,

sending a desktop sharing request aiming at a sharing terminal to a server;

receiving the sharing terminal desktop video coding stream sent by the server, and splicing the sharing terminal desktop video coding stream and the initiating terminal desktop video coding stream to generate a combined desktop video coding stream;

The memory 920 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 920 may optionally include memory located remotely from processor 910, which may be connected to a terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. The output device 940 may include a display device such as a display screen.

Example nine

An embodiment ninth of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for sharing a desktop between scheduling terminals according to an embodiment of the present invention:

feeding back a sharing terminal desktop video coding stream to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of video acquisition equipment currently monitored by the sharing terminal;

and the shared terminal desktop video coding stream is sent to the external coder-decoder of the initiating terminal by the server for decoding and then is provided for the initiating terminal for sharing display. Alternatively, the first and second liquid crystal display panels may be,

sending a desktop sharing request aiming at a sharing terminal to a server;

Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing description is only exemplary of the invention and that the principles of the technology may be employed. Those skilled in the art will appreciate that the present invention is not limited to the particular embodiments described herein, and that various obvious changes, rearrangements and substitutions will now be apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in some detail by the above embodiments, the invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the invention, and the scope of the invention is determined by the scope of the appended claims.

Claims

1. A method for commanding desktop sharing among scheduling terminals is executed by an external codec connected with a sharing terminal, wherein the external codec is used for binding at least one video acquisition device, and the method is characterized by comprising the following steps:

the desktop video coding stream of the sharing terminal is sent to the external coder-decoder of the initiating terminal through the server for decoding, and then is provided for the initiating terminal for sharing display;

before the receiving a desktop sharing request of an initiating terminal sent by a server, the method further includes:

establishing audio and video call connection with the initiating terminal through a server;

receiving an equipment identifier of video acquisition equipment sent by the sharing terminal, wherein the video acquisition equipment is equipment selected and monitored by a user;

acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier and an interface coding stream of a human-computer interaction interface in the shared terminal;

Splicing the video coding stream and the interface coding stream to generate a shared terminal desktop video coding stream, and decoding the shared terminal desktop video coding stream to provide the shared terminal desktop video coding stream for audio and video call display;

the initiating terminal sends a desktop sharing request to the server through the connected external codec, and the sharing terminal receives the desktop sharing request sent by the server through the connected external codec.

2. The method of claim 1, wherein receiving a desktop sharing request of an originating terminal sent by a server comprises:

receiving a video channel, a video coding parameter and a Session Initiation Protocol (SIP) stream parameter of an initiating terminal, which are sent by a server;

feeding back a sharing terminal desktop video coding stream to the server according to the desktop sharing request, wherein the method comprises the following steps:

and according to the desktop sharing request, feeding back the desktop video coding stream of the sharing terminal, which corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters, to the server.

3. The method according to claim 1, after receiving a desktop sharing request of an originating terminal sent by a server, further comprising:

Sending the desktop sharing state of the sharing terminal to the server;

and when the desktop sharing state is started, feeding back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request.

4. A method for sharing desktop between commanding and scheduling terminals is executed by an external coder-decoder connected with an initiating terminal, wherein the external coder-decoder is used for binding at least one video acquisition device, and the method is characterized by comprising the following steps:

sending a desktop sharing request aiming at a sharing terminal to a server;

decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sending the combined desktop video decoding stream to the initiating terminal for shared display;

before the sending of the desktop sharing request for the shared terminal to the server, the method further includes:

Establishing audio and video call connection with the sharing terminal through a server;

receiving an equipment identifier of video acquisition equipment sent by the initiating terminal, wherein the video acquisition equipment is equipment selected and monitored by a user;

acquiring a video coding stream of the video acquisition equipment matched with the equipment identifier and an interface coding stream of a human-computer interaction interface in the initiating terminal;

splicing the video coding stream and the interface coding stream to generate an initiating terminal desktop video coding stream, and decoding the initiating terminal desktop video coding stream to provide the initiating terminal desktop video coding stream for audio and video call display;

the initiating terminal sends a desktop sharing request to the server through the connected external coder-decoder, and the sharing terminal receives the desktop sharing request sent by the server through the connected external coder-decoder.

5. The method of claim 4, wherein sending a desktop sharing request for the shared terminal to the server comprises:

sending a video channel, video coding parameters and Session Initiation Protocol (SIP) stream parameters aiming at the shared terminal to a server;

receiving the shared terminal desktop video coding stream sent by the server, including:

And receiving the sharing terminal desktop video coding stream which is sent by the server, corresponds to the video channel and is registered according to the video coding parameters and the SIP stream parameters.

6. The method of claim 4, after sending the desktop sharing request for the sharing terminal to the server, further comprising:

receiving the desktop sharing state of the sharing terminal sent by the server;

and when the desktop sharing state is started, receiving the desktop video coding stream of the sharing terminal sent by the server.

7. A method for sharing desktops among command and dispatch terminals is characterized by comprising the following steps:

an external coder-decoder connected with an initiating terminal sends a desktop sharing request aiming at a sharing terminal to a server;

the external coder-decoder connected with the sharing terminal feeds back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of a video acquisition device currently monitored by the sharing terminal;

the external coder-decoder connected with the initiating terminal decodes the combined desktop video coding stream to obtain a combined desktop video decoding stream, and sends the combined desktop video decoding stream to the initiating terminal for shared display;

receiving an equipment identifier of video acquisition equipment sent by the shared terminal, wherein the video acquisition equipment is equipment selected and monitored by a user;

splicing the video coding stream and the interface coding stream to generate a sharing terminal desktop video coding stream, and decoding the sharing terminal desktop video coding stream to provide the sharing terminal with the sharing terminal for audio and video call display;

8. A desktop sharing system between commanding and scheduling terminals is characterized by comprising: the system comprises an initiating terminal, an external coder-decoder connected with the initiating terminal, a sharing terminal, an external coder-decoder connected with the sharing terminal and a server;

the initiating terminal, the external codec connected with the initiating terminal, the sharing terminal and the external codec connected with the sharing terminal are respectively connected with the server;

The external coder-decoder connected with the sharing terminal is used for receiving a desktop sharing request of the initiating terminal sent by a server and feeding back the desktop video coding stream of the sharing terminal to the server according to the desktop sharing request; the sharing terminal desktop video coding stream is generated by splicing an interface coding stream of a human-computer interaction interface in a sharing terminal with a video coding stream of video acquisition equipment currently monitored by the sharing terminal;

the external codec connected with the initiating terminal is used for decoding the combined desktop video coding stream to obtain a combined desktop video decoding stream and sending the combined desktop video decoding stream to the initiating terminal for shared display;