CN111031274A - Method for watching video conference without adding video session - Google Patents

Abstract

The invention discloses a method for watching a video conference without adding a video session. The method specifically comprises the following steps: (1) appointing roles which can be added into the session, wherein the roles which can be added into the session are divided into common roles which can receive and transmit data and virtual roles which can only receive and do not transmit data, the roles which participate in the session are appointed to be common roles, and the roles which do not participate in the session are appointed to be virtual roles; (2) allowing the virtual role to join in the session, receiving data packets of all common roles, but not sending data outwards; (3) respectively synthesizing and outputting audio and video data of all common roles, wherein the output only comprises one path of audio and one path of video; (4) both the generic character and the virtual character can view this session on any player that supports playback. The invention has the beneficial effects that: so that the third party personnel can watch the conversation of other members on the premise of not participating in the conversation.

Description

Method for watching video conference without adding video session

Technical Field

The invention relates to the technical field related to video communication, in particular to a method for watching a video conference without adding a video session.

Background

Currently, a mainstream video conference system can perform audio and video communication with other members only after a client serves as a member to join a session. If a third party person wishes to view the session without participating in it, the system is no longer satisfactory.

Disclosure of Invention

The present invention provides a method for allowing third-party people to watch a video conference without participation on the premise of not adding a video session, so as to overcome the defects in the prior art.

In order to achieve the purpose, the invention adopts the following technical scheme:

a method for watching a video conference without adding a video session specifically comprises the following steps:

(1) appointing roles which can be added into the session, wherein the roles which can be added into the session are divided into common roles which can receive and transmit data and virtual roles which can only receive and do not transmit data, the roles which participate in the session are appointed to be common roles, and the roles which do not participate in the session are appointed to be virtual roles;

(2) allowing the virtual role to join in the session, receiving data packets of all common roles, but not sending data outwards;

(3) respectively synthesizing and outputting audio and video data of all common roles, wherein the output only comprises one path of audio and one path of video;

(4) both the generic character and the virtual character can view this session on any player that supports playback.

Through the design of the method, the third-party personnel can watch the conversation of other members on the premise of not participating in the conversation.

Preferably, in step (1), in the role management of the joining session, the original role is a normal role, and when the joining or quitting session, other normal roles receive the joining or quitting message of the normal role, so that the player can correctly display the number of members and the corresponding pictures; and a virtual role is added, when the virtual role joins or exits, the common role and the virtual role can not receive the information of joining or exiting the virtual role, and when the common role joins or exits, the common role and the virtual role can receive the information of joining or exiting the common role. The virtual role is designed according to the design that audio and video data of other common members in the conversation can be received without adding the conversation.

Preferably, in the step (3), the specific operation steps of respectively synthesizing and outputting the audio and video data of all the common characters are as follows:

(31) setting a video synthesis template, and synthesizing video data into a new video source according to the video synthesis template;

(32) synthesizing the multi-channel audio into a new audio source;

(33) and respectively pushing the obtained video source data and the obtained audio source data to a stream pushing server.

Preferably, in step (31), the specific synthesis method is as follows:

(311) decoding the video data of each path of common role into YUV or RGB data respectively;

(312) rendering the video data of each path of common role to the corresponding position of the video synthesis template through OpenGL;

(313) extracting YUV data of the synthesized picture;

(314) and coding the extracted YUV data to obtain synthesized video data.

Preferably, in step (32), the specific synthesis method is as follows:

(321) respectively decoding the audio data of each path of common role into pcm data;

(322) mixing the sound of each path of pcm data through a sound mixing algorithm, and outputting one path of pcm;

(323) and coding the pcm to obtain the synthesized audio data.

The invention has the beneficial effects that: so that the third party personnel can watch the conversation of other members on the premise of not participating in the conversation.

Drawings

FIG. 1 is a block diagram of one configuration of a video compositing template of the present invention;

fig. 2 is a block diagram of another structure of the video compositing module of the present invention.

Detailed Description

The invention is further described with reference to the following figures and detailed description.

A method for watching a video conference without adding a video session specifically comprises the following steps:

(1) appointing roles which can be added into the session, wherein the roles which can be added into the session are divided into common roles which can receive and transmit data and virtual roles which can only receive and do not transmit data, the roles which participate in the session are appointed to be common roles, and the roles which do not participate in the session are appointed to be virtual roles; in the role management of the joining session, the original role is a common role, and when the joining or quitting session, other common roles receive the joining or quitting message of the common role, so that the player can correctly display the number of members and corresponding pictures; a virtual role is added, when the virtual role joins or exits, the common role and the virtual role can not receive the message of joining or exiting the virtual role, and when the common role joins or exits, the common role and the virtual role can receive the message of joining or exiting the common role; the virtual role is designed according to the design that the audio and video data of other common members in the conversation can be received without adding the conversation;

(2) allowing the virtual role to join in the session, receiving data packets of all common roles, but not sending data outwards;

(3) respectively synthesizing and outputting audio and video data of all common roles, wherein the output only comprises one path of audio and one path of video; the specific operation steps are as follows:

(31) setting a video synthesis template (for example: fig. 1 and fig. 2, wherein each member in fig. 1 does not cover each other; fig. 2, member 1 is a main picture covering the whole display area, and other members (not necessarily two, but also fewer or more) cover member 1, and the display area can be changed; including but not limited to the templates of fig. 1 and fig. 2), and synthesizing video data into a new video source according to the video synthesis template; the specific synthesis method comprises the following steps:

(311) decoding the video data of each path of common role into YUV or RGB data respectively;

(312) rendering the video data of each path of common role to the corresponding position of the video synthesis template through OpenGL;

(313) extracting YUV data of the synthesized picture;

(314) encoding the extracted YUV data (for example, encoding the extracted YUV data into H264) to obtain synthesized video data;

(32) synthesizing the multi-channel audio into a new audio source; the specific synthesis method comprises the following steps:

(321) respectively decoding the audio data of each path of common role into pcm data;

(322) mixing the sound of each path of pcm data through a sound mixing algorithm, and outputting one path of pcm;

(323) coding pcm (such as opus) to obtain synthesized audio data;

(33) respectively pushing the obtained video source data and the obtained audio source data to a stream pushing server; the plug flow server may be rtmp or http streaming;

(4) both the generic and virtual roles can view this session on any player that supports playing rtmp/http.

Through the design of the method, the third-party personnel can watch the conversation of other members on the premise of not participating in the conversation.

Claims (5)

1. A method for watching a video conference without adding a video session is characterized by comprising the following steps:

(1) appointing roles which can be added into the session, wherein the roles which can be added into the session are divided into common roles which can receive and transmit data and virtual roles which can only receive and do not transmit data, the roles which participate in the session are appointed to be common roles, and the roles which do not participate in the session are appointed to be virtual roles;

(2) allowing the virtual role to join in the session, receiving data packets of all common roles, but not sending data outwards;

(3) respectively synthesizing and outputting audio and video data of all common roles, wherein the output only comprises one path of audio and one path of video;

(4) both the generic character and the virtual character can view this session on any player that supports playback.

2. The method according to claim 1, wherein in step (1), in the role management of the join session, the original role is a normal role, and when the join session or the quit session, other normal roles receive the join or quit message of the normal role, so that the player can correctly display the number of members and the corresponding pictures; and a virtual role is added, when the virtual role joins or exits, the common role and the virtual role can not receive the information of joining or exiting the virtual role, and when the common role joins or exits, the common role and the virtual role can receive the information of joining or exiting the common role.

3. The method for watching the video conference without adding the video session according to claim 1 or 2, wherein in the step (3), the specific operation steps of respectively synthesizing and outputting the audio and video data of all the common roles are as follows:

(31) setting a video synthesis template, and synthesizing video data into a new video source according to the video synthesis template;

(32) synthesizing the multi-channel audio into a new audio source;

(33) and respectively pushing the obtained video source data and the obtained audio source data to a stream pushing server.

4. A method for watching a video conference without joining a video session according to claim 3, wherein in step (31), the specific synthesis method is as follows:

(311) decoding the video data of each path of common role into YUV or RGB data respectively;

(312) rendering the video data of each path of common role to the corresponding position of the video synthesis template through OpenGL;

(313) extracting YUV data of the synthesized picture;

(314) and coding the extracted YUV data to obtain synthesized video data.

5. A method for watching a video conference without joining a video session according to claim 3, wherein in step (32), the specific composition method is as follows:

(321) respectively decoding the audio data of each path of common role into pcm data;

(322) mixing the sound of each path of pcm data through a sound mixing algorithm, and outputting one path of pcm;

(323) and coding the pcm to obtain the synthesized audio data.

Images