WO2011050690A1

WO2011050690A1 - Method and system for recording and replaying multimedia conference

Info

Publication number: WO2011050690A1
Application number: PCT/CN2010/077973
Authority: WO
Inventors: 魏小霞; 陈显义; 王静; 詹五洲; 李凯; 徐凌峰; 陈庆丰
Original assignee: 华为终端有限公司
Priority date: 2009-11-02
Filing date: 2010-10-22
Publication date: 2011-05-05
Also published as: CN102055949B; CN102055949A

Abstract

The present invention discloses a method and system for recording and replaying multimedia conference. The said multimedia inference recording method comprises the steps of obtaining multiple media streams in the multimedia conference, and executing combined recording process to the multiple media streams according to recording strategies, wherein the data of said media streams includes at least video data or audio data or picture data. Since combined recording process can be implemented to the multiple media streams in the multimedia conference according to recording strategies, and the recording strategies can be determined flexibly, therefore a synthetical situation of the multimedia conference can be reflected.

Description

Method and system for recording and playing back multimedia conferences

The present invention relates to the field of communications technologies, and in particular, to a multimedia conference recording method, a playback method, a recording and playback device, and a recording and broadcasting system. Background technique

At present, the recording method of multimedia conferences is usually in the following form:

A method for recording and broadcasting in a terminal is: integrating a recording and broadcasting system in a traditional television terminal, enabling a recording function of a television terminal during a multimedia conference, recording and storing data of a local audio, video, and the like of the television terminal, Or recording and storing data of the media stream of the remote audio, video, and the like of other television terminals received by the television terminal. After the multimedia conference ends, the data content of the recorded media stream is played back through the television terminal.

Another recording and broadcasting method of the application detecting and recording server is as follows: the probe recording server and the terminal in the multimedia conference, the multipoint control unit (MCU), etc. are connected to the same network. During the multimedia conference, the probe recording server captures the communication data packet on the network, and then extracts data of the media stream to be recorded, such as audio and video data, according to the set filtering information, and then performs storage recording. After the multimedia conference ends, the data of the stored media stream is played back.

In the process of implementing the present invention, the inventors have found that at least the following problems exist in the prior art: The first recording mode, because only the data of the single channel media stream received by the television terminal itself or received is separately recorded and separately stored. It is not possible to perform some combined recording processing on data of multi-channel audio, video and other media streams, such as multi-picture, picture-in-picture and other image forms.

The second recording mode, because the probe recording server captures the communication data packets on the network, and then extracts the audio and video data separately for recording and recording, it is also impossible to perform some combination of the data of the multi-channel audio, video and other media streams. Recording processing. Summary of the invention Embodiments of the present invention provide a multimedia conference recording method, a playback method, a recording device, a playback device, a recording device, and a recording and broadcasting system, which realize combined recording of a multi-way conference media stream in a multimedia conference.

An embodiment of the present invention provides a method for recording a multimedia conference, including:

Obtaining a multi-way conference media stream to be recorded according to a conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream;

The combined recording process is performed on the multi-session conference media stream according to a media recording policy.

Correspondingly, the embodiment of the present invention provides a recording device for a multimedia conference, which comprises:

a receiving module, configured to receive, by the conference-level recording policy, a multi-way conference media stream to be recorded, where the conference media stream is at least a video media stream or an audio media stream;

And a recording processing module, configured to perform combined recording processing on the multi-session conference media stream according to a media recording policy.

Correspondingly, the embodiment of the present invention further provides a playback method of a multimedia conference, including: receiving a playback request carrying a media identifier, where the media identifier is used to identify a media file; and obtaining a corresponding media file according to the media identifier For playing back, the media file is obtained by performing combined recording processing on the multi-way conference media stream in the multimedia conference according to the recording strategy.

Correspondingly, the embodiment of the present invention further provides a multimedia conference playback apparatus for implementing the foregoing method, including:

a playback request receiving module, configured to receive a playback request carrying a media identifier, where the media identifier is used to identify the media file;

a playback module, configured to obtain a corresponding media file according to the media identifier, to perform playback, and the media file is combined to record the multi-way conference media stream in the multimedia conference according to the recording policy. The recording and reproducing device of the multimedia conference includes the above-mentioned recording device or the above-mentioned playback device.

The recording method and device of the multimedia conference provided by the embodiment of the present invention are provided. The embodiment of the present invention provides a method for recording a multimedia conference, including:

Obtaining, by the conference-level recording policy, the multi-way conference media stream to be recorded, where the conference media stream is at least a video media stream or an audio media stream; And storing, according to the site to which the conference media stream belongs, the multi-party conference media stream and the associated identifier, where the association identifier is used to associate the conference media stream of each site.

a receiving module, configured to obtain a multi-way conference media stream of each conference site in the multimedia conference, where the conference media stream is at least a video media stream or an audio media stream;

The association identifier allocation module is configured to store the multi-session conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.

The embodiment of the invention further provides a method for playing back a multimedia conference, including:

And receiving the replay request carrying the associated identifier, and obtaining the multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate the conference media stream of each conference site, where the conference media stream is at least a video media stream or an audio media. Flow

Correspondingly, the embodiment of the present invention further provides a playback device for a multimedia conference, which includes the following methods, including:

a playback request receiving module, configured to receive a playback request with an associated identifier, to obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate a conference media stream of each site, the conference media stream At least a video media stream or an audio media stream;

The playback processing module is configured to perform combined recording processing on the multiple conference media streams according to a media recording policy.

The embodiment of the invention further provides a recording and broadcasting device for a multimedia conference, comprising the above-mentioned recording device or the above-mentioned playback device.

As can be seen from the technical solution provided by the foregoing embodiments of the present invention, since the combined recording process of the multi-way conference media stream in the multimedia conference can be performed according to the recording strategy, the comprehensive situation of the multimedia conference can be better reflected, and the recording strategy is further The ground setting is flexible. DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, Those of ordinary skill in the art, without paying for creative labor Further drawings can also be obtained from these drawings.

1 is a schematic flowchart of a method for recording a multimedia conference according to an embodiment of the present invention;

2 is a schematic structural diagram 1 of a recording apparatus of a multimedia conference according to an embodiment of the present invention;

3 is a schematic structural diagram 2 of a recording apparatus of a multimedia conference according to an embodiment of the present invention;

4 is a schematic flowchart of a method for playing back a multimedia conference according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram 1 of a playback device of a multimedia conference according to an embodiment of the present invention; FIG.

6 is a schematic structural diagram 2 of a playback device of a multimedia conference according to an embodiment of the present invention;

7 is a schematic flowchart of a method for recording a multimedia conference according to an embodiment of the present invention;

8 is a schematic structural diagram 1 of a recording apparatus of a multimedia conference according to an embodiment of the present invention;

9 is a schematic structural diagram 2 of a recording apparatus of a multimedia conference according to an embodiment of the present invention;

FIG. 10 is a schematic flowchart diagram of a method for playing back a multimedia conference according to an embodiment of the present invention;

FIG. 1 is a schematic structural diagram 1 of a playback device of a multimedia conference according to an embodiment of the present invention;

12 is a schematic structural diagram 2 of a playback device of a multimedia conference according to an embodiment of the present invention;

13 is a schematic structural diagram 1 of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention;

14 is a schematic structural diagram 2 of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention;

15 is a schematic diagram of a telepresence system according to an embodiment of the present invention;

FIG. 16 is a schematic diagram of a specific application flow of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention; FIG. 17 is a schematic diagram of a specific application flow of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention; Schematic diagram of the structure of the system three;

FIG. 19 is a schematic diagram of a specific application flow of a multimedia conference recording and broadcasting method according to an embodiment of the present invention; FIG. 20 is a schematic structural diagram 4 of a multimedia conference recording and broadcasting system according to an embodiment of the present invention;

FIG. 21 is a schematic diagram of a specific application process of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention. detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The invention provides a defect that the combined recording of the media stream (such as the audio media stream, the video media stream, the picture media stream, and the like) in the multimedia conference cannot be combined. A multimedia conference recording, playback method, device, recording device and recording and broadcasting system, which can perform combined recording processing on multi-way conference media streams in a multimedia conference according to a recording strategy, and multi-way conferences that can perform combined recording processing The media stream is played back.

Here, the multi-way conference media stream in the multimedia conference may be a multi-channel local media stream of a conference venue, or multiple remote media streams, or multiple local media streams or multiple remote media of multiple conference venues. Flow, multipath can be understood as at least 2 channels, and will not be described here. It is also known that a conference venue can include more than one conference terminal. For example, in the telepresence system shown in FIG. 12, one conference site includes three conference terminals, and a single telepresence system conference site has three local video media streams, three local audio media streams, and three remote video media streams. 3 remote audio media streams, that is, a total of 6 video media streams and 6 audio media streams.

The method and device for recording and playing back a multimedia conference provided by the embodiment of the present invention, the recording and broadcasting device and the recording and broadcasting system, and the combined recording processing of the multi-way conference media stream in the multimedia conference, mainly, such as multi-channel video media stream Synthesize into one-way or multi-channel multi-picture, one-way or multi-channel picture-in-picture, or one-way or multi-channel wide-screen image, etc.; such as combining multiple audio media streams into single-channel audio, multi-channel audio or multiple sounds Recording modes such as channel audio, and more. In this way, the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference, and can also conveniently broadcast the data of the media stream to obtain the comprehensive situation of the multimedia conference. Embodiment 1

As shown in FIG. 1 , an embodiment of the present invention provides a method for recording a multimedia conference, including: Step 1 1: Obtain a multi-way conference media stream to be recorded according to a conference-level recording policy, where the conference media stream is at least a video. Media stream or audio media stream;

Step 12: Perform combined recording processing on the multi-way conference media stream according to a media recording policy. Optionally, the execution body of the multimedia conference recording method may be a recording server, as shown in the figure.

As shown in FIG. 13, the recording server is connected to the multipoint control unit (multipoint control unit MCU), and when the multipoint control unit MCU is connected to the at least one conference terminal, the multi-way conference media stream to be recorded determined according to the conference level recording policy is obtained. Step 1 1 may specifically include:

The conference-level recording policy is sent to the multi-point control unit (MCU), and the conference-level recording strategy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode; Receiving, by the multi-point control unit MCU, the multi-way conference media stream to be recorded in the at least one site determined according to the conference-level recording policy, where the conference site includes at least one conference terminal.

Specifically, the voice-activated conference site recording mode refers to the data of the media stream of the conference terminal that records the largest conference site in the conference according to the size of the voice of each conference site in the conference; the broadcast conference recording mode refers to the conference terminal of the broadcast conference site in the recording conference. Data of the media stream; the recording mode of the chair site, which records the data of the media stream of the conference terminal of the chair site in the conference; and the recording mode of the site, which records the media stream of the conference terminal of the selected single or multiple sites.

The conference-level recording strategy is mainly used to determine which media streams of the site need to be recorded. Conference-level recording strategies include, but are not limited to, the above example strategies.

Alternatively, as shown in FIG. 14, the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multi-point control unit MCU, and the multi-point control unit MCU is further connected with other When the at least one conference terminal connected to the recording server is obtained, the step 1 1 of obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy may include: sending the conference-level recording policy to the conference terminal, where the conference site includes At least one conference terminal, the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode;

And receiving, by the conference terminal, the multi-way conference media stream to be recorded according to the conference level recording policy.

Since the recording server is connected to the conference terminal instead of the multipoint control unit MCU, the recording server can only obtain the media stream data on the conference terminal connected to it, so some conference-level recording strategies cannot be used, such as: voice-activated switching Site recording mode and broadcast site recording mode.

Specifically, the specific site recording mode refers to the data of the media stream of the conference terminal that records the selected single or multiple sites; the local media stream recording mode of the specific site refers to the recording of the conference terminal of the selected single or multiple sites. Data of the local media stream; The remote media stream recording mode of the specific site refers to the data of the remote media stream received by the conference terminal of the selected single or multiple sites.

Optionally, the step 12 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may include:

According to the video media recording mode of the media recording strategy, the multiple video media streams are combined into one or more video multi-pictures, or one or more video picture-in-pictures, or one or more wide-screen videos, the video media Recording modes include: video recording mode setting mode, or video multi-picture recording mode , or video picture-in-picture recording mode, or wide-screen video media recording mode;

And synthesizing the multi-channel audio media stream into audio mono, or audio multi-channel according to an audio media recording mode of a media recording policy, where the audio media recording mode includes: an audio recording path setting mode, or an audio mono Track recording mode, or audio multi-channel recording mode.

The media-level recording strategy is mainly used to determine how the multi-way conference media stream is synthesized into a recording process. Media level recording strategies include, but are not limited to, the example strategies described above.

Specifically, the video recording path number setting refers to recordable output multi-channel video; the video multi-picture recording mode means that multiple video media can be combined into one-way or multi-channel multi-picture recording; video picture-in-picture recording mode, Refers to the combination of multiple video media into single or multi-channel picture-in-picture for recording; Wide-screen video media recording mode, which combines multiple video media into single or multi-channel widescreen video images for recording. The video media recording mode includes, but is not limited to, the above example recording mode. Moreover, the above-mentioned video media recording modes can be used in combination, and the multi-channel video media stream determined by the conference-level recording strategy in the combined recording multimedia conference can better reflect the comprehensive situation of the multimedia conference.

Audio recording channel setting, which means recording and outputting multiple channels of audio; Audio mono recording mode, which can mix multiple audio media (site sound, background music, etc.) in the conference into mono audio for recording, mixing The number of audio channels can be set; the audio multi-channel recording mode means that multiple audio media in a conference can be mixed into multiple audios, and then recorded in multi-channel audio media. Audio media recording modes include, but are not limited to, the example recording modes described above. Moreover, the above audio media recording modes can also be used in combination, and the multi-channel audio media determined by the conference-level recording strategy in the combined recording multimedia conference can better reflect the comprehensive situation of the multimedia conference.

Optionally, the recording method of the multimedia conference in the embodiment of the present invention can simultaneously set a plurality of different recording strategies to record data of the media stream in the conference. For example, two different conference-level recording strategies are set, and two sets of media streams composed of multiple video media streams and audio media streams are respectively determined, and media streams composed of one set of multiple video media streams and audio media streams are selected. Combine recording with one video media recording mode and audio media recording mode, and combine media streams of another set of multiple video media streams and audio media streams with another video media recording mode and audio media recording mode. Recording can more comprehensively reflect the comprehensive situation of multimedia conferences.

Optionally, in the method for recording a multimedia conference according to the embodiment of the present invention, if a recording parameter, such as one of a recording duration, a recording capacity, a recording format, a recording rate, and a compression protocol, is set, step 12, specifically It may also be that the multi-way conference medium is used according to a media recording strategy and a recording parameter. The body stream is combined for recording processing. For example, when recording a video media stream according to the video media recording mode of the media-level recording strategy, the recording parameters include a recording rate, a recording format, a frame rate, a compression protocol that can be used after data synthesis, and the like. For example, when recording an audio media stream according to an audio media recording mode of a media-level recording strategy, the recording parameters include a recording rate, a recording bandwidth, and a compression protocol that can be used after the data is synthesized. For example, the compression protocol for video media streaming can be: H.263, H.264, MPEG2, MPEG4, etc. The compression protocol for the audio media stream can be: G.71 1, G.722, G.729,

ACC, etc., will not be described here.

Optionally, in the recording method of the multimedia conference in the embodiment of the present invention, the recording and recording server in one scenario is connected to the multi-point control unit MCU, the multi-point control unit MCU is connected to at least one conference terminal, and the multi-point control unit MCU can record The broadcast server sends time synchronization information, media indication information, and conference indication information of the video media stream and the audio media stream of the conference media stream.

Specifically, the step 1 1 of obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy may further include: obtaining time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream. In this case, the step 12 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may further include: synthesizing the synthesized video media according to time synchronization information of the video media stream and the audio media stream. The data of the stream and the data of the audio media stream are multiplexed into a media file; the media file is stored, and a media identifier is set for the media file, and the media identifier is used to identify the media file.

The media file can use a more common format such as the MPEG media file format, which is beneficial to the storage of the media file, and avoids the problem that the video and audio are not synchronized when the playback is performed, and the playback quality is improved. Moreover, by setting a corresponding media identifier for the stored media file, the media data that needs to be played back can be conveniently and quickly found through the media identifier.

The media indication information may at least include: a media data type, whether the media data is compressed, a media compression protocol, a data rate, a media bandwidth, or the like. Through the media indication information, it can be determined whether the received multi-session conference media stream is decoded. For example, different types of media data are distributed to different media decoders, such as video decoders, audio decoders, picture decoders, and the like.

The meeting instructions include at least one of: starting of the meeting, ending the meeting, leaving the meeting, attending the meeting, and so on. According to the meeting instructions, the combined recording can be handled differently. For example, when the conference end indication message is received, indicating that the current conference has ended, then the current conference is The recording and recording process can be ended. For example, when receiving the meeting in the meeting, there are many processing strategies. The simplest strategy is to stop recording the media data of the meeting site. Of course, you can use another site. Replace the venue, of course, when the recording format is multi-screen, you can dynamically change the multi-screen style (such as: change from four screens to three screens), and so on.

Optionally, in the recording method of the multimedia conference in the embodiment of the present invention, the recording and recording server is connected to the at least one conference terminal in another scenario, and the conference terminal connected to the recording and playback server is connected to the multipoint control unit MCU, and the multipoint control is performed. The unit MCU is also connected to at least one conference terminal that is not connected to the recording server. The conference terminal connected to the multi-point control unit MCU can send time synchronization information, media indication information and conference indication information of the video media stream and the audio media stream of the conference media stream to the recording server, and the same, time synchronization information, media indication information The specific application of the conference indication information can be understood by referring to the above scenario, and details are not described herein.

Optionally, the recording method of the multimedia conference in the embodiment of the present invention may further include performing corresponding compression coding on the data of the synthesized media stream, where the process is not necessary, and the compression coding is mainly to reduce the data volume of the media stream. .

Optionally, in step 1 1 of obtaining a multi-way conference media stream to be recorded according to the conference-level recording policy, the conference-level recording policy and the media-level recording policy may also be sent to the multi-point control unit MCU or the conference. Terminal, unlimited.

For the "television" system, as shown in Figure 15, more than one conference terminal is set up in each venue, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors. In use, 3 HD monitors can be displayed. The life-size remote image, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.

The recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by the dotted line in FIG. 13 and FIG. 14), and setting a media level recording policy, such as in the terminal group. The local video of each terminal is combined with the local video multi-screen or the local wide-screen image. The technical solution provided by the embodiment of the present invention can be understood that the recording method of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream is combined. Better response to the comprehensive situation of multimedia conferences. Embodiment 2 Referring to the recording method of the multimedia conference provided in the first embodiment, as shown in FIG. 2, the embodiment of the present invention provides a recording apparatus for a multimedia conference that can implement the foregoing recording method, including:

The receiving module 21 is configured to receive a multi-way conference media stream to be recorded according to the conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream.

The recording processing module 22 is configured to perform combined recording processing on the multi-session conference media stream according to a media recording policy.

As shown in FIG. 3, the receiving module 21 may include:

The policy sending module 21 is configured to send the conference-level recording policy to the multi-point control unit (MCU), where the conference-level recording policy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific conference site. Recording mode.

The media stream receiving module 212 is configured to receive, by the multi-point control unit, the multi-way conference media stream to be recorded in the at least one site determined by the MCU according to the conference-level recording policy, where the conference site includes at least one conference terminal.

The receiving module 21 may further include:

The policy sending module 21 1 is configured to send the conference-level recording policy to the conference terminal, where the conference site includes at least one conference terminal, where the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or The remote media stream recording mode of a specific site.

The media stream receiving module 212 is configured to receive, by the conference terminal, the multi-way conference media stream to be recorded according to the conference level recording policy.

Optionally, the recording processing module 22 includes:

The video recording processing module 221 is configured to synthesize the multiple video media streams into one or more video multi-pictures, or one or more video picture-in-pictures, or all the way according to the video media recording mode of the media recording strategy. Or multi-channel widescreen video, the video media recording mode includes: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording mode.

The audio recording processing module 222 is configured to synthesize the multi-channel audio media stream into an audio mono channel or an audio multi-channel according to the audio media recording mode of the media recording policy, where the audio media recording mode includes: audio Recording mode setting mode, or audio mono recording mode, or audio multi-channel recording mode.

Optionally, the receiving module 21 may further include: The time synchronization information receiving module 213 is configured to receive time synchronization information of the video media stream and the audio media stream in the multi-way conference media stream.

At this time, the recording processing module 22 may further include:

The media file generating module 223 is configured to multiplex and encode the synthesized data of the video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream.

The storage module 224 is configured to store the media file, and set a media identifier for the media file, where the media identifier is used to identify the media file.

The recording device and the specific component of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference recording method provided in the first embodiment, and details are not described herein.

It can be seen from the technical solution provided by the foregoing embodiments of the present invention that the recording device of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference. Embodiment 3

Corresponding to the recording method of the multimedia conference provided by the first embodiment of the present invention, as shown in FIG. 4, the embodiment of the present invention provides a method for playing back a multimedia conference, including:

Step 41: Receive a rebate request carrying a media identifier, where the media identifier is used to identify the media file.

Step 42: Obtain a corresponding media file according to the media identifier, where the media file is obtained by performing combined recording processing on the multi-way conference media stream in the multimedia conference according to the recording policy.

The execution body of the playback method of the multimedia conference in the embodiment of the present invention may be a recording and playback server. The playback method of the multimedia conference in the embodiment of the present invention may further include: before the recording and receiving server receives the playback request with the media identifier, sending the media identifier to the multi-point control unit MCU or the conference terminal. In this way, in step 41, the recording and playback server may receive a playback request carrying the media identifier from the multipoint control unit MCU or the conference terminal. In step 42, the recording and playback server obtains the corresponding media file according to the media identifier, and multiple points. The control unit MCU or the conference terminal obtains the media file from the recording server for playback.

For the playback of media files, such as demultiplexing media files, if the media files are compressed, playback When decompressing, the recording server can adapt the recorded widescreen image (such as down resolution, frame down rate, etc.), and will not be described here.

As shown in FIG. 13, in one scenario of the embodiment of the present invention, the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal. After the recording and recording server performs combined recording processing on the multi-way conference media stream according to the media recording policy, the media identifier is set for the media file, and the media identifier is used to identify the media file. The recording server sends the media identifier corresponding to the media file to the multipoint control unit MCU. When the playback is required, the multi-point control unit MCU sends a playback request carrying the media identifier to the recording server, and the recording server obtains the media file corresponding to the media identifier from the media file recorded by the recording server, if the recording server itself has For the output device of the audio and video media, the recording and playback server can complete the playback of the media file by itself. Alternatively, the recording server can send the media file to the multi-point control unit MCU for playback by the multi-point control unit MCU.

Alternatively, the conference terminal connected to the multipoint control unit MCU can forward the playback request carrying the media identifier to the recording server through the multipoint control unit MCU, and the recording server obtains the media file corresponding to the media identifier from the media file recorded by the recording server. The recording and playback server can send the media file to the conference terminal through the multi-point control unit MCU, and the conference terminal performs the playback.

Referring to FIG. 14, in another scenario of the embodiment of the present invention, the recording and broadcasting server is connected to at least one conference terminal, and the conference terminal connected to the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected. There are at least one conference terminal that is not connected to the recording server. To implement the process of playback, you can refer to the previous scenario to implement the playback of media files.

Optionally, in another scenario of the embodiment of the present invention, for the "teletext" system shown in FIG. 15, when the video media stream of the widescreen image is played back:

If the corresponding number of terminals are used for playback, the recording server can decompress the widescreen image media stream to recover the widescreen image, and then segment the images corresponding to the respective terminals, and encode the images to generate respective terminal images. The code stream is sent to the corresponding terminals in the telepresence terminal group for playback, to completely reproduce the state at the time of recording.

If a single terminal is used for playback, the decoding capability of a single terminal may not be able to decode the widescreen image. In the case of playback, the recording server can adapt the recorded widescreen image (such as down resolution). , frame down rate, etc.) to convert widescreen images into a single terminal to support Media format.

It can be seen that, in the foregoing method for implementing the multimedia conference, the media file can be obtained by using the media identifier to obtain the corresponding media file, and the media file is obtained by combining the data of the multiple media streams in the multimedia conference according to the recording strategy. The broadcasted media files can better reflect the comprehensive situation of multimedia conferences. Embodiment 4

As shown in FIG. 5, corresponding to the playback method of the multimedia conference provided in the third embodiment, the embodiment of the present invention provides a playback device for the multimedia conference, including:

The playback request receiving module 51 is configured to receive a playback request carrying a media identifier, where the media identifier is used to identify the media file.

The playback module 52 is configured to obtain a corresponding media file according to the media identifier, to perform playback, and the media file is combined to record the multi-way conference media stream in the multimedia conference according to the recording policy, as shown in FIG. The selected playback device of the multimedia conference may further include:

The media identity sending module 53 is configured to send the media identifier to the multipoint control unit MCU or the conference terminal.

The playback device and the specific configuration module of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference playback method provided in the foregoing third embodiment, and details are not described herein. Embodiment 5

Corresponding to the recording method, the device, the playback method and the device of the multimedia conference provided by the above embodiments 1 to 4, the embodiment of the invention provides a recording and playback device for the multimedia conference, comprising: a multimedia conference recording device and/or a multimedia conference Replay device. The recording device of the multimedia conference can be a recording server.

Further, the recording and broadcasting device of the multimedia conference in the embodiment of the present invention may further include:

The input/output device, the input recording policy and the recording parameter, and the output of the playback media stream are visible from the above. The recording and recording device of the multimedia conference in the embodiment of the present invention can flexibly set the recording strategy and record the recording according to the recording strategy. Media stream data, better response multimedia conference The overall situation. Embodiment 6

As shown in FIG. 7 , an embodiment of the present invention provides a method for recording a multimedia conference, including: Step 71: Obtain a multi-way conference media stream to be recorded according to a conference-level recording policy, where the conference media stream is at least a video. Media stream or audio media stream.

Step 72: Store the multi-party conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.

Optionally, the execution body of the multimedia conference recording method may be a recording server. Referring to FIG. 13, the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal. And obtaining, by the conference-level recording policy, the multi-way conference media stream to be recorded, specifically:

The conference-level recording policy is sent to the multi-point control unit MCU, and the conference-level recording strategy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode;

Receiving, by the MCU, the multi-way conference media stream to be recorded in the at least one site determined according to the conference-level recording policy, where the conference site includes at least one conference terminal.

Alternatively, as shown in FIG. 14, the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected to other non-recording server. At least one conference terminal. And obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy, specifically:

The conference-level recording policy is sent to the conference terminal, where the conference site includes at least one conference terminal, and the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode. ;

Optionally, the step 72 of storing the multi-way conference media stream and assigning the association identifier according to the site to which the conference media stream belongs, specifically, according to the type of the multi-way conference media stream, A file is created for each media of the site. You can also create a file for each site based on the site to which the multi-session media stream belongs. You can also create a file for the entire conference. No In the storage record mode, an associated identifier is associated with the recorded site record.

Optionally, the method for recording the multimedia conference in the embodiment of the present invention may further include: obtaining time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.

In this way, according to the time synchronization information of the video media stream and the audio media stream, data of the video media stream and data of the audio media stream can be multiplexed into a media file, which is beneficial to avoid video and audio when playing back. The problem of out of sync, improve the quality of playback.

Optionally, the method for recording the multimedia conference in the embodiment of the present invention may further include: obtaining and storing a control command of each site in the multimedia conference.

In this way, when the playback is resumed, the image and the sound that is heard during the conference can be played back, and the control commands of the conference site in the conference can be played back to complete the reproduction of the conference site.

It can be seen from the technical solution provided by the foregoing embodiments of the present invention that the recording method of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference. Example eight

Referring to the recording method of the multimedia conference provided in the foregoing seventh embodiment, as shown in FIG. 8, the embodiment of the present invention provides a recording device for a multimedia conference that can implement the foregoing recording method, including:

The receiving module 81 is configured to obtain a multi-way conference media stream to be recorded according to the conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream.

The association identifier allocation module 82 is configured to store the multi-session conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.

As shown in FIG. 9, optionally, if the execution body of the multimedia conference recording method is a recording and recording server, the recording and playback server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal, or The recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU. The multipoint control unit MCU is also connected to at least one conference terminal that is not connected to the recording server.

The recording apparatus of the embodiment of the present invention may further include: a synchronization information acquiring module 83, configured to obtain time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.

The recording apparatus of the embodiment of the present invention may further include: a control command acquiring module 84, configured to obtain The control commands of each site in the multimedia conference are obtained and stored.

The recording device and the specific configuration module of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference recording method provided in the foregoing seventh embodiment, and details are not described herein.

It can be understood from the technical solutions provided by the foregoing embodiments of the present invention that the recording device of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference. Example nine

Corresponding to the recording method of the multimedia conference provided by the seventh embodiment of the present invention, as shown in FIG. 10, the embodiment of the present invention provides a method for playing back a multimedia conference, including:

Step 101: Receive a playback request carrying the associated identifier, and obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate a conference media stream of each site, where the conference media stream is at least a video media stream. Or audio media stream.

Step 102: Perform combined recording processing on the multi-way conference media stream according to a media recording policy. The media-level recording strategy includes a video media recording mode and an audio media recording mode, and the video media recording mode includes: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording. In the mode, the audio media recording mode includes: an audio recording path setting mode, or an audio mono recording mode, or an audio multi-channel recording mode.

Optionally, the step 102 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may include:

According to the video media recording mode of the media recording strategy, the multiple video media streams are combined into one or more video multi-pictures, or one or more video picture-in-pictures, or one or more wide-screen videos;

According to the audio media recording mode of the media recording strategy, the multiple audio media streams are combined into an audio mono, or an audio multi-channel.

The method for playing back the multimedia conference in the embodiment of the present invention may further include:

Obtaining time synchronization information of the video media stream and the audio media stream in the multi-way conference media stream; and synthesizing the synthesized video media stream data and audio media according to the time synchronization information of the video media stream and the audio media stream The data of the stream is multiplexed into a media file.

Media files can use a more common format such as MPEG media file format to avoid playback. It is prone to the problem that the video and audio are not synchronized, and the playback quality is improved.

The execution body of the playback method of the embodiment of the present invention may be a recording and playback server.

In a scenario of the embodiment of the present invention, as shown in FIG. 13, if the recording server is connected to the multipoint control unit MCU, the multipoint control unit MCU is connected to at least one conference terminal.

The multi-point control unit MCU may send a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording and broadcasting server sends the multi-session conference media stream to multiple points. The control unit MCU, the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and performs playback.

Alternatively, the conference terminal sends a playback request carrying the associated identifier to the multipoint control unit MCU, and the recording and playback server receives the playback request through the multipoint control unit MCU, and the recording and playback server obtains the corresponding multisession conference media stream according to the association identifier. The multi-point conference media stream is sent to the multi-point control unit MCU by the recording and playback server, and the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and the multi-point control unit MCU will record the combination. The processed media stream is sent to the conference terminal, and is played back by the conference terminal.

If the recording server is directly connected to the player or the conference terminal, the player or the conference terminal may send a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the associated identifier. The multi-point conference media stream is sent to the multi-point control unit MCU by the recording and playback server, and the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and the multi-point control unit MCU records the broadcast. The server sends the combined recording and processing media stream to the player or the conference terminal, and the player or the conference terminal plays back the broadcast.

In another scenario of the embodiment of the present invention, as shown in FIG. 13, the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is further connected. Other at least one conference terminal that is not connected to the recording server.

The conference terminal connected to the recording server sends a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording server pairs the multiple channels according to the media level recording policy. The conference media stream performs combined recording processing and performs playback.

Or the conference terminal connected to the recording server sends a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording and broadcasting server sends the multi-way conference media stream to a conference terminal connected to the recording server, and the conference terminal connected to the recording server performs combined recording on the multi-way conference media stream according to a media level recording policy Rational, and replay.

If the recording server is directly connected to the player or the conference terminal, the player or the conference terminal can implement the function of the conference terminal connected to the recording server as described above, for example, performing the multi-session conference media stream according to the media level recording policy. Combine recording processing and perform playback.

The playback method of the multimedia conference in the embodiment of the present invention, in the playback process, for example, the interface provided by the recording server, or the extension plug-in, may send a request to pause, change the play time, and stop. The recording and recording server can process the request, and re-determine the time point of playing the code stream in each conference site (determining the code stream time point: the time stamp in the code stream can be calculated according to the playing time), and the code for requesting and confirming the time point is The stream is sent to the multipoint control unit MCU. Multipoint Control Unit The MCU waits to receive the code stream from the recording server to reconfirm the time point before proceeding.

The image and the sound heard during the conference are played back, and the control commands of the conference site and the conference are broadcasted at the same time to complete the reproduction of the conference site.

During the playback process, you can use the interface provided by the recording server, or the extension plug-in to implement the specified conference virtual enrollment, set multi-screen, multi-screen polling, switch on-demand venue, static closed tone, remote presentation screen switching, etc. .

For the specified site virtual enrollment operation, the image and the sound heard by the specified site during the conference will be played back, and the control commands of the site will be played back to complete the replay of the site.

For setting the multi-screen operation, the specified site is combined into the specified screen split mode and sent to the on-demand player.

For the multi-screen polling operation, the specified site timings are combined into a specified screen split mode and sent to the on-demand player.

For switching on-demand site operations, the specified on-demand site image and sound are sent to the on-demand player. For the static and closed operation, the sound of the specified site is removed, so that the on-demand player can not hear the site sound, and the noisy site is blocked.

For switching the telepresence site screen operation, the image of the specified screen is sent to the on-demand player.

It can be seen that the above-mentioned method for implementing the multimedia conference can obtain the corresponding multi-channel media stream through the association identifier, and combine and record the multi-channel media stream to better reflect the comprehensive situation of the multimedia conference. Example ten

As shown in FIG. 11 , corresponding to the playback method of the multimedia conference provided in the seventh embodiment, the embodiment of the present invention provides a playback device for the multimedia conference, including:

The playback request receiving module 1 1 1 is configured to receive a playback request carrying the associated identifier, and obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate the conference media stream of each site, The conference media stream is at least a video media stream or an audio media stream.

The playback processing module 1 12 is configured to perform combined recording processing on the multiple conference media streams according to a media recording policy.

As shown in FIG. 12, optionally, the playback processing module 1 12 may include:

The video recording processing module 1 121 is configured to synthesize the multi-channel video media stream into one or more video multi-pictures, or one or more video picture-in-pictures according to a video media recording mode of the media recording policy, or The one-way or multi-channel widescreen video, the media-level recording strategy includes a video media recording mode and an audio media recording mode, and the video media recording mode includes: a video recording path setting mode, or a video multi-picture recording mode, or a video Draw recording mode, or widescreen video media recording mode.

The audio recording processing module 1 122 is configured to synthesize the multi-channel audio media stream into audio mono, or audio multi-channel according to an audio media recording mode of the media recording policy. The audio media recording mode includes: an audio recording path setting mode, or an audio mono recording mode, or an audio multi-channel recording mode.

The playback device of the embodiment of the present invention may further include:

The synchronization information obtaining module 1 13 is configured to obtain time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.

The media file generating module 1 14 is configured to multiplex and encode the synthesized data of the video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream.

The control command playback module 1 15 is configured to play back the control command determined according to the conference level recording policy. The playback device and the specific configuration module of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference playback method provided in the foregoing embodiment 9, and details are not described herein. According to the technical solution provided by the foregoing embodiments of the present invention, the playback device of the multimedia conference can obtain the corresponding multi-channel media stream by using the association identifier, and record and play back the multi-channel media stream, thereby better reflecting the multimedia conference. Comprehensive situation. Embodiment 11

Corresponding to the recording method, the device, the playback method and the device of the multimedia conference provided by the above-mentioned embodiments 7 to 10, the embodiment of the invention provides a recording and playback device for the multimedia conference, comprising: a multimedia conference recording device and/or multimedia The playback device of the conference. The recording device of the multimedia conference can be a recording server.

Further, the recording and broadcasting apparatus of the embodiment of the present invention may further include:

Input/output device for entering recording strategies, recording parameters, and providing an on-demand interface. Recording strategies include media-level recording strategies. The on-demand interface provides a request to send a pause, change the play time, stop, provide a specified site virtual entry, set multi-screen, multi-screen polling, switch on-demand venue, static sound, telepresence screen switching and other control operations.

It can be seen that the recording and recording apparatus of the embodiment of the present invention can flexibly set the recording strategy and combine the data of the recorded media stream according to the recording strategy to better reflect the comprehensive situation of the multimedia conference. Example twelve

Corresponding to the recording method, device, playback method and device of the multimedia conference provided by the above embodiments 1 to 4, the embodiment of the invention provides a multimedia conference recording and broadcasting system, including a multimedia conference recording and broadcasting device, and a multipoint control unit. MCU and conference terminal. As shown in Figure 13, the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal. The recording device 100, a multipoint control unit (multipoint control unit MCU) 200 connected to the recording device 100, and at least one conference terminal 300 connected to the multipoint control unit MCU 200. The recording device of the multimedia conference can be a recording server.

Optionally, the plurality of conference terminals 300 and the multipoint control unit 200 are connected by the first communication network, and the multipoint control unit 200 completes the interaction of the data of the media streams between the plurality of conference terminals 300. At the same time, the recording and playback device 100 is connected to the multipoint control unit 200 through the second communication network, and establishes a connection for performing data and information of the media stream between the recording device 100 and the multipoint control unit 200 (such as a conference). The recording device 100 can perform composite recording on the data of the multi-media media stream on the multipoint control unit 200 by the interaction of the indication information, the media indication information, and the like.

Note: The second communication network and the first communication network may be the same communication network, such as Ethernet, and the second communication network and the first communication network may also be different communication networks. A plurality of conference terminals 300, a multipoint control unit 200, and a recording device 100 can also be disposed in a communication network such as Ethernet.

When the recording device 100 is used as a stand-alone device, it can have its own input device for information input, such as: keyboard, touch screen, mouse, remote control, etc.; also can have its own output device for information output display Such as: LCD screen, display, etc. Of course, when the recording device is used as an independent device, it may not have its own independent input/output device. At this time, it can share the input/output device of the multipoint control unit 200 management station, and manage the station through the multipoint control unit 200. Indirect control of the recording device.

The user can set the recording strategy and recording parameters through the input device of the recording device 100. The multipoint control unit 200 receives the conference level recording policy sent by the recording device 100, and the multipoint control unit 200 determines the multisession conference media stream to be recorded according to the conference level recording policy, and the multipoint control unit 200 transmits the multisession conference media to be recorded. The recording is performed on the recording and playback device 100, and the recording and playback device 100 synthesizes the data of the multi-way conference media stream according to the media-level recording strategy to obtain a media file. The recording and playback device 100 stores the media file and sets the corresponding media identification.

The multipoint control unit 200 sends a playback request carrying the media identifier to the recording and playback device 100. The recording and playback device 100 obtains the corresponding media file according to the media identifier, and the recording and playback device 100 implements the playback. Alternatively, the recording and playback device 100 can display the media file. Sended to the multipoint control unit 200, the multipoint control unit 200 implements playback.

The recording and playback device 100 can be integrated with the multipoint control unit 200 or set independently.

In another scenario of the embodiment of the present invention, when the conference finally constitutes a "teletext" system, each conference site has more than one conference terminal, as shown in FIG. 15, three conference terminals, three high-definition cameras, and three high-definition displays. The conference terminals of the same site form a terminal group (as shown by the dashed box in Figure 15). The difference between this scenario and the above two scenarios is that the terminal group replaces the conference terminal, and the recording and playback device 100 can be set independently or integrated with the conference terminal in the terminal group. The recording and recording process of this scenario can be understood by referring to the scenario, and will not be described here. Example thirteen

Corresponding to the recording method, device, playback method and device of the multimedia conference provided by the above embodiments 1 to 4, the embodiment of the invention provides a multimedia conference recording and broadcasting system, including a multimedia conference recording and broadcasting device, and a multipoint control unit. MCU and conference terminal. As shown in FIG. 14, the recording and broadcasting system of the multimedia conference includes a recording and playback device 100, at least one conference terminal 300 connected to the recording and playback device 100, and a multipoint control unit connected to at least one conference terminal 300 connected to the recording and playback device 100. (Multipoint Control Unit MCU) 200. The multipoint control unit 200 is further connected to at least one conference terminal 300: Optionally, the plurality of conference terminals 300 and the multipoint control unit 200 are connected through the first communication network, and the multipoint control unit 200 completes the interaction of data of the media streams between the plurality of conference terminals 300. At the same time, the recording and playback apparatus 100 is connected to the at least one conference terminal 300 via the second communication network, and the recording and playback apparatus 100 can perform combined recording on the data of the plurality of media streams on the at least one conference terminal 300 connected thereto. Note: The second communication network and the first communication network may be the same communication network, such as Ethernet; the second communication network and the first communication network may also be different communication networks. The plurality of conference terminals 300, the multipoint control unit 200, and the recording and playback device 100 may also be disposed in a communication network such as an Ethernet. When the recording device 100 is used as a stand-alone device, it can have its own input device for information input, such as: keyboard, touch screen, mouse, remote control, etc.; also can have its own output device for information output display Such as: LCD screen, display, etc. Of course, when the recording device is used as an independent device, it may not have its own independent input/output device. At this time, it can share the input/output device of the multipoint control unit 200 management station, and manage the station through the multipoint control unit 200. Indirect control of the recording device.

The user can set the recording strategy and recording parameters through the input device of the recording device 100.

Since the recording and playback device 100 is only connected to the partial conference terminal 300, and the recording and playback device is only a record of the conference process, the recording and playback device 100 can only record the multi-way conference media stream of the conference terminal 300 connected thereto during the conference. In this way, the conference-level recording policy that the recording and recording device 100 sends to the conference terminal 300 connected thereto includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode.

The conference terminal 300 connected to the recording device 100 receives the conference-level recording policy sent by the recording device 100, the conference terminal 300 determines the multi-session conference media stream to be recorded according to the conference-level recording policy, and the conference terminal 300 transmits the multi-channel to be recorded. The conference media stream is sent to the recording and playback device 100, and the recording and playback device 100 synthesizes the data of the multi-way conference media stream according to the media-level recording strategy to obtain the media file. Record The broadcast device 100 stores the media file and sets a corresponding media identifier.

The conference terminal 300 sends a playback request carrying the media identifier to the recording and playback device 100. The recording and playback device 100 obtains the corresponding media file according to the media identifier, and the recording and playback device 100 implements the playback. Alternatively, the recording and playback device 100 sends the media file to the recording device 100. The conference terminal 300 and the conference terminal 300 implement playback.

The recording and playback apparatus 100 can be integrated with the conference terminal 300 or set independently.

In another scenario of the embodiment of the present invention, when the conference finally constitutes a "teletext" system, each conference site has more than one conference terminal, as shown in FIG. 15, three conference terminals, three high-definition cameras, and three high-definition displays. The conference terminals of the same site form a terminal group (as shown by the dashed box in Figure 15). The difference between the scene and the above two scenarios is that the terminal group replaces the conference terminal, and the recording and playback device 100 can be set independently or integrated with the conference terminal in the terminal group. The recording and recording process of this scenario can be understood by referring to the above scenario, and will not be described here. DETAILED DESCRIPTION 1

The recording and playback method of the multimedia conference is illustrated by the recording and broadcasting system of the multimedia conference shown in FIG. 13. As shown in FIG. 16, the first is the recording process of the multimedia conference:

1601. The recording device sends the conference-level recording strategy to the multi-point control unit.

The recording device sends the conference-level recording policy "sound control switching site recording mode" to the multi-point control unit MCU. "Voice Switching Site Recording Mode" indicates that the media stream that needs to be recorded is the media stream with the highest volume.

Alternatively, if the multipoint control unit MCU is preset with a conference level recording policy, the recording device does not need to send a conference level recording strategy to the multipoint control unit MCU.

1602. Multipoint Control Unit The MCU determines the multi-way conference media stream to be recorded according to the conference level recording strategy.

The multi-point control unit MCU receives the conference-level recording policy of the voice-activated switching site recording mode sent by the recording device. The multi-point control unit MCU periodically detects the volume of each site in the conference, and determines the media stream that maximizes the volume of the site. The data is sent to the recording device for recording.

1603. The multipoint control unit MCU sends the multi-way conference media stream to be recorded to the recording device. The data of the conference media stream transmitted by the multipoint control unit MCU to the recording device may use a single data connection channel to transmit data of all types of conference media streams, or may use multiple data links. Channels are used to transmit data of different types of conference media streams, and data of different types of conference media streams such as video and audio data.

Moreover, the multipoint control unit MCU can simultaneously transmit time synchronization information, media indication information, and conference indication information of the video media stream and the audio media stream of the conference media stream to the recording and playback device.

1604. The recording device synthesizes data of the received multi-session conference media stream according to a media level recording strategy.

Media-level recording strategies for recording devices, such as video recording strategy "multi-screen", audio recording strategy "multi-channel mode". According to the "multi-screen" and "multi-channel mode", the recording device synthesizes the data of the multi-media media stream of the largest conference site in the conference obtained according to the "sound control switching site recording mode". For example, recording the local video media stream and the far-end video media stream as multiple pictures, recording the local audio media stream and the far-end audio recording media stream as multi-channel audio, such as local voice left channel, far-end voice right channel and many more.

If the recording device further includes recording parameters (such as recording duration, etc.), the synthesis of the multi-session conference media stream is completed according to the recording parameters.

If the multi-point control unit MCU sends the time synchronization information, the media indication information and the conference indication information of the video media stream and the audio media stream of the conference media stream to the recording and playback device, the recording unit may receive the slave multi-point control unit. The transmitted media indication information determines whether the data of the multi-media media stream is decoded. Whether the recording device decodes the data of the received multi-media media stream depends on whether the data of the received media stream is compressed, and when the data of the received media stream is not compressed, the composition can be directly synthesized.

The recording and playback device performs corresponding compression encoding on the data of the synthesized media stream. It is not necessary for the recording and playback device to perform corresponding compression coding on the synthesized media stream data, and the compression coding is mainly for reducing the amount of data of the media stream.

The recording and reproducing device multiplexes the data of the synthesized media stream into one or more media files according to the time synchronization information, and the media file format can use the MPEG media file format to facilitate storage and playback. It is not necessary to multiplex the data of the compressed media stream into a media file, and the data of the compressed media stream and the time synchronization information thereof may be directly stored in the storage device. If the recording instruction device receives the conference indication information sent by the multipoint control unit, for example, when the conference end indication information is received, indicating that the current conference has ended, the recording of the current conference may end.

1605. The recording device stores the media file and configures a corresponding media identifier.

The recording and recording device can store the media files obtained by multiplexing and encoding in a device or device with a storage function such as a hard disk, a USB flash drive, an SD card, a magnetic tape, and the like, and can configure a corresponding media identifier, which is convenient for playing back, and is found according to the media identifier. Corresponding media file.

Then there is the playback process of the multimedia conference:

1606. The recording device sends the media identifier to the multi-point control unit MCU.

The recording device transmits the media identification to the multipoint control unit MCU.

It can be known that the multi-point control unit MCU can also send the media identifier to each conference terminal without further description.

1607. The multipoint control unit sends a playback request to the recording device.

The multipoint control unit MCU sends a playback request to the recording device, and the playback request carries a media identification.

Note that each conference terminal can also send a rebate request, and forward the rebroadcast request to the recording device through the multipoint control unit.

1608. The recording and playback device obtains a corresponding media file according to the playback request.

The recording and playback device receives the playback request, and reads the stored corresponding media file according to the media identifier carried by the playback request.

If the recording device itself has an output device for the video and audio medium, the recording and reproducing device itself can perform demultiplexing and decoding of the media file, and then perform playback. The recording and playback device may also perform media adaptation processing on the data of the demultiplexed media stream and send the data to the multipoint control unit MCU. The media adaptation process is mainly used to convert the media compression type into a media compression type that the multi-point control unit MCU can support.

1609. The recording device transmits the data of the media stream to the multi-point control unit MCU.

The recording device transmits the data of the media stream to the multipoint control unit MCU, and the data of the media stream is data suitable for processing.

1610. The multipoint control unit MCU performs playback. The multipoint control unit MCU receives the data of the media stream sent by the recording device, and decodes it and then plays back the data. Alternatively, the multipoint control unit MCU may also send the data of the media stream to the conference terminal, and the conference terminal decodes and then rebroadcasts.

In addition, the media file can be copied or sent to other devices (such as a PC) for playback via the data interface (such as USB interface) provided by the recording device.

It can be seen that in a multimedia conference, a multimedia conference may involve more than one conference site, and each conference site usually has one conference terminal, so that the recording and playback methods of the multimedia conference can be used for data of multiple media streams in the multimedia conference. Perform combined recording processing to meet different recording strategy requirements.

For the "television" system, as shown in Figure 15, each conference site has more than one conference terminal, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors. In use, 3 HD monitors can The life-size remote image is displayed, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.

The recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by a dotted line in FIG. 15), and setting a media-level recording policy, such as each terminal in the terminal group. The local video combines the local video multi-picture or the local wide-screen image. As a result, the local video image and the far-end video image are not interlaced, which facilitates the recognition of the local video image and the far-end video image during playback. The overall situation of the venue. Of course, the local media and the remote media of each terminal in the terminal group can also be recorded in any combination, and will not be described. DETAILED DESCRIPTION 2

The recording and playback method of the multimedia conference is illustrated by the recording and broadcasting system of the multimedia conference shown in FIG. 14, as shown in FIG. 17, the first is the recording process of the multimedia conference:

1701. The recording device sends the conference-level recording strategy to the conference terminal.

The recording device sends the conference-level recording policy "Specific site recording mode" to the conference terminal connected to it.

Similarly, if the conference terminal connected to the recording device is preset with a conference-level recording strategy, 1702. The conference terminal determines, according to the conference level recording policy, the multi-way conference media stream to be recorded. The conference terminal connected to the recording device receives the recording policy "Specific Site Recording Mode" sent by the recording device to determine whether it is a specific site in the recording policy. If the conference terminal connected to the recording device determines that it is a specific site in the recording policy, it is confirmed that the media stream on the recording device is the multi-way conference media stream to be recorded, and the media on the conference terminal connected to the recording device The stream is sent to the recording device.

1703. The conference terminal sends a multi-way conference media stream to be recorded to the recording device.

The data of the multi-way conference media stream transmitted by the conference terminal connected to the recording device to the recording device may use a single data connection channel to transmit data of all types of conference media streams, or may use multiple data connection channels to transmit different data. Types of conference media stream data, different types of conference media stream data such as video, audio data.

Moreover, the conference terminal connected to the recording device can simultaneously transmit time synchronization information, media indication information, and conference indication information to the recording and playback device.

1704. The recording device synthesizes the data of the received multi-session conference media stream according to the media level recording strategy.

The media-level recording strategy of the recording device, such as the video recording strategy "Picture in Picture" and the audio recording strategy "Multi-channel mode". The recording device synthesizes data of multiple media streams according to "Picture in Picture" and "Multichannel Mode". For example, recording the local video media stream and the far-end video media stream as picture-in-picture, recording the local audio media stream and the far-end audio recording media stream as multi-channel audio, such as local voice left channel, far-end voice right sound Road and so on.

And when the conference terminal connected to the recording device transmits the time synchronization information, the media indication information, and the conference indication information of the video media stream and the audio media stream of the conference media stream to the recording and playback device, specifically:

The recording and receiving device receives the media indication information sent by the conference terminal, and determines whether to decode the data of the multiple media streams. Whether the recording device decodes the data of the received multi-media media stream depends on whether the data of the received media stream is compressed, and when the data of the received media stream is not compressed, the composition can be directly synthesized. The recording and playback device performs corresponding compression encoding on the data of the synthesized media stream. It is not necessary for the recording and playback device to perform corresponding compression encoding on the data of the synthesized media stream, and the compression encoding is mainly for reducing the amount of data of the media stream.

The recording and reproducing apparatus multiplexes the synthesized media stream data into one or more media files based on the time synchronization information. It is not necessary to multiplex the data of the compressed media stream into a media file, and the data of the compressed media stream and the time synchronization information thereof may be directly stored in the storage device independently.

If the recording and receiving device receives the meeting instruction information sent by the conference terminal, for example, when the conference end indication information is received, indicating that the current conference has ended, the recording of the current conference may end.

1705. The recording device stores the media file and configures a corresponding media identifier.

The recording and recording device can store the media files obtained by multiplexing and encoding, and can configure corresponding media identifiers, so that when the playback is performed, the corresponding media files are found according to the media identifiers.

Then there is the playback process of the multimedia conference:

1706. The recording device sends the media identifier to the conference terminal.

The recording device transmits the media identification to at least one conference terminal connected thereto.

It can be known that the conference terminal connected to the recording device can also send the media identifier to other conference terminals through the multi-point control unit MCU, and no further description is made.

1707. The conference terminal sends a playback request to the recording device.

The at least one conference terminal connected to the recording device sends a playback request to the recording device, where the playback request carries the media identifier.

It can be known that the multi-point control unit MCU and other conference terminals not connected to the recording device can also send a rebate request without comment.

1708. The recording device obtains a corresponding media file according to the playback request.

The recording and playback device receives the playback request, and reads the stored media file corresponding to the media identifier according to the media identifier carried by the playback request.

Note that if the recording device itself has an output device for the AV media, the media file can be demultiplexed, decoded, and then played back by the recording device itself.

If the recording device ignores the output device of the audio medium, the recording and playback device may perform the media adaptation processing on the data of the demultiplexed media stream, and send the data to at least one conference terminal connected to the recording device. Note that the media adaptation process is mainly used to convert the media compression type into a media compression type that the conference terminal can support.

1709. The recording and playback device sends the data of the media stream to the conference terminal.

The recording device transmits the data of the media stream to at least one conference terminal connected to the recording device, and the data of the media stream is data adapted for processing.

1710. The conference terminal performs playback.

At least one conference terminal connected to the recording device receives the adapted media file, decodes the media file, and then plays back the video file.

The at least one conference terminal connected to the recording device may also send the data of the media stream to the multipoint control unit MCU, and the multipoint control unit MCU sends the data of the media stream to other conference terminals not connected to the recording device, The point control unit MCU or other conference terminal not connected to the recording device is decoded and then played back.

In addition, the media file can also be copied or sent to other devices (such as a PC) for playback via the data interface (such as USB interface) provided by the recording device.

In a multimedia conference, a multimedia conference may involve more than one conference site. Each conference site usually has one conference terminal. In this way, the recording and playback methods of the multimedia conference can perform combined recording processing on data of multiple media streams to meet different requirements. Recording strategy requirements.

Similarly, for the "television" system, as shown in Figure 15, each conference site has more than one conference terminal, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors. In use, 3 HD monitors can The life-size remote image is displayed, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.

The recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by a dotted line in FIG. 15), and setting a media-level recording policy, such as each terminal in the terminal group. The local video combines the local video multi-picture or the local wide-screen image. As a result, the local image and the far-end image are not interlaced, which facilitates the recognition of the local image and the far-end image during playback, and clearly shows the comprehensive situation of the venue. . Of course, the local media and the remote media of each terminal in the terminal group may be recorded and stored in any combination, and details are not described herein. DETAILED DESCRIPTION OF THE INVENTION Referring to the recording and broadcasting system shown in FIG. 18, the recording and playback method of the multimedia conference is explained. For example, in the recording and broadcasting system, the recording and playback device is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal. The recording server can also directly connect to a player or a conference terminal, and the player or conference terminal does not participate in the conference, and can be used as an on-demand player.

As shown in Figure 19, the first is the recording process of the multimedia conference:

1901. The recording and recording device records the multi-way conference media stream of each conference site in the conference.

The recording and playback device determines a multi-way conference media stream to be recorded according to the conference-level recording policy, records the playback device, and records the multi-session conference media stream.

1902. The recording device allocates an association identifier for the multi-session conference media stream.

The recording and recording device stores the multi-way conference media stream and allocates an association identifier according to the site to which the conference media stream belongs, and the association identifier is used to associate the conference media stream of each site. For example, each site creates a file, 1.avi, 2.avi, 3.avi, associated identifier confl associated 1.avi, 2.avi, 3.avi.

Then there is the playback process of the multimedia conference:

1903. The player sends a playback request carrying the associated identifier to the recording device.

The player can use the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.

1904. The recording and playback device sends the multi-session conference media stream corresponding to the association identifier to the multi-point control unit MCU.

The recording device obtains the corresponding multi-way conference media stream 1.avi, 2.avi, 3.avi and sends it to the multi-point control unit MCU according to confl.

1905. Multi-point control unit The MCU performs combined recording processing on the multi-way conference media stream.

Multipoint Control Unit The MCU performs combined recording processing on the multi-way conference media streams 1.avi, 2.avi, 3.avi according to the media level recording strategy. Such as composite multi-screen, telepresence screen stitching, sound mixing, main stream and auxiliary stream merge, superimposed conference holding time, duration of time, etc.

1906. Multipoint Control Unit The MCU sends the recorded media stream to the recording device.

1907. The recording device sends the recorded media stream to the player.

1908. The player records the processed media stream.

The player implements the playback according to the media stream after the recording process.

It can be known that the multi-point control unit MCU can also directly send the processed media stream to the on-demand player without forwarding through the recording device. Alternatively, the player in 1903 can send a playback request carrying the associated identifier to the multipoint control unit MCU. At this time, the multipoint control unit MCU needs to forward the playback request to the recording device. Next, 1904. The recording and playback device sends the multi-session conference media stream corresponding to the association identifier to the multi-point control unit MCU. 1905. The multipoint control unit MCU performs combined recording processing on the multi-way conference media stream. At this time, 1906, the multimedia stream recorded by the multi-point control unit MCU is sent to the player. The player implements the playback according to the media stream after the recording process.

In the above embodiment, the multipoint control unit MCU and the recording and playback device may have multiple, one multipoint control unit MCU may be connected to a plurality of recording and playback devices, and one recording and playback device may be connected to a plurality of multipoint control unit MCUs. The multipoint control unit MCU and recording device can also be integrated into one device. Detailed Description 4

The recording and playback method of the multimedia conference will be described by the recording and broadcasting system of the multimedia conference shown in FIG. In the recording and broadcasting system, the recording and broadcasting server is connected to at least one conference terminal, and the conference terminal connected to the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected to at least one other connection that is not connected to the recording and recording server. Conference terminal. The recording server can also directly connect to the player or the conference terminal. The player or conference terminal does not participate in the conference, and it can be used as an on-demand player.

As shown in Figure 21, the first is the recording process of the multimedia conference:

2101. The recording and recording device records the multi-way conference media stream of each conference site in the conference.

2102. The recording device allocates an association identifier for the multi-session conference media stream.

Then there is the playback process of the multimedia conference:

2103. The conference terminal sends a playback request carrying the associated identifier to the recording device.

The conference terminal player connected to the recording server can use the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.

2104. The recording and playback device performs combined recording processing on the multi-way conference media stream. The recording and recording device performs combined recording processing on the multi-way conference media streams 1.avi, 2.avi, 3.avi according to the media level recording strategy. Such as synthetic multi-screen, telepresence screen stitching, sound mixing, mainstream and auxiliary stream merging, overlay meeting holding time, duration, etc.

2105. The recording and playback device sends the recorded media stream to the conference terminal.

The recording device transmits the recorded media stream to the conference terminal connected to the recording server.

2106. The conference terminal plays back the recorded media stream.

The conference terminal connected to the recording server implements the playback.

The conference terminal can be replaced with a player.

Alternatively, the recording device in 2104 can send multiple conference media to the conference terminal. At this time, the conference terminal performs combined recording processing on the multi-way conference media stream to implement playback.

A person skilled in the art can understand that all or part of the process of implementing the above embodiment method can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. In execution, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM). The above is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or within the technical scope disclosed by the present invention. Alternatives are intended to be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

Rights request

A recording method for a multimedia conference, characterized in that it comprises:

The method for recording a multimedia conference according to claim 1, wherein the obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy comprises:

Receiving, by the multi-point control unit, the multi-way conference media stream to be recorded in the at least one site determined by the MCU according to the conference-level recording policy, where the conference site includes at least one conference terminal.

The method for recording a multimedia conference according to claim 2 or 3, wherein the combined recording processing of the multi-way conference media stream according to the media recording policy comprises:

According to the video media recording mode of the media recording strategy, the multiple video media streams are combined into one or more video multi-pictures, or one or more video picture-in-pictures, or one or more wide-screen videos, the video media The recording modes include: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording mode;

Combining the multi-channel audio media stream into an audio media recording mode according to a media recording policy Audio mono, or audio multi-channel, the audio media recording mode includes: audio recording mode setting mode, or audio mono recording mode, or audio multi-channel recording mode.

The method for recording a multimedia conference according to claim 4, wherein the obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy further includes:

Obtaining time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.

The method for recording a multimedia conference according to claim 5, wherein the combining the recording process of the multi-way conference media stream according to the media recording policy further includes:

And combining the data of the synthesized video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream;

And storing the media file, and setting a media identifier for the media file, where the media identifier is used to identify the media file.

7. A recording device for a multimedia conference, comprising:

The recording device of the multimedia conference according to claim 7, wherein the receiving module comprises:

The policy sending module is configured to send the conference-level recording policy to the multi-point control unit MCU, where the conference-level recording policy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode. ;

The media stream receiving module is configured to receive, by the multi-point control unit, the multi-way conference media stream to be recorded in the at least one site determined by the MCU according to the conference-level recording policy, where the conference site includes at least one conference terminal.

The apparatus for recording a multimedia conference according to claim 7, wherein the receiving module comprises: The policy sending module is configured to send the conference-level recording policy to the conference terminal, where the conference site includes at least one conference terminal, where the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site Remote media stream recording mode;

The media stream receiving module is configured to receive, by the conference terminal, the multi-way conference media stream to be recorded according to the conference level recording policy.

The recording device of the multimedia conference according to claim 8 or 9, wherein the recording processing module comprises:

a video recording processing module, configured to synthesize the multi-channel video media stream into one or more video multi-pictures, or one or more video picture-in-pictures, or all the way or according to the video media recording mode of the media recording strategy The multi-channel widescreen video, the video media recording mode includes: a video recording path setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording mode;

An audio recording processing module, configured to synthesize the multi-channel audio media stream into an audio mono channel or an audio multi-channel according to an audio media recording mode of the media recording policy, where the audio media recording mode includes: audio recording Path setting mode, or audio mono recording mode, or audio multi-channel recording mode.

The recording device of the multimedia conference according to claim 10, wherein the receiving module further comprises:

The time synchronization information receiving module is configured to receive time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.

12. The recording device of the multimedia conference according to claim 1, wherein the recording processing module further comprises:

a media file generating module, configured to multiplex and encode data of the synthesized video media stream and data of the audio media stream into a media file according to time synchronization information of the video media stream and the audio media stream;

a storage module, configured to store the media file, and set a media identifier for the media file, The media identifier is used to identify the media file.

13. A method for playing back a multimedia conference, characterized in that it comprises:

Receiving a playback request carrying a media identifier, where the media identifier is used to identify the media file, and obtaining a corresponding media file according to the media identifier, where the media file is multi-channel in the multimedia conference according to the recording policy. The conference media stream is obtained by combining recording processing.

The method for replaying a multimedia conference according to claim 13, wherein the method further comprises: before receiving the playback request carrying the media identifier, sending the media identifier to the multi-point control unit MCU or the conference terminal.

15. A playback device for a multimedia conference, comprising:

a playback module, configured to obtain a corresponding media file according to the media identifier, to perform playback, where the media file performs combined recording on the multi-session conference media stream in the multimedia conference according to the recording policy

The playback device of the multimedia conference according to claim 15, further comprising:

The media identifier sending module is configured to send the media identifier to the multipoint control unit MCU or the conference terminal.

A recording and reproducing apparatus for a multimedia conference, comprising the recording apparatus according to any one of claims 7 to 12 or the playback apparatus according to claim 15 or 16.

18. A recording method for a multimedia conference, characterized in that:

And storing the multi-party conference media stream and assigning an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.

The method for recording a multimedia conference according to claim 18, wherein the obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy comprises: The conference-level recording policy is sent to the multi-point control unit (MCU), and the conference-level recording strategy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode;

And receiving, by the multi-point control unit, the multi-way conference media stream to be recorded in the at least one site determined according to the conference-level recording policy, where the conference site includes at least one conference terminal.

The method for recording a multimedia conference according to claim 18, wherein the obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy comprises: transmitting the conference-level recording policy to the conference terminal The conference site includes at least one conference terminal, and the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode;

The method for recording a multimedia conference according to claim 18, wherein the method further comprises: obtaining time synchronization information of the video media stream and the audio media stream in the multi-way conference media stream.

The method for recording a multimedia conference according to claim 18, wherein the method further comprises: obtaining a control command of each conference site in the multimedia conference.

23. A recording device for a multimedia conference, comprising:

a receiving module, configured to obtain a multi-way conference media stream to be recorded according to a conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream;

The apparatus for recording a multimedia conference according to claim 23, wherein the receiving module specifically includes:

The policy sending module is configured to send the conference-level recording policy to the multi-point control unit MCU, where the conference-level recording policy includes: a voice-activated switching site recording mode, or a broadcast site recording mode, or a master Site recording mode, or a specific site recording mode;

The media stream receiving module is configured to receive the multi-way conference media stream to be recorded in the at least one site determined by the multi-point control unit MCU according to the conference-level recording policy, where the conference site includes at least one conference terminal.

The policy sending module is configured to send the conference-level recording policy to the conference terminal, where the conference site includes at least one conference terminal, where the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site Remote media stream recording mode;

The recording device of the multimedia conference according to claim 23, wherein the recording device further comprises: a synchronization information acquiring module, configured to obtain a video media stream and an audio media stream in the multi-way conference media stream Time synchronization information.

The recording device of the multimedia conference according to claim 23, wherein the recording device further comprises: a control command acquiring module, configured to obtain a control command of each site in the multimedia conference.

28. A method for playing back a multimedia conference, characterized in that it comprises:

The method for playing back a multimedia conference according to claim 28, wherein the media level recording policy comprises a video media recording mode and an audio media recording mode, and the video media recording mode comprises: a video recording path setting Mode, or video multi-picture recording mode, or video picture-in-picture recording mode, or wide-screen video media recording mode, the audio media recording mode includes: The frequency recording mode setting mode, or the audio mono recording mode, or the audio multi-channel recording mode; the combining recording processing of the multi-way conference media stream according to the media recording policy, specifically:

The method for replaying a multimedia conference according to claim 28, wherein the method further comprises:

The method for replaying a multimedia conference according to claim 28, wherein the method further comprises: obtaining a control command of each site in the multimedia conference, and playing back the control command.

32. A playback device for a multimedia conference, comprising:

33. The playback device of the multimedia conference according to claim 32, wherein the playback processing module comprises:

a video recording processing module, configured to synthesize the multi-channel video media stream into one or more video multi-pictures, or one or more video picture-in-pictures, or all the way or according to the video media recording mode of the media recording strategy Multi-channel widescreen video, the media-level recording strategy includes a video media recording mode And the audio media recording mode, the video media recording mode includes: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording mode; an audio recording processing module, The multi-channel audio media stream is synthesized into an audio mono, or an audio multi-channel according to an audio media recording mode of the media recording policy. The audio media recording mode includes: an audio recording path setting mode, or an audio mono recording mode, or an audio multi-channel recording mode.

The playback device of the multimedia conference according to claim 32, wherein the playback device further comprises:

a synchronization information obtaining module, configured to obtain time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream;

The media file generating module is configured to multiplex the data of the synthesized video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream.

The playback device of the multimedia conference according to claim 32, wherein the playback device further comprises: a control command playback module, configured to obtain a control command of each conference site in the multimedia conference, and play back the control commands.

A recording and reproducing apparatus for a multimedia conference, comprising the recording apparatus according to any one of claims 23-27 or the playback apparatus according to any one of claims 32-35.