WO2011050690A1 - Procédé et système pour enregistrer et reproduire une conférence multimédia - Google Patents

Procédé et système pour enregistrer et reproduire une conférence multimédia Download PDF

Info

Publication number
WO2011050690A1
WO2011050690A1 PCT/CN2010/077973 CN2010077973W WO2011050690A1 WO 2011050690 A1 WO2011050690 A1 WO 2011050690A1 CN 2010077973 W CN2010077973 W CN 2010077973W WO 2011050690 A1 WO2011050690 A1 WO 2011050690A1
Authority
WO
WIPO (PCT)
Prior art keywords
conference
recording
media
media stream
video
Prior art date
Application number
PCT/CN2010/077973
Other languages
English (en)
Chinese (zh)
Inventor
魏小霞
陈显义
王静
詹五洲
李凯
徐凌峰
陈庆丰
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Publication of WO2011050690A1 publication Critical patent/WO2011050690A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a multimedia conference recording method, a playback method, a recording and playback device, and a recording and broadcasting system. Background technique
  • the recording method of multimedia conferences is usually in the following form:
  • a method for recording and broadcasting in a terminal is: integrating a recording and broadcasting system in a traditional television terminal, enabling a recording function of a television terminal during a multimedia conference, recording and storing data of a local audio, video, and the like of the television terminal, Or recording and storing data of the media stream of the remote audio, video, and the like of other television terminals received by the television terminal.
  • the data content of the recorded media stream is played back through the television terminal.
  • Another recording and broadcasting method of the application detecting and recording server is as follows: the probe recording server and the terminal in the multimedia conference, the multipoint control unit (MCU), etc. are connected to the same network.
  • the probe recording server captures the communication data packet on the network, and then extracts data of the media stream to be recorded, such as audio and video data, according to the set filtering information, and then performs storage recording. After the multimedia conference ends, the data of the stored media stream is played back.
  • the first recording mode because only the data of the single channel media stream received by the television terminal itself or received is separately recorded and separately stored. It is not possible to perform some combined recording processing on data of multi-channel audio, video and other media streams, such as multi-picture, picture-in-picture and other image forms.
  • Embodiments of the present invention provide a multimedia conference recording method, a playback method, a recording device, a playback device, a recording device, and a recording and broadcasting system, which realize combined recording of a multi-way conference media stream in a multimedia conference.
  • An embodiment of the present invention provides a method for recording a multimedia conference, including:
  • the combined recording process is performed on the multi-session conference media stream according to a media recording policy.
  • the embodiment of the present invention provides a recording device for a multimedia conference, which comprises:
  • a receiving module configured to receive, by the conference-level recording policy, a multi-way conference media stream to be recorded, where the conference media stream is at least a video media stream or an audio media stream;
  • a recording processing module configured to perform combined recording processing on the multi-session conference media stream according to a media recording policy.
  • the embodiment of the present invention further provides a playback method of a multimedia conference, including: receiving a playback request carrying a media identifier, where the media identifier is used to identify a media file; and obtaining a corresponding media file according to the media identifier For playing back, the media file is obtained by performing combined recording processing on the multi-way conference media stream in the multimedia conference according to the recording strategy.
  • the embodiment of the present invention further provides a multimedia conference playback apparatus for implementing the foregoing method, including:
  • a playback request receiving module configured to receive a playback request carrying a media identifier, where the media identifier is used to identify the media file;
  • a playback module configured to obtain a corresponding media file according to the media identifier, to perform playback, and the media file is combined to record the multi-way conference media stream in the multimedia conference according to the recording policy.
  • the recording and reproducing device of the multimedia conference includes the above-mentioned recording device or the above-mentioned playback device.
  • the recording method and device of the multimedia conference provided by the embodiment of the present invention are provided.
  • the embodiment of the present invention provides a method for recording a multimedia conference, including:
  • the conference-level recording policy Obtaining, by the conference-level recording policy, the multi-way conference media stream to be recorded, where the conference media stream is at least a video media stream or an audio media stream; And storing, according to the site to which the conference media stream belongs, the multi-party conference media stream and the associated identifier, where the association identifier is used to associate the conference media stream of each site.
  • the embodiment of the present invention provides a recording device for a multimedia conference, which comprises:
  • a receiving module configured to obtain a multi-way conference media stream of each conference site in the multimedia conference, where the conference media stream is at least a video media stream or an audio media stream;
  • the association identifier allocation module is configured to store the multi-session conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.
  • the embodiment of the invention further provides a method for playing back a multimedia conference, including:
  • the combined recording process is performed on the multi-session conference media stream according to a media recording policy.
  • the embodiment of the present invention further provides a playback device for a multimedia conference, which includes the following methods, including:
  • a playback request receiving module configured to receive a playback request with an associated identifier, to obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate a conference media stream of each site, the conference media stream At least a video media stream or an audio media stream;
  • the playback processing module is configured to perform combined recording processing on the multiple conference media streams according to a media recording policy.
  • the embodiment of the invention further provides a recording and broadcasting device for a multimedia conference, comprising the above-mentioned recording device or the above-mentioned playback device.
  • FIG. 1 is a schematic flowchart of a method for recording a multimedia conference according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram 1 of a recording apparatus of a multimedia conference according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram 2 of a recording apparatus of a multimedia conference according to an embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of a method for playing back a multimedia conference according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram 1 of a playback device of a multimedia conference according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram 2 of a playback device of a multimedia conference according to an embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of a method for recording a multimedia conference according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram 1 of a recording apparatus of a multimedia conference according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram 2 of a recording apparatus of a multimedia conference according to an embodiment of the present invention.
  • FIG. 10 is a schematic flowchart diagram of a method for playing back a multimedia conference according to an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram 1 of a playback device of a multimedia conference according to an embodiment of the present invention
  • FIG. 12 is a schematic structural diagram 2 of a playback device of a multimedia conference according to an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram 1 of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention
  • FIG. 14 is a schematic structural diagram 2 of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention
  • 15 is a schematic diagram of a telepresence system according to an embodiment of the present invention.
  • FIG. 16 is a schematic diagram of a specific application flow of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention
  • FIG. 17 is a schematic diagram of a specific application flow of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention
  • FIG. 19 is a schematic diagram of a specific application flow of a multimedia conference recording and broadcasting method according to an embodiment of the present invention
  • FIG. 20 is a schematic structural diagram 4 of a multimedia conference recording and broadcasting system according to an embodiment of the present invention
  • FIG. 21 is a schematic diagram of a specific application process of a method for recording and broadcasting a multimedia conference according to an embodiment of the present invention. detailed description
  • the invention provides a defect that the combined recording of the media stream (such as the audio media stream, the video media stream, the picture media stream, and the like) in the multimedia conference cannot be combined.
  • a multimedia conference recording, playback method, device, recording device and recording and broadcasting system which can perform combined recording processing on multi-way conference media streams in a multimedia conference according to a recording strategy, and multi-way conferences that can perform combined recording processing The media stream is played back.
  • the multi-way conference media stream in the multimedia conference may be a multi-channel local media stream of a conference venue, or multiple remote media streams, or multiple local media streams or multiple remote media of multiple conference venues.
  • Flow, multipath can be understood as at least 2 channels, and will not be described here.
  • a conference venue can include more than one conference terminal.
  • one conference site includes three conference terminals, and a single telepresence system conference site has three local video media streams, three local audio media streams, and three remote video media streams.
  • 3 remote audio media streams that is, a total of 6 video media streams and 6 audio media streams.
  • the method and device for recording and playing back a multimedia conference provided by the embodiment of the present invention, the recording and broadcasting device and the recording and broadcasting system, and the combined recording processing of the multi-way conference media stream in the multimedia conference, mainly, such as multi-channel video media stream Synthesize into one-way or multi-channel multi-picture, one-way or multi-channel picture-in-picture, or one-way or multi-channel wide-screen image, etc.; such as combining multiple audio media streams into single-channel audio, multi-channel audio or multiple sounds Recording modes such as channel audio, and more.
  • the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference, and can also conveniently broadcast the data of the media stream to obtain the comprehensive situation of the multimedia conference.
  • Embodiment 1 Embodiment 1
  • an embodiment of the present invention provides a method for recording a multimedia conference, including: Step 1 1: Obtain a multi-way conference media stream to be recorded according to a conference-level recording policy, where the conference media stream is at least a video. Media stream or audio media stream;
  • Step 12 Perform combined recording processing on the multi-way conference media stream according to a media recording policy.
  • the execution body of the multimedia conference recording method may be a recording server, as shown in the figure.
  • Step 1 1 may specifically include:
  • the conference-level recording policy is sent to the multi-point control unit (MCU), and the conference-level recording strategy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode; Receiving, by the multi-point control unit MCU, the multi-way conference media stream to be recorded in the at least one site determined according to the conference-level recording policy, where the conference site includes at least one conference terminal.
  • the voice-activated conference site recording mode refers to the data of the media stream of the conference terminal that records the largest conference site in the conference according to the size of the voice of each conference site in the conference;
  • the broadcast conference recording mode refers to the conference terminal of the broadcast conference site in the recording conference.
  • the conference-level recording strategy is mainly used to determine which media streams of the site need to be recorded.
  • Conference-level recording strategies include, but are not limited to, the above example strategies.
  • the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multi-point control unit MCU, and the multi-point control unit MCU is further connected with other
  • the step 1 1 of obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy may include: sending the conference-level recording policy to the conference terminal, where the conference site includes At least one conference terminal, the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode;
  • the recording server Since the recording server is connected to the conference terminal instead of the multipoint control unit MCU, the recording server can only obtain the media stream data on the conference terminal connected to it, so some conference-level recording strategies cannot be used, such as: voice-activated switching Site recording mode and broadcast site recording mode.
  • the specific site recording mode refers to the data of the media stream of the conference terminal that records the selected single or multiple sites;
  • the local media stream recording mode of the specific site refers to the recording of the conference terminal of the selected single or multiple sites.
  • the remote media stream recording mode of the specific site refers to the data of the remote media stream received by the conference terminal of the selected single or multiple sites.
  • the step 12 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may include:
  • the multiple video media streams are combined into one or more video multi-pictures, or one or more video picture-in-pictures, or one or more wide-screen videos
  • the video media Recording modes include: video recording mode setting mode, or video multi-picture recording mode , or video picture-in-picture recording mode, or wide-screen video media recording mode;
  • the audio media recording mode includes: an audio recording path setting mode, or an audio mono Track recording mode, or audio multi-channel recording mode.
  • the media-level recording strategy is mainly used to determine how the multi-way conference media stream is synthesized into a recording process.
  • Media level recording strategies include, but are not limited to, the example strategies described above.
  • the video recording path number setting refers to recordable output multi-channel video;
  • the video multi-picture recording mode means that multiple video media can be combined into one-way or multi-channel multi-picture recording;
  • video picture-in-picture recording mode Refers to the combination of multiple video media into single or multi-channel picture-in-picture for recording;
  • Wide-screen video media recording mode which combines multiple video media into single or multi-channel widescreen video images for recording.
  • the video media recording mode includes, but is not limited to, the above example recording mode.
  • the above-mentioned video media recording modes can be used in combination, and the multi-channel video media stream determined by the conference-level recording strategy in the combined recording multimedia conference can better reflect the comprehensive situation of the multimedia conference.
  • Audio recording channel setting which means recording and outputting multiple channels of audio
  • Audio mono recording mode which can mix multiple audio media (site sound, background music, etc.) in the conference into mono audio for recording, mixing The number of audio channels can be set
  • the audio multi-channel recording mode means that multiple audio media in a conference can be mixed into multiple audios, and then recorded in multi-channel audio media.
  • Audio media recording modes include, but are not limited to, the example recording modes described above. Moreover, the above audio media recording modes can also be used in combination, and the multi-channel audio media determined by the conference-level recording strategy in the combined recording multimedia conference can better reflect the comprehensive situation of the multimedia conference.
  • the recording method of the multimedia conference in the embodiment of the present invention can simultaneously set a plurality of different recording strategies to record data of the media stream in the conference.
  • two different conference-level recording strategies are set, and two sets of media streams composed of multiple video media streams and audio media streams are respectively determined, and media streams composed of one set of multiple video media streams and audio media streams are selected.
  • a recording parameter such as one of a recording duration, a recording capacity, a recording format, a recording rate, and a compression protocol
  • the multi-way conference medium is used according to a media recording strategy and a recording parameter.
  • the body stream is combined for recording processing.
  • the recording parameters include a recording rate, a recording format, a frame rate, a compression protocol that can be used after data synthesis, and the like.
  • the recording parameters include a recording rate, a recording bandwidth, and a compression protocol that can be used after the data is synthesized.
  • the compression protocol for video media streaming can be: H.263, H.264, MPEG2, MPEG4, etc.
  • the compression protocol for the audio media stream can be: G.71 1, G.722, G.729,
  • the recording and recording server in one scenario is connected to the multi-point control unit MCU, the multi-point control unit MCU is connected to at least one conference terminal, and the multi-point control unit MCU can record
  • the broadcast server sends time synchronization information, media indication information, and conference indication information of the video media stream and the audio media stream of the conference media stream.
  • the step 1 1 of obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy may further include: obtaining time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.
  • the step 12 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may further include: synthesizing the synthesized video media according to time synchronization information of the video media stream and the audio media stream.
  • the data of the stream and the data of the audio media stream are multiplexed into a media file; the media file is stored, and a media identifier is set for the media file, and the media identifier is used to identify the media file.
  • the media file can use a more common format such as the MPEG media file format, which is beneficial to the storage of the media file, and avoids the problem that the video and audio are not synchronized when the playback is performed, and the playback quality is improved. Moreover, by setting a corresponding media identifier for the stored media file, the media data that needs to be played back can be conveniently and quickly found through the media identifier.
  • the media indication information may at least include: a media data type, whether the media data is compressed, a media compression protocol, a data rate, a media bandwidth, or the like. Through the media indication information, it can be determined whether the received multi-session conference media stream is decoded. For example, different types of media data are distributed to different media decoders, such as video decoders, audio decoders, picture decoders, and the like.
  • the meeting instructions include at least one of: starting of the meeting, ending the meeting, leaving the meeting, attending the meeting, and so on.
  • the combined recording can be handled differently. For example, when the conference end indication message is received, indicating that the current conference has ended, then the current conference is The recording and recording process can be ended.
  • the simplest strategy is to stop recording the media data of the meeting site. Of course, you can use another site. Replace the venue, of course, when the recording format is multi-screen, you can dynamically change the multi-screen style (such as: change from four screens to three screens), and so on.
  • the recording and recording server is connected to the at least one conference terminal in another scenario, and the conference terminal connected to the recording and playback server is connected to the multipoint control unit MCU, and the multipoint control is performed.
  • the unit MCU is also connected to at least one conference terminal that is not connected to the recording server.
  • the conference terminal connected to the multi-point control unit MCU can send time synchronization information, media indication information and conference indication information of the video media stream and the audio media stream of the conference media stream to the recording server, and the same, time synchronization information, media indication information
  • the specific application of the conference indication information can be understood by referring to the above scenario, and details are not described herein.
  • the recording method of the multimedia conference in the embodiment of the present invention may further include performing corresponding compression coding on the data of the synthesized media stream, where the process is not necessary, and the compression coding is mainly to reduce the data volume of the media stream.
  • step 1 1 of obtaining a multi-way conference media stream to be recorded according to the conference-level recording policy the conference-level recording policy and the media-level recording policy may also be sent to the multi-point control unit MCU or the conference. Terminal, unlimited.
  • more than one conference terminal is set up in each venue, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors.
  • 3 HD monitors can be displayed.
  • the life-size remote image, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.
  • the recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by the dotted line in FIG. 13 and FIG. 14), and setting a media level recording policy, such as in the terminal group.
  • the local video of each terminal is combined with the local video multi-screen or the local wide-screen image.
  • the recording method of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream is combined. Better response to the comprehensive situation of multimedia conferences.
  • Embodiment 2 Referring to the recording method of the multimedia conference provided in the first embodiment, as shown in FIG. 2, the embodiment of the present invention provides a recording apparatus for a multimedia conference that can implement the foregoing recording method, including:
  • the receiving module 21 is configured to receive a multi-way conference media stream to be recorded according to the conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream.
  • the recording processing module 22 is configured to perform combined recording processing on the multi-session conference media stream according to a media recording policy.
  • the receiving module 21 may include:
  • the policy sending module 21 is configured to send the conference-level recording policy to the multi-point control unit (MCU), where the conference-level recording policy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific conference site. Recording mode.
  • MCU multi-point control unit
  • the media stream receiving module 212 is configured to receive, by the multi-point control unit, the multi-way conference media stream to be recorded in the at least one site determined by the MCU according to the conference-level recording policy, where the conference site includes at least one conference terminal.
  • the receiving module 21 may further include:
  • the policy sending module 21 1 is configured to send the conference-level recording policy to the conference terminal, where the conference site includes at least one conference terminal, where the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or The remote media stream recording mode of a specific site.
  • the media stream receiving module 212 is configured to receive, by the conference terminal, the multi-way conference media stream to be recorded according to the conference level recording policy.
  • the recording processing module 22 includes:
  • the video recording processing module 221 is configured to synthesize the multiple video media streams into one or more video multi-pictures, or one or more video picture-in-pictures, or all the way according to the video media recording mode of the media recording strategy.
  • the video media recording mode includes: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording mode.
  • the audio recording processing module 222 is configured to synthesize the multi-channel audio media stream into an audio mono channel or an audio multi-channel according to the audio media recording mode of the media recording policy, where the audio media recording mode includes: audio Recording mode setting mode, or audio mono recording mode, or audio multi-channel recording mode.
  • the receiving module 21 may further include:
  • the time synchronization information receiving module 213 is configured to receive time synchronization information of the video media stream and the audio media stream in the multi-way conference media stream.
  • the recording processing module 22 may further include:
  • the media file generating module 223 is configured to multiplex and encode the synthesized data of the video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream.
  • the storage module 224 is configured to store the media file, and set a media identifier for the media file, where the media identifier is used to identify the media file.
  • the recording device and the specific component of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference recording method provided in the first embodiment, and details are not described herein.
  • the recording device of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference.
  • the embodiment of the present invention provides a method for playing back a multimedia conference, including:
  • Step 41 Receive a rebate request carrying a media identifier, where the media identifier is used to identify the media file.
  • Step 42 Obtain a corresponding media file according to the media identifier, where the media file is obtained by performing combined recording processing on the multi-way conference media stream in the multimedia conference according to the recording policy.
  • the execution body of the playback method of the multimedia conference in the embodiment of the present invention may be a recording and playback server.
  • the playback method of the multimedia conference in the embodiment of the present invention may further include: before the recording and receiving server receives the playback request with the media identifier, sending the media identifier to the multi-point control unit MCU or the conference terminal.
  • the recording and playback server may receive a playback request carrying the media identifier from the multipoint control unit MCU or the conference terminal.
  • the recording and playback server obtains the corresponding media file according to the media identifier, and multiple points.
  • the control unit MCU or the conference terminal obtains the media file from the recording server for playback.
  • the recording server can adapt the recorded widescreen image (such as down resolution, frame down rate, etc.), and will not be described here.
  • the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal.
  • the recording and recording server performs combined recording processing on the multi-way conference media stream according to the media recording policy, the media identifier is set for the media file, and the media identifier is used to identify the media file.
  • the recording server sends the media identifier corresponding to the media file to the multipoint control unit MCU.
  • the multi-point control unit MCU sends a playback request carrying the media identifier to the recording server, and the recording server obtains the media file corresponding to the media identifier from the media file recorded by the recording server, if the recording server itself has For the output device of the audio and video media, the recording and playback server can complete the playback of the media file by itself.
  • the recording server can send the media file to the multi-point control unit MCU for playback by the multi-point control unit MCU.
  • the conference terminal connected to the multipoint control unit MCU can forward the playback request carrying the media identifier to the recording server through the multipoint control unit MCU, and the recording server obtains the media file corresponding to the media identifier from the media file recorded by the recording server.
  • the recording and playback server can send the media file to the conference terminal through the multi-point control unit MCU, and the conference terminal performs the playback.
  • the recording and broadcasting server is connected to at least one conference terminal, and the conference terminal connected to the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected. There are at least one conference terminal that is not connected to the recording server. To implement the process of playback, you can refer to the previous scenario to implement the playback of media files.
  • the recording server can decompress the widescreen image media stream to recover the widescreen image, and then segment the images corresponding to the respective terminals, and encode the images to generate respective terminal images.
  • the code stream is sent to the corresponding terminals in the telepresence terminal group for playback, to completely reproduce the state at the time of recording.
  • the recording server can adapt the recorded widescreen image (such as down resolution). , frame down rate, etc.) to convert widescreen images into a single terminal to support Media format.
  • the media file can be obtained by using the media identifier to obtain the corresponding media file, and the media file is obtained by combining the data of the multiple media streams in the multimedia conference according to the recording strategy.
  • the broadcasted media files can better reflect the comprehensive situation of multimedia conferences.
  • the embodiment of the present invention provides a playback device for the multimedia conference, including:
  • the playback request receiving module 51 is configured to receive a playback request carrying a media identifier, where the media identifier is used to identify the media file.
  • the playback module 52 is configured to obtain a corresponding media file according to the media identifier, to perform playback, and the media file is combined to record the multi-way conference media stream in the multimedia conference according to the recording policy, as shown in FIG.
  • the selected playback device of the multimedia conference may further include:
  • the media identity sending module 53 is configured to send the media identifier to the multipoint control unit MCU or the conference terminal.
  • the embodiment of the invention provides a recording and playback device for the multimedia conference, comprising: a multimedia conference recording device and/or a multimedia conference Replay device.
  • the recording device of the multimedia conference can be a recording server.
  • the recording and broadcasting device of the multimedia conference in the embodiment of the present invention may further include:
  • the input/output device, the input recording policy and the recording parameter, and the output of the playback media stream are visible from the above.
  • the recording and recording device of the multimedia conference in the embodiment of the present invention can flexibly set the recording strategy and record the recording according to the recording strategy. Media stream data, better response multimedia conference The overall situation.
  • an embodiment of the present invention provides a method for recording a multimedia conference, including: Step 71: Obtain a multi-way conference media stream to be recorded according to a conference-level recording policy, where the conference media stream is at least a video. Media stream or audio media stream.
  • Step 72 Store the multi-party conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.
  • the execution body of the multimedia conference recording method may be a recording server.
  • the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal. And obtaining, by the conference-level recording policy, the multi-way conference media stream to be recorded, specifically:
  • the conference-level recording policy is sent to the multi-point control unit MCU, and the conference-level recording strategy includes: a voice-activated conference site recording mode, or a broadcast site recording mode, or a conference site recording mode, or a specific site recording mode;
  • the multi-way conference media stream to be recorded in the at least one site determined according to the conference-level recording policy, where the conference site includes at least one conference terminal.
  • the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected to other non-recording server. At least one conference terminal. And obtaining the multi-way conference media stream to be recorded according to the conference-level recording policy, specifically:
  • the conference-level recording policy is sent to the conference terminal, where the conference site includes at least one conference terminal, and the conference-level recording policy includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode. ;
  • the method for recording the multimedia conference in the embodiment of the present invention may further include: obtaining time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.
  • data of the video media stream and data of the audio media stream can be multiplexed into a media file, which is beneficial to avoid video and audio when playing back.
  • the method for recording the multimedia conference in the embodiment of the present invention may further include: obtaining and storing a control command of each site in the multimedia conference.
  • the recording method of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference.
  • the embodiment of the present invention provides a recording device for a multimedia conference that can implement the foregoing recording method, including:
  • the receiving module 81 is configured to obtain a multi-way conference media stream to be recorded according to the conference level recording policy, where the conference media stream is at least a video media stream or an audio media stream.
  • the association identifier allocation module 82 is configured to store the multi-session conference media stream and allocate an association identifier according to the conference site to which the conference media stream belongs, where the association identifier is used to associate the conference media stream of each conference site.
  • the recording and playback server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal, or
  • the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU.
  • the multipoint control unit MCU is also connected to at least one conference terminal that is not connected to the recording server.
  • the recording apparatus of the embodiment of the present invention may further include: a synchronization information acquiring module 83, configured to obtain time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.
  • the recording apparatus of the embodiment of the present invention may further include: a control command acquiring module 84, configured to obtain The control commands of each site in the multimedia conference are obtained and stored.
  • the recording device and the specific configuration module of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference recording method provided in the foregoing seventh embodiment, and details are not described herein.
  • the recording device of the multimedia conference can flexibly set the recording strategy, so that the data of the combined recorded media stream can better reflect the comprehensive situation of the multimedia conference.
  • the embodiment of the present invention provides a method for playing back a multimedia conference, including:
  • Step 101 Receive a playback request carrying the associated identifier, and obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate a conference media stream of each site, where the conference media stream is at least a video media stream. Or audio media stream.
  • Step 102 Perform combined recording processing on the multi-way conference media stream according to a media recording policy.
  • the media-level recording strategy includes a video media recording mode and an audio media recording mode
  • the video media recording mode includes: a video recording mode setting mode, or a video multi-picture recording mode, or a video picture-in-picture recording mode, or a wide-screen video media recording.
  • the audio media recording mode includes: an audio recording path setting mode, or an audio mono recording mode, or an audio multi-channel recording mode.
  • the step 102 of performing combined recording processing on the multi-way conference media stream according to the media recording policy may include:
  • the multiple video media streams are combined into one or more video multi-pictures, or one or more video picture-in-pictures, or one or more wide-screen videos;
  • the multiple audio media streams are combined into an audio mono, or an audio multi-channel.
  • Media files can use a more common format such as MPEG media file format to avoid playback. It is prone to the problem that the video and audio are not synchronized, and the playback quality is improved.
  • the execution body of the playback method of the embodiment of the present invention may be a recording and playback server.
  • the multipoint control unit MCU is connected to at least one conference terminal.
  • the multi-point control unit MCU may send a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording and broadcasting server sends the multi-session conference media stream to multiple points.
  • the control unit MCU, the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and performs playback.
  • the conference terminal sends a playback request carrying the associated identifier to the multipoint control unit MCU, and the recording and playback server receives the playback request through the multipoint control unit MCU, and the recording and playback server obtains the corresponding multisession conference media stream according to the association identifier.
  • the multi-point conference media stream is sent to the multi-point control unit MCU by the recording and playback server, and the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and the multi-point control unit MCU will record the combination.
  • the processed media stream is sent to the conference terminal, and is played back by the conference terminal.
  • the player or the conference terminal may send a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the associated identifier.
  • the multi-point conference media stream is sent to the multi-point control unit MCU by the recording and playback server, and the multi-point control unit MCU performs combined recording processing on the multi-way conference media stream according to the media level recording policy, and the multi-point control unit MCU records the broadcast.
  • the server sends the combined recording and processing media stream to the player or the conference terminal, and the player or the conference terminal plays back the broadcast.
  • the recording server is connected to at least one conference terminal, and the conference terminal connected to the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is further connected. Other at least one conference terminal that is not connected to the recording server.
  • the conference terminal connected to the recording server sends a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording server pairs the multiple channels according to the media level recording policy.
  • the conference media stream performs combined recording processing and performs playback.
  • the conference terminal connected to the recording server sends a playback request carrying the associated identifier to the recording server, and the recording server obtains the corresponding multi-session conference media stream according to the association identifier, and the recording and broadcasting server sends the multi-way conference media stream to a conference terminal connected to the recording server, and the conference terminal connected to the recording server performs combined recording on the multi-way conference media stream according to a media level recording policy Rational, and replay.
  • the player or the conference terminal can implement the function of the conference terminal connected to the recording server as described above, for example, performing the multi-session conference media stream according to the media level recording policy. Combine recording processing and perform playback.
  • the playback method of the multimedia conference in the embodiment of the present invention may send a request to pause, change the play time, and stop.
  • the recording and recording server can process the request, and re-determine the time point of playing the code stream in each conference site (determining the code stream time point: the time stamp in the code stream can be calculated according to the playing time), and the code for requesting and confirming the time point is
  • the stream is sent to the multipoint control unit MCU.
  • Multipoint Control Unit The MCU waits to receive the code stream from the recording server to reconfirm the time point before proceeding.
  • the image and the sound heard during the conference are played back, and the control commands of the conference site and the conference are broadcasted at the same time to complete the reproduction of the conference site.
  • the image and the sound heard by the specified site during the conference will be played back, and the control commands of the site will be played back to complete the replay of the site.
  • the specified site is combined into the specified screen split mode and sent to the on-demand player.
  • the specified site timings are combined into a specified screen split mode and sent to the on-demand player.
  • the specified on-demand site image and sound are sent to the on-demand player.
  • the sound of the specified site is removed, so that the on-demand player can not hear the site sound, and the noisy site is blocked.
  • the image of the specified screen is sent to the on-demand player.
  • the above-mentioned method for implementing the multimedia conference can obtain the corresponding multi-channel media stream through the association identifier, and combine and record the multi-channel media stream to better reflect the comprehensive situation of the multimedia conference.
  • Example ten
  • the embodiment of the present invention provides a playback device for the multimedia conference, including:
  • the playback request receiving module 1 1 1 is configured to receive a playback request carrying the associated identifier, and obtain a multi-way conference media stream corresponding to the association identifier, where the association identifier is used to associate the conference media stream of each site,
  • the conference media stream is at least a video media stream or an audio media stream.
  • the playback processing module 1 12 is configured to perform combined recording processing on the multiple conference media streams according to a media recording policy.
  • the playback processing module 1 12 may include:
  • the video recording processing module 1 121 is configured to synthesize the multi-channel video media stream into one or more video multi-pictures, or one or more video picture-in-pictures according to a video media recording mode of the media recording policy, or
  • the one-way or multi-channel widescreen video, the media-level recording strategy includes a video media recording mode and an audio media recording mode, and the video media recording mode includes: a video recording path setting mode, or a video multi-picture recording mode, or a video Draw recording mode, or widescreen video media recording mode.
  • the audio recording processing module 1 122 is configured to synthesize the multi-channel audio media stream into audio mono, or audio multi-channel according to an audio media recording mode of the media recording policy.
  • the audio media recording mode includes: an audio recording path setting mode, or an audio mono recording mode, or an audio multi-channel recording mode.
  • the synchronization information obtaining module 1 13 is configured to obtain time synchronization information of the video media stream and the audio media stream in the multi-session conference media stream.
  • the media file generating module 1 14 is configured to multiplex and encode the synthesized data of the video media stream and the data of the audio media stream into a media file according to the time synchronization information of the video media stream and the audio media stream.
  • the control command playback module 1 15 is configured to play back the control command determined according to the conference level recording policy.
  • the playback device and the specific configuration module of the multimedia conference provided by the embodiment of the present invention can be understood by referring to the multimedia conference playback method provided in the foregoing embodiment 9, and details are not described herein.
  • the playback device of the multimedia conference can obtain the corresponding multi-channel media stream by using the association identifier, and record and play back the multi-channel media stream, thereby better reflecting the multimedia conference. Comprehensive situation.
  • the embodiment of the invention provides a recording and playback device for the multimedia conference, comprising: a multimedia conference recording device and/or multimedia The playback device of the conference.
  • the recording device of the multimedia conference can be a recording server.
  • the recording and broadcasting apparatus of the embodiment of the present invention may further include:
  • Input/output device for entering recording strategies, recording parameters, and providing an on-demand interface.
  • Recording strategies include media-level recording strategies.
  • the on-demand interface provides a request to send a pause, change the play time, stop, provide a specified site virtual entry, set multi-screen, multi-screen polling, switch on-demand venue, static sound, telepresence screen switching and other control operations.
  • the recording and recording apparatus of the embodiment of the present invention can flexibly set the recording strategy and combine the data of the recorded media stream according to the recording strategy to better reflect the comprehensive situation of the multimedia conference.
  • the embodiment of the invention provides a multimedia conference recording and broadcasting system, including a multimedia conference recording and broadcasting device, and a multipoint control unit. MCU and conference terminal.
  • the recording server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal.
  • the recording device of the multimedia conference can be a recording server.
  • the plurality of conference terminals 300 and the multipoint control unit 200 are connected by the first communication network, and the multipoint control unit 200 completes the interaction of the data of the media streams between the plurality of conference terminals 300.
  • the recording and playback device 100 is connected to the multipoint control unit 200 through the second communication network, and establishes a connection for performing data and information of the media stream between the recording device 100 and the multipoint control unit 200 (such as a conference).
  • the recording device 100 can perform composite recording on the data of the multi-media media stream on the multipoint control unit 200 by the interaction of the indication information, the media indication information, and the like.
  • the second communication network and the first communication network may be the same communication network, such as Ethernet, and the second communication network and the first communication network may also be different communication networks.
  • a plurality of conference terminals 300, a multipoint control unit 200, and a recording device 100 can also be disposed in a communication network such as Ethernet.
  • the recording device 100 When the recording device 100 is used as a stand-alone device, it can have its own input device for information input, such as: keyboard, touch screen, mouse, remote control, etc.; also can have its own output device for information output display Such as: LCD screen, display, etc.
  • the recording device when used as an independent device, it may not have its own independent input/output device.
  • it can share the input/output device of the multipoint control unit 200 management station, and manage the station through the multipoint control unit 200. Indirect control of the recording device.
  • the user can set the recording strategy and recording parameters through the input device of the recording device 100.
  • the multipoint control unit 200 receives the conference level recording policy sent by the recording device 100, and the multipoint control unit 200 determines the multisession conference media stream to be recorded according to the conference level recording policy, and the multipoint control unit 200 transmits the multisession conference media to be recorded.
  • the recording is performed on the recording and playback device 100, and the recording and playback device 100 synthesizes the data of the multi-way conference media stream according to the media-level recording strategy to obtain a media file.
  • the recording and playback device 100 stores the media file and sets the corresponding media identification.
  • the multipoint control unit 200 sends a playback request carrying the media identifier to the recording and playback device 100.
  • the recording and playback device 100 obtains the corresponding media file according to the media identifier, and the recording and playback device 100 implements the playback. Alternatively, the recording and playback device 100 can display the media file. Sended to the multipoint control unit 200, the multipoint control unit 200 implements playback.
  • the recording and playback device 100 can be integrated with the multipoint control unit 200 or set independently.
  • each conference site has more than one conference terminal, as shown in FIG. 15, three conference terminals, three high-definition cameras, and three high-definition displays.
  • the conference terminals of the same site form a terminal group (as shown by the dashed box in Figure 15).
  • the terminal group replaces the conference terminal, and the recording and playback device 100 can be set independently or integrated with the conference terminal in the terminal group.
  • the recording and recording process of this scenario can be understood by referring to the scenario, and will not be described here.
  • the embodiment of the invention provides a multimedia conference recording and broadcasting system, including a multimedia conference recording and broadcasting device, and a multipoint control unit. MCU and conference terminal.
  • the recording and broadcasting system of the multimedia conference includes a recording and playback device 100, at least one conference terminal 300 connected to the recording and playback device 100, and a multipoint control unit connected to at least one conference terminal 300 connected to the recording and playback device 100. (Multipoint Control Unit MCU) 200.
  • the multipoint control unit 200 is further connected to at least one conference terminal 300:
  • the plurality of conference terminals 300 and the multipoint control unit 200 are connected through the first communication network, and the multipoint control unit 200 completes the interaction of data of the media streams between the plurality of conference terminals 300.
  • the recording and playback apparatus 100 is connected to the at least one conference terminal 300 via the second communication network, and the recording and playback apparatus 100 can perform combined recording on the data of the plurality of media streams on the at least one conference terminal 300 connected thereto.
  • the second communication network and the first communication network may be the same communication network, such as Ethernet; the second communication network and the first communication network may also be different communication networks.
  • the plurality of conference terminals 300, the multipoint control unit 200, and the recording and playback device 100 may also be disposed in a communication network such as an Ethernet.
  • the recording device 100 can have its own input device for information input, such as: keyboard, touch screen, mouse, remote control, etc.; also can have its own output device for information output display Such as: LCD screen, display, etc.
  • the recording device when used as an independent device, it may not have its own independent input/output device. At this time, it can share the input/output device of the multipoint control unit 200 management station, and manage the station through the multipoint control unit 200. Indirect control of the recording device.
  • the user can set the recording strategy and recording parameters through the input device of the recording device 100.
  • the recording and playback device 100 can only record the multi-way conference media stream of the conference terminal 300 connected thereto during the conference.
  • the conference-level recording policy that the recording and recording device 100 sends to the conference terminal 300 connected thereto includes: a specific site recording mode, or a specific site local media stream recording mode, or a specific site remote media stream recording mode.
  • the conference terminal 300 connected to the recording device 100 receives the conference-level recording policy sent by the recording device 100, the conference terminal 300 determines the multi-session conference media stream to be recorded according to the conference-level recording policy, and the conference terminal 300 transmits the multi-channel to be recorded.
  • the conference media stream is sent to the recording and playback device 100, and the recording and playback device 100 synthesizes the data of the multi-way conference media stream according to the media-level recording strategy to obtain the media file.
  • Record The broadcast device 100 stores the media file and sets a corresponding media identifier.
  • the conference terminal 300 sends a playback request carrying the media identifier to the recording and playback device 100.
  • the recording and playback device 100 obtains the corresponding media file according to the media identifier, and the recording and playback device 100 implements the playback.
  • the recording and playback device 100 sends the media file to the recording device 100.
  • the conference terminal 300 and the conference terminal 300 implement playback.
  • the recording and playback apparatus 100 can be integrated with the conference terminal 300 or set independently.
  • each conference site has more than one conference terminal, as shown in FIG. 15, three conference terminals, three high-definition cameras, and three high-definition displays.
  • the conference terminals of the same site form a terminal group (as shown by the dashed box in Figure 15).
  • the terminal group replaces the conference terminal, and the recording and playback device 100 can be set independently or integrated with the conference terminal in the terminal group.
  • the recording and recording process of this scenario can be understood by referring to the above scenario, and will not be described here.
  • the recording and playback method of the multimedia conference is illustrated by the recording and broadcasting system of the multimedia conference shown in FIG. 13. As shown in FIG. 16, the first is the recording process of the multimedia conference:
  • the recording device sends the conference-level recording strategy to the multi-point control unit.
  • the recording device sends the conference-level recording policy "sound control switching site recording mode" to the multi-point control unit MCU.
  • "Voice Switching Site Recording Mode” indicates that the media stream that needs to be recorded is the media stream with the highest volume.
  • the recording device does not need to send a conference level recording strategy to the multipoint control unit MCU.
  • Multipoint Control Unit The MCU determines the multi-way conference media stream to be recorded according to the conference level recording strategy.
  • the multi-point control unit MCU receives the conference-level recording policy of the voice-activated switching site recording mode sent by the recording device.
  • the multi-point control unit MCU periodically detects the volume of each site in the conference, and determines the media stream that maximizes the volume of the site. The data is sent to the recording device for recording.
  • the multipoint control unit MCU sends the multi-way conference media stream to be recorded to the recording device.
  • the data of the conference media stream transmitted by the multipoint control unit MCU to the recording device may use a single data connection channel to transmit data of all types of conference media streams, or may use multiple data links. Channels are used to transmit data of different types of conference media streams, and data of different types of conference media streams such as video and audio data.
  • the multipoint control unit MCU can simultaneously transmit time synchronization information, media indication information, and conference indication information of the video media stream and the audio media stream of the conference media stream to the recording and playback device.
  • the recording device synthesizes data of the received multi-session conference media stream according to a media level recording strategy.
  • Media-level recording strategies for recording devices such as video recording strategy "multi-screen”, audio recording strategy "multi-channel mode".
  • the recording device synthesizes the data of the multi-media media stream of the largest conference site in the conference obtained according to the "sound control switching site recording mode". For example, recording the local video media stream and the far-end video media stream as multiple pictures, recording the local audio media stream and the far-end audio recording media stream as multi-channel audio, such as local voice left channel, far-end voice right channel and many more.
  • the recording device further includes recording parameters (such as recording duration, etc.), the synthesis of the multi-session conference media stream is completed according to the recording parameters.
  • recording parameters such as recording duration, etc.
  • the recording unit may receive the slave multi-point control unit.
  • the transmitted media indication information determines whether the data of the multi-media media stream is decoded. Whether the recording device decodes the data of the received multi-media media stream depends on whether the data of the received media stream is compressed, and when the data of the received media stream is not compressed, the composition can be directly synthesized.
  • the recording and playback device performs corresponding compression encoding on the data of the synthesized media stream. It is not necessary for the recording and playback device to perform corresponding compression coding on the synthesized media stream data, and the compression coding is mainly for reducing the amount of data of the media stream.
  • the recording and reproducing device multiplexes the data of the synthesized media stream into one or more media files according to the time synchronization information, and the media file format can use the MPEG media file format to facilitate storage and playback. It is not necessary to multiplex the data of the compressed media stream into a media file, and the data of the compressed media stream and the time synchronization information thereof may be directly stored in the storage device. If the recording instruction device receives the conference indication information sent by the multipoint control unit, for example, when the conference end indication information is received, indicating that the current conference has ended, the recording of the current conference may end.
  • the recording device stores the media file and configures a corresponding media identifier.
  • the recording and recording device can store the media files obtained by multiplexing and encoding in a device or device with a storage function such as a hard disk, a USB flash drive, an SD card, a magnetic tape, and the like, and can configure a corresponding media identifier, which is convenient for playing back, and is found according to the media identifier. Corresponding media file.
  • the recording device sends the media identifier to the multi-point control unit MCU.
  • the recording device transmits the media identification to the multipoint control unit MCU.
  • the multi-point control unit MCU can also send the media identifier to each conference terminal without further description.
  • the multipoint control unit sends a playback request to the recording device.
  • the multipoint control unit MCU sends a playback request to the recording device, and the playback request carries a media identification.
  • each conference terminal can also send a rebate request, and forward the rebroadcast request to the recording device through the multipoint control unit.
  • the recording and playback device obtains a corresponding media file according to the playback request.
  • the recording and playback device receives the playback request, and reads the stored corresponding media file according to the media identifier carried by the playback request.
  • the recording and reproducing device itself can perform demultiplexing and decoding of the media file, and then perform playback.
  • the recording and playback device may also perform media adaptation processing on the data of the demultiplexed media stream and send the data to the multipoint control unit MCU.
  • the media adaptation process is mainly used to convert the media compression type into a media compression type that the multi-point control unit MCU can support.
  • the recording device transmits the data of the media stream to the multi-point control unit MCU.
  • the recording device transmits the data of the media stream to the multipoint control unit MCU, and the data of the media stream is data suitable for processing.
  • the multipoint control unit MCU performs playback.
  • the multipoint control unit MCU receives the data of the media stream sent by the recording device, and decodes it and then plays back the data.
  • the multipoint control unit MCU may also send the data of the media stream to the conference terminal, and the conference terminal decodes and then rebroadcasts.
  • the media file can be copied or sent to other devices (such as a PC) for playback via the data interface (such as USB interface) provided by the recording device.
  • the data interface such as USB interface
  • a multimedia conference may involve more than one conference site, and each conference site usually has one conference terminal, so that the recording and playback methods of the multimedia conference can be used for data of multiple media streams in the multimedia conference. Perform combined recording processing to meet different recording strategy requirements.
  • each conference site has more than one conference terminal, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors.
  • 3 HD monitors can The life-size remote image is displayed, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.
  • the recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by a dotted line in FIG. 15), and setting a media-level recording policy, such as each terminal in the terminal group.
  • the local video combines the local video multi-picture or the local wide-screen image.
  • the local video image and the far-end video image are not interlaced, which facilitates the recognition of the local video image and the far-end video image during playback.
  • the overall situation of the venue can also be recorded in any combination, and will not be described.
  • the recording and playback method of the multimedia conference is illustrated by the recording and broadcasting system of the multimedia conference shown in FIG. 14, as shown in FIG. 17, the first is the recording process of the multimedia conference:
  • the recording device sends the conference-level recording strategy to the conference terminal.
  • the recording device sends the conference-level recording policy "Specific site recording mode" to the conference terminal connected to it.
  • the conference terminal connected to the recording device is preset with a conference-level recording strategy, 1702.
  • the conference terminal determines, according to the conference level recording policy, the multi-way conference media stream to be recorded.
  • the conference terminal connected to the recording device receives the recording policy "Specific Site Recording Mode" sent by the recording device to determine whether it is a specific site in the recording policy. If the conference terminal connected to the recording device determines that it is a specific site in the recording policy, it is confirmed that the media stream on the recording device is the multi-way conference media stream to be recorded, and the media on the conference terminal connected to the recording device The stream is sent to the recording device.
  • the conference terminal sends a multi-way conference media stream to be recorded to the recording device.
  • the data of the multi-way conference media stream transmitted by the conference terminal connected to the recording device to the recording device may use a single data connection channel to transmit data of all types of conference media streams, or may use multiple data connection channels to transmit different data.
  • Types of conference media stream data, different types of conference media stream data such as video, audio data.
  • the conference terminal connected to the recording device can simultaneously transmit time synchronization information, media indication information, and conference indication information to the recording and playback device.
  • the recording device synthesizes the data of the received multi-session conference media stream according to the media level recording strategy.
  • the media-level recording strategy of the recording device such as the video recording strategy "Picture in Picture” and the audio recording strategy "Multi-channel mode”.
  • the recording device synthesizes data of multiple media streams according to "Picture in Picture” and "Multichannel Mode". For example, recording the local video media stream and the far-end video media stream as picture-in-picture, recording the local audio media stream and the far-end audio recording media stream as multi-channel audio, such as local voice left channel, far-end voice right sound Road and so on.
  • the recording device further includes recording parameters (such as recording duration, etc.), the synthesis of the multi-session conference media stream is completed according to the recording parameters.
  • recording parameters such as recording duration, etc.
  • the conference terminal connected to the recording device transmits the time synchronization information, the media indication information, and the conference indication information of the video media stream and the audio media stream of the conference media stream to the recording and playback device, specifically:
  • the recording and receiving device receives the media indication information sent by the conference terminal, and determines whether to decode the data of the multiple media streams. Whether the recording device decodes the data of the received multi-media media stream depends on whether the data of the received media stream is compressed, and when the data of the received media stream is not compressed, the composition can be directly synthesized.
  • the recording and playback device performs corresponding compression encoding on the data of the synthesized media stream. It is not necessary for the recording and playback device to perform corresponding compression encoding on the data of the synthesized media stream, and the compression encoding is mainly for reducing the amount of data of the media stream.
  • the recording and reproducing apparatus multiplexes the synthesized media stream data into one or more media files based on the time synchronization information. It is not necessary to multiplex the data of the compressed media stream into a media file, and the data of the compressed media stream and the time synchronization information thereof may be directly stored in the storage device independently.
  • the recording and receiving device receives the meeting instruction information sent by the conference terminal, for example, when the conference end indication information is received, indicating that the current conference has ended, the recording of the current conference may end.
  • the recording device stores the media file and configures a corresponding media identifier.
  • the recording and recording device can store the media files obtained by multiplexing and encoding, and can configure corresponding media identifiers, so that when the playback is performed, the corresponding media files are found according to the media identifiers.
  • the recording device sends the media identifier to the conference terminal.
  • the recording device transmits the media identification to at least one conference terminal connected thereto.
  • the conference terminal connected to the recording device can also send the media identifier to other conference terminals through the multi-point control unit MCU, and no further description is made.
  • the conference terminal sends a playback request to the recording device.
  • the at least one conference terminal connected to the recording device sends a playback request to the recording device, where the playback request carries the media identifier.
  • the multi-point control unit MCU and other conference terminals not connected to the recording device can also send a rebate request without comment.
  • the recording device obtains a corresponding media file according to the playback request.
  • the recording and playback device receives the playback request, and reads the stored media file corresponding to the media identifier according to the media identifier carried by the playback request.
  • the media file can be demultiplexed, decoded, and then played back by the recording device itself.
  • the recording and playback device may perform the media adaptation processing on the data of the demultiplexed media stream, and send the data to at least one conference terminal connected to the recording device.
  • the media adaptation process is mainly used to convert the media compression type into a media compression type that the conference terminal can support.
  • the recording and playback device sends the data of the media stream to the conference terminal.
  • the recording device transmits the data of the media stream to at least one conference terminal connected to the recording device, and the data of the media stream is data adapted for processing.
  • the conference terminal performs playback.
  • At least one conference terminal connected to the recording device receives the adapted media file, decodes the media file, and then plays back the video file.
  • the at least one conference terminal connected to the recording device may also send the data of the media stream to the multipoint control unit MCU, and the multipoint control unit MCU sends the data of the media stream to other conference terminals not connected to the recording device, The point control unit MCU or other conference terminal not connected to the recording device is decoded and then played back.
  • the media file can also be copied or sent to other devices (such as a PC) for playback via the data interface (such as USB interface) provided by the recording device.
  • the data interface such as USB interface
  • a multimedia conference may involve more than one conference site.
  • Each conference site usually has one conference terminal.
  • the recording and playback methods of the multimedia conference can perform combined recording processing on data of multiple media streams to meet different requirements. Recording strategy requirements.
  • each conference site has more than one conference terminal, such as 3 conference terminals, 3 HD cameras, and 3 HD monitors.
  • 3 HD monitors can The life-size remote image is displayed, and the image is continuous in the horizontal direction, so that the participants can have a meeting and face-to-face communication experience.
  • the recording and playback method of the multimedia conference may further include: forming a conference terminal of the same site into a terminal group (as shown by a dotted line in FIG. 15), and setting a media-level recording policy, such as each terminal in the terminal group.
  • the local video combines the local video multi-picture or the local wide-screen image.
  • the local image and the far-end image are not interlaced, which facilitates the recognition of the local image and the far-end image during playback, and clearly shows the comprehensive situation of the venue.
  • the local media and the remote media of each terminal in the terminal group may be recorded and stored in any combination, and details are not described herein.
  • the recording and playback device is connected to the multipoint control unit MCU, and the multipoint control unit MCU is connected to at least one conference terminal.
  • the recording server can also directly connect to a player or a conference terminal, and the player or conference terminal does not participate in the conference, and can be used as an on-demand player.
  • the first is the recording process of the multimedia conference:
  • the recording and recording device records the multi-way conference media stream of each conference site in the conference.
  • the recording and playback device determines a multi-way conference media stream to be recorded according to the conference-level recording policy, records the playback device, and records the multi-session conference media stream.
  • the recording device allocates an association identifier for the multi-session conference media stream.
  • the recording and recording device stores the multi-way conference media stream and allocates an association identifier according to the site to which the conference media stream belongs, and the association identifier is used to associate the conference media stream of each site. For example, each site creates a file, 1.avi, 2.avi, 3.avi, associated identifier confl associated 1.avi, 2.avi, 3.avi.
  • the player sends a playback request carrying the associated identifier to the recording device.
  • the player can use the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.
  • the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.
  • the recording and playback device sends the multi-session conference media stream corresponding to the association identifier to the multi-point control unit MCU.
  • the recording device obtains the corresponding multi-way conference media stream 1.avi, 2.avi, 3.avi and sends it to the multi-point control unit MCU according to confl.
  • Multi-point control unit The MCU performs combined recording processing on the multi-way conference media stream.
  • the MCU performs combined recording processing on the multi-way conference media streams 1.avi, 2.avi, 3.avi according to the media level recording strategy.
  • Multipoint Control Unit The MCU sends the recorded media stream to the recording device.
  • the recording device sends the recorded media stream to the player.
  • the player records the processed media stream.
  • the player implements the playback according to the media stream after the recording process.
  • the multi-point control unit MCU can also directly send the processed media stream to the on-demand player without forwarding through the recording device.
  • the player in 1903 can send a playback request carrying the associated identifier to the multipoint control unit MCU.
  • the multipoint control unit MCU needs to forward the playback request to the recording device.
  • the recording and playback device sends the multi-session conference media stream corresponding to the association identifier to the multi-point control unit MCU.
  • the multipoint control unit MCU performs combined recording processing on the multi-way conference media stream.
  • the multimedia stream recorded by the multi-point control unit MCU is sent to the player.
  • the player implements the playback according to the media stream after the recording process.
  • the multipoint control unit MCU and the recording and playback device may have multiple, one multipoint control unit MCU may be connected to a plurality of recording and playback devices, and one recording and playback device may be connected to a plurality of multipoint control unit MCUs.
  • the multipoint control unit MCU and recording device can also be integrated into one device.
  • the recording and playback method of the multimedia conference will be described by the recording and broadcasting system of the multimedia conference shown in FIG.
  • the recording and broadcasting server is connected to at least one conference terminal, and the conference terminal connected to the recording and broadcasting server is connected to the multipoint control unit MCU, and the multipoint control unit MCU is also connected to at least one other connection that is not connected to the recording and recording server.
  • the recording server can also directly connect to the player or the conference terminal.
  • the player or conference terminal does not participate in the conference, and it can be used as an on-demand player.
  • the first is the recording process of the multimedia conference:
  • the recording and recording device records the multi-way conference media stream of each conference site in the conference.
  • the recording and playback device determines a multi-way conference media stream to be recorded according to the conference-level recording policy, records the playback device, and records the multi-session conference media stream.
  • the recording device allocates an association identifier for the multi-session conference media stream.
  • the recording and recording device stores the multi-way conference media stream and allocates an association identifier according to the site to which the conference media stream belongs, and the association identifier is used to associate the conference media stream of each site. For example, each site creates a file, 1.avi, 2.avi, 3.avi, associated identifier confl associated 1.avi, 2.avi, 3.avi.
  • the conference terminal sends a playback request carrying the associated identifier to the recording device.
  • the conference terminal player connected to the recording server can use the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.
  • the stream control protocol such as RTSP to order the conference confl through the recording device, such as H132/SIP call mode on-demand confl.
  • the recording and playback device performs combined recording processing on the multi-way conference media stream.
  • the recording and recording device performs combined recording processing on the multi-way conference media streams 1.avi, 2.avi, 3.avi according to the media level recording strategy.
  • the recording and playback device sends the recorded media stream to the conference terminal.
  • the recording device transmits the recorded media stream to the conference terminal connected to the recording server.
  • the conference terminal plays back the recorded media stream.
  • the conference terminal connected to the recording server implements the playback.
  • the conference terminal can be replaced with a player.
  • the recording device in 2104 can send multiple conference media to the conference terminal.
  • the conference terminal performs combined recording processing on the multi-way conference media stream to implement playback.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
  • ROM read-only memory
  • RAM random access memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

La présente invention concerne un procédé et un système pour enregistrer et reproduire une conférence multimédia. Ledit procédé d'enregistrement d'inférence multimédia comprend les étapes consistant à obtenir de multiples flux multimédias dans la conférence multimédia, et à exécuter le procédé d'enregistrement combiné sur les multiples flux multimédias selon des stratégies d'enregistrement, les données desdits flux multimédias comportant au moins des données vidéo ou des données audio ou des données d'image. Puisque le procédé d'enregistrement combiné peut être implémenté pour les multiples flux multimédias dans la conférence selon des stratégies d'enregistrement et que ces dernières peuvent être déterminées de manière flexible, on peut donc refléter une situation synthétique de la conférence multimédia.
PCT/CN2010/077973 2009-11-02 2010-10-22 Procédé et système pour enregistrer et reproduire une conférence multimédia WO2011050690A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200910211202.X 2009-11-02
CN 200910211202 CN102055949B (zh) 2009-11-02 2009-11-02 多媒体会议的录播方法、装置及系统、回播方法及装置

Publications (1)

Publication Number Publication Date
WO2011050690A1 true WO2011050690A1 (fr) 2011-05-05

Family

ID=43921321

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/077973 WO2011050690A1 (fr) 2009-11-02 2010-10-22 Procédé et système pour enregistrer et reproduire une conférence multimédia

Country Status (2)

Country Link
CN (1) CN102055949B (fr)
WO (1) WO2011050690A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595004A (zh) * 2011-12-21 2012-07-18 上海会畅通讯科技发展有限公司 电话会议的录音方法和装置
CN105847935A (zh) * 2016-03-31 2016-08-10 徐文波 视频内容的显示控制方法和装置
CN112463283A (zh) * 2020-12-25 2021-03-09 创想空间信息技术(苏州)有限公司 一种回看应用程序历史内容的方法、系统及电子设备
EP4113985A4 (fr) * 2020-02-24 2023-08-02 Beijing Bytedance Network Technology Co., Ltd. Procédé et appareil de traitement de données de conférence multimédia, et dispositif électronique

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102223515B (zh) * 2011-06-21 2017-12-05 中兴通讯股份有限公司 远程呈现会议系统、远程呈现会议的录制与回放方法
CN102821308B (zh) * 2012-06-04 2014-11-05 西安交通大学 一种多场景流媒体课件录制与直播方法
CN103686219B (zh) * 2012-09-24 2017-09-29 华为技术有限公司 一种视频会议录播的方法、设备及系统
CN104349117B (zh) * 2013-08-09 2019-01-25 华为技术有限公司 多内容媒体通信方法、装置及系统
CN104735390A (zh) * 2013-12-20 2015-06-24 华为技术有限公司 浸入式会议中视频、音频布局方法与装置
CN104581346A (zh) * 2015-01-14 2015-04-29 华东师范大学 一种微视频课程制作系统及其制作方法
CN106341622B (zh) * 2015-07-06 2020-01-24 阿里巴巴集团控股有限公司 一种多路视频流的编码方法及装置
CN105262976B (zh) * 2015-09-22 2019-02-01 武汉钢铁(集团)公司 一种控制第三方录播源方法及多点控制器mcu
CN105812659A (zh) * 2016-03-14 2016-07-27 阔地教育科技有限公司 录像资源管理方法、录像资源管理架构及录像处理设备
CN106453440A (zh) * 2016-12-27 2017-02-22 国网信息通信产业集团有限公司 一种录播系统
CN109246449A (zh) * 2017-07-11 2019-01-18 中国移动通信集团重庆有限公司 视频流分发方法、装置、设备及计算机存储介质
CN109040644B (zh) * 2018-07-25 2020-12-04 成都鼎桥通信技术有限公司 视频点呼录像的保存方法和系统
CN109218810A (zh) * 2018-08-29 2019-01-15 努比亚技术有限公司 一种视频录制参数调控方法、设备及计算机可读存储介质
CN110049272A (zh) * 2019-03-26 2019-07-23 上海创视通软件技术有限公司 一种与视频会议终端直连录制视频会议的方法及装置
CN110300322B (zh) 2019-04-24 2021-07-13 网宿科技股份有限公司 一种屏幕录制的方法、客户端和终端设备
CN110351513B (zh) * 2019-06-17 2023-07-14 平安科技（深圳）有限公司 庭审录制方法、装置、计算机设备和存储介质
CN112153321B (zh) * 2019-06-28 2022-04-05 华为技术有限公司 一种会议录制方法、装置及会议录制系统
CN111131760B (zh) * 2019-12-31 2022-12-13 视联动力信息技术股份有限公司 一种视频录制方法和装置
CN111182258B (zh) * 2020-02-11 2022-12-23 视联动力信息技术股份有限公司 一种网络会议的数据传输方法和装置
CN112702559B (zh) * 2021-03-23 2021-07-09 浙江华创视讯科技有限公司 一种录播异常反馈方法、系统、设备及可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1551631A (zh) * 2003-05-16 2004-12-01 ������������ʽ���� 用于媒体回放体系结构的方法和系统
JP2008066794A (ja) * 2006-09-04 2008-03-21 Ntt Bizlink Inc テレビ会議予約・実施制御・記録制御装置、テレビ会議予約・実施制御・記録制御方法およびテレビ会議予約・実施制御・記録制御プログラム
US7466334B1 (en) * 2002-09-17 2008-12-16 Commfore Corporation Method and system for recording and indexing audio and video conference calls allowing topic-based notification and navigation of recordings

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080158337A1 (en) * 2001-12-15 2008-07-03 John William Richardson Videoconference Bandwidth Selection Mechanism
CN101039409A (zh) * 2007-04-04 2007-09-19 中兴通讯股份有限公司 多媒体会议音视频录制/回放系统及方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7466334B1 (en) * 2002-09-17 2008-12-16 Commfore Corporation Method and system for recording and indexing audio and video conference calls allowing topic-based notification and navigation of recordings
CN1551631A (zh) * 2003-05-16 2004-12-01 ������������ʽ���� 用于媒体回放体系结构的方法和系统
JP2008066794A (ja) * 2006-09-04 2008-03-21 Ntt Bizlink Inc テレビ会議予約・実施制御・記録制御装置、テレビ会議予約・実施制御・記録制御方法およびテレビ会議予約・実施制御・記録制御プログラム

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595004A (zh) * 2011-12-21 2012-07-18 上海会畅通讯科技发展有限公司 电话会议的录音方法和装置
CN105847935A (zh) * 2016-03-31 2016-08-10 徐文波 视频内容的显示控制方法和装置
CN105847935B (zh) * 2016-03-31 2019-03-15 徐文波 视频内容的显示控制方法和装置
EP4113985A4 (fr) * 2020-02-24 2023-08-02 Beijing Bytedance Network Technology Co., Ltd. Procédé et appareil de traitement de données de conférence multimédia, et dispositif électronique
CN112463283A (zh) * 2020-12-25 2021-03-09 创想空间信息技术(苏州)有限公司 一种回看应用程序历史内容的方法、系统及电子设备

Also Published As

Publication number Publication date
CN102055949A (zh) 2011-05-11
CN102055949B (zh) 2013-10-02

Similar Documents

Publication Publication Date Title
WO2011050690A1 (fr) Procédé et système pour enregistrer et reproduire une conférence multimédia
JP5345081B2 (ja) 常駐会議を行うための方法およびシステム
US7532231B2 (en) Video conference recorder
RU2610451C2 (ru) Способ, устройство и система записи видеоконференции
JP4702397B2 (ja) コンテンツサーバ、情報処理装置、ネットワーク機器、コンテンツ配信方法、情報処理方法およびコンテンツ配信システム
WO2007082433A1 (fr) Appareil, dispositif de réseau et procédé de transmission de signaux audio et vidéo
US9398315B2 (en) Multi-source video clip online assembly
CN101370114A (zh) 视频及音频处理方法、多点控制单元和视频会议系统
WO2011116611A1 (fr) Procédé permettant de lire des données vidéo en vue de réunions par tv
US20080288990A1 (en) Interactive Broadcasting System
JP2007028586A (ja) 対話型マルチメディアコンテンツ制作システム
JP2009502073A (ja) 携帯電話からテレビジョン生放送するためのシステム
WO2012175025A1 (fr) Système de conférence présentée à distance, procédé d'enregistrement et de transmission en différé de la conférence présentée à distance
CN112272281B (zh) 一种区域分布式视频会议系统
WO2015003532A1 (fr) Procédé, dispositif et système d'établissement conférence multimédia
JP5428734B2 (ja) ネットワーク機器、情報処理装置、ストリーム切替方法、情報処理方法、プログラムおよびコンテンツ配信システム
KR102090070B1 (ko) 스트리밍 서버, 클라이언트 단말 및 이를 이용한 av 라이브 스트리밍 시스템
JP2010028232A (ja) 通信制御装置および通信制御方法
JP2003271530A (ja) 通信システム，システム間関連装置，プログラム，及び，記録媒体
JP3760564B2 (ja) テレビ会議システム
JP2002314960A (ja) マルチビュー放送サービスシステム及び、それに関する、装置または方法または記録媒体またはプログラム
JPH10285568A (ja) 会議通信システム
JP5581437B1 (ja) 映像提供システムおよびプロラム
WO2018000953A1 (fr) Procédé de traitement audio et vidéo, appareil, et microphone
JP6324829B2 (ja) 映像提供システムおよびプロラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10826053

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10826053

Country of ref document: EP

Kind code of ref document: A1