WO2012175025A1

WO2012175025A1 - Remotely presented conference system, method for recording and playing back remotely presented conference

Info

Publication number: WO2012175025A1
Application number: PCT/CN2012/077266
Authority: WO
Inventors: 吴衍平
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-06-21
Filing date: 2012-06-20
Publication date: 2012-12-27
Also published as: CN102223515B; CN102223515A

Abstract

Provided are a remotely presented conference system, and a method for recording and playing back a remotely presented conference.The remotely presented conference system includes: an MCU and a recording and broadcasting server, wherein the MCU includes: a configuration module set up to add into a conference the recording and broadcasting server as a remote conference presenting location, and a first connection establishment module set up to initiate one or more calls towards the recording and broadcasting server to establish a communication connection, wherein an establishment message of the call carries spatial information about the position in which a video associated with the communication connection to be established is located;and the recording and broadcasting server includes: a receiving module set up to receive media streams from the MCU, and a storage and recording module set up to store the media streams and record the correlation between various media streams.The technical solution provided by the present invention can ensure natural splicing effects and sound location effects when playing back images.

Description

The present invention relates to the field of communications, and in particular to a method for recording and playing back a telepresence conference system and a telepresence conference. BACKGROUND OF THE INVENTION In the related art, the following methods are generally used for recording and playback of a video conference: One is a recording and playback method based on an analog mode, and FIG. 1 can be specifically seen. As shown in FIG. 1, it is independent of the video conference system (by the Multipoint Control Unit (MCU) 101, the video terminal host 103, the camera 106, the microphone 107, the PC 108, the television 109, the speaker 110, and the display 111. In addition to the composition, a recording and recording system is added, which includes a recording server 102 deployed in the central computer room and an encoder 104 and a decoder 105 deployed in the conference room, which have acquisition, encoding, transmission, storage, and decoding. And playback features. The disadvantages are: the functions of the acquisition/encoding/decoding and the functions of the video conferencing system are duplicated, resulting in functional redundancy and high system configuration cost; the main lecture site cannot be tracked in real time (the conference site is broadcasted during the conference, during the conference, each conference site has May become a broadcast venue). The other is a digital recording and playback method, as shown in Figure 2. As shown in FIG. 2, a set of recording server 202 is added independently of the video conferencing system (consisting of MCU 201, video terminal host 203, camera 206, microphone 207, PC 208, television 209, speaker 210, display 211). The recording server needs to be digitally connected to the MCU and the venue terminal. During recording, according to the interaction signaling with the multipoint control unit (MCU), receiving the multimedia information sent by the MCU and storing it; during playback, according to the interaction signaling with the terminal, sending the stored multimedia information to the terminal, The terminal plays back. The advantages are: complementing the functions of the video conference system, and only realizing the functions of multimedia information storage not available in the video conference system; and tracking the lecture site in real time. Due to application and technical limitations, traditional video conferencing systems generally only need to record video, audio, and data content, and are not concerned with other information. The following is a detailed description of the features of the telepresence conferencing system compared to the conventional video conferencing system: The telepresence conferencing system is an advanced video conferencing system, which is characterized by the fact that there are multiple video terminal hosts in the venue; Multiple directly or indirectly connected to these video terminal hosts Audio and video capture devices, a dedicated telepresence camera, multiple audio and video output devices, a centrally controlled touch screen, multiple desktop LCD displays, and dedicated conference tables and chairs. Figure 3 shows a typical three-screen telepresence site (the terminal host is not shown in Figure 3). The communication entities in the existing telepresence conference system are generally composed of several video terminals complying with the ITU-T H.323 protocol (for example, for a three-screen telepresence conference site, generally including three video terminals), these terminals and telepresence MCUs. Communicate according to the ITU-T H.323 protocol. The images of the remote presentation camera output have a spatial arrangement relationship. At the same time, the sounds collected by multiple microphones also have positional properties, and the images and sounds have a spatial relationship. However, in the telepresence conference system, the recording and playback scheme of the conventional video conference system cannot guarantee the natural stitching effect and the sound recognition effect of the image during playback. SUMMARY OF THE INVENTION The present invention provides a remote presentation conference system, a remote presentation conference recording and playback method, to at least solve the related art in a telepresence conference system, using a conventional video conference system recording and playback scheme, can not guarantee playback The natural stitching effect of the image and the problem of the sound recognition effect. According to one aspect of the invention, a telepresence conferencing system is provided. The telepresence conference system according to the present invention includes: an MCU and a recording server. The MCU includes: a configuration module, configured to add the recording server as a telepresence site to the conference; the first connection establishment module is configured to initiate one or more calls to the recording server to establish a communication connection, where The call setup message carries spatial information of the location of the video associated with the communication connection to be established; the recording server includes: a receiving module configured to receive the media stream from the MCU; and a storage recording module configured to be a storage medium Stream, record the relationship between the various media streams. The association relationship between the media streams includes at least one of the following: a spatial relationship between the video streams; a correspondence between the data streams and the video streams; and a correspondence between the audio streams and the video streams. The foregoing MCU includes: a broadcast module, configured to broadcast a media stream recorded by the recording server according to an association relationship between the media streams in a form of calling a conference. The telepresence conference system further includes: a telepresence conference site; the telepresence conference site includes: a second connection establishment module, configured to establish a point-to-point connection with the recording server; and a presentation module, configured to acquire a record according to an association relationship between the media streams The media stream recorded by the broadcast server is presented. The foregoing second connection establishing module includes: an initiating unit, configured to initiate one or more calls for establishing a connection to the recording server, where the setup message of the call carries a video associated with the communication connection that needs to be established Spatial information of the orientation. The recording server includes: a first sending module, configured to send file list information corresponding to the recorded media stream to one or more of the video terminals; and a second sending module, configured to respond to the user according to the file list information The operation sends a media stream to each video terminal according to an association relationship between the media streams. The communication signaling between the MCU and the recording and recording server, and the communication signaling between the telepresence site and the recording server are signaling based on the H.323 protocol protocol or the IETF SIP protocol. According to another aspect of the present invention, a recording method of a telepresence conference is provided. The recording method of the telepresence conference according to the present invention includes: after the MCU in the telepresence conference system adds the recording server as a telepresence conference site to the conference, the recording server receives one or more initiated from the MCU for establishing a connected call, where the call setup message carries spatial information of the location of the video associated with the communication connection that needs to be established; the recording server receives the media stream from the MCU and stores it, and records between the media streams connection relation. After the MCU is connected to the recording server, the MCU also performs the following processing on the port connected to the recording server: prohibiting the media stream from the recording server from entering the conference mixer; prohibiting the recording server from joining the conference list It is forbidden to notify the remote presentation site in the telepresence conference system of the upper and lower end information of the recording server; and to transfer the main site, the sub-site or the mixed media stream to the recording server. The association relationship between the media streams includes at least one of the following: a spatial relationship between the video streams; a correspondence between the data streams and the video streams; and a correspondence between the audio streams and the video streams. When there are multiple calls, the number of calls is greater than or equal to the number of screens of the telepresence site with the most screens in the conference that needs to be recorded. According to still another aspect of the present invention, a playback method of a telepresence conference is provided. The playback method of the telepresence conference according to the present invention includes: The MCU in the telepresence conference system will broadcast the media stream recorded by the recording server according to the association relationship between the respective recorded media streams by calling the conference. According to still another aspect of the present invention, a playback method of a telepresence conference is provided. The playback method of the telepresence conference according to the present invention includes: establishing a point-to-point connection between the video terminal of the telepresence site in the telepresence conference system and the recording server; and obtaining the recording server according to the association relationship between the recorded media streams by the telepresence site The recorded media stream is presented. The establishing, by the video terminal, the peer-to-peer connection with the recording server includes: the video terminal initiating one or more calls for establishing a connection to the recording server, where the call setup message carries the video associated with the communication connection to be established. Spatial information of the orientation. The remote presentation site obtains the media stream from the recording server, including: the recording server sends the file list information corresponding to the recorded media stream to one or more of the video terminals; and the recording server responds to the user according to the file list information. The selection operation sends a recorded media stream to each video terminal according to the association relationship between the recorded media streams. Through the invention, when the recording and recording server records the media stream, the association relationship between the media streams is recorded, and the recording and playback scheme of the traditional video conference system in the telepresence conference system in the related art is solved, and the image during playback cannot be guaranteed. The natural stitching effect and the problem of the sound recognition effect can ensure the natural stitching effect and the sound recognition effect of the image during playback. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, In the drawings: FIG. 1 is a schematic diagram of an analog-based video conferencing system according to the related art; FIG. 2 is a schematic diagram of a digital-based video conferencing system according to the related art; FIG. 3 is a three-screen remote presentation according to the related art. 4 is a structural block diagram of a telepresence conference system according to an embodiment of the present invention; FIG. 5 is a structural block diagram of a telepresence conference system according to a preferred embodiment of the present invention; FIG. 6 is a telepresence conference according to an example of the present invention. FIG. 7 is a flowchart of a method for recording a telepresence conference according to an embodiment of the present invention; FIG. 8 is a flowchart of a method for recording a telepresence conference according to a preferred embodiment of the present invention; 9 is a flowchart of a playback method of a telepresence conference according to an embodiment of the present invention; and FIG. 10 is a flowchart of an on-demand playback method of a telepresence conference according to a preferred embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. 4 is a structural block diagram of a telepresence conference system in accordance with an embodiment of the present invention. As shown in FIG. 4, the telepresence conference system mainly includes: a multipoint control unit (MCU) 10 and a recording server 20; the MCU 10 further includes: a configuration module 100, configured to add the recording server as a telepresence site The first connection establishing module 102 is configured to initiate one or more calls to the recording server to establish a communication connection, where the setup message of the call carries a video associated with the communication connection that needs to be established. The recording server 20 further includes: a receiving module 200 configured to receive a media stream from the MCU; and a storage recording module 202 configured to store the media stream and record an association relationship between the media streams. The association relationship between the foregoing media streams includes, but is not limited to, at least one of the following: a spatial relationship between the video streams; a correspondence between the data stream and the video stream; and a correspondence between the audio stream and the video stream. In the telepresence conference system, the images of the remote presentation cameras are spatially arranged. At the same time, the sounds collected by the multiple microphones also have positional properties, and the images and sounds have spatial correspondences. In the telepresence conference system, the recording and playback scheme of the traditional video conference system cannot guarantee the natural stitching effect and the sound recognition effect of the image during playback. In the telepresence conference system shown in FIG. 4, the MCU 10 carries the spatial information of the location of the video associated with the communication connection to be established in the call setup message, and sends the information to the recording server. The recording server not only needs to store the media stream. , you also need to record the relationship between the various media streams. Thereby, the natural stitching effect and the sound recognition effect of the image during playback can be ensured. It should be noted that the MCU 10 can be considered as a collection of multiple conferences held thereon. Each conference includes multiple telepresence sites, and each telepresence site includes several video terminals. The upper end process of a telepresence site in a conference means that the MCU establishes a connection with several video terminals of the telepresence site in the conference. At the same time, the recording server can be considered as a collection of several independent telepresence venues. In each conference that needs to be recorded, the recording server is added to the conference as a telepresence venue. The telepresence site package Contains several video terminals that are virtualized by the recording server. The upper end process of the telepresence site means a process of establishing a connection between the MCU and a plurality of video terminals virtualized by the recording server. After the conference starts, the MCU 10 initiates multiple calls to the recording server 20, and binds the communication connections established by the multiple calls to one communication port to indicate that the connections belong to a remote presentation site. After the recording server and the normal upper end of each site, the MCU can perform the following processing on the port connected to the recording server:

(1) prohibiting the media stream from the recording server from entering the conference mixer;

(2) It is forbidden to add the recording server to the site list;

(3) It is forbidden to notify the remote presentation site in the telepresence conference system of the upper and lower end information of the recording server;

(4) Transfer the main site, the breakout site, or the mixed media stream to the recording server. Although the recording server is added to the conference as a telepresence venue, it is not equivalent to telepresencing the venue. During the conference, media streams from the recording server should be prevented from entering the conference mixer, thus interfering with the normal operation of the conference. Of course, in the telepresence conference system, multiple video terminals in the remote presentation site can physically correspond to one device. Further, the physical device may have many changes in the communication protocol. For example, the communication between the physical device and the MCU and the communication with the recording server are no longer represented by multiple signaling interaction processes, but only as one letter. make. Similarly, the recording and playback signaling of the solution can also adopt a signaling manner. When there are multiple calls (ie, recording and playback signaling is not in a signaling manner, each call carries spatial information of the location of the video associated with the communication connection that needs to be established), then the call The number should be greater than or equal to the number of screens in the telepresence site with the most screens in the conference that needs to be recorded. Only when the above conditions are met, the spatial information of the orientation in which the video associated with the communication connection to be established is located can be completely transmitted to the recording server. The natural complete stitching effect of the image can be guaranteed during playback. For telepresence conferencing systems based on the H.323 protocol, the above calls follow the H.323 protocol procedure. Similarly, when a telepresence site needs to play back the content stored in the recording server, it also communicates with several video terminals virtualized by the recording server using a communication method conforming to the H.323 protocol. Of course, it is not limited to the H.323 protocol procedure, but other protocol procedures can also be used, for example, the IETF SIP protocol procedure. For the way of playback, there are two situations. One is to convene a conference through the MCU. The MCU broadcasts the recording server and switches the video and audio data stream sent by the recording server to other sites. It can be understood that this process is equivalent to the reverse process of the recording process; preferably, As shown in FIG. 5, the MCU 10 may further include: a broadcast module 104, configured to broadcast a media stream recorded by the recording and recording server in a form of calling a conference. The other is to use the site on-demand method, and the video terminal of the telepresence site communicates with the recording server to establish a point-to-point connection to receive the recorded media and present it on a multimedia output device such as a TV/speaker/display. Preferably, as shown in FIG. 5, the telepresence conference system may further include: a telepresence conference site 30; the telepresence conference site 30 includes: a second connection establishment module 300, configured to establish a point-to-point connection with the recording server; Set to get the media stream recorded by the recording server and render. Preferably, the second connection establishing module 300 may further include: an initiating unit 3000 (not shown in FIG. 5) configured to initiate one or more calls for establishing a connection to the recording server, wherein the call establishment message It carries spatial information about the location of the video associated with the communication connection that needs to be established. Preferably, as shown in FIG. 5, the recording and recording server 20 may further include: a first sending module 204, configured to send file list information corresponding to the recorded media stream to one or more of the video terminals; The module 206 is configured to send the recorded media stream to each video terminal according to the association relationship between the recorded media streams in response to the user performing a selection operation according to the file list information. During the playback process, the recording server can also receive and respond to instructions such as fast forward and rewind from one or more video terminals. In the specific implementation process, the playback process may be implemented directly by using the communication terminal device in the telepresence site, or may be implemented by other methods, for example, using PC software. Preferably, the communication signaling between the MCU 10 and the recording server 20, and the communication signaling between the telepresence conference site 30 and the recording server 20 may be a letter extended based on the H.323 protocol protocol or the IETF SIP protocol protocol. make. Of course, it can also be signaling that is extended based on other protocol procedures. The above preferred embodiment is further described below in conjunction with the example shown in FIG. 6. 6 is a schematic diagram of a telepresence conference system in accordance with an example of the present invention. As shown in FIG. 6, the system includes: a plurality of telepresence conference venues, a telepresence conference office system, and a recording system. Among them, each venue includes: (1) The camera group 606 includes three cameras, which are set to capture images of local venue participants;

(2) The microphone group 607, which includes four microphones, is set to collect audio information of the local site;

(3) PC group 608, including 1~3 PCs, as the conference dual-stream data source;

(4) TV group 609, including 3 TVs, set to display remote image information; (5) Speaker group 610, including 2 speakers, set to output conference stereo audio information;

(6) The desktop LCD panel 611, which contains 3 LCD monitors, is set to display dual stream data. It can be understood that in addition to the above devices, other devices or systems for providing a sense of presence of the conference, such as lighting, venue decoration, etc., can be deployed. The remote presentation conference central office system, including the MCU 601 and its management system (not shown in FIG. 6) (1) MCU 601, implements multipoint conference control, and broadcasts and exchanges media streams (video and audio) of each venue. And mixing, is the core equipment of the entire conference system;

(2) Management system, providing the human-machine interface of the central management personnel. The recording and broadcasting system includes a recording server 602 and a management system thereof (not shown in FIG. 6).

(1) The recording server 602 interacts with the MCU 401 and the video terminal host 622 624 of the remote presentation site (interfaces 612, 613) to implement multimedia content storage and live broadcast on demand;

(2) Management system: Provide the man-machine interface of the recording server administrator to realize system configuration, program editing, and so on. The following describes the recording and playing back of the telepresence conference in which the pure three-screen telepresence site participates, and the above preferred embodiment is specifically described with reference to FIG. 6. It should be noted that other conference networking situations that are not represented by a pure three-screen telepresence site can be recorded and played back by referring to the following methods.

1. The conference is configured. The Wang administrator configures the recording server address on the management system of the MCU 601, and then defines a telepresence conference that needs to be recorded by the pure three-screen telepresence site, and then goes to the MCU 601. After sending this configuration, the start conference command is released.

2, recorded over Wo (1) Communication connection establishment process

After receiving the notification from the administrator, the MCU 601 successively initiates three H.225.0 Q.931 calls conforming to the H.323 protocol procedure to the recording server 602. In the setup message of the call, according to the message extension mechanism defined by the H.225.0 Q.931 protocol, a video related to the communication connection to be established by the call is added in the call setup message (setup.sourcelnfo.nonStandardData.Data message) Spatial information of the left, center, and right directions. Thereafter, the MCU 601 establishes a communication connection with the recording server according to the normal procedure of H.323.

(2) Conference control process After the recording server and the normal upper end of each site, the MCU 401 needs to process the port of the connected recording server 602 as follows:

(2.1) The audio signal transmitted from the recording server is not allowed to enter the conference mixer;

(2.2) Do not receive the video signal transmitted from the recording server, nor allow other sites or administrators to broadcast/select/switch the video signal sent by the recording server;

(2.3) Do not put the telepresence site represented by the recording server into the site list, and do not notify other sites of the upper and lower end of the site;

(2.4) The MCU sends a sub-site or main venue or the mixed audio and video data media stream to the recording server according to the H.323 normal procedure or other procedures according to the conference control policy.

(3) The stored procedure recording server receives and stores the media streams sent from the three connections, and records the relationship between the media streams, for example, the spatial relationship between the video streams, the correspondence between the data streams and the video streams. Relationships, correspondences between audio streams and video streams, and the like.

3. The playback process is mainly divided into two situations. One is to call the conference through the MCU. The MCU broadcasts the broadcast server and switches the video and audio data stream sent by the recording server to other sites. It can be understood that this process is equivalent to The reverse process of the recording process; the other is to use the site on-demand method, and the video terminal of the telepresence site communicates with the recording server to establish a point-to-point connection to receive the recorded media and present it on a multimedia output device such as a TV/speaker/display. The communication connection establishment process of the latter playback mode will be described in detail below. After receiving the notification from the administrator, the three video terminals (622-624) of the telepresence site respectively initiate H.225.0 Q.931 calls to the recording server in accordance with the H.323 protocol procedure or other protocol procedures. Mouth 4. In the setup message of the call, according to the message extension mechanism defined by the H.225.0 Q.931 protocol, in the call setup message (setup.sourcelnfo.nonStandardData.Data message), the video corresponding to the communication connection to be established by the call is added. Left, center and right space information. After receiving all the calls, the recording server 602 sends a file list video of the stored content to one or more predetermined video terminals (for example, a three-screen telepresence venue, an agreement intermediate video terminal 623) according to a system pre-agreed, And receive user selection. After determining that the content selected by the user is also a three-screen remote presentation site conference recording content, different media streams are sent to different video terminals according to the stored relationship between the stored media streams. During the playback process, the recording server can also accept and respond to instructions such as fast forward and rewind from the particular video terminal. According to an embodiment of the present invention, based on the above-described telepresence conference system, a recording method of a telepresence conference is also provided. 7 is a flow chart of a method of recording a telepresence conference in accordance with an embodiment of the present invention. As shown in FIG. 7, the recording method of the telepresence conference includes the following processing: Step S702: After the MCU in the telepresence conference system adds the recording server as a telepresence conference site to the conference, the recording server receives the origination from the MCU. One or more call ports for establishing a connection, wherein the setup message of the call carries spatial information of the location of the video associated with the communication connection that needs to be established; Step S704: The recording server receives the information from the MCU The media stream is stored and recorded, and the relationship between the media streams is recorded. The association relationship between the media streams includes, but is not limited to, at least one of the following: a spatial relationship between the video streams; a correspondence between the data streams and the video streams; and a correspondence between the audio streams and the video streams. In the telepresence conference method shown in FIG. 7, the MCU carries the spatial information of the location of the video associated with the communication connection to be established in the call setup message, and sends the information to the recording server. The recording server not only needs to store the media stream. , you also need to record the relationship between the various media streams. Thereby, the natural stitching effect and the sound recognition effect of the image during playback can be ensured. Preferably, after the MCU establishes a connection with the recording server, the MCU processes the port connected to the recording server, and the specific processing is as follows:

(2) It is forbidden to add the recording server to the site list; (3) It is forbidden to notify the remote presentation site in the telepresence conference system of the upper and lower end information of the recording server;

(4) Transfer the main site, the breakout site, or the mixed media stream to the recording server. When there are multiple calls (ie, recording and playback signaling is not in a signaling manner, each call carries spatial information of the location of the video associated with the communication connection that needs to be established), then the call The number should be greater than or equal to the number of screens in the telepresence site with the most screens in the conference that needs to be recorded. Only when the above conditions are met, the spatial information of the orientation in which the video associated with the communication connection to be established is located can be completely transmitted to the recording server. The natural complete stitching effect of the image can be guaranteed during playback. Of course, in the telepresence conference system, multiple video terminals in the remote presentation site can physically correspond to one device. Further, the physical device may have many changes in the communication protocol. For example, the communication between the physical device and the MCU and the communication with the recording server are no longer represented by multiple signaling interaction processes, but only as one letter. make. Similarly, the recording and playback signaling of the solution can also adopt a signaling manner. For telepresence conferencing systems based on the H.323 protocol, the above calls follow the H.323 protocol procedure. In the same way, when a remote presentation site needs to play back the content stored in the recording server, it also communicates with several video communication terminals virtualized by the recording server by using the communication method conforming to the H.323 protocol. In the above recording and playback, the communication signaling between the MCU and the recording server, the recording server, and the telepresence site may be extended by the message extension mechanism specified by the H.323 protocol. Of course, it is not limited to the above H.323 protocol procedures, but other protocol procedures, such as the IETF SIP protocol procedures, may also be employed. The above preferred implementation process is further described below in conjunction with FIG. 8 is a flow chart of a method of recording a telepresence conference in accordance with a preferred embodiment of the present invention. As shown in FIG. 8, the recording method of the telepresence conference mainly includes the following processing: Step S802: The MCU adds the recording server as a telepresence conference site to the conference; Step S804: The MCU calls each site, and the recording server serves as a special telepresence site, and initiates one or more calls to the recording server to establish a communication connection. Step S806: After the call is successful, send the current broadcast site media stream to Recording the server, and indicating the association relationship between the media streams; Step S808: The recording server stores the media stream according to the foregoing indication, and records the association relationship between the media streams. Step S810: The conference ends, and the recording server responds to the administrator operation instruction, edits and publishes the recorded media stream, and waits for the user to order. According to an embodiment of the present invention, based on the telepresence conference system described above, a playback method of a telepresence conference is also provided. The method mainly includes: The MCU in the remote presentation conference system broadcasts the media stream recorded by the recording server according to the association relationship between the recorded media streams by calling the conference. It should be noted that this playback process is equivalent to the reverse process of the above recording process. Since the media stream recorded by the recording server is broadcast according to the association relationship between the media streams mentioned above during playback, the natural image during playback can be guaranteed. Stitching effect and listening sound recognition effect. According to an embodiment of the present invention, based on the above-described telepresence conference system, another playback method of the telepresence conference is also provided. 9 is a flow chart of a method of playing back a telepresence conference in accordance with an embodiment of the present invention. As shown in FIG. 9, the playback method of the telepresence conference mainly includes the following processes: Step S902: The video terminal of the telepresence site in the telepresence conference system establishes a point-to-point connection with the recording server; Step S904: The remote presentation site is recorded according to the The association between the media streams obtains the media stream recorded by the recording server and is presented. During playback, the telepresence site obtains the media stream recorded by the recording server according to the relationship between the recorded media streams, which can ensure the natural stitching effect and the sound recognition effect of the image during playback. Preferably, the foregoing step S902 may further include the following steps: the video terminal initiates one or more calls for establishing a connection to the recording server, where the call setup message carries the video associated with the communication connection that needs to be established. Spatial information of the orientation. Preferably, the above step S904 may further include the following processing:

(1) the recording server sends the file list information corresponding to the recorded media stream to one or more of the video terminals;

(2) The recording server responds to the user's selection operation according to the file list information, and transmits the recorded media stream to each video terminal according to the association relationship between the recorded media streams. An on-demand playback method of a telepresence conference is further described below in conjunction with FIG. 10 is a flow chart of a method of on-demand playback of a telepresence conference in accordance with a preferred embodiment of the present invention. As shown in FIG. 10, the on-demand playback method of the telepresence conference mainly includes the following processes: Step 1002: The remote presentation site responds to an administrator operation instruction, and needs to initiate a call to the recording server. Step 1004: Remotely present the video terminals of the conference site to initiate a call Recording the call of the server, and carrying the call setup message carrying the spatial information (for example, the location identifier) of the location of the video associated with the communication connection to be established; Step 1006: The recording server receives the call and according to the call The parameter determines the type of the caller's site, and sends a corresponding media stream to each video terminal according to the association relationship between the recorded media streams. Step 1008: The remote presentation site video terminal presents the media stream on the multimedia device according to the requirements of time and space. In summary, with the above embodiments provided by the present invention, recording and playback of a telepresence conference can be realized. The recorded content not only contains multimedia content (media stream) in the conference room, but also records the relationship between them (for example, time and space relationship), thereby ensuring the true restoration possibility of the conference scene during playback. In addition, the existing video conference recording server can record telepresence conferences through simple software upgrades, which can effectively save and protect user investment. Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device so that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A telepresence conference system, comprising: a multipoint control unit MCU and a recording server;

The MCU includes:

a configuration module, configured to add the recording server as a telepresence site to the conference; a first connection establishment module, configured to initiate one or more calls to the recording server to establish a communication connection, where the call is The setup message carries spatial information of the location of the video associated with the communication connection that needs to be established;

The recording server includes:

a receiving module, configured to receive a media stream from the MCU;

And a storage recording module, configured to store the media stream, and record an association relationship between the media streams.

2. The system according to claim 1, wherein the association relationship between each of the media streams comprises at least one of the following:

The spatial relationship between video streams;

Correspondence between data stream and video stream;

Correspondence between audio stream and video stream.

3. The system according to claim 1, wherein the MCU comprises:

The broadcast module is configured to broadcast the media stream recorded by the recording server according to an association relationship between the media streams in a form of calling a conference.

The system of claim 1, wherein the telepresence conference system further comprises: a remote presentation venue; the telepresence venue includes:

And a second connection establishing module, configured to establish a point-to-point connection with the recording server, and obtain a presentation module, configured to acquire and display the media stream recorded by the recording server according to the association relationship between the media streams.

The system according to claim 4, wherein the second connection establishing module comprises: The initiating unit is configured to initiate one or more calls for establishing a connection to the recording server, where the setup message of the call carries spatial information of the location of the video associated with the communication connection that needs to be established. The system according to claim 4, wherein the recording server comprises:

a first sending module, configured to send, to one or more of the video terminals, file list information corresponding to the recorded media stream;

And a second sending module, configured to send the media stream to each of the video terminals according to an association relationship between the media streams in response to a selection operation performed by the user according to the file list information. The system according to claim 4, wherein communication signaling between the MCU and the recording server, and communication signaling between the remote presentation site and the recording server are based on H.323 Extended protocol signaling by protocol procedures or IETF SIP protocol procedures. A remote presentation conference recording method, the remote presentation conference system according to any one of claims 1 to 7, comprising:

After the multipoint control unit MCU in the telepresence conference system adds the recording server as a telepresence conference site to the conference, the recording server receives one or more initiated connections from the MCU for establishing a connection. a call, where the setup message of the call carries spatial information of an orientation of a video associated with a communication connection that needs to be established;

The recording server receives and stores the media stream from the MCU, and records an association relationship between the respective media streams. The method according to claim 8, wherein, after the MCU establishes a connection with the recording server, the method further comprises: the MCU performing the following processing on a port connected to the recording server:

Prohibiting the media stream from the recording server from entering the conference mixer;

It is forbidden to add the recording server to the site list.

Disabling the upper and lower end information of the recording server to notify the telepresence conference site in the telepresence conference system;

The main site, the sub-site, or the mixed media stream is transmitted to the recording server. The method according to claim 8, wherein the association relationship between each of the media streams comprises at least one of the following:

The spatial relationship between video streams; Correspondence between data stream and video stream;

Correspondence between audio stream and video stream.

The method according to claim 8, wherein, when the number of the calls is plural, the number of the calls is greater than a number of screens of the telepresence site having the most screens among the conferences to be recorded.

A method of playing back a remote presentation conference, the remote presentation conference system according to any one of claims 1 to 7, comprising:

The multipoint control unit MCU in the telepresence conference system broadcasts the media stream recorded by the recording server according to the association relationship between the respective recorded media streams in the form of a conference.

The video terminal of the telepresence site in the telepresence conference system establishes a point-to-point connection with the recording server;

The telepresence site acquires and presents the media stream recorded by the recording server according to the association relationship between the recorded media streams.

14. The method of claim 13, wherein establishing the point-to-point connection between the video terminal and the recording server comprises:

The video terminal initiates one or more calls for establishing a connection to the recording server, wherein the setup message of the call carries spatial information of the location of the video associated with the communication connection that needs to be established.

The method of claim 13, wherein the remotely presenting the venue to obtain the media stream from the recording server comprises:

Transmitting, by the recording and playing server, file list information corresponding to the recorded media stream to one or more of the video terminals;

And the recording and recording server sends the recorded media stream to each of the video terminals according to the association relationship between the recorded media streams in response to a selection operation performed by the user according to the file list information.