WO2014044059A1 - 一种视频会议录播的方法、设备及系统 - Google Patents
一种视频会议录播的方法、设备及系统 Download PDFInfo
- Publication number
- WO2014044059A1 WO2014044059A1 PCT/CN2013/076642 CN2013076642W WO2014044059A1 WO 2014044059 A1 WO2014044059 A1 WO 2014044059A1 CN 2013076642 W CN2013076642 W CN 2013076642W WO 2014044059 A1 WO2014044059 A1 WO 2014044059A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- site
- sub
- streaming media
- screen
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 5
- 239000002131 composite material Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1831—Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/567—Multimedia conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Definitions
- the present invention relates to the field of communications, and in particular, to a method, device, and system for video conference recording and broadcasting.
- the embodiment of the invention provides a method, a device and a system for video conference recording and broadcasting, which can realize the video playback of the conference video according to the needs of the user in the middle of the video conference.
- An aspect of the embodiments of the present invention provides a video conference recording and broadcasting method, including: receiving a playback request message input by a user.
- the playback request message is sent to the recording server, so that the recording server selects the recorded streaming media information according to the playback request message.
- the receiving a playback request message input by a user includes:
- the user terminal display area includes at least one sub-picture, and each of the sub-pictures is used to display an image outputting a conference site.
- the playback request message includes the streaming media identification information and the playback location information, and the streaming media identification information includes the site identification information of the conference site or the sub-screen flag information corresponding to the conference site;
- the recording and recording server selects a site to be played back according to the streaming media identification information, and selects streaming media information that needs to be played back from the recorded streaming media information of the site according to the playback location information.
- the method further includes: receiving the streaming media identification information sent by the recording and playing server.
- the first sub-screen of the user terminal display area displays the received first streaming media information corresponding to the first sub-picture flag information or the site identification information of the first site;
- the streaming media identification information is the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen, displaying, in the user terminal display area, the output received and the first sub-picture flag Information or the first streaming media information corresponding to the site identification information of the first site; or
- the streaming media identification information includes the first sub-picture flag information or the first sub-picture pair
- the first sub-screen display area of the user terminal display area outputs the received and received The first sub-picture mark information or the first streaming media information corresponding to the site identification information of the first site, and simultaneously outputting the received second and the second sub-pictures in the second sub-picture display area of the user terminal
- the second stream information corresponding to the screen flag information or the site identifier information of the second site.
- the streaming media information includes at least one of video information, audio information, picture information, and subtitle information.
- Another aspect of the embodiments of the present invention provides a video conference recording and broadcasting method, including: acquiring a playback request message.
- the streaming media information is selected according to the playback request message.
- the at least one channel of the selected streaming media information is combined into a combined code stream, where the one channel of the media information corresponds to one site.
- the combined code stream is transmitted to at least one user terminal.
- the acquiring a playback request message includes:
- the recording server display area includes at least one sub-picture, and each of the sub-pictures is used to display an image outputting a conference site.
- the method further includes:
- the playback request message includes the streaming media identification information and the playback location information, and the streaming media identification information includes the site identification information of the conference site or the sub-screen flag information corresponding to the conference site;
- the selecting the streaming media information according to the playback request message is specifically:
- the site to be played back is selected according to the streaming media identification information, and the streaming media information that needs to be played back is selected from the recorded streaming media information of the site according to the playback location information.
- the method further includes:
- the streaming media information included in the combined code stream that is selected by the display output includes: when the streaming media identification information includes the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen, And displaying, by the first sub-screen of the display area of the recording server, the first streaming media information corresponding to the first sub-screen flag information or the site identification information of the first site; or
- the streaming media identification information is the first sub-screen flag information or the site identification information of the first site corresponding to the first sub-screen, displaying, in the recording server display area, the output selected and the first sub-screen The flag information or the site identification letter of the first site, and the corresponding first stream media information; or
- the streaming media identification information includes the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen and the second sub-screen flag information or the site identification information of the second site corresponding to the second sub-screen And displaying the first streaming media information corresponding to the first sub-screen flag information or the site identification information of the first site selected by the first sub-screen of the recording server display area, and simultaneously recording the The second sub-screen synchronization information of the broadcast server display area is outputted to output the second streaming media information corresponding to the second sub-picture flag information or the site identification information of the second site.
- the streaming media information includes at least one of video information, audio information, picture information, and subtitle information.
- a user terminal including:
- a receiver configured to receive a playback request message input by a user.
- a transmitter configured to send the playback request message to the recording server, so that the recording server selects the recorded streaming media information according to the playback request message.
- the receiver is further configured to receive a combined code stream sent by the recording server, where the combined code stream includes at least one selected piece of streaming media information, where the one channel of the streaming media information corresponds to a site.
- the user terminal display area is configured to display and output streaming media information included in the combined code stream.
- the receiver is also used to:
- the user terminal display area includes at least one sub-picture, and each of the sub-pictures is used to display an image outputting a conference site.
- the playback request message includes the streaming media identification information and the playback location information, and the streaming media identification information includes the site identification information of the conference site or the sub-screen flag information corresponding to the conference site;
- the recording and recording server selects a site to be played back according to the streaming media identification information, and selects streaming media information that needs to be played back from the recorded streaming media information of the site according to the playback location information.
- the user terminal display area is further configured to:
- the first sub-screen display area of the user terminal display area outputs the received and the The first sub-picture flag information or the first streaming media information corresponding to the site identification information of the first site; or
- the streaming media identification information is the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen, displaying, in the user terminal display area, the output received and the first sub-picture flag Information or the first streaming media information corresponding to the site identification information of the first site; or
- the streaming media identification information includes the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen and the second sub-screen flag information or the site identification information of the second site corresponding to the second sub-screen
- the first sub-screen of the display area of the user terminal the first streaming media information corresponding to the first sub-screen flag information or the site identifier information of the first site, and the user terminal
- the second sub-screen synchronization display of the display area outputs the received second streaming media information corresponding to the second sub-screen flag information or the site identification information of the second site.
- a recording and playback server including: a receiver, configured to acquire a playback request message.
- a processor configured to select, according to the playback request message, streaming media information.
- the processor is further configured to combine the selected at least one channel of the streaming media information into a combined code stream, where the one channel of the media information corresponds to one site.
- a transmitter configured to send the combined code stream to the at least one user terminal.
- the receiver is also used to:
- the recording server display area includes at least one sub-picture, and each of the sub-pictures is used to display a real-time image outputting a conference site.
- the playback request message includes the streaming media identification information and the playback location information, and the streaming media identification information includes the site identification information of the conference site or the sub-screen flag information corresponding to the conference site;
- the processor is specifically configured to:
- the site to be played back is selected according to the streaming media identification information, and the streaming media information that needs to be played back is selected from the recorded streaming media information of the site according to the playback location information.
- the recording server display area is also used to:
- the first sub-screen display area of the recording server display area outputs the selected location Decoding the first sub-screen flag information or the first streaming media information corresponding to the site identifier information of the first site;
- the streaming media identification information is the first sub-screen flag information or the site identification information of the first site corresponding to the first sub-screen, displaying, in the recording server display area, the output selected and the first sub-screen The flag information or the site identification letter of the first site, corresponding to the first streaming media information; or
- the streaming media identification information includes the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen and the second sub-screen flag information or the site identification information of the second site corresponding to the second sub-screen And displaying the first streaming media information corresponding to the first sub-screen flag information or the site identification information of the first site selected by the first sub-screen of the recording server display area, and simultaneously recording the Broadcast server display
- the second sub-picture information of the display area is displayed in synchronization with the second sub-media information corresponding to the second sub-picture flag information or the site identification information of the second site.
- a video conference recording and broadcasting system including: at least one user terminal as described above, and a recording server as described above.
- the method, device and system for recording and broadcasting a video conference receive a playback request message input by a user, and send the playback request message to the recording and playback server, and the recording and playback server can select the streaming media information according to the playback request message.
- the user terminal After receiving the combined code stream sent by the recording and recording server, the user terminal displays and outputs the received at least one piece of streaming media information, where the combined code stream includes at least one channel of streaming media information, and one channel of the streaming media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- FIG. 1 is a schematic flowchart of a video conference recording and broadcasting method according to an embodiment of the present invention
- FIG. 2 is a schematic flowchart of another video conference recording and broadcasting method according to an embodiment of the present invention
- FIG. 4 is a schematic diagram of a display screen of a user terminal according to an embodiment of the present invention
- FIG. 5 is a schematic diagram of a display screen of another user terminal according to an embodiment of the present invention
- FIG. 6 is a schematic diagram of another user terminal according to an embodiment of the present invention
- FIG. 7 is a schematic diagram of a display screen of another user terminal according to an embodiment of the present invention
- FIG. 8 is a schematic diagram of a display screen of another user terminal according to an embodiment of the present invention.
- Schematic diagram of a user terminal
- FIG. 10 is a schematic structural diagram of another user terminal according to an embodiment of the present invention
- FIG. 11 is a schematic structural diagram of a recording and playback server according to an embodiment of the present invention
- FIG. 12 is a schematic structural diagram of another recording and recording server according to an embodiment of the present invention
- FIG. 13 is a schematic structural diagram of a video conference recording and broadcasting system according to an embodiment of the present invention.
- the video conference recording and broadcasting method provided by the embodiment of the present invention relates to a user terminal, as shown in FIG. 1 , including:
- the user terminal receives a playback request message input by a user.
- the playback request message may include the streaming media identification information and the playback location information, where the streaming media identification information may further include the site identification information of the conference site or the sub-screen flag information corresponding to the conference site.
- the recording and recording server may select a site to be played back according to the media identification information, and select, according to the playback location information, the streaming media information that needs to be played back from the recorded streaming media information of the site.
- users participating in the video conference can be divided into multiple different conference sites.
- Each user's user terminal has multiple sub-screens on the display screen, and each sub-picture corresponds to one conference site.
- the streaming media identification information of the target site and the playback location information of the desired playback session may be selected by using a remote controller or a touch screen.
- the user terminal sends the playback request message to the recording server, so that the recording server selects the recorded streaming media information according to the playback request message.
- the user terminal receives a combined code stream sent by the recording server, where the combined code stream includes at least one selected streaming media information, and one channel of the streaming media information corresponds to one site.
- the streaming identification information of the two sites is selected in the input playback request message, and the required playback location information is selected, and the recording server obtains the playback.
- the streaming media identification information finds the video of the corresponding two sites, and extracts the video from the corresponding time point according to the playing position information, and combines the selected two pieces of streaming media information into one combined code stream and sends the request to the requesting User terminal.
- the user terminal displays the streaming media information included in the received combined code stream.
- the streaming media information may specifically include at least one of video information, audio information, picture information, and subtitle information.
- the video conference recording and broadcasting method receives the playback request message input by the user, and sends the playback request message to the recording and playing server, and the recording and playing server can select the streaming media information according to the playback request message, where the user terminal is And after receiving the one-way combined code stream sent by the recording and recording server, displaying the outputted at least one piece of streaming media information, where the combined code stream includes at least one channel of streaming media information, and one channel of the streaming media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- the video conference recording and broadcasting method relates to a recording and playing server, as shown in FIG. 2, including:
- the recording server acquires a playback request message.
- the recording and receiving server may receive the playback request message sent by the at least one user terminal, or when the recording server has the display area, the recording and playing server may obtain a playback request message input by the user in the display area of the recording server, and the recording and broadcasting message
- the server display area includes at least one sub-picture, and each sub-picture is used to display and output a real-time image of a site.
- the process of the recording server acquiring the playback request message input by the user in the recording server display area may refer to the process of the user terminal receiving the playback request message input by the user.
- the recording and playback server selects the streaming media information according to the playback request message.
- the playback request message may include the streaming media identification information and the playback location information, where the streaming media identification information may further include the site identification information of the conference site or the sub-screen flag information corresponding to the conference site.
- the recording and recording server may select a site to be played back according to the streaming media identification information, and select, according to the playback location information, the streaming media information that needs to be played back from the recorded streaming media information of the site.
- recording The server may select a site screen that needs to be recorded and played back according to the streaming media identification information.
- the recording and playback server may determine the starting point of the historical screen that needs to be recorded and played back according to the playback location information.
- the recording and recording server combines the selected ones of the at least one streaming media information into one combined code stream, and one channel of the streaming media information corresponds to one site.
- the recording server sends the combined code stream to at least one user terminal.
- the streaming media information may specifically include at least one of video information, audio information, picture information, and subtitle information.
- the video conference recording and broadcasting method receives the playback request message input by the user, and sends the playback request message to the recording and playing server, and the recording and playing server can select the streaming media information according to the playback request message, where the user terminal is And after receiving the one-way combined code stream sent by the recording and recording server, displaying the outputted at least one piece of streaming media information, where the combined code stream includes at least one channel of streaming media information, and one channel of the streaming media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- the video conference recording and broadcasting method of the embodiment of the present invention includes:
- the recording and receiving server receives the streaming media identification information.
- the user may preset a set of streaming media identification information on the recording server according to historical experience or the number of sites participating in the video conference before the video conference starts, so that the recording server can monitor and record at least one of the streaming media identification information in real time.
- User terminal Or, after the user terminal accesses the conference network, the recording server automatically generates a network topology and obtains the streaming identifier information of all the sites.
- the recording and recording server can also configure a recording policy according to the streaming media identification information. For example, the recording and playback server can select to record the conference video of all user terminals that record the streaming media identification information.
- the recording server sends the streaming identifier information to the at least one user terminal. For example, if the streaming media identification information includes the streaming media identification information of the site 1 to the site 9, respectively, after the user terminal receives the streaming media identification information, the sub-screen corresponding to the site 1 to the site 9 in the display area of the user terminal will be It is on. In this way, the user terminal can quickly and easily understand the information of all the participating venues, and quickly record and record.
- the server establishes a connection, so that the user terminal can select the streaming media information of the site to be played back from all the participating sites according to the streaming media identification information.
- the user terminal sends the conference information to the recording server, so that the recording server updates the streaming identifier information.
- the conference information may be used to indicate whether the current conference site participates in the conference, or may be used to indicate all the streaming media that the current conference venue can provide.
- the user terminal at the initial time of the video conference includes the user terminal of the site 1 to the site 9, the user of the site 9 leaves the conference during the conference, and the user terminal of the site disconnects from each site.
- the terminal will send the conference information to the recording server.
- the user information indicating that the user terminal of the site 9 has been disconnected, or the user of the site 9 rejoins after the user has left the conference for a period of time.
- the user terminal also sends the conference information to the recording server, where the user terminal indicating the site 9 is connected, and the recording server can update the streaming identifier information according to the conference information. In this way, it is possible to prevent the disconnected user terminal from continuing to occupy the resources of the recording server.
- the user terminal collects images and sounds of the site where the user is located, and obtains streaming media information.
- the user terminal can obtain the image information of the site where the user is located by using the camera, and collect the sound information of the site by using the microphone, and superimpose the image information and the sound information at the same time to form a streaming media of the site. information.
- the recording and receiving server receives and saves the streaming media message sent by the at least one user terminal.
- the streaming media information may specifically include at least one of video information, audio information, picture information, and subtitle information.
- the recording server acquires a playback request message.
- the recording and receiving server may receive the playback request message sent by the at least one user terminal, or when the recording server has the display area, the recording and playing server may obtain a playback request message input by the user in the display area of the recording server, and the recording and broadcasting message
- the server display area includes at least one sub-picture, and each sub-picture is used to display and output a real-time image of a site. It should be noted that, for a recording server having a display area, the recording and playing server may select the streaming media information according to the playback request message acquired from the user terminal, and return the selected streaming media information to the requesting user terminal.
- the recording server may select the streaming information according to the playback request message input by the user terminal in the display area of the recording server, and send the selected streaming information to the determined
- the user terminal or playback is performed in the display area of the recording server.
- the process of the recording server acquiring the playback request message input by the user in the recording server display area may refer to the process of the user terminal receiving the playback request message input by the user.
- the playback request message may include the streaming media identification information and the playback location information, and the streaming media identification information may further include the site identification information of the conference site or the parameter.
- the streaming media identification information in the playback request message may be selected from the streaming media identification information obtained by the user terminal, and the streaming media identification information corresponding to the meeting place that needs to be played back, and the recording and playing server may select according to the streaming media identification information.
- the site that needs to be played back is selected from the recorded streaming media information of the site according to the playback location information.
- the recording and playing server selects the streaming media information according to the playback request message.
- the recording and recording server combines the selected ones of the at least one stream media information into one combined code stream, and one channel of the streaming media information corresponds to one site.
- the recording and recording server having the code stream combination function may perform the code stream combination by using the code stream combination module; or the recording and broadcasting server may also send the selected at least one channel of the streaming media information to the conference MCU (multipoint control unit, multiple points). Control unit), the conference MCU can combine at least one stream media information into one code stream.
- the following method may be used to combine the multiple streams of media information to obtain a combined code stream: when the recording server selects at least one channel of the streaming media information, the code stream combination resource is invoked; and the combined multiple stream media information is switched and sent. Decoding to each substream to generate decoding information of the streaming media information; combining the decoding information of each substream into a unified combined code stream, and encoding the combined code stream.
- the recording server selects a multi-stream according to a playback request message input by the user
- the combined subsystem of the recording server will be triggered, and the combined subsystem will issue a composite command to the combined control module.
- the combined control module analyzes the composite command and invokes the combined resource management module to allocate processing resources. If the combined resource management module does not have sufficient resources to perform the code stream combination, the combined control module will report an insufficient resource error to the combined subsystem; if the combined resource management module has sufficient resources, the combined control module invokes the resource.
- the combined control module sends a stream encoder, stream decoder scheduling command to the stream processing control module of the associated processing device for completing the code stream combination in the recording server.
- the stream processing control module of the correlation processing device forwards the scheduling commands to the stream encoding module and the stream decoding module respectively, thereby scheduling the corresponding encoder and decoder.
- the combined control module sends an instruction to the flow switching module instructing it to switch the combined multi-stream media information that needs to be combined to the stream processing module where the stream decoder of each substream of the combined code stream is located.
- the multi-stream media information that needs to be combined can be switched to the stream processing module where the decoder of the sub-picture stream of the video combined picture is located.
- the stream processing module in which the stream decoders of the respective substreams of the combined code stream are located distributes the received stream media information to the stream decoding module.
- the stream decoding module decodes the stream media information code stream to generate decoding information of the stream media information (for example, the decoded information of the video information is the decoded image, and the decoded information of the audio information is the decoded audio data), and then the decoding is performed.
- the subsequent streaming media information is sent to the corresponding stream processing module.
- the stream processing module in which the stream decoder of each substream of the combined code stream is located transmits the received decoded stream media information to the stream processing module in which the encoder of the combined code stream is located.
- the stream processing module distributes the decoded streaming media information to a stream coding module of the combined code stream, and combines the data of each substream into a unified combined code stream, and encodes the combined code stream.
- the unified coded combined code stream is stored inside the recording and broadcasting server, so that the recording server displays the output or transmits the combined code stream information to the user terminal.
- Such a combined code stream may include multi-channel streaming media information that the user clicks on.
- recording and playback of multi-site audio and video information can be realized under the premise of constant bandwidth.
- the recording server displays at least one piece of streaming media information selected for output.
- the streaming media identification information includes the first sub-screen flag information or the site identifier information of the first site corresponding to the first sub-screen
- the first sub-screen display area of the recording server display area is outputted and selected.
- the first sub-screen display output selection in the display area of the recording server when the site identification information of the first site corresponding to the sub-screen and the second sub-screen flag information or the site identification information of the second site corresponding to the second sub-screen
- the recording server can directly play at least one selected streaming media information.
- the user may copy or send at least one streaming media information to the user's other private device through the data interface of the recording server.
- S310 The user terminal receives a combined code stream sent by the recording server, where the combined code stream includes at least one selected streaming media information, and one channel of the streaming media information corresponds to one site.
- the user terminal displays and outputs at least one piece of streaming media information received.
- the first sub-screen display area of the user terminal display area outputs the received and the first The first stream media information corresponding to the site information of the first site; or the site identifier information of the first site corresponding to the first sub-screen Displaying the first streaming media information corresponding to the first sub-screen flag information or the site identification information of the first site received in the display area of the user terminal; or when the streaming media identification letter
- the user terminal displays The first sub-screen of the area displays the received first streaming media information corresponding to the first sub-screen flag information or the site identifier information of the first site, and simultaneously outputs the second sub-screen in the display area of the user terminal.
- second received media information includes the first sub-screen flag information or the site identifier information of the first site corresponding to the first sub-screen
- the user terminal forwards the combined code stream to the other at least one user terminal.
- the video conference recording and broadcasting method receives the playback request message input by the user, and sends the playback request message to the recording and playing server, and the recording and playing server can select the streaming media information according to the playback request message, where the user terminal is And after receiving the one-way combined code stream sent by the recording and recording server, displaying the outputted at least one piece of streaming media information, where the combined code stream includes at least one channel of streaming media information, and one channel of the streaming media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- the sub-screen of the display screen of each user terminal can respectively display the real-time video captured by the user terminals of other sites.
- Each sub-picture has a progress bar indicating the time progress, and the position where the progress bar is located is the current data position.
- the user can request the recording server to record and play back the historical video information through the operation progress bar.
- the user terminal participating in the video conference includes only the local user terminal and the two user terminals located in another remote conference site, only the screen of the other site is displayed on the display screen of the local user terminal.
- the display screen of the local user terminal display is the real time screen of another site.
- the bottom of the screen has a progress bar showing the time, and the position of the progress bar is the current time point.
- the progress bar may be dragged to the left to the historical moment desired to be browsed, and the local user terminal thereby determines that the user inputs the playback request message.
- the local user terminal sends the request message to the recording server, and the recording server according to the recording server
- the request message selects corresponding streaming media information stored in the recording server, and performs the adaptation processing on the selected historical video screen to the local user terminal.
- the local user terminal decodes the received streaming media information and displays it on the display of the local user terminal.
- the streaming media information may include at least one of video information, audio information, picture information, and subtitle information. For example, when the user drags the progress bar to browse the historical video frame of another site, the sound and subtitles will also follow the user's Drag to play back.
- the display screen of the local user terminal is divided into nine different display sub-screens, and the site 1 to the venue 9 are respectively displayed.
- Real-time picture Below each sub-screen there is a progress bar showing the time of each sub-picture, and a global progress bar showing the overall time below the overall picture.
- the global progress bar can be dragged to the left to the historical moment that he wishes to browse, and the local user terminal determines that the user inputs the playback request message.
- the local user terminal sends the request message to the recording and recording server, and the recording and broadcasting server selects corresponding multi-channel streaming media information stored in the recording and playing server according to the request message, and the recording and broadcasting server can combine the multi-way streaming media information into one combined code. Stream and send to the local user terminal.
- the local user terminal decodes the received combined code stream and displays it on the display screen of the local user terminal.
- Each sub-screen displays a history picture of the same historical moment of the corresponding site, as shown in FIG. 6, when the user drags to the left
- the progress bar of all the sub-pictures moves in accordance with the movement of the global progress bar.
- the streaming media information may include at least one of video information, audio information, picture information, and subtitle information.
- the progress bar of the corresponding site may be dragged to the left to the historical moment desired to be browsed, and the local user terminal determines that the user inputs Playback request message.
- the progress bar of the screen 6 can be dragged to the left.
- the local user terminal sends the request message to the recording server, and the recording server according to the recording server
- the request message selects corresponding multi-stream media information stored in the recording server, and the recording server can combine the multi-stream media information into a combined code stream and send it to the local user terminal.
- the sub-picture 6 is configured as the historical video picture of the site 6 requested by the user, and the sub-picture corresponding to the other meeting place is not changed.
- the display screen of the display screen of the local user terminal may be as shown in FIG. 7, wherein the streaming media information may include at least one of video information, audio information, picture information, and subtitle information.
- the progress bar of the sub-screen 6 is located at the historical time selected by the user, and the sub-screen 6 displays the history screen of the site 6, and the other sub-screens have not changed.
- the user can also enlarge the sub-picture 6 to full-screen playback, as shown in Figure 7, which can further improve the user experience.
- the sub-picture 1 and the sub-picture 2 are associated animation surfaces.
- the progress bar of the sub-picture 1 or the sub-picture 2 can be dragged to the left. .
- the local user terminal sends the request message to the recording and recording server, and the recording and broadcasting server selects corresponding multi-channel streaming media information stored in the recording and playing server according to the request message, and the recording and broadcasting server can combine the multi-way streaming media information into one combined code.
- the sub-picture 1 and the sub-picture 2 are configured as historical video pictures requested by the user, and the sub-pictures corresponding to other meeting places are not changed.
- the display screen of the display screen of the local user terminal may be as shown in FIG. 8 , wherein the streaming media information may include at least one of video information, audio information, picture information, and subtitle information.
- the progress bar of sub-picture 1 and sub-picture 2 is located at the historical time selected by the user, and the history pictures of the site 1 and the site 2 are displayed separately, and the other sub-pictures are unchanged.
- the local user terminal may further forward the streaming media information to the user terminals of other sites participating in the conference, so that other sites can simultaneously See this recording playback.
- the video conference recording and broadcasting method receives a playback request message input by a user, and sends the playback request message to a recording and playback server, and the recording and broadcasting server
- the streaming media information may be selected according to the playback request message, and the user terminal displays the received at least one streaming media information after receiving the combined code stream sent by the recording server, where the combined code stream includes at least one channel of streaming media information.
- the streaming media information corresponds to a venue.
- the user terminal 90 provided by the embodiment of the present invention may be used in all the steps in the foregoing method embodiment, and the detailed method steps corresponding to the user terminal 90 are described in the foregoing method embodiment, and are not described here. A detailed description. As shown in Figure 9, it includes:
- the receiver 91 is configured to receive a playback request message input by the user.
- the transmitter 92 is configured to send the playback request message to the recording server, so that the recording server selects the recorded streaming information according to the playback request message.
- the receiver 91 is further configured to receive a combined code stream sent by the recording server, where the combined code stream includes at least one selected streaming media information, and one channel of the streaming media information corresponds to a site.
- the user terminal display area 93 is configured to display and output streaming media information included in the combined code stream.
- the video conference user terminal receives the playback request message input by the user, and sends the playback request message to the recording and playback server, and the recording and playback server can select the streaming media information according to the playback request message, and the user terminal receives the After the combined code stream sent by the recording and playing server, the at least one piece of the streaming media information is outputted, and the combined code stream includes at least one piece of streaming media information, and one channel of the streaming media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- the receiver 91 may further be configured to receive the streaming media identification information sent by the recording server before receiving the playback request message input by the user.
- the sender 92 can also be configured to send the conference information to the recording server, so that the recording server updates the streaming identifier information.
- the conference information may include site information and media indication information of each site.
- the user terminal 90 may further include:
- the information collector 94 is configured to collect images and sounds of the site where the user is located, and obtain streaming media information.
- the sender 92 can also be used to send the streaming media information to the recording server.
- the transmitter 92 can also be used to forward the combined code stream to the other at least one user terminal.
- the receiver 91 can also be configured to receive a playback request message input by the user in the display area of the user terminal.
- the user terminal display area 93 may include at least one sub-picture, each of which is used to display a real-time image outputting a conference site.
- the playback request message may include the streaming media identification information and the playback location information
- the streaming media identification information may further include the site identification information of the conference site or the sub-screen flag information corresponding to the conference site.
- the recording and recording server may select a site to be played back according to the streaming media identification information, and select, according to the playback location information, the streaming media information that needs to be played back from the recorded streaming media information of the site.
- the streaming identifier information may include at least one sub-screen flag information.
- the user terminal display area 93 can also be used to:
- the first sub-screen 931 of the user terminal display area 93 displays the output received and the first sub- The first stream media information corresponding to the screen flag information or the site identifier information of the first site; or
- the user terminal display area 93 displays the output received information and the first sub-screen flag information or the first The first streaming media information corresponding to the site identification information of a site; or
- the streaming media identification information includes the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen and the second sub-screen flag information or the site identification information of the second site corresponding to the second sub-screen
- the first streaming media information corresponding to the first sub-screen flag information or the site identifier information of the first site is outputted, and the second sub-screen 932 of the user terminal display area 93 is synchronously displayed and outputted.
- the second sub-screen information or the second streaming information corresponding to the site identification information of the second site is synchronously displayed and outputted.
- the streaming media information may include at least one of video information, audio information, picture information, and subtitle information.
- the recording and recording server 110 provided by the embodiment of the present invention corresponds to the foregoing method embodiment, and can be used in all the steps in the foregoing method embodiment.
- the detailed method steps corresponding to the recording server 110 are described in the foregoing method embodiment, and More details will be described. As shown in Figure 11, it includes:
- the receiver 111 is configured to acquire a playback request message.
- the processor 112 is configured to select the streaming media information according to the playback request message.
- the processor 112 is further configured to combine the selected at least one stream media information into a combined code stream, where the one channel of the media information corresponds to one site.
- the transmitter 113 is configured to send the combined code stream to at least one user terminal.
- the video conference recording and playback server provided by the embodiment of the present invention receives the playback request message input by the user, and sends the playback request message to the recording and playback server, and the recording and playback server can select the streaming media information according to the playback request message, and the user terminal receives the After the combined code stream sent by the recording server, the at least one channel of the received media information is displayed, where the combined code stream includes at least one channel of media information, and one channel of the stream media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- the receiver 111 may further be configured to receive the streaming identifier information input by the user before receiving the playback request message sent by the at least one user terminal.
- the sender 113 can also be used to send streaming identification information to at least one user terminal.
- the receiver 111 may be configured to receive the conference information sent by the at least one user terminal, where the conference information may include the site information and each site. Media instructions.
- the processor 112 can update the streaming identification information according to the conference information.
- the recording server 110 may further include:
- the memory 114 is configured to receive and save a streaming media message sent by at least one user terminal.
- the recording server 110 may further include:
- the recording server display area 115 is configured to display at least one of the selected streaming media information.
- receiver 111 can also be used to:
- the playback request message input by the user in the recording server display area is obtained.
- the recording server display area 115 may include at least one sub-picture, and each sub-picture is used to display a real-time image outputting a conference site.
- the playback request message may include the streaming media identification information and the playback location information, and the streaming media identification information may further include the site identification information of the conference site or the sub-screen flag information corresponding to the conference site.
- the recording and recording server may select a site to be played back according to the streaming media identification information, and select, according to the playback location information, the streaming media information that needs to be played back from the recorded streaming media information of the site.
- the recording server display area 115 can also be used to:
- the first sub-screen 1151 of the recording server display area 115 displays the output selected and the first The first stream media information corresponding to the sub-screen flag information or the site identifier information of the first site; or
- the recording server display area 115 displays the output selected information and the first sub-screen flag information.
- the first streaming media information corresponding to the site identification information of the first site; or
- the streaming media identification information includes the first sub-picture flag information or the corresponding corresponding to the first sub-picture
- the first sub-screen 1151 of the recording server display area 115 displays the output selected and The first sub-picture mark information or the first streaming media information corresponding to the site identification information of the first site, and simultaneously outputting the selected second sub-picture flag information in the second sub-screen 1152 of the recording server display area 115 Or the second streaming media information corresponding to the site identifier information of the second site.
- the streaming media information may include at least one of video information, audio information, picture information, and subtitle information.
- the embodiment of the present invention further provides a video conference recording and broadcasting system 130.
- the method includes: at least one user terminal 90 as described above, and the recording server 110 as described above.
- the structure of the user terminal 90 and the recording server 110 has been described in detail in the foregoing embodiments, and details are not described herein.
- the video conference recording and broadcasting system receives the playback request message input by the user, and sends the playback request message to the recording and playback server, and the recording and playback server can select the streaming media information according to the playback request message, and the user terminal receives the After the combined code stream sent by the recording server, the at least one channel of the received media information is displayed, where the combined code stream includes at least one channel of media information, and one channel of the stream media information corresponds to one site.
- the recording and playback of the video conference by using such a method can realize the recording and playback of the video of the conference according to the needs of the user in the middle of the video conference, thereby improving the user experience.
- a video conference recording and broadcasting method characterized in that it comprises:
- the combined code stream includes at least one channel of selected streaming media information, where the one channel of the stream media information corresponds to a site; the output of the received combined code stream is included Streaming information.
- the user terminal display area includes at least one sub-picture, and each of the sub-pictures is used to display an image outputting a conference site.
- the playback request message includes the streaming media identification information and the playback location information
- the streaming media identification information includes the site identification information of the conference site or the parameter. a sub-screen flag information corresponding to the meeting place; wherein, the recording and playing server selects a site to be played back according to the streaming media identification information, and selects a required content from the recorded streaming media information of the site according to the playback location information. Streaming information for playback.
- the method before the receiving the playback request message input by the user, the method further includes:
- streaming media information included in the combined code stream received by the display output comprises:
- the first sub-screen display area of the user terminal display area outputs the received and the The first sub-picture flag information or the first streaming media information corresponding to the site identification information of the first site; or
- the streaming media identification information is the first sub-picture flag information or the site identification information of the first site corresponding to the first sub-screen, displaying, in the user terminal display area, the output received and the first sub-picture flag Information or site identification information of the first site
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2015107459A RU2610451C2 (ru) | 2012-09-24 | 2013-06-03 | Способ, устройство и система записи видеоконференции |
BR112015004474-3A BR112015004474B1 (pt) | 2012-09-24 | 2013-06-03 | Método de gravação de conferência de vídeo, terminal de usuário, servidor de gravação, e sistema de gravação de conferência de vídeo |
EP13839444.0A EP2863642B1 (en) | 2012-09-24 | 2013-06-03 | Method, device and system for video conference recording and playing |
US14/597,666 US20150127782A1 (en) | 2012-09-24 | 2015-01-15 | Video Conference Recording Method, Device, and System |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210358088.5 | 2012-09-24 | ||
CN201210358088.5A CN103686219B (zh) | 2012-09-24 | 2012-09-24 | 一种视频会议录播的方法、设备及系统 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/597,666 Continuation US20150127782A1 (en) | 2012-09-24 | 2015-01-15 | Video Conference Recording Method, Device, and System |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014044059A1 true WO2014044059A1 (zh) | 2014-03-27 |
Family
ID=50322299
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2013/076642 WO2014044059A1 (zh) | 2012-09-24 | 2013-06-03 | 一种视频会议录播的方法、设备及系统 |
Country Status (6)
Country | Link |
---|---|
US (1) | US20150127782A1 (zh) |
EP (1) | EP2863642B1 (zh) |
CN (1) | CN103686219B (zh) |
BR (1) | BR112015004474B1 (zh) |
RU (1) | RU2610451C2 (zh) |
WO (1) | WO2014044059A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111131760A (zh) * | 2019-12-31 | 2020-05-08 | 视联动力信息技术股份有限公司 | 一种视频录制方法和装置 |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105262979B (zh) * | 2014-06-27 | 2018-09-28 | 浙江大华技术股份有限公司 | 一种多路视频回放方法及装置 |
CN105898173B (zh) * | 2015-01-26 | 2019-04-30 | 南宁富桂精密工业有限公司 | 视频回放装置及方法 |
JP2017169108A (ja) * | 2016-03-17 | 2017-09-21 | 株式会社リコー | 情報処理装置とそのプログラム及び会議支援システム |
US10348907B1 (en) * | 2016-05-12 | 2019-07-09 | Antony P. Ng | Collaborative data processing |
CN108966024B (zh) * | 2017-11-29 | 2020-06-26 | 视联动力信息技术股份有限公司 | 一种音视频流的传输方法、回放方法、装置及系统 |
CN108965783B (zh) * | 2017-12-27 | 2020-05-26 | 视联动力信息技术股份有限公司 | 一种视频数据处理方法及视联网录播终端 |
US20190236547A1 (en) * | 2018-02-01 | 2019-08-01 | Moxtra, Inc. | Record and playback for online collaboration sessions |
CN111355920A (zh) * | 2018-12-24 | 2020-06-30 | 中兴通讯股份有限公司 | 会议纪要生成方法及会议终端 |
CN112312057A (zh) * | 2020-02-24 | 2021-02-02 | 北京字节跳动网络技术有限公司 | 多媒体会议数据处理方法、装置和电子设备 |
CN111556351B (zh) * | 2020-05-15 | 2022-04-15 | 宁波菊风系统软件有限公司 | 一种rtp文件播放系统 |
CN112738451B (zh) * | 2021-04-06 | 2021-07-09 | 浙江华创视讯科技有限公司 | 一种视频会议录播方法、装置、设备及可读存储介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101771853A (zh) * | 2010-01-29 | 2010-07-07 | 华为终端有限公司 | 会议内容播放的方法及装置 |
CN102209230A (zh) * | 2011-05-31 | 2011-10-05 | 浙江中烟工业有限责任公司 | 一种具有主会场控制模块的视频会议系统 |
CN102223515A (zh) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | 远程呈现会议系统、远程呈现会议的录制与回放方法 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2352845A (en) * | 1999-07-29 | 2001-02-07 | Data Connection Ltd | System for recording and retrieval of multimedia conferences |
US7598975B2 (en) * | 2002-06-21 | 2009-10-06 | Microsoft Corporation | Automatic face extraction for use in recorded meetings timelines |
US20040207724A1 (en) * | 2003-04-17 | 2004-10-21 | Siemens Information And Communication Networks, Inc. | System and method for real time playback of conferencing streams |
EP1868347A3 (en) * | 2006-06-16 | 2010-07-14 | Ericsson AB | Associating independent multimedia sources into a conference call |
CN101540872B (zh) * | 2009-02-23 | 2012-07-04 | 华为终端有限公司 | 媒体控制服务器多通道级联的控制方法、装置和系统 |
CN102055949B (zh) * | 2009-11-02 | 2013-10-02 | 华为终端有限公司 | 多媒体会议的录播方法、装置及系统、回播方法及装置 |
CN101820524A (zh) * | 2010-03-22 | 2010-09-01 | 中兴通讯股份有限公司 | 用于电视会议的视频播放方法 |
US8797380B2 (en) * | 2010-04-30 | 2014-08-05 | Microsoft Corporation | Accelerated instant replay for co-present and distributed meetings |
CN101895718B (zh) * | 2010-07-21 | 2013-10-23 | 杭州华三通信技术有限公司 | 视频会议系统多画面广播方法及其装置和系统 |
US8922658B2 (en) * | 2010-11-05 | 2014-12-30 | Tom Galvin | Network video recorder system |
CN102572370B (zh) * | 2011-01-04 | 2014-06-11 | 华为终端有限公司 | 视频会议的控制方法和会议终端 |
-
2012
- 2012-09-24 CN CN201210358088.5A patent/CN103686219B/zh active Active
-
2013
- 2013-06-03 RU RU2015107459A patent/RU2610451C2/ru active
- 2013-06-03 WO PCT/CN2013/076642 patent/WO2014044059A1/zh active Application Filing
- 2013-06-03 EP EP13839444.0A patent/EP2863642B1/en active Active
- 2013-06-03 BR BR112015004474-3A patent/BR112015004474B1/pt active IP Right Grant
-
2015
- 2015-01-15 US US14/597,666 patent/US20150127782A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101771853A (zh) * | 2010-01-29 | 2010-07-07 | 华为终端有限公司 | 会议内容播放的方法及装置 |
CN102209230A (zh) * | 2011-05-31 | 2011-10-05 | 浙江中烟工业有限责任公司 | 一种具有主会场控制模块的视频会议系统 |
CN102223515A (zh) * | 2011-06-21 | 2011-10-19 | 中兴通讯股份有限公司 | 远程呈现会议系统、远程呈现会议的录制与回放方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2863642A4 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111131760A (zh) * | 2019-12-31 | 2020-05-08 | 视联动力信息技术股份有限公司 | 一种视频录制方法和装置 |
CN111131760B (zh) * | 2019-12-31 | 2022-12-13 | 视联动力信息技术股份有限公司 | 一种视频录制方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
RU2015107459A (ru) | 2016-11-20 |
CN103686219B (zh) | 2017-09-29 |
RU2610451C2 (ru) | 2017-02-13 |
EP2863642A1 (en) | 2015-04-22 |
BR112015004474A8 (pt) | 2019-08-27 |
BR112015004474A2 (pt) | 2017-07-04 |
EP2863642A4 (en) | 2015-08-05 |
EP2863642B1 (en) | 2017-01-25 |
BR112015004474B1 (pt) | 2023-02-07 |
US20150127782A1 (en) | 2015-05-07 |
CN103686219A (zh) | 2014-03-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014044059A1 (zh) | 一种视频会议录播的方法、设备及系统 | |
US8988486B2 (en) | Adaptive video communication channel | |
WO2008131644A1 (fr) | Procédé, dispositif et système pour réaliser une commutation d'images dans le service vidéo | |
JP2014511621A (ja) | 表示切換えのための方法および装置 | |
WO2019157803A1 (zh) | 传输控制方法 | |
WO2011050690A1 (zh) | 用于录制和回播多媒体会议的方法和系統 | |
CN105763832A (zh) | 一种视频互动、控制方法及装置 | |
WO2011116611A1 (zh) | 用于电视会议的视频播放方法 | |
WO2011026382A1 (zh) | 视频会议虚拟会场的呈现方法、设备及系统 | |
WO2012055335A1 (zh) | 会议控制方法及相关设备和系统 | |
WO2012075937A1 (zh) | 视频通话方法及可视电话 | |
WO2014101428A1 (zh) | 画面控制的方法及终端、视频会议装置 | |
EP2506571A1 (en) | Analog and digital video monitoring fusion system and fusion method thereof | |
US20150172558A1 (en) | Video processing method, apparatus, and system | |
US20160212383A1 (en) | Video Conference Virtual Endpoints | |
WO2008148333A1 (fr) | Système et procédé de traitement d'un flux vidéo | |
WO2012175025A1 (zh) | 远程呈现会议系统、远程呈现会议的录制与回放方法 | |
KR20140103156A (ko) | 멀티미디어 서비스를 이용하기 위한 시스템, 장치 및 방법 | |
JP6024002B2 (ja) | 動画配信システム | |
CN113194278A (zh) | 一种会议控制方法、装置及计算机可读存储介质 | |
CN112866725A (zh) | 一种直播控制方法及装置 | |
WO2014012384A1 (zh) | 通信数据的发送方法、系统及接收装置 | |
CN101141615B (zh) | 会议电视终端支持双流的外置实现方法 | |
US20160255375A1 (en) | Multipoint broadcast method | |
CN111385590A (zh) | 直播数据处理方法、装置及终端 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13839444 Country of ref document: EP Kind code of ref document: A1 |
|
REEP | Request for entry into the european phase |
Ref document number: 2013839444 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013839444 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112015004474 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 2015107459 Country of ref document: RU Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 112015004474 Country of ref document: BR Kind code of ref document: A2 Effective date: 20150227 |