WO2015058494A1

WO2015058494A1 - Conference label generation and application method, device and system

Info

Publication number: WO2015058494A1
Application number: PCT/CN2014/074840
Authority: WO
Inventors: 阮冠春
Original assignee: 华为技术有限公司
Priority date: 2013-10-21
Filing date: 2014-04-04
Publication date: 2015-04-30
Also published as: CN103561229B; CN103561229A

Abstract

Disclosed are a conference label generation and application method, device and system, which are used for quickly indexing and positioning recorded conference videos and audio to a corresponding position, so that a designated conference content can be quickly and accurately broadcasted on demand. The method in the embodiments of the present invention comprises: generating, by an MCU, a corresponding conference event label generation request according to variation information identifying a conference event and sending same to a recording and broadcasting system, the conference event label generation request containing the variation information about the conference event; and receiving, by the recording and broadcasting system, the conference event label generation request, generating a conference label according to a conference event variation time in the variation information about the conference event, forming the generated conference label and a conference media stream into a time correlation and storing the formed correlation.

Description

Conference Generation and Application Method, Device, and System This application is filed on October 21, 2013, and is filed on the Chinese Patent Office. The application number is 201310496741. 9. The invention is entitled "Conference Label Generation and Application Method, Device, System" Chinese Patent Application Priority is hereby incorporated by reference in its entirety. Technical field

The present invention relates to the field of communications technologies, and in particular, to a conference tag generation and application method, apparatus, and system. Background technique

The conference recording and broadcasting system uses streaming media storage and playback technology for video conferencing, and realizes the function of storing and playing back video conference content. A typical conference recording system is deployed on the network side of a video conference system (vcs, video conference system), and interacts with network elements responsible for media exchange (such as a multipoint conference unit MCU). The live video and audio stream can be recorded and stored in real time for online on-demand playback by the client. Some recording and broadcasting systems also forward the conference stream in real time, providing online live broadcast.

In the prior art, the information recorded by the conference recording system only includes the video and audio information of the conference, and the conference event information is not recorded. There is also no corresponding storage mode in the video and audio recording files. The video and audio information of the entire conference is stored as a set of independent video and audio. The client that plays on-demand during playback generally starts playing from the initial position of the conference. If the client wants to quickly find the content of interest, the following methods can be used: 1. Quickly play the content on demand, fast playback can be played at 2x speed, 4x speed, 8x speed, etc., or drag the playback progress bar to observe Image conversion, find the desired position and start playing; 2. Record the time point of interest during recording or on-demand, and quickly locate to the specified position during playback.

However, in the above prior art, the on-demand mode of the drag play progress bar in the video and audio playback depends on the on-demand person's familiarity with the on-demand content, and the positioning of the play time is not accurate during the dragging process, and only the point of interest can be found. Information about the time nearby. The practice of recording the point in time of interest in advance requires a dedicated person to record the time value of each relevant event in the meeting, and then provide it to the on-demand person. For a system with frequent meetings, it is often only possible to record separate records for some meetings. . This makes it difficult for the on-demand client to quickly and accurately find a specific location where the audiovisual content has been recorded. Summary of the invention

The embodiment of the invention provides a method, a device and a system for generating and applying a conference label, which are used for automatically labeling the corresponding content of the conference recording content, so that the user can quickly retrieve and locate the label through the labeled label during the conference on-demand process. By the corresponding position of the recorded video and audio of the conference, the specified conference content can be quickly and accurately broadcasted.

A first aspect of the present invention provides a method for generating a conference label, which may include:

The multi-point conference unit generates a corresponding conference event tag generation request according to the change information of the conference event, and sends the request to the recording system, where the conference event tag generation request includes the change information of the conference event;

Receiving, by the recording and broadcasting system, the conference event tag generation request;

Generating a conference label according to the conference event change time in the change information of the conference event; forming a corresponding correspondence between the generated conference label and the conference media stream, and storing the formed correspondence relationship.

In a first possible implementation, the generating a conference label according to the conference event change time in the conference event information includes: acquiring and recording a conference event change time in the conference event information; and recording the conference event information The conference event source information is generated; the conference label is generated according to the conference event change time and the conference event source information.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, the method further includes: receiving a request for adding a label information from the multipoint conference unit; generating a conference label corresponding to the label information request; forming a corresponding correspondence between the generated conference label corresponding to the label information request and the media stream sent by the multipoint conference unit, and storing the formed correspondence .

A second aspect of the present invention provides a conference label application method, which may include:

The on-demand client receives a request to play the conference media stream, and the request for playing the conference media stream includes the identification information of the requested conference media stream;

Sending the request for playing the conference media stream to the recording and broadcasting system;

Receiving, by the recording and broadcasting system, the conference media stream and all the label information corresponding to the conference media stream, and displaying the conference media stream label;

And sending, according to the received instruction for selecting the conference media stream label, a request for acquiring the conference media stream corresponding to the selected conference media stream label to the recording and broadcasting system;

Receiving and playing the conference media stream corresponding to the selected conference media stream label. In a first possible implementation manner, the request, according to the received instruction for selecting a conference media stream label, to send the conference media stream corresponding to the selected conference media stream label to the recording and broadcasting system, includes: according to the received The user selects an instruction of the conference media stream label, determines a time point of the conference media stream corresponding to the selected conference media stream label, and converts the time point of the corresponding conference media stream into a play that conforms to the play format of the recording and playing system. The positioning instruction is sent to the recording and broadcasting system, so that the recording and broadcasting system plays the conference media stream corresponding to the playing time point indicated by the playing positioning instruction according to the playing positioning instruction.

A third aspect of the present invention provides a conference label generation system, which may include:

Multi-point conference unit, recording and broadcasting system;

The multi-point conference unit is configured to generate a corresponding conference event label generation request and send the response to the recording system according to the change information of the conference event, where the conference event label generation request includes the change information of the conference event;

The recording and broadcasting system is configured to receive the conference event tag generation request;

The recording and recording system is configured to generate a conference label according to a change event time of the conference event in the change information of the conference event;

The recording and recording system is further configured to form a temporal correspondence between the generated conference label and the conference media stream, and store the formed correspondence.

In a first possible implementation manner, the recording and recording system is further configured to acquire and record a meeting event change time in the conference event information; the recording and broadcasting system is further configured to record the conference event information. The conference event source information is further configured to generate a conference label according to the conference event change time and the conference event source information.

In conjunction with the first aspect or the first possible implementation of the first aspect, in a second possible implementation,

The recording and broadcasting system is further configured to receive a request for adding tag information from the multipoint conference unit;

The recording and recording system is further configured to generate a conference label corresponding to the label information request; the recording system is further configured to: generate the conference label corresponding to the label information request and the multiple points The media streams sent by the conference unit form a corresponding relationship in time, and store the formed correspondence.

A fourth aspect of the present invention provides a conference label application apparatus, which may include:

a receiving unit, configured to receive a request for playing a conference media stream, where the request for playing the conference media stream is Containing identification information of the requested conference media stream;

a sending unit, configured to send, by the receiving unit, the request for playing the conference media stream to the recording and broadcasting system;

The receiving unit is further configured to receive the conference media stream sent by the recording and broadcasting system and all label information corresponding to the conference media stream;

a display unit, configured to display a conference media stream label received by the receiving unit;

And the sending unit is further configured to send, according to the instruction for selecting the conference media stream label, the request for the conference media stream corresponding to the selected conference media stream label, to the recording and broadcasting system;

The receiving unit is further configured to receive the conference media stream corresponding to the selected conference media stream label, and the playing unit is configured to play the conference media stream corresponding to the selected conference media stream label received by the receiving unit.

In a first possible implementation manner, the sending unit further includes:

a determining unit, configured to determine a time point of the conference media stream corresponding to the selected conference media stream label according to an instruction of the user to select the conference media stream label received by the receiving unit;

a conversion unit, configured to convert a time point of the corresponding conference media stream determined by the determining unit into a play positioning instruction that conforms to a play format of the recording system, and send the record to the recording system, so that the recording The broadcast system plays the play time point indicated by the play positioning instruction according to the play positioning instruction.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages: in the embodiments of the present invention,

The MCU identifies the change information of the conference event, generates a conference event tag generation request corresponding to the change information, and includes the change information of the conference event, and sends the change information to the recording and broadcasting system, and the recording and broadcasting system receives the conference event tag generation request, And generating a conference label according to the conference event change time in the change information of the conference event, forming a corresponding correspondence between the generated conference label and the conference media stream, and storing the formed correspondence relationship. In this way, when the user plays back the conference media stream, the conference content can be freely retrieved according to the conference labels of the conference media stream, and the conference media stream corresponding to the time point at which the transformation occurs in the conference can be accurately located, and the content of the specific conference is improved. effectiveness. DRAWINGS

1 is a schematic structural diagram of a conference label generation and application system according to an embodiment of the present invention;

2 is a schematic diagram of an embodiment of a method for generating a conference label according to an embodiment of the present invention; FIG. 3 is a schematic diagram of another embodiment of a method for generating a conference label according to an embodiment of the present invention; FIG. 4 is a schematic diagram of an embodiment of a method for applying a conference label according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of another embodiment of a conference label application method according to an embodiment of the present invention; FIG. 6 is a schematic diagram of an embodiment of a conference label generation system according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of an embodiment of a conference label application apparatus according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic diagram of another embodiment of a conference label application apparatus according to an embodiment of the present invention; FIG. 9 is a schematic diagram of still another embodiment of a conference label application apparatus according to an embodiment of the present invention. detailed description

The embodiment of the invention provides a conference label generation and application method, device and system, which are used for automatically labeling corresponding content of the conference recording content, so that the user can quickly and accurately play the conference content of interest.

The embodiment provided by the present invention constructs an apparatus capable of automatically recognizing a conference event, generating, storing, and using a conference ticket in the existing system networking mode. The device is used to implement automatic labeling of the corresponding content of the conference recording content. During the conference on-demand, the user can quickly retrieve and locate the recorded corresponding position through the labeled label, so that the user can quickly and accurately start the playback. Interested meeting content.

The specific conference label generation and application system includes: conference terminal 101, multipoint conference unit (English: Multipoint Conferencing Unit, abbreviation: MCU) system 102, recording system 103, on-demand client 104.

The conference terminal 101 is usually multiple, and is connected to the MCU system 102. The conference terminal has built-in conference client software, and the user needs to log in to the client when participating in the conference;

The MCU system 102 includes: a conference control signaling processing unit 1021 and a media processing unit 1022. The recording and playback system 103 includes: a label generation module 1031, a system foreign label module 1032, a media stream storage module 1033, and a media stream storage library 1034. The media stream sending module 1035, the media stream locating module 1036, and the tag identifying module 1037. The on-demand client 104 includes: a media stream playing module 1041, a play control module 1042, a media stream receiving module 1043, a tag converting module 1044, and a tag selection. Module 1045 ο

The conference control signaling processing unit 1021 is a part of the MCU system 102, and is configured to identify and execute an operation instruction and a conference signaling change process of each site in the conference. The conference control signaling processing unit 1021 extracts related information such as signaling changes and site operations, and generates signaling correspondences, while the conference control information is being processed. The tag generation request information is sent to the tag generation module 1031. Among them, the conference control signaling changes such as the conference joining the conference, leaving the conference, various applications submitted by the conference chairperson, and a conference site broadcast by the conference. The venue operations such as starting the auxiliary stream video, stopping the auxiliary stream video, and the participants at the conference site make a speech.

The media processing unit 1022 is also part of the MCU system 102 for processing media information for each venue in the conference. The media information includes but is not limited to: mainstream video streaming media, mainstream audio streaming media, secondary streaming video streaming media and data conferencing information, data conferencing information such as electronic whiteboard information, short messages, subtitle information, and the like. The media processing unit 1022 identifies the content change of the media stream, and then sends the tag generation request information corresponding to the recognition result generation media change to the tag generation module 1031. It should be noted that, depending on the type of the processing media stream, the media processing unit 1022 may include a video media processing unit, an auxiliary media processing unit, and an audio media processing unit.

Further, the tag generating module 1031 is configured to receive tag generation request information sent by the conference control signaling processing unit 1021, the media processing unit 1022, and the system foreign tag module 1032, and simultaneously acquire the meeting time, generate a time point, and process and process Form label information. The label information is summarized and sent to the media storage module 1033;

The system foreign tag module 1032 is configured to receive, during the conference recording process, a request for adding tag information sent by the device, such as a tag sent by the network management software, a tag sent by the live client, and a tag manually added by the user. After receiving the foreign tag information, the system foreign tag module 1032 generates corresponding tag generation request information, and sends the corresponding tag generation request information to the tag generation module 1031.

The media stream storage module 1033 is configured to receive the media stream sent by the media processing unit 1022, where the media stream includes, but is not limited to, mainstream video streaming media data, mainstream audio streaming media data, secondary streaming video streaming media data, and data conference information, and The data of these streaming media is processed and stored in the media stream repository 1034. At the same time, the tag information sent by the tag generating module 1031 is also received, and stored in the media stream repository 1034 together with the streaming media;

The media stream repository 1034, typically in the form of a database, disk array, or file, is used to store and store media stream data for the conference. In addition to the information of the general video and audio streaming media data, the tag information corresponding to the video and audio streaming media data is also stored, and the media stream storage module 1033 and the media stream storage library 1034 are all units in the recording and broadcasting system 103;

The media stream sending module 1035 is configured to send the media stream queried in the media stream repository 1034 to the on-demand client 104;

The media stream locating module 1036 is configured to receive the label conversion module in the on-demand client 104.

The playback positioning command sent by 1144, the driving media stream sending module 1035 selects from the media stream repository 1034. The corresponding media stream information is sent to the media stream receiving module 1143 in the on-demand client 104;

The tag identification module 1037 is configured to read tag information corresponding to the conference media stream, and identify and parse the tag information.

The media stream playing module 1041 is configured to play the conference streaming media sent by the media stream sending module 1035 in the recording and broadcasting system 103;

The play control module 1042 is configured to select, by the user, the conference streaming media or the label;

The media stream receiving module 1043 is configured to receive the conference streaming media sent by the media stream sending module 1035 in the recording and broadcasting system 103;

The label conversion module 1044 is configured to: determine a conference label selected by the user, determine a time point of the conference media stream corresponding to the conference label, convert the time point into a play positioning instruction that conforms to the play format of the recording and playing system 103, and send the broadcast positioning command to the recording and broadcasting System 103;

The label selection module 1045 is configured to integrate labels of the conference media streams, so that the labels of the conference streaming media can be sorted, searched, added, deleted, and the like. For example, find all the labels of the specified site, sort the labels by time, and so on.

Referring to FIG. 2, an embodiment of a method for generating a conference label in an embodiment of the present invention includes:

201. The MCU generates a corresponding label generation request according to the change information of the recognition conference event, and sends the corresponding label generation request to the recording and broadcasting system.

At each venue, participants join the video conference by logging in to the conference terminal.

The MCU in the video conference system includes a conference control signaling processing unit and a media processing unit, and the conference control signaling processing unit can process the conference control information of each conference site in the conference, where the conference control information includes the conference operation instruction and the conference signaling, where The site operation command may include starting the auxiliary stream video, stopping the auxiliary stream video, and the conference site to perform the conference. The conference signaling may include the conference joining the conference, the conference leaving the conference, the application for the chairman, and the conference being broadcasted. The media processing unit can process mainstream video streaming media, mainstream audio streaming media, and auxiliary streaming video streaming media. Therefore, the media processing unit may at least include: a video media processing unit, an audio media processing unit, and an auxiliary stream media processing unit.

Specifically, the conference control signaling processing unit identifies the conference control instruction of each site and the current conference mode, where the current conference mode refers to different forms of the current conference, such as: the conference form is a point-to-point conference or a multipoint conference, If there is a broadcast, whether it is sending a secondary stream, whether there is a chair, etc., it generates information about the conference event that can indicate the status of the conference process, such as the conference joining the conference, leaving the conference, the conference site being broadcast, the venue being closed, and the venue requesting to speak. The media sent by the media processing unit to the participating conference terminal The information is detected in real time, and information about events related to the meeting is identified, such as page turning of the auxiliary stream film, and the personnel of the meeting place increase, decrease, walk, and speak at the meeting place.

Further, the conference control event that the conference control signaling processing unit and the media processing unit can recognize, please refer to the following table: Event Source Identification Unit Event Content Label Name Description Mainstream video and video media video switching content in the main video source video occurs Scene media processing unit switches when switching

When people move around in the mobile video, people in the video change facial expressions change the appearance of the person's expression in the video, such as smile, anger, lack of concentration, etc. The number of people in the video changes when the number of people changes, such as the increase in personnel, Decrease when the subtitle subtitle is sent to the video sender to superimpose the subtitle information or to cancel the superimposition of the subtitle information onto the video image. Subtitles include banners, scrolling messages, venue names, etc.

Lens off Lens change Video sender turns on/off mirror/on/blue head, or when sending blue screen information

Auxiliary stream video Auxiliary stream media Auxiliary stream transmission Auxiliary stream starts In the conference, the site starts to send media processing unit / stop sending auxiliary stream or stop sending auxiliary stream

Film flipping film flipping When the film displayed in the auxiliary stream has a page change

Draw, input, draw, draw the site of the auxiliary stream, draw the brush on the auxiliary film, or superimpose the text input

Audio Streaming Audio Media Audio Switching Audio Switching When the conference site is switched, the processing unit is called by the conference site A, and the conference is switched to the site B.

The venue mixing venue mixes multiple venues to speak, when entering the mix or exiting the mix mode Music playback music overlay starts playing music, stop playing

Music time

Pre-defined sound Pre-defined sounds. Some sounds from the venue are detected. Specific sounds, such as dual-tone multi-frequency codes.

Tone, self-excited howling, telephone ring tones, doorbell tones, knocking sounds, etc.

Conference Control Command Control Signaling Joining the Conference Joining the Conference Leave the conference to join the conference, or leave

Processing unit

Chairman function Chairman's application There is a venue to apply for the chairman and release the main

Position

Viewing the venue Viewing the venue Receiving the venue to view the request signaling

Time

Broadcasting site Broadcasting site When the chairman broadcasts a site, the site is muted. The site is muted. The chairman closes or opens a meeting.

Field sound output

The venue is closed, the venue is closed, the chairman closes or opens a meeting.

Field microphone input

Multi-screen operation Multi-screen When the chairman performs multi-screen operation, it includes setting up multiple screens and watching more.

Picture, broadcast multi-picture, etc. In the above table, "event source" refers to which meeting information the identified meeting event comes from, and "identification unit" refers to which unit recognizes the meeting event information, such as the video media processing unit identifies the mainstream The conference event information in the video, the audio media processing unit identifies the conference event information in the audio stream, the auxiliary stream media processing unit identifies the conference event information in the auxiliary stream video stream, and the conference control signaling processing unit identifies the conference control command. The conference event in this embodiment refers to the change of the conference related information during the conference, and the occurrence of each event described in the "event content" in the above table. The description in the above table is an explanation of the label information.

It should be noted that the MCU includes the conference control signaling processing unit and the media processing unit, but is not limited to identifying the conference event in the above table.

After the conference control signaling processing unit and the media processing unit in the MCU recognize the conference event, send a conference time label generation request to the recording and broadcasting system in the video conference system, and include the recognized conference event in the conference event label generation request. information. 202. The recording and broadcasting system receives a conference event tag generation request.

203. Generate a conference label according to a conference event change time in the change information of the conference event. After the conference system generates a request according to the conference event identifier, the conference event change time and the conference event source information according to the conference event information included therein , generate a meeting label. The conference label of this embodiment refers to data indicating a combination relationship of events and time occurring during the recording of the conference, and the representation may be a series of {meeting event, event source, time} combination. The resulting conference label is saved in the database along with the conference video data.

For example, the content of the conference event is "people walking", indicating that there is a person walking in the meeting. The time when the person walks is when the meeting is carried out until 20 minutes and 30 seconds. The event source is the mainstream video. Then, the recording and broadcasting system is based on the movement of the personnel. The time and event source generates a meeting label with the label name "People Move".

204. Form a temporal correspondence between the generated conference label and the conference media stream, and store the formed correspondence.

The recording and recording system generates a correspondence between the generated conference label and the conference media stream sent by the MCU according to the time point of the conference media stream recording, gp, the time when the conference event indicated by the conference label occurs, and the conference media stream records the conference event. The time corresponds, and the formed correspondence is saved in the media repository. After the label recording is completed, if the recording is not completed, the detection and recording of the next recording label information will be repeated until the entire recording process ends.

In the embodiment of the present invention, the MCU identifies the change information of the conference event, generates a conference event tag generation request corresponding to the change information, and includes the change information of the conference event, and sends the change information to the recording and broadcasting system, and the recording and broadcasting system receives the The conference event label generation request generates a conference label according to the conference event change time in the change information of the conference event, and forms a corresponding correspondence between the generated conference label and the conference media stream, and stores the formed correspondence relationship. In this way, when the user plays back the conference media stream, the conference content can be freely retrieved according to the conference labels of the conference media stream, and the conference media stream corresponding to the time point at which the transformation occurs in the conference can be accurately located, and the content of the specific conference is improved. effectiveness.

The method for generating a conference label in the embodiment of the present invention is described in detail in another embodiment. Referring to FIG. 3, another embodiment of the conference label generation method in the embodiment of the present invention includes:

301. The MCU generates a corresponding label generation request according to the change information of the conference event, and sends the corresponding label generation request to the recording and broadcasting system.

At each venue, participants join the video conference by logging in to the conference terminal. The MCU in the video conference system includes a conference control signaling processing unit and a media processing unit, and the conference control signaling processing unit can process the conference control information of each conference site in the conference, where the conference control information includes the conference operation instruction and the conference signaling, where The site operation command may include starting the auxiliary stream video, stopping the auxiliary stream video, and the conference site to perform the conference. The conference signaling may include the conference joining the conference, the conference leaving the conference, the application for the chairman, and the conference being broadcasted. The media processing unit can process mainstream video streaming media, mainstream audio streaming media, and auxiliary streaming video streaming media. Therefore, the media processing unit may at least include: a video media processing unit, an audio media processing unit, and an auxiliary stream media processing unit.

Specifically, the conference control signaling processing unit generates information of a conference event that can indicate the status of the conference process by identifying the conference control command and the current conference mode of each site, such as the conference joining the conference, leaving the conference, the conference site being broadcasted, and the conference site being closed. Sound, venue request to speak, etc. The media processing unit detects the media information sent by the conference terminal at the conference in real time, and identifies information about the event related to the conference, such as page turning of the auxiliary stream film, increasing, decreasing, walking, and speaking at the venue. For details, refer to Table 1 in the embodiment shown in Figure 2, and details are not described here.

302. The recording and broadcasting system receives a conference event tag generation request.

303. Generate a conference label according to the conference event change time and the conference event source information in the change information of the conference event.

After the recording and receiving system generates a request according to the received event tag, the recording label is generated according to the meeting event change time and the meeting event source information in the meeting event information contained therein. The conference label of this embodiment refers to data indicating a combination relationship of events and time occurring during the recording of the conference, and the representation may be a series of {meeting event, event source, time} combination. The resulting conference label is saved in the database along with the conference video data.

Further, the recording and broadcasting system may also receive a request for adding tag information other than the MCU, such as a request for adding a tag information sent by a network management software in the network management module, a request for adding a tag information sent by a live client, and a message for adding a comment by the user. The tag information request includes at least a time point at which the tag is requested to be added and a content to which the tag is requested to be added. The recording system will request the unified format of the tag information to be added, record the time point at which the request is added, and request the content of the tag to generate a corresponding tag. 304. Form a temporal correspondence between the generated conference label and the conference media stream, and store the formed correspondence.

It should be noted that the identification function of the change information of the conference event in the embodiment of the present invention may be implemented by the MCU, or may be integrated into the internal implementation of the conference terminal.

An embodiment of a method for applying a conference label according to an embodiment of the present invention is described below. Referring to FIG. 4, an embodiment of a method for applying a conference label in an embodiment of the present invention includes:

401. The on-demand client receives a request for playing a conference media stream, where the request for playing the conference media stream includes the identification information of the requested conference media stream.

The on-demand client receives a request to play a conference media stream, for example, receiving a request for a user to play a conference media stream. The request to play the conference media stream includes identification information of the requested conference media stream, such as the name, unique code, path, etc. of the requested conference media stream. The on-demand client first sends an on-demand request to the recording server, the name (ID), unique code, and path of the requested conference media stream.

402. Send the request for playing the conference media stream to the recording and broadcasting system.

The on-demand client sends the request for playing the conference media stream to the recording and broadcasting system, and the recording and broadcasting system queries the conference media stream and all the labels of the conference media stream according to the request of the broadcast conference media stream.

403. Receive the conference media stream sent by the recording and recording system, and all label information corresponding to the conference media stream, and display the conference media stream label.

The on-demand client receives the conference media stream sent by the recording system and all the label information corresponding to the conference media stream, and the label information of the conference stream may be sent before the data of the conference media stream is sent. The streamed data is sent at the same time, and the conference media stream label is displayed through the interface of the on-demand client, so that the user can select the conference media stream of interest according to the label of the conference media stream, and the displayed label can provide the user to the conference media stream. The tags are sorted, sorted, looked up, etc. 404: Send, according to the received instruction for selecting a conference media stream label, a request for acquiring the conference media stream corresponding to the selected conference media stream label to the recording and broadcasting system;

The on-demand client sends a request for obtaining the conference media stream corresponding to the selected conference media stream label to the recording system according to the received instruction of the conference media stream label selected by the user, to obtain the conference media stream selected by the user.

405. Receive and play the conference media stream corresponding to the selected conference media stream label.

In the embodiment of the present invention, the on-demand client receives the request for playing the conference media stream, the request for playing the conference media stream includes the information of the requested conference media stream, and the request for playing the conference media stream is sent to the recording and broadcasting system. Receiving, by the recording and broadcasting system, the conference media stream and the label of the conference media stream, and displaying the conference media stream label, requesting, according to the received instruction for selecting a conference media stream label, to the recording and broadcasting system The conference media stream corresponding to the conference media stream label is selected and played, and the user can accurately and freely locate the conference content of interest according to the conference label, thereby improving the accuracy and convenience of positioning the conference content.

The method for applying the conference label in the embodiment of the present invention is described in a more detailed embodiment. Referring to FIG. 5, another embodiment of the method for applying the conference label in the embodiment of the present invention includes:

501. The on-demand client receives a request for playing a conference media stream, where the request for playing the conference media stream includes information of the requested conference media stream.

The on-demand client receives a request to play a conference media stream, for example, receiving a request for a user to play a conference media stream. The request to play the conference media stream includes information of the requested conference media stream, such as the name of the requested conference media stream, a unique code, and the like.

502. Send the request for playing the conference media stream to the recording and broadcasting system.

The on-demand client sends the request to play the conference media stream to the recording system, and the recording system reads the conference media stream and all the labels of the conference media stream according to the request of the conference video stream. Specifically, the tag identification module of the recording and broadcasting system queries and reads all the tag information corresponding to the conference media stream in the media repository, and the media stream sending module of the recording and broadcasting system reads the conference media in the media repository. Streamed and sent to the media receiving module of the on-demand client.

503. Receive the conference media stream sent by the recording and recording system, and all label information corresponding to the conference media stream, and display the conference media stream label.

The on-demand client receives the conference media stream sent by the recording system and all the label information corresponding to the conference media stream, and the label information of the conference stream may be sent before the data of the conference media stream is sent. Streaming data is sent simultaneously, and through the on-demand client interface The conference media stream label is displayed, so that the user can select the conference media stream of interest according to the label of the conference media stream, and the displayed label can provide the user to classify, sort, and search the label of the conference media stream.

504. Determine, according to the received instruction that the user selects the conference media stream label, a time point of the conference media stream corresponding to the selected conference media stream label.

The user selects the conference media stream label according to the needs of the user, and the client determines the time point of the conference media stream corresponding to the conference media stream label selected by the user according to the selection instruction input by the user.

505. Convert a time point of the corresponding conference media stream into a play positioning instruction that conforms to a play format of the recording and broadcasting system, and send the broadcast positioning instruction to the recording and broadcasting system, so that the recording and playback system plays the broadcast instruction according to the play positioning instruction. Decoding a conference media stream corresponding to a playback time point indicated by the playback positioning instruction;

And determining, by the determined time point of the conference media stream corresponding to the conference media stream label, a playback positioning instruction that conforms to the playback format of the recording and playing system, and sending the playback positioning instruction to the recording and broadcasting system, where the recording and broadcasting system receives the playback positioning instruction The driving media stream sending module selects the conference media stream selected by the user in the media repository, and sends the conference media stream to the media receiving module of the on-demand client.

506. Receive and play the conference media stream corresponding to the selected conference media stream label.

The media stream receiving module of the on-demand client receives the conference media stream selected by the user and sent by the recording system, and plays the video stream to the user through the media stream playing module.

In the embodiment of the present invention, the on-demand client receives the request for playing the conference media stream, the request for playing the conference media stream includes the information of the requested conference media stream, and the request for playing the conference media stream is sent to the recording and broadcasting system. Receiving, by the recording media system, the conference media stream and the label information corresponding to the conference media stream, and displaying the conference media stream label, according to the received instruction for selecting the conference media stream label, to the recording and recording The system requests the conference media stream corresponding to the selected conference media stream label to be played, and the user can accurately and freely locate the conference content that is of interest to the user according to the conference label, thereby improving the accuracy and convenience of positioning the conference content.

The following describes the conference label generation system in the embodiment of the present invention. Referring to FIG. 6, the conference label generation system in the embodiment of the present invention includes:

MCU601 , recording and broadcasting system 602 ;

The MCU 601 is configured to generate a corresponding conference event tag generation request according to the change information of the conference event, and send the request to the recording system, where the conference event tag generation request includes the change information of the conference event;

The recording and broadcasting system 602 is configured to receive the conference event tag generation request; The recording and recording system 602 is configured to generate a conference label according to a conference event change time in the change information of the conference event;

The recording and recording system 602 is further configured to form a temporal correspondence between the generated conference label and the conference media stream, and store the formed correspondence.

Further, the recording and recording system 602 is further configured to acquire and record a meeting event change time in the conference event information;

The recording and recording system 602 is further configured to record the conference event source information in the conference event information. The recording and playback system 602 is further configured to generate a conference label according to the conference event change time and the conference event source information. ;

The recording and recording system 602 is further configured to receive a request for adding a tag information from the MCU 601; the recording and playing system 602 is further configured to generate a conference tag corresponding to the tag information request; The system 602 is further configured to form a temporal correspondence between the generated conference label corresponding to the added label information request and the media stream sent by the MCU, and store the formed correspondence.

The following describes the conference label application apparatus in the embodiment of the present invention. Referring to FIG. 7, an embodiment of the conference label application apparatus in the embodiment of the present invention includes:

The receiving unit 701 is configured to receive a request for playing a conference media stream, where the request for playing the conference media stream includes the identification information of the requested conference media stream.

The sending unit 702 is configured to send, by the receiving unit 701, the request for playing the conference media stream to the recording and broadcasting system;

The receiving unit 701 is further configured to receive, by the recording and broadcasting system, the conference media stream and all label information corresponding to the conference media stream;

The display unit 703 is configured to display the conference media stream label received by the receiving unit 701. The sending unit 702 is further configured to select the conference media stream according to the receiving unit 701. An instruction of the label, sending, to the recording and broadcasting system, a request for acquiring the conference media stream corresponding to the selected conference media stream label;

The receiving unit 701 is further configured to receive the conference media stream corresponding to the selected conference media stream label.

The playing unit 704 is configured to play the conference media stream corresponding to the selected conference media stream label received by the receiving unit 701.

In the embodiment of the present invention, the receiving unit 701 receives the request for playing the conference media stream, the request for playing the conference media stream includes the information of the requested conference media stream, and the sending unit 702 sends the request for playing the conference media stream to a recording and receiving system, the receiving unit 701 receives the conference media stream and the label of the conference media stream sent by the recording and broadcasting system, the display unit 703 displays the conference media stream label, and the sending unit 702 selects the conference media stream according to the received The instruction of the tag requests the recording media system to select the conference media stream corresponding to the conference media stream label, the receiving unit 701 receives the conference media stream corresponding to the selected conference media stream label, and the playing unit 704 performs the playing, and the user may The conference label is accurate and free to locate the content of the conference that you are interested in, which can improve the accuracy and convenience of positioning the conference content.

The conference label application apparatus is described in detail below. Referring to FIG. 8, another embodiment of the conference label application apparatus in the embodiment of the present invention includes:

The receiving unit 801 is configured to receive a request for playing a conference media stream, where the request for playing the conference media stream includes information of the requested conference media stream.

The sending unit 802 is configured to send, by the receiving unit 801, the request for playing the conference media stream to the recording and broadcasting system;

The receiving unit 801 is further configured to receive the conference media stream sent by the recording and broadcasting system and all label information corresponding to the conference media stream;

The display unit 803 is configured to display the conference media stream label received by the receiving unit 802. The sending unit 802 is further configured to: according to the instruction for selecting the conference media stream label received by the receiving unit 802, to the recording and broadcasting system Sending a request for obtaining the conference media stream corresponding to the selected conference media stream label;

The receiving unit 801 is further configured to receive the conference media stream corresponding to the selected conference media stream label;

The playing unit 804 is configured to play the conference media stream corresponding to the selected conference media stream label requested by the receiving unit 801. The sending unit 802 in the embodiment of the present invention may further include:

a determining unit 8021, configured to determine, according to an instruction that the user selects the conference media stream label received by the receiving unit 801, a time point of the conference media stream corresponding to the selected conference media stream label;

The converting unit 8022 is configured to convert a time point of the corresponding conference media stream determined by the determining unit 8021 into a play positioning instruction that conforms to a play format of the recording system, and send the broadcast positioning instruction to the recording and broadcasting system, so that The recording and broadcasting system plays the conference media stream corresponding to the playing time point indicated by the play positioning instruction according to the play positioning instruction.

In the embodiment of the present invention, the receiving unit 801 receives the request for playing the conference media stream, the request for playing the conference media stream includes the information of the requested conference media stream, and the sending unit 802 sends the request for playing the conference media stream to The receiving unit 801 receives the conference media stream sent by the recording system and all the label information corresponding to the conference media stream, the display unit 803 displays the conference media stream label, and the sending unit 802 selects according to the received The instruction of the media stream label is requested by the recording system to the conference media stream corresponding to the selected conference media stream label. Specifically, the determining unit 8021 receives an instruction of the user to select the conference media stream label according to the user received by the receiving unit 801. Determining a time point of the conference media stream corresponding to the selected conference media stream label, and converting, by the converting unit 8022, the time point of the corresponding conference media stream determined by the determining unit 8021 to be consistent with the play format of the recording and broadcasting system Playing a positioning instruction and transmitting to the recording system, so that the recording and broadcasting The system plays the conference media stream corresponding to the playing time point indicated by the play positioning instruction according to the play positioning instruction, and the playing unit 804 performs the playing, and the user can accurately and freely locate the meeting content of interest according to the meeting label, thereby improving the positioning meeting. The accuracy and convenience of the content.

Referring to FIG. 9, still another embodiment of the conference label application apparatus in the embodiment of the present invention includes: a processor 901, a receiver 902, and a transmitter 903;

The receiver 902 is configured to receive a request for playing a conference media stream, where the request for playing the conference media stream includes the identification information of the requested conference media stream.

The transmitter 903 is configured to send, by the receiver 902, the request for playing the conference media stream to the recording system.

The receiver 902 is further configured to receive the conference media stream sent by the recording system and all label information corresponding to the conference media stream;

The processor 901 is configured to display a conference media stream label received by the receiver 902.

The transmitter 903 is further configured to send, according to the instruction for selecting the conference media stream label, the receiver 902, a request for acquiring the conference media stream corresponding to the selected conference media stream label, to the recording system; The receiver 902 is further configured to receive the conference media stream corresponding to the selected conference media stream label. The processor 901 is further configured to play the conference media stream corresponding to the selected conference media stream label received by the receiver 902.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be performed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, the above mentioned storage. The medium can be a read only memory, a magnetic disk or a compact disk or the like.

The foregoing describes a conference label generation and application method, apparatus, and system provided by the present invention in detail. For those skilled in the art, according to the idea of the embodiment of the present invention, there may be changes in specific implementation manners and application scopes. In the above, the contents of the specification are not to be construed as limiting the invention.

Claims

Rights request

1. A method for generating conference labels, which is characterized by including:

The multipoint conference unit generates a corresponding conference event label generation request based on the change information identifying the conference event and sends it to the recording and broadcasting system. The conference event label generation request contains the change information of the conference event;

The recording and broadcasting system receives the meeting event tag generation request;

Generate a conference label according to the conference event change time in the conference event change information; form a time correspondence between the generated conference label and the conference media stream, and store the formed correspondence.

2. The method according to claim 1, wherein generating a conference label based on the conference event change time in the conference event information includes:

Obtain and record the meeting event change time in the meeting event information;

Record the meeting event source information in the meeting event information;

A conference label is generated according to the conference event change time and the conference event source information.

3. The method according to claim 1 or 2, characterized in that the method further includes: receiving a request for adding tag information from outside the multipoint conference unit;

Generate a meeting tag corresponding to the request for adding tag information;

Form a temporal correspondence between the generated conference tag corresponding to the tag information request and the media stream sent by the multipoint conference unit, and store the formed correspondence.

4. A conference label application method, characterized by including:

The on-demand client receives a request to play the conference media stream, and the request to play the conference media stream includes the identification information of the requested conference media stream;

Send the request to play the conference media stream to the recording and broadcasting system;

Receive the conference media stream sent by the recording and broadcasting system and all tag information corresponding to the conference media stream, and display the conference media stream tags;

According to the received instruction to select the conference media stream tag, send a request to the recording and broadcasting system to obtain the conference media stream corresponding to the selected conference media stream tag; Receive and play the conference media stream corresponding to the selected conference media stream tag.

5. The method according to claim 4, characterized in that, according to the received instruction to select a conference media stream tag, a request to obtain the conference media stream corresponding to the selected conference media stream tag is sent to the recording and broadcasting system. include:

Determine the time point of the conference media stream corresponding to the selected conference media stream label according to the received instruction from the user to select the conference media stream label;

Convert the corresponding time point of the conference media stream into a playback positioning instruction that conforms to the playback format of the recording and broadcasting system and send it to the recording and broadcasting system, so that the recording and broadcasting system plays the playback positioning instruction according to the playback positioning instruction. Play the conference media stream corresponding to the playback time point indicated by the positioning instruction.

6. A conference label generation system, characterized by including:

Multipoint conference unit, recording and broadcasting system;

The multipoint conference unit is configured to generate a corresponding conference event label generation request and send it to the recording and broadcasting system based on the change information identifying the conference event, and the conference event label generation request contains the change information of the conference event;

The recording and broadcasting system is used to receive the conference event tag generation request;

The recording and broadcasting system is configured to generate a conference tag based on the conference event change time in the conference event change information;

The recording and broadcasting system is also used to form a time correspondence between the generated conference tag and the conference media stream, and store the formed correspondence.

7. The conference label generation system according to claim 6, characterized in that,

The recording and broadcasting system is also used to obtain and record the meeting event change time in the meeting event information;

The recording and broadcasting system is also used to record the conference event source information in the conference event information; the recording and broadcasting system is also used to generate a conference tag according to the conference event change time and the conference event source information.

8. The conference tag generation system according to claim 6 or 7, characterized in that the recording and broadcasting system is also used to receive requests for adding tag information from outside the multipoint conference unit. beg;

The recording and broadcasting system is further configured to generate a conference tag corresponding to the tagging information request; the recording and broadcasting system is further configured to combine the generated conference tag corresponding to the tagging information request with the multipoint The media streams sent by the conference unit form a time correspondence, and the formed correspondence is stored.

9. A conference label application device, characterized by including:

A receiving unit configured to receive a request to play the conference media stream, where the request to play the conference media stream contains identification information of the requested conference media stream;

A sending unit, configured to send the request for playing the conference media stream received by the receiving unit to the recording and broadcasting system;

The receiving unit is also configured to receive the conference media stream sent by the recording and broadcasting system and all tag information corresponding to the conference media stream;

A display unit, configured to display the conference media stream tag received by the receiving unit;

The sending unit is further configured to send a request to the recording and broadcasting system to obtain the conference media stream corresponding to the selected conference media stream label according to the instruction of selecting the conference media stream label received by the receiving unit;

The receiving unit is further configured to receive the conference media stream corresponding to the selected conference media stream tag; the playback unit is configured to play the conference media stream corresponding to the selected conference media stream tag received by the receiving unit.

10. The device according to claim 9, characterized in that,

The sending unit also includes:

A determining unit configured to determine the time point of the conference media stream corresponding to the selected conference media stream label according to the user's instruction to select the conference media stream label received by the receiving unit;

A conversion unit, configured to convert the time point of the corresponding conference media stream determined by the determination unit into a playback positioning instruction that conforms to the playback format of the recording and broadcasting system and send it to the recording and broadcasting system, so that the recording and broadcasting system can The playback system plays the playback time point indicated by the playback positioning instruction according to the playback positioning instruction.