CN110784678B

CN110784678B - Conference data recording method and device and readable storage medium

Info

Publication number: CN110784678B
Application number: CN201910963630.1A
Authority: CN
Inventors: 乔金龙; 杨春晖; 王艳辉; 沈军
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-10-11
Filing date: 2019-10-11
Publication date: 2022-01-11
Anticipated expiration: 2039-10-11
Also published as: CN110784678A

Abstract

The embodiment of the invention provides a conference data recording method, which relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server; the control terminal establishes a network conference and controls the video networking terminal and the Internet terminal to join the network conference; the control terminal sends a recorded broadcast request message aiming at the internet terminal to the recorded broadcast server, and the recorded broadcast server is used for sending a recorded broadcast response message to the video network server according to the recorded broadcast request message. The invention can record the audio and video content of the internet terminal, store the audio and video content in the recording and broadcasting server, provide users to access the recording file, reduce the cost of establishing the network conference and reduce the operation difficulty of the conference.

Description

Conference data recording method and device and readable storage medium

Technical Field

The present invention relates to the field of network technologies, and in particular, to a conference data recording method and a conference data recording apparatus.

Background

With the development and popularization of network technology, a network conference room becomes a common office conference mode at present.

At present, with the popularization and development of the video networking service in the national range, the video networking high-definition video networking interaction technology plays a significant role in other industries already in government departments. The video networking adopts the most advanced worldwide Vision Vera real-time high-definition video exchange technology, realizes the real-time transmission of the whole-network high-definition video which cannot be realized by the current Internet, integrates dozens of services such as high-definition video conferences, video monitoring, remote training, intelligent monitoring analysis, emergency command, video telephone, live broadcast, television mails, information distribution and the like into a system platform, and realizes the real-time interconnection and intercommunication of high-definition quality video communication through various terminal devices.

However, in addition to the network conference established by the video network terminal, the video network terminal also needs to establish the network conference with the internet terminal.

After the network conference of the video network terminal and the internet terminal is established, the internet terminal participating in the conference can not be recorded and broadcast in the conference process, the conference data of the internet terminal can not be recorded, and a user needs to additionally add equipment to record the conference data of the internet terminal, so that the conference cost is increased, the operation difficulty of the conference is improved, and the use experience of the user is also reduced.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a conference data recording method and a corresponding conference data recording apparatus that overcome or at least partially solve the above problems.

In order to solve the above problems, an embodiment of the present invention discloses a conference data recording method, where the method relates to a video network terminal, a video network server connected to the video network terminal, a control terminal connected to the video network server, a protocol server and a recording and broadcasting server respectively connected to the control terminal, and an internet terminal connected to the protocol server, and the method includes:

the control terminal establishes a network conference and controls the video networking terminal and the Internet terminal to join the network conference; the Internet terminal is used for sending first conference data to the first protocol conversion server after the Internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data;

the control terminal sends a recorded broadcast request message aiming at the Internet terminal to the recorded broadcast server, and the recorded broadcast server is used for sending a recorded broadcast response message to the video network server according to the recorded broadcast request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message.

Optionally, the controlling terminal controls the internet terminal to join the web conference, including:

the control terminal sends a first call request message to the coordination server; the protocol conversion server is used for sending a second call request message to the internet terminal according to the first call request message, and the internet terminal is used for responding to the second call request message and joining the network conference.

The embodiment of the invention also discloses a conference data recording method, which relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server, and comprises the following steps:

after the video networking terminal and the Internet terminal join the network conference created by the control terminal, the protocol conversion server receives first conference data sent by the Internet terminal;

the protocol conversion server sends second conference data to the video networking server according to the first conference data; the video network server is used for sending the second conference data to the recording and broadcasting server and/or the video network terminal;

the protocol conversion server receives third conference data sent by the video networking server; the third conference data is sent to the video networking server by the video networking terminal;

and the cooperative conversion server sends fourth conference data to the internet terminal according to the third conference data.

Optionally, before the internet terminal joins the network conference, the method further includes:

the protocol conversion server receives a first call request message sent by the control terminal and sends a second call request message to the internet terminal according to the first call request message; and the internet terminal is used for responding the second call request message to join the network conference.

Optionally, before the coordination server receives the first call request message sent by the control terminal, the method further includes:

and the protocol conversion server generates a protocol conversion virtual terminal, and the protocol conversion virtual terminal is added into the video network.

Optionally, the collaboration server includes a video networking module and an internet module;

the protocol conversion server receives first conference data sent by the internet terminal, and the protocol conversion server comprises:

the internet module receives first conference data sent by the internet terminal; the first conference data comprises first audio stream data and first video stream data which are encapsulated according to an RTP protocol;

the protocol conversion server sends second conference data to the video networking server according to the first conference data, and the protocol conversion server comprises:

the internet module decapsulates the first conference data to obtain the first audio stream data and the first video stream data;

the internet module sends the first audio stream data and the first video stream data to the video networking module;

the video networking module respectively encapsulates the first audio stream data and the first video stream data into second audio stream data and second video stream data according to a video networking protocol, and the second audio stream data and the second video stream data serve as second conference data;

and the video networking module sends the second conference data to the video networking server.

Optionally, the receiving, by the collaboration server, third conference data sent by the video networking server includes:

the video networking module receives third conference data which is sent by the video networking server and packaged according to a video networking protocol; the third conferencing data comprises a third audio data stream and a third video data stream;

the cooperative conversion server sends fourth conference data to the internet terminal according to the third conference data, and the method comprises the following steps:

the video networking module respectively decapsulates the third audio data stream and the third video data stream to generate a fourth audio data stream and a fourth video data stream;

the video networking module sends the fourth audio data stream and the fourth video data stream to the internet module;

the internet module encapsulates the fourth audio data stream and the fourth video data stream into fourth conference data according to an RTP protocol;

and the internet module sends the fourth conference data to the internet terminal.

the protocol conversion server receives a first call request message sent by the control terminal, and the first call request message comprises

The video networking module receives a first call request message sent by the control terminal;

the coordination server sends a second call request message to the internet terminal according to the first call request message, and the method comprises the following steps:

the video networking module converts the first call request message into a first call response message and sends the first call response message to the Internet module;

and the internet module converts the first call response message into a second call request message and sends the second call request message to the internet terminal.

after the video networking terminal and the Internet terminal join the network conference created by the control terminal, the recording and broadcasting server receives a recording and broadcasting request message which is sent by the control terminal and aims at the Internet terminal;

the recorded broadcast server sends a recorded broadcast response message to the video network server according to the recorded broadcast request message;

and the recording and broadcasting server receives second conference data returned by the video networking server responding to the recording and broadcasting response message.

Optionally, the second conference data includes second audio stream data and second video stream data, and the method further includes:

the recording and broadcasting server respectively decapsulates second audio stream data and second video stream data into the first audio stream data and the first video stream data;

and the recording and playing server sends the first audio stream data and the first video stream data to a preset storage module and packages the first audio stream data and the first video stream data according to a preset playing protocol.

The embodiment of the invention also discloses a conference data recording device, which comprises the following modules:

the control terminal establishing module is used for establishing a network conference by the control terminal and controlling the video networking terminal and the Internet terminal to join the network conference; the Internet terminal is used for sending first conference data to the first protocol conversion server after the Internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data;

the control terminal sending module is used for sending a recorded broadcast request message aiming at the Internet terminal to the recorded broadcast server by the control terminal, and the recorded broadcast server is used for sending a recorded broadcast response message to the video networking server according to the recorded broadcast request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message.

Optionally, the control terminal establishing module includes:

a control sending module, configured to send, by the control terminal, a first call request message to the coordination server; the protocol conversion server is used for sending a second call request message to the internet terminal according to the first call request message, and the internet terminal is used for responding to the second call request message and joining the network conference.

The embodiment of the invention also discloses a conference data recording device, which comprises:

the protocol conversion receiving module is used for receiving first conference data sent by the Internet terminal by the protocol conversion server after the video networking terminal and the Internet terminal join the network conference created by the control terminal;

the protocol conversion sending module is used for sending second conference data to the video networking server by the protocol conversion server according to the first conference data; the video network server is used for sending the second conference data to the recording and broadcasting server and/or the video network terminal;

the protocol conversion data receiving module is used for receiving third conference data sent by the video network server by the protocol conversion server; the third conference data is sent to the video networking server by the video networking terminal;

and the auxiliary forwarding data sending module is used for sending fourth conference data to the internet terminal by the auxiliary forwarding server according to the third conference data.

Optionally, the apparatus further comprises:

a first request receiving module of the coordination transfer, configured to receive, by the coordination transfer server, a first call request message sent by the control terminal, and send, according to the first call request message, a second call request message to the internet terminal; and the internet terminal is used for responding the second call request message to join the network conference.

Optionally, the apparatus further comprises:

and the protocol conversion generating module is used for generating a protocol conversion virtual terminal by the protocol conversion server and adding the protocol conversion virtual terminal into the video network.

Optionally, the cooperative transmitting and receiving module includes:

the first conference data receiving module is used for receiving the first conference data sent by the internet terminal by the internet module; the first conference data comprises first audio stream data and first video stream data which are encapsulated according to an RTP protocol;

a first conference data sending module, configured to send, by the protocol server, second conference data to the video networking server according to the first conference data, where the first conference data sending module includes:

the decapsulation first conference data module is used for decapsulating the first conference data by the internet module to obtain the first audio stream data and the first video stream data;

the audio and video data sending module is used for sending the first audio stream data and the first video stream data to the video networking module by the internet module;

a second conference data encapsulating module, configured to encapsulate, by the video networking module, the first audio stream data and the first video stream data into second audio stream data and second video stream data, respectively, according to a video networking protocol, and use the second audio stream data and the second video stream data as second conference data;

and the second conference data sending module is used for sending the second conference data to the video networking server by the video networking module.

Optionally, the protocol forwarding data receiving module includes:

a third conference data receiving module, configured to receive, by the video networking module, third conference data that is sent by the video networking server and is encapsulated according to a video networking protocol; the third conferencing data comprises a third audio data stream and a third video data stream;

a fourth conference data sending module, configured to send, by the collaboration server, fourth conference data to the internet terminal according to the third conference data, where the fourth conference data sending module includes:

a fourth audio and video data generation module, configured to decapsulate the third audio data stream and the third video data stream, respectively, by the video networking module, and generate a fourth audio data stream and a fourth video data stream;

a fourth audio and video data sending module, configured to send the fourth audio data stream and the fourth video data stream to the internet module by the video networking module;

a fourth conference data encapsulation module, configured to encapsulate, by the internet module, the fourth audio data stream and the fourth video data stream into fourth conference data according to an RTP protocol;

Optionally, the first request receiving module for the protocol switch comprises

A first request receiving module of the video network, which is used for the video network module to receive a first call request message sent by the control terminal;

the first call module is used for converting the first call request message into a first call response message by the video networking module and sending the first call response message to the Internet module;

and the internet sending second calling module is used for converting the first call response message into a second call request message by the internet module and sending the second call request message to the internet terminal.

the recording and broadcasting receiving module is used for receiving a recording and broadcasting request message which is sent by the control terminal and aims at the internet terminal after the video networking terminal and the internet terminal join the network conference created by the control terminal;

the recorded broadcast sending module is used for sending a recorded broadcast response message to the video network server by the recorded broadcast server according to the recorded broadcast request message;

and the recorded broadcast receiving data module is used for receiving second conference data returned by the video network server in response to the recorded broadcast response message by the recorded broadcast server.

Optionally, the apparatus further comprises:

the recorded broadcast encapsulation module is used for the recorded broadcast server to respectively decapsulate second audio stream data and second video stream data into the first audio stream data and the first video stream data;

and the recorded broadcast sending and storing module is used for sending the first audio stream data and the first video stream data to a preset storing module by the recorded broadcast server and packaging the first audio stream data and the first video stream data according to a preset broadcast protocol.

The embodiment of the invention also discloses a device, which comprises: a processor, a memory and a computer program stored on the memory and capable of running on the processor, the computer program, when executed by the processor, implementing the steps of the conference data recording method as described in any one of the above.

The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the steps of the conference data recording method are realized.

The embodiment of the invention has the following advantages: the invention can establish a network conference through the control terminal and control the video network terminal and the internet terminal to join the network conference, the control terminal sends a recording and broadcasting request message aiming at the internet terminal to the recording and broadcasting server, and the recording and broadcasting server is used for sending a recording and broadcasting response message to the video network server according to the recording and broadcasting request message. The invention can record the audio and video content of the internet terminal, store the audio and video content in the recording and broadcasting server, provide the user with access to the recording file, facilitate the use of the user, reduce the cost of establishing the network conference, reduce the operation difficulty of the conference and improve the use experience of the user.

Drawings

Fig. 1 is a flowchart of the steps of one embodiment of a method for recording conference data according to the present invention;

fig. 2 is a schematic diagram of a device connection of a conference data recording method according to the present invention;

fig. 3 is a flowchart illustrating the steps of one embodiment of a method for recording conference data according to the present invention;

fig. 4 is a flowchart illustrating the steps of one embodiment of a method for recording conference data according to the present invention;

fig. 5 is a flowchart illustrating steps of one embodiment of a method for recording conference data according to the present invention;

fig. 6 is a message transmission diagram of one embodiment of a conference data recording method according to the present invention;

fig. 7 is a schematic structural diagram of one embodiment of a conference data recording apparatus according to the present invention;

fig. 8 is a schematic diagram of data transmission of one embodiment of a conference data recording apparatus according to the present invention;

fig. 9 is a schematic structural diagram of one embodiment of a conference data recording apparatus according to the present invention;

fig. 10 is a schematic structural diagram of one embodiment of a conference data recording apparatus according to the present invention;

fig. 11 is a schematic structural diagram of one embodiment of a conference data recording apparatus according to the present invention;

FIG. 12 is a networking schematic of a video network of the present invention;

FIG. 13 is a diagram of a hardware architecture of a node server according to the present invention;

fig. 14 is a schematic diagram of a hardware architecture of an access switch of the present invention;

fig. 15 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Referring to fig. 1, a flowchart illustrating steps of one embodiment of a method for recording conference data according to the present invention is shown. The method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server.

In this embodiment, the method may be applied to a network conference, and in particular, may be applied to a network conference between a video network terminal and an internet terminal.

In this embodiment, the video network terminal may be configured to launch the network video data on the display screen for receiving or sending the network video data.

In this embodiment, the video networking server is configured to receive video data sent by each terminal, forward the video data to a fixed format received by the video networking terminal, and send the video data after format conversion to the video networking terminal.

In this embodiment, the control terminal may be a PC terminal, a mobile phone or other terminals, and optionally, the control terminal may be installed with pamir software, where the pamir software is conference control software independently developed by visual linkage, and organizes a video networking conference by calling multiple video networking terminal participants, and is software for controlling a conference function in a conference. The control terminal can be used for creating a network conference, controlling terminals such as a video network terminal and an internet terminal to join the network conference, and controlling a speaking party of the conference.

In this embodiment, the protocol conversion server may be an XMCU server or an H323 protocol conversion server, may be responsible for communication, and has functions of converting streaming media protocol and encapsulating audio and video data packets. The data format conversion method can be used for being connected with the Internet terminal, converting the data sent by the video networking terminal into the data format of the Internet terminal according to a specific Internet protocol, or converting the data sent by the Internet terminal into the format corresponding to the video networking protocol.

In this embodiment, the recording and playing server may be a server that records, stores, and controls audio and video captured by a participant terminal in a video network terminal conference.

Referring to fig. 2, a device connection diagram of a conference data recording method according to the present invention is shown. In this embodiment, the control terminal may be a PC terminal installed with pamir, and the internet terminal is a conference terminal with model Te 30. The method for connecting the devices can refer to fig. 2, a video network terminal can be connected with a video network server, the video network server can be connected with a first switch, a control terminal, a transfer server and a recording and broadcasting server can be respectively connected with the first switch, the transfer server can be connected with an internet terminal through a second switch, and the recording and broadcasting server can be connected with a PC terminal of a user.

Specifically, the method may include:

step 501, the control terminal establishes a network conference and controls the video networking terminal and the internet terminal to join the network conference; and the Internet terminal is used for sending first conference data to the first protocol conversion server after the Internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data.

In this embodiment, the control terminal may establish a network conference, and after the network conference is established, one or more video networking terminals and one or more internet terminals may be added to the network conference, respectively. In the network conference, the control terminal can set one of the video network terminals as a chairman, and the chairman can be used for setting a specific speaking party. In the network conference, the conference members can be divided into a speaking party and a listening party, the listening party can hear and see the speaking content of the speaking party, the listening party cannot speak, and the speaking party can speak. After the chairman is set, the video networking terminal of the chairman can randomly select a plurality of internet terminals or video networking terminals participating in the conference as a speaking party, and after the selection, the speaking party can start speaking and send audio data and video data to the server through the terminal corresponding to the speaking party for the listening party to listen to and watch.

In a specific implementation, the collaboration server and the recording and broadcasting server may be provided with corresponding virtual terminals, for example, the collaboration server may preset a collaboration virtual terminal, the recording and broadcasting server may preset a recording and broadcasting virtual terminal, the control terminal may add the collaboration virtual terminal and the recording and broadcasting virtual terminal to the network conference, the collaboration server may receive or send audio data and video data through the collaboration virtual terminal, and the recording and broadcasting server may also receive audio data and video data through the recording and broadcasting virtual terminal.

In specific implementation, when the chairman terminal is set to be the speaking party, the internet terminal can send first conference data to the video network terminal to the protocol server, the protocol server can convert the first conference data sent by the internet terminal into second conference data according to a video network protocol, the second conference data is sent to the video network server, and the video network server sends the second conference data to the video network terminal. The first conference data may include audio data and video data, and the second conference data may also include audio data and video data.

Step 502, the control terminal sends a recorded broadcast request message for the internet terminal to the recorded broadcast server, and the recorded broadcast server is used for sending a recorded broadcast response message to the video network server according to the recorded broadcast request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message.

In this embodiment, after the control terminal selects a certain terminal participating in the conference as a conference chairman, when the conference chairman selects one of the internet terminals as a speaking party, the internet terminal may send the audio data and the video data to the coordination server, the coordination server may convert the audio data and the video data of the internet terminal into a video networking format, and then send the video networking format to the video networking server, and then the video networking server sends the format-converted audio data and video data to each video networking terminal. When the protocol conversion server sends the audio data and the video data with the converted formats to the video network server, the control terminal can send a recorded broadcast request message aiming at the internet terminal to the recorded broadcast server, the recorded broadcast server can send a recorded broadcast response message to the video network server according to the recorded broadcast request message, the video network server can send the audio data and the video data with the converted formats to the recorded broadcast server after receiving the recorded broadcast response message, the recorded broadcast server can receive second conference data sent by the video network server, and the second conference data comprise the audio data and the video data with the converted formats by the protocol conversion server.

In this embodiment, the recording request message sent by the control terminal to the recording server may be a call request message 8e01 adapted to the video network, and the recording response message sent by the recording server to the video network server may be a call response message 8e02 adapted to the video network.

The audio data and the video data are sent to the coordination server through the internet terminal, format conversion can be carried out on the audio data and the video data through the coordination server, the audio data and the video data are made to accord with the format of a video networking protocol, then the audio data and the video data in the converted format are sent to the video networking server through the coordination server, and the video networking server sends the audio data and the video data to each video networking terminal for each video networking terminal to watch and listen. When the co-rotating server sends the audio data and the video data to the video network server, the control terminal can send a recorded broadcast request message to the recorded broadcast server, the recorded broadcast server can respond to the recorded broadcast request message and send a recorded broadcast response message to the video network server, the video network server can respond to the recorded broadcast response message and send the audio data and the video data to the recorded broadcast server, and finally the recorded broadcast server receives the audio data and the video data, so that the data of the internet terminal can be received, and the audio data and the video data of the internet terminal can be recorded and broadcast.

In an optional embodiment of the present invention, a network conference may be established through the control terminal, and the video network terminal and the internet terminal are controlled to join the network conference, the control terminal sends a recording and broadcasting request message for the internet terminal to the recording and broadcasting server, and the recording and broadcasting server is configured to send a recording and broadcasting response message to the video network server according to the recording and broadcasting request message. The invention can record the audio and video content of the internet terminal, store the audio and video content in the recording and broadcasting server, provide the user with access to the recording file, facilitate the use of the user, reduce the cost of establishing the network conference, reduce the operation difficulty of the conference and improve the use experience of the user.

Referring to fig. 3, a flowchart illustrating steps of one embodiment of a method for recording conference data according to the present invention is shown. The method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server.

Specifically, the method may include:

step 601, the control terminal sends a third call request message to the video networking server, the video networking server is used for sending a second call response message to the video networking terminal according to the third call request message, and the video networking terminal responds to the second call response message and joins in the network conference.

The control terminal can send a third call request message to the video networking server, after the video networking server receives the third call request message, the video networking server sends a second call response message to the video networking terminal according to the third call request message, and the video networking terminal can respond to the second call response message and join the network conference.

In this embodiment, the third call request message may be a call request message 8e01 adapted to the internet of view, which may be used to call the internet of view server, and the internet of view server may convert the call request message 8e01 into a second call answer message for sending to the internet of view terminal, which may be a call answer message 8e02 adapted to the internet of view, and the internet of view terminal may join the network conference in response to the call answer message 8e 02.

Step 602, the control terminal establishes a network conference and controls the video networking terminal and the internet terminal to join the network conference; and the Internet terminal is used for sending first conference data to the first protocol conversion server after the Internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data.

In this embodiment, step 602 may include the following sub-steps:

substep 6021, the control terminal sends a first call request message to the cooperative conversion server; the protocol conversion server is used for sending a second call request message to the internet terminal according to the first call request message, and the internet terminal is used for responding to the second call request message and joining the network conference.

In actual operation, the control terminal adds a protocol virtual terminal preset by the protocol server to the network conference, and the protocol server can use the protocol virtual terminal to receive or send data and can also be used for receiving and sending commands or requests. Specifically, the control terminal may send a first call request message to the coordination server, and the first call request message may be a call request message 8e01 adapted to the video network; after receiving the first call request message, the collaboration server may convert the first call request message into a second call request message adapted to the internet, where the second call request message may be sent to the internet terminal and may be used to call the internet terminal to join the network conference. In particular, the second call request message may be an internet-adapted callsetup.

After the video networking terminal and the internet terminal are added into the network conference, the video networking terminal and the internet terminal can be connected on line, and video data transmission of the video networking terminal and the internet terminal is achieved.

Step 603, the control terminal sends a recorded broadcast request message for the internet terminal to the recorded broadcast server, and the recorded broadcast server is used for sending a recorded broadcast response message to the video network server according to the recorded broadcast request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message.

In a preferred embodiment of the present invention, a third call request message is sent to the video networking server through the control terminal, the video networking server is configured to send a second call response message to the video networking terminal according to the third call request message, the video networking terminal responds to the second call response message to join in a network conference, and then the control terminal establishes the network conference and controls the video networking terminal and the internet terminal to join in the network conference; the internet terminal is used for sending first conference data to the first protocol server after joining the network conference, the protocol server is used for sending second conference data to the video network server according to the first conference data, the control terminal sends a recording and broadcasting request message aiming at the internet terminal to the recording and broadcasting server, and the recording and broadcasting server is used for sending a recording and broadcasting response message to the video network server according to the recording and broadcasting request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message. The invention can add the video networking terminal and the internet terminal to the network conference through the control terminal, can add the internet terminal quickly, and improves the speed of the internet terminal entering the conference, and the invention can record the audio and video content of the internet terminal and store the recorded audio and video content on the recording and broadcasting server, and finally can access the recorded file on the browser of a PC through inputting the IP address of the recording and broadcasting server, thereby being convenient for users to use, reducing the cost of establishing the network conference, reducing the operation difficulty of the conference, and improving the use experience of the users.

Referring to fig. 4, a flowchart illustrating steps of one embodiment of a method for recording conference data according to the present invention is shown. The method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server.

Specifically, the method may include:

and 701, after the video networking terminal and the internet terminal join the network conference created by the control terminal, the protocol conversion server receives first conference data sent by the internet terminal.

In this embodiment, after the control terminal creates the web conference, the video networking terminal and the internet terminal may be added to the web conference, and then the control terminal may select one of the terminals participating in the conference as a conference chairman terminal, and the conference chairman terminal may select any one of the terminals participating in the conference as a speaking party. The first conference data may comprise audio data and video data.

Step 702, the protocol conversion server sends second conference data to the video network server according to the first conference data; and the video network server is used for sending the second conference data to the recording and broadcasting server and/or the video network terminal.

In this embodiment, the protocol conversion server may convert the first conference data sent by the internet terminal into second conference data adapted to the video network, and send the second conference data to the video network server, where the video network server sends the second conference data to each video network terminal, or the video network server sends the second conference data to the recording and broadcasting server, where the recording and broadcasting server receives and records the second conference data, and encapsulates the second conference into a specific format for storage.

Step 703, the protocol conversion server receives third conference data sent by the video network server; and the third conference data is sent to the video network server by the video network terminal.

In this embodiment, the collaboration server may further receive third conference data sent by the video networking server, where the third conference data may be sent to the video networking server by the video networking terminal, and the third conference data may include audio data and video data.

In the network conference, when the speaking party is the video networking terminal, the video networking terminal can send the audio data of the video networking terminal and the video data of the video networking terminal to the video networking server, the video networking server sends the video data of the video networking terminal and the video data of the video networking terminal to the protocol conversion server, the protocol conversion server converts the audio data and the video data of the video networking terminal into the audio data and video data which are adaptive to the internet format, and therefore the audio data and the video data can be watched by the internet terminal.

Step 704, the collaboration server sends fourth conference data to the internet terminal according to the third conference data.

In this embodiment, the collaboration server may convert the third conference data into fourth conference data adapted to the internet, and then send the fourth conference data to the internet terminal for the internet terminal to view.

In an optional embodiment of the present invention, the protocol conversion server receives first conference data sent by the internet terminal, then the protocol conversion server sends second conference data to the video networking server according to the first conference data, then the protocol conversion server receives third conference data sent by the video networking server, and finally the protocol conversion server sends fourth conference data to the internet terminal according to the third conference data. The invention can reduce the cost of establishing the network conference, and can record and broadcast the internet terminal and the video network terminal in the network conference, thereby reducing the operation difficulty of the conference and improving the use experience of users.

Referring to fig. 5, a flowchart illustrating steps of one embodiment of a method for recording conference data according to the present invention is shown. The method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server.

Specifically, the method may include:

step 801, the protocol conversion server generates a protocol conversion virtual terminal, and the protocol conversion virtual terminal is added into the video network.

After the network conference which is the network environment is established by the control terminal, the protocol conversion server can convert some virtual terminals which can be subjected to protocol conversion into virtual terminals in a virtual mode. The collaboration virtual terminal can be used for representing a collaboration server, can be used as a participant of a network conference, and can be displayed in the network conference; the collaboration server may also be connected to an internet terminal, and the collaboration virtual terminal may represent the internet terminal, through which the internet terminal may be displayed in the web conference. When the control terminal selects the cooperation virtual terminal as a speaking party, the internet terminal connected with the cooperation server can speak. Therefore, the internet terminal can be added into the network conference to carry out network conversation with the video network terminal.

Step 802, the coordination server receives a first call request message sent by the control terminal, and sends a second call request message to the internet terminal according to the first call request message; and the internet terminal is used for responding the second call request message to join the network conference.

In this embodiment, after the collaboration server may generate the collaboration virtual terminal, the collaboration server waits for a request of the control terminal, and then adds the internet terminal connected to the collaboration server to the web conference according to the request of the control terminal, optionally, the collaboration virtual terminal generated by the collaboration server may be loaded to the web conference, and the collaboration virtual terminal may be connected to the internet terminal, and the internet terminal may add the internet terminal to the web conference with the identity of the collaboration virtual terminal.

In practical implementation, the collaboration server may receive a first call request message sent by the control terminal, convert the first call request message into a second call request message applicable to an internet format, and send the second call request message to the internet terminal. In particular, the first call request message may be a video network adapted call request message 8e01 and the second call request message may be an internet adapted call request message 8e 01.

Referring to fig. 6, a message transmission diagram of one embodiment of a conference data recording method according to the present invention is shown. In this embodiment, the collaboration server may include an internet module and a video networking module, the video networking module may be configured to receive or send data or messages adapted to the video networking, the internet module may be configured to receive or send data or messages adapted to the internet, the video networking module may be connected to the internet module, and specifically step 802 may include the following sub-steps:

substep 8021, the video networking module receives a first call request message sent by the control terminal;

in this embodiment, the video networking module may be configured to receive or send data or a message adapted to the video networking, and the video networking module may receive the first call request message sent by the control terminal, so as to improve a rate of receiving the message.

Substep 8022, said video networking module converting said first call request message into a first call answer message and sending said first call answer message to said internet module;

in this embodiment, the first call request message may be converted into a first call answer message by the internet of view module, which may be a call answer message 8e02 adapted to the internet of view, which may be used to prompt the internet module.

Sub-step 8023, the internet module converts the first call response message into a second call request message, and sends the second call request message to the internet terminal.

In this embodiment, the internet module may convert the first call response message into a second call request message, where the second call request message may be a callsetup adapted to the internet, and may be used to prompt the internet terminal, so that the internet terminal sends a message or joins the network conference.

In this embodiment, the video networking module and the internet module are used in cooperation with each other, so that a message sent by the control terminal can be converted, a message or data adapted to the video networking can be converted into a message or data adapted to the internet, the message or data adapted to the internet can also be converted into a message or data adapted to the video networking, the data interaction rate between the video networking terminal and the internet terminal can be increased, the data or messages sent by the internet terminal can also be processed or managed, and therefore video data or audio data of the internet terminal can be recorded.

And 803, after the video networking terminal and the internet terminal join the network conference created by the control terminal, the protocol conversion server receives the first conference data sent by the internet terminal.

In this embodiment, the collaboration server may include a video networking module and an internet module, and step 803 may include the following sub-steps:

a substep 8031, receiving the first conference data sent by the internet terminal by the internet module; the first conference data comprises first audio stream data and first video stream data encapsulated according to an RTP protocol.

In particular, the internet module may be used to receive or transmit data or messages adapted to the internet. The first conference data transmitted from the internet terminal may be received by the internet module. In this embodiment, the first conference data may include first audio stream data and first video stream data encapsulated according to a Real-time Transport Protocol (RTP), where the first audio stream data may be an audio Protocol stream in a G711 format, and the first video stream data may be a video Protocol stream in a H264 format.

Step 804, the protocol conversion server sends second conference data to the video network server according to the first conference data; and the video network server is used for sending the second conference data to the recording and broadcasting server and/or the video network terminal.

In this embodiment, step 804 may include the following sub-steps:

substep 8041, decapsulating the first conference data by the internet module to obtain the first audio stream data and the first video stream data.

In this embodiment, the internet module may be configured to receive or send data or messages adapted to the internet, and may receive the first conference data sent by the internet terminal, and then encapsulate the first conference data to obtain the first audio stream data and the first video stream data.

Specifically, the internet module may encapsulate the first conference data according to the RTP protocol to obtain first audio stream data and first video stream data.

Substep 8042, said internet module sending said first audio stream data and said first video stream data to said video networking module.

In this embodiment, the video networking module may be configured to receive or send data or a message adapted to the video networking, the video networking module is connected to the internet module, the internet module encapsulates the first conference data according to an RTP protocol to obtain first audio stream data and first video stream data, and then may send the first audio stream data and the first video stream data to the video networking module, and the video networking module may receive the first audio stream data and the first video stream data, convert the first audio stream data and the first video stream data into audio stream data and video stream data adapted to the video networking, so as to be viewed by the video networking terminal.

Substep 8043, said video networking module encapsulates said first audio stream data and said first video stream data into second audio stream data and second video stream data, respectively, according to a video networking protocol, as second conference data.

In this embodiment, the video networking module may encapsulate the first audio stream data and the first video stream data into second audio stream data and second video stream data according to a video networking protocol, respectively, and use the second audio stream data and the second video stream data as second conference data, where the second audio stream data may be 2001 audio stream data of the audio protocol data, and the second video stream data may be 2002 video stream data of the video protocol data.

Substep 8044, said video networking module sending said second conference data to said video networking server.

In this embodiment, the video networking module may send the second audio stream data and the second video stream data to the video networking server, and the video networking server sends the second audio stream data and the second video stream data to each video networking terminal, and each video networking terminal may see the audio data and the video data of the internet terminal.

Step 805, the protocol conversion server receives third conference data sent by the video network server; and the third conference data is sent to the video network server by the video network terminal.

In this embodiment, the collaboration server may include an internet module and a video network module, and step 805 may include the following sub-steps:

substep 8051, the video networking module receives third conference data packaged according to the video networking protocol and sent by the video networking server; the third conferencing data comprises a third audio data stream and a third video data stream.

In a specific operation, third conference data packaged according to a video networking protocol and sent by a video networking server can be received through the video networking module, wherein the third conference data can comprise a third audio data stream of the video networking terminal and a third video data stream of the video networking terminal. In this embodiment, the third audio data stream may be 2001 audio stream data of the video networking audio protocol, and the third video data stream may be 2002 audio stream data of the video networking video protocol.

Step 806, the coordination server sends fourth conference data to the internet terminal according to the third conference data.

In this embodiment, step 806 may include the following sub-steps:

substep 8061, the video networking module decapsulates the third audio data stream and the third video data stream respectively to generate a fourth audio data stream and a fourth video data stream;

in this embodiment, third conference data may be received by the video networking module, and the third conference data may include a third audio data stream of the video networking terminal and a third video data stream of the video networking terminal. The video networking module may decapsulate the third audio data stream and the third video data stream according to an RTP protocol, respectively, to generate fourth audio data and fourth video data.

Specifically, the video networking module can decapsulate and convert 2001 audio stream data of the video networking audio protocol into audio protocol stream in the G711 format, and can decapsulate and convert 2002 audio stream data of the video networking video protocol into video protocol stream in the H264 format.

Substep 8062, said video networking module sending said fourth audio data stream and said fourth video data stream to said internet module.

In this embodiment, the video networking module may transmit the converted fourth audio data stream and the fourth video data stream adapted to the internet module, and the internet module transmits the converted fourth audio data stream and the converted fourth video data stream to the internet terminal.

Substep 8063, said internet module encapsulates said fourth audio data stream and said fourth video data stream into fourth conference data according to RTP protocol.

In this embodiment, the internet module may encapsulate the fourth audio data stream and the fourth video data stream into fourth conference data according to a Real-time Transport Protocol (Real-time Transport Protocol).

Substep 8064, said internet module sending said fourth conference data to said internet terminal.

In this embodiment, the internet module sends the fourth conference data to the internet terminal for the internet terminal to view.

In an optional embodiment of the present invention, a protocol conversion virtual terminal is generated by the protocol conversion server, a video network is added through the protocol conversion virtual terminal, then the protocol conversion server receives a first call request message sent by the control terminal, and sends a second call request message to the internet terminal according to the first call request message, then the protocol conversion server receives first conference data sent by the internet terminal, then the protocol conversion server sends second conference data to the video network server according to the first conference data, the protocol conversion server receives third conference data sent by the video network server, and finally the protocol conversion server sends fourth conference data to the internet terminal according to the third conference data. The invention can reduce the cost of establishing the network conference, and can record and broadcast the internet terminal and the video network terminal in the network conference, thereby reducing the operation difficulty of the conference and improving the use experience of users.

Referring to fig. 7, a schematic structural diagram of one embodiment of a conference data recording apparatus according to the present invention is shown. The method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server.

Specifically, the method may include:

step 901, after the video networking terminal and the internet terminal join the network conference created by the control terminal, the recording and broadcasting server receives a recording and broadcasting request message for the internet terminal sent by the control terminal.

In this embodiment, the control terminal may create a web conference, and after the web conference is created, the video networking terminal and the internet terminal may be added to the web conference. After the video networking terminal and the internet terminal join the network conference, the control terminal can select a conference chairman terminal from all terminals participating in the conference, the conference terminal can select a speaking party of the network conference, when the speaking party of the conference is the internet terminal, the internet terminal can send audio data and video data to the protocol server, and the protocol server can send the audio data and the video data to the video networking server. When the internet terminal is selected as a speaking party, the control terminal may send a recording and broadcasting request message for the internet terminal to the recording and broadcasting server, where the recording and broadcasting request message may be used to control the recording and broadcasting server to start recording and broadcasting the audio data and the video data sent by the internet terminal.

In a specific operation, the recording request message may be a call request message 8e01 adapted to the video network.

And step 902, the recording and broadcasting server sends a recording and broadcasting response message to the video network server according to the recording and broadcasting request message.

In this embodiment, after receiving the recording request message, the recording server may convert the recording request message into a response message, and send the response message to the video network server.

In a particular operation, the recorded response message may be a call response message 8e02 adapted to the video network.

Step 903, the recording and broadcasting server receives second conference data returned by the video network server responding to the recording and broadcasting response message.

In this embodiment, after the video network server receives the recorded broadcast response message sent by the recorded broadcast server, the audio data and the video data sent by the cooperative conversion server to the video network server can be sent to the recorded broadcast server, the recorded broadcast server can receive the audio data and the video data, and the audio data and the video data can be second conference data which is converted and adapted to the audio data and the video data of the video network through the cooperative conversion service network.

In a specific operation, the second conference data may include second audio stream data, which may be 2001 audio stream data of the audio protocol data, and second video stream data, which may be 2002 video stream data of the video protocol data.

Step 904, the recording and playing server decapsulates the second audio stream data and the second video stream data into the first audio stream data and the first video stream data, respectively.

In this embodiment, the recording and playing server may decapsulate the second audio stream data and the second video stream data, decapsulate the second audio stream data into the first audio stream data, and decapsulate the second video stream data into the first video stream data, respectively.

In specific operation, the recording and playing server can decapsulate and convert 2001 audio stream data of the video networking audio protocol into audio protocol stream in a G711 format, and can decapsulate and convert 2002 audio stream data of the video networking audio protocol into video protocol stream in an H264 format.

Step 905, the recording and playing server sends the first audio stream data and the first video stream data to a preset storage module, and encapsulates the first audio stream data and the first video stream data according to a preset playing protocol.

In a specific operation, the recording and playing server may send the first audio stream data and the first video stream data to the preset storage module, and the preset storage module may package the first audio stream data and the first video stream data according to a preset playing protocol, and then store the first audio stream data and the first video stream data packaged by the playing protocol in a preset database of the recording and playing server.

Specifically, the preset storage module may encapsulate the first audio stream data and the first video stream data encapsulated by the playing protocol by the MP4 protocol, and finally store the first audio stream data and the first video stream data as a file of MP4 in the preset database of the recording and playing server.

When a user needs to watch recorded and broadcast files, the user can use a PC machine in the same network segment as the recorded and broadcast server, input the IP address of the recorded and broadcast server on a browser of the PC machine, log in, find the stored recorded and broadcast files, and play the videos of the recorded and broadcast files through a video playing plug-in integrated with the browser.

Optionally, the recording and broadcasting server may also include a video networking module and a storage module, the video networking module may be connected with the storage module, and the video networking module may be configured to receive or transmit data or messages adapted to the video networking. Specifically, the recording and playing server may receive the second audio stream data and the second video stream data through the video networking module. And decapsulating the second audio stream data into first audio stream data and decapsulating the second video stream data into first video stream data by the video networking module. The video network module sends the first audio stream data and the first video stream data to the storage module, and the storage module stores the first audio stream data and the first video stream data.

Referring to fig. 8, a data transmission diagram of one embodiment of a conference data recording apparatus according to the present invention is shown. In specific operation, the control terminal respectively sends a meeting opening instruction to the video networking server and the coordination server, the video networking terminal is added into the network conference through the video networking server, and the internet terminal is added into the network conference through the coordination server. When the internet terminal sends audio data and video data to the corotation server, the corotation server sends the audio data and the video data to the video network server, the video network server sends the audio data and the video data to the video network terminal, meanwhile, the control terminal sends a recording and broadcasting instruction to the recording and broadcasting server, after the recording and broadcasting server receives the recording and broadcasting instruction, the recording and broadcasting server can respond to the recording and broadcasting instruction and send a recording and broadcasting responding instruction to the video network server, after the video network server receives the recording and broadcasting responding instruction, the video network server can send the audio data and the video data to the recording and broadcasting server, and after receiving the audio data and the video data, the recording and broadcasting server can send the audio data and the video data to a PC terminal of a user for the user to watch.

In an optional embodiment of the present invention, the recording and broadcasting request message for the internet terminal sent by the control terminal may be received by the recording and broadcasting server; then the recording and broadcasting server sends a recording and broadcasting response message to the video network server according to the recording and broadcasting request message; then the recording and broadcasting server receives second conference data returned by the video networking server responding to the recording and broadcasting response message; then the recording and playing server respectively decapsulates second audio stream data and second video stream data into the first audio stream data and the first video stream data; and finally, the recording and playing server sends the first audio stream data and the first video stream data to a preset storage module and packages the first audio stream data and the first video stream data according to a preset playing protocol. The invention can reduce the cost of establishing the network conference, and can record and broadcast the internet terminal and the video network terminal in the network conference, thereby reducing the operation difficulty of the conference and improving the use experience of users.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 9, a conference data recording apparatus according to an embodiment of the present invention is shown, where the apparatus is applied to a video network, the video network is communicatively connected to an ethernet network, where the video network includes a proxy sending end, a video network server, and a proxy receiving end, and the ethernet network includes a first site and a second site; the first site is in communication connection with the agent sending end, and the second site is in communication connection with the agent receiving end; the apparatus may include the following modules:

a control terminal establishing module 1001, configured to establish a network conference by the control terminal, and control the video networking terminal and the internet terminal to join the network conference; the Internet terminal is used for sending first conference data to the first protocol conversion server after the Internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data;

a control terminal sending module 1002, configured to send a recorded broadcast request message for the internet terminal to the recorded broadcast server by the control terminal, where the recorded broadcast server is configured to send a recorded broadcast response message to the video networking server according to the recorded broadcast request message; and the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message.

Optionally, the control terminal establishing module includes:

Referring to fig. 10, a conference data recording apparatus according to an embodiment of the present invention is shown, where the apparatus is applied to a video network, the video network is communicatively connected to an ethernet network, where the video network includes a proxy sending end, a video network server, and a proxy receiving end, and the ethernet network includes a first site and a second site; the first site is in communication connection with the agent sending end, and the second site is in communication connection with the agent receiving end; the apparatus may include the following modules:

a protocol conversion receiving module 1101, configured to receive, by the protocol conversion server, first conference data sent by the internet terminal after the video networking terminal and the internet terminal join the network conference created by the control terminal;

a protocol forwarding module 1102, configured to send, by the protocol server, second conference data to the video networking server according to the first conference data; the video network server is used for sending the second conference data to the recording and broadcasting server and/or the video network terminal;

a protocol conversion data receiving module 1103, configured to receive, by the protocol conversion server, third conference data sent by the video network server; the third conference data is sent to the video networking server by the video networking terminal;

and a data forwarding module 1104, configured to send, by the forwarding server, fourth conference data to the internet terminal according to the third conference data.

Optionally, the apparatus further comprises:

Optionally, the cooperative transmitting and receiving module includes:

Optionally, the protocol forwarding data receiving module includes:

Referring to fig. 11, a conference data recording apparatus according to an embodiment of the present invention is shown, where the apparatus is applied to a video network, and the video network is communicatively connected to an ethernet network, where the video network includes an agent sending end, a video network server, and an agent receiving end, and the ethernet network includes a first site and a second site; the first site is in communication connection with the agent sending end, and the second site is in communication connection with the agent receiving end; the apparatus may include the following modules:

a recording and broadcasting receiving module 1201, configured to receive, by the recording and broadcasting server, a recording and broadcasting request message for the internet terminal sent by the control terminal after the video networking terminal and the internet terminal join the network conference created by the control terminal;

a recorded broadcast sending module 1202, configured to send, by the recorded broadcast server, a recorded broadcast response message to the video network server according to the recorded broadcast request message;

a recorded broadcast receiving data module 1203, configured to receive, by the recorded broadcast server, second conference data returned by the video network server in response to the recorded broadcast response message.

Optionally, the apparatus further comprises:

a recorded broadcast sending storage module, configured to send the first audio stream data and the first video stream data to a preset storage module by the recorded broadcast server, and package the first audio stream data and the first video stream data according to a preset broadcast protocol

For the embodiment of the conference data recording device, since it is basically similar to the embodiment of the conference data recording method, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the embodiment of the conference data recording method.

An embodiment of the present invention further provides an apparatus, including:

one or more processors; and

one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform one or more methods of recording conference data as described in embodiments of the invention.

The embodiment of the invention also provides a computer-readable storage medium, and a stored computer program enables a processor to execute the conference data recording method according to the embodiment of the invention.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 12, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 13, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 14, the network interface module (downstream network interface module 301, upstream network interface module 302), switching engine module 303, and CPU module 304 are mainly included;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 15, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The conference data recording method, the conference data recording device and the computer readable storage medium provided by the invention are described in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A conference data recording method is characterized in that the method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server, and the method comprises the following steps:

the control terminal establishes a network conference and controls the video networking terminal and the Internet terminal to join the network conference; the internet terminal is used for sending first conference data to the protocol conversion server after the internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data;

the control terminal sends a recorded broadcast request message aiming at the Internet terminal to the recorded broadcast server, and the recorded broadcast server is used for sending a recorded broadcast response message to the video network server according to the recorded broadcast request message; the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message;

wherein, the control terminal controls the internet terminal to join the network conference, including:

the control terminal sends a first call request message to the coordination server; the protocol conversion server is used for sending a second call request message to the internet terminal according to the first call request message, and the internet terminal is used for responding to the second call request message and joining the network conference;

wherein the first conference data and the second conference data each comprise audio data and video data.

2. A conference data recording method is characterized in that the method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server, and the method comprises the following steps:

the coordination server sends fourth conference data to the internet terminal according to the third conference data;

wherein, before the internet terminal joins the network conference, the method further comprises:

the protocol conversion server receives a first call request message sent by the control terminal and sends a second call request message to the internet terminal according to the first call request message; the Internet terminal is used for responding to the second call request message and joining the network conference;

wherein the first conference data, the second conference data, the third conference data, and the fourth conference data each include audio data and video data.

3. The method of claim 2, wherein before the coordination server receives the first call request message sent by the control terminal, the method further comprises:

4. The method of claim 2, wherein the collaboration server comprises a video networking module and an internet module;

5. The method of claim 4, wherein the collaboration server receives third conference data sent by the video networking server, comprising:

6. The method of claim 2, wherein the collaboration server comprises a video networking module and an internet module;

7. A conference data recording method is characterized in that the method relates to a video network terminal, a video network server connected with the video network terminal, a control terminal connected with the video network server, a protocol server and a recording and broadcasting server respectively connected with the control terminal, and an internet terminal connected with the protocol server, and the method comprises the following steps:

the recording and broadcasting server receives second conference data returned by the video networking server responding to the recording and broadcasting response message;

wherein the second conference data comprises audio data and video data;

wherein the method further comprises:

8. The method of claim 7, wherein the second conference data comprises second audio stream data and second video stream data, the method further comprising:

9. A conference data recording device is characterized by comprising the following modules:

the control terminal establishing module is used for establishing a network conference by the control terminal and controlling the video networking terminal and the Internet terminal to join the network conference; the internet terminal is used for sending first conference data to the protocol conversion server after the internet terminal joins the network conference, and the protocol conversion server is used for sending second conference data to the video network server according to the first conference data;

the control terminal sending module is used for sending a recorded broadcast request message aiming at the Internet terminal to the recorded broadcast server by the control terminal, and the recorded broadcast server is used for sending a recorded broadcast response message to the video networking server according to the recorded broadcast request message; the recording and broadcasting server is used for receiving second conference data returned by the video networking server in response to the recording and broadcasting response message;

wherein, the control terminal establishing module comprises:

a control sending module, configured to send, by the control terminal, a first call request message to the coordination server; the protocol conversion server is used for sending a second call request message to the internet terminal according to the first call request message, and the internet terminal is used for responding to the second call request message and joining the network conference;

10. A conference data recording apparatus, characterized in that the apparatus comprises:

the auxiliary forwarding data sending module is used for sending fourth conference data to the internet terminal by the auxiliary forwarding server according to the third conference data;

wherein the apparatus further comprises:

a first request receiving module of the coordination transfer, configured to receive, by the coordination transfer server, a first call request message sent by the control terminal, and send, according to the first call request message, a second call request message to the internet terminal; the Internet terminal is used for responding to the second call request message and joining the network conference;

11. The apparatus of claim 10, further comprising:

12. The apparatus of claim 10, wherein the protocol receiving module comprises:

13. The apparatus of claim 12, wherein the protocol receive data module comprises:

14. The apparatus of claim 10, wherein the protocol receiving first request module comprises

15. A conference data recording apparatus, characterized in that the apparatus comprises:

the recorded broadcast receiving data module is used for the recorded broadcast server to receive second conference data returned by the video network server in response to the recorded broadcast response message;

wherein the second conference data comprises audio data and video data;

wherein the apparatus further comprises:

16. The apparatus of claim 15, further comprising:

17. An apparatus, comprising: processor, memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the method of recording conference data according to any one of claims 1 or 2 to 6 or 7 to 8.

18. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of recording conference data according to any one of claims 1 or 2 to 6 or 7 to 8.