CN113259621B - Cloud conference step-by-step recording method and system - Google Patents
Cloud conference step-by-step recording method and system Download PDFInfo
- Publication number
- CN113259621B CN113259621B CN202110799447.XA CN202110799447A CN113259621B CN 113259621 B CN113259621 B CN 113259621B CN 202110799447 A CN202110799447 A CN 202110799447A CN 113259621 B CN113259621 B CN 113259621B
- Authority
- CN
- China
- Prior art keywords
- data
- conference
- recording
- conversion
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a system for recording a cloud conference step by step. By separating data recording and data conversion from each other, the recording of the cloud conference is performed in two steps. The method specifically comprises the following steps: the method comprises the following steps: data entry: establishing a recording service to record source data in the cloud conference process; recording source data into a network disk, and recording a state flag bit of the data; data conversion: establishing data conversion service, regularly reading the state flag bit of the data, and once finding that a conference starts to be recorded, reading the data in the network disk from the conference directory to perform cloud conversion; and generating the converted data into a specific directory in the network disk according to a specific media file format for playback and downloading. The method can improve the high concurrency rate of the confluent recorded MP4, and can effectively improve the abnormal repair capability in the recording process of the cloud conference.
Description
Technical Field
The invention relates to the technical field of cloud conferences, in particular to a cloud conference step-by-step recording method and system.
Background
The cloud conference is an efficient, convenient and low-cost conference form based on a cloud computing technology, and can be used for remote communication and remote assistance by sharing audio, video, terminal desktop, documents, white boards and the like by using various terminal modes such as a telephone, a mobile phone, a computer, a special terminal and the like all over the world.
The cloud conference recording refers to recording original data sent from a client and other cloud servers, including media data such as control signaling data and audio and video data, and accurately converting the data into a playable media file.
In the cloud conference process, not only data fusion of a plurality of video sources, but also data such as a desktop, a document, a white board, a comment, speaker speaking voice, computer playing voice and the like participate in the fusion, and the method is a scene more complex than multi-source video fusion.
In general, cloud recording is performed by generating a playable media file after a cloud recording server encodes and decodes received data in real time, but the problem that the cloud recording is difficult or impossible to understand is that:
problem 1: how to handle backlog data problems when the data processing speed is much slower than the speed of receiving network data;
problem 2: when the service is broken down or the operation and maintenance needs to restart the service, what the recording conference is doing;
problem 3: how to process the recorded conference when the recording is disconnected from the whole system for a period of time and then reconnected;
problem 4: codec operations that are extremely server performance consuming affect the reception of data, resulting in data delay, data loss, and limited amount of concurrency.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a cloud conference step-by-step recording method, which separates data recording and conversion from each other, thereby improving the reliability of cloud conference recording.
The invention provides a cloud conference step-by-step recording method, which comprises the following steps:
data entry: establishing a recording service to record source data in the cloud conference process; recording source data into a network disk, and recording a state flag bit of the data;
data conversion: establishing data conversion service, regularly reading the state flag bit of the data, and once finding that a conference starts to be recorded, reading the data in the network disk from the conference directory to perform cloud conversion;
and generating the converted data into a specific directory in a network disk according to a specific media file format for playback and downloading, or sending the data to a client through a cloud server for playing.
In this scheme, the data entry includes:
the client sends the audio and video data to the cloud server, and the cloud server sends the received audio and video data to the recording server;
and the recording server adds the custom information to construct recorded data, records the state flag bit of the data at the same time, and then writes the data to a network disk to generate a conference data file.
In the scheme, each data in the conference data file is a readable unit, and the head of each unit data is self-defined information; one session corresponds to one conference data file.
In this scheme, the generation of the custom information is specifically as follows:
the client sends various conference control instructions to the cloud server, and the cloud server receives the control instructions and then sends the control instructions to the recording server; and the recording server generates custom information according to the signaling.
In the scheme, the custom information comprises data size, data type, ID of each conference, ID of each video in the conference, distributed position of each video when being displayed and the like.
In this scheme, the data conversion specifically includes:
the data conversion server reads the status flag bit of the data at regular time, reads the conference data file from the network disk once the recording of the conference is found, and performs audio and video coding and decoding conversion processing on the read conference data file;
performing MP4 packaging processing on the data after encoding and decoding;
and writing each frame of data subjected to MP4 packaging processing onto a network disk to generate a media file for playback, or sending the media file to a client through a cloud server for playing.
In the scheme, source data is recorded into a network disk while data is recorded, and when a server is abnormal, an abnormal state mark is written into a database after the abnormality is recovered;
starting a timer, checking the state of the database regularly, finding the abnormal and finished meeting, and switching the recording of the field from the beginning again.
The invention also provides a cloud conference step-by-step recording system, which comprises a cloud server, a recording server, a network disk, a data conversion server and a database;
the cloud server is responsible for receiving audio and video data from the client and sending the data to the recording server;
the cloud server is also responsible for receiving the converted playable media data from the data conversion server and sending the playable media data to the client for playing;
the recording server is responsible for adding custom information to construct recorded data, recording the state flag bit of the data at the same time, and then writing the data to a network disk to generate a conference data file;
the data conversion server is responsible for regularly reading the state flag bit of the data, reading a conference data file from a network disk once a conference is found to start recording, and performing audio and video coding and decoding conversion processing on the read conference data file; performing MP4 packaging processing on the data after encoding and decoding; and writing each frame of data subjected to MP4 packaging processing onto a network disk to generate a media file for playback, or sending the media file to a client through a cloud server for playing.
The database is used as a recording node for conference data conversion, and one conference corresponds to one database record; the abnormal state marks correspond to the conference IDs one by one, and the marks of the conference which are not converted, are converted and are converted are corresponding to the abnormal state marks;
when the conversion service is down in the meeting or the service is stopped artificially or other events causing service interruption occur, the database is always in a conversion state;
when the service returns to normal and the conference system is accessed again, the conversion service checks the conversion state of the server through the internal timer of the program, if the conversion state is found, the abnormal state of the conference is recorded in the abnormal mark of the database, and the conversion of the conference data is stopped.
In the scheme, the system also comprises a timer;
the system records source data into a network disk while recording data, and writes an abnormal state mark into a database after abnormal recovery when a server is abnormal;
the timer is used to check the database state regularly, and if the abnormal meeting is found and the meeting is ended, the recording of the field is switched from the beginning again.
In the scheme, the custom information comprises data size, data type, ID of each conference, ID of each video in the conference and distributed position of each video when being displayed.
In the scheme, the data conversion servers comprise a plurality of data conversion servers, the data conversion servers perform task preemption in a conference bit conversion unit, each data conversion server checks a data conversion state at regular time, and if a convertible task is found, the data conversion server immediately preempts the convertible task; and setting preemption instructions in the database after preemption to prevent other data conversion servers from converting the conference again.
The invention discloses a method and a system for recording a cloud conference step by step. By separating data recording and data conversion from each other, the recording of the cloud conference is performed in two steps. After the data receiving and conversion processing are separated to different servers, the data receiving does not consume memory or CPU, so that the data is larger at high concurrency, and all the data can be correctly recorded by only slightly increasing the data receiving servers. The data conversion server can increase machines and then increase the machines, and can queue the machines for data conversion at the highest consumption speed according to the current machine condition if the machines cannot be increased, and the worst result is that some conferences slightly delay the generation of playback files due to waiting for machine resources in queue, but the reception of data is never influenced, and the problems of data loss, recording failure and the like cannot occur. In addition, the invention records the source data into the network disk while recording the data, when the server is abnormal, an abnormal state mark is written into the database after the abnormal recovery; the timer is used for checking the state of the database at regular time, and the recording of the field is switched from the beginning again when the meeting which is abnormal and has ended is found. The abnormal repairing capability in the recording process of the cloud conference can be effectively improved.
Drawings
Fig. 1 shows a flowchart of a cloud conference step recording method;
fig. 2 shows a block diagram of a cloud conference step recording system.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
Fig. 1 shows a flowchart of a cloud conference step-by-step recording method according to the present application.
As shown in fig. 1, the application discloses a cloud conference step-by-step recording method, which includes the following steps:
s102: data entry: establishing a recording service to record source data in the cloud conference process; recording source data into a network disk, and recording a state flag bit of the data;
s104: data conversion: establishing data conversion service, regularly reading the state flag bit of the data, and once finding that a conference starts to be recorded, reading the data in the network disk from the conference directory to perform cloud conversion;
s106: generating the converted data into a specific directory in a network disk according to a specific media file format for playback and downloading; or the data is sent to the client side through the cloud server for playing.
It should be noted that, the recording of the cloud conference is performed in two steps by separating the data recording and the data conversion from each other. The recording means records the source data into a disk file, and the conversion means that the source data is packaged into a playable file through coding and decoding or a media file format and is stored into a disk. Separate recording and conversion are different processing schemes than the conventional recording and conversion integrated.
The conventional recording method is problematic not only in high concurrency, but also in the case of single-session recording. Therefore, data reception and data processing need to be separated. To balance the dependency of data reception and data processing, it is common practice to divide these two things into different threads for processing. With multi-threaded processing, it should still be possible with a small amount of data, but there is still the problem of data being discarded or memory drain as the amount of data increases. Typically, network data is received very quickly, but is time consuming to process this data into playable media files by encoding and decoding and then packaging.
The invention separates data recording and data conversion from each other, and records the cloud conference in two steps. The data recording and conversion are separated, namely the data recording is put into one service, the coding and decoding conversion is put into another service, the two services belong to different processes or different machines, and the two services do not influence each other. After the data receiving and conversion processing are separated to different servers, the data receiving does not consume memory or CPU, so that the data is larger at high concurrency, and all the data can be correctly recorded by only slightly increasing the data receiving servers. The data conversion server can increase machines and then increase the machines, and can queue the machines for data conversion at the highest consumption speed according to the current machine condition if the machines cannot be increased, and the worst result is that some conferences slightly delay the generation of playback files due to waiting for machine resources in queue, but the reception of data is never influenced, and the problems of data loss, recording failure and the like cannot occur.
According to an embodiment of the invention, the data entry comprises:
the client sends the audio and video data to the cloud server, and the cloud server sends the received audio and video data to the recording server;
and the recording server adds the custom information to construct recorded data, records the state flag bit of the data at the same time, and then writes the data to a network disk to generate a conference data file.
It should be noted that, in this embodiment, the conference data file may be conf.data, and the conf.data file is not a fixed name of the conference data file, and can be changed to other names at any time, and as long as the conference data file belongs to the protection scope of the present invention.
According to the embodiment of the invention, each data in the conf.data is a readable unit, and the head of each unit data is self-defined information; a field corresponds to a conf.
It should be noted that the source data in the cloud conference process is recorded. Besides the received data content, the recorded data needs to be added with necessary recording self-defining information, namely data size and data type. The source data recording server records data into a network disk, and one field corresponds to one conf.data, namely, the conf.data contains signaling and data of the whole cloud conference. Data is a readable unit, and the header convention byte of data of each unit is defined as data size and data type.
It should be noted that the present invention uses two services, namely, the recording server and the data conversion server, to perform data processing separately, but requires cooperative work. Data are shared network disk data conf.data, and a database in the network disk is used as a cooperative medium. In the cloud conference process, when a client starts recording, a source data recording server writes data into a file conf.data and simultaneously writes a state flag bit for starting recording the data into a database. And the conversion server reads the status flag bit of the database at regular time, and once finding out which conference starts to be recorded, reads conf.data data from the directory of the conference and takes each read data to perform corresponding media file conversion. The whole process is equivalent to triggering data conversion processing by a database, and a shared network disk file conf.data is used as an interprocess message and data queue, so that the problems of queue fullness, data loss or machine memory exhaustion in the process of processing a single thread or a plurality of threads in one process are solved.
According to the embodiment of the invention, the generation of the custom information is specifically as follows:
the client sends various conference control instructions to the cloud server, and the cloud server receives the control instructions and then sends the control instructions to the recording server; and the recording server generates custom information according to the signaling.
According to the embodiment of the invention, the custom information comprises data size, data type, ID of each conference, ID of each video in the conference, and distributed position of each video when being displayed.
According to the embodiment of the present invention, the data conversion specifically includes:
the data conversion server reads the status flag bit of the data at regular time, reads the conf.data from the network disk once the conference is found to start recording, and performs audio and video coding and decoding conversion processing on the read conf.data;
performing MP4 packaging processing on the data after encoding and decoding;
and writing each frame of data subjected to MP4 packaging processing onto a network disk to generate a media file for playback, or sending the media file to a client through a cloud server for playing.
The conf.data is used as the original data collected by the client on site and is stored in the server for a long time. Once an abnormality is found in the played MP4 during the later recording and playback, the repair conversion can be reinitiated after the program is modified or the system is upgraded, so as to repair the video with the abnormality.
Data and MP4 files which can be played back are stored separately, a user only deletes the MP4 file after clicking deletion operation on a client side, restoration can be applied when needed, and a server side can initiate conversion again to the user through the conf data to restore the MP4 file.
It should be noted that the media files for playback may be MP4, FLV, HLS, etc., but are not limited to the above media files, and other media files for playback may also be implemented within the scope of the present invention. It should be noted that, the recording of the cloud conference is performed in two steps by separating the data recording and the data conversion from each other. The recording means records the source data into a disk file, and the conversion means that the source data is packaged into a playable file through coding and decoding or a media file format and is stored into a disk. Separate recording and conversion are different processing schemes than the conventional recording and conversion integrated.
The conventional recording method is problematic not only in high concurrency, but also in the case of single-session recording. Therefore, data reception and data processing need to be separated. To balance the dependency of data reception and data processing, it is common practice to divide these two things into different threads for processing. With multi-threaded processing, it should still be possible with a small amount of data, but there is still the problem of data being discarded or memory drain as the amount of data increases. Typically, network data is received very quickly, but is time consuming to process this data into playable media files by encoding and decoding and then packaging.
The invention separates data recording and data conversion from each other, and records the cloud conference in two steps. The data recording and conversion are separated, namely the data recording is put into one service, the coding and decoding conversion is put into another service, the two services belong to different processes or different machines, and the two services do not influence each other. After the data receiving and conversion processing are separated to different servers, the data receiving does not consume memory or CPU, so that the data is larger at high concurrency, and all the data can be correctly recorded by only slightly increasing the data receiving servers. The data conversion server can increase machines and then increase the machines, and can queue the machines for data conversion at the highest consumption speed according to the current machine condition if the machines cannot be increased, and the worst result is that some conferences slightly delay the generation of playback files due to waiting for machine resources in queue, but the reception of data is never influenced, and the problems of data loss, recording failure and the like cannot occur.
It should be noted that the present invention uses two services, namely, the recording server and the data conversion server, to perform data processing separately, but requires cooperative work. Data are shared network disk data conf.data, and a database in the network disk is used as a cooperative medium. In the cloud conference process, when a client starts recording, a source data recording server writes data into a file conf.data and simultaneously writes a state flag bit for starting recording the data into a database. And the conversion server reads the status flag bit of the database at regular time, and once finding out which conference starts to be recorded, reads conf.data data from the directory of the conference and takes each read data to perform corresponding media file conversion. The whole process is equivalent to triggering data conversion processing by a database, and a shared network disk file conf.data is used as an interprocess message and data queue, so that the problems of queue fullness, data loss or machine memory exhaustion in the process of processing a single thread or a plurality of threads in one process are solved.
It should be noted that, in the data conversion process, the data conversion server needs to complete the conversion of the cloud conference by reading conf.data on the network disk, and then generates the converted data into a specific directory of the network disk according to a specific media file format for playback and downloading. When reading data, analyzing the size of the byte appointed by the head to obtain the actual size of the data packet content, and reading the content according to the size. The data type of the appointed byte is read, and the data is known to be signaling or media data. And realizing the processing of signaling and data according to a specific type allocation processing mode.
According to the embodiment of the invention, source data is recorded into a network disk while data is recorded, and when a server is abnormal, an abnormal state mark is written into a database after the abnormality is recovered;
starting a timer, checking the state of the database regularly, finding the abnormal and finished meeting, and switching the recording of the field from the beginning again.
It should be noted that, in the cloud conference recording process, there is a mode of recording a single stream, that is, audio, video, desktop, and the like are recorded separately, and a single HLS file or a single MP4 file is generated separately, in this case, in order to generate online play for a user without delay, that is, generate online play for the user as soon as recording is finished, data uploaded from a client is H264 video data that does not need to be encoded, in this case, only the received data needs to be framed, and then the H264 data is packaged into a playable media file according to the HLS or MP4 standard. This recording, which does not consume machine performance, can put data reception and data processing together for processing, without requiring separate data reception and data conversion processes. However, there are other problems caused by abnormal situations, such as a network timeout of the server resulting in a drop, a service crash restart, and an operation and maintenance requirement restart, and after these situations occur, the recording server will reconnect to the whole system. After reconnection, because playable media files are not editable and writeable, it is only possible to destroy the previously converted results and recreate new files. Clearly, the results obtained in this way are problematic, for which case serious customer failures would result if exception handling measures were not taken. The invention records the source data to the network shared disk while receiving and processing the data. After the service is recovered from the abnormal condition, writing an abnormal condition mark in the database. Starting a timer, checking the state of the database regularly, finding the abnormal and finished meeting, and switching the recording of the meeting from the beginning again. Therefore, abnormal repair in the recording process can be effectively promoted.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring grade information of the cloud conference;
judging whether the grade information is in a preset high-grade mode or not;
if so, determining that the source data transmission and storage mode is a first mode; and if not, determining that the source data transmission and storage mode is the second mode.
It should be noted that, the first mode is an encryption transmission and storage mode, in which source data is transmitted in an encryption manner, that is, after data is encrypted, the data is transmitted in a ciphertext manner, and is encrypted and stored when being stored. Firstly, the level information of the cloud conference needs to be acquired, the level information is high level and low level, the conference content is confidential in the high level, and encryption needs to be performed in the transmission and storage process in order to prevent third parties from cracking or intercepting the information, so that the confidentiality of the conference is improved. If the level is low level, the transmission can be carried out by adopting a low encryption level or a non-encryption mode, so that the resource consumption caused by encryption is reduced.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring grade information and resource occupation data of the cloud conference;
if the grade information is in a high-grade mode, judging whether the resource occupation data exceeds a preset occupation threshold value;
if yes, determining that the source data transmission and storage mode is a third mode; and the third mode is to transmit source data through the first encryption mode and store the source data through the second encryption mode.
It should be noted that when the terminal occupies more resources, that is, when the idle resources are less, the encryption mode may be dynamically adjusted in real time, first, when the cloud conference level is determined to be the high-level mode, then, whether the resource occupancy data exceeds a preset occupancy threshold is determined, if so, the resource occupancy is higher, and at this time, the mode of transmitting and storing the source data may be adjusted to be the third mode. And the third mode is to transmit source data through the first encryption mode and store the source data through the second encryption mode. The first encryption mode is a low-level encryption mode, the second encryption mode is a high-level encryption mode, and the first encryption mode occupies lower resources than the second encryption mode. By adopting the method, the resource occupancy rate of the conference terminal can be reduced by adopting the encryption mode with lower grade during transmission, and the conference file can be better ensured not to be cracked by a third party by adopting the encryption mode with higher grade at the server. For example, the first encryption scheme is an 8-bit encryption scheme, and the second encryption scheme is a 32-bit encryption scheme.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring user information and conference information of cloud conference participants;
and generating a conference file extraction code according to the user information and the conference information, and respectively sending the conference file extraction code to the cloud conference participant end.
It should be noted that the conference file formed after the data entry and conversion of the present invention is stored in the server, that is, stored in the server disk, for playback or download playing. In order to ensure that only participants can download the conference files, user information and conference information of cloud conference participants can be obtained first, wherein the user information can be ID information, the conference information can be names of conferences and conference start time, and extraction codes are formed to distinguish the users from participating in different conferences. The generation of the conference file extraction code according to the user information and the conference information may be that the ID information of the user, the conference name and the time information are subjected to eigenvalue calculation or hash calculation to obtain an extraction code, and the user information may be reversely calculated by the extraction code, and the specific extraction code generation may adopt the existing extraction code calculation method, which is not described in detail any more. And finally, the extracted codes are sent to each participant end, and only the users of the participant ends are allowed to download and playback, so that the file leakage is prevented, and the security of the conference is improved.
According to the embodiment of the invention, the method further comprises the following steps:
receiving a conference file extraction code;
acquiring user information of a conference file extraction terminal;
calculating user information according to the conference file extraction code, and comparing the user information with the user information of the conference file extraction terminal;
if the conference files are consistent, sending the conference files; and if the two are not consistent, sending warning information.
It should be noted that when the participant extracts the meeting file, the participant may reversely calculate the user information through the extraction code, and then compare whether the currently extracted user information is consistent with the extraction code, if so, it is indicated that the participant performs the meeting file extraction, and if not, it is indicated that the extraction code is leaked, and the extraction may be performed by a third party, so that the notification information is sent to the administrator or the user side corresponding to the extraction code.
According to the embodiment of the invention, the method further comprises the following steps:
receiving third-party extraction request information;
acquiring user information and an extraction code according to the third party extraction request information;
calculating user information according to the extraction code, and comparing the user information with the user information in the third-party extraction request information;
if the conference files are consistent, sending the conference files; and if the two are not consistent, sending warning information.
It should be noted that when extracting an actual conference file, other account numbers or devices are often used to extract the file, and when extracting the file, third-party extraction request information needs to be sent to the server, where the third-party extraction request information includes the extracted user information and the extraction code. The server analyzes and obtains user information and an extraction code after receiving the third-party extraction request information, then calculates the user information according to the extraction code, compares the user information with the user information in the third-party extraction request information, and sends a conference file if the user information is consistent with the user information in the third-party extraction request information; and if the two are not consistent, sending warning information. By the method, the user can extract the conference files by using different devices or accounts, and the use experience of the user is improved.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring terminal equipment information failed in extracting the conference file;
counting the failure times;
if the failure times exceed a preset failure time threshold, sending the associated information of each extracted conference file to a server;
and the server analyzes the extracted associated information of the conference file each time, and sends warning information if the conference file is in an abnormal state.
It should be noted that when one device fails to extract a plurality of conference files, a warning needs to be raised, terminal device information is obtained first, then failure times are counted, if the failure times exceed a failure time threshold value, it is indicated that conditions of being stolen or intentionally extracted may exist, so that specific analysis needs to be performed, association information of each time of extracting the conference files is sent to a server, wherein the association information includes current network environment information, user information, extraction codes, login account information and the like, and whether a risk of malicious extraction or cracking exists can be analyzed through the association information. The server can analyze whether the state is a normal state or an abnormal state according to the associated information, and if the abnormal state is a risk of malicious extraction or cracking, the server can send warning information to the manager side or other preset client sides to remind the manager side or other preset client sides.
FIG. 2 is a block diagram of a big data analysis based health alert system of the present invention.
As shown in fig. 2, the invention discloses a cloud conference step-by-step recording system, which comprises a cloud server 202, a recording server 203, a network disk 205, a data conversion server 204 and a database 206;
the cloud server 202 is responsible for receiving audio and video data from the client 201 and sending the data to the recording server 203;
the cloud server 202 is also responsible for receiving the converted playable media data from the data conversion server 204 and sending the playable media data to the client 201 for playing;
the recording server 203 is responsible for adding custom information to construct recorded data, recording the state flag bit of the data, and then writing the data into the network disk 205 to generate conf.data;
the data conversion server 204 is responsible for regularly reading the status flag bit of the data, and once a conference is found to start recording, the conf.data is read from the network disk 205, and the read conf.data is subjected to audio/video coding and decoding conversion; performing MP4 packaging processing on the data after encoding and decoding; writing each frame of data subjected to MP4 packaging processing to the network disk 205, generating a media file for playback, or sending the media file to the client 201 through the cloud server 202 for playing.
The database 206 serves as a recording node for converting conference data, and one conference corresponds to one database record. The abnormal state flag must be in one-to-one correspondence with the conference ID, and correspond to the flag of the conference that is not converted, is converted, and is converted. When the conversion service is down or stops service artificially or other events causing service interruption, the database 206 is always in the conversion state, when the service is recovered to be normal and is accessed into the conference system again, the conversion service checks the conversion state of the server through a program internal timer, if the conversion state is found, the abnormal state of the conference is recorded in a database abnormal mark, and the conversion of the conference data is stopped. And reading in the conf.data data again for repair conversion after the timer of the repair conversion service detects the abnormal mark in the database.
According to an embodiment of the invention, the system further comprises a timer;
the system records source data into the network disk 205 while recording data, and writes an abnormal state mark into the database of the network disk 205 after abnormal recovery when the recording server 203 is abnormal;
the timer is used to check the database state regularly, and if the abnormal meeting is found and the meeting is ended, the recording of the field is switched from the beginning again.
According to the embodiment of the invention, the data conversion service can deploy a plurality of servers to work simultaneously. And taking the conference as a conversion unit to perform multi-task preemption, so that the concurrency performance of the server is improved. The basis for designing the multi-task preemption is to share the same database and the same network disk. Each data conversion server 204 periodically checks the data conversion status, and if one of them finds a convertible task, immediately preempts, and sets values in the database 206 to indicate that the task has been preempted and that the other data conversion servers 204 can not convert to this session. The converted MP4 is placed on the same network disk 205 for access by the user in a uniform manner. When switching from multiple stations, because the database 206 is shared by multiple stations, if a service is interrupted, it checks by the database which conference switching tasks are due to its interruption after the service is restored to normal, concatenates the abnormal conference flag, and cannot operate on tasks that do not belong to it.
It should be noted that the data conversion service and the recording service are two different services, and each service can concurrently process a plurality of conference data. The recording service is responsible for recording the source data, and the conversion service is responsible for converting the recorded source data into the MP4 file. The conversion service is divided into a conversion service in the meeting and a data restoration conversion service, the conversion service in the meeting is responsible for converting data which is continuously input in the meeting under the normal condition, and the data restoration conversion service is responsible for converting conference data which is interrupted under the abnormal condition. Repair transition services were introduced because the transition of MP4 was not interruptible and MP4, which was interrupted in the transition, had to transition from scratch again. The normal-to-session service will burden the session with repair-to-session work if necessary after the service interruption is resumed, affecting the amount of normal concurrency in the session.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring grade information of the cloud conference;
judging whether the grade information is in a preset high-grade mode or not;
if so, determining that the source data transmission and storage mode is a first mode; and if not, determining that the source data transmission and storage mode is the second mode.
It should be noted that, the first mode is an encryption transmission and storage mode, in which source data is transmitted in an encryption manner, that is, after data is encrypted, the data is transmitted in a ciphertext manner, and is encrypted and stored when being stored. Firstly, the level information of the cloud conference needs to be acquired, the level information is high level and low level, the conference content is confidential in the high level, and encryption needs to be performed in the transmission and storage process in order to prevent third parties from cracking or intercepting the information, so that the confidentiality of the conference is improved. If the level is low level, the transmission can be carried out by adopting a low encryption level or a non-encryption mode, so that the resource consumption caused by encryption is reduced.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring grade information and resource occupation data of the cloud conference;
if the grade information is in a high-grade mode, judging whether the resource occupation data exceeds a preset occupation threshold value;
if yes, determining that the source data transmission and storage mode is a third mode; and the third mode is to transmit source data through the first encryption mode and store the source data through the second encryption mode.
It should be noted that when the terminal occupies more resources, that is, when the idle resources are less, the encryption mode may be dynamically adjusted in real time, first, when the cloud conference level is determined to be the high-level mode, then, whether the resource occupancy data exceeds a preset occupancy threshold is determined, if so, the resource occupancy is higher, and at this time, the mode of transmitting and storing the source data may be adjusted to be the third mode. And the third mode is to transmit source data through the first encryption mode and store the source data through the second encryption mode. The first encryption mode is a low-level encryption mode, the second encryption mode is a high-level encryption mode, and the first encryption mode occupies lower resources than the second encryption mode. By adopting the method, the resource occupancy rate of the conference terminal can be reduced by adopting the encryption mode with lower grade during transmission, and the conference file can be better ensured not to be cracked by a third party by adopting the encryption mode with higher grade at the server. For example, the first encryption scheme is an 8-bit encryption scheme, and the second encryption scheme is a 32-bit encryption scheme.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring user information and conference information of cloud conference participants;
and generating a conference file extraction code according to the user information and the conference information, and respectively sending the conference file extraction code to the cloud conference participant end.
It should be noted that the conference file formed after the data entry and conversion of the present invention is stored in the server, that is, stored in the server disk, for playback or download playing. In order to ensure that only participants can download the conference files, user information and conference information of cloud conference participants can be obtained first, wherein the user information can be ID information, the conference information can be names of conferences and conference start time, and extraction codes are formed to distinguish the users from participating in different conferences. The generation of the conference file extraction code according to the user information and the conference information may be that the ID information of the user, the conference name and the time information are subjected to eigenvalue calculation or hash calculation to obtain an extraction code, and the user information may be reversely calculated by the extraction code, and the specific extraction code generation may adopt the existing extraction code calculation method, which is not described in detail any more. And finally, the extracted codes are sent to each participant end, and only the users of the participant ends are allowed to download and playback, so that the file leakage is prevented, and the security of the conference is improved.
According to the embodiment of the invention, the method further comprises the following steps:
receiving a conference file extraction code;
acquiring user information of a conference file extraction terminal;
calculating user information according to the conference file extraction code, and comparing the user information with the user information of the conference file extraction terminal;
if the conference files are consistent, sending the conference files; and if the two are not consistent, sending warning information.
It should be noted that when the participant extracts the meeting file, the participant may reversely calculate the user information through the extraction code, and then compare whether the currently extracted user information is consistent with the extraction code, if so, it is indicated that the participant performs the meeting file extraction, and if not, it is indicated that the extraction code is leaked, and the extraction may be performed by a third party, so that the notification information is sent to the administrator or the user side corresponding to the extraction code.
According to the embodiment of the invention, the method further comprises the following steps:
receiving third-party extraction request information;
acquiring user information and an extraction code according to the third party extraction request information;
calculating user information according to the extraction code, and comparing the user information with the user information in the third-party extraction request information;
if the conference files are consistent, sending the conference files; and if the two are not consistent, sending warning information.
It should be noted that when extracting an actual conference file, other account numbers or devices are often used to extract the file, and when extracting the file, third-party extraction request information needs to be sent to the server, where the third-party extraction request information includes the extracted user information and the extraction code. The server analyzes and obtains user information and an extraction code after receiving the third-party extraction request information, then calculates the user information according to the extraction code, compares the user information with the user information in the third-party extraction request information, and sends a conference file if the user information is consistent with the user information in the third-party extraction request information; and if the two are not consistent, sending warning information. By the method, the user can extract the conference files by using different devices or accounts, and the use experience of the user is improved.
According to the embodiment of the invention, the method further comprises the following steps:
acquiring terminal equipment information failed in extracting the conference file;
counting the failure times;
if the failure times exceed a preset failure time threshold, sending the associated information of each extracted conference file to a server;
and the server analyzes the extracted associated information of the conference file each time, and sends warning information if the conference file is in an abnormal state.
It should be noted that when one device fails to extract a plurality of conference files, a warning needs to be raised, terminal device information is obtained first, then failure times are counted, if the failure times exceed a failure time threshold value, it is indicated that conditions of being stolen or intentionally extracted may exist, so that specific analysis needs to be performed, association information of each time of extracting the conference files is sent to a server, wherein the association information includes current network environment information, user information, extraction codes, login account information and the like, and whether a risk of malicious extraction or cracking exists can be analyzed through the association information. The server can analyze whether the state is a normal state or an abnormal state according to the associated information, and if the abnormal state is a risk of malicious extraction or cracking, the server can send warning information to the manager side or other preset client sides to remind the manager side or other preset client sides.
The invention discloses a method and a system for recording a cloud conference step by step. By separating data recording and data conversion from each other, the recording of the cloud conference is performed in two steps. The high concurrency rate of generating the merged recording MP4 can be improved. The confluence MP4 refers to that audio, video, desktop, white board and the like shared in all cloud conference processes are recoded according to a specific layout to generate an MP 4. Because the encoding and decoding especially consume a CPU, in order to record and play back the generated real-time performance, the data processing speed needs to be obtained by the highest utilization rate of the CPU during the encoding and decoding, if the receiving of the data and the processing of the data are not separated, the data receiving is limited due to the consumption of the CPU, even if machines are continuously added, the requirement is still difficult to be met when the data volume is large. After the data receiving and conversion processing are separated to different servers, the data receiving does not consume memory or CPU, so that the data is larger at high concurrency, and all the data can be correctly recorded by only slightly increasing the data receiving servers. The data conversion server can increase machines and then increase the machines, and can queue the machines for data conversion at the highest consumption speed according to the current machine condition if the machines cannot be increased, and the worst result is that some conferences slightly delay the generation of playback files due to waiting for machine resources in queue, but the reception of data is never influenced, and the problems of data loss, recording failure and the like cannot occur. In addition, the invention records the source data into the network disk while recording the data, when the server is abnormal, an abnormal state mark is written into the database after the abnormal recovery; the timer is used for checking the state of the database at regular time, and the recording of the field is switched from the beginning again when the meeting which is abnormal and has ended is found. The abnormal repairing capability in the recording process of the cloud conference can be effectively improved.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Claims (3)
1. A cloud conference step-by-step recording method is characterized by comprising the following steps:
data entry: establishing a recording service to record source data in the cloud conference process; recording source data into a network disk, and recording a state flag bit of the data;
data conversion: establishing data conversion service, regularly reading the state flag bit of the data, and once finding that a conference starts to be recorded, reading the data in a network disk from a directory of the conference to perform cloud conversion;
generating the converted data into a specific directory in a network disk according to a specific media file format for playback and downloading, or sending the data to a client through a cloud server for playing;
the data entry includes:
the client sends the audio and video data to the cloud server, and the cloud server sends the received audio and video data to the recording server;
the recording server adds the user-defined information to construct recorded data, records the state flag bit of the data at the same time, and then writes the data to a network disk to generate a conference data file;
each data in the conference data file is a readable unit, and the head of each unit data is self-defined information; one conference corresponds to one conference data file;
the user-defined information comprises data size, data type, ID of each conference, ID of each video in the conference and distributed position of each video when being displayed;
the data conversion specifically comprises:
the data conversion server reads the status flag bit of the data at regular time, reads the conference data file from the network disk once the recording of the conference is found, and performs audio and video coding and decoding conversion processing on the read conference data file;
performing MP4 packaging processing on the data after encoding and decoding;
writing each frame of data packaged and processed by the MP4 to a network disk to generate a media file for playback, or sending the media file to a client for playing through a cloud server;
the generation of the custom information is specifically as follows:
the client sends various conference control instructions to the cloud server, and the cloud server receives the control instructions and then sends the control instructions to the recording server; the recording server generates custom information according to the signaling;
when the server is abnormal, writing an abnormal state mark in the database after the abnormal recovery;
starting a timer, checking the state of the database at regular time, and switching the abnormal and finished conference recording from the beginning again if the abnormal and finished conference is found;
further comprising:
acquiring grade information of the cloud conference;
the grade information is high grade or low grade; the high-level conference content is confidential, and is encrypted during transmission and storage in order to prevent third party decryption or information interception; if the grade is low grade, the low encryption grade or the non-encryption mode is adopted for transmission;
judging whether the grade information is in a preset high-grade mode or not;
if so, determining that the source data transmission and storage mode is a first mode; if not, determining that the source data transmission and storage mode is the second mode;
the first mode is an encryption transmission and storage mode, wherein source data transmits data in an encryption mode, namely, data is encrypted and transmitted in a ciphertext mode, and the data is encrypted and stored during storage;
further comprising:
acquiring grade information and resource occupation data of the cloud conference;
if the grade information is in a high-grade mode, judging whether the resource occupation data exceeds a preset occupation threshold value;
if yes, determining that the source data transmission and storage mode is a third mode; the third mode is that source data transmission is carried out through a first encryption mode and source data storage is carried out through a second encryption mode;
the first encryption mode is a low-level encryption mode, the second encryption mode is a high-level encryption mode, and the first encryption mode occupies lower resources than the second encryption mode;
further comprising:
acquiring user information and conference information of cloud conference participants;
generating a conference file extraction code according to the user information and the conference information, and respectively extracting the conference file extraction codes
Sending the data to a cloud conference participant end;
further comprising:
receiving a conference file extraction code;
acquiring user information of a conference file extraction terminal;
calculating user information according to the conference file extraction code, and comparing the user information with the user information of the conference file extraction terminal
Comparing;
if the conference files are consistent, sending the conference files; and if the two are not consistent, sending warning information.
2. A cloud conference step-by-step recording system is characterized by comprising a cloud server, a recording server, a network disk, a data conversion server and a database;
the cloud server is responsible for receiving audio and video data from the client and sending the data to the recording server;
the cloud server is also responsible for receiving the converted playable media data from the data conversion server and sending the playable media data to the client for playing;
the recording server is responsible for adding custom information to construct recorded data, recording the state flag bit of the data at the same time, and then writing the data to a network disk to generate a conference data file;
the data conversion server is responsible for regularly reading the state flag bit of the data, reading a conference data file from a network disk once a conference is found to start recording, and performing audio and video coding and decoding conversion processing on the read conference data file; performing MP4 packaging processing on the data after encoding and decoding; writing each frame of data packaged and processed by the MP4 to a network disk to generate a media file for playback, or sending the media file to a client for playing through a cloud server;
the database is used as a recording node for conference data conversion, and one conference corresponds to one database record; the abnormal state marks correspond to the conference IDs one by one, and the marks of the conference which are not converted, are converted and are converted are corresponding to the abnormal state marks;
when the conversion service is down in the meeting or the service is stopped artificially or other events causing service interruption occur, the database is always in a conversion state;
when the service is recovered to be normal and the conference system is accessed again, the conversion service in the conference checks the conversion state of the server through a timer in the program, if the database has the state in conversion, the abnormal state of the conference is recorded in the abnormal mark of the database, and the conversion of the conference data is stopped;
the system further includes a timer;
the system records source data into a network disk while recording data, and writes an abnormal state mark into a database after abnormal recovery when a server is abnormal;
the timer is used for checking the state of the database at regular time, finding the abnormal and finished meeting, and then switching the abnormal and finished meeting recording from the beginning again.
3. The cloud conference step-by-step recording system according to claim 2, wherein the data conversion servers comprise a plurality of data conversion servers, the plurality of data conversion servers perform task preemption by taking the conference as a conversion unit, each data conversion server checks the data conversion state at regular time, and if a convertible task is found, the data conversion server immediately preempts; and setting preemption instructions in the database after preemption to prevent other data conversion servers from converting the conference again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110799447.XA CN113259621B (en) | 2021-07-15 | 2021-07-15 | Cloud conference step-by-step recording method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110799447.XA CN113259621B (en) | 2021-07-15 | 2021-07-15 | Cloud conference step-by-step recording method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113259621A CN113259621A (en) | 2021-08-13 |
| CN113259621B true CN113259621B (en) | 2021-10-15 |
Family
ID=77180434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110799447.XA Active CN113259621B (en) | 2021-07-15 | 2021-07-15 | Cloud conference step-by-step recording method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259621B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113691762B (en) * | 2021-08-16 | 2023-07-07 | 咪咕文化科技有限公司 | Data transmission method and device for video conference and computer readable storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105306861B (en) * | 2015-10-15 | 2017-03-01 | 深圳市鹰硕技术有限公司 | A kind of Web-based instruction recorded broadcast method and system |
| CN108040061B (en) * | 2017-12-19 | 2021-04-27 | 广州敬信药草园信息科技有限公司 | Cloud conference live broadcasting method |
| US11171795B2 (en) * | 2019-03-29 | 2021-11-09 | Lenovo (Singapore) Pte. Ltd. | Systems and methods to merge data streams from different conferencing platforms |
| CN112073810B (en) * | 2020-11-16 | 2021-02-02 | 全时云商务服务股份有限公司 | Multi-layout cloud conference recording method and system and readable storage medium |
| CN112399134B (en) * | 2021-01-21 | 2021-04-09 | 全时云商务服务股份有限公司 | Self-management release method and system for cloud conference recording |
-
2021
- 2021-07-15 CN CN202110799447.XA patent/CN113259621B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113259621A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110430441B (en) | Cloud mobile phone video acquisition method, system, device and storage medium | |
| CN112235597B (en) | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment | |
| CN104837052A (en) | Playing method of multimedia data and device | |
| CN102648584B (en) | Use the system of forward error correction inspection available bandwidth, method and medium | |
| CN109450777B (en) | Session information extraction method, device, equipment and medium | |
| CN112073543B (en) | Cloud video recording method and system and readable storage medium | |
| WO2017050067A1 (en) | Video communication method, apparatus, and system | |
| WO2015196590A1 (en) | Method and apparatus for playing desktop cloud video | |
| CN113259621B (en) | Cloud conference step-by-step recording method and system | |
| CN114598931A (en) | Streaming method, system, device and medium for multi-open cloud game | |
| CN113141352B (en) | Multimedia data transmission method and device, computer equipment and storage medium | |
| CN112565656B (en) | Video call method, device, system, electronic equipment and storage medium | |
| WO2021174879A1 (en) | Ai video call quality analysis method and apparatus, computer device, and storage medium | |
| CN111064976B (en) | Method for sending live broadcast information and server | |
| CN109819278B (en) | Optimization method of live video | |
| CN111669650A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN116320431A (en) | Video compression coding data dynamic wireless network transmission system | |
| CN116842205A (en) | Game playback method, device and storage medium | |
| CN115102701B (en) | Multi-chip data encryption and decryption processing method and device | |
| CN113192520B (en) | Audio information processing method and device, electronic equipment and storage medium | |
| CN111090818A (en) | Resource management method, resource management system, server, and computer storage medium | |
| US10231004B2 (en) | Network recording service | |
| KR101893829B1 (en) | A method for encrypting and decrypting a record file through data modulation | |
| CN112565655A (en) | Video data yellow identification method and device, electronic equipment and storage medium | |
| CN110392285B (en) | Media stream processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |