KR101702535B1 - Recoding system for multimedia data with fault-tolerance design and method for enhancing stability thereof - Google Patents

Abstract

The present invention relates to a multimedia data recording system and a method for processing the same. The multimedia data recording system according to the present invention comprises: an acquisition device which acquires audio and video data; an audio and video recording device which includes a dualized board in which a plurality of input ports receive data obtained by the acquisition device, in which each of the input ports is connected to two AGC circuits and a filter circuit, in which the received data is input to a CPU through a codec and subjected to parallel processing, which sends parallel-processed audio and video data, and which detects a defective file in a file packet through a loss diagnostic engine; and a main server and an auxiliary server which simultaneously receive, store and process the parallel-processed data, transmitted by the audio and video recording device, in real time.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multi-data recording system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia data recording system, and more particularly, to a multimedia data recording system for recording multimedia data of voice and image for improving data reliability and system reliability through redundancy design and recording data inspection reflecting fault- Storage, management, retrieval and reproduction of multimedia data, and a processing method thereof.

In general, multimedia data including voice data, video data, and text data are utilized as resources having socially and economically valuable value.

As the types and amounts of multimedia contents are continuously increasing, systematic and integrated data collection and storage management are required, and there is a growing demand for search and sharing for utilizing them.

However, there is no system that can easily and effectively integrate and manage various types of multimedia data.

For example, a typical transcription board system simply configures transcription boards and servers to collect voice data in parallel. Such a recording board system is economically inefficient due to redundancy, and there is a fear of loss of data due to a single voice recording system of a recording board and the absence of a self storage medium.

In addition, audio and video data are separate boards, which reduces the reliability and efficiency of the control, and in the event of a failure, it is impossible to perform quick action and maintenance.

The existing control record operating server It is a server that separates, manages and stores various multi data such as telephone, VoIP, VHF, UHF, TRS, camera image and screen image separately. It is very expensive for construction and maintenance, So that it is not efficient in managing and operating various multimedia data.

In addition, the conventional backup device is a simple media storage device of the control record operation server, which increases the load on the control record operation server, and there is a possibility that data is lost when the control record operation server fails. In addition, since the backup device has a short data retention period, it is necessary to store and store data in a distributed manner.

Conventional screen image compression and transmission In the case of a transmitter that compresses a large amount of image data, the dependency of the product on import is high, so localization is necessary.

FIG. 1 shows a conventional recording system. As shown in FIG. 1, the main server 20 and the auxiliary server 24 are provided as a main server because of the cost problem that the recording apparatus 14 occupies more than 50% Only the servers 20 and 24 are configured in parallel or the entirety of the recording apparatuses 34 and 36 are simply configured in parallel as shown in FIG.

Such conventional recording systems 10 and 30 have the following fatal problems.

First, in case of failure of the main servers 20 and 40, there is a large risk of data loss due to the manual switching method to the auxiliary servers 24 and 44. Second, (14, 34, 36), so that it has not contributed greatly to the improvement of the stability of the system.

In addition, the recording systems 10 and 30 can be checked only in the process of directly reproducing the recording file due to the failure by the user, and even if they recognize the failure, , It is impossible to process a file defect inspection in real time in the process of generating a multimedia data file such as voice and image, an event occurrence, a failure, and a log storage according to an event.

Also, the recording systems 10 and 30 of the related art separately record, store, and manage multimedia data such as voice and video. Therefore, it is necessary for the recording systems 10 and 30 to integrally manage audio data such as wired and wireless, broadcasting and the like, and video data such as CCTV, in a single server from the user environment.

Korean Registered Patent No. 10-1237523 (Published Feb. 26, 2013) Korean Registered Patent No. 10-1228480 (Published on Jan. 31, 2013) Korean Patent Publication No. 10-2004-0036170 (published on April 30, 2004) Korean Patent Publication No. 10-2005-0090788 (published on September 14, 2005)

An object of the present invention is to provide a multimedia data recording system and a processing method thereof for enhancing safety and reliability by duplicating system data by parallel processing.

It is another object of the present invention to provide a multimedia data recording system and a processing method thereof for efficiently managing data by processing the multimedia data of voice and image in a single system for integrated recording, management and reproduction.

It is still another object of the present invention to provide a multimedia data recording system and a processing method thereof for improving the function of voice and video multimedia data.

In order to achieve the above objects, in the multimedia data recording system of the present invention,

An acquisition device for acquiring audio and video data;

A plurality of input ports arranged to receive data obtained from the acquisition device, each input port being connected to two AGC circuits and a filter circuit, each of which is input to a CPU through a codec and parallel- A voice and video recording device for transmitting voice and image data and detecting a bad file from a file packet by a loss analysis engine;

And a main server and an auxiliary server for simultaneously receiving, storing, and processing parallel-processed data transmitted from the audio and video recording apparatus in real time.

The voice and video recording apparatus comprising: A plurality of input ports for receiving analog voice signals from the acquisition device; An AGC circuit connected to each of the input ports by two; A filter circuit connected to each AGC circuit to equalize signal levels between two channels; A codec for receiving and compressing data passed through each filter circuit; A decoder for decoding the compressed data in conjunction with the codec; And a CPU for parallel processing the analog voice signals in conjunction with the decoder and duplicating them into two signals.

The two signals processed in parallel by the CPU (processor) are transmitted in real time to the main server and the auxiliary server through the first LAN transformer and the second LAN transformer and are stored.

The recording board is provided with a buffer to temporarily store audio / video data for a predetermined period of time, thereby preventing loss of data even when a failure occurs in the main server and the auxiliary server.

The RTC (Real Time Clock) is loaded on the CPU, so that the generation time of the recording file can be prevented from being delayed.

The CPU interlocks with the loss analysis engine to detect a bad file in real time through an aesthetic function and a deviation analysis algorithm, or to detect the occurrence of an event, through a pattern of a recorded recording file through Fourier transform.

According to another embodiment of the present invention, there is provided a method of detecting and processing a lost file in a multimedia data recording system,

Compressing a voice data packet transmitted from the voice and image acquisition device and collecting file initial data for generating a voice recording file;

Decoding the recorded file using the collected file initial data, and detecting whether an error occurs in the voice data packet by the loss analysis engine;

Determining whether a bad file or an event is generated as a result of the detection and generating and storing voice data as a voice recording file if a bad file or an event is not generated;

And storing a log file corresponding to the occurrence of a bad file or an event when a bad file or an event occurs.

Wherein the detecting comprises: After the image and voice files are subjected to Fourier transform, the time pattern on the X axis and the frequency pattern on the Y axis of the converted recording file are compared with the normal pattern through the aesthetic function and deviation analysis algorithm, Or detects the occurrence of an event.

As described above, the multimedia data recording system of the present invention has the following effects.

First, in the recording board, by implementing a parallel processing circuit composed of first and second circuits for processing audio and video multimedia data in parallel, it is possible to output a recording file in the second circuit even if a failure occurs in the first circuit The stability and economical efficiency of the data can be improved.

Second, voice and image data generated by two parallel processing circuits in the recording board can be simultaneously stored in real time in multiple servers, thereby improving the reliability and stability of fault tolerant data.

Third, the engine can detect a voice recording file in real time and can detect a failure quickly, and minimize the occurrence of bad files.

Fourth, since the RTC (Real Time Clock) is loaded on the CPU, it is possible to prevent a delay in the generation of the recording file.

1 is a block diagram illustrating a configuration of a server duplication recording system according to an embodiment of the present invention;
2 is a block diagram illustrating the configuration of a system redundancy recording system according to an embodiment of the present invention;
3 is a block diagram illustrating a configuration of a multimedia data recording system according to the present invention;
FIG. 4A is a circuit diagram showing the configuration of the recording duplication (parallel processing) apparatus shown in FIG. 3, and FIG. 4B is a block diagram showing the configuration of the recording duplication (parallel processing) ;
5 is a block diagram showing the configuration of the control unit shown in FIG. 4; And
FIG. 6 is a graph illustrating waveforms analyzed by the loss analysis engine provided in the recording board shown in FIG. 3. FIG.
7 is a flowchart illustrating a procedure for processing a lost file in the multimedia data recording system according to the present invention.

The embodiments of the present invention can be modified into various forms and the scope of the present invention should not be interpreted as being limited by the embodiments described below. The present embodiments are provided to enable those skilled in the art to more fully understand the present invention. Therefore, the shapes and the like of the components in the drawings are exaggerated in order to emphasize a clearer explanation.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 3 to 6 attached hereto.

FIG. 3 is a block diagram showing the configuration of a multimedia data recording system according to the present invention, FIG. 4 is a block diagram showing a configuration of a recording duplication (parallel processing) apparatus shown in FIG. 3, and FIG. FIG. 2 is a block diagram showing the configuration of a control unit shown in FIG.

3 to 5, the multimedia data recording system 100 of the present invention includes voice and video multimedia data such as analog / digital telephone, VoIP, UHF / VHF / TRS wireless video, CCTV camera video, It is possible to minimize the loss of files in case of a system failure by simultaneously executing parallel processing, storing two recorded files generated by the parallel processing circuit in real time on different servers in real time, have.

To this end, the multimedia data recording system 100 of the present invention generates data by means of a parallel circuit of a main circuit part (for example, a DSP circuit and an analog input circuit) of the analogue wired and wireless recording apparatus 120, In real time simultaneously to the main server 150 and the auxiliary server 170, and detects a real-time bad file by the loss analysis engine, detects occurrence of an event, and stores logs when a recording file is generated , And voice, video, and multimedia data.

Specifically, the multimedia data recording system 100 of the present invention processes voice data and video data based on a communication network, for example, a computer network and a telephone network TCP / IP in parallel, records the data in duplicate, .

The multimedia data recording system 100 includes a voice and image acquisition device 110 for acquiring image and / or voice data in various ways; Each input port is connected to two AGC circuits and filter circuits, respectively, and input to the CPU through a codec. The input ports are connected in parallel to each other. A voice and video recording apparatus 120 having a board to be duplicated by processing and transmitting parallel processed voice and image data and detecting a bad file from a file packet by a loss analysis engine; A main server 150 and an auxiliary server 170 for simultaneously receiving, storing and processing parallel-processed data transmitted from the audio and video recording apparatus 110 in real time; A database 160 for storing and managing data by the main server 150; A plurality of monitoring monitoring terminals 180 and an administrator terminal 190 provided in a call center and a control center.

The audio and video acquisition device 110 may be any device that is capable of receiving analog and digital audio and / or video signals from devices for various audio and video inputs, such as analog telephones (general lines and extensions), UHF / VHF / TRS wireless communication devices, CCTV camera devices, The video data is transmitted to the voice and video recording apparatus 120 using a wired / wireless communication network, and the digital phone and the VoIP phone are transmitted to the main server 150 and the avi server 170, which are integrated servers.

The voice and image acquisition device 110 acquires video and audio data from, for example, a security camera, a radio, a telephone, and the like inside and outside the control center, and transmits the video and audio data acquired through the wired / wireless communication network to the integrated recording device 120 Lt; / RTI >

Of course, digital signal input devices such as devices for inputting digital voice and / or image data among the audio and video capture devices 110, such as digital phones, VoIP phones, and digital CCTV cameras, And / or image data to the controller 170.

The voice and video recording apparatus 120 receives voice data from the voice and image capturing apparatus 110 to generate packets and protocols and transmits them in real time. The main server 150 and the standby server 170, which are integrated servers, The audio data packet is compressed, the file initial data for the recording file generation is collected, the file is decoded, and then it is automatically detected whether a packet error, for example, a bad file is detected or an event is generated in real time.

4 and 5, the audio and video recording apparatus 120 is provided with redundant main circuit units and outputs of the analog wired and wireless recording board unit by parallel processing, and the audio and video recording apparatus 120 And provides the acquired audio and video data to the main server 150 and the auxiliary server 170 at the same time.

Specifically, the audio and video recording apparatus 120 includes a CPU 122, a memory 124, a decoder 126, a plurality of codecs 128, and a plurality of input devices 130.

The input device 130 receives the analog voice signal from the voice and image acquisition device 110 and generates digital voice data.

The input device 130 receives analog voice signals through a plurality of input ports. For example, eight input ports may be disposed in the input device 130 to form eight channels.

Two AGC (Automatic Gain Control) circuits 132 are provided in each input port. That is, 16 AGC circuits 132 are connected to eight input ports. Accordingly, the analog audio / video signals inputted through one input port are divided into two channels, so that one same audio / video signal can be generated and generated in two.

In addition, one filter circuit 134 is connected to each AGC circuit 132. That is, 16 filter circuits 134 are connected to the 16 AGC circuits 132. Thus, the signal levels of the two video / audio data are equalized in the course of passing through the 16 filter circuits 134. [

The codec 128 is composed of a plurality of codecs, for example, eight codecs. That is, eight codecs 128 are connected to 16 filter circuits to convert the analog voice signals into digital voice data and provide them to the decoder 128.

Various codecs can be used for the codec 128. For example, video data such as divx, mpeg4, and xvid can be used, and audio data such as DD, DTS, and MP3 can be used.

In addition, the codec 128 compresses audio / video data using the above-described codec.

The decoder 126 decodes the compressed audio / video signal and returns the audio / video signal to its original size. The decoder 126 converts the compressed audio / video signal into an analog audio signal to reproduce desired video and audio data from the monitoring monitoring terminals 180 and the administrator terminal 190.

The CPU 122 generates digital audio / video data provided from the codec 128 as two recording files.

That is, one audio / video signal inputted through one input port is generated through the AGC circuit 132, and the same file is further generated and divided into two, and then passed through the filter circuit 134 and the CODEC 128 And is input to the CPU 122 respectively. Then, the CPU 122 generates two recording files by parallel processing, respectively.

The generated two recording files are stored in the memory 124. At this time, the memory 124 includes various kinds of memories, for example, SDRAM, NAND FLASH, SRAM, and SSD. The digital audio / video data stored in the memory 124 is retrieved and reproduced by the CPU 122 as described above.

By providing a buffer on the recording board, the audio / video data can be temporarily stored for a predetermined time. At this time, the buffer has a memory of a predetermined size or more, for example, 128 MB.

Accordingly, when a server failure occurs, the CPU 122 can prevent data from being lost by storing voice / video data for a predetermined time without transmitting the voice / video data to the server.

In addition, since the RTC (Real Time Clock) 136 is installed in the CPU 122, it is possible to prevent the generation time of the recording file from being delayed.

The operation program of the main server 150 and the spare server 170, which are the integrated servers, executes a real-time file check of the recording file generated by the loss analysis engine.

That is, the loss analysis engine automatically detects in real time whether a bad file or an event is generated before generating a recording file by an operating program (storage, search, listening, etc.), and generates a recording file or stores a bad or event log file .

At this time, the loss analysis engine detects a bad file through the aesthetic function and deviation analysis algorithm by the pattern of the recording file by Fourier transform.

The Fourier transform is a method of dividing the voice data by each frequency and dividing the unnecessary data into zeroes.

Such Fourier transforms are classified into various types, and Discrete Fourier Transform (DFT) is a method of calculating a continuous signal as a signal obtained by sampling in time.

The Fast Fourier Transform (FFT) is a method proposed by the DFT method because it requires a long calculation time. It does not convert all of the sampled signals but only extracts necessary signals and minimizes them to calculate Fourier transform at high speed Method.

This Fourier transform process is shown in FIG. 6, where a normal voice file is shown in the left graph, while a file having a Fourier transform is shown in the right graph.

In this graph, a lossy file is detected by analyzing the wavelength pattern of the frequency shown in the Y-Y1 section on the X-axis representing time and the amplitude pattern of the X1 section of X on the Y-axis.

Meanwhile, the two files generated by the CPU 122 are transferred in real time to the main server 150 and the auxiliary server 170 via two LAN transformers and stored. That is, two signals (protocols) processed in parallel by the CPU are transmitted through the first trans transformer T1 and the second LAN transformer T2, and the data passed through the first LAN transformer T1 are transmitted to the main server 150 And the data transmitted to the second LAN transformer T2 is transmitted to the auxiliary server 170. [

Accordingly, the two files generated in real time by the CPU 122 are simultaneously transmitted to and stored in the main server 150 and the auxiliary server 170, so that, when a failure occurs in one server, It is possible.

That is, when the auxiliary server is manually switched in the case of a main server failure as in the conventional case, data may be lost in this process. However, according to the present invention, two data are generated at the time of data generation and stored in the main server and the auxiliary server Even if one server fails, the data of another server can be preserved.

The main server 150 and the auxiliary server 170 store and manage the video and audio data transmitted from the audio and video recording apparatus 120 in the database 150 and the management monitoring terminals 180 and the manager terminals 190 To retrieve and reproduce desired video and audio data.

The main server 150 stores voice / image data transmitted in real time from the voice and video recording apparatus 120. [ If a packet error of the data file, for example, a bad file is detected or an event is detected, the corresponding log file is stored in the database 160.

The database 160 stores various multimedia data by the main server 150. The database 160 stores, for example, transceiver voice data, IP telephone voice data, general telephone voice data, control screen image data, security camera image data, and metadata for each voice and image data.

The auxiliary server 170 automatically stores and manages video and audio data transmitted from the audio and video recording apparatus 120 and the main server 150. Therefore, the auxiliary server 170 automatically stores video and audio data in preparation for stable storage of data and data loss based on a network.

The controller monitoring terminal 180 and the administrator terminal 190 process various multimedia data stored in the main server 150 and the auxiliary server 170 so that they can be retrieved and reproduced.

As described above, the multimedia data recording system 100 of the present invention performs parallel processing on the audio / video data obtained by the audio and video capturing apparatus 110 by the recording apparatus 120, And the auxiliary server 170 simultaneously.

At this time, the main server 150 and the spare server 170, which are integrated servers, automatically detect in real time whether a bad file or an event is generated by a loss analysis engine before generating a recording file, generate a recording file, Process to save the log file.

Accordingly, the administrator and the user can retrieve desired multimedia data from the main server 150 and the auxiliary server 170 through the communication network and reproduce the desired multimedia data.

And FIG. 7 is a flowchart illustrating a procedure for analyzing a lost file in the multimedia data recording system according to the present invention.

As shown in FIG. 7, in order to detect and process the lost file, the voice packet is first compressed in step S200, and the file initial data for recording file creation is collected in step S210.

The recording file is decoded using the file initial data collected in step S220, and a packet error is automatically detected in step S230.

At this time, the error detection job is performed by the loss analysis engine and will be described in detail as follows.

That is, the loss analysis engine is operated by the operation programs of the integration servers 150 and 170 to automatically detect in real time whether a bad file or an event is generated before generating a recording file to generate a recording file or store a bad or event log file .

At this time, the loss analysis engine detects a bad file through the aesthetic function and deviation analysis algorithm by the pattern of the recording file by Fourier transform.

As shown in the right graph of FIG. 6, a lossy file is detected by analyzing the wavelength pattern of the frequency shown in the Y1 section on the X axis of the time and the amplitude pattern of the X1 section on the X axis of the Y axis.

In step S240, it is determined whether a bad file or an event is generated. If a bad file or an event is not generated, this procedure generates and stores a recording file in step S250.

As a result of the determination, if a bad file or an event occurs, the procedure goes to step S260 to store a bad file or a log file corresponding to the occurrence of the event.

 While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. This is possible.

100: Multimedia data recording system
110: Voice and image acquisition device
120: voice and video recording device
150: main server
160: Database
170: auxiliary server
180: Monitoring monitoring terminal
190: administrator terminal

Claims (8)

In a multimedia data recording system,
An acquisition device for acquiring audio and video data;
A plurality of input ports arranged to receive data obtained from the acquisition device, each input port being connected to two AGC circuits and a filter circuit, each of which is input to a CPU through a codec and parallel- A voice and video recording device for transmitting voice and image data and detecting a bad file from a file packet by a loss analysis engine;
And a main server and an auxiliary server for simultaneously receiving, storing, and processing parallel-processed data transmitted from the audio and video recording apparatus in real time. The method according to claim 1,
The voice and video recording apparatus comprising:
A plurality of input ports for receiving analog voice signals from the acquisition device;
An AGC circuit connected to each of the input ports by two; A filter circuit connected to each AGC circuit to equalize signal levels between two channels; A codec for receiving and compressing data passed through each filter circuit; A decoder for decoding the compressed data in conjunction with the codec; And a CPU for parallel processing the analog voice signals and duplicating the analog voice signals into two signals in cooperation with the decoder. 3. The method of claim 2,
Wherein the two signals processed in parallel by the CPU are transmitted to the main server and the auxiliary server through the first LAN transformer and the second LAN transformer and are stored. 3. The method of claim 2,
Wherein the board is provided with a buffer to temporarily store audio / video data for a predetermined time, thereby preventing loss of data even when a failure occurs in the main server and the auxiliary server. 3. The method of claim 2,
The multimedia data recording system can prevent the delay of the recording time of the recording file by loading RTC (Real Time Clock) on the CPU. 3. The method of claim 2,
The packet and protocol generated by the CPU are interlocked with the loss analysis engine to detect a bad file in real time through an aesthetic function and a deviation analysis algorithm of a pattern of the recorded recording file through a Fourier transform, Wherein the control unit detects the multimedia data. A method for detecting and processing a lost file in a multimedia data recording system, comprising:
Compressing a voice data packet transmitted from the voice and image acquisition device and collecting file initial data for generating a voice recording file;
Decoding the recorded file using the collected file initial data, and detecting whether an error occurs in the voice data packet by the loss analysis engine;
Determining whether a bad file or an event is generated as a result of the detection and generating and storing voice data as a voice recording file if a bad file or an event is not generated;
And storing a log file corresponding to a bad file or an event when a bad file or an event occurs. 8. The method of claim 7,
Wherein the detecting comprises:
After the video and audio files are subjected to Fourier transform,
A time pattern on the X axis of the converted recording file and a frequency pattern on the Y axis are compared with a normal pattern through an aesthetic function and a deviation analysis algorithm to detect a bad file in real time or to detect occurrence of an event. A method of processing a system.

Images