KR101281129B1 - Digital video recorder system displaying sound fields and application method thereof - Google Patents

Abstract

A sound field display digital video recorder system and a method of operating the same are disclosed.
The present invention relates to a method and apparatus for recognizing a specific sound from sound data by receiving image, sound, and sound field data, A process of calculating a sound position from a sound field of a specific sound when a specific sound is recognized, and a process of tracking a sound field image input device to a position where a specific sound is generated; A specific sound, a specific sound type, a sound generation section information in which a specific sound is generated, sound field information of a specific sound, a sound of a specific sound, Sound field occurrence period information, and sound occurrence position information in real time and storing them in a database; If an image search for a specific sound is detected, the sound generation section information of a specific sound is searched in the database according to a required condition to search for image section information, and the sound field generation section information of a specific sound is searched for, Searches the sound generation position information of a section where a specific sound is generated, finds position information of a section that moves to a sound generation position and a sound generation position, and searches for a sound field image input device A specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information.

Description

TECHNICAL FIELD [0001] The present invention relates to a digital video recorder system and a method of operating the same,

The present invention relates to a sound field display digital video recorder system and a method of operating the same. More particularly, the present invention relates to a sound field display digital video recorder system, A specific sound, a specific sound type, a sound generation interval information of a specific sound, a sound of a specific sound, The sound field information, the sound field generation period information of the specific sound, and the sound generation position information are displayed and stored in real time, and the sound image sound field input device A specific sound, a specific sound type, sound field information of a specific sound, A sound field display digital video recorder system for searching and reproducing sound generation position information, and a method of operating the same.

In general, a digital video recorder (DVR) system refers to a device capable of recording an image on a hard disk-based digital storage device instead of a video tape. A PVR (Personal Video Recorder) System.

The DVR system converts the video data input from the at least one surveillance camera into an analog signal and then compresses the video into MPEG2 (Moving Picture Experts Group), H.263, H.264, etc. Resolution recording system that allows a user to view and restore stored compressed images as needed.

In addition to high-definition video recorder (HDV Recorder) systems, face recognition systems have been developed according to the development of technology, and face recognition devices use real-time monitored images and faces of specific persons as databases And can be used for security purposes at police stations, airports, and the like.

Also, in the image processing of the DVR system, various types of motion recognition algorithms have been applied, and a DVR system which stores only motion segments in which motion occurs has been commercialized.

However, not only the video but also the sound information is very important. Especially, if you can search the video location where the sound of a specific accident is found in the parking lot where the car contact accident is frequent, There is an effect that observation and analysis can be performed more precisely.

However, due to the lack of sound analysis and technology, existing DVR system could not search only the section where the specific sound was generated by storing the video information on the day or the time basis for the whole area or the motion occurrence section, It has only been developed in the development of image processing technology.

Therefore, in order to retrieve and analyze an image of a specific section in the stored image data, the conventional DVR system has a cumbersome problem of restoring and reproducing all the stored images in chronological order.

Particularly, it is possible to classify images into sound types, to store image and sound field sections where specific sounds are generated, to store image section information and sound field occurrence section information in which a specific sound is generated, and to freely reproduce The apparatus is not provided, so that it is troublesome to retrieve all of the recorded whole images and retrieve them one by one.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-mentioned problems, and an object of the present invention is to provide a microphone array and a camera that receive sound and image data, distinguish sounds detected through a microphone by sound types, It calculates the sound field of the input sound and calculates the location of the sound, moves the sound image sound field input device continuously to track the position where the sound is generated, and tracks the sound image sound field input device A sound field area for displaying and storing real-time images of a specific sound, a specific sound type, sound generation section information of a specific sound, sound field information of a specific sound, sound field generation section information of a specific sound, And to provide a digital video recorder system and method of operation.

It is another object of the present invention to provide a method and apparatus for searching for a specific sound when an image search for a specific sound is detected, The sound source position information of the section where the specific sound is generated is searched to find the position of the section where the sound generation position and the sound generation position are moved, The present invention provides a sound field display digital video recorder system and a method of operating the sound field visual field sound field input device, which can reproduce images up to a section, a specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information.

In order to achieve the above object, according to an aspect of the present invention, there is provided an image input apparatus for inputting a video of a surveillance region; A sound input device for inputting sound of the surveillance area; A sound field input device for inputting a sound field of the surveillance area; The sound and the sound field of the sound are displayed and stored, and the corresponding image and sound field are accessed according to a search request of the image for the specific sound, To the DVR device; There is provided a sound field display digital video recorder system including a display and a speaker, and an output device for outputting an image, a sound and a sound field for a specific sound applied by the DVR device.

According to another aspect of the present invention, there is provided an image processing apparatus including: a video input device for capturing an image of a surveillance area; A sound field input device for inputting sound and sound field of the surveillance area; The sound and the sound field of the sound are displayed and stored, and the corresponding image and sound field are accessed according to a search request of the image for the specific sound, To the DVR device; There is provided a sound field display digital video recorder system including a display and a speaker, and an output device for outputting an image, a sound and a sound field for a specific sound applied by the DVR device.

According to another aspect of the present invention, there is provided an apparatus for monitoring a sound field position, the apparatus comprising: a video input device that is integrally coupled to a pan / tilt transmission device for capturing an image of a surveillance area; A sound image sound field input device; The sound field is input to the sound field input device and the sound is classified and displayed according to the type of the sound field, and the position of the specific sound is calculated to drive the input device. A DVR device for accessing and displaying a corresponding image, sound field, and position information according to a search request for a specific sound; There is provided a sound field display digital video recorder system including a display and a speaker, and an output device for outputting video, sound, sound field, and position information for a specific sound applied by the DVR device.

According to another aspect of the present invention, there is provided an image processing apparatus including: a video input device for capturing an image of a surveillance area; A sound field input device for inputting sound and sound field of the surveillance area; A pan / tilt transmission device for combining the image input device and the sound field input device to provide rotation (pan / tilt); An image input unit for receiving an analog image by a camera and converting the analog image into a digital image; A sound field input unit for receiving analog sound information from a specific microphone of the microphone array and converting the analog sound information into a digital signal, receiving sound field information from all the microphones of the microphone array, and converting the analog sound information into a digital signal; A sound recognition unit for analyzing sound data applied from a specific microphone in the sound field input unit and classifying a sound type; A video management unit for managing a normal video image and an image of a section where a specific sound is generated; A sound field management unit for analyzing and managing sound field data by receiving sound field information from all microphones for sound recognized as a specific sound by the sound recognition unit; A position recognition unit for calculating a position of a sound based on the sound data input from the sound field management unit; A position drive unit for driving the input device based on the positional data at which the sound transmitted from the position recognition unit is generated; A sound image sound field position display unit for real time displaying a sound image section, sound field, and position information; The sound generation section information of the specific sound, the sound generation section information of the specific sound, and the sound field generation section information are managed as files and stored in the database, and the sound recording image sound file storing the sound recording image sound file part; A database storing a specific sound file, a normal recording image file and a specific sound image file, a sound field file for a specific sound, a sound generating section information file, a sound field generating section information file, and a position information file; A sound image sound field position search unit for searching an image file stored in a database in response to a search request for a specific sound image; A sound image sound field position display management unit for providing an image search function through a user interface and reproducing the sound generation period, sound field generation period, and position information of the image file retrieved through the sound image sound field position search unit through an output device; There is provided a sound field display digital video recorder system including a display and a speaker, and an output device for outputting video, sound, sound field, and position information for a specific sound applied by the DVR device.

According to another aspect of the present invention, there is provided a method of recognizing a specific sound from sound data by receiving image, sound, and sound field data; Calculating a sound position from a sound field of a specific sound when a specific sound is recognized; A step of tracking a sound image sound field input device at a position where a specific sound is generated; A specific sound, a specific sound type, a sound generation section information in which a specific sound is generated, a sound field information of a specific sound, a specific sound The sound field generation section information and the sound generation location information of the sound source in real time and storing the sound information in a database; If an image search for a specific sound is detected, the sound generation section information of a specific sound is searched in the database according to a required condition to search for image section information, and the sound field generation section information of a specific sound is searched for, Searches the sound generation position information of a section where a specific sound is generated, searches for the position of the sound generation position and the position of the section that moves to the sound generation position, and searches for a sound image sound field input device A specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information to the tracked section, a specific sound, a specific sound type, a specific sound type, a specific sound, and sound generation position information.

According to another aspect of the present invention, there is provided a method of recognizing a sound, comprising the steps of: receiving image, sound, and sound field information; Calculating a sound position from a sound field of a specific sound when a specific sound is recognized; Displaying a specific sound, a specific sound, a specific sound type, sound generation period information of a specific sound, sound field information of a specific sound, sound field generation period information of a specific sound, and sound generation position information, and storing them in a database; If an image search for a specific sound is required, the sound source section information of a specific sound is searched for in the database according to the required conditions, the video section information is searched, the sound field occurrence section information of the specific sound is searched, A method of operating a sound field display digital video recorder system including a process of reproducing a sound field and a sound field of the sound field is provided.

According to the embodiment of the present invention, the sound image sound field input device is tracked to a position where a specific sound is recognized and a specific sound is generated, thereby detecting a sound image sound field input device Sound, sound type, sound field information, and location information of a specific sound can be displayed and stored in real time, and the video, sound, sound type, sound field information, and location information of a specific sound can be quickly and conveniently retrieved So that it is possible to quickly and reliably provide an image analysis of a specific sound.

According to the embodiment of the present invention, when a specific sound is recognized by a sound image sound field input device composed of a camera, a microphone array, and a transmission device, a sound image sound field input device is traced to a position where a specific sound is generated, Sound, sound type, sound field information, and location information from the specific sound generation position to the position where the sound sound image sound field input device is tracked to the position where the specific sound is generated from the specific sound generation position, And provide reliable analysis through rapid searching and playback of stored specific sounds.

Further, according to the embodiment of the present invention, when a specific sound is recognized in a sound image sound field input device in which a camera and a microphone array are combined, a location where a specific sound is generated can be displayed on the screen in real time on a sound field. It is possible to provide a specific sound, sound type, sound field information, and position information reproduction in a video search for a specific sound.

In addition, according to the embodiment of the present invention, at a moment when a specific sound is recognized by a sound image sound field input device combined with a camera and a microphone array, a position of the sound is displayed as a sound field, and a camera and a microphone array By rotating the device at the same time, it is possible to track the sound generation position continuously, and under the circumstances where it is difficult to detect by the image due to weather conditions such as rain or fog, based on the acoustic data for various accidents and incidents, The intensity of the accident, the type of accident can be visually displayed, and the location of the accident can be tracked.

In addition, according to the embodiment of the present invention, it is possible to search for an image in which a specific sound (accident) has occurred by using a sound keyword in which a specific sound (accident) has occurred and visualize the sound field of the sound on the (X, Thus, it is possible to quickly find out where an accident has occurred, and it is possible to quickly cope with the accident by visualizing the intensity of the accident. In particular, it provides an advantage of recording the movement path of a specific sound and reproducing it as an image.

According to the embodiment of the present invention, a camera, a microphone array, and a transmission are provided for sound tracking. A camera is positioned at the center of the microphone array, a specific sound is recognized using a microphone array, And the camera is moved to the sound generation position by the power transmission device so that the sound generation position can be continuously tracked.

In addition, according to the embodiment of the present invention, it is possible to synchronize a sound image and a sound generation position sound field in which a specific sound is generated, thereby generating a sound and a specific sound from a specific sound generation to a sound generation position, , Sound generation location information, and the stored image, sound, sound field, and location information can be searched and reproduced on the DVR.

1 is a block diagram of a sound field display digital video recorder system according to a first embodiment of the present invention.
FIG. 2 is a diagram illustrating a detailed configuration of a camera, a microphone, and a microphone array in a sound field display digital video recorder system according to a first embodiment of the present invention.
3 is a block diagram of a sound field display digital video recorder system according to a second embodiment of the present invention.
FIG. 4 is a detailed block diagram of a camera and a microphone array in a sound field display digital video recorder system according to a second embodiment of the present invention.
5 is a diagram illustrating a configuration of a sound field display digital video recorder system according to a third embodiment of the present invention.
FIG. 6 is a detailed block diagram of a sound field image input device in a sound field display digital video recorder system according to a third embodiment of the present invention.
7 is a detailed block diagram of a sound image sound field display management unit in a sound field display digital video recorder system according to an embodiment of the present invention.
8 is a diagram illustrating a process of generating sound field generation period information in a sound field display digital video recorder system according to an embodiment of the present invention.
9 is a flowchart schematically showing a first operating method of a sound field display digital video recorder system according to an embodiment of the present invention.
FIG. 10 is a flowchart schematically showing a second operation method of a sound field display digital video recorder system according to an embodiment of the present invention.
11 is a flowchart schematically showing a third operating method of a sound field display digital video recorder system according to an embodiment of the present invention.
12 is a view showing a search screen of a sound image sound field location file of a sound field display digital video recorder system according to an embodiment of the present invention.
13 is a view showing another example of a screen for searching a sound image sound field location file of a sound field display digital video recorder system according to an embodiment of the present invention.
FIG. 14 is a view showing another example of a search screen of a sound image sound field location file in the sound field display digital video recorder system according to the embodiment of the present invention.
15 is a diagram illustrating a search procedure of a sound field display digital video recorder system according to an embodiment of the present invention.
16 is a diagram illustrating another configuration of a sound field display digital video recorder system according to an embodiment of the present invention.
17 is a view showing a sound track area of a sound field display digital video recorder system according to an embodiment of the present invention.
18 is a diagram illustrating a sound tracking method of a sound field display digital video recorder system according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

The present invention can be embodied in various different forms, and thus the present invention is not limited to the embodiments described herein.

FIG. 1 is a diagram illustrating a configuration of a sound field display digital video recorder system according to an embodiment of the present invention.

As shown in FIG. 1, the present invention includes an input device 100, a DVR device 200, and an output device 300.

The input device 100 detects the video of the surveillance region and the sound and sound field data generated in the surveillance region, and inputs the detected sound and sound field data to the DVR device 200.

The input device 100 may include a video input device 110, a sound input device 120, and a sound field input device 120.

The image input device 110 may be a digital camera or an analog camera. The image input device 110 collects images of a surveillance area at an arbitrarily adjusted angle in an installed area and transmits the collected image information to the DVR 200 .

The sound input device 120 may be micro-enabled, collects various types of sound generated in the installed area, and inputs the collected sound information to the DVR device 200.

The sound input device 120 may be a dynamic microphone, a condenser microphone, a ribbon microphone, or the like depending on its structure. Depending on the directivity, a directional microphone, a nondirectional microphone, a unidirectional microphone, (Super cardioid, Hyper cardioid) can be used. Therefore, any one or more of them can be applied.

The sound input device 120 may preferably use a directional microphone to suppress sounding and howling and to stably collect sound generated from a long distance.

The image input device 110 and the sound input device 120 may be installed individually or in the form of a pair of image input devices 110 in which the sound input device 120 is embedded, And the sound and image generated in the surroundings are collected.

That is, it can be installed in the form of a camera with a built-in microphone.

The sound field input device 130 is composed of a microphone array in which two or more microphones are regularly arranged in a square, circular, spiral, random, or the like. The sound field input device 130 collects sound field information of the sound and outputs the collected sound field information to the DVR 200 .

The sound field input device 130 is fixedly installed in an environment where rotation (pan / tilt) is not required in the collection of the sound field information.

The sound field input device 130 may include a sound absorbing unit for absorbing sound around the microphone, and a microphone array having two or more microphones arranged at regular intervals. The sound field input device 130 amplifies the micro- An acoustic processing unit may be included.

Generally, a sound field refers to a region of a medium in which a sound wave exists. In the sound field, a method of visualizing a sound and displaying it as an image is to express the magnitude of the sound pressure as a change in color or contrast.

At this time, the position (X, Y) on the space of the sound source can be mapped to the spatial coordinates of the image, and the acoustic parameter called the sound pressure is mapped to a visual variable called color or lightness.

In order to accurately visualize the sound, the physical phenomenon of the sound must be expressed without error, and the physical meaning of the sound parameter must be intuitively expressed.

The size of the microphone array may be various sizes such as 100 ~ 100mm ~ 300 ~ 300mm in width and width, and it is possible to modify the microphone array horizontal / vertical length and microphone interval in consideration of the microphone size and the interval between the microphones. have.

The microphone array can arbitrarily adjust the interval between the microphones. In order to communicate between the microphone array and the PC, at least serial communication must be prepared. The microphone array has a portion for amplifying a signal input to the microphone in preparation for a small signal, , A portion for changing the analog signal to digital, and an SDK for processing the digital signal.

The DVR device 200 recognizes image information and sound information input through the image input device 110 and the sound input device 120 to separately display and store sound by type, Stores the image or video segment information in which a specific sound is generated according to the detected sound field information, and displays and stores the sound field corresponding to the specific sound in real time.

The DVR 200 accesses only the corresponding image of the sound using the sound generation period information file and the sound field generation period information file to request the output device 300 together with the sound field, .

The output device 300 includes a display and a speaker, and outputs only a specific sound applied to the DVR device 200 and an image and a sound field matching therewith so that the user can view the sound.

The DVR device 200 includes an image input unit 210, a sound input unit 220, a sound field input unit 230, an image management unit 240, a sound recognition unit 250, a sound field management unit 260, a sound image sound field display unit 270 A sound image sound field file storage unit 275, a database 280, a sound image sound field search unit 290, and a sound image sound field display management unit 295.

The video input unit 210 and the sound input unit 220 can output sound and video to the 16-channel, 32-channel, 64-channel, and 124-channel video input device 110, The video information and the sound information can be input from the device 120 at the same time.

Alternatively, video information and sound information may be input separately from the arbitrary number of video input devices 110 and the audio input device 120 using a separate video capture card and an audio capture card.

The image input unit 210 and the sound input unit 220 convert the input image information and the sound information into a digital signal when they are analog signals.

The sound field input unit 230 receives the sound field information from the sound field input device 130 and provides the sound field information to the sound field management unit 260 for analysis.

The image management unit 240 analyzes and records the image information provided by the image input unit 210. The image management unit 240 matches the sound type, time interval information, and waveform information transmitted from the sound recognition unit 250 to images to be recorded, And creates an image file and stores it in the image DB 282. [

The video management unit 240 manages general video recording and recording of a section in which a specific sound is generated, and separately manages general video recording by operation-recognized recording and full-time recording.

The sound recognition unit 250 analyzes the sound data converted into a digital signal by the sound input unit 220 to perform endpoint detection, and classifies a sound type through a sound recognition algorithm. A sound type, an image recording file name, sound data (waveform information, etc.) corresponding to the time point at which the end point is detected, to the image management unit 240 and the sound image sound field file storage unit 275 .

The sound recognition unit 250 receives the sound information input through the sound input device 120, and when a specific sound is detected from the sound information, the sound recognition unit 250 obtains the time interval information or the frame position information of the sound, And stores it in the sound information DB 484 via the sound image sound field file storage unit 275. [

The sound recognition method of the sound recognition unit 250 determines how similar the sound currently input is to the sound classification stored in the database by using Dynamic Time Warping (DTW), Hidden Marcov Model (HMM), Artificial Neural Network (ANN) Vector Machine, and Fuzzy) to determine the most similar sound type.

For example, the sound input from the sound input device 120 detects an end point using ZCR (zero crossing rate) and energy, and uses an LPC (Linear Predictive Coding) method and a Mel Frequency Cepstral Coefficients (HMM), Artificial Neural Network (ANN), Support Vector Machine (SVM), and Fuzzy are used alone or in combination of two or more And performs sound recognition by determining the most similar sound type.

As another example, the sound recognition unit 250 may perform a sound recognition function using a sound recognition chip.

That is, in the case of a digital video recorder system using a DVR card, a sound recognition chip can be inserted into a DVR card having an audio input terminal, and a sound recognition card composed of an audio input terminal and a sound recognition chip is formed and inserted into the main board May be provided.

At this time, the sound type value is received from the sound recognition chip, and the sound type and the image section information in which the sound is generated are stored in the database, thereby performing the image search function by the specific sound.

The sound field management unit 260 analyzes the sound field information input from the sound field input unit 230 and analyzes and manages the sound field information of sound recognized as a specific sound by the sound recognition unit 250, And transfers it to the file storage unit 275 and stores it.

The sound field management unit 260 may display the analyzed sound field information in real time through the sound visual field display unit 270 or may generate a sound field file and store the sound field file in the pitch database 283 to generate a sound field generation period information file, And stores it in the information DB 285.

The sound field file generated by the sound field management unit 260 includes waveform changes, frequency information, sound data, and sound pressure information of the microphones of each sound according to time. The sound field generation period information file includes sound field generation time of sound microphones, The interval information is included between the end time in terms of the time base in milliseconds or the number of frames.

The sound image sound field display unit 270 displays the sound type, time interval information, and waveform information transmitted from the sound recognition unit 250 on the recording screen, displays the sound field information transmitted from the sound field management unit 260, , And the sound field is displayed in real time by being integrated as an image.

The sound image sound field file storage unit 275 stores various types of sounds such as a specific sound, a specific sound type, sound generation period information (sound type, sound generation time, sound end time) of the image in which the specific sound is generated, sound field information And the sound field generation period information (sound field generation time and sound field end time of the sound-specific microphones) are stored.

In particular, the sound generation period information (sound generation time and sound end time) and sound field generation period information (sound field generation time and sound field end time) are displayed based on a time reference or frame number in milliseconds.

The sound field information file may include information related to sound such as waveform changes, frequency information, sound data, and sound pressure information of the microphones of each sound with time. The sound field duration information file may include sound field generation time of sound microphones and sound field end The interval information is stored based on the time reference or frame number in milliseconds between the time points.

The sound image sound field file storage unit 275 stores sound information, sound field information, and sound field generation period information of a specific sound, a video in which a specific sound is generated, and sound field generation period information in the sound information DB 284, The images are separated and stored as image files so that they can be searched.

The sound image sound field file storage unit 275 stores general image recording files and image files in which sound is generated in the image DB 282 and stores sound files in a time interval in which a specific sound is generated in the sound DB 281, The sound field information for a specific sound is stored in the sound field DB 283 and the sound generation period information (path information of the image file for each sound type and sound generation period information) is stored in the sound information DB 284, The section information is stored in the sound field information DB 285.

The sound image sound field file storage unit 275 stores only sound generation period information, sound field information, and sound field generation period information of each sound in one image file when the global image storage is set, Or one sound file information file, one sound file information file, and one sound file information file in one image file so that only one image file, sound generation section information of each sound in the image file, and sound field generation section information of sound can be retained, One sound field generation section information file can be linked and stored.

Also, when sound recognition is set, one image file can be generated for each sound-recognized section, and one image file per sound file can be generated and stored in pairs.

The sound image sound field file storage unit 275 may store the image and sound in synchronization with each other, and may also store a separate sound recording file so that various options can be selected during image playback.

The playback function according to the storage type of the sound image sound field file storage unit 275 is briefly summarized as shown in Table 1 below.

Storage type How to play (Or a predetermined section image) file,
Sound generation section information file, sound field information file,
Sound field occurrence section information file (Reproduction of a predetermined section image) and a sound generation section, a picture / sound field reproduction of a sound generation section (Or a predetermined section image) / sound / sound field synchronization file,
Sound generation section information file, sound field information file,
Sound field occurrence section information file Full-screen video and sound, sound field playback (playback of a certain section), video and sound of a sound generation section, sound field reproduction An entire image file (or a predetermined section image file),
Sound file of sound generation section,
Sound generation section information file, sound field information file,
Sound field occurrence section information file Full-time video (constant interval video) and sound, sound field playback, video and sound of sound generation section, sound field reproduction Sound generation section image file, sound generation section information file, sound field information file, sound field generation section information file Sound and sound field reproduction of sound generation section and sound field generation section Sound generation section image and sound file,
Sound generation section information file, sound field information file,
Sound field occurrence section information file Sound and sound of the sound generation section, sound field reproduction Sound generation section video / sound / sound field synchronization file,
Sound generation section information file, sound field information file,
Sound field occurrence section information file Sound and sound of the sound generation section, sound field reproduction

The sound image sound field file storage unit 275 stores H.263, H264, MPEG4, and the like. Various compression methods such as ADPCM (Adaptive Differential Pulse Code Modulation), G.723, and G.726 can be used when storing sound.

The database includes a sound DB for storing a sound file in a time period during which a sound is generated, an image DB for storing a general image recording file and an image file for a specific sound, a sound field DB for storing sound field information for a specific sound, A sound information DB for managing a sound generation section information file storing the sound generation section information, and a sound field information DB for managing the sound field generation section information file storing the sound field generation section information for each specific sound type.

The sound image sound field search unit 290 provides a keyword search, a search by sound type, and a tag search, and provides a sound file corresponding to the search result, image file path information stored in the sound information DB 284 by the sound file, The sound generation section information in which the specific sound is generated and the path information of the image file in which the specific sound is generated using the time interval information, waveform and sound pressure information according to the time of each microphone stored in the sound field information DB 285, And acquires the different sound field occurrence period information and transmits it to the sound image display management unit 295 for playback.

The sound image display management unit 295 provides time search, sound type search, keyword search, period search, interval search, tag search, and channel search functions to search for image information in which a specific sound is generated, Sound reproduction of video file The video, sound and sound field are reproduced through the output device.

In addition, an interface is provided so that a user can view a searched image through the sound image sound field searching unit 290, and a search function of an image is provided to search for a sound image file by date when the time searching means is used, When using the sound type search means, it is possible to perform period search based on the sound type and the sound keyword, and provides tag search.

The tag search displays the time, minutes, and seconds of a specific sound on the graph representing the hour, minute, and second corresponding to a specific year, month, and day in an eye-catching manner, and displays the type of sound in the bottom of the graph intuitively Easily access the image.

In addition, when viewing a sound image file, it provides a function for viewing only a video, a function for separately viewing video and sound, a sound field, and a function for synchronizing video, sound, and sound field.

The output device 300 includes a display and a speaker, and outputs video, sound, and sound field for a specific sound, which is input from the DVR device, through a display device and a speaker.

FIG. 2 is a detailed block diagram of an input device in a sound field display digital video recorder system according to an embodiment of the present invention. Referring to FIG.

The input device 100 is equipped with a voice input device 120 which is an external microphone for recognizing sound generation at an arbitrary position and a microphone array 133 constituting the sound field input device 130 is connected to a video input device 110 ) Is located.

The viewing direction of the camera, which is the video input device 110, and the viewing direction of the microphone array 133 are arranged on the same straight line so that the camera and the microphone array 133 are operated in a fixed state.

At this time, the microphone array 133 is arranged at equal intervals, and can be fixed to a ceiling, a wall, or the like through the fixing member 135.

FIG. 3 is a diagram illustrating another configuration of a sound field display digital video recorder system according to a second embodiment of the present invention.

As shown in FIG. 3, the sound field display digital video recorder system according to the second embodiment differs from the first embodiment in that the input device is differentiated, and the DVR device and the output device are configured identically, A detailed description of the output device will be omitted.

In the second embodiment of the present invention, the input device 100 removes the external microphone, which is a sound input device installed at an arbitrary position, and removes the microphone at a specific position or at the center of the sound field input device 140, It is used to analyze the sound field information. The system is further simplified by analyzing not only the sound field but also the type of sound to at least one microphone.

In this way, the sound field input unit 235 transmits a specific micro-input sound of the microphone array constituting the sound field input device 140 to the sound recognition unit 250, and at the same time, all the sounds To the sound field management unit 260.

FIG. 4 is a detailed block diagram of an input device in a sound field display digital video recorder system according to a second embodiment of the present invention.

As shown in FIG. 4, the external microphone is removed from the configuration of FIG. 2, and a specific microphone (microphone) of the microphone array 143 is also used to input sound field information and specific sound, The cost can be reduced.

5 is a diagram illustrating a configuration of a sound field display digital video recorder system according to a third embodiment of the present invention.

As shown in FIG. 5, the sound field display digital video recorder system according to the third embodiment is different from the input device in the configuration of the second embodiment, and the DVR device and the output device are configured to be the same or similar, A detailed description of the DVR device and the output device will be omitted.

In the third embodiment of the present invention, the sound field image input device 100b includes a video input device 110b constituted by a camera, a sound field input device 120b constituted by a microphone array, and a pan / tilt transmission device 130b do.

The sound input through the sound field input device 120b constituted by the microphone array is calculated by the position recognizing part 261b and the position of the sound is detected by the position detecting part 262b via the pan / (130b).

The position information of the sound calculated by the position recognition unit 261b is displayed on the screen through the sound image sound field position display unit 270b and displayed on the screen through the sound image sound field position file storage unit 271b And the sound position information is also stored in the sound information DB 284b and the sound field information DB 285b.

The sound image sound field position searching unit 290b searches the sound information DB 284b and the image DB 282b for a video in which a specific sound is generated when a user's search condition is inputted and simultaneously outputs sound, sound field, And outputs it through the display management unit 295b.

The playback function according to the storage type of the sound image sound field position file storage unit 271b is briefly summarized as shown in Table 2 below.

Storage type How to play (Or sound track section video) file,
Sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Full-screen video playback (sound track section video playback) and sound generation section, video / sound field playback of the sound field section, location information display (Or sound track section video) / sound / sound field synchronization file,
Sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Full-length video and sound, sound field reproduction (sound track section video), video and sound of sound track section, sound field reproduction, location information display An entire image file (or a predetermined section image file),
Sound file of sound generation section,
Sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Full-length video (sound track section video) and sound,
Sound field reproduction, position information display,
Sound and sound of sound track section, sound field reproduction, location information display Sound track section image file, sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Sound Tracking Section and Sound Generation Section, Image of Sound Generation Section, Sound Field Reproduction, Location Information Display Sound track section video and sound files,
Sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Sound and sound of sound track section, sound field reproduction, location information display Sound track section video / sound / sound field synchronization file,
Sound generation section information file, sound field information file,
A sound field occurrence section information file, a position information file Sound and sound of sound track section, sound field reproduction, location information display

The image of the sound-tracking section of Table 2 refers to an image from a specific sound to a position where the sound field image position driving device is moved to a position where a specific sound is generated.

FIG. 6 is a detailed block diagram of an input device in a sound field display digital video recorder system according to a third embodiment of the present invention.

As shown in FIG. 6, the input device includes a pan / tilt transmission device 130b for real-time tracking of a camera, which is a video input device 110b on a microphone array constituting a sound field input device 120b, So that the sound field input device 120b can track the sound.

The method of analyzing the sound position enables the sound information inputted through the microphone array 120b to be estimated by the FFT algorithm.

delete

That is, the surface on which the sound source is present is called the sound source surface, and the measurement surface is set in parallel with the sound source surface. Assuming that there are an infinite number of microphones on the measurement surface, the amplitude of sound pressure when the interval between the microphones is infinitely small is obtained, and the reproduction strength is obtained. The position where the reproduction power becomes maximum becomes the position of the sound source.

delete

delete

For example, when a specific sound is recognized, the position of the sound source is calculated from the sound information inputted in real time through 16 or more microphones, and the color information according to each waveform size (sound pressure) is allocated, The sound field is displayed in concentric form from strong to weak.

At this time, a short measurement time and a high resolution are supported. Sampling can be performed up to 16 kHz from sound data of 16 channels or more, and sampling data can be stored in a sound field information DB.

The method of operating the sound field display digital video recorder system described with reference to FIG. 5 and FIG. 6 includes the steps of receiving image, sound, and sound field data and recognizing a specific sound from sound data; Calculating a sound position from a sound field of a specific sound when a specific sound is recognized; A step of tracking a sound field image input device to a position where a specific sound is generated; A specific sound, a specific sound type, a sound generation section information in which a specific sound is generated, sound field information of a specific sound, a sound of a specific sound, Sound field occurrence period information, and sound occurrence position information in real time and storing them in a database; If an image search for a specific sound is detected, the sound generation section information of a specific sound is searched in the database according to a required condition to search for image section information, and the sound field generation section information of a specific sound is searched for, Searching for the sound generation position information of the section where the specific sound is generated, searching for the position of the sound generation position and the position of the section for moving to the sound generation position, and searching the sound field image input apparatus A specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information.

Also, the sound field image input apparatus is returned to the initial position when a specific sound is not recognized for a predetermined time after the sound field image input apparatus is traced to the position where the specific sound is generated.

In addition, when storing the image, there is a feature of storing an image up to a section in which the sound field image position driving device is moved from a specific sound occurrence to a specific sound occurrence location, rather than a video section where a specific sound is generated.

In addition, in the image retrieval, the path information of the image file up to the section in which the sound field image position driving device is moved from a specific sound occurrence to a specific sound occurrence point is retrieved and reproduced .

7 is a detailed block diagram of a sound image sound field position display management unit in a sound field display digital video recorder system according to an embodiment of the present invention.

The sound image sound field position display management unit 295b includes a sound type selection unit 295-1 and a keyword search unit 295-2, a period setting unit 295-3, a tag search unit 295-6, A sound image list display unit 295-8, and a sound image sound field watching unit 295-9.

The sound type selection unit 295-1 provides a function for enabling a user to perform an image search by selecting a sound type.

The sound type selection unit 295-1 divides the types of sound collected according to the installation location of the sound field display digital video recorder system into a very wide variety so that the sound types can be selected.

For example, when installed in an underground parking lot, a road or a tunnel, sounds such as a horn, a collision, a slip, a glass breakage, a scratch, a tap, a fire, an explosion, a scream and a leak are collected. , When installed in a zoo, the sounds of lions, tigers, gorillas, chimpanzees, orangutans, parrots, and penguins are collected so that they can be distinguished and selected. If installed in a dog cafe, the dog's hungry sounds, Since barking, fighting, and whining sounds are collected, these sounds can be selected separately.

This can be summarized as shown in Table 3 below.

underground parking lot Zoo Dog cafe Horn, crash, slippage, glass breakage, scratching, tapping, fire, explosion, screaming, leakage, etc. Lions, tigers, gorillas, chimpanzees, penguins, parrots, orangutans, etc. Hungry, strangers barking, fighting, crying, etc.

The keyword searching unit 295-2 provides a function of searching for a specific image by inputting a character keyword.

Since the specific sound generation period information is stored in the sound information DB 284b in the XML format as shown in Table 4 below, the XML script (Script) in the table 4 holds image file information for each sound type, Provides the ability to quickly search for files.

The video file can represent both the sound generation time and the sound end time as below, and the image file is generated every time the sound is generated.

<FILE_INFO>
<ALARM>
A01_20090123113012123_20090123113016589.avi
</ ALM>
<COLLISION>
A02_20090123113145012_20090123113145625.avi
</ COLLISION>
<BRAKE>
A03_20090123114528337_20090123114531050.avi
</ BRAKE>
</ FILE_INFO>

Also, as shown in Table 5 below, the image file can represent the time between the sound generation time and the sound end time in milliseconds, and the image file is generated for each sound generation section.

<FILE_INFO>
<ALARM>
A01_20090123113012123 [4466] .avi
</ ALM>
<COLLISION>
A02_20090123113145012 [613] .avi
</ COLLISION>
<BRAKE>
A03_20090123114528337 [713] .avi
</ BRAKE>
</ FILE_INFO>

Table 6 below shows an example of a sound generation interval information file in which various sound information is recorded in one image file. The date and time information of the image file are recorded, and the sound and the sound Time information is recorded.

As a result, it is possible to know at what time position a specific sound is generated in the image file. By moving to the time interval and reproducing the image, it is possible to view the image in which the sound is generated.

<FILE_INFO>
<Movie
name = Car20090131113012000.avi
Date = 20090131
Start Time = 11: 30: 12,000 End Time = 11: 50: 22.300
Delay Time = 00: 20: 10.300 >< / Movie >
<SoundCategory>
<ALARM>
2009.01.23.11:30:12.123 [4466]
</ ALM>
<COLLISION>
2009.01.23.11:31:45.012 [613]
</ COLLISION>
<BRAKE>
2009.01.23.11:45:28.337 [713]
</ BRAKE>
</ SoundCategory>
</ FILE_INFO>

The period setting unit 295-3 provides a function of searching the information selected or inputted by the sound type selecting unit 295-1 and the keyword searching unit 295-2 according to a specific period.

The period setting unit 295-3 is divided into a period search unit 295-4 and a period search unit 295-5. The period search unit 295-4 selects a year / month / And the section searching unit 295-5 can search the corresponding image by selecting the year / month / day / hour corresponding to the start and end of the specific section.

The tag search unit 295-6 displays graphs of the hour, minute, and second of the sound of each camera, displays the type of sound in the form of text on the graph indicating 'seconds' So that it can be easily retrieved.

The channel selection unit 295-7 provides a function of designating a camera that inputs an image in a process of searching for a sound-specific image.

The sound-based image file list display unit 295-8 displays the information retrieved through the sound type selection unit 295-1, the keyword retrieval unit 295-2, and the period setting unit 295-3, It can be displayed according to the date as shown in Table 7 below. It displays the year / month / day / hour / minute / second / millisecond, the time of sound in milliseconds, and the sound type.

20091109 01: 11: 09.023 01: 11: 09: 159 [137, crash]
20091109 01: 23: 12.001 01: 23: 12: 300 [300, Slipping]
20091109 01: 29: 45.222 01: 29: 45: 358 [136, Break]
20091109 01: 35: 29.056 01: 35: 29: 156 [101, mild]
20091109 01: 37: 30.183 01: 37: 30: 194 [012, mild]
20091109 01: 37: 32.251 01: 37: 32: 350 [100, speeding]
20091109 01: 43: 02.063 01: 43: 02: 177 [115, Horn]

The sound field-specific sound field viewing unit 2959 displays the image information stored for each sound. The sound field-specific sound field viewing unit 2959 outputs an image for an interval in which a specific sound is generated, or simultaneously outputs an image and a sound.

8 is a diagram illustrating a process of generating sound field generation period information in a sound field display digital video recorder system according to an embodiment of the present invention.

The sound field generation section information refers to section information based on the time reference or frame number in milliseconds between the sound field occurrence time and sound field end time of the sound microphones, and this information is stored in the sound field occurrence section information file.

The sound field in which a specific sound is generated can be reproduced on the basis of waveform data and sound pressure information of each microphone of each sound in the sound field file according to the sound field occurrence period information.

For example, if it is detected that a specific sound such as a horn, a collision, or slippage occurs in a specific time interval while the video is being input from the video input device 110b, (Sound field generation period information) as a time or frame number including a sound type, a sound generation time and a sound end time, and stores the sound field generation time and sound field input time through each microphone of the sound field input device 120b, Continuously records in the sound field information DB as time or frame number including the end time.

Waveform data, waveform changes, frequency information, sound data, and sound pressure information of each microphone due to a specific sound are stored in a sound field DB (sound field file).

For example, to describe the sound field occurrence interval information file (sound field information DB), when a specific sound, for example, a bell sound, is detected at 11:30:12 on April 30, 2009 at 123 milliseconds When the sound of the horn is finished at 11:30:16, 589 milliseconds on April 30, 2009, the image of the horn sound is terminated and the sound information DB is generated and stored do.

At this time, the start time and the end time information of each microphone input through the microphone array are also recorded to generate a sound field generation period information file (sound field information DB).

Table 8 shows an example of the sound field occurrence period information.

<FILE_INFO>
<Movie
name = Car20100430113012000.avi
Date = 2009-01-31
Start Time = 11: 30: 12,000
End Time = 11: 50: 22.300
Delay Time = 00: 20: 10.300 >< / Movie >
<SoundCategory>
<ALARM>
2009.04.30.11:30:12.123 [4466]
<MIC1>
2009.04.30.11:30:12.123 [3500]
</ MIC1>
<MIC2>
2009.04.30.11:30:12.256 [3430]
</ MIC2>
<MIC3>
2009.04.30.11:30:12.312 [3322]
</ MIC3>
... ... .
</ ALM>
</ SoundCategory>
</ FILE_INFO>

9 is a flowchart schematically illustrating a method of operating a sound field display digital video recorder system according to an embodiment of the present invention.

When video, sound, and sound field information are input from the input device 100 to the DVR 200, the DVR 200 recognizes a specific sound from the input sound information (S101).

When a specific sound is recognized in S101, a sound position is calculated from a sound field of a specific sound (S102), and a specific sound is tracked by rotating the sound field image position input device to a position where the specific sound is generated (S103).

A specific sound, a specific sound, a specific sound type, sound field information of a specific sound, and a specific sound from a specific sound to a position where the sound field image position input device is moved to a position where a specific sound is generated, The generated sound region information, the sound field generation period information of the specific sound, and the location information of the specific sound are displayed in real time and stored in the database (S104) (S105).

Then, when an image search for a specific sound stored in the user interface is requested, the sound generation section information in which a specific sound is generated is searched in the database according to a required condition, and the sound section occurrence information of the specific sound is searched , Searching for the sound field of the section in which the specific sound is generated, searching for the sound generation position information of the section in which the specific sound is generated, searching for the position of the section for moving to the sound generation position and sound generation position, A specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information to a section where the sound field image position input device is moved to a position where the sound is generated (S106).

FIG. 10 is a flowchart schematically showing a second operation method of a sound field display digital video recorder system according to an embodiment of the present invention.

When image, sound, and sound field information are input from the sound field image position input device (S201), the sound information is analyzed to determine whether a specific sound is recognized (S202).

If it is determined in S202 that the specific sound is not recognized, the process returns to S201 to detect the input of the video, sound, and sound field information. If a specific sound is recognized in the sound information, the sound position is calculated from the sound field of the specific sound, The sound field image position input device is moved to a position where the sound field image is positioned (S203).

A specific sound, a specific sound type, sound generation section information in which a specific sound is generated, sound field information of a specific sound, sound information of a specific sound, The sound field generation period information of the specific sound, and the sound generation position information are stored in the database (S204).

A specific sound, a specific sound type, a sound generation period information in which a specific sound is generated, sound field information of a specific sound, a sound field generation period of a specific sound, Information and sound generation location information are stored in the database (S205).

After the sound field image position input device is moved to the calculated position in step S205, if the specific sound is not recognized, the sound field image position input device is returned to its original position after the storing operation is completed. And returns to the initial step of detecting the input (S206).

However, if a specific sound is recognized within a predetermined time after the sound field image position input device is rotated to the calculated position, the sound position is calculated from the sound field information of the specific sound, The sound field image position input device is rotated to track a specific sound (S207).

A specific sound, a specific sound type, a sound generation section information in which a specific sound is generated, a sound field information of a specific sound, The sound field generation period information of the specific sound, and the sound generation position information are stored in the database (S208).

In addition, if an image search for a specific sound stored in the database is requested from the user interface, the sound generation section information is searched for in the database according to the detected requirement, and the sound section occurrence information and the position information A specific sound, a specific sound type, sound field information of a specific sound, and sound generation position information from a point at which the specific sound is generated to a position where the sound field image position input device is tracked Play through the device.

11 is a flow chart schematically illustrating another operation method of a sound field display digital video recorder system according to an embodiment of the present invention.

When the image, sound, and sound field information are input from the sound field image position input device (S201), the specific sound is recognized by analyzing the sound information (S301).

If a specific sound is recognized in step S301, a sound position is calculated from the sound field information of the specific sound (S302).

When the position of the specific sound is calculated from the sound field information in step S303, the specific sound, the specific sound, the specific sound type, the sound field information of the specific sound, and the sound generation position information of the specific sound are displayed on the output device at step S303.

Specific sound, specific sound type, sound generation period information on a specific sound, sound field information of a specific sound, sound field generation period information of a specific sound, The sound generation position information is stored (S304).

Thereafter, when an image search for a specific sound stored in the database is requested from the user interface, the sound generation section information of a specific sound is searched for in the database according to the detected requirement to find the image section information, And the sound field of the section in which the sound is generated is reproduced through the output device of the image and sound (S305).

12 is a view showing a search screen of a sound image sound field location file of a sound field display digital video recorder system according to an embodiment of the present invention.

When the time search is selected on the screen of the sound image sound field display management unit to which the user interface is connected, as shown in the figure, a button A101 for selecting a sound image sound field position search and a button A102 for selecting a global image search are included A button for selecting a time search for a sound image sound field file, a button for selecting a sound type search for a sound image sound field file, and a button for selecting a tag search.

A button A103 for selecting a date to be searched when a time search is selected from the menu, a button A104 for selecting a time to be searched, and a button A106 for selecting a channel. Although not shown, A button for selecting a file, and a button for playing back the retrieved sound image file.

The buttons are connected to a user interface by a mouse, a touch panel, or the like to select a button.

The time search of the sound image sound field file through the screen of the sound image sound field display management unit having the above structure is as follows.

Button A103 for selecting the date to be searched is activated by selecting the sound image sound field position search button A101 and the time search button, and when the "year, month, day" to be searched is selected, the time selection button A104) is activated, and the information of the time at which the image is stored in the corresponding date is activated.

Accordingly, when "time" to be searched is selected, the sound image sound field file information generated within the selected "time" is displayed (A105).

01 means 1 hour, and [8] means that 8 sound image files are recorded in 1 time zone in 01 [8] of "Time" activated in red on the above screen.

Each sound image file is displayed as 11: 09.023 11: 09: 159 [137, Horn], which means "horn" for 137 milliseconds within 11 minutes 09 seconds 23 milliseconds to 11 minutes 09 seconds 159 milliseconds, It can be seen that the sound information is the file information.

When one of the sound image file lists is clicked, an image file for a specific sound such as collision, slippage, break, punctuation, and a horn is reproduced (A 200) and displayed and the waveform A 300 of the sound is displayed.

In addition, it is possible to grasp in real time the type of accident (collision), the distance of the accident (10m ahead), the sound position (30 ° tilt of the fan 10 °) and the accident site volume information (60dB).

13 is a view showing another example of a screen for searching a sound image sound field location file of a sound field display digital video recorder system according to an embodiment of the present invention.

And provides a function of selecting a preset sound type to be searched and selecting it when the sound type search is selected from the menu.

When a user desires to directly input a sound type, a character is input to a keyword input to perform a search.

FIG. 14 is a view showing another example of a search screen of a sound image sound field location file in the sound field display digital video recorder system according to the embodiment of the present invention.

When a tag search is selected from the menu, if a year, month, and day are selected, a sound field location image file generated on the corresponding day is visualized and displayed in the hour, minute, and second intervals. When the corresponding interval is clicked, The corresponding specific sound, the sound field in which the specific sound is generated, and the position information can be reproduced together with the image.

15 is a diagram illustrating a search procedure of a sound field display digital video recorder system according to an embodiment of the present invention.

When a search function for a specific image is executed through the user interface, the executed search function is classified as time search, sound type search, or tag search (S400).

If it is time search in the search function classification of S400, selection of "year, month, day" to search for a specific image (S411) and selection of time to search are detected (S412).

When the selection of "year, month, day, time" for the image search is detected, the sound image information of the corresponding time is read from the database (S413) and the sound image list is displayed (S414).

Then, when a specific image for reproduction is selected in the sound-specific image list (S415), the designated image stored in the database is read and the image and sound are output (S416).

If it is determined that the type of sound is to be searched in step S400, it is determined whether a sound type or an input of a keyword is detected (S421).

If the selection of the sound type or the input of the keyword is detected in S421, the selection of the year, month, day, and time to search for a specific image is detected (S422).

When the selection of "year, month, day, time" for the image search is detected, the sound image information in which the sound is generated is read from the database (S423) and the image list of the sound is displayed (S424).

Then, if a specific image for reproduction is selected in the image list of the displayed sound (S425), the designated image stored in the database is read and the image and sound are output (S426).

If the tag search is performed in step S400, the user selects a desired year, month, and day to search for a specific image (S431), selects a desired time zone (S432) (S433), and detects the selection of a sub-period to be searched (S434).

When the selection of the year, month, day, hour, minute, and second intervals requesting the image search is detected and the selection of the tag is detected (S435), the sound image information selected by the tag is read from the database, And outputs a sound (S436).

16 is a diagram illustrating another configuration of a sound field display digital video recorder system according to an embodiment of the present invention.

When the image and sound information are input through the cameras 110C and 120C included in the sound image input apparatus 100C, the entire image of the input image and sound information is stored in the entire image database 284C of the database 280C. .

If the input sound information is recognized as a particular incident sound by the sound recognition unit 250C, the corresponding image and sound are synchronized (255C) and stored in the global image DB 284C and the sound segment information DB 283C.

In addition, the sound field analysis result obtained by analyzing the input sound information through the sound field analyzing unit 260C is stored in the sound field data DB 282C of the database 280C, and the position calculation result calculated through the position calculating unit 261C is stored And stores it in the collision position information DB 281C of the database 280C.

It is also possible to display the sound recognition (sound classification) information, the sound field analysis information, and the collision position information to the real-time DVR user interface 410 and to display the same on the real time sound source / sound field tracking by the pan / tilt driving of the sound image input device 100C .

If the search keyword inputted from the user 500 is detected by the accident search module 430, the accident search module 430 synchronizes the accident collision image and the sound field information stored in the sound interval information DB 283C, 440 and the output device 300C.

The vehicle collision position information, the sound field data, the sound section information, and the whole-section image information are retrieved by the accident retrieval module 430 and provided to the user. The DVR management module 420 includes a sound image input device 100C, And controls the power transmission device 130C to rotate the sound image input device 100C to the position where the sound is generated.

17 is a view showing a sound track area of a sound field display digital video recorder system according to an embodiment of the present invention.

The figure shows that, depending on the point of sound generation, it is possible to distinguish between a zone requiring rotation (zone B) and a zone not requiring rotation (zone A).

That is, when rotating, the sound generation position (X, Y) on the monitor of the area monitored by the camera rotates when there is a zone B as in the above picture, and does not rotate when it is in the zone A

18 is a diagram illustrating a sound tracking method of a sound field display digital video recorder system according to an embodiment of the present invention.

As shown in the figure, when a sound occurs at one point on the B-zone, the sound is rotated by adjusting the pan angle and the tilt angle so that the center of the monitor (the center of the camera) is positioned at the sound generation position.

At this time, it is possible to rotate the image sound device by using the communication protocol such as RS232 or RS422 on the derived coordinates by calculating the sound generation position.

While the present invention has been particularly shown and described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, , Additions, deletions, and so on, other embodiments may be easily suggested, but this is also included in the spirit of the present invention.

100: input device 200: DVR device
300: Output device

Claims (105)

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete An input device which is integrally coupled to the pan / tilt driving device for tracking a sound generation position and comprises a video input device for capturing an image of a surveillance area and a sound field input device for inputting sound and sound field of the surveillance area;
The sound field image position driving device is operated by recognizing the sound of the surveillance area input by the input device and displaying the sound by sorting and displaying the sound, and calculating the position of the specific sound, A DVR device for accessing and displaying a corresponding image, sound field, and position information according to a search request for a specific sound;
An output device including a display and a speaker for outputting video, sound, sound field, and position information for a specific sound applied by the DVR device;
Lt; / RTI &gt;
The DVR apparatus includes an image input unit for receiving an analog image provided from a camera and converting the analog image into digital data;
A sound field input unit that receives analog sound information provided from a microphone and converts the analog sound information into a digital signal, receives analog sound field information provided from two or more microphones, and converts the analog sound field information into a digital signal;
A sound recognition unit for analyzing digital sound information applied from a sound field input unit to classify sound types and recognizing a specific sound;
A video management unit for managing a normal video image and an image of a section where a specific sound is generated;
A sound field management unit for analyzing and managing sound field information of a recognized specific sound provided by the sound recognition unit;
A position recognition unit for calculating a position of a specific sound input from the sound field management unit;
A position drive unit for driving the camera and the microphone to a specific sound generation position provided by the position recognition unit;
A sound image sound field position display unit for real time displaying a sound image section, sound field, and position information;
The sound generation section information of the specific sound, the sound generation section information of the specific sound, and the sound field generation section information are managed as files and stored in the database, and the sound recording image sound file storing the sound recording image sound file part;
A database storing a specific sound file, a normal recording image file and a specific sound image file, a sound field file for a specific sound, a sound generating section information file, a sound field generating section information file, and a position information file;
A sound image sound field position search unit for searching an image file stored in a database through a sound image sound field position file storage unit in accordance with a search request for a video in which a specific sound is generated;
A sound image sound field position display management unit for providing an image search function through a user interface and reproducing the sound generation period, sound field generation period, and position information of the image file retrieved through the sound image sound field position search unit through an output device;
/ RTI &gt;
The sound recognition unit classifies a sound type through a sound recognition algorithm, and if the sound type is recognized as a specific sound, information on the type of the sound and the start time and end time information of the sound are provided to a sound management unit and a sound image sound field file storage unit and,
The similarity between the input sound information and the sound information stored in the database is discriminated by the pattern classification algorithm to determine the sound type,
The sound image sound field position display unit displays sound type, time interval information and waveform information transmitted from the sound recognition unit, displays sound field information transmitted from the sound field management unit, displays the sound position calculated by the position recognition unit, Sound type, and sound field are integrated in real time together with the image,
The sound image sound field position file storage unit includes waveform information and sound pressure information according to the type of sound, sound generation time, sound end time, sound field generation time per microphone, sound field end time, and microphone time, , Interval information between the sound field occurrence time and the sound field end time is stored based on the time reference or frame number in milliseconds and the sound position information according to time is stored by the sound field information according to the specific sound,
Wherein the database comprises: a sound DB storing a sound file of a time interval during which sound is generated;
An image DB storing a general image recording file and a specific sound image file;
A sound field DB for storing sound field information pertaining to a specific sound;
A sound information DB for managing path information of a video file for each specific sound type, and a sound generation section information file for storing sound generation section information;
A sound field information DB for managing a sound field occurrence period information file storing sound field occurrence period information for each specific sound type;
A position information DB for storing a sound position according to time calculated by sound field information of a specific sound;
&Lt; / RTI &gt;
The sound image sound field position search unit provides a keyword search, a sound type search, and a tag search. The sound image sound field position search unit searches for a specific sound using the image file path information and the time interval information stored in the sound information DB, And the sound information of the image file where the specific sound is generated, and acquires the waveform and sound pressure information according to the time of each microphone stored in the sound field information DB and the sound field occurrence period information per microphone, and stores the information in the position information DB The location information is obtained by the sound field information of the specific sound and is transmitted to the sound image sound field location display management unit,
The sound image sound field position display management unit provides time search, sound type search, keyword search, period search, interval search, tag search, and channel search functions to search for image information in which a specific sound is generated, Sound field, sound field, and position information of a video file are reproduced through an output device.
delete delete delete delete delete delete delete delete 54. The method of claim 53,
Wherein the sound image sound field position display management unit outputs only the image, sound field, and position of a section in which a specific sound is generated, or simultaneously outputs image, sound, sound field, and position information.
54. The method of claim 53,
In the tag search, the time, minute, and second of occurrence of a specific sound on the graph indicating the time, minute, and second corresponding to a specific year, month, and day are displayed in the form of a glance, and the type of sound is displayed in text on the bottom Features a sound field display digital video recorder system.
delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images