KR101651158B1 - C c t v security system for emergency situation notice based on sound and hybrid cognition, and method for providing thereof - Google Patents

Abstract

The present invention relates to an emergency situation cognitive CCTV crime preventing system based on sound and hybrid cognition and a CCTV crime prevention providing method. The system uses a directional flat type speaker. Therefore, the system can minimize civil complaints of neighboring residents.

Description

Technical Field [0001] The present invention relates to a CCTV security system and a CCTV security system, and more particularly,

The present invention relates to a CCTV security system and an CCTV security system based on acoustical and hybrid recognition, and more particularly, to a CCTV security system and a CCTV security system that can be used for two to five seconds In this paper, we propose a method for tracking and tracking a tracking object on a selected tracked object. In addition, If you want to be able to receive help, and if necessary, receive a beacon signal from a person who has run a safe ear-app on a mobile terminal such as a mobile phone, and send an e-mail to the acquaintance. A security system and a CCTV security providing method.

Korean Patent Registration No. 10-1507978 " VERSATILE CLOSED CIRCUIT TELEVISION SECURITY SYSTEM "corresponding to Conventional Technology 1 is related to a multi-purpose CCTV security system and is disposed inside a toilet, An emergency button for transmitting a radio signal corresponding to a push command; A wireless emergency bell receiver disposed within the toilet, the wireless emergency bell receiver receiving the wireless signal from the emergency button; A signal processor for receiving a radio signal from the radio emergency bell receiver and transmitting a radio signal in an emergency; A radio transmission unit for transmitting the radio signal in the emergency state under the control of the signal processing unit; A radio receiver for receiving the transmitted emergency radio signal; And a CCTV security pole including the CCTV camera installed when the radio receiver is installed and the radio receiver receives the radio signal in the emergency. Thus, the CCTV security pole can be used as a surveillance method using indoor CCTV, There are limitations that can not be done.

Korean Patent Registration No. 10-1291728 "CCTV POLE SYSTEM CAPABLE OF MOVING CAMERA UP AND DOWN ", which can raise and lower the camera, The object of the present invention is to provide a CCTV pawl system capable of easily mounting or lowering a camera to ascend and descend a camera that can be efficiently checked and repaired down to the lower end of a pole. There is a limit to the effective recognition and tracking of the data.

Korean Patent Laid-Open Publication No. 10-2016-0070922 corresponding to the prior art 3 "Subway cabin surveillance CCTV system and subway cabin information transmission method using the same (Surveillance CCTV system for subway cabin information using the same ") relates to a subway room monitoring CCTV system and a subway room information transmission method using the same, which enable high-resolution information to be continuously transmitted so that the situation in a subway room can be checked in real time in history, There is a limitation that it can not be used as a wide range CCTV system on the road.

Korean Patent Registration No. 10-1581795 entitled " MANUFACTURING METHOD OF LED STREET LIGHT WITH CCTV CAMERA ", which incorporates a CCTV camera, (Closed Circuit Television) camera installed in a street light or an LED (Light Emitting Diode) lighting used to illuminate a predetermined object including a security light for illuminating a road on which pedestrians are walking, and a predetermined subject can be photographed The present invention is directed to an LED street lamp having a built-in CCTV camera. However, the object of the present invention is to acquire an image of a clear object, and there is a limit to effectively recognize and track the object.

Korean Patent Registration No. 10-1507978 entitled " VERSATILE CLOSED CIRCUIT TELEVISION SECURITY SYSTEM " Korean Patent Registration No. 10-1291728 entitled " CCTV POLE SYSTEM CAPABLE OF MOVING CAMERA UP AND DOWN " Korean Patent Laid-Open Publication No. 10-2016-0070922 entitled " Surveillance CCTV System for Subway Cabin & Surveillance Method Using Subway Cabin Information Using the Same " Korean Patent Registration No. 10-1581795 entitled " MANUFACTURING METHOD OF LED STREET LIGHT WITH CCTV CAMERA "

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an acoustic and hybrid recognition system for selecting an object to be traced in an emergency based on an acoustic frequency of a single- Based emergency situation, a CCTV security system and a CCTV security providing method.

In addition, the present invention provides an emergency situation-aware CCTV crime prevention system and CCTV crime prevention providing method based on acoustic and hybrid recognition to enable the tracking area determination and tracking for the selected tracking object to be continuously performed in the case where the area is changed .

In addition, the present invention not only allows the user to pay close attention to the surroundings through the directional flat-plate speaker at the place where the tracked object is located, but also provides sound and sound for minimizing the complaints of the nearby residents by utilizing the directional flat- A CCTV security system and a CCTV security providing method based on the hybrid recognition.

In addition, the present invention not only transmits a beacon signal to a mobile terminal such as a mobile phone and receives a beacon signal from a person who has executed the safe ear application, A CCTV security system and a CCTV security providing method based on acoustic and hybrid recognition to enable an emergency situation report to be made.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided a method for providing an emergency situation-aware CCTV security based on acoustic and hybrid recognition, the method comprising: receiving, from a plurality of acoustic frequency recognition devices, A first step of receiving a monophonic sound detection of the frequency; A second step of receiving monophonic sound frequency information from the sound frequency recognition device which senses the monophonic sound of the first step for analyzing whether or not the sound recognition based emergency situation recognition module is an emergency situation; The acoustic-recognition-based emergency situation recognition module analyzes the received monophonic sound frequency information to analyze whether or not the monophonic sound corresponds to the sound frequency of the help request, and detects a first event corresponding to the help request, A third step of determining whether the image is sensed from a photographed image from a fixed camera disposed in the same area as the sensed acoustic frequency recognition device; (First judgment) that the sound is a help-requested sound frequency (first judgment), and judges that the first sound corresponds to the case where the first event is sensed (second judgment), and finally analyzes it as an emergency situation, A fourth step of determining an imaging target area of the portable camera as an acoustic frequency signal direction (a direction in which an acoustic frequency signal is sensed); A fifth step of not only rotating the lens of the movable type camera toward the determined target area but also controlling warning broadcast output through a directional flat type speaker located at a location determined as a photographing target area, And the acoustic-recognition-based emergency situation recognition module performs zoom-in and focus adjustment so that the portable camera photographs a subject in the subject area, and photographs and tracks the subject. In addition to sequentially capturing and tracking the subject, A sixth step of performing a relay function of an elapsed broadcast output using a flat speaker at the same position as the mobile camera corresponding to the next movement path; And a control unit.

In this case, the help request acoustic frequency is stored in advance as all information capable of frequency output with respect to a combination of characters constituting a sentence by a sentence by a voice of a person who requests assistance.

In the third step, the acoustic-recognition-based emergency situation recognition module performs recognition within a predetermined range of error range from the frequency output range of each character of the stored sentence, And analyzing whether a sentence matched with the acoustic frequency is recognized.

In the third step, the acoustic recognition-based emergency situation recognition module calculates the direction of the received monophonic sound frequency signal, and then calculates the direction of the received monophonic sound frequency signal from the image captured from the fixed camera disposed in the area matching the direction The image of the subject shaking his or her hand, the image of the subject shaking his hand, and the image of the subject being tilted.

The acoustic and hybrid recognition-based emergency situation-aware CCTV security system and the CCTV security-providing method according to the embodiment of the present invention can be implemented in an emergency situation based on the acoustic frequency of the single- The results of this study are summarized as follows.

In addition, according to another embodiment of the present invention, the acoustic and hybrid recognition-based emergency situation-aware CCTV security system and the CCTV security-providing method are implemented by continuously performing the tracking area determination and tracking on the selected tracking object, It provides an effect that can be done.

In addition, according to another embodiment of the present invention, the acoustic and hybrid recognition-based emergency situation-aware CCTV security system and the CCTV security providing method can be assisted by giving attention to surroundings through the directional flat- In addition, the use of directional flat-panel loudspeakers provides the effect of minimizing or eliminating complaints of nearby residents.

In addition, according to another embodiment of the present invention, an acoustic and hybrid recognition-based emergency situation-aware CCTV security system and CCTV security providing method includes receiving a beacon signal from a person who executes a safe ear- In addition to transmitting the location to the acquaintance, when the emergency button is pressed on the mobile terminal, the emergency center can be notified to the crime prevention center together with the warning broadcast.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating an acoustic and hybrid recognition based emergency situation aware CCTV security system 100 according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the configuration of the control device 160 of the CCTV security system 100 according to the acoustic and hybrid recognition based emergency situation of FIG. 1.
3 is a flowchart illustrating an acoustic recognition-based method among acoustical and hybrid recognition-based emergency situation-aware CCTV security providing methods according to an embodiment of the present invention.
4 is a flowchart illustrating a hybrid recognition-based method among acoustical and hybrid recognition-based emergency situation-aware CCTV security providing methods according to another embodiment of the present invention.
5 is a diagram illustrating an acoustic and hybrid recognition based emergency situation-aware CCTV security system in accordance with another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

1 is a diagram illustrating an acoustic and hybrid recognition based emergency situation aware CCTV security system 100 according to an embodiment of the present invention. Referring to FIG. 1, the CCTV security system 100 for recognizing an emergency based on acoustic and hybrid recognition includes a fixed camera 110, a movable camera 120, an acoustic frequency recognition device 130, a flat speaker 140, A radio signal transmitting and receiving unit 150 and a control unit 160. [

The fixed camera 110 photographs a specific area and detects whether the first to third events, the normal events, occur. The fixed camera 110 is constituted by at least one camera, and each camera photographs a specific specific area. In addition, the fixed camera 110 may detect whether the first to third events, the normal events, are occurring within the specific area being shot. Here, the first event indicates a case where a help request is detected in a specific area such as "a subject jumps," " a subject swings a hand, " In a specific area, "the subject is holding or holding a whistle," "the subject is holding or rattling the whistle," "the subject is swinging his or her hand while biting or whistling," or " Quot ;, the third event indicates a case in which a " two objects are entangled ", "two objects are located at a predetermined interval ", & At least one of the two subjects has fallen or shakes his or her hand when the subject is twisted, The first event, and shows the case where the second higher probability of emergency situations other than the event, and finally, normal event shows a case in which at least a moving object is detected in the specific area. That is, the fixed camera 110 performs a function of detecting whether a moving object exists in a specific area.

The fixed camera 110 may be a camera capable of capturing various types of images such as a general camera, a dome camera, an infrared camera, a laser camera, and a thermal camera. In addition, the fixed camera 110 may be a camera capable of photographing a wide range of angle of view.

The portable camera 120 is a camera capable of rotating the lens vertically and horizontally, and zooming in and zooming out. Specifically, the portable camera 120 can photograph and track a subject by rotating the lens to the region to be photographed under the control of the controller 160, and zooming and focusing. The portable camera 120 may be a PTZ (Pan Tilt Zoom) camera including a lens rotation function, a zoom function, and a focus adjustment function, and may include a driving device for such operation.

The acoustic frequency recognition device 130 recognizes an acoustic frequency signal inputted through at least one microphone. In addition, the acoustic frequency recognition device 130 may include three or more microphones to calculate the direction of the input acoustic frequency signal. The acoustic frequency recognition device 130 transmits the inputted acoustic frequency signal information to the control device 160. The microphones included in the acoustic frequency recognition device 130 may be installed at a position where at least one fixed camera 110 is disposed and at a position where the movable camera 120 is disposed, It may also be installed in a zone.

The control device 160 controls the overall operation of the CCTV security system 100 according to the acoustic and hybrid recognition-based emergency situations. Specifically, the control device 160 detects whether there is a moving object (that is, an event) in the image photographed by at least one fixed camera 110, and detects the moving object, if any, as an event.

At this time, the control device 160 can assign a priority according to the degree of change of motion. In addition, when a plurality of events are simultaneously generated in the plurality of fixed cameras 110, the control device 160 may prioritize events according to events depending on whether the subject is a person or a motion of the subject, May select a higher event. For example, in the case of a plurality of subjects, priority can be made higher than in the case of a single subject, and priority can be raised when instantaneous movement of the subject is quicker than when the subject is momentarily moved.

Further, the control device 160 can calculate the direction of the point where the acoustic frequency signal is generated by using three or more acoustic frequency signal signals input from the acoustic frequency recognition device 130. [ Also, the controller 160 may calculate the direction of the acoustic frequency signal only when the intensity of the input acoustic frequency signal is equal to or greater than the first dB value.

The control device 160 may be configured to collect the event information based on the event information detected by the fixed camera 110 and the sound frequency signal information among the sound frequency signal information recognized by the sound frequency recognition device 130, Determines the region to be photographed, and controls the lens direction of the portable camera 120 so as to photograph the determined photographed region. The controller 160 controls the portable camera 120 to zoom in and photograph a moving subject included in the photographing target area.

The determination of the region to be photographed using at least one of the above-mentioned means may be performed by determining the region to be photographed only by the acoustic frequency signal information recognized by the acoustic frequency recognition apparatus 130 or by using only the event information detected by the fixed type camera 110 It means that the region to be photographed can be determined in accordance with the information of ranking which is determined by determining the target region, or by comparing the two according to the combination result of the information or both. Specifically, it can be divided into whether the event is detected through the fixed camera 110 or not.

FIG. 2 is a block diagram showing the configuration of the control device 160 of the CCTV security system 100 according to the acoustic and hybrid recognition based emergency situation of FIG. 1. Referring to FIG. 2, the controller 160 is divided into an acoustic recognition based emergency recognition module 161 and a hybrid emergency recognition module 162. In the acoustic recognition based emergency recognition module 161, In FIG. 4, the hybrid emergency situation recognition module 162 operates.

In this specification, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of < / RTI >

3 is a flowchart illustrating an acoustic recognition-based method among acoustical and hybrid recognition-based emergency situation-aware CCTV security providing methods according to an embodiment of the present invention.

Referring to FIG. 3, the acoustic-recognition-based emergency situation recognition module 161 receives the single-phonetic sensing of a predetermined range of frequencies from one of the acoustic-frequency recognition devices 130 (S11).

After the step S11, the acoustic-recognition-based emergency situation recognition module 161 receives the monophonic sound frequency information from the acoustic-frequency recognition device 130 that senses the single sound of the step S11 S12).

After step S12, the acoustic-recognition-based emergency situation recognition module 161 analyzes the short-term sound frequency information received in step S12 and determines whether the short sound corresponds to the acoustic frequency requested for assistance (S13). Here, the sound frequency of the help request is stored in advance by storing all the information capable of frequency output by a combination of characters constituting a sentence by a voice of a person such as 'help me' requesting help, 'please save' The emergency situation recognition module 161 performs recognition in an error range within a predetermined range from the frequency output range of each character of the sentence stored in advance and then recognizes the sentence matched with the help request acoustic frequency by the combination of the recognized characters Whether or not it is possible.

If it is determined in step S13 that the phoneme corresponds to the assist request sound frequency, the process proceeds to step S13a. If the phoneme does not correspond to the assist request sound frequency, the process proceeds to step S13, Based emergency situation recognition module 161 analyzes the monophonic sound frequency information received in step S12 and determines whether the monophonic sound corresponds to the whistle sound frequency in step S14.

More specifically, in step S13a, the acoustic-recognition-based emergency situation recognition module 161 performs the first event detection. After calculating the direction of the end-sounding frequency signal received in step S12, From the image photographed from the fixed camera 110 disposed in the fixed camera 110, it is judged whether or not there is an image in which the subject is running, an image in which the subject shakes his or her hand, an image in which the subject falls, etc. corresponding to the first event (S13a).

If it is determined in step S13 that the monophonic sound is the assist request sound frequency (first judgment), and if it is determined in step S13a that the first event is detected (second judgment) The acoustic-recognition-based emergency situation recognition module 161 analyzes an emergency situation of a subject and then determines an area to be photographed by the portable camera 120 as an acoustic frequency signal direction (i.e., a direction in which an acoustic frequency signal is sensed) (S16).

After the step S16, the acoustic-recognition-based emergency situation recognition module 161 not only rotates the lens of the portable camera 120 to the determined object area, but also rotates the lens of the movable camera 120 toward the object area determined in step S16, And controls the warning broadcast output through the speaker 140 (S17).

After step S17, the acoustic-recognition-based emergency situation recognition module 161 performs zoom-in and focus adjustment so that the portable camera 120 photographs a subject in the target area, not only photographs and tracks the subject, And performs a relay function of an elapsed broadcast output using the flat-type speaker 140 at the same position as the portable camera 120 corresponding to the next movement path of the subject in accordance with the photographing and tracking (S18).

Through this process, the CCTV security system 100 recognizes not only the event detection information of the fixed type camera 110 but also the acoustic frequency signal information, so that the CCTV security system 100 recognizes the emergency based on acoustic and hybrid recognition. Therefore, It becomes possible to monitor.

On the other hand, if it is determined in step S13 that the monophonic sound is not the assist request sound frequency, the sound recognition based emergency situation recognition module 161 analyzes the monophonic sound frequency information received in step S12 It is determined whether or not the sound is equivalent to the whistle sound frequency (S14).

Here, the whistle sound frequency is preliminarily stored in advance as all possible information as the frequency output of the whistle distributed in the market, so that the acoustic recognition based emergency situation recognition module 161 recognizes the whistle frequency within the predetermined range of error range from the previously stored whistle frequency output range , And the number of cases of the output intensity of each recognized whistle frequency is combined to analyze whether it corresponds to the whistle acoustic frequency.

If it is determined in step S14 that the monophonic sound corresponds to the whistle sound frequency, the process proceeds to step S15a. On the contrary, if the monophonic sound does not correspond to the whistle sound frequency, the process proceeds to step S15.

More specifically, in step S15a, the acoustic-recognition-based emergency situation recognition module 161 performs a second event detection. After calculating the direction of the end-sounding frequency signal received in step S12, Quot ;, " an image in which a subject whistles or whistles a whistle, "" an image in which a subject whistles or whistles a whistle," which corresponds to a second event from an image photographed from the fixed camera 110, Quot ;, "an image in which the subject whistles or whistles ", or the like.

It is determined in step S14 that the monophonic sound is the whistle sound frequency (first judgment), and if it is determined in step S15a that the second event is detected (the second judgment) The acoustic-recognition-based emergency situation recognition module 161 analyzes an object to be photographed in the acoustic-frequency signal direction (that is, acoustic frequency The direction in which the signal is detected) (S16). The subsequent steps S17 and S18 are as described above.

Next, the process returns to step S13. If the analysis result of step S13 indicates that the monophonic sound is not the assist request sound frequency (first judgment), and the analysis result of the following step S14 is not the whistle sound frequency The acoustic-recognition-based emergency situation recognition module 161 determines whether the third event is detected through the image of the subject photographed by the fixed-type camera 100 (S15).

As a result of the determination in step S13, when the third event is detected, the acoustic-recognition-based emergency situation recognition module 161 analyzes the subject as an emergency situation and then subjects the region to be photographed by the portable camera 120 to an acoustic frequency signal direction (I.e., the direction in which the acoustic frequency signal is sensed) (S16). The subsequent steps S17 and S18 are as described above.

4 is a flowchart illustrating a hybrid recognition-based method among acoustical and hybrid recognition-based emergency situation-aware CCTV security providing methods according to another embodiment of the present invention. The flow according to the method of FIG. 4 may be performed independently in addition to the steps S13a, NO in FIG. 3, the step S15 NO in FIG. 3, and the step S15a NO in FIG.

Here, the step S13a, NO in Fig. 3 is a step S13a in which if the sound is a help request sound frequency (first judgment) in step S13 and the first event is not detected as a result of the judgment in step S13a Quot; corresponding to the second judgment) ", the process proceeds to the step S20 of FIG. 4 by the following process.

3, step S15, NO) indicates that the sound is not the assist sound frequency and the whistle sound frequency (first judgment) and the third event is not detected. The process proceeds to step S20 of FIG.

In the determination of the third event, the Hybrid Emergency Situation Acknowledgment Module 162 determines that the hybrid Emergency Situation Acknowledgment Module 162 has detected that the shortest sounding frequency signal received in Step S12 Quot; an image in which two subjects are entangled "corresponding to a third event," an image in which two subjects are under a predetermined interval "Quot; image ", "an image in which at least one of two subjects falls, or an image of waving their hand" .

3, step S15a, NO) indicates that the step sound S is a whistle sound frequency (first judgment) as a result of the judgment of step S14 and the second event is sensed as a result of the judgment of step S15a If not, the process proceeds to step S20 of FIG.

More specifically, step S20 will be described.

First, the hybrid emergency situation recognition module 162 detects a normal event from one of the plurality of fixed cameras 110 (S21). Here, the normal event indicates a case where at least a moving subject is detected within a specific area. That is, the fixed camera 110 performs a function of detecting whether a moving object exists in a specific area.

After step S21, the hybrid emergency situation recognition module 162 determines whether or not the 'shortened sounding dB? First dB value' (S22). That is, the hybrid emergency situation recognition module 162 receives the sound frequency recognition device 130 located in the area matching with the fixed camera 110 that senses the normal event in step S21 among the plurality of acoustic frequency recognition devices 130, (DB), which is the magnitude of the sound frequency signal of the single-ended sound received through the speaker, and then determines whether the value is greater than a preset first decibel (dB) value.

Here, the first dB value represents the dB value of the acoustic frequency signal which is larger than the noise normally generated in the surroundings. That is, it can be recognized that the occurrence of an acoustic frequency signal having a frequency higher than the first dB value occurs as usual. Accordingly, the hybrid emergency situation recognition module 162 controls the portable camera 120 to photograph the area where the acoustic frequency signal is generated when the acoustic frequency signal of the first dB value or more is recognized.

Such a case will be mainly used as a method for judging the crime or accident scene occurring in the blind spot of the fixed type camera 110 as an acoustic frequency signal.

As a result of the determination in step S22, if the stepped sounding dB is equal to or greater than the first sounding amount value, the hybrid emergency situation recognition module 162 determines whether or not the sounding sounding step is the step S23.

If it is determined in step S23 that the terminal sound dB is equal to or greater than the second dB value, the hybrid emergency state sensing module 162 proceeds to step S27 to determine the target area of the portable camera in the terminal sound direction, If dB is less than the second dB value, the process proceeds to step S24 to determine the target area according to the predetermined priority.

That is, if it is determined in step S23 that the terminal sound dB is equal to or greater than the second dB value, the hybrid emergency state sensing module 162 sets the imaging object area of the portable camera 120 in the direction of the acoustic frequency signal The detected direction).

More specifically, when the strength of the sound signal of the single sound is higher than the second dB value, the hybrid emergency situation recognition module 162 calculates the direction of the sound frequency signal using the recognized sound frequency signal information, The direction of the signal may be determined directly to the target area. Thereafter, the hybrid emergency situation recognition module 162 causes the portable camera 120 to photograph the direction in which the acoustic frequency signal is sensed, thereby controlling the imaging of the cause of the acoustic frequency signal. That is, even when the fixed camera 110 generates a normal event, the direction of the acoustic frequency signal can be directly determined as the target area by ignoring the event.

Here, the second dB value corresponds to the intensity of the treble (e.g., screaming acoustic frequency signal) or impact sound (e.g., total acoustic frequency signal, bomb sound frequency signal, etc.) . That is, the second dB value is larger than the first dB value. Accordingly, when the controller 160 recognizes the acoustic frequency signal of the second dB value or more, the portable camera 120 is controlled to preferentially photograph the area where the acoustic frequency signal is sensed because it is in a dangerous state.

As a result of the judgment in the step S23, if the single sounding dB corresponding to the sound frequency signal intensity is smaller than the second dB value, the hybrid emergency situation recognition module 162 sets the portable camera 120 to the subject Is determined.

This priority may include whether or not the direction of the acoustic frequency signal is included in a specific area where the normal event is generated. If the direction of the acoustic frequency signal is included in the specific area in which the event is generated, The camera 120 can determine the direction to be photographed. In addition, if the direction of the sound frequency signal is not included in the specific area in which the event is generated, the direction to be photographed may be determined according to various priorities set by the user.

That is, when a plurality of normal events are detected by the fixed type camera 110, the hybrid emergency situation recognition module 162 determines a specific region captured by the camera in which one event having the highest priority among a plurality of normal events is detected, It is possible to control the camera 120 to shoot in detail.

For example, the hybrid emergency situation awareness module 162 may determine whether or not the acoustic frequency signal dB value A in the range between the first dB value and the second dB value> motion event a> first dB value A motion frequency signal dB value B is greater than a sound frequency signal dB value B, and a motion event signal b > a is the arm's fast-moving event, and motion event b is the leg-fast-moving event. The reason is that when the sound frequency signal is bigger than when the sound frequency signal is small, and when the arm moves faster than when the leg is moving quickly, there is a high possibility of a crime or an accident.

On the other hand, if it is determined in step S22 that the stepped sound dB is less than the first dB value, the hybrid emergency situation recognition module 162 proceeds to step S25 to determine the target area of the mobile camera 120 as the normal event area (S25).

If it is determined in step S21 that no normal event has been detected, the process proceeds to step S26, where the hybrid emergency situation recognition module 162 determines whether or not the "shortened sounding dB? First dB value" If the sounding dB is smaller than the first dB value, the flow returns to step S11 in FIG. 3. Conversely, if the sounding sounding dB is greater than the first dB value, the object area of the moving camera is determined in the sounding direction S27).

Also, if it is determined in step S23 that the terminal sound dB is equal to or greater than the second dB value, the hybrid emergency state sensing module 162 determines the object area of the mobile camera in the single sounding direction (S27) ).

If the intensity of the sound frequency signal of the recognized phoneme is between the first dB value and the second dB value (step S23, NO), the control of the portable camera 120 by the hybrid emergency situation recognition module 162 The hybrid emergency situation awareness module 162 determines the shooting object according to the priority order by combining or comparing the sound frequency signal information and the event information.

To this end, the hybrid emergency situation awareness module 162 calculates the direction of the acoustic frequency signal using the monophonic sound frequency signal information, and determines whether or not the normal event is sensed in an area photographed by at least one fixed camera 110 . When the normal event is detected in a specific area captured by the fixed camera 110, the hybrid emergency situation recognition module 162 determines whether the direction of the calculated acoustic frequency signal is a specific direction It is determined whether or not it is included in the area.

If the direction of the calculated acoustic frequency signal is included in a specific area captured by the fixed camera 110 in which the event is generated, the hybrid emergency situation recognition module 162 determines that the mobile camera 120 has generated the acoustic frequency signal And controls to shoot a specific area corresponding to the direction.

On the other hand, if the direction of the calculated acoustic frequency signal is not included in the specific area captured by the fixed camera 110 in which the event is detected, the hybrid emergency situation recognition module 162 determines whether the fixed camera 120 A specific area of the image is photographed.

In this case, the hybrid emergency situation recognition module 162 compares the priority of the normal event information with the priority of the sound frequency signal information to control the mobile camera 120 to photograph the direction corresponding to the higher priority You may.

To this end, the hybrid emergency situation awareness module 162 may assign priorities to various levels of events, or assign different priorities to different levels of sound frequency signal information by intensity. When a plurality of events are detected in the plurality of fixed cameras 110, the hybrid emergency situation recognition module 162 detects a normal event having a highest priority among a plurality of normal events, The portable camera 120 may be controlled so that the portable camera 120 captures the image in detail.

If the normal event is not detected in the specific region captured by the fixed camera 110, the hybrid emergency situation recognition module 162 calculates the direction of the acoustic frequency signal using the recognized acoustic frequency signal information, The direction of the signal is determined as the target area.

When the acoustic frequency signal is not recognized in the acoustic frequency recognition device 130 and an event is detected in the fixed camera 110, the hybrid emergency situation recognition module 162 recognizes that the event is detected in the fixed camera 110 The target area is determined as a specific area and the lens direction of the portable camera 120 is controlled to photograph the determined target area.

Since the CCTV security system 100 recognizes not only the event detection information of the fixed camera 110 but also the acoustic frequency signal information, the CCTV security system 100 recognizes the acoustic and hybrid identification based on the acoustic and hybrid recognition, .

The fixed camera 110, the movable camera 120, the acoustic frequency recognition device 130, the flat speaker 140, the beacon wireless signal transceiver 150 and the control device 160 The process of monitoring by the acoustic frequency recognition device 130 and / or the mobile camera 120 is generally described. However, the monitored result, that is, the acquired image is transmitted to the control center It can be monitored and edited and used by these control centers as needed. In addition, such a set device may be provided for each site so that the monitoring center can monitor images obtained from a plurality of sites.

Those skilled in the art can implement the control of the fixed camera 110, the portable camera 120, the acoustic frequency recognition device 130, and the flat panel speaker 140 individually or collectively, It will be obvious.

In the above description, the fixed camera 110, the mobile camera 120, the acoustic frequency recognition device 130, the flat speaker 140, the beacon wireless signal transceiver 150, It is supposed that they are installed in a specific place such as the upper part of the landing and are installed in a lump, but this is merely an example for convenience of explanation. 5, for controlling the fixed camera 110, the portable camera 120, the acoustic frequency recognition device 130, the flat speaker 140, and the beacon wireless signal transceiver 150, and The technical idea of the present invention can be applied as it is when the controller 160 is installed in a separate external control center. Hereinafter, the configuration of a tracking control system according to another embodiment of the present invention will be described with reference to FIG.

5 is a diagram illustrating an acoustic and hybrid recognition based emergency situation-aware CCTV security system in accordance with another embodiment of the present invention. 5, the stationary camera 110, the mobile camera 120, the acoustic frequency recognition device 130, the flat speaker 140, and the beacon wireless signal transceiver 150 are set up, And the control device 160 may be installed separately in the external control center 350. In this case, the control unit 160 may be installed in the external control center 350, The control unit 350 or the control unit 160 can manage or control all of the plurality of sets individually.

This prevents duplication of unnecessary resources and enables continuous and total management of crimes and accidents caused by the collective management and movement of the sites.

Meanwhile, the network 400 is a communication network that is a high-speed period network of a large communication network capable of a large-capacity, long-distance voice and data service, and may be a next generation wired and wireless network for providing the Internet or a high-speed multimedia service. When the network 400 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the network 400 may include a Radio Network Controller (RNC). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The network 400 is connected to the control center 350 and is connected to the stationary camera 110 of the sites 300-1, 300-2, ..., and 300-m around the monitored area, And a beacon radio signal transmitting and receiving unit 150. The first through m-th mobile terminals 500-1 through 500-m, m are natural numbers of 2 or more) And transmits signals and data between the systems.

The control unit 160 of the control center 350 enlarges an image of the position where the emergency situation has occurred through the portable camera 120 and sends a warning broadcast through the directional flat speaker 140 to the area This can reduce the complaints of nearby residents.

In addition, the control device 160 of the control center 350 is set to receive the beacon radio signal from the mobile terminal executing the application of the safety out of the mobile terminals 500-1 to 500-m, The beacon wireless signal transmitting and receiving unit 150 of each of the surrounding areas 300-1, 300-2, ..., and 300-m is received via the network 500, To the mobile terminal.

The control unit 160 of the control center 350 may also be configured to transmit a beacon signal to each of the mobile terminals 500-1 to 500- The control unit 150 extracts the identification number of the beacon radio signal transmitting and receiving unit 150 receiving the signal and controls the flat speaker 140 set in the same monitored area having the same identification number, Perform emergency reporting to the nearest crime prevention center.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

100: Acoustic and Hybrid recognition-based emergency situation CCTV Security System
110: Fixed type camera
120: Mobile camera
130: Acoustic frequency recognition device
140: Flat-plate speaker
150: Beacon radio signal transmitting /
160: Control device
161: Acoustic recognition based emergency awareness module
162: Hybrid emergency situation aware module
300-1 to 300-m: first to m-th spot
350: Control center
400: Network
500-1 to 500-m: first to mth mobile terminals

Claims (5)

A first step in which the acoustic-recognition-based emergency situation recognition module receives the monophonic sound sensing of a predetermined range of frequencies from the acoustic-frequency recognition device;
A second step of receiving monophonic sound frequency information from the sound frequency recognition device which senses the monophonic sound of the first step for analyzing whether or not the sound recognition based emergency situation recognition module is an emergency situation;
The acoustic-recognition-based emergency situation recognition module analyzes the received monophonic sound frequency information to analyze whether or not the monophonic sound corresponds to the sound frequency of the help request, and detects a first event corresponding to the help request, A third step of determining whether the image is sensed from a photographed image from a fixed camera disposed in the same area as the sensed acoustic frequency recognition device;
(First judgment) that the sound is a help-requested sound frequency (first judgment), and judges that the first sound corresponds to the case where the first event is sensed (second judgment), and finally analyzes it as an emergency situation, A fourth step of determining an imaging target area of the portable camera as an acoustic frequency signal direction (a direction in which an acoustic frequency signal is sensed);
A fifth step of not only rotating the lens of the portable camera toward the determined target area but also controlling the warning broadcast output through the speaker located at the determined location as the photographing target area, And
The acoustic-recognition-based emergency situation recognition module performs zoom-in and focus adjustment so that the mobile camera photographs a subject in the target area, and not only photographs and tracks the subject, but also sequentially captures the subject A sixth step of performing a relay function of an elapsed broadcast output using a speaker at the same position as the mobile camera corresponding to the movement route; Wherein the CCTV security method is based on acoustic and hybrid recognition.
2. The method of claim 1,
Wherein the acoustic-recognition-based emergency-situation recognition module calculates the direction of the received monophonic sound frequency signal based on the acoustic-and-hybrid-recognition-based emergency-situation recognition module.
2. The method of claim 1,
Wherein the acoustic-recognition-based emergency situation recognition module determines whether or not there is a moving subject based on the monophonic sound frequency signal.
2. The method according to claim 1,
Wherein the fixed camera is constituted by at least one camera, and each camera photographs a different specific area.
2. The method of claim 1,
Wherein the fixed camera is a camera capable of capturing a wide range of angle of view, and the CCTV security providing method based on acoustic and hybrid recognition.

Images