KR20210061182A - Security alarm system that works with environmental sensor based on IP camera - Google Patents

Abstract

The present invention relates to a security alarm system interlocking with an environmental sensor based on an IP camera, which includes: an IP camera unit which detects a visible ray image, a thermal image, and motion information of a preset photographing area; a sound recognition unit for collecting sounds in each direction set in advance; an atmospheric component detecting unit for detecting atmospheric components; and a smart hub which detects a preset object based on the information transmitted from the IP camera unit, and then automatically monitors a behavior of an object, and detects a dangerous situation of each object based on the sound information transmitted from the sound recognition unit and the atmospheric component transmitted from the atmospheric component detection unit. Therefore, the present invention can create a comfortable living environment by securing scalability of sensing such as fire detection as well as indoor temperature and humidity measurement.

Description

Security alarm system that works with environmental sensor based on IP camera}

The present invention relates to a security alarm system, and more particularly, to a security alarm system that operates in conjunction with an environmental sensor based on an IP camera.

In general, a cctv camera is a device that transmits an image using a cable television in a specific building or a specific facility, and is widely used in various fields.

For example, users can install CCTV cameras in facilities such as production plants, financial institutions, train stations and subways, steel mill ships and construction sites, distributors, leisure facilities, highways and city traffic networks, The personnel can monitor a wide area at a glance.

In addition, it can be used in various ways in process supervision, entry and exit, control, and automatic home office work, and it can be used as post data because it can be recorded.

In addition, the maximum surveillance effect can be seen with the minimum number of personnel, and when a criminal activity is discovered, it is possible to immediately eradicate it, and because patrol is not required in unnecessary areas, it is possible to improve the morale of workers and protect personal safety through full surveillance.

The general configuration of such a cctv camera is that the body of the camera is rotatably installed by the pan head, and the video signal output from the camera is connected to be input to the pan head controller of the control room. In this pan head controller, the pan head is controlled. Connected.

However, in this configuration, when an image signal photographed through the lens of the camera is input to the pan head controller, the user of the control room checks the image through the monitor. Therefore, in the control room, the user manually adjusts the pan head so that the camera connected through the shaft moves up, down, left, and right to take a picture while tracking an object. However, in such a case in the related art, since there are many flaws in monitoring the user's monitor in a place where human traffic is not frequent, there is a problem in that the surveillance is blinded.

In order to solve the above problem, Korean Patent Laid-Open Publication No. 10-2010-0061890 compares the level intensity of sound coming from five microphones, finds the corresponding azimuth angle of the highest level, and drives the camera in the direction in which the voice signal is generated. A camera position control device through detection was proposed.

However, the proposed device has a problem in that it merely moves the photographing direction in the direction in which the sound is generated.

KR 10-2010-0061890 A

The present invention has been proposed to solve the above technical problems, and provides a security alarm system capable of implementing a personal security and safety system anywhere through an interlocking operation with an environmental sensor based on an IP camera.

According to an embodiment of the present invention for solving the above problem, an IP camera unit that detects a visible ray image, a thermal image, and motion information of a preset photographing area, and a sound recognition that collects sound in each preset direction. After detecting a preset object based on the information transmitted from the buwa and the atmospheric component, and the air component detection unit that detects the components of the air and the IP camera, the behavior of the object is automatically monitored, and the sound information transmitted from the sound recognition unit and A security alarm system including a smart hub that detects a dangerous situation of each object based on the air component transmitted from the air component detection unit is provided.

In addition, the present invention is characterized in that it further comprises an earthquake detection sensor that detects the low frequency of ground generation in the 10 ~ 240HZ band generated from the ground in the initial stage of the earthquake and detects whether an earthquake occurs based on the vibration of the screen. .

In addition, the present invention is characterized in that it further comprises a management server that receives information transmitted from a smart hub and provides image information and alarm information to at least one or more pre-registered portable terminals.

In addition, the atmospheric component sensing unit included in the present invention is characterized in detecting the concentration of any one or more of hydrocarbons, nitrogen oxides, sulfur oxides, carbon monoxide, carbon dioxide, formaldehyde, LPG, LNG, temperature and humidity.

In addition, the smart hub included in the present invention is characterized in that an area in which an object is detected in the photographing area is set as a gaze-focusing area.

In addition, the smart hub included in the present invention is characterized in that an area in which an object is detected in the photographing area is set as a gaze-focusing area, and when a dangerous situation of the detected object is detected, the area of the gaze-focusing area is automatically adjusted.

The security alarm system according to an embodiment of the present invention can implement a personal security and safety system anywhere through an interlocking operation with an environmental sensor based on an IP camera.

Through the application of this system, rapid response to disasters (earthquakes, gas leaks) can be developed to ensure safety of life, and a pleasant living environment can be created by securing the expandability of sensing such as subsequent fire detection as well as indoor temperature and humidity measurement. It will be possible to expand application to institutional facilities such as banks, restaurants, offices, and libraries by progressing the advancement of the hub-type system that is controlled to be controlled.

1 is a conceptual diagram of a security alarm system interlocking with an environmental sensor based on an IP camera according to an embodiment of the present invention
2 is a block diagram of a security alarm system that works in conjunction with an environmental sensor based on an IP camera
3 is an exemplary view of a visible ray image of an IP camera unit
4 is an exemplary view showing an image generated by a security alarm system

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings in order to describe in detail enough to enable a person of ordinary skill in the art to easily implement the technical idea of the present invention.

1 is a conceptual diagram of a security alarm system that operates in conjunction with an environmental sensor based on an IP camera according to an embodiment of the present invention, and FIG. 2 is a configuration diagram of a security alarm system that operates in conjunction with an environmental sensor based on an IP camera. 3 is an exemplary view of a visible ray image of an IP camera unit.

The security alarm system 1 according to the present embodiment includes only a simple configuration for clearly explaining the technical idea to be proposed.

1 to 3, the security alarm system 1 includes an IP camera unit 100, a sound recognition unit 200, an atmospheric component detection unit 300, a smart hub 400, and a management server. It is configured to include 500, a portable terminal 600, and an earthquake detection sensor 700.

Here, the IP camera unit 100 includes an image capturing unit 110, a thermal image capturing unit 120, and a lidar (LiDAR)/radar (RADAR) sensor unit 130. The lidar (LiDAR)/radar (RADAR) sensor unit 130 is provided with at least one of a lidar sensor and a radar sensor to detect movement of an object in a preset photographing area. For reference, the radar sensor unit may use an ultra-wideband (UWB) sensor that does not use a radio carrier and uses a very wide frequency band of several GHz or more in the baseband.

The smart hub 400 exchanges data wirelessly with the IP camera unit 100, the sound recognition unit 200, the atmospheric component detection unit 300, and the earthquake detection sensor 700-a wireless communication method through a gateway-while, It serves as a main controller that processes data, and can share data with an external device (portable terminal 600) through the management server 500.

The main operation of the security alarm system 1 configured as described above is performed as follows.

The IP camera unit 100 operates to detect a visible ray image, a thermal image, and motion information of a preset photographing area. The IP camera unit 100 may apply a Time Lapse function that is recorded and stored only when there is movement.

Since the IP camera unit 100 includes an image capturing unit 110, a thermal image capturing unit 120, and a LiDAR/RADAR sensor unit 130, the shooting area is effectively monitored even at night. can do.

The image photographing unit 110 photographs a visible ray image of a preset photographing area.

The left image of FIG. 3 is an image using an omnidirectional lens, and an image by such an omnidirectional lens has a blind area in the center area.

However, as shown in the right image of FIG. 3, the image photographing unit 110 of the present invention can minimize blind spots by applying a fisheye lens, and apply a lens supporting up to 5 Mega (QHD) and a 3 Mega class image sensor. By applying, you can secure a high-resolution 360-degree image.

The earthquake detection sensor 700 may be mounted inside the image photographing unit 110 or may be placed in a separate place. It detects the low frequency of the ground generation in the 10 ~ 240HZ band generated from the ground in the initial stage of the earthquake, and at the same time, it is caused by vibration. An earthquake can be detected based on the vibration of the screen.

The thermal image capturing unit 120 captures a thermal image of a photographing area. The thermal imaging unit 120 is a non-contact temperature measuring device. The thermal imaging unit 120 senses infrared energy radiated, transmitted, or reflected by all materials at a temperature of absolute 0 degrees (0° Kelvin) or higher, and converts this energy factor into a temperature measurement value or a temperature record. The temperature recording outputs the infrared energy displayed by the thermal imaging unit 120 as a thermal image of an object that radiates, transmits, or reflects.

The thermal imaging unit 120 transmits a very narrow pulse of ultra-wideband/low power and restores the received pulse signal with a precise resolution. The RF transmission/reception chipset for impulse radar, the clutter removal from the received radar signal, and features for moving objects It can also be utilized by applying a radar signal processing algorithm that can estimate collection (speed), posture estimation (walking), and characteristics of a stationary object (breathing).

In addition, the LiDAR/RADAR sensor unit 130 is a device capable of detecting distance, direction, speed, temperature, material distribution, and concentration characteristics to an object by shining a laser on the target.

The configuration of the lidar sensor may be divided into a laser transmission unit, a laser detection unit, a signal collection and processing, and a part for transmitting and receiving data. In addition, the lidar sensor can be classified into a time-of-flight (TOF) method and a phase-shift method according to a method of modulating a laser signal.

In the TOF method, it is possible to measure the distance by measuring the time when the laser emits a pulse signal and the reflected pulse signals from objects within the measurement range arrive at the receiver. The phase-shift method calculates time and distance by emitting a laser beam that is continuously modulated with a specific frequency and measuring the amount of phase change of a signal reflected and returned from an object within the measurement range.

As laser light sources, laser light sources having a specific wavelength or variable wavelength in a wavelength range from 250 nm to 11 μm are used, and recently, semiconductor laser diodes capable of small size and low power are widely used. In particular, the wavelength of the laser directly affects the permeability and eye-safety of the atmosphere, clouds and rain. Basically, the receiver's reception sensitivity and dynamic range, along with laser power, wavelength, spectral characteristics, pulse width and shape, and characteristics of optical filters and lenses are the main factors that determine LiDAR performance. In addition, the Field Of View (FOV) indicating the measurement angle of the receiver, the field stop to select the measurement range, and the FOV overlap characteristics of the laser beam and the receiver are also important items. The minimum time for unit data collection for the luminous flux is a factor that determines the range resolution, and therefore, data collection and processing within several ns is required for a distance resolution of 1m or less.

In the present invention, since the LiDAR/RADAR sensor unit 130 is used, a 3D image of a preset photographing area can be secured in real time. The wavelength used at this time may be variable.

The image capturing unit 110, the thermal image capturing unit 120, and the LiDAR/RADAR sensor unit 130 respectively use internal motors to rotate (PAN), tilt (TILT), and zoom ( ZOOM) is preferably configured to be adjustable, and the image capturing unit 110, the thermal image capturing unit 120, and the LiDAR/RADAR sensor unit 130 are all set to detect the same shooting area. It is most desirable to be.

If the image capturing unit 110, the thermal image capturing unit 120, and the lidar/radar (RADAR) sensor unit 130 detect different shooting areas, the control unit 400 may perform the image capturing unit 110 ), the thermal imaging unit 120 and the LiDAR/RADAR sensor unit 130 automatically set only a common area as a photographing area, respectively, to process an image.

The sound recognition unit 200 collects sounds in each preset direction.

In the present embodiment, the sound recognition unit 200 is configured with a plurality of directional microphones to recognize sounds sensed in each direction. For example, when four microphones are placed in the same position, a partition wall is installed between each microphone to assist in identifying the source of the sound. Accordingly, when a specific voice pattern is detected from the sound collected by the sound recognition unit 200, the smart hub 400 may control the IP camera unit 100 to photograph the direction in which the sound is collected.

In addition, the smart hub detects the sound of gas leaking in the home, the sound of falling objects, and the sound of a person falling in a specific place (bath), and controls the IP camera unit 100 to shoot the direction in which the sound was collected, and a warning sound. Can be controlled to output.

The air component detection unit 300 detects air components. The air component detection unit 300 detects the concentration of harmful substances in air components. The atmospheric component detection unit 300 is preferably composed of a multi-sensor unit capable of detecting the concentration of any one or more of hydrocarbons, nitrogen oxides, sulfur oxides, carbon monoxide, carbon dioxide, formaldehyde, LPG, LNG, temperature and humidity. Do.

Basically, the smart hub 400 detects a preset object based on the information transmitted from the IP camera unit 100 and then automatically monitors the behavior of the object. In addition, the smart hub 400 automatically monitors the behavior of the object, and automatically detects the dangerous situation of each object based on the sound information transmitted from the sound recognition unit 200 and the atmospheric component transmitted from the atmospheric component detection unit 300. can do.

That is, the smart hub 400 may automatically detect and warn whether indoor ventilation is required, outsiders intrusion, dangerous situations, or earthquakes are detected based on the collected information.

The management server 500 receives information transmitted from the smart hub 400 and provides an image to at least one pre-registered portable terminal 600. Whenever a pre-registered event occurs, the management server 500 automatically transmits the corresponding image and information to the pre-registered portable terminal 600.

Here, the portable terminal 600 is a generic term for a device that a user can use while carrying, such as a mobile phone, a smart phone, and a smart pad, and in the present embodiment, it is assumed that it is a portable terminal composed of a smart phone.

4 is an exemplary view showing an image generated by a security alarm system.

Referring to FIG. 4, the smart hub 400 sets the area in which an object is detected in the photographing area as a line-of-sight zone (red dotted line), and automatically adjusts the area of the line-of-sight zone when a dangerous situation of the detected object is detected. do.

For example, the smart hub 400 sets and displays a gaze-focusing area with a predetermined size from the point when a preset object (baby, elderly) is detected, and the object (baby) moves toward a hot object (electric kettle). In this case, “Baby, Hot, Dangerous Goods” is highlighted in red while reducing the focus area. At this time, information displayed irrelevant to the baby or dangerous situation is automatically moved out of the attention zone. When a display device is embedded in the smart hub 400, such information is displayed on the built-in display device, and may be displayed on the display device of the management server 500 and the portable terminal 600.

At this time, the temperature and shape of the object (baby) and the electric port are the image capture unit 110 of the IP camera unit 100, the thermal image capture unit 120, the lidar (LiDAR) / radar (RADAR) sensor unit 130 It may be identified by collecting all of the information of, water vapor detection information of the air component detection unit 300, and sound information of the sound recognition unit 200.

In addition, the smart hub 400 may set a region in which a predetermined temperature change occurs in the photographing region as a line-of-sight region (red dotted line). At this time, the smart hub 400 may automatically adjust the area of the eye-focusing zone in proportion to the temperature change. For example, when a certain temperature abnormality is detected, the eye-focusing zone is set, and when the temperature reaches the level of fire, the eye-focusing zone is concentrated in the zone, and the phrase “fire caution” is additionally displayed, and the temperature is red. You can highlight it with.

On the other hand, when a plurality of image capturing units 110 are installed, for example, a first image capturing unit is capturing a (basic) capturing area, and a second image capturing unit is additionally disposed to cover a part of the (basic) capturing area. Photographing overlapping-Shooting an area that the first image photographing unit cannot photograph by the structure-In this case, the smart hub 400 receives the image photographed by the blind area from the second image photographing unit and matches the coordinates to display it. I can.

The management server 500 feeds back a portion of the received image that does not change the image, and the smart hub 400 automatically removes the portion of the image that does not change, thereby reducing the storage capacity. In addition, after dividing the image into a plurality of regions, the management server 500 may feed back information for varying the stored image frame for each region in consideration of the movement speed of the object.

For reference, the security alarm system 1 may capture a facial image of an object (person) recognized based on a visible image captured by the image capturing unit 110.

The smart hub 400 calculates the heart rate by measuring the pulsating blood flow of the facial artery through color change of the photographed facial image. In other words, after selecting a region of interest among the photographed facial images, it is separated into RGB (Red Green Blue) channels, and a nonlinear scale factor is applied to each of the RGB channels to adjust the signal-to-noise ratio (SNR), and nonlinear scale. The heart rate is calculated based on a signal to which a scale factor is applied.

That is, the smart hub 400 extracts a facial image of an object (person), selects a region of interest from among the facial images, separates it into RGB (Red Green Blue) channels, and provides a nonlinear scale factor for each channel among the RGB channels. A signal-to-noise ratio (SNR) can be adjusted by adding, and a heart rate can be calculated based on a signal to which a nonlinear scale factor has been applied.

In addition, the smart hub 400 converts a signal to which a nonlinear scale factor is assigned to a frequency domain, and then calculates the respiratory rate based on the largest power spectrum frequency value among the frequency domains corresponding to the heart rate. .

That is, the smart hub 400 can determine the sleep state, death state, and coma possibility of the object (person) based on the calculated heart rate and respiration rate, and breathing difficulties or heart rate based on the calculated heart rate and respiration rate. Even paralysis can be judged.

In addition, the smart hub 400 may detect a correlation with each object based on the detected speed and shape of a plurality of objects and then warn. For example, when a child (object 1) and a motorcycle (object 2) are detected at the same time, the smart hub 400 may warn when the motorcycle moves in the direction of the child at a predetermined speed or higher.

Meanwhile, when measuring a person's body temperature, the thermal imaging unit 120 may calculate a final body temperature after correcting the person's body temperature by referring to the distance value of the LiDAR sensor unit 130.

In addition, in order to suppress and receive random noise generated inside the chip, the thermal image capturing unit 120 performs repeated reception in the same range (same time interval between the transmission clock and the reception sampling clock) and then the next range reception. Can act to change.

In addition, the smart hub 400 may divide a preset photographing region into a plurality of regions, and then independently preset a sensing time, a sensing object, and a sensing event for each region.

In addition, the management server 500 receiving the image transmitted from the smart hub 400 may perform an object recognition operation on its own. That is, the management server 500 feeds back the recognized object information to the smart hub 400, and each object information includes an identification code pre-allocated for each object type and location information for a central area of each object by time.

For example, when an object of the elderly is recognized, an identification code previously allocated to the elderly and location information for the location (coordinates) of the central region of the elderly are transmitted over time.

For reference, the identification code includes an object code and an additional code, the object code is a code assigned to the shape of the elderly, and the additional code is defined as a code of additional data information such as the name of the elderly.

Therefore, the smart hub 400 receives object information transmitted from the management server 500 without directly processing the image processing, and identifies the recognized name of the object of the elderly (identifying the name of the person) and its moving location. I can grasp it. The management server 500 can simultaneously recognize a plurality of objects at the request of the smart hub 400 and track each location in real time.

In addition, the security alarm system 1 executes a protection mode for the elderly when an elderly person is detected as an object.

In the elderly protection mode, when the elderly is sitting on the sofa and the IP camera unit 100 can detect the elderly's face only through the mirror in a state in which there is a mirror reflecting the elderly’s face,

The IP camera unit 100 may detect an image of a face reflected in the mirror. Accordingly, the IP camera unit 100 may recognize the face reflected in the mirror as an object, and then determine the heart rate and respiration rate of the elderly.

For reference, when an elderly person recognizes an object and executes the protection mode for the elderly, an additionally equipped motion sensor can periodically transmit and receive radio waves of a predetermined wavelength in the direction in which the object is recognized, so that the movement of the object can be more accurately identified. .

In other words, when the elderly fall behind the sofa, they may escape from the image by the sofa, so a motion detection sensor is additionally used to compensate for this.

The security alarm system according to an embodiment of the present invention can implement a personal security and safety system anywhere through an interlocking operation with an environmental sensor based on an IP camera.

Through the application of this system, rapid response to disasters (earthquakes, gas leaks) can be developed to ensure safety of life, and a pleasant living environment can be created by securing the expandability of sensing such as subsequent fire detection as well as indoor temperature and humidity measurement. It will be possible to expand application to institutional facilities such as banks, restaurants, offices, and libraries by progressing the advancement of the hub-type system that is controlled to be controlled.

As such, those skilled in the art to which the present invention pertains will be able to understand that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the embodiments described above are illustrative in all respects and should be understood as non-limiting. The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

100: IP camera unit
110: video recording unit
120: thermal imaging unit
130: lidar (LiDAR) / radar (RADAR) sensor part
200: sound recognition unit
300: air component detection unit
400: smart hub
500: management server
600: portable terminal
700: earthquake detection sensor

Claims (6)

An IP camera unit that detects a visible ray image, a thermal image, and motion information of a preset photographing area;
A sound recognition unit for collecting sounds in each preset direction;
An atmospheric component sensing unit that detects an air component; And
After detecting a preset object based on the information transmitted from the IP camera unit, the behavior of the object is automatically monitored, and based on the sound information transmitted from the sound recognition unit and the atmospheric component transmitted from the atmospheric component sensing unit. A smart hub that detects a dangerous situation of each object;
Security alarm system comprising a.
The method of claim 1,
An earthquake detection sensor that detects the low frequency of the ground generation in the 10 ~ 240HZ band generated from the ground in the initial stage of the earthquake and detects whether an earthquake occurs based on the vibration of the screen.
The method of claim 1,
And a management server for receiving information transmitted from the smart hub and providing video information and alarm information to at least one or more pre-registered portable terminals.
The method of claim 1,
The atmospheric component detection unit,
A security alarm system, characterized in that it detects the concentration of any one or more of hydrocarbons, nitrogen oxides, sulfur oxides, carbon monoxide, carbon dioxide, formaldehyde, LPG, LNG, temperature and humidity.
The method of claim 1,
The smart hub,
A security alarm system, characterized in that an area in which an object is detected in the photographing area is set as an eye focus area.
The method of claim 1,
The smart hub,
An area in which an object is detected in the photographing area is set as a gaze focused area, and when a dangerous situation of the detected object is detected, the area of the gaze focused area is automatically adjusted.

Images