KR102319520B1 - Home security system capable of being communicated with a doorbel and smart phone and method thereof - Google Patents

Abstract

Disclosed are a home security system capable of communicating with a smart phone associated with a doorbell and a method therefor. The home security system may include at least one IP camera for capturing a home security image; As an IoT device to which a mobile phone number and IP address are assigned, it includes a key input unit, microphone, speaker, control unit, storage unit, NB-IoT communication unit or LTE 4G/5G modem or Wi-Fi communication unit, and transmits voice calls and text messages. This capable doorbell IoT device; an NVR server connected to the at least one camera, storing image data for each camera channel, and having a storage; and a doorbell that is connected to the NVR server and generates an alarm when receiving a human body detection signal of a doorbell IoT device provided at the door, and provides functions for sending and receiving voice call data between a visitor and a smartphone user and sending and receiving a text message. Includes smartphones with apps installed. The home security system is equipped with up to four IP cameras and NVR servers for CCTV, and the doorbell IoT device has a human body detection sensor within communication coverage with an LTE 4G/5G modem or Wi-Fi communication unit, and a smartphone and It connects directly and provides voice calls and text message sending and receiving functions.

Description

Home security system capable of being communicated with a doorbel and smart phone and method thereof

The present invention relates to a home security system and method, and more particularly, a doorbell IoT device within communication coverage including four IP cameras for CCTV, an NVR server, and an LTE 4G/5G modem or Wi-Fi communication unit. To a home security system and method capable of smart phone communication linked to a doorbell, which has a human body detection sensor and is directly connected to a smartphone to provide voice calls and text message transmission and reception functions.

A CCTV (Closed Circuit Television) system includes at least one camera that shoots video, and a DVR (Digital Video Recorder) or NVR (Network Video Recorder) that is connected to at least one camera and UTP cable to compress and store the video data of each camera. ) and a storage device connected to a DVR or NVR, it is used as a remote monitoring system for video and audio of each camera channel to a PC through a network through a multiviewer screen.

The camera includes a lens, a camera, and a power supply, and has a dome or upper cover type camera housing that covers it, and is classified into a stationary camera and a rotary camera.

CCTV cameras include a fixed camera, a dome camera that can rotate vertically and horizontally inside a small camera, a PTZ (Pan Tilt Zoom) camera, and an IR (Infrared Ray) camera equipped with an infrared LED suitable for night photography. used

PTZ (Pan, Tilt, Zoom) camera has PTZ control function, Pan is the function to fix the position of the camera and moves the camera left and right, Tilt (tilt up, tilt down) is the function to move the camera up and down, Zoom In/out provides a function to reduce/enlarge the video screen by focusing the focal length of the camera to a near or far distance.

A DVR (Digital Video Recorder) is a digital image storage device that encodes images captured by multiple cameras connected by cables within a distance of 1.8 km, compresses them on a hard disk, and distributes and displays images for each camera channel. It is a system that integrates a screen change switch, a screen divider, a VCR (video player) sensor, and an alarm controller separately from the analog system.

NVR (Network Video Recorder) is a dedicated PC server for video recording, monitoring, event management, and playback of IP cameras installed on the network. Therefore, there is no need for an apparatus for converting an analog camera image signal into a digital camera image signal.

As the related prior art 1, Patent Registration No. 10-1735780 discloses "a method and a terminal for detecting an intrusion in a smart home security system". The terminal measures the strength of a signal received from a different type of radio, and calculates a change value of the measured strength of the received signal. Then, the terminal calculates the received signal strength change probability using the calculated received signal strength change value, and compares the received signal strength change probability with a predetermined threshold value to determine whether an intruder has invaded.

As the related prior art 1, Patent Publication No. 10-2014-0028238 discloses a "home security method and system with enhanced network security", and a home terminal (M2M device, gateway, etc.) logically separated from a general public network. ) and the network domain M2M (Machine to Machine, Machine to Machine) service provider's management server, by configuring a separate logical virtual point-to-point network (Virtual P2P Network), access to the home terminal or management server is possible through the public network. It provides a home security method and system that strengthens the network security that is blocked at the source.

1 is a diagram for explaining a conventional home security system 100 with enhanced network security.

The home security system 100 is a network equipment ( 130), the core network may include an IP address allocation system 140 and a management server 150 of the M2M service provider.

The home terminal 110 is a terminal (or device) installed for monitoring/security in the home, and may be an M2M terminal, and at least one or more cameras (eg, CCTV cameras) for capturing images of the installed monitoring area. , or at least one sensor that generates a detection signal for the surrounding environment (eg, temperature, humidity, rainfall, intruder, etc.) may include all devices that generate data for a specific purpose in the installed area. As such, the following description will be given as an example that the monitoring area is within the home, but is not limited thereto, and the monitoring area may be any area requiring monitoring/security, such as an illegal garbage dumping area, a crime prevention area, and an illegal parking/stop enforcement area. In addition, in the monitoring area, there are devices (cameras, sensors, etc.) that generate data for the above specific purpose and gateways that communicate wired/wireless (eg, serial communication, short-distance wireless communication (Zigbee, Bluetooth, NFC (Near Field Communication), etc.) It may be included as an M2M terminal.

The Internet terminal 120 is a terminal that uses an Internet service by being assigned a general public IP address on the Internet (access network, core network), and is wired or wireless such as a desktop PC, a notebook PC, a smart phone, a tablet PC, and a PDA (Personal Digital Assistant). It may include all terminals capable of accessing the Internet through a communication method.

Such a monitoring area terminal, that is, the home terminal 110 or the Internet terminal 120 may be connected to the core network through the network equipment 130 for the access network (access network), and the core network It may communicate with the IP address allocation system 140 on the core network and the management server 150 of the M2M service provider.

The IP address allocation system 140 may allocate a dynamic private IP address to the home terminal 110 according to the request of the home terminal 110 , and accordingly, the network device 130 determines that the dynamic private IP address is the sender. By transmitting a packet transmitted from the home terminal 110 to which the fixed private IP address for the management server 150 is a destination, to the management server 150 according to a tunneling method, a public IP address is assigned. Access to the home terminal 110 or the management server 150 of the Internet terminal 120 on the access network or the core network is fundamentally blocked to increase security, while the management server 150 receives the data ( data for monitoring such as camera and sensor information) can be collected.

Accordingly, the network equipment 130 performs logical tunneling of each packet from a plurality of (eg, 30000) home terminals 110 irrespective of the number of home terminals 110 in the monitoring area, all in one logical tunnel on the core network. Through the interface, it is possible to transmit to the management server 150, which is the end point of the tunnel, according to a logical virtual P2P network network method. That is, one logical tunneling interface is configured between the edge router 132 of the network equipment 130 as the tunnel start point and the management server 150 as the tunnel end point, and the home terminal 110 in the monitoring area. ), the tunneling interface does not increase even if the number of .

To this end, the L3 switch 131 of the network equipment 130 for the access network performs load balancing on the traffic from the home terminal 110 to direct the traffic to a plurality of edge routers 132 . and the corresponding edge router 132 to which the traffic has been distributed manages the tunnel information as an ACL (Access Control List) in a database so as to provide a service through the tunneling interface only to the authorized home terminal 110, and You can refer to it for routing. For example, when a dynamic private IP address is assigned to the home terminal 110 as described above, the edge router 132 provides a tunnel for the corresponding tunneling interface for the service between the home terminal 110 and the management server 150 in the monitoring area. You can store and manage the dynamic private IP address of the home terminal of the corresponding monitoring area, the fixed private IP address of the corresponding management server, and the tunnel type, etc. in the database for each tunnel in each monitoring area set by setting . The fixed private IP address for the management server 150 may be included in the IP address assignment request of the home terminal 110 , and the tunnel type is PPTP (Point to Point Tunneling Protocol), L2F (Layer 2 Forwarding Protocol), VTP (Virtual). Various methods such as Tunneling Protocol) and IPSec (IP Security Protocol) may be used.

In addition, the IP address assignment request of the home terminal 110 may include a terminal identifier (eg, M2M_PV_xxxx) in the option 60 (vendor class identifier) or option 77 (user class identifier) field according to the Dynamic Host Configuration Protocol (DHCP). , accordingly, the IP address allocation system 140 determines that a specific service or policy is included through the corresponding identifier in the option 60 or 77 field of DHCP, and the corresponding IP address for each home terminal 110 in each monitoring area. By mapping the band, a dynamic private IP address may be allocated to the corresponding home terminal 110 . The IP address allocation system 140 may allocate a general public IP address to an IP address allocation request that does not include such a specific service or policy from the Internet terminal 120 on the Internet (access network, core network).

The Internet terminal 120 on the access network or the core network, which is assigned a general public IP address, is fundamentally blocked from accessing the home terminal 110 and the management server 150 in the monitoring area, and is managed with the authorized home terminal 110 . By allowing access only between the servers 150 through the tunneling interface, security can be improved.

The home security method of the prior art 1 is

In the security method for the security of data transfer between one or more monitoring area terminals and a management server on a core network connected,

allocating a dynamic private IP address to the monitoring area terminal in an IP address allocation system on the core network according to a request through the access network from the monitoring area terminal; and

In the network equipment for the access network, referring to the database storing tunnel information including the dynamic private IP address of the monitoring area terminal, the fixed private IP address for the management server, and the tunnel type, the dynamic private IP address is and transmitting a packet transmitted from the monitoring area terminal, which is a source and whose destination is a fixed private IP address for the management server, to the management server according to a tunneling method.

However, the existing home security system has a CCTV system having sensors and cameras, but within communication coverage with an LTE 4G/5G modem or Wi-Fi communication unit, the doorbell IoT device is equipped with a human branch sensor and communicates with a smartphone. It was directly connected and did not provide voice calls and text message sending and receiving functions.

Patent Publication No. 10-2014-0028238 (published on March 10, 2014), "Home security method and system with enhanced network security", KT Co., Ltd.

It is an object of the present invention to solve the above problems, a doorbell IoT device is equipped with four IP cameras for CCTV, an NVR server, and a human body detection sensor within communication coverage including an LTE 4G/5G modem or a Wi-Fi communication unit. It provides a home security system that can communicate with a smartphone connected to a doorbell that is equipped with a smartphone and directly connected to a smartphone to provide voice calls and text message transmission and reception functions.

Another object of the present invention is to provide a home security method that enables smart phone communication in connection with a doorbell.

In order to achieve the object of the present invention, a home security system capable of smart phone communication in connection with a doorbell includes at least one IP camera for capturing a home security image; As an IoT device to which a mobile phone number and IP address are assigned, it includes a key input unit, a human body sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit, or an LTE 4G/5G modem or Wi-Fi communication unit, and additionally A doorbell IoT device that may further include a camera unit connected to the control unit, and capable of transmitting voice calls and text messages; an NVR server connected to the at least one camera, storing image data for each camera channel, and having a storage; and a doorbell app that is connected to the NVR server and generates an alarm when receiving a human body detection signal of a doorbell IoT device provided at the door, and transmits and receives voice call data and text messages between a visitor and a smartphone user. Including installed smartphone,
The human body detection sensor uses a microwave Doppler sensor,

The smartphone in which the doorbell App is installed can transmit and receive voice call data and text messages to and from the doorbell IoT device directly with the doorbell IoT device or through the doorbell service server when necessary to enhance home security security, The doorbell IoT device outputs a voice call signal to the speaker, and a text message is output to the LCD display.

When going out, when the outing mode is set with the doorbell IoT device through the smartphone on which the doorbell App is installed, the home user automatically enters the house when the doorbell ringtone is pressed in the doorbell IoT device or a human body detection signal from the sensor is detected An automatically displayed text message is transmitted to the user's preset mobile phone number when absent, and the text message input by the visitor through the key input unit of the doorbell IoT device is transmitted to the home user's mobile phone number.

The home security system capable of smart phone communication in connection with the doorbell is connected to the NVR server and further includes a PC equipped with a microphone and a speaker.

When the doorbell IoT device uses the NB-IoT communication unit, communication is connected between the NB-IoT communication unit of the doorbell IoT device capable of transmitting the text message and the mobile communication base station,

When the doorbell IoT device uses a Wi-Fi communication unit, it further includes an IoT gateway using a wireless LAN access point (WLAN AP).

The doorbell IoT device includes: a key input unit including a doorbell bell and having number keys, character keys, and special characters like a keypad of a mobile communication terminal; human body sensor and ADC; It is implemented with a DSP (Digital Signal Processor) board equipped with a microphone that receives an analog audio signal, an ADC that A/D converts the analog audio signal input to the microphone, and an audio codec. a voice signal processing unit that processes a voice signal of pulse code modulation (PCM) and speech coding that provides sampling, quantization, and encoding; a DAC connected to the audio signal processing unit for converting digital audio data into an analog audio signal, and a speaker for outputting the analog audio signal provided from the DAC; It is connected to the key input unit, the human body detection sensor and ADC, and the microphone and the voice signal processing unit interlocked with the speaker. a control unit to control; a memory unit connected to the control unit and storing programs for transmitting and receiving voice calls and text messages; a communication unit connected to the control unit and having at least one of an NB-IoT communication unit or an LTE 4G/5G modem or a Wi-Fi communication unit; an LCD display unit connected to the control unit and outputting a text message from a smartphone holder and a door visitor; and a power supply unit.

The human body detection sensor of the doorbell IoT device uses any one of a PIR sensor, an infrared sensor, a microwave Doppler sensor, and an ultrasonic sensor, and detects a human body detection signal of a visitor at the door.

In order to achieve another object of the present invention, a method for providing home security that enables smart phone communication in connection with a doorbell (a) receives and stores image data of at least one IP camera installed in a home monitoring and surveillance area to an NVR server and stores it , step of remote monitoring with a smartphone installed with a doorbell app; (b) transmits the human body detection signal or doorbell ringtone of the sensor of the doorbell IoT device provided at the door to the PC and the smartphone, and the PC and the smartphone installed with the doorbell App are the human body detection sensors of the doorbell IoT device generating an alarm when receiving a human body detection signal and outputting a doorbell ringtone to the speaker of the PC and smartphone; (c) transmitting and outputting visitor/home user voice call data or text message packet data from a home user's PC or a smart phone in which the doorbell App is installed to the doorbell IoT device; and (d) when going out, when an outing mode is set with the doorbell IoT device through the smartphone in which the doorbell App is installed, the doorbell ringtone is pressed in the doorbell IoT device or the human body is detected by the human body detection sensor When a signal is detected, an automatically displayed text message is automatically sent to the home user's preset mobile phone number, and the text message entered by the visitor through the key input unit of the doorbell IoT device is transmitted to the home user's mobile phone number. includes,

The doorbell IoT device is an IoT device to which a mobile phone number and IP address are assigned, and includes a key input unit, a human body sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit, or an LTE 4G/5G modem or Wi-Fi communication unit. and, in addition, may further include a camera unit connected to the control unit,
The human body detection sensor uses a microwave Doppler sensor,

The smartphone in which the doorbell App is installed can transmit and receive voice call data and text messages to and from the doorbell IoT device directly with the doorbell IoT device or through the doorbell service server when necessary to enhance home security security, The doorbell IoT device outputs a voice call signal to the speaker and a text message is output to the LCD display.

In the method, in step (b), when the human body detection signal of the sensor of the doorbell IoT device or the doorbell ringtone is transmitted to the PC and the smartphone, the home security voice call and text message packet data transmission program is installed from the PC or the smartphone. The method further includes transmitting a PTZ (Pan Tilt Zoom) control signal of the camera to the detected corresponding IP camera.

The doorbell IoT device is an IoT device to which a mobile phone number and IP address are assigned, and includes a key input unit, a human body sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit, or an LTE 4G/5G modem or Wi-Fi communication unit. includes,

Additionally, it may further include a camera unit connected to the control unit.

The home security system and method capable of smart phone communication in connection with the doorbell of the present invention are provided with 4 IP cameras for CCTV, an NVR server, and a LTE 4G/5G modem or Wi-Fi communication unit within communication coverage. The doorbell IoT device has a human body detection sensor and is directly connected to a smartphone to provide voice calls and text message transmission and reception functions.

When going out, especially when the home user sets the outing mode of the doorbell IoT device, when the doorbell ringtone is pressed on the doorbell IoT device or a human body detection signal from the human body sensor is detected An indication text message is sent,

Automatic display message (“Leave a text message for the visitor because you are out” or “Please leave a text message at 010-1234-5678”, etc.) is automatically output from the smartphone to the LCD display of the doorbell IoT device, and the visitor The text message input through the key input unit of the doorbell IoT device is transmitted to the mobile phone number of the user in the house.In particular, the doorbell IoT device is a convenient function in the absence of the Home Security System, when delivering visitors, mail, or registered mail. Since it is connected to the user's mobile phone number, it is now possible to receive voice calls and text messages.

1 is a diagram for explaining a conventional home security system with enhanced network security.
2 is a configuration diagram of a home security system capable of smart phone communication in connection with a doorbell according to the present invention.
3 is a diagram illustrating an NB-IoT architecture when a doorbell IoT device includes an NB-IoT communication unit.
4 is a flowchart illustrating a method for providing home security that enables smart phone communication in connection with a doorbell according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The home security system and method for smart phone communication in connection with the doorbell of the present invention includes four IP cameras for CCTV, an NVR server, and a doorbell within communication coverage with an LTE 4G/5G modem or Wi-Fi communication unit. The IoT device is equipped with a human body sensor and is directly connected to a smartphone to provide voice calls and text message transmission and reception functions.

The doorbell IoT device is an IoT device to which a mobile phone number and IP address are assigned. It has at least one communication unit among an NB-IoT communication unit, an LTE 4G/5G modem, and a Wi-Fi communication unit. .

The doorbell IoT device initially enters a four-digit password, and the home user's smartphone mobile phone number to be forwarded when out or absent is input and stored in the storage unit.

2 is a configuration diagram of a home security system capable of smart phone communication in connection with a doorbell according to the present invention.

The home security system capable of smart phone communication in connection with the doorbell of the present invention is

at least one or more IP cameras 110 for capturing home security images;

It is provided at the door and is equipped with a key input unit, human body sensor, microphone, speaker, NB-IoT communication unit or LTE 4G/5G modem or Wi-Fi communication unit, and is an IoT device with a mobile phone number and IP address assigned. The doorbell IoT device 200 that may further include a camera unit connected to the control unit in addition to, and capable of transmitting voice calls and text messages;

a network video recorder (NVR) server 120 connected to the at least one camera 110, storing image data for each camera channel, and having a storage 130; and

It is connected to the NVR server 120 and generates an alarm when receiving the human body detection signal of the doorbell IoT device 200 provided at the door, and transmits and receives voice call data between the visitor and the smartphone user and transmits and receives text messages. Including a smartphone 300 installed with a doorbell app to provide,
The human body detection sensor 211 uses a microwave Doppler sensor,

The smartphone 300 in which the doorbell app is installed is directly connected to the doorbell IoT device 200 or through the doorbell service server when necessary to enhance home security security. Voice call data and A text message can be sent and received, and the doorbell IoT device 200 outputs a voice call signal to a speaker and a text message is output to the LCD display unit,

When going out, if the outing mode is set with the doorbell IoT device 200 through the smartphone 300 in which the doorbell app is installed, the doorbell ringtone is pressed in the doorbell IoT device 200 or the human body detection sensor ( 211) is detected, an automatically displayed text message is automatically transmitted to the user's preset mobile phone number in the absence of the user, and the visitor sends a text message input through the key input unit of the doorbell IoT device 200 to the preset home It is sent to the user's mobile phone number.

The home security system is equipped with up to four IP cameras and NVR servers for CCTV, and the doorbell IoT device has a human body detection sensor within communication coverage with an LTE 4G/5G modem or Wi-Fi communication unit, and a smartphone and It connects directly and provides voice calls and text message sending and receiving functions.

The smartphone 300 with the doorbell app installed is assigned a mobile phone number and equipped with an LTE 4G/5G modem, and the doorbell when necessary directly with the smartphone and the doorbell IoT device 200 or for strengthening home security security. Voice call data and text messages can be transmitted and received to and from the doorbell IoT device 200 through the service server, and the doorbell IoT device 200 outputs a voice call signal to the speaker 219 and a text message to the LCD display unit 231 is output

The home security system capable of smart phone communication in connection with the doorbell is connected to the NVR server 120 and further includes a PC equipped with a microphone and a speaker,

The home PC may transmit voice call data input through a microphone or text message packet data input through a keyboard to a doorbell IoT device having a communication unit assigned with a mobile phone number and IP address.

delete

When the doorbell IoT device 200 uses the NB-IoT communication unit, the NB-IoT communication unit of the doorbell IoT device 200 capable of transmitting the text message is connected to communication with the mobile communication base station,

When the doorbell IoT device 200 uses a Wi-Fi communication unit, it further includes an IoT gateway 270 using a wireless LAN access point (WLAN AP).

The doorbell IoT device 200 includes a key input unit 210 including a doorbell bell and having numeric keys, character keys, and special characters like a keypad of a mobile communication terminal; human body detection sensor 211 and ADC 212; A microphone 214 that receives an analog audio signal, an ADC 215 that A/D converts an analog audio signal input to the microphone, and a DSP (Digital Signal Processor) board having an audio codec are implemented to transmit voice call data. a voice signal processing unit 216 for processing a voice signal of Pulse Code Modulation (PCM) and speech coding, which provides sampling, quantization, and encoding of a voice signal for transmission; The DAC 217 and the DAC that is connected to the voice signal processing unit 216 and converts a doorbell ringtone and digital voice data of a smartphone holder (a smartphone holder having a mobile phone number at home/call forwarded) into an analog voice signal. a speaker 219 for outputting an analog audio signal provided from 217; The key input unit 210, the human body detection sensor 211 and ADC 212, the microphone 214 and the speaker 219 are connected to the voice signal processing unit 216 interlocked with each other, and a doorbell provided at the door is connected. a control unit 213 for controlling a human body detection signal, voice call, and text message packet data transmission/reception function of a pressed visitor; a memory unit 220 connected to the control unit 213 and storing programs for transmitting and receiving voice calls and text messages; an LCD display unit 231 connected to the control unit 213 and configured to output a text message of a smartphone holder and a door visitor; It is connected to the control unit 213 and includes a communication unit 230 having at least one of an NB-IoT communication unit, an LTE 4G/5G modem, or a Wi-Fi communication unit, and a power supply using a battery or a rechargeable secondary battery. do.

The doorbell IoT device 200 may further include an image processing unit having an embedded CMOS image sensor (CIS) camera unit and a video codec, and the image processing unit is connected to the control unit.

The human body detection sensor 211 of the doorbell IoT device 200 uses any one of a PIR sensor, an infrared sensor, a microwave Doppler sensor, and an ultrasonic sensor, and detects a human body detection signal of a visitor at the door. In the human body detection sensor 211, a microwave Doppler sensor is used.

The PIR sensor used as the human body detection sensor 211 is passive infrared, that is, the infrared sensor detects infrared rays of a moving person or moving object with a detection distance within 5 to 10 m and a constant detection angle of 120 to detect the difference in ambient temperature and temperature. It detects it and outputs it as a voltage signal. The PIR sensor is widely used for doors and entrance sensors, but when the door is closed or closed, infrared rays do not penetrate, so it was difficult to detect a person wearing a raincoat during rain.

To improve this, the human body detection sensor uses a microwave Doppler sensor to which the principle of the Doppler effect is applied.

The human body detection sensor 211 of the doorbell IoT device 200 uses a microwave sensor with doppler effect.

The microwave Doppler sensor uses a method of comparing frequencies by directly receiving a reflected wave reflected from a moving target of the microwave radiated by it.

The doppler effect is the intrinsic property of a wave source (sound source) according to the propagation speed of the wave and the relative speed of the observer to the wave source when at least one of the wave source (sound source) generating the wave and the observer observing the wave are in motion. The effect of being heard at a different frequency (or different wavelength) from the frequency occurs, and when the distance between the source and the observer gets closer, the frequency of the wave of the source becomes higher (the wavelength becomes smaller, the frequency of sound is shorter, and the natural frequency of the source is higher than the natural frequency of the source). Higher frequency, higher sound), and as the distance increases, the frequency of the wave of the source is observed to be lower (the wavelength is longer, the frequency of the sound is longer and the frequency is lower than the natural frequency of the wave source, the lower sound).

In the microwave Doppler sensor, when there is a relative motion between a radiation source of microwaves and a target object, the wavelength of the microwave is observed to be different from that when it is stationary. This phenomenon is the Doppler effect of microwaves, and in the embodiment of the present invention, a microwave Doppler sensor is used as the human body sensor of the doorbell IoT device.

Transmission-type ultrasonic doppler sensor is a sensor that uses the Doppler effect of ultrasonic waves emitted from the transmitter by arranging the ultrasonic transmitter and receiver as if sandwiching the object to be measured from both sides. used

The IP camera 110 uses an IP camera installed in a home CCTV for home security, and includes a lens, a camera, and a power supply, and has a dome or upper cover type camera housing that covers it, a fixed camera and a rotary camera. classified as

The IP camera 110 is a fixed camera, a dome camera that can rotate vertically and horizontally inside a small camera, a PTZ (Pan Tilt Zoom) camera, and a dome infrared (IR, Infrared Ray) equipped with an infrared LED suitable for night photography. use the camera

PTZ (Pan, Tilt, Zoom) camera has PTZ control function, Pan is the function to fix the position of the camera and moves the camera left and right, Tilt (tilt up, tilt down) is the function to move the camera up and down, Zoom In/out provides a function to reduce/enlarge the video screen by focusing the focal length of the camera to a near or far distance.

Up to 4 IP cameras for home security are used, and the PC's home monitoring client monitors up to 1/2/3/4 channel camera images.

The IoT gateway 270 includes a communication unit connected to the doorbell IoT device 200 provided at the door, and receiving an input voice signal or text message packet data from a doorbell ringtone or a microphone; a protocol conversion unit connected to the communication unit and converting a Wi-Fi protocol to a TCP/IP protocol (Wi-Fi ↔ TCP/IP); a control unit connected to the protocol conversion unit and controlling protocol conversion and data transmission/reception of the gateway; and a storage unit for temporarily storing signals transmitted and received with the IoT gateway driving program, and a communication unit for transmitting/receiving TCP/IP text message packet data on an IP network.

The doorbell IoT device transmits/receives voice call data or text message packet data from the home user's PC or the smartphone 300 on which the doorbell App is installed to the doorbell IoT device 200 with the doorbell visitor. It outputs a voice call signal to the speaker or a text message to the LCD display.

When going out, in particular, when an outing mode is set with the doorbell IoT device 200 through the smartphone 300 with the doorbell app installed by the home user, the doorbell ringtone is pressed in the doorbell IoT device 200 or the human body detection sensor When the human body detection signal of (211) is detected, an automatically displayed text message is automatically transmitted to the user's preset mobile phone number in the absence of the user.

Automatic doorbell message (“Please leave a text message for visitors because you are out” or “Leave a text message at 010-1234-5678”, etc.) from the smartphone 300 with the doorbell app installed It is output to the LCD display unit of the IoT device 200 , and a text message input by the visitor through the key input unit of the doorbell IoT device 200 is transmitted to a preset mobile phone number of the home user.

3 is a diagram illustrating an NB-IoT architecture when a doorbell IoT device includes an NB-IoT communication unit.

It communicates with NB-IoT terminal -> mobile communication base station (eNodeB) -> IoT EPC -> IoT platform -> doorbell service server (Application Server).

* Structure of NB-IoT

- NB-IoT terminal (doorbell IoT device) is composed of terminals having a key input unit, sensor, microphone, speaker, control unit, storage unit, LCD display unit, and NB-IoT communication unit module, and the NB-IoT communication unit is used. to communicate with the base station (eNodeB) using the Uu interface

- The NB-IoT communication unit is mounted on the doorbell IoT device and communicates with the NB-IoT network according to the NB-IoT wireless communication protocol.

- NB-IoT communication unit and doorbell IoT device communicate with the control unit UART

- eNodeB: NB-IoT terminal (doorbell IoT device) processes network access messages through Uu interface, manages cells, and non-access layers (NAS, Non-Access Stratum) data is transmitted.

eNodeB (base station) connects to IoT EPC via S1-Lite interface

- IoT EPC: Sends and receives information to and from the NB-IoT terminal [doorbell IoT device-(UART)-(NB-IoT communication unit)] at the NAS layer, and delivers NB-IoT data to the IoT platform

- IoT Platform: Collects various types of IoT data from the radio access network, and transmits the necessary IoT data to the requested service application.

- Application server (doorbell service server)

The doorbell service server stores and records the text message packet data and the visit time left by the visitor of the doorbell IoT device provided at the door.

4 is a flowchart illustrating a method for providing home security that enables smart phone communication in connection with a doorbell according to an embodiment of the present invention.

A method of providing home security that enables smartphone communication in connection with the doorbell is

The NVR server 120 receives and stores the video data of at least one (one or multiple) IP cameras installed in the home monitoring monitoring area such as the door, side door, garage door, and back door, and the PC, doorbell app is installed. Remote monitoring with a smart phone 300 (S10);

A mobile phone number and IP address are assigned, and a human body detection signal or a doorbell ringtone from the sensor of the doorbell IoT device 200 capable of transmitting voice calls and text messages is transmitted to a PC and a smartphone installed with a doorbell app (S20). ); When the PC and the smartphone 300 installed with the doorbell App receive the human body detection signal of the doorbell IoT device 200 provided at the door, an alarm is generated and a doorbell ringtone is transmitted to the PC and the doorbell App. The step of outputting to the speaker of the installed smart phone 300 (S30);

In step (b), when the human body detection signal of the sensor of the doorbell IoT device 200 or the doorbell ringtone is transmitted to the PC and the smartphone with the doorbell App installed, the home security voice call and text message packet data transmission program Transmitting the PTZ (Pan Tilt Zoom) control signal (remote control signal) of the camera from the installed PC or the smartphone with the doorbell app (App) installed to the detected IP camera (S40);

The doorbell IoT device 200 by sending and receiving voice call data or text message packet data from the home user's PC or the smartphone 300 with the doorbell app installed to the doorbell IoT device 200 with the doorbell ) outputting a voice call signal to the speaker or outputting a text message to the LCD display unit (S50); and

When going out, when the home user sets the outing mode of the doorbell IoT device 200 through the smartphone 300 in which the doorbell app is installed, the doorbell ringtone is pressed in the doorbell IoT device 200 or the When a human body detection signal is detected, an automatically displayed text message is automatically transmitted to the user's preset mobile phone number in the absence, and the visitor sends the text message input through the key input unit of the doorbell IoT device 200 to the home user's smartphone. and transmitting to a mobile phone number.

The doorbell IoT device 200 is an IoT device to which a mobile phone number and IP address are assigned, and a key input unit including a doorbell bell, a human body detection sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit or LTE 4G/5G including a modem or Wi-Fi communication unit;

In addition, the camera may further include a camera connected to the control unit of the doorbell IoT device 200 during production.

In the above method, when going out, when the home user sets the outing mode with the doorbell IoT device 200 through the smartphone 300 in which the doorbell App is installed, the doorbell ringtone is pressed in the doorbell IoT device 200 or the human body When the human body detection signal of the detection sensor is detected, an automatically displayed text message is automatically sent to the user's preset mobile phone number in the absence of the user.

Specifically, an automatic display message (“Please leave a text message for visitors because you are out” or “Please leave a text message at 010-1234-5678”, etc.) is automatically sent to the doorbell IoT device ( 200), and transmitting the text message input by the visitor through the key input unit of the doorbell IoT device 200 to a preset mobile phone number of the home user (S70).

In particular, the doorbell IoT device 200 is a convenient function in the absence of the Home Security System, and is connected to the home user's mobile phone number during delivery of visitors, mail, and registered mail, so that it is possible to receive voice calls or text messages.

Embodiments according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, and data structures alone or in combination. Computer-readable recording media include storage, hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - A hardware device configured to store and execute program instructions in magneto-optical media, and storage media such as ROM, RAM, flash memory, and the like may be included. Examples of program instructions may include those generated by a compiler and not only machine language code but also high-level language code that can be executed by a computer using an interpreter. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention.

As described above, the method of the present invention is implemented as a program in a form that can be read using software of a computing device on a recording medium (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device). etc.) can be stored.

Although described with reference to the preferred embodiment of the present invention, those of ordinary skill in the art can variously modify or modify the present invention within the scope without departing from the spirit and scope of the present invention described in the claims below. It will be understood that this can be done.

110: IP camera 120: NVR server
130: storage 200: doorbell IoT device
270: IoT gateway 300: user terminal (smartphone, PC)

Claims (8)

at least one or more IP cameras for capturing home security images;
As an IoT device to which a mobile phone number and IP address are assigned, it includes a key input unit, a human body sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit, or an LTE 4G/5G modem or Wi-Fi communication unit, and additionally A doorbell IoT device that may further include a camera unit connected to the control unit, and capable of transmitting voice calls and text messages;
an NVR server connected to the at least one camera, storing image data for each camera channel, and having a storage; and
It is connected to the NVR server and generates an alarm when it receives a human body detection signal from a doorbell IoT device provided at the door, and a doorbell App that transmits and receives voice call data and text messages between a visitor and a smartphone user. Including installed smartphone,
The human body detection sensor uses a microwave Doppler sensor,
The smartphone in which the doorbell App is installed may transmit and receive voice call data and text messages to and from the doorbell IoT device directly with the doorbell IoT device or through the doorbell service server when necessary to strengthen home security security, The doorbell IoT device outputs a voice call signal to the speaker, and a text message is output to the LCD display.
When going out, when the outing mode is set with the doorbell IoT device through the smartphone in which the doorbell app is installed, the doorbell ringtone is pressed in the doorbell IoT device or the human body detection signal of the human body detection sensor is detected In case of absence, an automatically displayed text message is automatically sent to the home user's preset mobile phone number, and the text message entered by the visitor through the key input unit of the doorbell IoT device is transmitted to the home user's mobile phone number A home security system that enables smartphone communication. According to claim 1,
A home security system connected to the NVR server and capable of smart phone communication in connection with a doorbell further comprising a PC equipped with a microphone and a speaker. According to claim 1,
When the doorbell IoT device uses the NB-IoT communication unit, communication is connected with the NB-IoT communication unit of the doorbell IoT device capable of transmitting the text message and the mobile communication base station,
When the doorbell IoT device uses a Wi-Fi communication unit, a home security system capable of smart phone communication associated with the doorbell further comprising an IoT gateway using a WLAN access point (WLAN AP). According to claim 1,
The doorbell IoT device
a key input unit including a doorbell bell and having numeric keys, character keys, and special characters like a keypad of a mobile communication terminal;
human body sensor and ADC;
It is implemented with a DSP (Digital Signal Processor) board equipped with a microphone that receives an analog audio signal, an ADC that A/D converts the analog audio signal input to the microphone, and an audio codec. a voice signal processing unit that processes a voice signal of pulse code modulation (PCM) and speech coding that provides sampling, quantization, and encoding;
a DAC connected to the voice signal processing unit that converts a doorbell ringtone and digital voice data of a smartphone holder into an analog voice signal, and a speaker outputting the analog voice signal provided from the DAC;
It is connected to the key input unit, the human body detection sensor and ADC, and the microphone and the voice signal processing unit interlocked with the speaker. a control unit to control;
a memory unit connected to the control unit and storing programs for transmitting and receiving voice calls and text messages;
an LCD display unit connected to the control unit and outputting a text message from a smartphone holder and a door visitor;
a communication unit connected to the control unit and having at least one of an NB-IoT communication unit or an LTE 4G/5G modem or a Wi-Fi communication unit; and
power supply;
A home security system that enables smartphone communication in connection with a doorbell that includes a. 5. The method of claim 4,
The human body detection sensor of the doorbell IoT device uses any one of a PIR sensor, an infrared sensor, a microwave Doppler sensor, and an ultrasonic sensor, and detects a human body detection signal of a visitor at the door. security system. 5. The method of claim 4,
The doorbell IoT device further includes an image processing unit having an embedded CMOS image sensor (CIS) camera unit and a video codec, and the image processing unit is connected to the control unit and enables smart phone communication in connection with the doorbell. (a) receiving and storing image data of at least one or more IP cameras installed in the home monitoring monitoring area to an NVR server, and remotely monitoring with a PC or a smart phone installed with a doorbell app;
(b) transmits the human body detection signal or the doorbell ringtone of the sensor of the doorbell IoT device provided at the door to the PC and the smartphone, and the PC and the smartphone installed with the doorbell App are the human body detection sensors of the doorbell IoT device generating an alarm when receiving a human body detection signal, and outputting a doorbell ringtone to a speaker of a PC and a smartphone;
(c) transmitting and outputting visitor/home user voice call data or text message packet data from a home user's PC or a smart phone in which the doorbell App is installed to the doorbell IoT device; and
(d) When going out, when the outing mode is set with the doorbell IoT device through the smartphone in which the doorbell app is installed, the doorbell ringtone is pressed in the doorbell IoT device or the human body detection signal of the human body detection sensor is detected, an automatically displayed text message is automatically transmitted to the home user's preset mobile phone number, and a text message entered by the visitor through the key input unit of the doorbell IoT device is transmitted to the preset home user's mobile phone number includes,
The doorbell IoT device is an IoT device to which a mobile phone number and IP address are assigned, and includes a key input unit, a human body sensor, a microphone, a speaker, a control unit, a storage unit, an NB-IoT communication unit, or an LTE 4G/5G modem or Wi-Fi communication unit. and, in addition, may further include a camera unit connected to the control unit,
The human body detection sensor uses a microwave Doppler sensor,
The smartphone in which the doorbell App is installed may transmit and receive voice call data and text messages to and from the doorbell IoT device directly with the doorbell IoT device or through the doorbell service server when necessary to strengthen home security security, A doorbell IoT device outputs a voice call signal to a speaker and a text message is output to the LCD display. 8. The method of claim 7,
In step (b), when the human body detection signal of the human body detection sensor of the doorbell IoT device or the doorbell ringtone is transmitted to the PC and the smartphone in which the doorbell App is installed, home security voice call and text message packet data transmission Home security that enables smartphone communication linked to the doorbell, further comprising the step of transmitting the PTZ (Pan Tilt Zoom) control signal of the camera to the detected IP camera from a PC with a program installed or a smartphone with a doorbell app installed How to provide.

Images