KR102514992B1 - Power-saving monitoring and control system using object recognition and control method thereof - Google Patents

Abstract

The present invention relates to a power-saving monitoring and control system using object recognition which uses a monitor and a smartphone application to monitor the outside of a door through a monitored video and recorded recording and monitoring video, and when the door is open, the door impact is sensed or a human body outside the door is continuously sensed for a predetermined time, generates an alarm message to inform a user in real time; and a control method thereof. The system operates as follows: when an object is sensed by a motion sensor installed outside the door, operating a recording control unit to start the recording; when the object is sensed by the motion sensor, performing the recording and, when an object sensing time is a preset first reference time or more, using a speaker installed outside the door to sound an alarm sound; when the sensing time of an object outside the door is a preset second reference time or more, generating an alarm message for human recognition to transmit the same to a user terminal; when it is sensed for the door to be opened in a state in which the motion sensing is performed, generating an alarm message for the door opening and transmitting the same to the user terminal; and when an impact applies to the door while a human is sensed, generating an alarm message for door impact to transmit the same to the user terminal, thereby having the user make all efforts to ensure safety and crime prevention.

Description

Power-saving monitoring and control system using object recognition and control method thereof

The present invention relates to a power-saving monitoring and control system using object recognition and a control method thereof, and in particular, monitors the outside of the front door through monitoring images and recorded surveillance images using a monitor and a smartphone application, and detects door opening or door impact It relates to a power-saving monitoring and control system using object recognition and a control method thereof, which generate an alarm message and inform the user in real time when a human body outside the city or outside the front door is continuously detected for a certain period of time.

In a public house such as a detached house or apartment, when the house is left empty for a long time or on vacation, a thief disguised as a courier company employee or an electricity meter reader rings the doorbell outside the door to check if there is anyone in the house, and determines that there is no presence. It is common for people to break into a house through a window or front door and steal.

In this way, if the theft is carried out in a state where no one is in the house, there is a problem in that immediate response such as prevention and reporting to the police is impossible because the state of the crime can be confirmed only after the landlord returns home.

In addition, when an emergency occurs in the house in the absence of people, it is impossible to accurately check the emergency situation in the house, so immediate response may be impossible, resulting in enormous property loss.

Therefore, it is desired to develop a technology that can easily check visitors and home conditions even when going out and can immediately check emergency or abnormal conditions in the house.

In addition, it is difficult to monitor the situation outside the front door in real time from indoors, so it is difficult to cope with the dangerous situation outside the front door in real time, and it is difficult to check the situation outside the front door later, so there is a problem that it is impossible to cope with future risks.

Republic of Korea Registered Patent No. 10-1060414 (2011.08.23 registration) (surveillance system and monitoring method) Republic of Korea Patent Publication 10-2009-0106030 (2009.10.08. Publication) (security system)

Therefore, the present invention is proposed to solve the problem of not being able to recognize and respond to dangerous situations such as general intrusion in advance and the need for technology development that can immediately check the situation inside and outside the house in real time, It monitors the outside of the front door through surveillance video and recorded surveillance video using a smartphone application, and generates an alarm message when a door is opened or a door impact is detected or when a human body outside the front door is continuously detected for more than a certain period of time to notify the user in real time. The purpose is to provide a power-saving monitoring and control system using object recognition and a control method thereof.

In order to achieve the above object, the "power-saving monitoring and control system using object recognition" according to the present invention,

A first motion detection sensor installed outside the front door to detect motion;

A second motion detection sensor installed indoors to sense motion;

A door open sensor for detecting the opening of the front door;

an impact detection sensor for detecting an impact applied to the front door;

a camera for photographing objects outside the front door;

Recording is controlled when a motion is detected by the first motion detection sensor, generation and transmission of a notification message is controlled when a door open or impact is detected by the door open detection sensor and/or impact sensor, and the second a monitoring control unit that automatically displays an image outside the front door captured by the camera on a screen when a motion is detected by a motion sensor;

a display displaying a captured image outside the front door on a screen under the control of the monitoring controller;

a recording controller operating the camera under the control of the monitoring controller to take a picture of the outside of the front door and providing the captured image as a monitoring image and a recorded image;

a notification message generation unit generating a notification message according to door opening or front door impact under the control of the monitoring control unit;

and a notification message transmitter for transmitting the notification message generated by the notification message generator to a user terminal.

In addition, the "power-saving monitoring and control system using object recognition" according to the present invention,

a speaker generating an alarm outside the front door under the control of the monitoring controller;

Further comprising an ultrasonic sensor for detecting an object outside the front door,

The monitoring control unit controls to generate an alarm through the speaker when the object detection time detected by the ultrasonic sensor exceeds a preset first reference time,

When the object detection time detected by the ultrasonic sensor is equal to or greater than a preset second reference time, the notification message generation unit is controlled to generate a notification message for human recognition and transmit the notification message to the user terminal.

In the above, the monitoring control unit,

Including an outside mode that performs a monitoring and control operation when a human body motion is detected by a first motion detection sensor installed outside the front door, and an indoor mode that performs a monitoring and control operation when a human body motion is detected by the second motion detection sensor It is characterized by doing.

In the above, the user terminal has a monitoring and control application for monitoring and control installed, receives a notification message about the front door opening or front door impact, or person recognition, displays it on the screen, and monitors video or recording through the monitoring and control application. It is characterized by checking the video.

In order to achieve the above object, the first embodiment of the "control method of a power-saving monitoring and control system using object recognition" according to the present invention,

(a) starting a recording by operating a recording control unit when a motion is detected by a first motion sensor installed outside the front door, and ending recording after waiting for a certain period of time when no motion is detected by the first motion sensor; ;

(b) detecting door opening while performing recording when a motion is detected by the first motion detection sensor, generating a door opening notification message and transmitting the message to a user terminal when the door opening is detected;

(c) when an impact is applied to the front door while performing recording when a motion is detected by the first motion detection sensor, generating a notification message for the door impact and transmitting the message to a user terminal;

(d) automatically displaying the front door monitoring image captured by the camera on a display when a motion is detected by a second motion detection sensor installed indoors; and

(e) automatically turning off the display and entering a screen power saving mode after waiting for a predetermined period of time when no motion is detected by the second motion detection sensor.

In order to achieve the above object, the second embodiment of the "control method of a power-saving monitoring and control system using object recognition" according to the present invention,

(a) starting a recording by operating a recording control unit when a motion is detected by a first motion sensor installed outside the front door, and ending recording after waiting for a certain period of time when no motion is detected by the first motion sensor; ;

(b) When a motion is detected by the first motion detection sensor, recording is performed and it is checked whether the object detection time is greater than or equal to a preset first reference time. Outputting a warning sound using a speaker installed outside the door;

(c) When a motion is detected by the first motion detection sensor, while recording is performed, it is checked whether the object detection time is equal to or longer than the preset second reference time, and when the object detection time is greater than or equal to the second reference time, the person Generating a notification message for recognition and transmitting it to a user terminal;

(d) detecting door opening while performing recording when a motion is detected by the first motion detection sensor, generating a door opening notification message and transmitting the message to a user terminal when the door opening is detected;

(e) generating a notification message for door impact and transmitting it to a user terminal when an impact is applied to the front door while performing recording when a motion is detected by the first motion detection sensor;

(f) automatically displaying the front door monitoring image captured by the camera on a display when a motion is detected by a second motion sensor installed indoors; and

(g) automatically turning off the display and entering a screen power saving mode after waiting for a predetermined period of time when no motion is detected by the second motion detection sensor.

According to the present invention, it is possible to monitor the outside of the front door through surveillance images and recorded surveillance images using a monitor and a smartphone application, and when a door is opened or a door impact is detected, or when a human body outside the front door is continuously detected for a certain period of time, an alarm is generated. By generating a message and notifying the user in real time, there is an effect of promoting safety and crime prevention.

In addition, according to the present invention, there is an effect of promoting safety and crime prevention by checking a real-time surveillance image or a recorded surveillance image outside the front door using a self-monitor (display) even in a situation where there is no smartphone or computer indoors.

In addition, according to the present invention, it is possible to identify a person outside the front door through a real-time monitoring image outside the front door, so that the existing intercom can be replaced, thereby reducing installation costs associated with installing a separate intercom.

1 is a block diagram of a power-saving monitoring and control system using object recognition according to the present invention;
2 is a flowchart of a first embodiment of a control method for a power-saving monitoring and control system using object recognition according to the present invention;
3 is a flowchart of a second embodiment of a control method of a power-saving monitoring and control system using object recognition according to the present invention.

Hereinafter, a power-saving monitoring and control system using object recognition according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

The terms or words used in the present invention described below should not be construed as being limited to a conventional or dictionary meaning, and the inventor may appropriately define the concept of the term in order to explain his/her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical spirit of the present invention based on the principle that it can be.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, so various equivalents and equivalents that can replace them at the time of the present application It should be understood that variations may exist.

1 is a configuration diagram of a power-saving monitoring and control system 100 (hereinafter, abbreviated as "monitoring and controlling system") using object recognition according to a preferred embodiment of the present invention, including an infrared illuminance sensor 101, first and second 2 Motion detection sensor 102, 103, door open detection sensor 104, shock detection sensor 105, sensor information processing unit 106, monitoring control unit 107, memory 108, display 109, speaker 110 , a recording controller 111 , a camera 112 , a notification message generator 113 , a notification message transmitter 114 and an ultrasonic sensor 115 .

The infrared illuminance sensor 101 serves to sense the illuminance for controlling the operating state of the infrared light so that the sharpness of the photographed image is similar to that of the daytime image even in cloudy weather or at night.

The first motion detection sensor 102 is installed outside the front door and serves to detect motion. A motion detection sensor may use a conventional PIR sensor.

The second motion detection sensor 103 is installed indoors and serves to detect motion. Like the first motion detection sensor, a general PIR sensor may be used.

The door open sensor 104 serves to detect the opening of the front door. The opening or closing of the front door may be detected using a sensor such as an optical sensor or a contact switch.

The impact detection sensor 105 is installed on the front door and serves to detect an impact applied to the front door.

The camera 112 serves to photograph objects outside the front door. The camera 112 is provided with an infrared light to obtain clear captured images even at night or during cloudy days.

The sensor information processing unit 106 includes the infrared illuminance sensor 101, the first and second motion detection sensors 102 and 103, the door open detection sensor 104, the shock detection sensor 105 and the ultrasonic sensor 115 It serves to pre-process and amplify the detection signals output from each, convert them into digital signals, and transmit them to the monitoring control unit 107.

The monitoring control unit 107 controls recording when motion is detected by the first motion detection sensor 102, and door opening or impact is detected by the door open detection sensor 104 and/or impact detection sensor 105. If it is detected, it controls the generation and transmission of a notification message, and when a motion is detected by the second motion detection sensor 103, it automatically controls the image outside the front door taken by the camera 112 to be displayed on the screen. do.

The monitoring control unit 107 can be implemented as a control device such as a microprocessor, controller, central processing unit, or the like.

The monitoring control unit 107 determines that a motion is detected by the first motion detection sensor 102 and an object detection time detected through the ultrasonic sensor 115 is a preset first reference time (eg, 10 seconds). ) or more, it is controlled to generate an alarm through the speaker 110.

In addition, when a motion is detected by the first motion detection sensor 102 and an object detection time detected through the ultrasonic sensor 115 exceeds a preset second reference time (eg, 20 seconds), the notification is made. The message generating unit 113 is controlled to generate a notification message for human recognition and transmit it to the user terminal.

In addition, the monitoring control unit 107 has an outside mode in which a monitoring and control operation is performed when a motion is detected by the first motion detection sensor 102 installed outside the front door, and an operation is performed by the second motion detection sensor 103. Includes a house mode that performs supervisory control operations when detected. The outside mode and the inside mode may operate simultaneously or independently.

The memory 108 serves to store various control algorithms and various sensed information generated, and to store recorded images.

The display 109 plays a role of displaying a captured image outside the front door on the screen under the control of the monitoring controller 107 . This display 109 can be implemented as a liquid crystal display (LCD) or a touch panel, and can be equipped with a door open button to replace the existing interphone.

The speaker 110 serves to generate an alarm outside the front door under the control of the monitoring control unit 107 .

The recording controller 111 operates the camera 112 under the control of the monitoring controller 107 to take pictures of the outside of the front door, and provides the captured images as monitoring images and recorded images.

The notification message generating unit 113 serves to generate a notification message according to door opening or front door impact or a notification message for human recognition under the control of the monitoring control unit 107 . To this end, the notification message generating unit 113 may generate and store various notification messages suitable for the situation in the internal memory, and extract and output notification messages suitable for the corresponding situation under the control of the monitoring control unit 107 .

The notification message transmitter 114 serves to transmit the notification message generated by the notification message generator 113 to the user terminal. Here, the notification message transmission unit 114 includes a message transmission module and a wireless communication module, and transmits monitoring video transmission or recording surveillance video transmission request information transmitted from a user terminal through a monitoring control application to the monitoring control unit 107. It is also possible to stream a real-time monitoring image or a recorded monitoring image to the user terminal under the control of the monitoring controller 107 .

The ultrasonic sensor 115 is installed at a predetermined location outside the front door and serves to detect an object located around the front door.

The user terminal is installed with a monitoring and control application for monitoring and control, receives a notification message about the opening of the front door, impact on the front door, or recognition of a person, displays it on the screen, and displays a monitoring image or recorded monitoring image through the monitoring and control application. It is also possible to check Such a user terminal may be implemented as a mobile device such as a smart phone, a personal computer, a laptop computer, and the like, and in the present invention, a smart phone will be described as an example.

2 is a flow chart showing a first embodiment of a “control method for a power-saving monitoring and control system using object recognition” according to the present invention. (S101 to S106) starting recording by operating and, if no motion is detected by the first motion detection sensor, stopping the recording after waiting for a certain period of time (S101 to S106), (b) detecting motion by the first motion sensor detecting the door open while performing recording, and generating a notification message for the door open when the door open is detected and transmitting the notification message to the user terminal (S107 to S108); If an impact is applied to the front door while recording is detected, generating a notification message for the door impact and transmitting the message to the user terminal (S109 to S110), If it is detected, automatically displaying the front door monitoring image captured by the camera on the display (S112 to S114), (e) If no motion is detected by the second motion detection sensor, the display is automatically displayed after waiting for a certain period of time. It may include turning off and entering a screen power saving mode (S115 to S117), and (f) maintaining an operation standby state when a human body is not detected (S111).

3 is a flow chart showing a second embodiment of a “control method for a power-saving monitoring and control system using object recognition” according to the present invention. (a) When a motion is detected by a first motion sensor installed outside the front door, the recording control (S201 to S206) starting recording by operating and, if no motion is detected by the first motion sensor, stopping the recording after waiting for a predetermined time (S201 to S206), (b) detecting motion by the first motion sensor recording is performed, checking whether the object detection time is greater than or equal to a preset first reference time, and outputting a warning sound using a speaker installed outside the front door when the object detection time is greater than or equal to the first reference time (S207 - S208), (c) When a motion is detected by the first motion detection sensor, while recording is performed, it is checked whether the object detection time is greater than or equal to the preset second reference time, and the object detection time is equal to the second reference time. If an abnormality occurs, generating a notification message for human recognition and transmitting it to the user terminal (S209 to S210), (d) detecting the door open while performing recording when a motion is detected by the first motion detection sensor, When the opening is detected, generating a door opening notification message and transmitting the message to the user terminal (S211 to S212), (e) When the motion is detected by the first motion detection sensor, the front door is impacted while recording is performed. Generating a notification message for ground and door impact and transmitting it to the user terminal (S213 to S214), (f) When motion is detected by the second motion sensor installed indoors, automatically monitoring the front door photographed by the camera Displaying an image on a display (S216 - S218), (g) automatically turning off the display after waiting for a certain period of time when no motion is detected by the second motion detection sensor and entering a screen power saving mode (S219 - S221), (h) if no motion is detected, maintaining an operation standby state (S215).

The first and second embodiments of the "control method of a power-saving monitoring and control system using object recognition" of the present invention are the same except for the part that controls the output of the warning sound and the transmission of the alarm for human recognition. The first and second embodiments will be described together.

A detailed description of the "power-saving monitoring and control system using object recognition and its control method" according to the present invention configured as described above is as follows.

First, the monitoring control unit 107 operates in two modes, that is, outside the door mode and inside mode, depending on whether an operation is detected outside the front door or indoors.

First, the out-of-door mode (S101, S201) will be described.

When a motion is detected outside the front door by the first motion detection sensor 102 installed outside the front door (S102, S202), the motion detection signal is processed through the sensor information processing unit 106 and then transmitted to the detection control unit 107. .

When motion is detected by the first motion detection sensor 102, the monitoring controller 107 starts recording by operating the recording controller 111 (S103, S203). For example, when a recording command is transmitted through the monitoring controller 107, the recording controller 111 controls the camera 112 to start recording. At this time, when the illuminance is detected through the infrared illuminance sensor 101 and the illuminance exceeds a certain amount, the photographing is performed with the infrared illumination turned off. If the intensity of illumination is less than a certain amount, photographing is performed in a state in which the infrared light is turned on.

The monitoring image captured by the camera 112 is transmitted to the monitoring controller 107 through the recording controller 111 . The monitoring controller 107 stores this in the memory 108 as a monitoring image.

Next, the monitoring control unit 107 continuously checks whether an object outside the front door is detected after the motion is detected by the first motion detection sensor 102 . That is, when a motion is detected by the first motion detection sensor 102, it is determined whether an object is detected at an arbitrary position outside the front door using the ultrasonic sensor 115. This causes an error in which motion detection is not performed even if an object exists outside the front door if the object that triggers the initial motion does not move and maintains a stopped state. In order to solve this error, the present invention uses the ultrasonic sensor 115 to detect the existence of an object and the object detection time. In addition, it is checked whether the object detection time is greater than or equal to a first preset reference time (eg, 10 seconds), and when the object detection time is greater than or equal to the first reference time, a predetermined warning sound is generated, and the generated warning sound is generated. A warning sound is output using the speaker 110 installed outside the front door (S207 - S208). Through this function, a person outside the front door is induced to depart from the front door position, thereby performing a crime prevention function.

Meanwhile, when a motion is detected by the first motion detection sensor 102, the monitoring controller 107 performs recording and checks whether an object is detected at an arbitrary position outside the front door using the ultrasonic sensor 115. And it checks whether the object detection time is longer than the preset second reference time (eg, 20 seconds), and controls the alarm message generator 113 when the object detection time is longer than the second reference time, A notification message for human recognition is generated and controlled to be transmitted to the user terminal (S209 to S210). That is, when a notification transmission command for human recognition is transmitted from the monitoring control unit 107, the notification message generating unit 113 extracts a notification message for recognizing a person registered in advance to generate a notification message, which is then generated by the notification message transmission unit. forward to (114). At this time, it is preferable to include contact information of a user terminal registered in advance. The notification message transmission unit 114 transmits the received notification message to the user terminal. Accordingly, when the user is located remotely or indoors, in real time, the user may recognize that a person is staying outside the front door for a long time.

Then, for safety and crime prevention, the monitoring and control application installed in the user terminal is executed, and a monitoring image or recorded monitoring image is requested. The video request information transmitted from the user terminal is transmitted to the monitoring control unit 107 through the notification message transmission unit 114 . The monitoring control unit 107 checks the transmitted image request information, and transmits the recorded monitoring image stored in the memory 108 or the real-time monitoring image obtained through the camera 112 in real time to the user through the notification message transmission unit 114. send to terminal The user recognizes the situation outside the front door through a video surveillance video outside the front door or a recorded surveillance video through a user terminal in real time, and takes appropriate measures accordingly to promote safety. If the person staying outside the front door is someone you do not know at all, contact the police and take prompt action to ensure safety from situations such as theft or robbery.

On the other hand, the monitoring control unit 107 determines that a person is passing by if no motion is detected by the first motion sensor 102 in a situation where a motion outside the front door is detected using the first motion sensor 102. and waits for a certain period of time (S105). Here, waiting for a certain period of time is for continuous monitoring in preparation for a case where a person outside the front door takes it and returns again. Thereafter, if no motion is detected for the predetermined time, the recording control unit 111 is controlled to stop recording by the camera 112 (S104 - S106, S204 - S206).

In this way, recording is performed only when a motion is detected, and when no motion is detected, power is saved compared to a continuous recording method by switching to an operation standby mode. In addition, in the case of continuous recording, an unnecessary amount of data is generated, resulting in additional costs such as the use of large-capacity memory. However, since the present invention selectively controls recording based on human body detection information, unnecessary data generation can be suppressed. Accordingly, a small-capacity memory can be used, which also has the advantage of reducing the overall system implementation cost.

On the other hand, the monitoring control unit 107 detects the door open using the door open sensor 104 while performing recording when motion is detected by the first motion sensor 102 (S107, S211).

As a result of detecting the door open, when the door open is detected, the alarm message generation unit 113 is controlled to generate a door open notification message. The notification message generation unit 113 generates a notification message about door opening according to the alarm message generation control of the monitoring control unit 107 and transmits the generated notification message to the notification message transmission unit 114 . The notification message transmitter 114 transmits a notification message about door opening to the user terminal (S108 and S212). A user receives a door open notification message through a user terminal while located at home or remotely. Through this, when recognizing that there is a visitor in one's house and wanting to check the person entering one's house, a recorded monitoring video is requested through the monitoring control application as described above. And through the recorded surveillance video screen, it checks the person who entered his house. Then, in the case of an unauthorized person, theft or robbery is prevented by reporting to the police station as described above so that follow-up measures are taken promptly.

In addition, when a motion is detected by the first motion sensor 102, the monitoring control unit 107 checks whether an impact is applied to the front door using the impact sensor 105 while performing recording (S109, S213). When an impact is applied to the front door, the impact detection sensor 105 checks it and transmits it to the monitoring control unit 107. When the front door impact is detected through the impact detection sensor 105, the monitoring control unit 107 controls the notification message generating unit 113 to generate a notification message for the front door impact. According to this control, the notification message generation unit 113 generates a notification message for door impact and transmits it to the notification message transmission unit 114 . The notification message transmission unit 114 transmits a notification message about the door impact to the user terminal (S110 and S214). The user receives the door impact notification message through the user terminal while located at home or remotely. Through this, if the user recognizes that a shock has occurred on the front door of his/her house and wants to check the cause of the shock on his or her front door, a recording/monitoring video is requested through the monitoring/control application as described above. And through the recorded surveillance video screen, the person who gave the shock to his front door is confirmed. Then, in the case of an unauthorized person, theft or robbery is prevented by reporting to the police station as described above so that follow-up measures are taken promptly.

Next, the house mode (S112, S216) will be described as follows.

When a motion is detected by the second motion detection sensor 103 installed in the room, the monitoring control unit 107 automatically controls the front door monitoring image captured by the camera 112 to be displayed on the display 109 . Here, the second motion detection sensor 103 detects motion only when it approaches and moves within a certain distance to the main body of the monitoring and control system 100 installed in the house. To this end, the motion detection distance is set to an appropriate distance in advance. If the motion detection distance is long, a problem arises in that the screen has to be turned on and off repeatedly whenever a person moves in the house. Therefore, it is desirable to set the range within the range in which the motion can be detected when approaching only when the user in the house wants to see only the situation outside the front door.

For example, when a motion is detected by the second motion detection sensor 103, the monitoring control unit 107 determines that the user wants to check the situation outside the front door, and automatically records the camera through the recording control unit 111 ( 112) is driven to photograph the outside of the front door, and the captured surveillance image is displayed on the display 109 in real time (S113 - S114, S217 - S218). Through this, the user in the house can check the situation outside the front door through the video.

Through this function, the user can use the monitoring and control system 100 as a substitute for an interphone.

When an operation in the house is detected through the above process, the monitoring control unit 107 continuously displays the monitoring image captured outside the front door on the display 109 so that the user in the house can check it. In addition, the user in the house checks the situation outside the front door and leaves the current location if there is nothing special. Then, when the user leaves the motion detection range, the second motion detection sensor 103 does not detect the motion. If no motion is detected, the monitoring controller 107 waits for a certain amount of time, which is a time period in which the user returns or moves for a while, considering the situation in which no motion is made, and then, if no motion is detected within the certain amount of time, the recording control unit 111 ), the camera 112 and the display 109 are automatically turned off, and the screen power saving mode is entered (S115 - S1170, S219 - S221). Through this, it acquires and displays real-time surveillance video only when motion is detected in the house, and automatically turns off both the recording device and the display device when no motion is detected to reduce power consumption compared to existing devices that continuously film and display. let it do

Meanwhile, when no motion is detected through the first and second motion detection sensors 102 and 103, it automatically switches to an operation standby mode to prevent unnecessary waste of power consumption (S111 and S215).

According to the present invention described above, it is possible to monitor the outside of the front door through monitoring images and recorded surveillance images using a monitor and a smartphone application, and when a door is opened or a door impact is detected, or a human body outside the front door is continuously detected for a certain period of time or longer If it is detected, an alarm message is generated and notified to the user in real time, promoting safety and crime prevention.

In addition, according to the present invention, it is possible to promote safety and crime prevention by checking a real-time surveillance image or a recorded surveillance image outside the front door using a monitor (display) even in a situation where there is no smartphone or computer indoors.

In addition, according to the present invention, it is possible to check a person outside the front door through a real-time monitoring image outside the front door, so that the existing intercom can be replaced, thereby reducing installation costs associated with installing a separate intercom.

Although the invention made by the present inventors has been specifically described according to the above embodiments, the present invention is not limited to the above embodiments, and it is common knowledge in the art that various changes can be made without departing from the gist of the present invention. It is self-evident to those who have

100: Power-saving monitoring and control system using object recognition
101: infrared light sensor
102: first motion detection sensor
103: second motion detection sensor
104: door open sensor
105: shock detection sensor
106: sensor information processing unit
107: monitoring control unit
108: memory
109: display
110: speaker
111: recording control unit
112: camera
113: notification message generation unit
114: notification message transmission unit
115: ultrasonic sensor

Claims (6)

A first motion detection sensor installed outside the front door to detect motion;
A second motion detection sensor installed indoors to detect motion;
A door open sensor for detecting the opening of the front door;
an impact detection sensor for detecting an impact applied to the front door;
a camera for photographing objects outside the front door;
Recording is controlled when a motion is detected by the first motion detection sensor, generation and transmission of a notification message is controlled when a door open or impact is detected by the door open detection sensor and/or impact sensor, and the second a monitoring control unit that automatically displays an image outside the front door captured by the camera on a screen when a motion is detected by a motion sensor;
a display displaying a captured image outside the front door on a screen under the control of the monitoring controller;
a recording controller operating the camera under the control of the monitoring controller to take a picture of the outside of the front door and providing the captured image as a monitoring image and a recorded image;
a notification message generation unit generating a notification message according to door opening or front door impact under the control of the monitoring control unit;
a notification message transmitter for transmitting the notification message generated by the notification message generator to a user terminal;
a speaker generating an alarm outside the front door under the control of the monitoring controller; and
Including an ultrasonic sensor for detecting an object outside the front door,
The monitoring control unit controls to generate an alarm through the speaker when a motion is detected by the first motion detection sensor and an object detection time detected by the ultrasonic sensor is equal to or longer than a preset first reference time, Performs a crime prevention function by inducing a person outside the door to leave the front door position,
When the object detection time detected by the ultrasonic sensor is greater than or equal to a preset second reference time, the notification message generating unit controls to generate a notification message for human recognition and transmit it to the user terminal. Power-saving monitoring and control system using
delete In claim 1, the monitoring control unit,
Including an outside mode that performs a monitoring and control operation when a motion is detected by a first motion detection sensor installed outside the front door, and an indoor mode that performs a monitoring and control operation when a motion is detected indoors by the second motion detection sensor A power-saving monitoring and control system using object recognition, characterized in that.
The method of claim 1, wherein the user terminal is installed with a monitoring and control application for monitoring and control, receives and displays a notification message on the front door opening, front door impact, or human recognition on the screen, and displays the monitoring image through the monitoring and control application. Or a power-saving monitoring and control system using object recognition, characterized in that for checking the recorded monitoring image.
A method of performing monitoring and control through object recognition using a power-saving monitoring and control system using object recognition according to any one of claims 1, 3, and 4, comprising:
(a) starting a recording by operating a recording control unit when a motion is detected by a first motion sensor installed outside the front door, and ending recording after waiting for a certain period of time when no motion is detected by the first motion sensor; ;
(b) detecting door opening while performing recording when a motion is detected by the first motion detection sensor, generating a door opening notification message and transmitting the message to a user terminal when the door opening is detected;
(c) when an impact is applied to the front door while performing recording when a motion is detected by the first motion detection sensor, generating a notification message for the door impact and transmitting the message to a user terminal;
(d) automatically displaying the front door monitoring image captured by the camera on a display when a motion is detected by a second motion detection sensor installed indoors; and
(e) automatically turning off the display and entering a screen power saving mode after waiting for a certain period of time when no motion is detected by the second motion detection sensor. control method.
A method of performing monitoring and control through object recognition using a power-saving monitoring and control system using object recognition according to any one of claims 1, 3, and 4, comprising:
(a) starting a recording by operating a recording control unit when a motion is detected by a first motion sensor installed outside the front door, and ending recording after waiting for a certain period of time when no motion is detected by the first motion sensor; ;
(b) When a motion is detected by the first motion detection sensor, recording is performed and it is checked whether the object detection time is greater than or equal to a preset first reference time. Outputting a warning sound using a speaker installed outside the door;
(c) When a motion is detected by the first motion detection sensor, while recording is performed, it is checked whether the object detection time is equal to or longer than the preset second reference time, and when the object detection time is greater than or equal to the second reference time, the person Generating a notification message for recognition and transmitting it to a user terminal;
(d) detecting door opening while performing recording when a motion is detected by the first motion detection sensor, generating a door opening notification message and transmitting the message to a user terminal when the door opening is detected;
(e) generating and transmitting a notification message for door impact to a user terminal when an impact is applied to the front door while performing recording when an object is detected by the first motion detection sensor;
(f) automatically displaying the front door monitoring image captured by the camera on a display when a motion is detected by a second motion sensor installed indoors; and
(g) automatically turning off the display after waiting for a certain period of time when no motion is detected by the second motion detection sensor, and entering a screen power saving mode. control method.

Images