KR102257088B1 - System for secured door based on wireless iot service - Google Patents

Abstract

The present invention relates to a security system for a front door, comprising: a doorbell attached to an outer side of a front door; And a smartphone that is wirelessly connected to the doorbell and displays image data collected by the camera unit of the doorbell, wherein voice data input from the smartphone is output through the voice output unit of the doorbell. It is characterized.

Description

Entrance security system based on wireless IoT {SYSTEM FOR SECURED DOOR BASED ON WIRELESS IOT SERVICE}

The present invention relates to a wireless IoT-based entrance security system, and more particularly, to a system for monitoring internal and external environments of a smart home through a device mounted on the entrance door.

As the number of single-person households increases, the number of people living alone at home not only in urban areas but also in non-urban areas is increasing. In addition, in recent years, as courier or food delivery services become active, a lot of attention is paid to the safety of a single household member, and technologies for the safety of a single household member are being developed.

In particular, in the case of the front door, the situation outside the front door can be photographed through a camera and checked through the interphone system, so anxiety caused by not knowing exactly about the outside situation is increasing.

In particular, aging apartments and villas do not have a separate intercom system, so it is inconvenient to identify outsiders only by voice. Therefore, the demand for safety is increasing.

In addition, in the case of low-rise houses with a scale of 2-3 floors, there is an inconvenience of having to go down to the first floor to check visitors, and tenants who are not homeowners may need the consent of the owner to install a security system at the entrance. In addition, it is a reality to hesitate about building a security system because it can act as a burden for construction costs.

Accordingly, the present invention proposes a system capable of controlling a smart home while easily understanding the situation outside the front door.

The present invention is to solve the problems of the prior art described above, it is possible to monitor the external situation outside the front door through a smartphone.

In addition, it is possible to perform various functions through a smartphone by collecting information outside the front door.

An embodiment of the present invention relates to a security system for a front door, comprising: a doorbell attached to an outer side of a front door; And a smartphone that is wirelessly connected to the doorbell and displays image data collected by a camera unit of the doorbell, wherein voice data input from the smartphone is output through the voice output unit of the doorbell. It is done.

In addition, voice data input from the smartphone may be modulated into a specific sound range and output through the voice output unit of the doorbell.

In addition, when the payment code image inputted to the camera unit of the doorbell is displayed as payment request information in the smartphone, and payment approval information of the user is input in the smartphone, payment may be performed.

In addition, when the shape of a person is detected in the image data collected by the camera unit of the doorbell, the smartphone transmits control information to the furniture or home appliance to turn on the furniture or home appliance inside the front door. I can.

In addition, the entrance security system may further include a server, and the server may identify a parcel product input from the camera unit of the doorbell, and transmit the identified parcel delivery product information to the smartphone.

Another embodiment of the present invention relates to a security system for a front door, comprising: a doorbell attached to an outer side of the front door; A smartphone connected wirelessly to the doorbell to display image data collected by a camera unit of the doorbell; And a display device attached to the interior of the front door, and voice data input from the smartphone or the display device may be output through the voice output unit of the doorbell.

The present invention relates to a wireless IoT-based entrance security system, and an external situation can be monitored by attaching a doorbell device to the exterior side of the entrance door.

In addition, by receiving information outside the front door from a smartphone connected wirelessly to the doorbell, various functions may be performed through the smartphone.

1 is a view showing a door security system according to an example of the present invention.
2 is a block diagram conceptually showing the structure of a doorbell according to an example of the present invention.
3 is a block diagram conceptually showing the structure of a smart phone according to an example of the present invention.
4 is a view showing a door security system according to another example of the present invention.
5 is a block diagram conceptually showing the structure of a server according to an example of the present invention.
6 to 7 are diagrams showing entrance monitoring according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In the present specification, the "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware. Meanwhile,'~ unit' is not meant to be limited to software or hardware, and'~ unit' may be configured to be in an addressable storage medium or configured to reproduce one or more processors. Thus, as an example,'~ unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. Components and functions provided in the'~ units' may be combined into a smaller number of elements and'~ units', or may be further separated into additional elements and'~ units'. In addition, components and'~ units' may be implemented to play one or more CPUs in a device or a security multimedia card.

The "user terminal" mentioned below may be implemented as a computer or portable terminal that can access a server or other terminal through a network. Here, the computer includes, for example, a notebook equipped with a web browser, a desktop, a laptop, and the like, and the portable terminal is, for example, a wireless communication device that guarantees portability and mobility. , IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet), LTE (Long Term Evolution) communication-based terminal, smart It may include all kinds of handheld-based wireless communication devices such as phones and tablet PCs. In addition, the “network” refers to a wired network such as a local area network (LAN), a wide area network (WAN), or a value added network (VAN), or a mobile radio communication network or satellite. It can be implemented with any type of wireless network such as a communication network.

1 is a view showing a door security system according to an example of the present invention.

As shown in FIG. 1, the entrance security system may have a configuration in which the doorbell 100 and the smart phone 200 or 201 are connected through a network.

The doorbell 100 according to the present invention is an upgraded concept of an existing doorbell, and is an electronic device that can be attached to a front door in a simple manner. In the case of a conventional front door, an external sight through an iron door is included, and it is common to configure a doorbell through an interphone system separate from the front door. In this case, when the doorbell is broken, it is inconvenient to repair the doorbell, and since the location of the exoscope is attached to a specific location of the front door, it is inconvenient for a small child to monitor the external situation.

The doorbell 100 according to the present invention can be attached to the front door in various ways. The attachment method may vary depending on the weight of the doorbell, or the attachment method may vary depending on the material of the front door. For example, the doorbell 100 may be attached to the front door by adsorption, or may be attached with a magnet. As another example, it may be attached using an adhesive (adhesive tape) or a structural fastening part.

The doorbell 100 according to the present invention includes a communication unit and may be wirelessly connected to the smartphone 200 or 201. At least one smartphone 200 and 201 may check the data collected through the doorbell 100.

The doorbell 100 and the smartphone 200 according to the present invention are connected through a network, and may be directly connected through a short-range wireless method such as Bluetooth (BT) and Wi-Fi Direct. Alternatively, a separate server may be included between the doorbell 100 and the smartphone 200 or may be connected by configuring an access point (AP) such as a router.

2 is a block diagram conceptually showing the structure of a doorbell according to an example of the present invention.

As shown in FIG. 2, the doorbell 100 according to the present invention may include a camera unit 110, an audio output unit 120, and a communication unit 130. The doorbell 100 may further include a power supply unit, a sensing unit, a lamp unit, and a control unit.

The camera unit 110 according to the present invention serves to collect the situation outside the front door. The camera unit 110 according to the present invention may collect audio or video data outside the front door.

In addition, the camera unit 110 according to the present invention may collect a situation outside the front door for 24 hours, such as a black box, and in some cases may be operated through control of a sensing unit, a power supply unit, and the like.

In addition, since the camera unit 110 according to the present invention needs to collect the situation outside the front door, for optimal photographing of an object, when the subject is located within a certain distance near the front door, the lighting outside the front door is It can be set to shoot while turned on.

The voice output unit 120 according to the present invention outputs voice data to a person outside the front door. Because communication with people outside the front door (eg, courier, delivery man, etc.) is required, the voice data input through the smartphone is output or the door ring sound is output.

The communication unit 130 according to the present invention performs a role of transmitting and receiving data by being wirelessly connected to a smartphone. The communication unit 130 according to the present invention may perform communication with a smartphone using a wireless communication method such as Bluetooth (BT), Bluetooth low power (BLE), Wi-Fi Direct (WFD), and ZigBee.

In addition, the communication unit 130 according to the present invention may be connected to a router (AP) or the like, and may be connected to other home appliances through a network. For example, the doorbell 100 may be connected to a living room lighting, a shoe rack lighting, etc. through a network, and when the doorbell is operated, the living room and shoe rack lighting may be connected to be turned on/off.

The power supply unit (not shown) according to the present invention can supply power in the form of a battery that is easy to replace due to the characteristic of being separately attached to the outside of the entrance. In some cases, it is possible to supply power at all times by being connected to a wireless charging pad inside the front door, but it is preferable to supply power in the form of a battery in consideration of a small doorbell size.

3 is a block diagram conceptually showing the structure of a smart phone according to an example of the present invention.

The smartphone 200 according to the present invention includes a display unit 210, a microphone unit 220 and a communication unit 230.

The display unit 210 according to the present invention outputs image data collected by the camera unit of the doorbell. The image data in the present invention is preferably understood as a broad concept image including not only a static image captured at a certain point in time, but also a dynamic image captured for a certain time.

In addition, the display unit 210 according to the present invention may output not only image data collected through a doorbell, but also various information related thereto. Various information related to image data may include various information such as information on a person identified by identifying a face image, information on a product through identification such as a QR code, information registered on a schedule, information collected in a message, and so on. have.

For example, when a relative face image is photographed through a doorbell, the smartphone may match the face image in the smartphone, and may be identified as a relative to display the identified relative information.

For another example, when a QR code is input through a doorbell, the smartphone may specify the delivered product from the information of the QR code. In addition, the smartphone may output matched information through the display unit through a visit schedule registered before and after a predetermined time from the time when the image is identified.

The microphone unit 220 according to the present invention serves to input voice data output through a doorbell. The microphone unit 220 according to the present invention may be set to be operated after the physical button of the doorbell is pressed, and in some cases, it may be set to operate regardless of the physical button.

In addition, the microphone unit 220 according to the present invention may receive the user's voice data, and the smartphone 200 may modulate the voice data into a specific sound range. For example, when a visitor outside presses a doorbell, a child can monitor the external situation indoors, and the child's voice can be modulated into the father's voice or the mother's voice can be modulated and output.

In addition, as another example, even when no one is in the room, the user may input voice data to the microphone unit 220 of the smartphone and output it through a doorbell in order to pretend that there is a person in the room when a visitor comes. As a similar example, it is possible to set the female to be modulated to the male range or the male to be modulated to the female range and output it as a doorbell.

The communication unit 230 according to the present invention may perform communication with various devices. The communication unit 230 according to the present invention may be wirelessly connected to the communication unit of the doorbell to receive voice data and image data input through the doorbell.

In addition, the communication unit 230 according to the present invention may perform communication with various home appliances other than the doorbell. The communication unit 230 according to the present invention may be connected to various electronic devices such as a lighting device, a gas range, an electric range, an air conditioner, a TV, a refrigerator, a computer, a heating device, and a curtain inside the front door through a network.

In addition, the communication unit 230 according to the present invention may be connected to a server (not shown). The server in the present invention is a server of a broad concept that allows various application programs to be executed through a smart phone by being connected to a network.

4 is a view showing a door security system according to another example of the present invention.

As shown in FIG. 4, the entrance security system has a structure in which a doorbell 100, one or more smartphones 200 and 201, and a server 300 are connected through a network.

The server 300 according to the present invention may be a server that is connected to a doorbell and a smart phone through a network to support the operation of the doorbell and the smart phone. For example, the server 300 may be a server that controls the lighting inside the entrance to be turned on when the physical button of the doorbell is pressed, and may be a server that is connected to a smartphone through a network and allows various application programs to be executed. have.

In addition, the server 300 according to the present invention may be an internal server built inside the entrance, or may be an external server connected through a wireless communication network. In the case of an internal server, it is advantageous for small-scale control, that is, building a smart home, and an external server is advantageous for performing various services.

In addition, the server 300 according to the present invention may include a separate storage unit, and may be set to store the image and audio data collected through the doorbell in the storage unit. Like a black box, it can be stored for a certain period of time or semi-permanently.

The server 300 according to the present invention may analyze a visit pattern of a delivery person or a visitor. For example, a delivery man of a courier company A can determine that delivery can be repeated around 10:30 am by analyzing data photographed from a doorbell. This delivery pattern information may be used as basic data for the user to return the product or send the product in the future.

In addition, the user can access the server 300 and identify who the visitor at a specific time is by loading pre-stored data, and enter relevant information that can match other information stored in the server to establish the entrance security system. You can apply. For example, if there is a delivery person who repeatedly delivers milk in the morning of monthly payments, the user can directly match the image of the delivery person with the data stored in the server that the milk delivery person is, and a message to be delivered to the milk delivery person afterwards. If there is, it is possible to store data that is audio output at the corresponding time in advance so that it can be transmitted to the milk deliveryman. For example, the pre-stored voice data “Please do not put milk on Friday” can be output to a delivery person delivering milk at the time of delivery.

In addition, the server 300 may store history information that has been progressed in association with a doorbell in one or more smartphones 200 and 201. For example, if a courier driver visited yesterday, the phrase “Please leave it in front of the front door” was modulated into the voice of the father and output as log information. If the delivery driver visited today, the same voice can be output. , In some cases, it may be guided to output by modulating the mother's voice.

The server 300 may pre-store various voice data to modulate voice data. For example, in the case of a family of four consisting of a father, a mother, a son, and a daughter, the server 300 acquires voice samples of the father and mother, learns enough to be outputted as a corresponding voice, and outputs a modulated voice later. have.

In addition, the server 300 may be interlocked with an existing interphone system installed in the premises. When the doorbell of the present invention is additionally mounted in a situation where an existing intercom is provided, the outside person may not know which doorbell physical button to press. In this case, it is possible to control the server so that the interphone and the smart phone are interlocked even when any physical button of the doorbell of the existing intercom system and the doorbell of the present invention is pressed. That is, when any doorbell is operated, the server 300 can receive image data from the camera unit of the doorbell and the camera unit of the existing intercom system, and such image data is converted into the vision device of the interphone and the smartphone. You can display an image so that you can identify it all. Even in the case of audio output, the server may set the audio output from one of the audio output units so that the audio output of the interphone and the audio output of the doorbell do not interfere with each other.

5 is a block diagram conceptually showing the structure of a server according to an example of the present invention.

As shown in FIG. 5, the server 300 includes a payment information storage unit 310, a package identification unit 320, and a communication unit 330. Although not shown, it may further include a power supply unit, an input/output unit, a storage unit, and a control unit.

The payment information storage unit 310 according to the present invention may include information using a delivery (courier) service by a user through a smartphone. For example, when a user performs online shopping such as a courier service, the payment information storage unit 310 may include information on a purchase item, a payment date, a payment amount, a courier company, and a courier driver. For another example, when a user orders food for delivery, it may include food delivered, payment date, payment amount, delivery company, and delivery staff information.

The parcel delivery item identification unit 320 according to the present invention identifies a product targeted for delivery to the front door where a doorbell is installed. For example, a parcel package may be packaged in a paper box, and information for identifying the product, such as a QR code or a barcode, may be displayed outside the box.

The delivery product identification unit 320 according to the present invention uses identification information such as QR codes and barcodes input through the camera unit of the doorbell, etc. You can specify whether it is delivered.

The communication unit 330 according to the present invention may be directly connected to the doorbell, and may be connected to a smartphone to control the operation of the doorbell. The server according to the present invention may be connected to another server, and the communication unit 330 may perform communication with another server.

Example 1: Payment proceeding using a doorbell

6 to 7 are diagrams showing entrance monitoring according to an embodiment of the present invention.

As shown in FIG. 6, a doorbell 100 may be attached to the front door 10, and the doorbell 100 may be wirelessly connected to the smartphone 200. At this time, the smartphone 200 may be located indoors inside the entrance hall, and in some cases, may be located outside.

In the case of using the delivery service, the user cannot always monitor the offline delivery process, and in the case of using multiple delivery services, it is difficult to identify which goods have been delivered.

The doorbell 100 according to the present invention can monitor the delivery completion status from a delivery person outside the front door. For example, when the delivery man scans the QR code or barcode of the packaging box through the camera unit of the doorbell 100 before placing the object in front of the entrance, the camera unit of the doorbell 100 collects the scanned image and It can be sent to 200.

The smartphone 200 can analyze the image received from the doorbell through an application program, and can identify which object the delivered packaging box is for. The user can check the delivery item information displayed through the smartphone and recognize that the delivery has been completed.

The user's smartphone may analyze a payment code image (QR code, barcode, etc.) requiring payment and input payment approval information (fingerprint, PIN, etc.) to complete the payment process.

In general, when the delivery fee is paid in advance, there is little need to communicate with the delivery person. However, in the case of paying the courier delivery fee (paid to the destination), the user may feel a burden on security because an offline process of paying the cost must be performed directly with the delivery person.

According to an embodiment of the present invention, when a delivery person scans a QR code or the like through a doorbell, a delivery product can be specified on a smartphone linked to the doorbell, and online payment is performed for the specified delivery product. You will be able to. Therefore, there is an advantageous effect that the user can pay the delivery fee (even when there is no cash) without face-to-face with the delivery person.

In the previous description, payment of the delivery fee was explained as an example.However, in the case of delivery food, it is often used in the form of cash on delivery rather than prepayment, so it is also possible to pay for the delivery food through a doorbell and a smartphone at the front door. Do.

In some cases, a user's handwritten signature may be required. In this case, the signature has to be done directly at a specific signature terminal, so it is inevitable to do it face-to-face. According to the present invention, when a handwritten signature is required, when a signature terminal to be signed is tagged on the doorbell, the handwritten signature is completed on the user's smartphone, and the handwritten signature data is transmitted to the signature terminal. , You can complete the non-face-to-face signature.

Example 2: Doorbell with display unit

The doorbell 100 is attached to the outside of the front door to the outside 10 of the front door according to the present invention, and is linked with a smartphone. The display unit 150 may be attached to the interior 20 of the front door.

The display unit 150 according to an exemplary embodiment of the present invention may be attached to the inside of the front door to display data input through the camera unit of the doorbell.

In general, the intercom system is provided with a display unit on one side of the living room, a kitchen, a toilet, etc., and it is in the living room to identify who is actually, but the traffic line may be complicated or inconvenient because a visitor must be received at the entrance.

Since the display unit 150 according to the present invention is provided inside the entrance hall, it is possible to directly identify a visitor, and since the reception process is carried out in one moving line, it has an advantageous effect that the efficiency on the moving line is high.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general-purpose hardware architecture.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

100: doorbell
200: smartphone

Claims (10)

In the entrance security system,
A doorbell attached to the outer side of the front door; And
A smartphone connected wirelessly to the doorbell to display image data collected by a camera unit of the doorbell;
Including,
Voice data input from the smartphone is output through the voice output unit of the doorbell,
When the signing terminal requests a user's handwritten signature,
Tagging the signing terminal to the doorbell, receiving a handwritten signature input from the smartphone, and transmitting the received handwritten signature data to the signing terminal. The method of claim 1,
The doorbell security system, characterized in that the voice data input from the smartphone is modulated into a specific sound range and output through the voice output unit of the doorbell. The method of claim 1,
The payment code image input to the camera unit of the doorbell is displayed as payment request information on the smartphone,
When the user's payment approval information is inputted from the smartphone, payment is performed. The method of claim 1,
When the smart phone detects the shape of a person in the image data collected by the camera unit of the doorbell,
The front door security system, characterized in that transmitting control information to the furniture or home appliance to turn on the power of the furniture or home appliance inside the front door. The method of claim 1,
The entrance security system further comprises a server,
The server,
The doorbell security system, characterized in that by identifying the parcel item inputted from the camera unit of the doorbell, and transmitting the identified parcel item information to the smartphone. In the entrance security system,
A doorbell attached to the outer side of the front door;
A smartphone connected wirelessly to the doorbell to display image data collected by a camera unit of the doorbell; And
A display device attached to the interior of the front door;
Including,
Voice data input from the smartphone or the display device is output through the voice output unit of the doorbell,
When the signing terminal requests the user's handwritten signature,
Tagging the signing terminal to the doorbell, receiving a handwritten signature input from the smartphone, and transmitting the received handwritten signature data to the signing terminal. The method of claim 6,
The doorbell security system, characterized in that the voice data input from the smartphone is modulated into a specific sound range and output through the voice output unit of the doorbell. The method of claim 6,
The payment code image input to the camera unit of the doorbell is displayed as payment request information on the smartphone,
When the user's payment approval information is inputted from the smartphone, payment is performed. The method of claim 6,
When the smart phone detects the shape of a person in the image data collected by the camera unit of the doorbell,
The front door security system, characterized in that transmitting control information to the furniture or home appliance to turn on the power of the furniture or home appliance inside the front door. The method of claim 6,
The entrance security system further comprises a server,
The server,
The doorbell security system, characterized in that by identifying the parcel item inputted from the camera unit of the doorbell, and transmitting the identified parcel item information to the smartphone.

Images