KR20210045195A - Smart door - Google Patents

Abstract

A smart door is disclosed. According to an embodiment of the present invention, the smart door includes: a door lock for locking or unlocking the smart door installed in a day-care center for childcare; a camera for photographing a front of the smart door; and a processor which recognizes a person included in an image captured by the camera and performs an operation corresponding to a group to which the recognized person belongs. The group includes a group of children cared for at the day-care center, a group of caregivers who takes care of the child at the day-care center, and a guardian group who brings the children to or from the day-care center. The present invention improves the safety of children by restricting visitors.

Description

Smart Door {SMART DOOR}

The present invention relates to a smart door installed in a childcare facility and capable of providing different services depending on who is requesting access.

The existing front door has a mechanical door lock, and functions only as a locking means and an opening/closing means.

However, in recent years, electronic door locks or digital door locks have been developed to provide a lock/unlock function that is easier to use, and smart doors that provide various information and aesthetic elements and also perform security functions are appearing. .

In addition, since the conventional method of performing authentication using a button key has evolved, recently, a smart door using a simple and improved security authentication means such as biometric authentication has emerged.

On the other hand, childcare services are services that require a wide variety of management in security, provision of information about children, and access management.

Therefore, we propose a smart door that can provide various management functions necessary for childcare services depending on who is requesting access.

An object of the present invention is to provide a smart door installed in a childcare facility and capable of providing different services depending on who is requesting access.

An object of the present invention is to provide information related to child-rearing to a guardian when the person requesting access is a child.

An object of the present invention is to manage time and attendance of a caregiver when a person requesting access is a caregiver.

An object of the present invention is to support pickup of a child when a person requesting access is a guardian.

The smart door according to an embodiment of the present invention performs an operation corresponding to a group to which the recognized person belongs, and the group includes a group of children to be cared for in a child care facility, a group of child care workers for child in a child care facility, Includes a group of guardians who make the house or the House of Representatives.

When the recognized person belongs to the child group, the smart door may transmit developmental information including weight information and height information to the guardian's terminal.

When the recognized person belongs to the caregiver group, the smart door may store the recognized person's commute or leave time in the memory.

When the recognized person belongs to the guardian group, the smart door can call the child caregiver of the child that the recognized person makes to the home or the lower house.

The smart door according to the present invention has the advantage of being able to provide integrated safety, security, information about children, and access management functions required in childcare facilities. In particular, since the smart door is a device through which everyone who enters and exits the childcare facility, it is very advantageous in terms of information collection and service provision when various functions are provided in an integrated manner, and when various functions are provided by multiple devices. Compared to this, there is an advantage of saving cost. In addition, there is an advantage of improving the safety of children by restricting access to childcare facilities.

In addition, according to the present invention, there is an advantage of being able to simultaneously and effectively collect and manage the child's attendance information and development information in a smart door that children must pass through, and provide it to a guardian.

In addition, according to the present invention, there is an advantage of being able to effectively manage the attendance record of the caregiver.

In addition, according to the present invention, there is an advantage of providing convenience to the caregiver and improving security by automatically calling the caregiver when the caregiver visits.

1 is a view for explaining a childcare management system 10 according to an embodiment of the present invention.
2 is a block diagram illustrating a smart door 200 according to an embodiment of the present invention.
3 is a diagram illustrating a method of operating a smart door according to an embodiment of the present invention.
4 to 6 are diagrams for explaining an operation when a child is recognized.
7 to 8 are diagrams for explaining an operation when a guardian is recognized.
9 to 11 are diagrams for explaining an operation when a recognized person is not previously registered.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another component.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as "comprises" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof does not preclude in advance.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation systems, and slate PCs. , Tablet PC, ultrabook, wearable device, for example, smartwatch, smart glass, head mounted display (HMD), etc. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to fixed terminals such as digital TVs, desktop computers, and digital signage, except when applicable only to mobile terminals. will be.

1 is a view for explaining a childcare management system 10 according to an embodiment of the present invention.

Referring to FIG. 1, the childcare management system 10 may include a first terminal 100, a smart door 200, a server 600, and a second terminal 300.

The smart door 200 is connected to the server 600 through a wired/wireless network including an Internet network, and communicates with the server 600 to transmit/receive data.

In addition, the server 600 may be connected to the user's first terminal 100 through a wired/wireless network including an Internet network, and may transmit/receive data by communicating with the first terminal 100.

In addition, the smart door 200 may transmit/receive data by communicating with the first terminal 100. Specifically, the smart door 200 may transmit/receive data by communicating with the first terminal 100 through the server 600.

In addition, the smart door 200 may be directly connected to and communicate with the first terminal 100. To this end, the smart door 200 and the first terminal 100 may include a short-range communication module (a short-range communication circuit) for communicating with each other.

In addition, the smart door 200 and the first terminal 100 may be connected by a home network or other communication means to perform communication.

Meanwhile, the smart door 200 may be a front door of a house.

In addition, the smart door 200 may be an entrance door of a childcare facility. Here, a childcare facility may mean a facility where children are cared for and raised.

Meanwhile, the first terminal 100 may be a parental terminal. Here, the guardian may mean the person who makes the child to the deungwon or the lower house.

Also, the guardian may be a parent or family member of a child, a baby sitter, or the like.

In addition, the first terminal 100 may be a mobile terminal such as a smart phone or a tablet PC, or a fixed terminal such as a desktop.

Meanwhile, the second terminal 300 may be a terminal for a caregiver. Here, the caregiver may be a person who cares for a child in a childcare facility. For example, a caregiver may be a daycare teacher.

In addition, the second terminal 300 may be a mobile terminal such as a smart phone or a tablet PC, a fixed terminal such as a desktop, or a telephone capable of making a video or audio call.

2 is a block diagram illustrating a smart door 200 according to an embodiment of the present invention.

Referring to FIG. 2, the smart door 200 includes a communication unit 210, a sensing unit 220, an input unit 230, an output unit 240, a memory 250, a door lock 260, a processor 270, and a power supply unit ( 280) and a door driving unit 290 may be included.

Meanwhile, the components shown in FIG. 2 are not essential in implementing the smart door 200, so the smart door 200 described in this specification has more or less components than the components listed above. I can.

The communication unit 210 communicates between the smart door 200 and the wireless communication system, between the smart door 200 and the server, and between the smart door 200 and the smart door 200 and a mobile terminal through a wired or wireless connection. It may include one or more modules (communication circuits) to enable it.

In addition, the communication unit 210 may include one or more modules (communication circuits) that connect the smart door 200 to a home network or one or more other networks through a wired or wireless connection.

The communication unit 210 may include a mobile communication module (mobile communication circuit).

The mobile communication module includes technical standards or communication methods for mobile communication (for example, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000)), EV-DO ( Enhanced Voice-Data Optimized or Enhanced Voice-Data Only, WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term) Evolution-Advanced), etc.), transmits and receives radio signals with at least one of a base station, an external terminal, and a server.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission and reception of text/multimedia messages.

Meanwhile, the communication unit 210 may include a wireless Internet module (wireless Internet circuit).

The wireless Internet module refers to a module for wireless Internet access, and may be built into or external to the smart door 200. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module Data is transmitted and received according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module performing wireless Internet access through the mobile communication network is described above. It may be understood as a kind of mobile communication module.

Meanwhile, the communication unit 210 may include a short-range communication module (a short-range communication circuit).

The short range communication module is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field (NFC). Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus), and beacon (Beacon) technology may be used to support short-range communication.

The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

Meanwhile, when the smart door 200 is wired to an external device, the communication unit 210 may include an interface unit that serves as a passage with the external device.

These interface units include a data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, and a video I/O. It may include at least one of a (Input/Output) port and an earphone port.

Meanwhile, the sensing unit 220 may obtain authentication data for authenticating or identifying a user.

In more detail, the sensing unit 220 may acquire the user's biometric data.

More specifically, the sensing unit 220 may acquire biometric data related to a user's physical characteristics.

For example, the sensing unit 220 may include a fingerprint recognition sensor acquiring a user's fingerprint data, a vein recognition sensor acquiring the user's vein data, an iris recognition sensor acquiring the user's iris data, and a face acquiring the user's face data. Recognition sensor, voice recognition sensor to obtain user's voice data, palm recognition sensor to obtain user's palm data, long recognition sensor to obtain user's long data, retina recognition sensor to obtain user's retina data, user's DNA It may include at least one of the DNA recognition sensors to obtain.

In addition, the sensing unit 220 may acquire biometric data related to a user's behavioral characteristics.

For example, the sensing unit 220 may include a handwriting recognition sensor that acquires handwriting data of a user, a lip movement recognition sensor that acquires data on a habit of movement of the user's lips, and the amount of change in the area of black masturbation due to the user's eye blinking. It may include at least one of an eye-blink recognition sensor that acquires data on and a gait recognition sensor that acquires data on a gait characteristic of a user.

Meanwhile, the smart door 200 disclosed in the present specification is a multimodal biometrics method in which data sensed by at least two or more of these sensors is combined, and may authenticate a user or identify a user.

Meanwhile, the sensing unit 220 may include one or more cameras that acquire image data. In addition, one or more cameras may be a component of at least one of the above-described various sensors.

In addition, the sensing unit 220 may include one or more microphones that acquire voice data. In addition, one or more microphones may be configured as at least one of the various sensors described above.

Meanwhile, the processor 270 controls the operation of the smart door 200 using data acquired by the communication unit 210 or the sensing unit 220, or processes and functions data related to an application program installed in the smart door 200. Or you can perform an action.

As an example, the processor may lock or unlock the door lock 260 using data obtained from the communication unit 210. For example, when an ID is transmitted from a user's terminal through a short-range communication module, and a previously registered ID and an ID obtained through the short-range communication module match, the processor 270 may unlock the door lock 260. have

In addition, the processor may lock or unlock the door lock 260 by using the data acquired by the sensing unit 220.

For example, when a previously registered fingerprint and fingerprint data acquired through a fingerprint recognition sensor match, the processor 270 may unlock the door lock 260. On the other hand, if the previously registered fingerprint and the fingerprint data acquired through the fingerprint recognition sensor do not match, the processor 270 may lock the door lock 260.

For another example, when the previously registered iris and iris data acquired through the iris recognition sensor match, the processor 270 may unlock the door lock 260. On the other hand, if the previously registered iris and iris data acquired through the iris recognition sensor do not match, the processor 270 may lock the door lock 260.

Meanwhile, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. A camera, a microphone for inputting an audio signal, and a user input unit for receiving information from a user (eg, a touch key, a mechanical key, etc.) may be included. The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

In order to input image information, the input unit 120 may include one or a plurality of cameras. The camera processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display or stored in the memory 250.

The microphone processes external sound signals into electrical voice data. The processed voice data may be used in various ways according to a function (or an application program being executed) being executed in the smart door 200. Meanwhile, various noise removal algorithms may be implemented in the microphone to remove noise generated in the process of receiving an external sound signal.

The user input unit is for receiving information from a user. When information is input through the user input unit, the processor 270 may control the operation of the mobile terminal 100 to correspond to the input information. The user input unit is a mechanical input means (or a mechanical key, for example, a button located on at least one of the front and rear surfaces of the smart door 200, a dome switch, a jog wheel, a jog switch. Etc.) or a touch-type input means.

As an example, the touch input means is composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or a portion other than the touch screen It may be made of a touch key (for example, a touch key) disposed on a touch pad. On the other hand, the virtual key or the visual key can be displayed on the touch screen while having various forms, for example, graphic, text, icon, video, or these It can be made of a combination of.

The output unit 240 is for generating an output related to visual, auditory or tactile sense, and may include at least one of a display unit, an audio output unit, a hap tip module, and a light output unit. The display unit forms a mutual layer structure with the touch sensor or is integrally formed to implement a touch screen. Such a touch screen may function as a user input unit that provides an input interface between the smart door 200 and a user, and may provide an output interface between the smart door 200 and the user.

The display unit displays (outputs) information processed by the smart door 200. For example, the display unit may display execution screen information of an application program driven by the smart door 200, or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information.

The sound output unit may output audio data received from the communication unit 210, stored in the memory 250, or generated by the processor 270 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, etc. .

The sound output unit 152 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed by the smart door 200. The sound output unit may include a receiver, a speaker, a buzzer, and the like.

The haptic module generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module may be vibration. The intensity and pattern of vibrations generated by the haptic module may be controlled by a user's selection or setting of a controller. For example, the haptic module may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 153 is designed to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a blowing force or suction force of air through a jet or inlet, grazing against the skin surface, contact of an electrode, and electrostatic force. It can generate various tactile effects, such as an effect by the effect and an effect by reproducing the feeling of cooling and warming using an endothermic or exothermic element.

The light output unit outputs a signal for notifying the occurrence of an event by using the light of the light source of the smart door 200.

The signal output by the light output unit is implemented as the smart door 200 emits a single color or multiple colors of light to the front or rear. The signal output may be terminated when the smart door 200 detects a user's event confirmation.

The door lock 260 is a mechanical device mounted on the smart door 200 and is a device capable of locking or unlocking the smart door 200 with an operation mechanism driven by electric energy. In addition, the door lock 260 may include an actuator that is a mechanical driving source.

Here, lock means a lock, and the meaning that the smart door 200 is locked means that the smart door 200 is changed from an unlocked state to a locked state or is locked. It may mean that the smart door 200 in the state is kept in a locked state.

On the other hand, unlock means unlocking, and the meaning that the smart door 200 is unlocked means that the smart door 200 is changed from a locked state to an unlocked state or unlocked. It may mean that the smart door 200 in the (unlock) state continues to maintain the unlocked state.

Meanwhile, the door driver 290 may open or close the smart door under the control of the processor 270.

Here, the opening of the smart door may mean that the door is opened so that the user can pass through the door without touching the smart door.

Also, that the smart door is closed may mean that the door is closed so that the user cannot pass through the door without touching the smart door.

The door driving unit 290 may open and close the smart door by driving the smart door.

Here, the door driving unit 290 may include a motor that generates a driving force.

In addition, the door driving unit 290 may include a transmission mechanism that mechanically connects the motor and the opening and closing door, and transmitting a driving force generated by the motor to the opening and closing door.

In addition, the processor 270 may control the door driving unit 290, more specifically, a motor to open or close the smart door.

The memory 250 stores data supporting various functions of the smart door 200. The memory 250 may store a plurality of application programs (application programs or applications) driven by the smart door 200, data for the operation of the smart door 200, and instructions. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the smart door 200 from the time of shipment to perform the function of the smart door 200. Meanwhile, the application program may be stored in the memory 250, installed on the smart door 200, and driven by the processor 270 to perform an operation (or function) of the smart door 200.

In addition to the operation related to the application program, the processor 270 generally controls the overall operation of the smart door 200. The processor 270 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 250.

In addition, the processor 270 may control at least some of the constituent elements described in this drawing in order to drive the application program stored in the memory 150.

Furthermore, the processor 270 may operate by combining at least two or more of the components included in the smart door 200 to drive the application program.

In addition, the processor 270 may control any one or a combination of a plurality of components described in this drawing in order to implement various embodiments described below on the smart door 200 according to the present invention.

The power supply unit 280 receives external power and internal power under the control of the processor 270 and supplies power to each of the components included in the smart door 200.

The power supply unit 280 may include a battery, and the battery may be a built-in battery or a replaceable battery.

Meanwhile, hereinafter, various embodiments may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Next, the operation of the present invention will be described in detail with reference to FIG. 3.

3 is a diagram illustrating a method of operating a smart door according to an embodiment of the present invention.

The operation method of a smart door according to an embodiment of the present invention includes photographing the front of the smart door (S310), recognizing a person included in an image captured by a camera (S330), and a group to which the recognized person belongs. It may include the step (S350) of performing the operation according to. Here, the group may include a group of children who are cared for in a child care facility, a group of caregivers who take care of a child in a child care facility, and a group of caregivers who send a child to the child-care facility or lower the house.

First, an operation when a child is recognized will be described with reference to FIGS. 4 to 6.

4 to 6 are diagrams for explaining an operation when a child is recognized.

Referring to FIG. 4, the smart door 200 may be installed in a childcare facility for childcare. In addition, the smart door 200 may be an entrance door of a childcare facility.

Meanwhile, the processor 270 of the smart door 200 may control the camera 411 to photograph the front of the smart door.

Here, the front of the smart door may mean the outside direction of the childcare facility. That is, the inside and outside of the childcare facility are separated by the smart door, and the front of the smart door may mean the outside of the childcare facility.

Meanwhile, the processor 270 of the smart door 200 may obtain the user's authentication data and authenticate the user using the user's authentication data.

Specifically, the sensing unit 220 of the smart door 200 may obtain authentication data for user authentication.

Here, the authentication data may be biometric data. In addition, by using any one of various sensors, the sensing unit 220 of the smart door 200 may acquire the user's biometric data.

On the other hand, authentication data of a user is not limited to biometric data, and data capable of authenticating a user and distinguishing a specific user from other users is sufficient.

Meanwhile, the biometric data may include image data photographing a person.

Specifically, the processor 270 may photograph a person and recognize a person included in the photographed image. In this case, various known facial recognition algorithms may be used to recognize a person included in the captured image.

Meanwhile, the processor 270 may determine whether the recognized person has been previously registered.

Specifically, when biometric data of registered people is stored in the server 600, the processor 270 may transmit the recognition result data obtained by recognizing a person included in the image to the server 600.

In this case, the server 600 may determine whether the visitor has been pre-registered by using the recognition result data received from the smart door 200 and the biometric data of a pre-registered person.

Specifically, if the biometric data of a specific person among the biometric data of registered people and the recognition result data transmitted from the smart door 200 match, the server determines that the recognized person is already registered, and the recognized person is pre-registered It is possible to transmit the information to the smart door 200.

In addition, when information indicating that the recognized person is pre-registered is received, the processor 270 of the smart door 200 may determine that the person in the captured image is pre-registered.

Meanwhile, the processor 270 may determine a group to which the recognized person belongs.

Specifically, biometric data of pre-registered people may be stored in the server 600 together with group information to which pre-registered people belong.

In this case, the server 600 may determine a group to which the recognized person belongs using the recognition result data received from the smart door 200, the biometric data of the registered person, and group information of the registered person.

Specifically, when the biometric data of a specific person among the biometric data of registered people and the recognition result data transmitted from the smart door 200 match, and the specific person corresponds to a specific group, the server recognizes that the recognized person belongs to a specific group. Can be determined. In addition, the server may transmit information on a group to which the recognized person belongs to the smart door 200.

Meanwhile, it has been described that the determination as to whether or not the recognized person is already registered and the group to which the recognized person belongs are performed by the server 600, but are not limited thereto.

Specifically, biometric data of people who have already been registered may be stored in the memory 250 of the smart door 200.

In this case, the processor 270 may determine whether the visitor is pre-registered by using the recognition result data obtained by recognizing the person included in the image and the biometric data of the person already registered.

Also, the processor 270 may determine a group to which the recognized person belongs.

Specifically, biometric data of pre-registered people may be stored in the memory 270 together with group information to which pre-registered people belong.

In this case, the processor 270 may determine a group to which the recognized person belongs, using recognition result data obtained by recognizing a person included in the image, biometric data of a pre-registered person, and group information of pre-registered people. .

Meanwhile, the processor 270 may perform an operation corresponding to a group to which the recognized person belongs.

In this case, when the recognized person is pre-registered, the processor 270 may perform an operation corresponding to a group to which the recognized person belongs.

First, explain the situation in which the recognized person belongs to the child group.

A group may include a group of children who are cared for in a child care facility, a group of caregivers who take care of a child in a child care facility, and a group of caregivers who bring the child to the home or lower house.

In addition, when the recognized person belongs to the child group, the processor 270 may receive weight information of the person from the weight sensor 420 disposed in front of the smart door.

Specifically, the weight sensor 420 may be installed on the floor in front of the smart door, and may also be positioned in the photographing area of the camera 411 when a person is positioned above the weight sensor 420. That is, when a person is photographed by the camera 411, weight information of the person may be obtained by the weight sensor 420.

In addition, when the recognized person belongs to the child group, the processor may receive weight information of the child from the weight sensor 420.

In addition, the processor 270 may acquire key information of the child included in the captured image by using the image captured by the camera.

Specifically, the processor 270 includes the size of the person in the photographed image, the distance between the photographed person and the camera, the distance between the photographed person and the smart door, the distance between the camera and the weight sensor 420, and the smart door. The height information of the child included in the captured image may be obtained by using the distance between the weight sensors 420 and the like.

Meanwhile, the processor may transmit development information including at least one of weight information and height information to a terminal of a guardian of the recognized person.

For example, identification information (eg, a phone number) of a terminal of a guardian of a child may be stored in the memory 250. And, as shown in FIG. 5, the processor may transmit development information including at least one of weight information and height information of the child to the terminal of the mother of the child by using the identification information of the guardian's terminal stored in the memory 250. have.

Meanwhile, referring to FIG. 6, before receiving weight information, the processor 270 may control the output unit to output content including the character 611.

Specifically, it is important to focus children in order to stably identify facial recognition and development information. Therefore, before receiving the weight information or before performing photographing using a camera, the processor controls the display unit 610 to display an image of the character 611 or activates a speaker to output sound such as music or voice. Can be controlled.

In this case, the processor may control the output unit to output content previously selected by the recognized person.

Specifically, the processor may receive an input for selecting content from a recognized person. In addition, the processor may store information on the content selected by the recognized person in the memory.

In addition, when a person included in the captured image is recognized, the processor may control the output unit to output content selected by the recognized person.

Meanwhile, the processor may store the recognized child's entry/exit time in the memory and transmit the recognized child's entry/exit time to the guardian's terminal.

Specifically, the processor uses a camera to photograph the front of the smart door, recognizes the child in the image using the image taken in the front of the smart door, and determines the time when the recognized child passes the smart door and enters the room. Can be transmitted to the terminal.

In addition, the processor uses a camera to photograph the rear of the smart door, recognizes the child in the image using the image taken from the rear of the smart door, and records the time when the recognized child passes the smart door and goes outdoors. Can be transferred to.

Meanwhile, when the recognized person belongs to the child group, the processor may control the door lock to unlock the smart door.

7 to 8 are diagrams for explaining an operation when a guardian is recognized.

The processor 270 may photograph a person and recognize a person included in the photographed image.

In addition, when the recognized person belongs to the guardian group, the processor 270 may perform an operation corresponding to the guardian group.

Specifically, when the recognized person belongs to the guardian group, the processor may call the caregiver of the child to which the recognized person is in the deungwon or the lower house.

Here, the child caregiver may mean a person in charge of childcare. For example, if a child belongs to a sunflower class, the child's caregiver may be a teacher of the sunflower class. In addition, when a guardian of a specific child is recognized, the processor may call a caregiver of a specific child that the guardian makes to the deungwon or the lower house.

Here, the call of the caregiver can be performed in a variety of ways.

Specifically, the processor may control the output unit to output a voice representing the child's caregiver.

In another embodiment, the processor may request communication from the terminal 300 of the child's caregiver.

8 is a diagram illustrating a scene in which a caregiver and a guardian of a child make a video call according to an embodiment of the present invention.

The processor may request a telephone connection to the terminal 300 of the child's caregiver. In addition, when the incubator's terminal 300 accepts the request for a telephone connection, the processor may perform a video call with the child's incubator's terminal 300.

In this case, the processor may output video and audio input from the nurse's terminal 300 through the output unit.

Meanwhile, when a door open command is received, the processor may control the door lock to unlock the smart door.

Specifically, the processor may receive a door open command through the input unit 230 and control the door lock to unlock the smart door.

In another embodiment, the processor may receive a door open command from the incubator's terminal 300 through the communication unit and control the door lock to unlock the smart door.

The following is a diagram for explaining an operation when a caregiver is recognized.

The processor 270 may photograph a person and recognize a person included in the photographed image.

In addition, when the recognized person belongs to the caregiver group, the processor 270 may perform an operation corresponding to the caregiver group.

Specifically, when the recognized person belongs to the caregiver group, the processor may store the recognized person's attendance time or leave time in the memory.

More specifically, the processor photographs the front of the smart door using a camera, recognizes the child in the image using the image taken in front of the smart door, and the time the recognized child enters the room through the smart door ( After the caregiver is recognized, the time the smart door was opened) can be stored in memory.

In addition, the processor uses a camera to photograph the rear of the smart door, recognizes the caregiver in the image using the image taken from the rear of the smart door, and the time the recognized caregiver passes through the smart door and goes outside (recognized by the After that, the time the smart door was opened) can be stored in the memory.

Meanwhile, when the recognized person belongs to the caregiver group, the processor may control the door lock to unlock the smart door.

The following describes the operation when the recognized person has not been previously registered.

9 to 11 are diagrams for explaining an operation when a recognized person is not previously registered.

The processor 270 may determine whether the recognized person has been previously registered.

Specifically, referring to FIG. 9, the processor 270 may determine whether a visitor has already been registered using the recognition result data obtained by capturing an image and recognizing a person included in the image and biometric data of the registered person. have.

In addition, when the recognized person is not previously registered, the processor may control the door lock to unlock the smart door when a door open command is received.

When a specifically recognized person is not previously registered, the processor may control the door lock to maintain the smart door in a locked state. In addition, when a door open command is received, the processor may control the door lock to unlock the smart door.

Meanwhile, referring to FIG. 10, the processor may control the display unit 610 to display an image inquiring about the purpose of the visit, or control the speaker to output a voice inquiring about the purpose of the visit.

Meanwhile, the processor may receive an input for a visit purpose from a recognized person. In addition, when the input purpose of the visit is to the House of Representatives, the processor may call a caregiver of the child designated by the recognized person.

Specifically, the processor may receive an input for designating a child together with an input for a visit purpose. In addition, when the purpose of the visit is the Deungwon or the House of Representatives, the processor may call a caregiver of the child designated by the recognized person.

In this case, the processor may request a telephone connection to the terminal 300 of the designated child's caregiver. In addition, when the incubator's terminal 300 accepts the request for a telephone connection, the processor may perform a video call with the child's incubator's terminal 300.

In this case, the child's caregiver can check who the recognized person is through a video call with the recognized person. For example, the caregiver can confirm that the recognized person is not registered in the smart door, but is the child's father. In this case, the caregiver can enter the order to open the door.

Meanwhile, when a door open command is received, the processor may control the door lock to unlock the smart door.

11 is a diagram for explaining another method of designating a child.

The guardian's terminal 100, which is not registered with the smart door, may transmit information designating the child and the house time to the smart door.

Meanwhile, the processor may receive an input for a visit purpose from a recognized person. In addition, when the input purpose of the visit is the House of Representatives and the time when the person is recognized is the House Time received from the terminal 100, the processor may call the caregiver of the child designated by the recognized person by using the information designating the child.

Referring back to FIG. 10, the processor may control the display unit 610 to display an image inquiring about the purpose of the visit, or control the speaker to output a voice inquiring about the purpose of the visit.

Meanwhile, the processor may receive an input for a visit purpose from a recognized person. And, if the input purpose of the visit is a general job, the processor can call a general employee who works in the childcare facility.

Here, the general job may mean a job other than a childcare job among jobs of a childcare facility.

In addition, the term general staff may mean an employee other than a child caregiver among employees of a childcare facility.

In this case, the processor can request a phone connection to the general employee's terminal. In addition, when the general employee's terminal 300 accepts the request for a phone connection, the processor may perform a video call with the general employee's terminal 300.

In this case, the general employee can check who the recognized person is through a video call with the recognized person and input a door open command.

Meanwhile, when a door open command is received, the processor may control the door lock to unlock the smart door.

Meanwhile, various operations corresponding to the group to which the recognized person belongs has been described.

However, when a door open command is received while performing an operation corresponding to a group to which the recognized person belongs, the processor may control the door lock to unlock the smart door.

For example, when a door open command is received while content including a character is output through the display unit, the processor may control the door lock to unlock the smart door.

For another example, when a door open command is received in a state in which the recognized person has not been previously registered and the recognized person has not entered the purpose of the visit, the processor may control the door lock to unlock the smart door.

Even when various functions are being performed due to visits by visitors such as children and guardians, the access of childcare workers, etc. should be made freely. Accordingly, according to the present invention, when a door opening command is received from a child caregiver or general staff of a childcare facility, the door opening function can be executed with the highest priority.

The following describes the operation method of the smart door.

A method of operating a smart door includes photographing a front of a smart door installed in a childcare facility for childcare, recognizing a person included in an image captured by the camera, and a group to which the recognized person belongs. It may include performing a corresponding operation. Here, the group may include a group of children who are nurtured in the childcare facility, a group of caregivers who take care of the child in the childcare facility, and a group of guardians who send the child to or from the childcare facility.

Here, performing an operation corresponding to a group to which the recognized person belongs may include performing an operation corresponding to a group to which the recognized person belongs when the recognized person is pre-registered.

On the other hand, performing the operation corresponding to the group to which the recognized person belongs may include, when the recognized person belongs to the child group, receiving weight information of the person from a weight sensor disposed in front of the smart door, and the It may include the step of acquiring key information of a person included in the captured image by using the image captured by the camera.

In this case, performing the operation corresponding to the group to which the recognized person belongs may further include transmitting developmental information including at least one of the weight information and the key information to the terminal of the guardian of the recognized person. I can.

Meanwhile, performing an operation corresponding to a group to which the recognized person belongs may further include controlling the output unit to output content including a character before receiving the weight information.

In this case, controlling the output unit to output content including a character may include controlling the output unit to output the content previously selected by the recognized person.

On the other hand, performing the operation corresponding to the group to which the recognized person belongs, when the recognized person belongs to the caregiver group, may include storing the recognized person's going to work or leaving time in a memory. have.

On the other hand, performing the operation corresponding to the group to which the recognized person belongs may include controlling the door lock to unlock the smart door when the recognized person belongs to the child group or the caregiver group. Can include.

The step of performing the operation corresponding to the group to which the recognized person belongs is, when the recognized person belongs to the guardian group, the recognized person calls the nursery of the child to be deungwon or the lower house, and a door open command is received. If so, it may include controlling the door lock to unlock the smart door.

Meanwhile, the method of operating the smart door may further include controlling the door lock to unlock the smart door when a door opening command is received when the recognized person is not previously registered.

On the other hand, when the recognized person is not already registered, controlling the door lock to unlock the smart door when a door opening command is received includes receiving an input for a visit purpose from the recognized person, and the visit purpose is the House of Representatives. In the case of, it may include calling a caregiver of the child designated by the recognized person, and controlling the door lock to unlock the smart door when the door open command is received.

Meanwhile, the method of operating the smart door may include controlling the door lock to unlock the smart door when a door open command is received while performing an operation corresponding to a group to which the recognized person belongs.

The present invention described above can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAM, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc. There is this. In addition, the computer may include the control unit 180 of the terminal. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

200: smart door

Claims (12)

In the smart door,
A door lock that locks or unlocks the smart door installed in a childcare facility for childcare;
A camera photographing the front of the smart door; And
Recognizing a person included in the image captured by the camera, and comprising a processor for performing an operation corresponding to the group to which the recognized person belongs,
The group is:
Including a group of children to be cared for in the child care facility, a group of carers for caring for the child in the child care facility, and a group of guardians who bring the child to or from the child care facility.
Smart door. The method of claim 1,
The processor,
When the recognized person is already registered, performing an operation corresponding to the group to which the recognized person belongs
Smart door. The method of claim 1,
Further comprising a communication unit,
The processor,
When the recognized person belongs to the child group, the person included in the captured image by receiving the weight information of the person from the weight sensor disposed in front of the smart door, and using the image captured by the camera To obtain the key information of
Smart door. The method of claim 3,
The processor,
Transmitting development information including at least one of the weight information and the key information to the terminal of the guardian of the recognized person
Smart door. The method of claim 3,
Further comprising an output unit,
The processor,
Before receiving the weight information, controlling the output unit to output content including a character
Smart door. The method of claim 5,
The processor,
Controlling the output unit to output the content previously selected by the recognized person
Smart door. The method of claim 1,
The processor,
When the recognized person belongs to the caregiver group, storing the recognized person's attendance time or leave time in a memory
Smart door. The method of claim 1,
The processor,
When the recognized person belongs to the child group or the caregiver group, controlling the door lock to unlock the smart door
Smart door. The method of claim 1,
The processor,
When the recognized person belongs to the guardian group, the recognized person calls a caregiver of the child to be deungwon or lowered,
When a door open command is received, controlling the door lock to unlock the smart door
Smart door. The method of claim 2,
The processor,
When the recognized person is not previously registered, controlling the door lock to unlock the smart door when a door open command is received
Smart door. The method of claim 10,
The processor,
Receives an input of the purpose of visit from the recognized person, and when the purpose of visit is the House of Representatives, calls a caregiver of the child designated by the recognized person,
When the door open command is received, controlling the door lock to unlock the smart door
Smart door. The method of claim 1,
The processor,
When a door open command is received while performing an operation corresponding to the group to which the recognized person belongs, controlling the door lock to unlock the smart door
Smart door.

Images