KR102076289B1 - System and method for providing images of visitor in iot enviornment - Google Patents

Abstract

In a method of providing visitor image information in an IOT environment, performed by an IOT gateway, according to an embodiment of the present invention, (a) when connected to an IOT gateway based on driving of a real-time smart device, the terminal for the smart device Generating identification information and storing access time; (b) searching for a smart device connected to the IOT gateway based on the terminal identification information when receiving the visit signal from the doorbell; And (c) providing a video of the visitor input through the door bell to the smart device identified as the most recently used by the user among the searched smart devices, wherein the IOT gateway is located within a preset space from the IOT gateway. It may be a method of connecting with the device.

Description

Method and system for providing visitor image information in IOT environment {SYSTEM AND METHOD FOR PROVIDING IMAGES OF VISITOR IN IOT ENVIORNMENT}

The present invention relates to a method and system for providing visitor image information in an IOT environment. In detail, the system according to the present invention relates to a technology for transmitting a doorbell screen to a device that is used by a user among smart devices managed by being connected to an IOT gateway when the doorbell is triggered.

Door bells are generally signaling devices that are placed near the entrance of a building. With the development of technology, doorbell systems have recently evolved into wireless doorbell technology that does not require physical wiring.

Accordingly, the door bell is located at the starting point of the space, and the situation is attracting attention as an optimal device for extending the IOT environment in that the wireless technology can be used without any problems.

Currently, many papers propose smart doorbells, but the development of doorbell systems based on user behavior is insufficient. This is because excessive processing is not possible due to the limitation of the doorbell's internal resources, and there is a lack of storage for data management.

The most prominent doorbell models on the market today include mobile access, HD cameras, motion detection and night vision, which help users to check doorbells.

Nevertheless, the smart doorbell system on the market does not consider the detailed processing functions due to the resource limitations.

Korean Patent Publication No. 10-2014-0109683 (Invention name: Smart digital door lock system with a black box function)

In order to solve the above-mentioned problems, the present invention photographs a visitor detected through a pushbutton and an ultrasonic sensor, and transmits the doorbell image to a smart device recently used by the homeowner.

In addition, if there is no person in the visit place, it is an object to implement to transmit the image preferentially to the smartphone of the pre-registered home owner.

At this time, all devices provided in the same space are managed based on the smart IOT gateway in the space so that they can be adapted to the IOT environment from the system design stage.

Technical means for achieving the above technical problem, according to an embodiment of the present invention, performed by the IOT gateway, the visitor image information providing method in the IOT environment, (a) based on the real-time driving of the smart device When connected to the IOT gateway, generating terminal identification information for the smart device and storing the access time; (b) searching for a smart device connected to the IOT gateway based on the terminal identification information when receiving the visit signal from the doorbell; And (c) providing a video of the visitor input through the door bell to the smart device identified as the most recently used by the user among the searched smart devices, wherein the IOT gateway is located within a preset space from the IOT gateway. It may be a method of connecting with the device.

In another embodiment, a visitor image information providing apparatus in an IOT environment, wherein a visitor image received from a camera module included in a doorbell is stored, and a program for implementing the visitor image information providing method in an IOT environment is provided. And a processor configured to execute the stored memory and a program stored in the memory to execute the visitor image information providing operation in the IOT environment. When the processor is connected to the IOT gateway based on the driving of the real-time smart device, the terminal identification information for the smart device is included. If the user generates a connection and stores the access time and receives a visit signal from the doorbell, the IOT gateway searches for the smart device that the user is using based on the terminal identification information, and if the user is using the smart device as a result of the search, the smart It may be a device for connecting the device and the doorbell.

According to the above-described problem solving means of the present invention, the visitor detected through the push button and the ultrasonic sensor is photographed, and the doorbell image is transmitted to the smart device recently used by the homeowner.

In addition, when there is no person at the visited place or there is no smart device used within a preset time, it may be implemented to transmit an image by first selecting a smartphone of a pre-registered homeowner.

Conventionally, many researches suggest smart doorbells, but most of the doorbell device's own resources are limited in design, and thus, IOT communication, control, and data management cannot be performed.

Therefore, the conventional doorbell for smart space platform is difficult to manage data, and proposed a doorbell-based IOT platform for smart space to solve this problem.

The proposed platform separates the management system of the streaming device from the general device in the platform, and efficiently processes the streaming data generated by the doorbell device using the IOT gateway.

In addition, a new message transmission method can be devised to reduce the IOT gateway load that may be caused by streaming data.

Implement the platform proposed in the present invention through a test bed, it can prove that the doorbell-based IOT platform for smart space is suitable for the smart ubiquitous environment.

1 is an exemplary view showing a network connection configuration of a smart doorbell system according to an embodiment of the present invention.
2 is a view showing the structure of a smart doorbell system according to an embodiment of the present invention.
3 is a flowchart illustrating a message transmission method between a smart doorbell and a device according to an embodiment of the present invention.
4A to 4D are diagrams illustrating each step of streaming data transmission according to an embodiment of the present invention.
5 is a diagram illustrating a device management table according to an embodiment of the present invention.
6 is a flowchart illustrating a method for providing visitor image information in an IOT environment according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, without excluding other components, unless specifically stated otherwise, one or more other features It is to be understood that the present disclosure does not exclude the possibility of adding or presenting numbers, steps, operations, components, parts, or combinations thereof.

The following examples are detailed description to aid in understanding the present invention, and do not limit the scope of the present invention. Therefore, the invention of the same scope performing the same function as the present invention will also fall within the scope of the present invention.

In the smart doorbell system of the present invention, the visitor image information providing system in the IOT environment implements an endpoint, middleware, and cloud computing functions, thereby performing the corresponding function.

Raspberry Pi is used to implement this, a low-spec device, but optimized for implementing basic processing, allowing doorbell switches to be connected via GPIO and behave like traditional doorbells. Raspberry Pi also has the flexibility to connect to Ethernet, wi-fi, or 3G and 4G data, allowing doorbells to be placed outside the home or at the door.

In addition, the doorbell system based on user behavior in the smart space IOT environment can be stored as a standalone device including a camera, and when the doorbell operates, it will have a streaming server through VNC.

Smart TVs will use Kodi open source software and can be provided in picture-in-picture mode (PIP) mode, in case the doorbell screen is turned on through the smart TV. The PIP screen displays the image processing result processed by the IOT gateway and can check whether the correct recognition value is delivered to the user.

If the user determines that the screen does not need to be turned on, the user may transmit a doorbell screen to another device by pressing a button. Due to the limitation of using minimal space due to the characteristics of smart TV, the function is used to notify who the person is by overlaying the PIP screen.

On the other hand, the IOT gateway manages all resources and implements the image processing so that the platform can operate for the smart space. For basic data communication, IOTivity framework is used, which utilizes resource searching and CoAP-HTTP proxy functions.

Additional sources are added to manage the doorbell's streaming server data and enable seamless communication with external clouds and the cloud. The gateway will also use an access point, laptop and Ubuntu as a base.

The face detected through the doorbell is used to generate relationship data with pre-stored data and to identify the location of the user or to determine whether it is a criminal. Cloud computing will install Linux on GCP and provide the computing power required for doorbell-based platforms.

GCP provides external IP, and the relational data created at the IOT gateway is transmitted to the database inside GCP via HTTP.

In addition, when the IOT gateway requests relationship data by establishing a server-client relationship with the IOT gateway, the third party authentication transmits the relationship data suitable for the corresponding IOT gateway.

1 is an exemplary view showing a network connection configuration of a smart doorbell system according to an embodiment of the present invention.

The doorbell system based on user behavior in the smart space IOT environment solves the problems of the conventional doorbell system and is designed for a smart space.

In the present invention, the person recognized by the doorbell is first analyzed in comparison with a third party database, and if there is a screen among devices managed in the space, the doorbell image is transmitted to the smart device used until recently.

If the device is not operating, the user assumes that the doorbell is not present in the space where the doorbell is installed, and transmits the image to the smartphone so that the user can check the visit trail later. In addition, even when the user does not check the image, the log is transmitted to the smartphone along with the image of the visitor photographed for a predetermined time.

Referring to FIG. 1, a connection configuration of a network may include an IOT gateway 100, a user device (smart device), and a doorbell 300. At this time, the smart device 200 may be supported by a variety of devices.

In the present invention, to reduce the mutual communication of the network connection, and to increase the accessibility from the outside will have a configuration as shown in the figure.

According to one embodiment of the invention, the doorbell 300 is able to solve the limited performance problem due to the limited process through the distribution, the IOT gateway 100 is disposed between the user device and the endpoint (Endpoints) door The work done by the bell 300 is minimized.

In addition, various smart devices (that is, the smart device 200) may be simultaneously connected through the IOT gateway 100. For example, a desktop, a laptop, a smart TV, a smart phone, etc. may be connected with the IOT gateway 100 to receive data generated by the doorbell 300.

2 is a view showing the structure of a smart doorbell system according to an embodiment of the present invention.

Referring to FIG. 2, the system is divided into endpoints, middleware, and cloud computing.

In general, the endpoint refers to a device that a user or visitor, such as CCTV, smart device 200, door bell 300 access or use. In the case of the smart device 200, the device name, model number, hardware type, device type, version, type, and timestamp are locally connected to the sensor value, thereby generating measurement metadata.

A request for obtaining sensor metadata may be performed through the interface of the smart device 200 or may be pushed to the south interface of the IOT gateway 100.

Therefore, in the data retrieval phase, you must keep records of these endpoints. In addition, addition or deletion of devices and endpoints may inform via push to the IOT gateway 100 to properly update its internal database and configuration.

When the smart device 200 is first added, the configuration list is transmitted to the IOT gateway 100 and stored in a local database. The doorbell 300 also performs such basic data processing and supports a streaming server.

The IOT gateway 100 manages a list of all streaming servers. Managing lists in this way separates the processing required at the administrative level and the processing required at the subordinate level so that the Server-Client part can be clearly distinguished.

Middleware refers to computer software that provides a service that can be additionally used in addition to the service provided by the smart device 200.

Application software should be flexible, easy to scale up and scale out, and designed to meet these strengths so that developers do not have to rebuild platforms across different platforms.

In this case, the middleware may be composed of a south interface, an image processing part, a database, and a data processing part CoAP-HTTP proxy part.

The south interface may be an interface that is responsible for communication between the endpoint described above and the IOT gateway 100. This interface creates a network between the smart device and the IOT gateway 100 using CoAP, and opens the necessary socket when the IOT gateway 100 searches for the device.

The database is a space in which the smart device 200 stores data necessary for all processing processed by the IOT gateway 100, and means a place where data is temporarily passed for rapid processing of the processing. Representatively stored data may temporarily store the measurement data, the user device list, the doorbell image generated by each smart device 200, and the image for a predetermined time (about 5 seconds) generated by the doorbell 300. Can be.

CoAP-HTTP proxy may be a proxy required to connect the network and the Internet for the connection of the smart device 200 and the GCP.

Image processing may be a process of checking whether the picture is correct (that is, the person stored in advance) by comparing the picture generated by the doorbell 300 with the picture stored in the cloud.

The image processing part extracts a person or smart device 200 from a photo, and compares and analyzes the data stored in the cloud with a registered device.

3 is a flowchart illustrating a message transmission method between a smart doorbell 300 and a device according to an embodiment of the present invention.

Referring to Figure 3, Figure (a) shows a conventional message transmission method, Figure (b) may mean a message transmission method proposed by the present invention.

Looking at the conventional method (a), it has been implemented separately for each step of transmitting a message. This method should continue to send a get message when multiple devices are connected.

Therefore, the present invention incorporates the above-described steps as a way to improve the behavior and problems of the user.

Looking at Figure (b), the advantage of integrating the two tasks is that the get message, the assignment, and the transmission of the task data can be performed at once.

However, in this case, since it is difficult to grasp the exact state, the present invention gives the meaning of the message value to accurately distinguish the state. In this case, the method of assigning a meaning is to implement a message value using a number rather than a language.

4A to 4D are diagrams illustrating each step of streaming data transmission according to an embodiment of the present invention.

First, referring to FIG. 4A, a device registration step may be checked.

The step begins by registering the smart device 200 in the user device management table. When a user device first accesses the IOT gateway 100, the IOT gateway 100 regards the device as a smart device and registers the user device in the user device management table.

For example, suppose there are laptops, desktops, smart TVs, and smartphones in the current smart space (the space the user is using). When the smart device 200 connected to the IOT gateway 100 for the first time is a laptop, the device management table ID 1, the trigger number 2, and the device URI become a laptop. The trigger number assigns 2 to the sum of the ID of the laptop and the device currently managed by the gateway 100.

The device URI records URI information already defined in the smart device 200. If the desktop, smart TV and smartphone are additionally connected to the IOT gateway 100 after the laptop, the laptop ID is 1, the desktop ID is 2, the smart TV ID is 3, and the smartphone is assigned to 4. The trigger number is 4 depending on the total number of user devices currently managed, so that the laptop 5, smart TV 6, and smartphone 8. In this case, the Device URI is generated by referring to a URI already registered in the user device.

Looking at Figure 4b, it can be seen the Observation step.

In this step, the IOT gateway 100 transmits the ID value of the smart device 200 most recently used through broadcast, and the ID value transmitted through the broadcast of the IOT gateway 100 is used for all currently managed smart devices. Is passed to 200.

At this time, if the smart device 200 receives the ID value normally (?), The smart device 200 transmits an ACK message to the IOT gateway 100.

The IOT gateway 100 receiving the ACK message from the smart device 200 records the ACK message in the confirmation field of the user device management table, and the smart device 200 managed by the IOT gateway 100 does not normally send an ACK. Check whether there is a device that does not. If there is a device that does not transmit an ACK, the IOT gateway 100 records the NAK in the confirmation field of the device and activates the error handler.

Referring to FIG. 4C, a streaming data transmission step may be identified.

When the doorbell 300 operates in the corresponding step, the streaming data of the doorbell 300 is transmitted to the smart device 200 which is most recently used by the user or lastly used by another expression.

When a person is detected in front of the doorbell 300, the doorbell 300 transmits a trigger message to the IOT gateway 100 as an end message. The IOT gateway 100 receiving the trigger message checks the user device status table and the management table, and checks the ID value of the smart device 200 last used in the previous status table.

Next, the trigger number corresponding to the ID value confirmed in the state table of the device management table is broadcast to all user devices.

For example, assuming that the doorbell 300 is triggered, when the last smart device 200 used is a laptop, the user device management table checks a column corresponding to ID 1 of the laptop. At this time, when the check is completed, the trigger number of ID 1 is identified, and a trigger number message is broadcast to each smart device 200 using the status check mechanism.

The smart device 200 receiving the trigger number message checks whether the number matches the trigger number, and if the number matches the trigger number of the user, the function of the smart device 200 corresponding to the trigger number is performed, and the remaining smart device ( 200 deletes the trigger number.

In addition, at the same time the doorbell 300 will terminate the connection to the streaming server of the smart device 200. Upon receiving the user device ID value of another user, the IOT gateway 100 checks the ID value of the smart device 200 in the user device management table, and matches the trigger number of the ID value of the smart device 200 with the existing message. Send in the same message.

For example, suppose a user using a laptop sends doorbell streaming data to a smart TV, the laptop sends ID 3 to the IOT gateway 100 and terminates the streaming connection.

As shown in the figure, the IOT gateway 100 checks the number of triggers corresponding to ID 3 in the user device management table.

Here, the trigger number of the smart TV is transmitted to all terminals managed through the IOT gateway 100, the smart device 200 corresponding to the trigger message performs the access function for the doorbell 300 server, The other smart device 200 deletes the message 7.

Here, the exception is that when the smart device 200 used by the user is not the smart phone, the smart phone connects to the streaming server only in step 4. Sending the message again disconnects the streaming server if the smartphone does not reconnect to the streaming server and exits the streaming browser application.

Referring to FIG. 4D, the streaming data sharing step is illustrated.

5 is a diagram illustrating a device management table according to an embodiment of the present invention.

Referring to the table (a), the device management table is composed of the URI, ID, and trigger number of the device currently managed by the IOT gateway 100, and the numbers recorded in the table are used to distinguish jobs as described above. do.

The IOT gateway 100 has data for all devices through a table. When the proposed IOT gateway 100 performs a registration operation, an ID value of each smart device 200 is transmitted as an ACK message.

When the IOT gateway 100 performs an operation, the device transmits a trigger number in the ACK message.

The trigger number means each ID and becomes a number unique to each smart device 200. In addition, the IOT gateway 100 that knows the total number of devices allocates the number of triggers plus the total number of devices to the ID value of each device, and when the ID is received, the IOT gateway 100 determines that registration has been performed. do.

In addition, when the trigger number is received, each smart device 200 compares the trigger number with the trigger number received from the IOT gateway 100, and when the numbers match, the corresponding device functions as the doorbell 300. Do this.

Referring to table (b), as a detailed example of how the system delivers the message, the table records the last used smart device 200, and is composed of an ID, device URI, and time log fields. Can be.

The ID and URI fields are the same as the ID and device URI fields of the user device management table, and the time log field indicates the time when the user last used the smart device 200.

6 is a flowchart illustrating a method for providing visitor image information in an IOT environment according to an embodiment of the present invention.

Referring to FIG. 6, first, terminal identification information of the smart device 200 connected to the IOT gateway 100 is generated (S610).

In detail, when connected to the IOT gateway 300 based on the smart device 200 being driven in real time, the terminal identification information for the smart device 200 is generated and the access time is stored.

At this time, the terminal identification information includes at least one of an ID and a trigger number, the ID is composed of a number based on the order in which the smart device 200 is connected to the IOT gateway 100, the trigger number corresponds to the ID and ID. It is composed of the sum of the total number of devices of the same type as the smart device 200.

At this time, in a further embodiment, if the terminal identification information is configured as a trigger number, the terminal identification information for the smart device 200 is updated at each preset time period, and the terminal identification information is automatically generated for the unused smart device 200. Can be organized into

When the doorbell 300 generates a visit signal by the visitor and the IOT gateway 100 receives the visit signal, the doorbell 300 searches for the smart device 200 being used by the user (S620).

That is, when the IOT gateway 100 receives the visit signal from the doorbell 300, the smart device 200 connected to the IOT gateway 100 is searched based on the terminal identification information.

The IOT gateway 100 searches for the smart device 200 that is being driven in real time based on the terminal identification information, and determines the smart device 200 most recently connected to the IOT gateway 100 based on the access time.

Based on the result of the search in step S620, the doorbell and the smart device are connected, and an image generated from the doorbell is provided (S630).

That is, the smart device 200 which is identified as the most recently used by the user among the smart devices 200 searched through step S610 is to provide an image of the visitor input through the door bell 300.

At this time, if not connected to the recently used smart device 200, the connection with the smart device 200 used as a lane is performed.

In addition, the IOT gateway 100 collects the image received in real time from the doorbell and delivers it to the smart device 200, but recognizes the visitor's face included in the image, and compares it with the face of the person information stored by the user. If there is a matching value, the person information may be transmitted to the smart device 200, and if there is no matching value, a warning message may be generated and transmitted to the smart device 200.

At this time, in a further embodiment, if there are a plurality of smart devices 200 that the user is using in real time, the user may further provide an option to be connected to the doorbell 300 in plurality. For example, the doorbell 300 may be connected to people who are simultaneously using a computer or a smart TV.

In order to implement this, the IOT gateway 100 is connected to the smart device 200 connected to the door device 300 first among the plurality of smart devices 200 that the user is using in real time. It provides a connection question to ask, and allows the doorbell 300 and the smart device 200 to be connected in plurality depending on whether or not the reply.

In addition, when the IOT gateway 100 receives a switch request of a device from a specific smart device, the IOT gateway 100 may provide an image of the doorbell 300 to the smart device 200 that is the target of the switch request.

However, if the smart device 200 is not found in the search result of step S620, the IOT gateway 100 determines that the user is absent, and the door bell 300 generates a visit signal from the door bell 300. Afterwards, the user receives a picture of the visitor during the preset time.

Even in this case, as shown in step S630, the visitor's face is included in the image and the result of the matching is included in the visitor image by comparing with the face of the previously stored person information.

After that, the visitor image is to be delivered to the smartphone pre-registered in the IOT gateway 100. This way, even if you are away from home, you will be able to see and stay in touch with people who visited you remotely.

The apparatus and method for providing interior material order information registration and quotation service according to the embodiment of the present invention described above may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Can be. Such recording media include computer readable media, and computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media includes computer storage media, which are volatile and nonvolatile implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. , Both removable and non-removable media.

The above description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

100: IOT gateway 200: smart device
120: door bell

Claims (13)

In the method for providing visitor image information in an IOT environment, performed by an IOT gateway,
(a) generating a terminal identification information for the smart device and storing an access time when connected to an IOT gateway based on driving of a real-time smart device;
(b) searching for the smart device connected to the IOT gateway based on the terminal identification information when receiving a visit signal from a doorbell; And
(c) providing an image of a visitor input through the doorbell to the smart device which is identified as the most recently used by the user among the searched smart devices;
The IOT gateway is connected to a smart device located within a predetermined space from the IOT gateway,
Step (c) is
If it is not connected to the recently used smart device, and performs the connection with the smart device used in the lane,
If the smart device connected to the IOT gateway is not found, the IOT gateway determines that the user is absent,
(c-1) receiving a visitor image from the doorbell;
(c-2) delivering the visitor image to a smartphone that is pre-registered in the IOT gateway;
The visitor image is an image of photographing the visitor for a predetermined time after the doorbell generates the visit signal, the visitor image information providing method in an IOT environment. The method of claim 1,
The terminal identification information is
At least one of an ID and a trigger number,
The ID is composed of numbers based on the order in which the smart device is connected to the IOT gateway, and the trigger number is configured by the sum of the total number of devices of the same type as the smart device corresponding to the ID and the ID. A method for providing visitor image information in an IOT environment. The method of claim 1,
Step (b)
Search for the smart device running in real time based on the terminal identification information,
And determining the smart device most recently connected to the IOT gateway based on the access time. The method of claim 1,
Step (c) is
Collect the real-time image received from the doorbell to pass to the smart device, recognize the visitor's face included in the image,
If there is a matching value compared to the face of the user information previously stored, the matching person information is transmitted to the smart device together, visitor image information providing method in an IOT environment. The method of claim 4, wherein
If there is no value matching the face of the person information, a warning message is generated and delivered to the smart device, visitor image information providing method in an IOT environment. delete delete The method of claim 1,
After (c-1) above
The IOT gateway recognizes the visitor's face included in the visitor image,
The visitor image information providing method in an IOT environment, which includes a result of whether a match is included in the visitor image in comparison with the face of person information previously stored by a user. The method of claim 1,
Step (c) is
If there is a plurality of smart devices that are being used by the user in real time, providing a plurality of options that can be connected to the doorbell, visitor image information providing method in an IOT environment. The method of claim 9,
The IOT gateway provides a connection question that asks whether the smart device connected to the doorbell is connected to the first smart device among the plurality of smart devices that the user is using in real time.
The doorbell is to allow a plurality of connection with the smart device in response to the connection question, Visitor image information providing method in an IOT environment. The method of claim 1,
The IOT gateway provides an image of the doorbell to the other smart device when a request for switching the device is received from another smart device when the doorbell image is provided to a certain smart device. How to provide visitor video information. In the apparatus for providing visitor video information in an IOT environment,
A memory storing a visitor image received from a camera module provided in the doorbell and a program for implementing a method of providing visitor image information in an IOT environment;
And a processor configured to execute a program stored in the memory to execute visitor image information providing operation in an IOT environment.
The processor is
When connected to the IOT gateway based on the driving of the real-time smart device, generating the terminal identification information for the smart device and storing the access time, and receiving the visit signal from the doorbell, the IOT gateway is based on the terminal identification information. Search for the smart device being used by the user, and if the user is using the smart device as a result of the search, perform the connection between the smart device and the doorbell,
The processor is
If it is not connected to the recently used smart device, and performs the connection with the smart device used in the lane,
If the smart device connected to the IOT gateway is not searched, the IOT gateway determines that the user is absent, receives the visitor image from the doorbell, and transfers the visitor image to the smartphone that is previously registered with the IOT gateway. And the visitor image is an image of photographing the visitor for a preset time after the doorbell generates the visit signal. The method of claim 2,
If the terminal identification information is configured with the trigger number, the terminal identification information for the smart device is updated every predetermined time period, visitor image information providing method in an IOT environment.

Images