KR102107688B1 - System for notifying user's belongings using camera and smart floor and method thereof - Google Patents

Abstract

The present invention discloses a user's belongings guiding system and a user's belongings guiding method for identifying belongings by using video data of a camera for users and belongings sensed by a smart floor, and guiding change information of the identified belongings. The user's belonging guide system according to the present invention includes: a smart floor unit for sensing object data including a contact area and a weight of an object using a pressure sensor; A camera unit that photographs an object; And a home gateway unit that receives the object data from the smart floor unit, receives the image data at the object location through the camera unit, and compares and analyzes the object data and changes in the image data to identify the user's belongings. According to the present invention, it is possible to guide the changed belonging information to a user accessing the area of the smart floor.

Description

System for notifying user's belongings using camera and smart floor and method thereof

The present invention relates to a user's belongings guiding technology, and more particularly, to a user's belongings guidance system and a user's belongings guiding method for informing a user's belongings using information collected through a smart floor and a camera.

The smart floor or digital floor has a sensor, and a sensor can recognize an object on the floor. When the smart floor is installed on the floor surface, a user can identify a weight, a moving position, etc. by detecting a pressure change on a floor or a user.

The following patents related to the technology of smart flooring disclose a multifunctional digital floor system and control method. The digital floor system identifies the user using the RFID signal of the user who has the RFID tag, and detects the user's weight to recognize location movement and behavior. In addition, the digital floor system controls the surrounding electronic devices by processing the identified user and the recognized behavior as control commands.

Here, the digital floor system is only to identify the user and the user's behavior, and does not identify the user's belongings. To identify the user's belongings, when the user puts the belongings on the floor with the belongings in place, the smart floor recognizes the decrease in the user's weight and at the same time recognizes the increase in the weight of the belongings at the location where the belongings are placed, and the belongings The ability to compare whether the total weights before and after laying down are the same should be added. However, even if the above function is added, the smart floor only recognizes the existence of belongings and it is impossible to identify what the object is.

Korean Registered Patent 10-1150522

The present invention was created under the recognition of the prior art as described above, and the user's belongings that detect the belongings according to the amount of weight change of the user on the smart floor and identify the belonging information by using the image where the weight change is detected. It is an object of the present invention to provide a guide system and a method for guiding a user's belongings.

Another object of the present invention is to collect the information of the identified user and belongings and store them as the user's possession pattern information, and compare the belongings of the access user with the belongings of the previously stored possession pattern information to guide the changed belongings to the user. .

A user's belonging guide system using a smart floor and a camera according to the present invention for achieving the above technical problem includes: a smart floor unit for sensing object data including a contact area and weight of an object using a pressure sensor; A camera unit for photographing the image of the object; And a home gateway unit that receives the image data of the object location through the camera unit when the object data is received from the smart floor unit, and compares and analyzes the object data and changes in the image data to identify the user's belongings. .

In the present invention, the home gateway unit, the user's belonging guidance system, characterized in that receiving the object data including the contact area, weight, each change amount and position of the object detected in real time from the smart floor.

Here, the home gateway unit stores object data of the user object as user identification information, and when receiving object data from the smart floor unit, compares the user identification information to identify the user in real time.

Furthermore, the home gateway unit identifies a user and belongings using at least one of an object contact area, weight, and image data.

In addition, when the user is identified from the newly generated object data, the home gateway unit determines that the user has entered, and determines that the user has exited when the identified object data of the user is destroyed.

Here, the home gateway unit receives the object data of the first object whose weight has increased from the smart floor unit, and when the weight of the user object decreases by the weight of the increased first object, the user has the first object as belongings. It is judged to be put down. In addition, when the home gateway unit detects the weight reduction of the second object from the smart floor, and when the weight of the user object increases by the weight of the reduced second object, the user determines that the second object is in possession.

According to an aspect of the present invention, the home gateway unit detects a change in weight of the object data, requests the image of the object by transmitting the position of the detected object to the camera unit, and the image data before and after the weight is changed. Is stored by comparing and analyzing the changed image data as belonging identification information.

Here, the home gateway unit stores the identified user's belongings in association with the information of the user, access classification and time, and increases the frequency every time information of the user, access classification, time zone and belongings determined to be the same is stored. To save.

In addition, the home gateway unit, when the user enters or exits, inquires the belonging information of the corresponding access category and time zone, and guides the change information of the belongings that is different from the stored belonging information.

Preferably, the user's belonging guide system further includes an output terminal unit, and when the home gateway unit transmits the change information of the belongings to the output terminal unit, the change information of the belongings is output to the output terminal unit.

Here, the home gateway unit stores information of belongings carried by the user when the user leaves, and compares information of belongings possessed by the user when the user enters with information about the belongings possessed when the user enters and guides the change information of the belongings.

Moreover, the home gateway unit receives and stores weather information, and guides belonging information related to weather, including an umbrella, a hat, and sunglass.

According to another aspect of the present invention, the user's belonging guidance system includes: a user identification information management unit that receives and stores a contact area and weight for a user on the floor surface; An object data receiving unit that receives object data including a contact area and weight with respect to an object on the floor surface; A user identification unit that identifies the user by comparing the received object data with stored user identification information; A user behavior determination unit that determines whether a user lifts a belonging or puts the belonging down using a change in weight of the object data; A user belongings identification unit for requesting image data by transmitting the position of the object whose weight has changed, and real-time identification of the user's belongings detected by comparing and analyzing the change of the image data; A user possession pattern management unit that stores the identified belonging information in correspondence with information of a user, access classification and time; And a modified belongings providing unit for inquiring the belongings information corresponding to the information of the user of the identified belonging, access classification, and time, and comparing the identified belonging information with the inquired belonging information to transmit the changed belonging information to the designated output terminal. Home gateway devices.

A method for guiding a user's belongings using a smart floor and a camera according to the present invention for achieving the above technical problem is a method for guiding a user's belongings executed by a home gateway device that identifies a user's belongings, from (a) a smart floor. An object data receiving step of receiving object data including the contact area and weight of the object; (b) an object image receiving step of requesting an image of the object with a camera and receiving image data; (c) a user belongings identification step of analyzing the image data to identify the user's belongings where an image change occurs; (d) a change belongings determining step of inquiring the user's belongings information previously stored corresponding to the identified belongings information and comparing the identified belongings information with the inquired belongings information to determine the changed belongings; And (e) a change belonging guide step of transmitting the changed belonging information to the designated terminal for user guidance.

According to an aspect of the present invention, in the process of recognizing the user and the goods through the smart floor, the user's belongings are identified by using the image of the camera, and when the user's habitual belongings are different from the user's habitual belongings, the changed personal information is guided to the user Convenience service can be provided.

According to another aspect of the present invention, the user may be able to guide belongings missed, additional belongings, and personal belongings having a difference at the time of entry and exit, and weather-related belongings in advance according to the weather.

The following drawings attached to the present specification illustrate preferred embodiments of the present invention, and serve to further understand the technical idea of the present invention together with the detailed description of the invention described below, and thus the present invention is described in such drawings. It should not be interpreted as being limited to.
1 is a schematic configuration diagram of a user's belonging guidance system according to an embodiment of the present invention.
2 is a schematic internal structural diagram of a home gateway according to an embodiment of the present invention.
3 is an exemplary diagram of user's belonging data stored by a home gateway according to an embodiment of the present invention.
4 and 5 are exemplary views of a situation in which a user enters and exits according to an embodiment of the present invention.
6 is a schematic flowchart of a method for guiding a user's belongings according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, the terms or words used in the present specification and claims should not be construed as being limited to ordinary or lexical meanings, and the inventor appropriately explains the concept of terms to explain his or her invention in the best way. Based on the principle that it can be defined, it should be interpreted as meanings and concepts consistent with the technical spirit of the present invention.

Therefore, the embodiments shown in the embodiments and the drawings described in this specification are only the most preferred embodiments of the present invention and do not represent all of the technical spirit of the present invention. It should be understood that there may be equivalents and variations.

1 is a schematic configuration diagram of a user's belonging guidance system 1 according to an embodiment of the present invention.

The belongings guidance system 1 according to an embodiment of the present invention is constructed based on a wired or wireless network, and includes a smart floor 2, a smart floor 2, which detects the weight and contact area of an object on the floor surface. It comprises a camera (4) that transmits the image data of the object by photographing the area of the home floor (3) and the smart floor (2) to identify users and belongings using the data received from the camera (4).

The wired and wireless networks in the present invention typically cover all communication networks capable of data communication using various protocols such as a Wi-Fi network, a wired network such as the Internet, a wireless public network or a dedicated network.

The smart floor 2 is a flooring material that is constructed on the floor surface and detects contact area, weight, and location information of an object contacting the floor surface as object data through a plurality of pressure sensors. Here, the contact area is a concept including a contact area or a contact shape. The object may be a stationary body (eg, an object) or a moving object (eg, a person). When the moving object moves on the floor surface, the smart floor 2 may track the moving direction and the moving path using the detected object data. When the user enters the area of the smart floor 2 (eg, entry), the user's object data is generated and detection proceeds. When the user exits the area of the smart floor 2 (eg, exits), the user's object Data detection ends. The smart floor 2 transmits the object data detected in the floor area to the home gateway 3.

The home gateway 3 is a terminal device that receives object data from the smart floor 2. The home gateway 3 may include a processor, an input device, a screen output device, an audio output device, a storage device, and a communication device. The home gateway 3 may be connected to other automation equipment installed in a home or building (for example, an access system, a video system, a power system, a gas system, etc.) to control input / output and command processing of data.

Here, the change of the object data may be detected by the smart floor 2 or the home gateway 3. For example, the smart floor 2 may transmit object data including a change amount. Then, the home gateway 3 may identify whether the currently received object data is increased data or reduced data. Alternatively, after receiving the object data, the home gateway 3 may determine whether the object data is increased or decreased by comparing the received value immediately before the corresponding location.

In addition, when the home gateway 3 receives the entry information from the access system or receives new object data from the smart floor 2, it is possible to identify the user's entry. After the user enters the home gateway 3, whenever the user puts down his belongings, the home gateway 3 receives object data whose weight is reduced. In addition, when the home gateway 3 receives the exit information from the access system or the object data that is destroyed from the smart floor 2, it is possible to identify the user's exit. Whenever a user preparing for exit hears belongings, the home gateway 3 receives the object data whose weight is increased, and when the user leaves, the home gateway 3 receives the object data's disappearance value. Accordingly, the home gateway 3 receives object data from the smart floor 2, and when the weight of the identified user increases, the home gateway 3 may determine that the user has lifted the object. On the other hand, when the weight of the identified user decreases, the home gateway 3 may determine that the user has put down the object.

The camera 4 transmits an image photographed through a built-in communication device to the home gateway 3 as at least one photographing equipment installed to photograph the upper space of the smart floor 2.

Here, the home gateway 3 can grasp the presence or absence of belongings using the change in weight of the object data, but cannot determine what the belongings are. However, if the image data before and after the point in time when the object data is changed is compared, the home gateway 3 can identify the belongings and determine whether the user has carried the belongings or not. When the image data before and after the time when the weight increase or decrease occurs using the time information and the location information of the image data photographed by the camera 4, a difference image object may be identified as belongings. Identification of belongings using comparative analysis of image data can be handled by the imaging system or the home gateway (3). When at least one belonging is identified, the home gateway 3 compares the identified belonging information with the pre-stored user's belonging information to determine the changed belongings and notifies the user of the changed belongings. Then, the user can check the changed belonging information guided by the home gateway 3 and pack the missing item.

2 is a schematic internal structural diagram of a home gateway 3 according to an embodiment of the present invention.

The home gateway 3 identifies the user by using the user identification information management unit 31 that registers the user's object data, the object data receiving unit 32 that receives object data from the smart floor 2, and the received object data. User identification unit 33, user behavior determining unit 34 for determining whether the user has entered or not, or whether the belongings are lifted or put down, a user belongings identification unit 35 for analyzing belongings by analyzing the user's image data, the user It comprises a user possession pattern management unit (36) for collecting and storing access information and belonging information of the user, and a change belonging provider (37) for providing changed personal information when the user enters and exits.

The user identification information management unit 31 receives the user's contact area and weight from the smart floor 2 and stores it in the DB as user identification information capable of identifying the user. Alternatively, the user identification information management unit 31 may receive the object data of the user list input from the user and store it in the DB.

Here, the user identification information management unit 31 may register a contact area and weight of a user who does not carry belongings to the floor surface as user object data and store the user area as user identification information of the user object. The contact area may be an area or shape, and may be worn with shoes or naked.

The object data receiving unit 32 receives object data from the smart floor 2. The user object changes the signal value of the pressure sensor of the smart floor 2. The object data receiving unit 32 receives the object data whenever a change in object data occurs from the smart floor 2. The change value of the object data includes creation, destruction and increase / decrease of the value.

The user identification unit 33 compares the received object data with stored user identification information to identify the user of the data determined to be the same. In the comparison and judgment process, a predetermined error may be applied.

Here, in a situation where the user enters the area of the smart floor 2 and puts down at least one belonging, the degree of agreement between the received object data and the user identification information may increase over time. And in a situation where the user leaves at least one belonging and leaves the area of the smart floor 2, the coincidence may decrease as time passes. Alternatively, the user identification unit 33 may identify the user by analyzing image data received from the camera 4 for accurate user identification.

The user behavior determining unit 34 determines whether the user is lifting the product or putting down the product. The behavior of the user lifting the article can predict the user's exit, and the behavior of putting the article down when the user enters.

Here, the user action determining unit 34 increases the weight at the position of the detected user object and simultaneously loses or decreases the weight of the first object at another location, and the user lifts the first object at another location as belongings. You can judge that. In addition, when the weight of the first object is increased or newly recognized in another location while the weight is decreased at the location of the user object, the user may determine that the first object is put down as belongings.

When the user's belongings identification unit 35 detects a change in the object data through the reception of the object data, the user's belongings are compared and analyzed by comparing and analyzing the captured image data.

Here, assuming that the image system is processing the image comparison analysis, the image system controls the camera 4 corresponding to the location of the object requested by the user belongings identification unit 35, monitors the location and shoots Among the image data, the belongings are identified by comparing the image data before and after the requested time. Then, the image system responds to the user belongings identification unit 35 with the image information of the identified belongings. Of course, the user belongings identification unit 35 may perform the image comparison analysis. For example, the user belongings identification unit 35 requests image data from the image system using the location information and the time information, and compares and analyzes the image data before and after the response period information to identify the image of the belongings. .

The user possession pattern management unit 36 stores the identified belonging information in the DB in correspondence with information of the user, access classification and time. Then, in the DB, information that the user carried the belongings and information that the user came in and put the belongings down are stored as a pattern of possession of the user action.

Here, the user possession pattern management unit 36 stores the data that is determined to be the same instead of repeatedly storing the data by increasing the frequency. For example, if the user is at work or at home, the information of the belongings heard when the user leaves the specific time zone and the information of the belongings heard when the user enters are stored by increasing the number of data counts through the DB. Naturally, the belonging information of the highest frequency means that the corresponding user is belonging information regularly in the corresponding time zone. Furthermore, assuming that the user comes in and out of the exercise at regular times once a day, the number of daily information on the belongings to be taken when leaving the exercise and the belongings to be held when entering the exercise are increased daily.

When the changed belongings providing unit 37 identifies the changed belongings information of the user through data analysis of the smart floor 2 and the camera 4, the identified belongings information is compared with the belongings information of the possession pattern stored in the DB It is possible to guide the user with information of belongings that the user has missed or by adding more.

For example, it is assumed that an exercise bag and a water bottle are stored as belonging information for a user who regularly goes out to exercise and comes in. At this time, if the user prepares to go out while missing the possession of the water bottle, the belongings identification unit 35 identifies only the bag as a belongings. Subsequently, if the changed belongings providing unit 37 inquires for the baggage and the water bottle by inquiring the corresponding user, time zone, and outing information corresponding to the outgoing bag, it is determined that there is a difference in the water bottle, and the water bottle is output to the output terminal It can guide you to the information of your belongings.

Here, the output terminal may be an automation terminal installed in a doorway or a user mobile terminal (eg, a smart terminal, a smart pad, etc.). The output terminal is a terminal capable of outputting a screen and voice, and capable of wired and wireless data communication. There is no particular limitation.

Of course, the change belongings providing unit 37 can guide the information of the additional possessions to the terminal additionally possessed by the user. Here, the additional possession of the user is intentionally the user possesses the additional belongings, and thus, if the user sets the preferences to be guided only by the small belongings in the environment setting, the guidance of the additional possessions may be omitted.

As another example, in the home, when the user returns home the changed belongings information by comparing the belongings at home and the belongings at home or out, in accordance with the condition that the belongings at home or work must match the belongings at home. I can guide you. In addition, in the workplace, it is possible to guide information on the belongings changed at the time of leaving the workplace according to the condition that the belongings at the time of commuting to and from work match. In the workplace where the security policy is applied, if there are more belongings at work than those at work, additional possessions can be recorded in a log and guided.

Meanwhile, the home gateway 3 may receive weather information through a network. Then, the home gateway 3 may additionally guide the umbrella to go out in rainy weather depending on the probability of precipitation, and may guide that the umbrella you have is not in when you go out. In addition, the home gateway 3 may additionally guide belongings for going out, such as sunglass, sunshade, hat, and sunscreen, when the UV index is high.

3 is an exemplary diagram of user's belonging data stored by the home gateway 3 according to an embodiment of the present invention.

The home gateway 3 identifies the user's belongings at each entry / exit, and stores the belongings information in the DB in the manner of increasing the frequency. The belongings information includes at least one belongings object corresponding to each user, access division (eg, entry and exit), and time zone (eg, month, week, day, hour, etc.). In addition, the home gateway 3 may be able to edit the belonging information stored in the DB from the user, and register the belonging information in a manual manner.

4 and 5 are exemplary views of a situation in which a user enters and exits according to an embodiment of the present invention. For convenience of description, it is assumed that a user goes to work and leaves work.

Referring to FIG. 4, when a user enters the entrance of a workplace, the home gateway 3 may recognize the user's attendance through a door sensor. In addition, the smart floor 2 may recognize the user's attendance by detecting a user object that has entered the office as a new object. The smart floor 2 detects the shape, area, etc. of the foot of the user who went to work, detects the weight, and transmits the newly generated object data to the home gateway 3 through the detection. The home gateway 3 identifies the user determined to be the same by comparing the received object data with user identification information stored in the DB. Then, when the user puts down the object, the smart floor 2 transmits the changed object data of the user to the home gateway 3. Then, the home gateway 3 requests comparison of the image data to the camera 4 using the location information of the received object data. The camera 4 compares the image data before and after the point in time when the object data is generated, and responds with the identified belonging information to the home gateway 3. Then, the home gateway 3 stores belonging information determined to be the same in the DB using a frequency increase method. Of course, belonging information not judged to be the same is added to the DB.

Referring to FIG. 5, when the user lifts an object for work, the smart floor 2 may detect an increase in the weight of the object. When the smart floor 2 detects the user's foot shape / area and weight, it transmits the sensed object data to the home gateway 3. The home gateway 3 requests image data from the camera 4 using the location information of the received object data, and compares the object data with user identification information stored in the DB to identify a user determined to be the same. When the home gateway 3 receives the belonging information identified by the comparison of the video data from the camera 4, the difference between the identified belonging information and the belonging information corresponding to the user, work classification, and work time stored in the DB is different. I guide my belonging information through the output terminal. In addition, the home gateway 3 stores the currently identified belonging information in the DB using the frequency increase method.

6 is a schematic flowchart of a method for guiding a user's belongings according to an embodiment of the present invention.

The home gateway 3 stores identification information of the corresponding member in the home or building at the request of the user in the DB (S31). Then, the user identification information including the contact area and weight for each member is stored in the DB.

Then, when the smart floor 2 detects a change in the object on the floor, the home gateway 3 receives object data in which a change in weight occurs from the smart floor 2 (S32).

Then, the home gateway 3 identifies the user by comparing the received object data and user identification information stored in the DB (S33).

When the user who caused the change in weight is identified, the home gateway 3 determines that the user is carrying the belongings when the weight of the user object is increased, and if the user decreases the weight of the user object, the user puts the belongings down. It is judged (S34).

Then, the home gateway 3 transmits time information and location information of the object data to request image data from the image system, and identifies belonging information using the received image data (S35). Here, the result of the video analysis is video information of a user's action lifted or put down by the user, and the video information confirms what an individual belonging is.

When the belonging information is identified, the home gateway 3 stores the identified belonging information in the DB in correspondence with information such as a user, access classification, and time (S36). Here, when the belonging information determined to be the same is stored, the count of the pre-stored belonging information is increased. Of course, it is also possible for the user to register belonging information according to his / her habits using the input device of the home gateway 3.

In addition, the home gateway 3 inquires the belonging information stored in the DB using the user, the access category and the time zone corresponding to the identified belonging information, and compares the identified belonging information with the inquired belonging information to output the changed belonging information terminal It is transmitted to guide the user (S37). Here, the user may register in the home gateway 3 to guide the mismatched belongings when the belongings at the time of entry and exit do not match.

Due to such processing, the home gateway 3 lists the information of the goods carried when the user goes out or enters the database. The home gateway 3 cannot determine for what reason the user is going out, but if the user detects a situation with a specific item at a specific time (eg, season, day of the week, time zone), the home gateway 3 responds Inquire the belonging information from the DB and inform the user of the pre-stored belonging information and other belongings.

In the above-described embodiment, the term "~ part" is not used as a term for a hardware classification of a user's belonging guidance system and a user's belonging guidance method using a smart floor and a camera. Accordingly, a plurality of components may be integrated into one component, or a component may be divided into a plurality of components. Further, the configuration unit may mean a hardware configuration unit, but may also mean a software configuration unit. Therefore, it should be understood that the present invention is not particularly limited by the term "~ part".

Although the present invention has been described by means of limited embodiments and drawings, the present invention is not limited by this, and the technical idea of the present invention and claims to be described below by those skilled in the art to which the present invention pertains Of course, various modifications and variations are possible within the scope of the scope.

1: belongings guidance system 2: smart floor
3: Home Gateway 4: Camera

Claims (22)

A smart floor unit for sensing object data including a contact area and a weight of the object using a pressure sensor;
A camera unit for photographing the image of the object; And
When receiving the object data from the smart floor, and receiving the image data of the object position through the camera unit, and includes a home gateway unit for identifying the user's belongings by comparing and analyzing the object data and the change in the image data ,
The home gateway unit,
Detects a change in the weight of the object data, transmits the position of the detected object to the camera unit, requests an image of the object, compares the analyzed image data before and after the weight is changed, and analyzes and analyzes the changed image data as belonging identification information User's belongings information system, characterized in that the storage. According to claim 1,
The home gateway unit,
A user's belonging guidance system, characterized in that the object data including the contact area, weight, and each change amount and location of the object detected in real time is transmitted from the smart floor. According to claim 1,
The home gateway unit,
When storing user identification information and receiving object data from the smart floor, the user's belonging guidance system, characterized in that the user is identified in real time in comparison with the user identification information. According to claim 1,
The home gateway unit,
A user's belongings guidance system, characterized by identifying a user and belongings using at least one of an object's contact area, weight, and image data. According to claim 1,
The home gateway unit,
When the user is identified from the newly created object data, it is determined that the user has entered,
The user's belongings guidance system, characterized in that when the identified user's object data receives information that has been destroyed, the user determines that the user has left. According to claim 1,
The home gateway unit,
When receiving the object data of the first object whose weight is increased from the smart floor, and when the weight of the user object is reduced by the weight of the first object, the user determines that the first object is put down as belongings,
When the weight of the second object is sensed by the smart floor and the weight of the user object increases by the reduced weight of the second object, the user determines that the second object is in possession. Inventory information system. delete The method according to any one of claims 1 to 6,
The home gateway unit,
A user characterized by storing the belongings of the identified user in correspondence with the information of the user, access classification and time, and increasing and storing the frequency of each time the information of the user, access classification, time zone and belongings determined to be the same is stored. Belongings guidance system. The method of claim 8,
The home gateway unit,
When a user enters or exits, the user's belonging guidance system characterized by inquiring the corresponding access category and time zone belonging information, and guiding the change information of the belonging which is different from the stored belonging information. The method of claim 9,
When the home gateway unit further includes an output terminal unit and transmits the change information of the belongings to the output terminal unit, the user's belonging guidance system characterized in that the change information of the belongings is output to the output terminal unit. The method of claim 9,
The home gateway unit,
The user's belonging guidance system, characterized in that the user stores information of the user's belongings every time the user enters and compares the information of the user's belongings when the user enters the information of the belongings when the user enters. The method of claim 9,
The home gateway unit,
A user's belonging guidance system, characterized in that it receives and stores weather information, and guides belonging information related to the weather including umbrella, hat, and sunglass. A user identification information management unit that registers and stores a contact area and weight for a user on a smart floor including a pressure sensor;
An object data receiving unit that receives object data including a contact area and weight with respect to an object on the floor surface;
A user identification unit that identifies the user by comparing the received object data with stored user identification information;
A user behavior determination unit that determines whether a user lifts a belonging or puts the belonging down using a change in weight of the object data;
A user belongings identification unit for requesting image data by transmitting the position of the object whose weight has changed, and real-time identification of the user's belongings detected by comparing and analyzing the change of the image data;
A user possession pattern management unit that stores the identified belonging information in correspondence with information of a user, access classification and time; And
Changed belongings providing unit that inquires the belongings information corresponding to the information of the user, access classification and time of the identified belongings information and compares the identified belongings information with the inquired belongings information and transmits the changed belongings information to the designated output terminal
Home gateway device comprising a,
The user belongings identification unit,
The user's belongings characterized in that the position of the object whose weight has been changed is transmitted to the camera unit to request an image of the object, and the image data before and after the weight is changed is compared and analyzed and the analyzed image data is stored as belonging identification information. Guidance system. A method for guiding a user's belongings executed by a home gateway device that identifies the user's belongings,
(A) object data receiving step of receiving the object data including the contact area and weight of the object from the smart floor including a pressure sensor;
(b) an object image receiving step of requesting an image of the object with a camera and receiving image data;
(c) a user belongings identification step of analyzing the image data to identify the user's belongings where an image change occurs;
(d) a change belongings determining step of inquiring the user's belongings information previously stored corresponding to the identified belongings information and comparing the identified belongings information with the inquired belongings information to determine the changed belongings; And
(e) including a step of guiding the changed belongings to transmit the changed belongings information to a designated terminal for user guidance,
The object image receiving step,
The position of the object whose weight has been changed is transmitted to the camera to request an image of the object to receive image data,
The user belonging identification step,
A method of guiding a user's belongings, characterized in that the image data before and after the weight is changed is compared and stored as the analyzed identification information. The method of claim 14,
Before step (a),
The home gateway device further comprises the step of registering the user's contact area and weight from the smart floor and storing it as user identification information. The method of claim 14,
Step (a) is,
The home gateway device is a step of comparing the object data received from the smart floor and pre-stored user identification information to identify a matching user. The method of claim 14,
In step (a), the home gateway device determines a user's behavior,
If a user is identified from the newly generated object data, determining that the user has entered;
Detecting an increase in the weight of the first object while recognizing an incoming user, and when the weight of the user object decreases by the weight of the increased first object, determining by the user that the first object is put as belongings;
Detecting a weight reduction of the second object while recognizing the user object and the second object, and when the weight of the user object increases by the weight of the reduced second object, determining by the user the behavior of carrying the belongings; And
When receiving the information that the user's object data identified from the smart floor is destroyed, further comprising the step of determining that the user has left. The method according to any one of claims 14 to 17,
After step (c),
The home gateway device stores the belongings of the identified user in association with the information of the user, access classification, and time, and increases and stores the frequency of each time the information of the user, access classification, time zone, and belongings determined to be the same is stored. A method of guiding a user's belongings, further comprising a step The method of claim 18,
The step (d),
The home gateway device queries the user's first belonging information for the currently identified user, searches the pre-stored second belonging information for the user, access category, and time, and compares the first belonging information with the second belonging information to check the changed belongings. A method of guiding a user's belongings, characterized in that it is a determining step. The method of claim 14,
The step (d),
The home gateway device further comprises the step of storing the user's access information, and comparing the belonging information held when the user enters with the belonging information held when the user exits, and determining the changed belonging information. Way. The method of claim 14,
The step (e),
The home gateway device is a step of transmitting the change information of the belongings to the designated user terminal or home automation terminal, and the step of outputting the change information of the belongings from the user terminal or the home automation terminal. The method of claim 14,
The step (e),
A method for guiding a user's belongings, characterized in that the home gateway device inquires stored weather information and guides information related to the weather including an umbrella, a hat, and sunglasses.

Images