KR102007778B1 - Home network system and the service providing method of the same - Google Patents

Home network system and the service providing method of the same Download PDF

Info

Publication number
KR102007778B1
KR102007778B1 KR1020120135432A KR20120135432A KR102007778B1 KR 102007778 B1 KR102007778 B1 KR 102007778B1 KR 1020120135432 A KR1020120135432 A KR 1020120135432A KR 20120135432 A KR20120135432 A KR 20120135432A KR 102007778 B1 KR102007778 B1 KR 102007778B1
Authority
KR
South Korea
Prior art keywords
user
information
home network
unit
behavior pattern
Prior art date
Application number
KR1020120135432A
Other languages
Korean (ko)
Other versions
KR20140067765A (en
Inventor
김형록
백승민
손혁수
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020120135432A priority Critical patent/KR102007778B1/en
Publication of KR20140067765A publication Critical patent/KR20140067765A/en
Application granted granted Critical
Publication of KR102007778B1 publication Critical patent/KR102007778B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
    • H04L12/2827—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/283—Processing of data at an internetworking point of a home automation network
    • H04L12/2834—Switching of information between an external network and a home network

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention relates to a home network system and a service providing method thereof.
In at least one digital device constituting a home network according to an embodiment of the present invention, the sensor unit for sensing a user; A camera unit for photographing a user sensed by the sensor unit; Confirming the user based on the image of the user photographed by the camera unit, confirming the viewpoint information and the location information on which the user is photographed, and including the identified user information and the corresponding viewpoint information and the location information A controller for generating pattern information; A storage unit for storing a user image photographed by the camera unit and storing behavior pattern information corresponding to the user information generated by the controller; And a communication unit for performing communication with digital devices constituting the home network.

Description

Home network system and the service providing method of the same

The present invention relates to a home network system and a service providing method thereof.

The demand of various home appliances is increasing, the provision of various multimedia contents through internet connection and data sharing is active, and the home network related to the combination of home multimedia terminals and home appliances is being activated.

A home network means that two or more devices in the home communicate with each other. The home network currently used in the home is a white network such as an AV network, a washing machine, a refrigerator, and an air conditioner for the transmission of multimedia data between AV networks such as video, TV, etc. There is a living network for controlling household appliances and energy use.

As a technology used in a home network, a wireless network technology including Bluetooth and a wired network technology including an interface such as a telephone line and a power seat are applied.

Conventional home networks have focused on providing interoperability and user convenience of various home appliances by executing operations on control and mutual control functions of general home appliances.

However, depending on the implementation of various functions of each home appliance, only some limited functions are implemented or user-oriented functions have some limitations.

The present invention can provide a user-friendly home network and a service providing method thereof through an interface between each device constituting the home network and a user.

In addition, the present invention can provide a home network and a service providing method for enabling a user to easily use home appliances and various devices in a home to which the home network system is applied.

In at least one digital device constituting a home network according to an embodiment of the present invention, the sensor unit for sensing a user; A camera unit for photographing a user sensed by the sensor unit; Confirming the user based on the image of the user photographed by the camera unit, confirming the viewpoint information and the location information on which the user is photographed, and including the identified user information and the corresponding viewpoint information and the location information A controller for generating pattern information; A storage unit for storing a user image photographed by the camera unit and storing behavior pattern information corresponding to the user information generated by the controller; And a communication unit for performing communication with digital devices constituting the home network.

In addition, the service providing method of at least one digital device constituting a home network according to an embodiment of the present invention, comprising: detecting a user; Photographing the detected user; Confirming the user information and behavior pattern information corresponding thereto based on the captured image of the user; Determining whether the identified user and behavior pattern information is included in previously stored user and behavior pattern information; And providing the corresponding service in the digital device when the behavior pattern information corresponding to the identified user is included in previously stored behavior pattern information of the user.

According to the present invention, the home network system and its control method have an effect of facilitating the use of devices constituting the home network to match the behavior pattern of the user.

In addition, the present invention has the effect of providing a service and a variety of content according to the user's state and behavior patterns using a home network system and its control method.

1 is a block diagram of a home network system to which an embodiment of the present invention is applied.
2 is a plan view of a home to which a home network system according to an exemplary embodiment of the present invention is applied.
3 is a block diagram of a device constituting a home network according to an exemplary embodiment of the present invention.
4 is a flowchart illustrating a service providing operation using a home network according to an exemplary embodiment of the present invention.
5 is a table illustrating an example of a database of user behavior patterns using a home network system according to an exemplary embodiment of the present invention.
6 is a graph illustrating an example of a database of user behavior patterns using a home network system according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a home network system to which an embodiment of the present invention is applied, and FIG. 2 is a plan view of a home to which a home network system according to an embodiment of the present invention is applied.

1 to 2, a home network system to which an embodiment of the present invention is applied includes a home gateway 10 and a plurality of digital information devices 100.

The home gateway 10 may serve as a connection between the Internet 20 or a wide area service network and the in-house digital information device 100. It performs a built-in routing function for IP address management and supports multiple services such as voice, data, and video from the public network throughout the home. In addition, the home gateway 10 manages and stores information transmitted and received through the Internet 20 so that the digital information devices 100 in the home can be connected to the external Internet network 20.

The digital information device 100 is a device having a digital circuit that processes digital data. Examples of the digital information device 100 include a TV 110, a refrigerator 120, an air conditioner 130, a computer 140, and a robot cleaner 150. When operated by a user, the digital information device 100 according to an embodiment of the present invention may store and share various data such as operation contents and operator information with each digital information device.

In addition, the digital information device 100 according to an embodiment of the present invention may include a camera and perform a user recognition function.

That is, as illustrated in FIG. 2, the digital information devices 100 existing at each location in the home may include a camera, and the camera may capture and identify a user present in the photographing area.

Hereinafter, a plurality of digital information devices applied to an embodiment of the present invention will be described in detail with reference to FIG. 2.

3 is a block diagram of a device constituting a home network according to an exemplary embodiment of the present invention.

In the embodiment of the present invention, the TV 110 of the plurality of digital information devices 100 provided in the home will be described as an example. Other digital information devices 100 may additionally include a functional unit according to the functional feature. In the following description, common functions for performing functions applied to the present invention in the digital home appliances constituting the home network will be described.

TV 110 of the plurality of digital information devices 100 constituting the home network according to an embodiment of the present invention is the camera unit 111, the sensor unit 112, the display unit 113, the input unit 114 ), A communication unit 115, a storage unit 116, and a control unit 117.

The camera unit 111 is for capturing and recognizing a user existing in a space where the TV 110 is located, and processes an image frame such as a still image or a video obtained by an image sensor. The processed image frame may be displayed on the display unit 113.

The camera unit 111 according to an exemplary embodiment of the present invention may capture a face or state of a user as a still image or a video, and output the captured image to the controller 117 and the storage 116.

The sensor unit 112 may include various sensors required for a corresponding function according to the digital home appliance. For example, the TV 110 may include an access sensor for sensing by a user's approach or a touch sensor for touching a screen. In particular, the sensor unit 112 according to an embodiment of the present invention may be a proximity sensor for detecting the presence and location of the user.

Proximity sensors include transmissive photoelectric sensors, direct reflective spectral sensors, mirror reflective photoelectric sensors, high frequency oscillating proximity sensors, capacitive proximity sensors, magnetic proximity sensors and infrared proximity sensors.

When the sensor unit 112 detects the presence of the user and the presence of the object to be photographed, the detected sensor signal may be output to the control unit 117 to capture the user in the camera unit 111.

The display unit 113 displays information processed by the digital home appliance 100. For example, the TV 110 may output an image or an image of various contents supplied from the outside. In addition, according to an exemplary embodiment of the present invention, an image or an image of a user captured by the camera unit 111 and information about the user may be displayed. In addition, the display unit 113 may display information about a specific user, an image, life pattern information, and the like acquired from various digital home appliances 100 constituting a home network according to an exemplary embodiment of the present invention.

The input unit 114 generates input data for controlling the operation of the TV 110 by the user. The input unit 114 may be configured to receive user input in various forms such as a keypad, a switch, a touch pad, and a jog switch. In an embodiment of the present disclosure, the input unit 114 may receive information for registering a user or a signal for updating information corresponding to the user. In addition, it is possible to receive an operation control signal for the digital home appliances constituting the home network by the user request.

The communication unit 115 may include one or more modules that enable network wireless communication between the TV 110 and the digital home appliances 100 constituting the home network. In addition, the communication unit 115 is connected to at least one digital home appliance 100 constituting the home network and the Internet to share user information acquired and photographed in each device and behavior pattern information for the user. Can send and receive data. In addition, when the communication unit 115 is detected by the sensor unit 112 and user photographing is performed through the camera unit 111, the reliability of the captured image is low based on a control signal of the control unit 117. The control signal for requesting a user photographing may be transmitted to other digital home appliances constituting the home network to the corresponding digital home appliances.

The storage unit 116 may store a program for the operation of the controller 117 and may temporarily store input / output data. According to an embodiment of the present invention, the storage unit 116 may store information on a user existing in a home, or store information and mutually shared information about a digital home appliance connected to a home network. In addition, the storage unit 116 may update previously stored user information based on the control of the controller 117 or accumulate and store a user's behavior pattern.

The controller 117 typically controls the overall operation of the TV 110. For example, perform related control and processing for broadcast video, data communication, and the like. In particular, the control unit 117 generates a control signal for data sharing and processing requests to the plurality of digital home appliances 100 constituting the home network and transmit and receive through the communication unit 115. Can be. In addition, the control unit 117 may check the data acquired by the camera unit 111 and the sensor unit 112, and update or analyze information about the user's information stored in the storage unit 116 and the corresponding behavior pattern. Can be. That is, the controller 117 confirms the information of the user photographed by the camera unit 111 or obtained from other home appliances, updates the information of the user previously stored in the storage unit 116, or accumulates the user. By identifying the behavior pattern, a control signal for providing a service and content corresponding to the user may be generated. In addition, according to the analyzed behavior pattern of the user can detect the abnormal behavior pattern and generate a control signal for performing a corresponding process.

As described above, the digital home appliance 110 to which the embodiment of the present invention is applied is connected to a plurality of digital home appliances constituting a home network in the home, and obtains user information detected and photographed by each digital home appliance. It may be to provide a function and a service according to the behavior pattern corresponding to the user information.

Hereinafter, a home network control operation according to an embodiment of the present invention will be described in detail with reference to FIGS. 4 to 6.

4 is a flowchart illustrating a service providing operation using a home network according to an embodiment of the present invention. FIG. 5 is a table illustrating an example of a database of user behavior patterns using a home network system according to an embodiment of the present invention. 6 is a graph illustrating an example of a database of user behavior patterns using a home network system according to an embodiment of the present invention.

Hereinafter, a TV and a robot cleaner will be described as an example of any one of a plurality of digital home appliances that also form a home network. The above operations are similar to the operation flow of each digital home appliance constituting the home network according to an embodiment of the present invention.

4 to 6, when the sensor unit 112 of the digital home appliance 100 detects a user's movement in a space where the digital home appliance 100 is present (S402), the detected user includes a camera unit. Shoot at 111.

Based on the photographed user image, the controller 117 checks the information of the user by comparing with the user information previously stored in the storage 116. The user information stored in the storage unit 116 may be basic information such as a face image of the user, a user ID, and the like.

The controller 117 may determine whether the reliability of the photographed user image is equal to or greater than a preset reference reliability. Can be analyzed. The analysis diagram may use a result of comparison with an image state and an image included in pre-registered and stored user information.

The controller 117 generates and communicates a signal for capturing a user's image to the second digital home appliance when the image of the user's image captured by the camera unit 111 is higher than the reference reliability as a result of the reliability check. Send it through. An example of the second digital home appliance may be a mobile robot cleaner that is easy to move. The mobile robot cleaner is easy to move and may photograph the user at various angles or at various positions instead of a fixed camera. In addition, the second digital home appliance may be moved to a location where the first digital home appliance existing at the location where the user is detected may be used to photograph the user in various directions.

The type of the first and second digital home appliances for the user shooting is not limited, and may be flexible according to the user's convenience and the home network configuration.

If the user image is not obtained from the first digital home appliance, the controller 117 transmits a user photographing request signal to the second digital home appliance (S408), and acquires user information photographed from the second digital home appliance (S410). )

The controller 117 checks pre-stored user information and an action pattern corresponding thereto based on the user image acquired by the first digital home appliance or the second digital home appliance.

The controller 117 may check the obtained image of the user and the behavior pattern according to the acquired user, and update the identified information (S414).

The user information stored in the storage unit 116 and the corresponding behavior pattern information as shown in FIG. 5 may include identification information (ID) of the user, information about a location where the user is located at a specific date and time, and the location information. The digital home appliance photographing the user at the place and the operation information on the home appliance may be stored.

The user behavior pattern information may be accumulated and stored for a predetermined period, and the accumulated information may be stored by calculating a space located therein and a ratio corresponding thereto as shown in FIG. 6. FIG. 6 is an exemplary diagram illustrating a graph of a ratio of a location of a user on a specific day of the week based on the behavior pattern information accumulated for a predetermined period of time.

The controller 117 checks the image of the user acquired from the camera 111 and the behavior pattern information corresponding thereto, and stores the user behavior pattern previously stored in the storage unit 116 as shown in FIGS. 5 and 6. It is determined whether or not included (S416).

For example, the controller 117 may determine whether the user having the user ID AAA is photographed by a camera included in the TV present in the living room at the present time (for example, 10 am Sunday).

If information corresponding to the user behavior pattern condition is obtained, the controller 117 enables the corresponding home appliance to provide the content or service mainly used by the user. (S418) In other words, the controller 117 includes the TV. When the behavior pattern is confirmed in the camera that allows the user to turn on the power at the corresponding time, the TV of the living room is turned on in order to provide the corresponding service.

On the other hand, the controller 117 generates a preset alarm or user location request signal to configure a home network when the location information and the viewpoint information of the user image are not included in the stored behavior pattern information. Each can be sent as

Alternatively, if the user is not detected at a location belonging to the previously stored behavior pattern information or continuously detected at another specific location, the user may generate an alarm or check whether the behavior pattern information is updated in the digital home appliance within the range in which the user is located. .

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (10)

In at least one digital device constituting a home network,
A sensor unit sensing a user;
A camera unit for photographing a user sensed by the sensor unit;
Confirming the user based on the image of the user photographed by the camera unit, confirming the viewpoint information and the location information on which the user is photographed, and including the identified user information and the corresponding viewpoint information and the location information A controller for generating pattern information;
A storage unit for storing a user image photographed by the camera unit and storing behavior pattern information corresponding to the user information generated by the controller; And
Communication unit for performing communication with the digital devices constituting the home network
Including,
The storage unit
Collecting and storing the user information and corresponding behavior pattern information for a predetermined period based on the control of the controller,
The control unit
When the user image photographed by the camera is less than a predetermined reference reliability, and transmits a control signal for photographing the user in a second digital device connected to the home network through the communication unit,
Compare the user image photographed by the camera unit and the behavior pattern information corresponding thereto based on the user information collected during the predetermined period and the behavior pattern information corresponding thereto, and the digital device corresponding to the user according to the comparison result. To control the services of
Digital devices. delete The method of claim 1
The second digital device is a movable digital device having a camera,
The communication unit
Receiving the user image photographed by the second digital device and outputting the image to the controller;
Digital devices. delete delete The method of claim 1,
Based on the user information collected during the predetermined period and the behavior pattern information corresponding thereto, the user image photographed by the camera unit and the behavior pattern information corresponding thereto are compared, and the user stores the previously stored behavior pattern according to the comparison result. When not in the range of information to generate an alarm to at least one digital device constituting the home network
Digital devices. The method of claim 1,
The storage unit
Receiving and storing periodically stored user information and behavior pattern information corresponding to the user information from at least one digital device constituting the home network under the control of the controller;
Digital devices. delete delete delete
KR1020120135432A 2012-11-27 2012-11-27 Home network system and the service providing method of the same KR102007778B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120135432A KR102007778B1 (en) 2012-11-27 2012-11-27 Home network system and the service providing method of the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120135432A KR102007778B1 (en) 2012-11-27 2012-11-27 Home network system and the service providing method of the same

Publications (2)

Publication Number Publication Date
KR20140067765A KR20140067765A (en) 2014-06-05
KR102007778B1 true KR102007778B1 (en) 2019-08-06

Family

ID=51123928

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120135432A KR102007778B1 (en) 2012-11-27 2012-11-27 Home network system and the service providing method of the same

Country Status (1)

Country Link
KR (1) KR102007778B1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102055760B1 (en) * 2013-08-26 2019-12-13 주식회사 케이티 Method for controlling cleaning of home gateway connected to the floor and home gateway therefor and mobile cleaning robot using the same
KR101896096B1 (en) * 2016-09-22 2018-09-06 주식회사 아씨오 Home Service System
KR101965284B1 (en) * 2017-08-10 2019-04-03 이화여자대학교 산학협력단 System and method for controlling domestic appliances, and computer readable medium for performing the method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101800887B1 (en) * 2010-12-16 2017-11-23 엘지전자 주식회사 Network system
KR101248054B1 (en) * 2011-05-04 2013-03-26 삼성테크윈 주식회사 Object tracking system for tracing path of object and method thereof

Also Published As

Publication number Publication date
KR20140067765A (en) 2014-06-05

Similar Documents

Publication Publication Date Title
US10819958B2 (en) Home monitoring method and apparatus
JP6186517B2 (en) Task setting method, apparatus, program, and recording medium
US20160335981A1 (en) Remote control method and device using wearable device
US9742582B2 (en) House monitoring system
US20140167931A1 (en) Method and apparatus for controlling a home device remotely in a home network system
KR101635068B1 (en) Home network system and method using robot
JP5866551B1 (en) Monitoring system and monitoring method in monitoring system
CN105387566A (en) Parameter detection method and device for air purifier and terminal
CN105468152A (en) Terminal operation control method and device based on wearable equipment, and equipment
US20160148476A1 (en) Monitoring system
CN104460329A (en) Intelligent device connection method and device
US20180199009A1 (en) Monitoring system
CN105049807A (en) Method and apparatus for acquiring monitoring picture sound
KR102007778B1 (en) Home network system and the service providing method of the same
US9485111B2 (en) Monitoring system
CN104375760B (en) Method for information display and device
KR20150086807A (en) Method and apparatus of universal remocon based on object recognition
CN106358064A (en) Method and equipment for controlling television
CN106878654A (en) The method and device of video communication
KR20150035108A (en) System for robot cleaner and preventing crime using wifi direct
KR101642997B1 (en) Method for event sharing in image display system
CN111033448B (en) Household auxiliary system
KR20170034066A (en) Electronic device and control method thereof
JP5516279B2 (en) Communication device connection system, communication device connection method, and communication device connection program
JP2013207520A (en) Control device

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant