KR20150069961A - Method and apparatus for controlling home device - Google Patents

Abstract

The present invention relates to a method for controlling a home device. The method for a home server to control a home device comprises the processes of: receiving a natural language syntax entered into an electronic apparatus; determining whether the received natural language syntax includes home device information and according to the determination result, selecting at least one home device; and generating a control command for controlling the selected home device and controlling the selected at least one home device.

Description

METHOD AND APPARATUS FOR CONTROLLING HOME DEVICE [

The present invention relates to a method and apparatus for controlling a home device.

A home network system is a system that enables communication between home devices by connecting home devices such as a refrigerator, an air conditioner, a television, and a personal computer (PC) installed in the home via a wired or wireless network. Such a home network system can control a home device according to a request of a user to provide a service desired by a user, but only a limited service is available at present.

Accordingly, rather than providing a limited service for controlling a home device through a home network, the user is required to indirectly grasp the user's situation and provide a home network service.

According to another aspect of the present invention, there is provided a method of controlling a home device in a home server, the method comprising: receiving a natural language syntax from an electronic device; And controlling the selected at least one home device by generating a control command for controlling the selected home device.

According to another aspect of the present invention, there is provided a method of controlling a home device in a home server, the method comprising: acquiring alarm time information set in the electronic device from the electronic device; And controlling the at least one home device by generating a control command indicating an operation of at least one home device set in correspondence with the home device operation history information, .

According to another aspect of the present invention, there is provided a method of controlling a home device by a home server, the method comprising: checking whether the home device is operating; And controlling the at least one home device by generating a control command indicating an operation of at least one home device set in correspondence with the home device operation history information, .

According to another aspect of the present invention, there is provided a home server for controlling a home device, the home server comprising: a transmitting / receiving unit for receiving a natural language syntax from an electronic device; And a controller for controlling the selected at least one home device by generating a control command for controlling the selected home device.

In the various embodiments disclosed in the present invention, a home server operating at least one home device can grasp the situation of the user and control the home device.

1 is a diagram illustrating a home network system according to an embodiment of the present invention,
2 is a diagram illustrating an initial setting procedure between a home server and a home device and an initial setting procedure between an electronic device and a home server according to an embodiment of the present invention;
3 is a flowchart of a home network system according to the first embodiment of the present invention,
4 is a flowchart of a home network system according to a second embodiment of the present invention;
5 is a flowchart of a home network system according to a third embodiment of the present invention;
6A is a diagram illustrating a display screen of an integrated application according to an application of the first embodiment of the present invention,
6B is an operation flowchart of the home server according to the application of the first embodiment of the present invention,
FIG. 7A is a diagram illustrating a screen of an integrated application according to an application of the second embodiment of the present invention,
7B is an operation flowchart of a home server according to an application of the second embodiment of the present invention,
8 is a diagram illustrating a screen of an integrated application according to another application of the second embodiment of the present invention;
9 is a view illustrating a screen of an integrated application according to another application of the second embodiment of the present invention;
10 is a diagram illustrating a relationship between an integrated application of an electronic device and a home server according to an embodiment of the present invention;
11 is a diagram illustrating a menu tree of an integrated application according to an embodiment of the present invention;
12 is a diagram illustrating functions of a home link of an integrated application according to an embodiment of the present invention;
13 is a diagram illustrating security and power states of a home link function according to an embodiment of the present invention;
FIG. 14 is a diagram illustrating an item of a home link function and a dialog window function of an integrated application according to an embodiment of the present invention;
Figure 15 illustrates a basic operation in an integrated application according to an embodiment of the present invention;
16 is a diagram illustrating a power state and a correlation among items on a home link screen according to an embodiment of the present invention;
17 is a diagram illustrating an operation of controlling a device on a home link screen of an integrated application according to an embodiment of the present invention;
18 is a diagram illustrating an operation of controlling a home device through a dialog window function of an integrated application according to an embodiment of the present invention;
FIG. 19 illustrates control of a home device according to an action list of a dialog according to an embodiment of the present invention; FIG.
20 is a diagram illustrating a structure of a home server according to an embodiment of the present invention;

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The present invention can be variously modified and may have various embodiments, and specific embodiments will be described in detail with reference to the drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, the principle of operation of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention and may vary depending on the user, intention or custom of the user. Therefore, the definition should be based on the contents throughout this specification.

1 is a diagram illustrating a home network system according to an embodiment of the present invention.

Referring to FIG. 1, the home network system of the present invention may constitute an electronic device 100, a server 110, a home server 120, and a home device 130.

The electronic device 100 may include a mobile terminal capable of data transmission / reception and voice and video communication. Such an electronic device 100 may have at least one screen, and each screen may display results that are executed by at least one application. The electronic device 100 may include, for example, a smart phone, a tablet PC, a 3D-TV, a smart TV, an LED TV, an LCD TV, a table PC, You can include any device you can. The electronic device 100 may include a wireless communication device, a NFC (Near Field Communication) device, a WiFi direct communication device, and a wireless access point (AP). Also, the electronic device 100 may be connected to other devices such as a portable terminal, a smart phone, a tablet PC, a desktop PC, an input device, a camera and a server 110 by using wired or wireless communication.

The electronic device 100 can input a natural language phrase through an integrated application and send and receive instant messages to and from the home server 120 and at least one other electronic device through an integrated application. The term natural language is used herein to mean that a user using the electronic device 100 is able to communicate directly with the electronic device 100 in order to receive his or her current situation, It can mean the sentence to be entered. Alternatively, the natural language syntax may include a syntax for a user of the electronic device 100 to be input to the electronic device for receiving service from the home device 130. For example, the natural language syntax may include "go home," "cold," "hungry," and so on. In addition, the natural language syntax can be input in text format or input by voice. However, it is to be understood that the present invention is not limited to the above-described embodiments, but includes various other ways of inputting syntax and natural language syntax for all other situations including user's desires.

The server 110 may transmit the natural language sentence provided from the at least one electronic device 100 to the home server 120 and may transmit the information transmitted by the home server 120 to at least one electronic device 100 . And the server 110 may be an instant messaging server.

The home server 120 can store and execute at least one application required for controlling the home device 130, and can control the home device 130 through the application. In addition, the home server 120 may store and execute an integrated application for communicating with the electronic device 100. The home server 120 may prevent unnecessary memory allocation to the electronic device 100 by storing at least one of the required applications.

The integrated application is for communication between the electronic device 100 and the home server 120 and enables real-time communication between the at least one electronic device 100 and the home server 120, To be able to transmit and receive. The function of the integrated application may include a home link function in which a user directly controls the home device 130 and a dialog function in which a natural language phrase is displayed. The home link function and the dialog function are described in detail below.

The home server 120 can understand the user's situation through the natural language syntax received from the electronic device 100 and control the home device 130 accordingly (103, 105).

Also, the home server 120 can grasp the future state of the user through the natural language syntax received from the electronic device 100, and control the home device 130 accordingly.

For example, the home server 120 may receive (103) the natural language syntax entered in the electronic device 100 from the electronic device 100 and determine whether the home device information is included in the natural language syntax. The home device information may include at least one of a home device name, an Internet Protocol (IP) address, and a media control access (MAC) address. The home device may be, for example, an air conditioner, a refrigerator, a fan, and an illumination device. Such a home device may be controlled by the electronic device 100 of the present invention.

Also, the home server 120 may determine whether the natural language syntax includes the home device information, and may select at least one predetermined home device 130 corresponding to the natural language syntax according to the determination result. The home server 120 may generate a control command for controlling the selected home device to control the selected at least one home device 130.

The home server (120) For example, when the information composed of the natural language is 'cold', it can be determined that there is no information of the home device in the 'cold' syntax.

Also, the home server 120 may transmit the operation list related to the selected at least one home device to the electronic device 100, and may receive the home device operation information selected by the user from the electronic device 100 . The home server 120 generates a control command according to the selected home device operation, and controls the selected home device according to the generated control command.

The home server 120 can determine the status of the user using the information stored by the user in the electronic device 100 and control the home device 130 accordingly (107, 105).

For example, the home server 120 may check whether an alarm is set in the electronic device (107). Accordingly, the home server 120 may acquire time information on the alarm setting from the electronic device 100 in response to confirmation of the alarm setting.

Also, the home server 120 can check the home device operation history information corresponding to the time information for the alarm setting, and control the operation of at least one home device set in advance.

Here, the home device operation history information may include at least one predetermined home device different from the home device, and information mapping a predetermined one home device operation with the home device. Also, the home device operation history information may include information about an operation previously performed by the at least one home device.

When the user controls the home device 130, the home server 120 may control the preset home device 130 by checking the status of the user.

For example, the home server 120 may check whether the home device is operating, and if the operation of the home device is confirmed, the home server 120 may confirm the home device operation history information.

In addition, the home server 120 generates a control command for instructing operation of at least one home device different from the home device in response to the home device operation history information, and controls the at least one home device accordingly .

Here, the home device operation history information may include at least one predetermined home device different from the home device, and information mapping a predetermined one home device operation with the home device. Also, the home device operation history information may include information about an operation previously performed by the at least one home device.

The home device 130 may include, for example, a home appliances including a general TV, a spherical appliance including a spherical air conditioner and a socket, a security sensor, a camera, and a speaker, a smart home appliance, and the like. The appset is a hybrid term for an application and an accessory.

The home device 130 operates according to a control command received from the home server 120 and can transmit the state information of the home device 130 to the home server 120. When an abnormality is detected in the home device 130, for example, when an object not recognized by the camera is identified, the detected information may be included in the status information and transmitted to the home server 120.

2 illustrates an initial setup procedure 201 between the home server 210 and the home device 220 and an initial setup procedure 203 between the electronic device 200 and the home server 210 according to an embodiment of the present invention FIG.

 Referring to FIG. 2, an initial setting procedure 201 of the electronic device 200 and the home server 210 is first installed in the home server 210 and is powered on. Then, the electronic device 200 is brought into contact with the home server 210. For example, it may be Near Field Communication (NFC) tagging in a contact manner. Accordingly, the home server 210 and the electronic device 200 perform pairing, and if the electronic device 200 does not have an integrated application, the integrated application can be installed. The process of performing the pairing and installing the integrated application may be performed automatically or may be performed by a user. After the integrated application is installed, a dialog function can be created in the integrated application of the electronic device 200 to send and receive the natural language syntax to the home server. The chat window function may be, for example, a chatroom.

The initial setting procedure 203 between the home server 210 and the home device 220 may be performed by first connecting the NFC embedded in the home device 220 or the enclosed NFC tagging to the electronic device 200 or the home server 210, . Accordingly, the home server 210 can download the application for controlling and controlling the home device 220 from a separate server, and performs the pairing with the home device 220. Accordingly, the home server 210 can notify the home device 220 of information that the home device 220 has been newly added by the integrated application of the electronic device 200. [

3 is a flowchart of a home network system according to a first embodiment of the present invention.

Referring to FIG. 3, the first embodiment of the present invention is an example in which the home server 310 recognizes the user's situation through the natural language syntax received from the electronic device 300 and controls the home device 130 accordingly to be.

The electronic device 300 transmits the natural language syntax to the home server 310 (step 301). The home server 310 obtains the received natural language syntax, and determines whether the natural language syntax includes the home device information (operation 303). Then, the home server 310 selects a home device according to the determination result. In the case where the home device information is not included in the natural language syntax, at least one home device previously set corresponding to the natural language syntax may be selected in operation 305. Thereafter, the home server 310 generates a control command for the selected home device corresponding to the natural language syntax (step 307).

For example, steps 305 through 307 may be presented in Table 1.

Natural language syntax information At least one preset home device selection Control command for the selected home device Return home. Air conditioning and lighting Air Conditioner 20 Road Setting and Lighting on Sleeping, sleeping, Bedroom lighting and heating Bedroom lighting off and heating on cold Heating Heating on

For example, when the home server 310 receives a natural language phrase such as 'sleep' from the electronic device 300, the home server 310 may store at least one home device 310 in the home, For example, air conditioning and lighting can be selected (step 305). After that, the home server generates a control command for setting the selected air conditioner at 20 degrees, and generates a control command for powering the illumination (Step 307). In step 309, the home server 310 controls the home device 320 according to the control command according to the generated control command.

 According to a modification of the first embodiment, when home device information is included in the natural language syntax received by the home server 310 in step 305, the home device included in the natural language syntax can be controlled.

Further, in another embodiment, after step 309, the home server 310 may transmit an operation list related to the selected at least one home device to the electronic device, and, of the operation list, Lt; / RTI > Accordingly, the home server 310 may generate a control command according to the selected home device operation to control the selected home device.

In addition, although the first embodiment has exemplified one electronic device, the home server can receive the natural language syntax from at least one electronic device. Accordingly, when the natural language syntax is provided from the at least one electronic device, the home server may change the operation of controlling the home device according to the natural language syntax.

4 is a flowchart of a home network system according to a second embodiment of the present invention.

Referring to FIG. 4, the second embodiment of the present invention uses home server 410 information stored by a user in electronic device 400 to identify the user's situation, It is an example to control.

The home server 410 confirms whether or not an alarm is set in the electronic device 400 (step 401). When the alarm setting is confirmed in the electronic device 400, the home server 420 acquires time information on the alarm setting from the electronic device 400 (step 403). Here, the process of acquiring the time information on the alarm setting from the electronic device 400 may be performed, for example, by the home server 410 periodically transmitting a request message for setting an alarm to the electronic device 400, There may be a way to receive messages. The response message includes time information on an alarm setting.

After that, the home server 410 confirms the home device operation history information corresponding to the time information of the alarm setting (Step 405), and controls the operation of at least one home device set in advance in correspondence with the home device operation history information (Step 407). The home server 410 may control the home device 420 according to the generated control command (step 409).

Here, the home device operation history information may be, for example, information in which at least one home device set in advance and the operation of the at least one home device set in advance are mapped. Also, the home device operation history information may be information regarding an operation previously performed by at least one home device set in advance.

For example, steps 405 to 407 may be presented in Table 2.

Time information about alarm settings Home device operation history information Before change / 6 am Power on the lights at 6 am (before change),
Coffee maker works from 5:55 am (before change)
Power on the lights at 7 am (after change)
Coffee maker works from 6:55 am (after change) After change / 7 am

Referring to Table 2, for example, the time information for the alarm setting may be 6 am. Accordingly, if an alarm sounds in the electronic device 400 at 6:00 am, the home server 410 can power the lighting device at 6:00 am and control the coffee maker to operate at 5:55 am. As another example, if the user changes the time information for the alarm setting from 6:00 am to 7:00 am, the home server 410 powers the lights at 7:00 am and at 6:55 am, As shown in Fig.

According to a modification of the second embodiment, the home server 410 can determine whether the user is indoors according to the field strength of the electronic device 400, and thereby control the home device 420 according to the home device operation history information. That is, the home server 410 may check whether the alarm is set up (step 401) by checking whether there is an indoor electronic device 400 or not. Accordingly, the home server 410 determines whether the user is indoors, and if there is no user in the room, the home server 410 can confirm the home device operation history information when the user is not in the room. Accordingly, unnecessary home device operation in the home can be controlled.

The radio wave intensity may be, for example, a Bluetooth signal intensity.

In addition, the home server 410 may determine whether the user of the electronic device has gone out when the strength of the Bluetooth signal is weakened or disappears, for example. Alternatively, If the recognized Bluetooth signal suddenly disappears, it can be determined that the user has turned off the Bluetooth function.

5 is a flowchart of a home network system according to a third embodiment of the present invention.

Referring to FIG. 5, in the third embodiment of the present invention, when the user controls the home device 520, the home server 510 grasps the user's situation and controls the preset home device 520 Yes.

The home server 510 confirms whether the home device 520 is operating (operation 501). When the home server 510 confirms the operation of the home device 520, the home server 510 can confirm the home device operation history information in step 503. That is, for example, when the user applies power to the TV in the house, the home server 510 can confirm that the power is turned on to the TV, and confirm the history information of the TV and other home devices. For example, the other home device operation history information may include information that is mapped to operate the illumination and the illumination to be darkened. Also, the home device operation history information may include information about an operation previously performed by the at least one home device. For example, in consideration of the fact that the home server prefers the environment in which the user dims the lighting when the TV is viewed last time, it is possible to store the home device operation history information for creating the user's preferred environment in the home device operation history information have.

In step 505, the home server 510 may generate a control command indicating an operation of the at least one home device in response to the home device operation history information. The home server 510 may control the predetermined at least one home device according to the generated control command (step 507).

6 to 9 illustrate a flowchart of a specific system and a home server operation according to the first and second embodiments described above.

6A is a diagram illustrating a display screen of an integrated application according to an application of the first embodiment of the present invention.

Referring to FIG. 6A, the electronic device can confirm the environment and status according to other users in the room through the integrated application. That is, a plurality of users can use the chat window function in the dialog window function of the integrated application.

For example, if the user jack is at home, the home server may send the status (e.g., air conditioning power, gas oven lock) for the home devices in the room to the electronic device and provide it to the electronic device (611) .

In another example, if the user jack is to leave the home, the home server may send the status to the electronic devices (e. G., Lock the interior door lock, turn off the front door) (611).

In the electronic device, if a natural language phrase such as 'I am going home' is inputted (613), the home server acquires the natural language syntax and positions the user by GPS, and transmits the route from the positioned location to the home The estimated arrival time can be calculated (615).

Thereafter, the home server may transmit the calculated information to the electronic device, and the electronic device may provide the calculated information to the user (617). The calculated information may include an operation list and estimated arrival time information and a traffic route for at least one home device selected by the home server. The list of actions for the at least one home device may include, for example, the air conditioning time of the living room.

Accordingly, if the electronic device confirms the operation of the air conditioner in the operation list of the dialog function, the home server may set the air conditioner at an appropriate temperature according to the user's preference (619).

6B is an operation flowchart of the home server according to the application of the first embodiment of the present invention.

Referring to FIG. 6B, the home server obtains the natural language syntax inputted from the electronic device (Step 601). The home server determines whether or not the home device information is included in the natural language syntax, and selects a home device according to the determination result. For example, if the home device information is not included according to the determination result, at least one home device set in advance corresponding to the natural language syntax may be selected (step 603). The process of selecting the at least one home device may be performed through a control command input from the electronic device, and the home server may automatically select the at least one home device. The home server may control the selected at least one home device (step 605).

7A is a diagram illustrating a screen of an integrated application according to an application of the second embodiment of the present invention.

Referring to FIG. 7A, time information on an alarm setting may be stored in the electronic device. For example, the time information for the alarm setting is 7 am. The home server may obtain time information on the alarm setting stored in the electronic device (701). The home server can check the home device operation history information corresponding to the time information for the alarm setting, and control at least one home device set in advance in response to the checked home device operation history information (703). That is, the home server can power on the coffee maker at 7:00 am and set the room temperature to 24 degrees by operating the air conditioner (703). The home server can communicate the state of the coffee maker and the state of the air conditioner to the electronic device so that the electronic device can check the state of the coffee maker and the state of the air conditioner (705).

FIG. 7B is a diagram illustrating an operation flowchart of the home server according to the application of the second embodiment of the present invention.

Referring to FIG. 7B, the home server may obtain time information on an alarm setting from the electronic device (711). The home server confirms the home device operation history information corresponding to the time information on the alarm setting, and can control the home device accordingly (713). That is, the home server obtains the time information on the alarm setting from the electronic device by confirming the alarm setting, and confirms the home device operation history information corresponding to the time information on the alarm setting. Thereafter, the home server generates a control command indicating an operation of at least one home device set in advance corresponding to the home device operation history information, and controls the at least one home device set in advance

The home server may forward information about the state of the controlled home device to the electronic device (715).

FIG. 8 is a diagram illustrating a screen of an integrated application according to another application of the second embodiment of the present invention.

Referring to FIG. 8, the home server identifies the states of electronic devices and home devices in the room. The home server confirms the state of the user and the home device in the entire room and each room, and transmits the information to the electronic device (801). For example, the home server can identify the electronic device using Bluetooth. When the home server identifies the user and confirms the user, the home server can control the home device in accordance with the user (803). The home server operation history information may be used to provide the environment suitable for the user. Here, the home device operation history information may be the user's usual preferred room temperature, and may additionally present information such as a favorite TV program and a day schedule. The home device operation history information can refer to the information that the latest user has set by controlling the home device, and accordingly, the home server can update the home device operation history information to generate updated home device operation history information .

In another embodiment, when the user is playing back a moving image on his / her electronic device, the user can adjust the indoor lighting according to the type of the moving image. In other words, does the user play the video? The environment log information is generated based on the information on the normally set illumination, and the home device can be controlled through the generated environment log information.

FIG. 9 is a diagram illustrating a screen of an integrated application according to another application of the second embodiment of the present invention.

Referring to FIG. 9, the home server recognizes the user's outgoing (901). For example, the home server uses the strength of the Bluetooth signal of the user's electronic device to set a power saving mode by controlling the home device that does not need to operate when the user goes out (903).

Accordingly, the home server transmits a result of controlling the home device to the power saving mode to the electronic device (905).

10 is a diagram illustrating a relationship between an integrated application of an electronic device and a home server according to an embodiment of the present invention.

Referring to FIG. 10, when the integrated application is driven in the electronic device, the integrated application can display the home link function 1000 and the dialog window function 1020.

The home link function 1000 can confirm the statuses of the home, the home, and the home device through the home server 1010 and directly control the home device through the home server 1010 (1001). In addition, the home link function 1000 may check (1001) the electronic device of the user associated with the home server 1010 in the house.

The dialog function 1020 may control the home device in an interactive manner between the home server 1010 and the user. Here, the interactive method may include a method of inputting text, a method of recognizing speech, and a method using natural language syntax.

Also, when the home server 1010 has controlled the home device (1003), the state of the controlled home device can be presented. In addition, the electronic device can identify the status and the status of the user based on the entered natural language syntax, and present the corresponding information. For example, when the user inputs a natural language phrase such as " I'm going home ", the information may be a home arrival forecast time and a traffic situation based on the location of the home user.

When the integrated application is operated, the home link function 1000 and the dialog function 1020 can be selectively presented by the user (1005).

11 is a diagram illustrating a menu tree of an integrated application according to an embodiment of the present invention.

Referring to FIG. 11, the integrated application may be composed of a step 1100 for indicating an indoor situation, a step 1110 for displaying a status of each room and a dialog window function, and a step 1120 for indicating details of the step 1 have.

Step 1100 includes a home link function icon, a dialog window function icon, and a dialog window shortcut icon.

If the integrated application of the electronic device recognizes the touch input to the home link icon, it may present information on the first step 1110. [ As an example, the first step 1110 may display an entire house state and an icon of each room.

For example, when the entire house icon of the first stage 1110 is input, information on the third stage 1120 can be presented. For example, the third step 1120 may present security, power, and item icons, and when one of the icons is touched, detailed information on the touches may be confirmed.

When the electronic device receives the room 1 item, the integrated application can present temperature, humidity, air, and icons for the room, and when the user touches the icon, the temperature, humidity, Can be presented.

12 is a diagram illustrating a function of a home link of an integrated application according to an embodiment of the present invention.

Referring to FIG. 12, the home link function of the integrated application presents state information about the interior.

Specifically, the home link screen 1200 provides status information on security and power. In one example, security 1201 state, power state may be presented. In addition, the list 1 (1221), the list 2 (1223), and the more items can present additional information according to preset items. That is, the home link screen can display status information on the current collector.

The user can check the status of each room through an input method such as Flick on the home link screen 1200. [ For example, the user can check the status of the living room and the status information 1230 of the bedroom. When the user checks the living room, the room 1 state can present temperature and humidity air, and other items and status information about it.

The home link screen 1240 includes a title portion 1245, an integrated application icon 1241, a dialog window shortcut icon 1243, and a content portion 1251. The content portion may include a portion 1247 displaying the user in the house and a status message portion 1249. The status message part 1249 can express the overall situation of the house, for example, present security and current power issues.

13 is a diagram illustrating security and power states of a home link function according to an embodiment of the present invention.

13, the security screen 1300 of the integrated application can be presented when the security icon 1301 is touched on the user home link screen 1300. In one example, the security screen 1300 may include a title portion 1301, a room name portion 1303, a camera viewport portion 1305, a secure state portion 1307, and a sensor state portion 1309.

The room name portion may be presented as a living room or a bedroom as an example. The camera field of view 1305 may provide different fields of view due to left, right, up and down flicks when a camera is installed. On the other hand, if the room is not equipped with a camera, the room image setting may be possible.

The integrated application's power state 1310 may be presented when a power icon is touched on the user home link screen 1300. As an example, the power status screen 1310 may include a title portion 1311, a power consumption graph and a portion 1313 representing power consumption, and a home device portion 1315 consuming current power.

14 is a diagram illustrating an item of a home link function and a dialog window function of an integrated application according to an embodiment of the present invention.

14, the home link function item 1400 includes an item 1401 for adding a home device, an item 1403 for powering on the lamp, and an item 1405 for indicating the name of the home device . When the item indicating the name of the home device is touched, a setting screen for controlling the installation place and details of the home device can be provided.

The dialog window function 1410 includes a user command item 1411 for presenting a natural language syntax entered by the user, a home server feedback item 1413 for providing feedback of the home server to the natural language syntax, And an action item 1415 indicating an item and a place.

15 is a diagram illustrating a basic operation in an integrated application according to an embodiment of the present invention.

Referring to FIG. 15, the home screen of the integrated application may include a home link icon and a dialog (home station) icon.

When the user touches the home link icon, state information on the current home screen among the home link screens can be presented (1501). The information about the current collector may include, for example, security, power, and item icons.

Also, when the user touches the dialog window icon, the dialog window can be presented (1503).

If the user flicks 1507 on the home link screen, state information on the living room can be presented, for example. The state information on the living room may include information on the temperature and humidity. As an example, the situation of each room may be checked according to the direction of flicking.

In addition, if the user touches the shortcut function icon on the home link screen, the dialog window can be presented (1505).

16 is a diagram illustrating a power status and a correlation among items on a home link screen according to an embodiment of the present invention.

Referring to FIG. 16, when a user touches a power item on the home link screen, the integrated application can display a power status screen (1601). For example, the power status screen may indicate the power consumption of the air conditioner of the living room, the power consumption of the living room, and the power consumption of the kitchen.

Further, when the user touches the additional item on the home link screen, the integrated application can display the item screen (1603). For example, the item screen may provide an operation item for instructing operation of a lamp, an air conditioner, a speaker, a clock, and the like in each room.

17 is a diagram illustrating an operation of controlling a device on a home link screen of an integrated application according to an embodiment of the present invention.

Referring to FIG. 17, when the user touches the more icon on the home link screen, the electronic device can present the item screen. The item screen may provide an operation item (1701) for instructing an operation for a home device including a lamp, an air conditioner, a speaker, and a clock in each room.

Accordingly, when the user touches the power icon for the lamp in the bedroom as an example in operation item (1703), the state of the power icon for the lamp in the bedroom is changed on the operation screen, The lamp can be controlled to turn on or off. That is, the user can immediately change the power supply of the home device without switching the screen by using the home link function.

In addition, if the user touches the icon for the lamp in the bedroom in the operation item (1705), the detail setting item for the lamp in the bedroom can be provided.

18 is a diagram illustrating an operation of controlling a home device through a dialog function of an integrated application according to an embodiment of the present invention.

Referring to FIG. 18, a method of inputting a natural language phrase by a user on a dialog window may include a method 1801 of touching an input action icon and a method of touching a voice icon 1803. Hereinafter, it is assumed that the natural language syntax inputted by the user is 'I am going home'. For example, the electronic device can receive a natural language phrase by voice by touching a voice icon (1803).

On the other hand, if the user touches the input action icon, the electronic device can receive the natural language syntax as text (1801).

The home server selects at least one home device preset in correspondence with the natural language syntax and transmits an operation list related to the selected at least one home device to the electronic device (1809). The operation list related to the home device may include expected arrival time and return traffic information in consideration of the location of the user.

Accordingly, if the home server receives an approval request for the operation list related to the selected home device from the electronic device (1811), the home server can control the home device according to the selected home device operation.

19 is a diagram illustrating home device control according to an operation list of a dialog window according to an embodiment of the present invention.

Referring to FIG. 19, when the electronic device receives the natural language syntax in the above-described two methods, the home server selects at least one home device set in advance corresponding to the natural language syntax, To the electronic device.

In one example of an operation list for the at least one home device, when the electronic device flicks (1901) an operation item of the air conditioner of the living room, the electronic device can cancel the air conditioner operation item of the living room.

Also, the electronic device may adjust the detailed settings of the air conditioner of the living room, for example, when tapping the operation item of the air conditioner of the living room (1903), among the operation list related to the at least one home device.

20 is a diagram illustrating a structure of a home server according to an embodiment of the present invention.

20, the home server may include a control unit 2000, a transceiver unit 2010, a storage unit 2020, and an interface unit 2030.

The transceiver 2010 can receive a natural language sentence input to the electronic device. In addition, a request message and a response message can be transmitted and received to confirm whether or not an alarm is set in the electronic device.

Also, the transceiver 2010 can perform near-field communication with the electronic device, and can transmit information on the state of the home device to the electronic device through the instant message server.

Also, the transceiver 2010 may include a Bluetooth module, thereby receiving a Bluetooth signal of the electronic device.

The control unit 2000 determines whether the received natural language syntax includes the home device information, selects a home device according to the determination result, generates a control command for controlling the selected home device, Can be controlled.

The control unit 2000 transmits the operation list related to the selected at least one home device to the electronic device, receives from the electronic device the home device operation information selected by the user from the operation list, To control the selected home device.

Also, the control unit 2000 confirms the home device operation history information corresponding to the time information for the alarm setting, generates a control command instructing the operation of at least one home device set in advance corresponding to the home device operation history information And control the predetermined at least one home device.

Also, the control unit 2000 can confirm whether the home device is operating, and confirm the home device operation history information different from the home device in accordance with the confirmation of the home device operation. Also, it is possible to control at least one home device that is set in advance by generating a control command instructing operation of at least one home device set in advance in correspondence with the home device operation history information.

The storage unit 2020 may store the home device operation history information. The home device operation history information may include at least one predetermined home device different from the home device, and information mapping a predetermined one home device operation with the home device. Also, the home device operation history information may include information about an operation previously performed by the at least one home device set in advance.

That is, when the user controls the operation of the home device, the controller 2020 recognizes the surrounding environment according to the operation of the home device and determines an operation mode for at least one home device preset according to the environment do. Accordingly, the storage unit may store an operation mode for the predetermined at least one home device.

Also, the storage unit 2020 may store an integrated application capable of communicating with the electronic device, and may store an application corresponding to each of the home devices.

The interface unit 2030 may include a communication unit for the home server to control the home device. That is, the interface unit 2030 can communicate with the home device using an application stored in the storage unit. If the additional home device is found, the additional home device can be included in the home network system.

Meanwhile, it will be appreciated that the method and apparatus for controlling a home device according to an embodiment of the present invention can be implemented in hardware, software, or a combination of hardware and software. Such arbitrary software may be stored in a memory such as, for example, a volatile or non-volatile storage device such as a storage device such as ROM or the like, or a memory such as a RAM, a memory chip, a device or an integrated circuit, , Or a storage medium readable by a machine (e.g., a computer), such as a CD, a DVD, a magnetic disk, or a magnetic tape, as well as being optically or magnetically recordable. The graphic screen update method of the present invention can be implemented by a computer or a mobile terminal including a control unit and a memory, and the memory is a machine suitable for storing programs or programs including instructions embodying the embodiments of the present invention It is an example of a storage medium that can be read.

Accordingly, the invention includes a program comprising code for implementing the apparatus or method as claimed in any of the claims herein, and a storage medium readable by a machine (such as a computer) for storing such a program. Further, such a program can be electronically transferred through any medium such as a communication signal transmitted via a wired or wireless connection, and the present invention appropriately includes the same.

Also, the home-device control method and apparatus according to an embodiment of the present invention may receive and store the program from a program providing apparatus connected by wire or wireless. The program providing apparatus includes a memory for storing a program including instructions for causing the graphic processing apparatus to perform a method of controlling a home device, information required for a home device controlling method, and the like, A communication unit for performing communication, and a control unit for transmitting the request to the graphic processing apparatus or automatically transmitting the program to the transmission / reception apparatus.

Claims (17)

A method for a home server to control a home device,
Receiving a natural language phrase from an electronic device;
Selecting at least one home device corresponding to whether the home device information is included in the received natural language syntax;
And generating a control command for controlling the selected home device to control the selected at least one home device.
The method according to claim 1,
Further comprising the step of selecting at least one home device corresponding to the home device information when the home device information is not included in the natural language syntax.
3. The method of claim 2,
Wherein the home device information includes at least one of a home device name, an Internet Protocol (IP) address, and a media control access (MAC) address. How to.
The method according to claim 1,
Wherein the natural language syntax is a syntax in which a user of the electronic device is input to the electronic device for receiving a service from the home device.
The method according to claim 1,
Transmitting an operation list related to the selected at least one home device to the electronic device;
Receiving, from the electronic device, home device operation information selected by a user from an operation list transmitted to the electronic device;
And controlling the selected home device by generating a control command corresponding to the selected home device operation.
A method for a home server to control a home device,
Acquiring alarm time information set in the electronic device from the electronic device;
Confirming home device operation history information corresponding to the acquired time information;
And controlling the at least one home device by generating a control command indicating an operation of at least one home device set in advance in correspondence with the home device operation history information.

The method according to claim 6,
Wherein the home device operation history information is information about an operation previously performed by the at least one home device.
A method for a home server to control a home device,
Checking whether the home device is operating,
Confirming the home device operation history information different from the home device in response to confirmation of the home device operation;
And controlling the at least one home device by generating a control command indicating an operation of at least one home device set in advance in correspondence with the home device operation history information.
9. The method of claim 8,
Wherein the home device operation history information is information about an operation previously performed by the at least one home device.
A method for an electronic device to control a home device through a home server,
Transmitting a natural language sentence input to an electronic device to a home server;
Receiving an operation list related to at least one home device from the home server;
And transmitting the operation information of the home device selected by the user from the received operation list to the home server.
10. The method of claim 9,
Wherein the home device information includes at least one of a home device name, an Internet Protocol (IP) address, and a media control access (MAC) address. How to.
11. The method of claim 10,
Wherein the natural language syntax is a syntax in which a user of the electronic device is input to the electronic device for receiving a service from the home device.
A home server for controlling a home device,
And a control unit configured to select at least one home device corresponding to whether the home device information is included in the received natural language syntax and generate a control command for controlling the selected home device And a control unit for controlling at least one selected home device.
14. The method of claim 13,
Wherein,
Wherein the at least one home device corresponding to the home device information is selected when the home device information is not included in the natural language syntax.
14. The method of claim 13,
Wherein the home device information includes at least one of a home device name, an Internet Protocol (IP) address, and a media control access (MAC) address.
14. The method of claim 13,
Wherein the natural language syntax is a syntax in which a user of the electronic device is input to the electronic device to receive a service from the home device.
14. The method of claim 13,
Wherein the control unit transfers the operation list related to the selected at least one home device to the electronic device, receives from the electronic device the home device operation information selected by the user from the operation list, And generates a control command to control the selected home device.

Images