KR20170001999A

KR20170001999A - Settop terminal, application for settop terminal, and operation method of server

Info

Publication number: KR20170001999A
Application number: KR1020150091826A
Authority: KR
Inventors: 임연준
Original assignee: 주식회사 엘지유플러스
Priority date: 2015-06-29
Filing date: 2015-06-29
Publication date: 2017-01-06

Abstract

An operating method of a settop terminal is disclosed. The operating method of a settop terminal according to an embodiment of the present invention includes the steps of: receiving a control command from a server, wherein the control command is generated according as whether an event signal generated based on the generation of an event corresponds to a preset command set; and visually displaying notification data corresponding to the generation of the event on a display corresponding to the settop terminal, based on the control command. Accordingly, the present invention can control the settop terminal through the operations of things and a voice command and can provide an IoT service which is more convenient.

Description

TECHNICAL FIELD [0001] The present invention relates to a set-top terminal, an application for a set-top terminal, and a method of operating the server.

The following embodiments relate to the operation of the server and the application for the set-top terminal.

Recently, Internet of Things (IoT) technology, in which objects communicate with each other, is being developed. Smart home, smart car, and so on, the objects can be connected to the network to control objects from a distance, and information related to the operation of objects can be easily identified.

Korean Patent Laid-Open No. 10-2011-0047764 (a method and apparatus for controlling a home network system using a mobile terminal, applicant: Samsung Electronics Co., Ltd.) discloses a process of connecting a mobile terminal to a home network, Receiving a list of devices connected to the home network from a gateway of the home network; displaying devices connected to the home network by the mobile terminal; Requesting status information of the selected device from the selected device through the gateway, receiving status information of the selected device from the selected device, and transmitting the status information and the user interface Is started.

Embodiments can enable inter-object communication. In addition, the embodiments can display contents detected by objects on a TV through a notification or a message, and users of an IoT service can easily check the contents detected by objects by checking a notification or a message displayed on the TV. In addition, the embodiments can control the set-top terminal using the operations of objects, thereby providing a more convenient IoT service to the user.

A method of operating a set-top terminal according to one aspect includes receiving a control command from a server, the control command being generated based on whether an event signal generated based on an event occurrence corresponds to a predetermined instruction set; And visually displaying notification data corresponding to the event occurrence on a display corresponding to the settop terminal, based on the control command.

The step of visually displaying the notification data on the display corresponding to the set-top terminal may include overlaying the notification data on the image displayed on the display.

The control command may be generated when the event generation signal generated based on the detection of the motion of the object of the event generating device corresponds to the predetermined instruction set.

The predetermined instruction set may include condition information defined on the basis of execution information of the event generator and execution information of the set-top terminal.

The method may further include receiving a selection input indicating whether to display the notification data on the display.

And generating, based on the selection input, an instruction set including execution information defined by the set-top terminal to display the notification data.

The step of visually displaying the notification data on a display corresponding to the set-top terminal may include displaying an image captured by the event generating apparatus that generated the event signal.

An application according to one side is stored in a memory of a set-top terminal and is executed by a processor, and the application is controlled by a server. The control command is a command for determining whether an event signal generated on the basis of an event corresponds to a predetermined instruction set Based on whether or not the event is generated based on the control command, visually displaying notification data corresponding to the event occurrence on a display corresponding to the set-top terminal.

And receiving a selection input indicating whether or not to display the notification data on the display.

A method of operating a server according to one side includes receiving an event signal generated based on an event occurrence from a first device; Confirming whether the event signal corresponds to a predetermined instruction set; Generating a control command corresponding to the instruction set based on the confirmation; And transmitting the control command to the second device, wherein the second device displays the notification data corresponding to the event occurrence visually on the display corresponding to the second device based on the control command do.

The instruction set may include condition information defined based on execution information of the first device and execution information of the second device.

The step of verifying whether or not the instruction set corresponds to the instruction set may include checking whether the event signal and the condition information are matched.

The step of verifying whether or not the instruction set corresponds to the instruction set may include searching the instruction set associated with at least one of the first device and the second device using the event signal.

The method may further include checking whether a session with the second device is established if the event signal is a text event generated based on a voice event input to the first device, 2 device may transmit the control command to the second device through the session based on confirmation of the setting of the session.

Receiving a registration request from the first device when the first device is paired with the wireless network equipment connected to the second device; And registering the second device based on the registration request.

Receiving the instruction set from the terminal and storing the received instruction set in a database.

The instruction set including: receiving condition information for controlling the second device from a user of the terminal; Exposing a second device list to the display of the terminal based on receipt of the condition information and receiving a selection input for the second device list from the user; Receiving execution information corresponding to the second device selected based on the selection input from the user; And generating the instruction set based on the condition information, the information of the second device, and the execution information.

The second device may be a set-top terminal.

Embodiments can enable inter-object communication. In addition, the embodiments can display notices or messages of the contents detected by the objects and the operation state on the TV, and the IoT service user can confirm the notifications or messages displayed on the TV, Can be confirmed. In addition, the embodiments can control the set-top terminal through operation of objects and voice commands, thereby providing a more convenient IoT service to the user.

1 is a diagram for explaining an IoT service providing system according to an embodiment.
2 is a flowchart illustrating an operation method of a server according to an exemplary embodiment of the present invention.
3A and 3B are views for explaining registration of a set-top terminal according to an embodiment.
4 is a diagram for explaining the setting of the instruction set according to one embodiment.
5A to 5C are views for explaining control of a set-top terminal according to an embodiment.
6 is a block diagram illustrating a server according to an embodiment.
7 is a view for explaining the operation of a set-top terminal according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

Various modifications may be made to the embodiments described below. It is to be understood that the embodiments described below are not intended to limit the embodiments, but include all modifications, equivalents, and alternatives to them.

The terms used in the examples are used only to illustrate specific embodiments and are not intended to limit the embodiments. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as ideal or overly formal in the sense of the art unless explicitly defined herein Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

1 is a diagram for explaining an IoT service providing system according to an embodiment.

Referring to FIG. 1, an Internet of Things (IoT) service providing system according to an embodiment includes a server 110, a home IoT device 121, and a terminal 130.

The server 110 includes a connection gateway server (CGS) 111, a session server (SS) 112, an application server (AS) 113, an event processing server (EPS) 114, a database server (DS) 115, and an IoT service server (ISS) 116.

The CGS 111, the SS 112, the AS 113, the EPS 114, the DS 115 and the ISS 116 may be logically separated in the server 110 as a single physical device. The CGS 111, the SS 112, the AS 113, the EPS 114, the DS 115, and the ISS 116 may be separate physical devices.

The CGS 111 is connected to the home IoT device 121. More specifically, if there is a connection request of the home IoT device 121 and there is a response of the CGS 111 to the connection request, a session can be established between the CGS 111 and the home IoT device 121. The CGS 111 can receive the traffic of the home IoT device 121. [ When a session is established between the CGS 111 and the home IoT device 121, the CGS 111 can notify the AS 113 that the session has been established.

The SS 112 manages the session of the home IoT device 121. SS 112 may be a memory-based data store. For example, the SS 112 may store session information of the home IoT device 121. The session information stored in the SS 112 may be updated. The AS 113 can inquire the session information of the home IoT device 121 through the SS 112. Also, when it is necessary to confirm whether a session is established between the home IoT device 121 and the CGS 111, the AS 113 can confirm whether or not a session is established through the SS 112.

The AS 113 generates a control command for controlling the home IoT device 121. The AS 113 can send a control command to the CGS 111 and the CSG 111 can send a control command to the home IoT device 121 through the session. In addition, the AS 113 can manage the profile of the home IoT device 121 through the DBS 115. The AS 113 can also collect the state of the home IoT device 121 and store the state in the DBS 115. [ Also, the AS 113 can inquire the state of the home IoT device 121 through the DBS 115.

Also, the AS 113 can register the home IoT device 121 in the DBS 115. Fig. For example, if there is a registration request of the home IoT device 121 from the terminal 130, the AS 113 can register the home IoT device 121. [

The EPS 114 processes the event signal transmitted from the home IoT device 121. When the event signal is passed to the EPS 114, the EPS 114 may query the DBS 115 for a set of instructions related to the event signal. For example, if an event signal is received indicating "switch on the living room" is received, the EPS 114 may query the instruction set associated with the switch in the living room. Here, the switch in the living room is a type of the home IoT device 121, and the "living room switch is turned on" such as "turn on the settop terminal when the living room switch is turned on" May be searched for. The EPS 114 may request the AS 113 to control the home IoT device 121 based on the instruction set and the AS 113 may generate the control instruction corresponding to the instruction set. For example, the AS 113 may generate a control command to turn on the set-top terminal, which is the home IoT device 121, and generate a control command to turn on the toilet switch, which is the home IoT device 121 . The CGS 111 can transmit each of the generated control commands to the set-top terminal and the toilet switch.

The DBS 115 stores the IoT service subscription information of the user. For example, the DBS 115 may store subscription information of the home IoT device 121 associated with the IoT service. The subscription information of the home IoT device 121 may include the type of the home IoT device 121 and the like. In addition, the DBS 115 may store at least one of the state, control, and profile of the home IoT device 121. Also, the DBS 115 may store the mapping information of the user and the home IoT device 121. [ The DBS 115 may also store a set of instructions.

The ISS 116 is a server interworking with an application stored in the terminal 130. The ISS 116 may send a push message to the terminal 130 and the application may display a push message on the display.

The server 100 can be divided into a place where the traffic of the home IoT device 121 is received (CSG 111) and a place where the traffic of the terminal 130 is received (the AS 113 and the ISS 116) . Traffic may be dispersed, and the operation of the server 110 may be more efficient.

In order for the user to use the IoT service, objects in the home 120 must be able to communicate with each other. The home IoT device 121 corresponding to the object in the groove 120 communicates with the Internet to realize the object Internet service. For example, the home IoT device 121 may include a switch corresponding to the light, a door lock corresponding to the front door, or an opening sensor corresponding to the window. The home IoT device 121 may further include smart household appliances such as smart refrigerators and smart washing machines.

For the IoT service, the home IoT device 121 may be paired with the wireless network equipment located in the home 120. For example, a home IoT device 121 such as a switch, an outlet, an open sensor, and the wireless network equipment can be paired in a Z-wave manner via a USB dongle of a wireless network equipment. Also, the home IoT device 121 may communicate with the server 110 and may transmit an event signal to the server 110. [

2 is a flowchart illustrating an operation method of a server according to an exemplary embodiment of the present invention.

The server according to one embodiment may correspond to the server 110 shown in FIG.

Referring to FIG. 2, a server according to an embodiment receives an event signal from a first device (210). Here, the first device may be a user terminal or a home IoT device. When an event occurs in the home, the first device may generate an event signal indicating that the event has occurred. For example, when the living room switch is turned on and the living room light is turned on, the living room switch can generate an event signal indicating that the living room switch is turned on to the server and can transmit it to the server. In another example, if the terminal receives a voice event "Turn on the set-top terminal" from the user, the terminal can convert the voice event into a text event. The terminal can transmit a text event to the server.

The event signal may include an event ID. When an event occurs, the first device may include an event ID corresponding to the generated event in the event signal, and may transmit an event signal including the event ID to the server. In the above-described example, the event ID of the event signal generated based on each of the event that the living room switch is turned on and the voice event may be different from each other.

The server checks whether the event signal corresponds to a preset instruction set (120). The server generates a control command based on the confirmation in step 120 (130).

A set of instructions may be generated at the terminal. The terminal may receive condition information including information of the first device from the user (for example, identification information such as the name of the first device). When the condition information is received, the terminal can expose the second device list. The terminal may receive a selection input for the exposed second device list. According to one aspect, the first device included in the condition information can be visually deactivated in the second device list. If the second device is selected, the terminal can receive execution information corresponding to the second device. That is, the user can input execution information. The terminal can generate an instruction set using condition information, information of the second device, and execution information, and can transmit the instruction set to the server. The server can store a set of instructions in a database.

The server can retrieve a set of instructions containing the condition information via the database. For example, a set of instructions may be retrieved that includes condition information of "when the living room switch is on" or "when the living room switch is turned off ".

The server can check whether the event signal matches the condition information of the retrieved instruction set. Based on the confirmation result, the server can generate the control command using the matched instruction set. The server can generate the control command using the execution information of the matched instruction set. For example, the server may generate a control command for the set-top terminal so that the set-top terminal is powered on.

In another embodiment, the instruction set may include execution information of the second device. For example, the instruction set may include execution information of the second device, such as "power on set top terminal "," raise volume, " .

The first device can receive a voice event from the user. For example, the first device may be a terminal, and the terminal may receive a voice event "power on set-top terminal" from the user through the voice recognition function of the terminal. The terminal can convert a voice event into a text event through STT (Speech To Text).

An event signal received by the server, that is, a text event, may include an event ID. The event ID can be used to identify the event signal. For example, a text event generated based on a voice event may be assigned a unique event ID. The server uses the event ID to know that there is a voice command of the user. The server can search the database using the event ID. The server can search for a set of commands including keywords such as "channel "," KBS ", "7 ", and the like. For example, the instruction set of "channel KBS" or "channel 7" may be retrieved. Here, the server can further use the event ID to search for the instruction set. The event ID of the retrieved instruction set and the event ID of the text event may be the same.

The server can check whether the text event corresponds to the retrieved instruction set. If the text event corresponds to a set of instructions, the server can generate control commands based on the set of instructions.

The server can confirm whether or not a session is established with the second device. When the control command is generated, the server can confirm whether or not the session is established. For example, the session setup and session information between the second device and the server can be stored in the memory, and the server can confirm whether the session is established using the stored session information or the like. The set-top terminal receiving the control command through the session can change the channel to KBS.

In yet another embodiment, a notification corresponding to the event signal may be displayed on the display corresponding to the second device. In this case, the instruction set may be similar to that including condition information and execution information. For example, the instruction set may be "display error on door if door lock password is incorrect 5" or "display door detection on TV if door view detects motion".

When an event occurs, the first device can send an event signal to the server. For example, if the password of the door lock is incorrect five times, the door lock may transmit an event signal to the server indicating that the password is incorrect five times.

The server may receive the event signal and may use the event signal to retrieve a set of instructions including execution information of the first device. For example, the server can search for a set of commands using keywords such as "door lock "," password ", and the like. The server can check whether the event signal corresponds to the retrieved instruction set.

If the event signal corresponds to a retrieved instruction set, the server may generate a control instruction based on the instruction set. More specifically, the server may generate a control command such that the event signal is displayed on a display corresponding to the second device. For example, if the retrieved instruction set is "display the error occurred on the TV 5 times if the password of the door lock is wrong ", the server can generate a control command so that the error occurrence is displayed on the TV. Upon receiving the control command, the set-top terminal can display an error on the TV.

The server sends a control command to the second device (140). The second device may operate according to the control command.

In one embodiment, if the wireless network equipment and the first device connected to the second device are paired, the server can receive the registration request from the first device and register the second device based on the registration request . For example, when a set-top terminal and a wireless router located in a home are wired and a wireless router and a terminal are connected to Wi-Fi, the terminal can request the server to register the set-top terminal and the server can register the set-top terminal. The set-top terminal can be a home IoT device.

The operation method of the server described with reference to FIG. 2 may be applied to the operation of the server 100 shown in FIG.

3A and 3B are views for explaining registration of a set-top terminal according to an embodiment.

When the terminal application is executed, a screen 310 may be displayed on the display. In the example shown in FIG. 3A, the display may display the operation state information of the smart home appliance or the like. A smart home appliance can operate as a home IoT device.

Also, a button 311 for registering the set-top terminal may be displayed on the display. If there is an input to the button 311, the terminal application may display the screen 320 on the display.

The display may display a service available to the user when the set-top terminal is registered. For example, it can be displayed on the display that a service capable of controlling the set-top terminal by speech recognition can be used. If there is an input to the register button 312, the terminal application may display the screen 330 on the display.

The identification information of the wireless network equipment connected to the set-top box can be displayed on the display. If a password is entered and the user is authenticated based on the entered password, the terminal application may display the screen 340 on the display.

A screen 340 is a screen showing that the terminal and the wireless network equipment are being paired. For example, the terminal and the wireless network equipment can be connected via Wi-Fi. When the terminal and the wireless network equipment are paired, the terminal application can display the screen 350. Based on the pairing, the terminal can request registration of the set-top terminal to the server, and the server can register the set-top terminal. When the set-top terminal is registered, the terminal application can output a message 351 indicating that the set-top terminal is registered. If there is an input to the confirmation button of the message 351, the terminal application may display the screen 360 on the display. The operation state information 361 of the set-top terminal can be displayed on the display.

The set-top terminal may need a set-top application in order for the set-top terminal to operate according to the control command of the server. Set-top applications can be provided in application markets such as playstores. For example, suppose there is an instruction set that says, "When the living room switch is on, turn on the set-top terminal and play music." When the living room switch is turned on, the set top application can turn on the set top terminal and play music according to the control command.

4 is a diagram for explaining the setting of the instruction set according to one embodiment.

Referring to FIG. 4, the terminal application may display a screen 410 on the display. The terminal application may display a user interface for setting the instruction set on the display. In one embodiment, the instruction set may include condition information defined on the basis of execution information of the first device and execution information of the second device. Here, the first device is a home IoT device and the second device is another home IoT device.

The user can set the condition information through the area 411 and set the execution information through the area 412. [ The terminal can transmit the set of instructions to the server, and the server can store the set of instructions in the database.

5A to 5C are views for explaining control of a set-top terminal according to an embodiment.

5A to 5C, the second device can be controlled based on the voice command input through the first device. Here, the first device may be a terminal and the second device may be a home IoT device (e.g., a set-top terminal).

When the voice recognition function of the terminal application is executed, the screen 510 may be displayed on the display. When there is an input for a microphone-shaped button, the input interface (e.g., microphone) of the terminal is activated, and the terminal application can receive a voice event from the user.

5B-5C, voice commands for controlling the home IoT device are shown.

Each of the voice commands shown in Figures 5B through 5C may be stored in the server as a set of instructions. When a voice command corresponding to a command set not stored in the server is inputted, the terminal can output a message to the display to re-input an error message or a voice command. For example, assuming that there is no channel 999, if a voice command of "channel 999" is input to the terminal, the server searches for the command set associated with "channel 999 ". The server does not store the command set related to "channel 999 ", so that the server can send an error message to the terminal, and a message may be displayed on the display to re-enter the voice command.

6 is a block diagram illustrating a server according to an embodiment.

6, a server 600 according to an exemplary embodiment of the present invention includes a receiving unit 610, an identifying unit 620, a generating unit 630, and a transmitting unit 640.

The receiving unit 610 receives an event signal from the first device.

The confirmation unit 620 confirms whether the event signal corresponds to a predetermined instruction set. For example, the instruction set may include condition information defined on the basis of execution information of the first device and execution information of the second device. The confirmation unit 620 can confirm whether the event signal and the condition information are matched.

In one embodiment, the verifier 620 may use an event signal to retrieve a set of instructions associated with at least one of the first device and the second device.

The generation unit 630 generates a control command corresponding to the instruction set based on the confirmation. In addition, the generator 630 may generate the control command so that the event signal is displayed on the display corresponding to the second device.

The transmitting unit 640 transmits the control command to the second device. For example, the second device may be a set-top terminal. The set top application stored in the set top terminal can display information on the display or execute music according to a control command.

If the event signal is a text event generated based on a voice event input to the first device, the server 600 may further include a session establishment confirmation unit for confirming whether or not a session with the second device is established. The transmitting unit 640 may transmit the control command to the second device through the session based on confirmation of the setting of the session.

In one embodiment, the server may further include a registration unit. The registration unit may register the second device based on the registration request received from the first device when the first device and the wireless network equipment connected to the second device are paired.

The first device may be a terminal. When the first device is a terminal, the terminal can receive a command set from the user and can transmit the command set to the server. The server 600 may further include a database for storing a set of instructions.

1 through 5 can be applied to the matters described with reference to FIG. 6, detailed description thereof will be omitted.

7 is a view for explaining the operation of a set-top terminal according to an embodiment.

The set top terminal 710 receives a control command from the server. The terminal receiving the control command is not limited to the set-top terminal but may be various display devices (TV, notebook, etc.). Here, the control command is generated on the basis of whether the event signal generated based on the event occurrence corresponds to a predetermined instruction set. For example, the control command may be generated when the event generation signal generated based on the detection of the motion of the object of the event generating device corresponds to a predetermined set of instructions. The event generating device may be a door view, a gas lock, a power meter, and the like. For example, let us consider a door view as an event generating device. The door view may be a means of viewing the house (for example, in front of a hallway or a front door) in the house, and may include a sensor for detecting movement. If the door view senses a person in front of the porch or senses a person's movement, the door view can generate an event signal. The door view can transmit an event signal to the server, and the server can check whether or not the event signal corresponds to a preset instruction set. As a result of checking, if so, the server can generate a control command and transmit the control command to the set top terminal 710. [

The set-top terminal 710 visually displays the notification data corresponding to the event occurrence on the display 720 corresponding to the set-top terminal, based on the control command. For example, the set-top terminal 710 can overlay the notification data on the image displayed on the display 720 and display it. In the above example, the set-top terminal 710 may display a notification on the display 720 indicating "There is a person before the front door." In addition, the set-top terminal 710 can display an image captured by the event generating device on the display 720. [ The user can view the real time image taken by the door view through the display 720. When the event generating device senses the motion of the object and / or the object so that the image captured by the event generating device is displayed on the display 720, the set top terminal 710 can identify the object. For example, the set-top terminal 710 can identify whether a person in the video is a member of the family. The set-top terminal 710 may display the identification result on the display 720. [ Also, the set-top terminal 710 can transmit a signal for controlling the door lock to the server based on the user's selection input. For example, the user may apply an input to open the front door to the set top terminal 710, and the set top terminal 710 may transmit a signal to the server to open the door lock, which is the home I / O device. The server can transmit the signal to the door lock, and the door lock can be operated according to the signal to open the front door.

In one embodiment, the set-top terminal 710 may receive a selection input indicating whether to display notification data on the display 720. [ When the event occurs, the set-top terminal 710 can ask the user whether to display the notification data corresponding to the event occurrence. For example, the set-top terminal 710 may display a "progress alarm" on the display 720 indicating "gas lock high temperature notification", "notification of motion detection of the door view" The user can inquire whether or not to display the notification data, and the set-top terminal 710 can select whether to display the notification data, and the set-top terminal 710 receives the selection input .

If there is reception of a select input, a set of instructions can be generated. In the above example, an instruction set "notification when door view motion is detected" may be generated. That is, the instruction set including the condition information of the event generating device "motion detection of the door view" and the execution information of the set-top terminal 710 called "notification of the set-top terminal 710" may be generated. The set-top terminal 710 can send a set of instructions to the server, and the server can store a set of instructions.

The set top terminal 710 may be connected to the wireless network equipment 730. In order to register the set-top terminal 710 in the server, the user can use the terminal application stored in the terminal. More specifically, when the registration function of the set-top terminal 710 of the terminal application is executed, the terminal and the wireless network equipment 730 can be paired. Based on the pairing, the terminal can request the server to register the set-top terminal 710, and the server can register the set-top terminal 710.

1 to 6 can be applied to the matters described with reference to FIG. 7, so that detailed description will be omitted.

The operation of the set-top terminal 710 described with reference to FIG. 7 may be performed by a set-top application stored in the memory of the set-top terminal 710. That is, when the set-top application is received from the server, the control command-control command is generated based on whether or not the event signal generated on the basis of the event corresponds to a preset instruction set. The corresponding notification data is visually displayed on the display corresponding to the set-top terminal.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA) , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims

A method of operating a set top terminal,
Receiving a control command from a server, the control command being generated based on whether an event signal generated based on an event occurrence corresponds to a predetermined instruction set; And
And visually displaying notification data corresponding to the event occurrence on a display corresponding to the set-top terminal based on the control command
/ RTI >
A method of operating a set top terminal.

The method according to claim 1,
Wherein the step of visually displaying the notification data on a display corresponding to the set-
Displaying the notification data overlaid on the image displayed on the display
/ RTI >
A method of operating a set top terminal.

The method according to claim 1,
The control command includes:
And generating an event generation signal based on the detection of the motion of the object of the event generating device corresponding to the preset instruction set,
A method of operating a set top terminal.

The method of claim 3,
Wherein the predetermined instruction set includes:
Wherein the event information includes condition information defined on the basis of execution information of the event generator and execution information of the set-
A method of operating a set top terminal.

The method according to claim 1,
Receiving a selection input indicating whether to display the notification data on the display
&Lt; / RTI >
A method of operating a set top terminal.

6. The method of claim 5,
Generating, based on the selection input, an instruction set including execution information defined by the set-top terminal to display the notification data
&Lt; / RTI >
A method of operating a set top terminal.

The method according to claim 1,
Wherein the step of visually displaying the notification data on a display corresponding to the set-
Displaying an image captured by the event generating apparatus that generated the event signal
/ RTI >
A method of operating a set top terminal.

In an application,
The application is stored in the memory of the set-top terminal and is executed by the processor,
The application comprises:
A control command from the server, wherein the control command is generated based on whether an event signal generated based on an event occurrence corresponds to a predetermined instruction set, and when the control command is received based on the control command, And visually displaying notification data on a display corresponding to the set-top terminal
Running,
application.

9. The method of claim 8,
Wherein the step of visually displaying the notification data on a display corresponding to the set-
Displaying the notification data overlaid on the image displayed on the display
/ RTI >
application.

9. The method of claim 8,
The control command includes:
And generating an event generation signal based on the detection of the motion of the object of the event generating device corresponding to the preset instruction set,
application.

11. The method of claim 10,
Wherein the predetermined instruction set includes:
Wherein the event information includes condition information defined on the basis of execution information of the event generator and execution information of the set-
application.

9. The method of claim 8,
Receiving a selection input indicating whether to display the notification data on the display
Lt; / RTI >
application.

13. The method of claim 12,
Generating, based on the selection input, an instruction set including execution information defined by the set-top terminal to display the notification data
Lt; / RTI >
application.

9. The method of claim 8,
Wherein the step of visually displaying the notification data on a display corresponding to the set-
Displaying an image captured by the event generating apparatus that generated the event signal
/ RTI >
application.

Receiving an event signal generated based on an event occurrence from a first device;
Confirming whether the event signal corresponds to a predetermined instruction set;
Generating a control command corresponding to the instruction set based on the confirmation; And
Transmitting the control command to the second device
Lt; / RTI >
Wherein the second device visually displays notification data corresponding to the event occurrence on a display corresponding to the second device based on the control command,
How the server works.

16. The method of claim 15,
The instruction set includes:
Wherein the second device includes condition information defined based on execution information of the first device and execution information of the second device.
How the server works.

17. The method of claim 16,
The step of verifying whether or not the instruction set corresponds to the instruction set includes:
Confirming whether the event signal and the condition information are matched
/ RTI >
How the server works.

16. The method of claim 15,
The step of verifying whether or not the instruction set corresponds to the instruction set includes:
Retrieving a set of instructions associated with at least one of the first device and the second device using the event signal
/ RTI >
How the server works.

16. The method of claim 15,
When the event signal is a text event generated based on a voice event input to the first device,
Determining whether a session with the second device has been established
Further comprising:
Wherein the transmitting the control command to the second device comprises:
And transmitting the control command to the second device via the session based on the confirmation of the session establishment.
How the server works.

16. The method of claim 15,
Receiving a registration request from the first device when the first device is paired with the wireless network equipment connected to the second device; And
Registering the second device based on the registration request
&Lt; / RTI >
How the server works.

16. The method of claim 15,
Receiving the instruction set from the terminal and storing the received instruction set in a database
&Lt; / RTI >
How the server works.

22. The method of claim 21,
The instruction set includes:
Receiving condition information for controlling the second device from a user of the terminal;
Exposing a second device list to the display of the terminal based on receipt of the condition information and receiving a selection input for the second device list from the user;
Receiving execution information corresponding to the second device selected based on the selection input from the user; And
Generating the instruction set based on the condition information, the information of the second device, and the execution information
Lt; / RTI >
How the server works.

16. The method of claim 15,
Wherein the second device is a set-
How the server works.