KR102587618B1 - Method and apparatus for service oriented input and output - Google Patents

Abstract

This disclosure relates to technologies for Sensor Network, Machine to Machine (M2M), Machine Type Communication (MTC), and Internet of Things (IoT). This disclosure can be used for intelligent services (smart home, smart building, smart city, smart car or connected car, healthcare, digital education, retail, security and safety-related services, etc.) based on the above technology. Disclosed is a service-specific input/output method and device for a smart hotel control system. The method includes receiving a shortcut key input from a remote controller, transmitting a command corresponding to the shortcut key input to a device corresponding to the command, and receiving a processing result according to the command from the device, If the display is deactivated when the processing result is received, activating the display and outputting a message according to the processing result through the display, and deactivating the display after output of the message ends. Includes.

Description

Service-specific input/output method and device {METHOD AND APPARATUS FOR SERVICE ORIENTED INPUT AND OUTPUT}

The present invention relates to a method and device for providing service-specific input and output.

The Internet is evolving from a human-centered network where humans create and consume information to an Internet of Things (IoT) network that exchanges and processes information between distributed components such as objects. IoE (Internet of Everything) technology can be an example of IoT technology combining big data processing technology through connection to cloud servers, etc.

In order to implement IoT, technological elements such as sensing technology, wired and wireless communication and network infrastructure, service interface technology, and security technology are required. Recently, sensor networks for connection between objects, and machine to machine communication (Machine to Machine) are required to implement IoT. , M2M), and MTC (Machine Type Communication) are being researched.

In the IoT environment, intelligent IT (Internet Technology) services that create new value in human life can be provided by collecting and analyzing data generated from connected objects. IoT can be applied to fields such as smart homes, smart buildings, smart cities, smart cars or connected cars, smart grids, healthcare, smart home appliances, and advanced medical services through the convergence and combination of existing IT technologies and various industries. there is.

With the full-scale advent of IoT services, technologies are being introduced to realize services that link various devices into a single network. IoT is a technology that allows all network-based devices to be seamlessly connected to each other, and is a technology required in various IT service fields. Various technologies are being researched to realize these IoT services. Examples of representative services include smart home and smart hotel control.

The present disclosure provides a method and apparatus for transmitting and receiving information in a remote control system.

The present disclosure provides a method and device for providing service-specific input and output in a network system for remote control.

This disclosure provides a method and apparatus for performing device control through a gateway in a smart hotel control system.

This disclosure provides a method and device for processing room service requests through a gateway in a smart hotel control system.

The present disclosure provides a method and device for displaying the processing results of a service request through a display of a gateway in a network system.

The present disclosure provides a method and device for displaying an adaptive control menu through a remote controller in a smart hotel control system.

The present disclosure provides a method and device for displaying an adaptive control menu according to orientation information of a remote controller.

A method according to an embodiment of the present disclosure is a service-specific input/output method, comprising: determining orientation information of the remote controller in response to a first user input detected by the remote controller; and storing the determined orientation information and the pre-stored orientation information. Selecting one device based on location information of devices included in the control target list, displaying a control menu including at least one control item for the selected device, and displaying the control menu It includes detecting a second user input while transmitting a control command indicating a control item corresponding to the second user input to the selected device.

A method according to an embodiment of the present disclosure is a service-specific input/output method, comprising: receiving a first user input signal corresponding to a first user input sensed by a remote controller and including directional information of the remote controller; , selecting one device based on the orientation information and location information of devices included in a pre-stored control target list, and displaying information about a control menu including at least one control item for the selected device on a TV. receiving a second user input signal corresponding to a second user input detected by the remote controller while the control menu is being output to the TV display, and corresponding to the second user input. It includes transmitting a control command indicating a control item to the selected device.

A device according to an embodiment of the present disclosure is a device that provides service-specific input and output, comprising an input unit that detects a user input, an output unit that includes a display, and a device that responds to a first user input detected by the input unit. Determine orientation information, select one device based on the determined orientation information and location information of devices included in a pre-stored control target list, and generate a control menu including at least one control item for the selected device. a control unit that generates a control command that outputs the output to the display and instructs a control item corresponding to the second user input when a second user input is detected by the input unit while the control menu is being displayed, the control command; It includes a communication unit that transmits to the selected device.

A device according to an embodiment of the present disclosure is a device that provides service-specific input and output, comprising: a first communication unit that communicates with a remote controller, a second communication unit that communicates with a plurality of devices, and a device sensed by the remote controller. When a first user input signal corresponding to a first user input and including orientation information of the remote controller is received by the first communication unit, the first user input signal is based on the orientation information and location information of devices included in a pre-stored control target list. selects a device, outputs information about a control menu including at least one control item for the selected device to a TV display, and detects information about a control menu including at least one control item for the selected device by the remote controller while the control menu is being output to the TV display. When a second user input signal corresponding to a second user input is received by the first communication unit, a control unit that transmits a control command indicating a control item corresponding to the second user input to the selected device through the second communication unit. Includes.

A method according to an embodiment of the present disclosure; A service-specific input/output method comprising: receiving a shortcut key input from a remote controller; transmitting a command corresponding to the shortcut key input to a device corresponding to the command; and receiving a processing result according to the command from the device. If the display is inactive when the processing result is received, activating the display and outputting a message according to the processing result through the display, and turning the display on after output of the message ends. Includes deactivating steps.

A method according to an embodiment of the present disclosure; A service-specific input/output method comprising: receiving a command corresponding to a shortcut key input detected by a remote controller; determining whether the command is related to device control or a service request; and determining whether the command is related to device control. When related to, determining at least one device to be controlled, transmitting a control command corresponding to the command to the determined at least one device, receiving a state change result from the at least one device, and receiving the state change result outputting to a TV display, and if the command is related to a service request, transmitting a service ID corresponding to the command to a hotel server; receiving a processing result of the service request from the hotel server; and processing the service request. and outputting the results to the TV display.

A device according to an embodiment of the present disclosure; A device that provides service-specific input and output, comprising: a first communication unit that receives a shortcut key input from a remote controller; transmitting a command corresponding to the shortcut key input to a device corresponding to the command; and processing results according to the command from the device. a second communication unit that receives, and if the TV display is deactivated when the processing result is received, activating the TV display to output a message according to the processing result through the TV display, and the output of the message ends It includes a control unit that deactivates the TV display after it is turned on.

A device according to an embodiment of the present disclosure; A device that provides service-specific input and output, comprising: a first communication unit that receives a command corresponding to a shortcut key input detected by a remote controller, a second communication unit that communicates with a hotel server, and whether the command is related to device control or service Determine whether the command is related to a request, determine at least one device to be controlled if the command is related to device control, transmit a control command corresponding to the command to the determined at least one device, and transmit a control command corresponding to the command to the determined at least one device. Receive a state change result, transmit the state change result to a TV display, and if the command is related to a service request, transmit a service ID corresponding to the command to the hotel server through the second communication unit, and transmit the service ID corresponding to the command to the hotel server through the second communication unit. It includes a control unit that receives a processing result of the service request from the hotel server through a communication unit and transmits the processing result to the TV display.

Other aspects, features and benefits as described above of certain preferred embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.
1A and 1B illustrate implementation examples of a smart hotel control system according to an embodiment of the present disclosure.
Figure 2 shows an example of remote control through a TV display according to an embodiment of the present disclosure.
Figure 3 shows an input unit of a remote controller including hot-keys according to an embodiment of the present disclosure.
Figure 4a shows the functional configuration of a smart hotel control system according to an embodiment of the present disclosure.
Figure 4b shows the functional configuration of a remote controller according to an embodiment of the present disclosure.
Figure 5A is a flowchart showing an operation for determining a shortcut code according to an embodiment of the present disclosure.
Figure 5b is a flowchart showing the operation of processing a command according to an embodiment of the present disclosure.
Figure 6 is a flowchart showing the operation of processing a shortcut key input according to an embodiment of the present disclosure.
Figure 7 is a flowchart showing an operation of displaying a shortcut key input or processing result according to an embodiment of the present disclosure.
Figure 8 is a signal flow diagram showing a device control or service request processing operation according to an embodiment of the present disclosure.
Figure 9 shows the functional structure of a gateway according to an embodiment of the present disclosure.
Figure 10 shows a procedure for executing a device control command in a gateway according to an embodiment of the present disclosure.
Figure 11 shows a procedure for receiving a device state change result from a gateway according to an embodiment of the present disclosure.
FIG. 12 is a diagram for explaining a device control processing procedure according to an embodiment of the present disclosure.
Figure 13 is a diagram for explaining a service request processing procedure according to an embodiment of the present disclosure.
Figure 14 shows a screen on a TV display notifying a change in the status of a service request according to an embodiment of the present disclosure.
Figure 15 shows a screen of a TV display notifying a temperature change according to an embodiment of the present disclosure.
Figures 16a and 16b show a screen of a TV display that outputs processing results with the TV function activated according to an embodiment of the present disclosure.
Figure 17 shows a method of processing shortcut key input according to an embodiment of the present disclosure.
Figure 18 is a flowchart showing a lighting control operation according to an embodiment of the present disclosure.
Figure 19 shows shortcut key input by a mobile terminal operating as a remote controller according to an embodiment of the present disclosure.
Figure 20 shows other examples of a remote controller according to an embodiment of the present disclosure.
Figure 21 is a diagram for explaining a shortcut key mapping guide according to an embodiment of the present disclosure.
Figure 22 shows an overall flowchart for providing a shortcut key mapping guide according to an embodiment of the present disclosure.
Figure 23 shows an example of providing a shortcut key mapping guide according to the direction of the remote controller according to an embodiment of the present disclosure.
24A to 24C are diagrams for explaining an operation procedure for providing a shortcut key mapping guide according to the direction of a remote controller according to an embodiment of the present disclosure.
Figure 25 shows a flowchart of an operation for providing an adaptive shortcut key mapping guide according to an embodiment of the present disclosure.
FIG. 26 illustrates a signal flow diagram for providing an adaptive shortcut key mapping guide by a remote controller according to an embodiment of the present disclosure.
FIG. 27 is a signal flow diagram for providing an adaptive shortcut key mapping guide when a plurality of devices are in the same direction according to an embodiment of the present disclosure.
Figure 28 is a flowchart showing the operation of a remote controller for providing a shortcut key mapping guide according to an embodiment of the present disclosure.
Figure 29 is a flowchart showing the operation of a gateway to provide a shortcut key mapping guide according to an embodiment of the present disclosure.
FIG. 30 illustrates a signal flow diagram for controlling a device corresponding to directional information by a gateway according to an embodiment of the present disclosure.
Figure 31 is a flowchart showing the operation of a gateway that displays a shortcut key mapping guide according to an embodiment of the present disclosure.
Figures 32a and 32b illustrate an input unit of a remote controller configured exclusively for shortcut keys according to an embodiment of the present disclosure.
Figures 33A and 33B are diagrams for explaining examples of use of a remote controller dedicated to shortcut keys according to an embodiment of the present disclosure.
Figure 34 is a flowchart showing the operation of providing a shortcut key mapping guide considering room conditions according to an embodiment of the present disclosure.
Figures 35A to 35C are diagrams for explaining provision of a shortcut guide that is adaptive over time according to an embodiment of the present disclosure.
Figures 36A and 36B are diagrams for explaining the provision of a shortcut key mapping guide reflecting the user's status according to an embodiment of the present disclosure.
FIG. 37 is a diagram illustrating the provision of an adaptive shortcut key mapping guide according to room mode according to an embodiment of the present disclosure.
Figure 38 is a diagram for explaining a shortcut key mapping guide configured according to shortcut key usage history according to an embodiment of the present disclosure.
Figure 39 illustrates a display example of a shortcut key mapping guide using a room image according to an embodiment of the present disclosure.
FIG. 40 illustrates an input unit of a remote controller including shortcut keys corresponding to controlled devices according to an embodiment of the present disclosure.
Figure 41 is a diagram for explaining a curtain control operation using a shortcut key of a remote controller according to an embodiment of the present disclosure.
Figure 42 is a diagram for explaining a control operation of a temperature controller using a shortcut key of a remote controller according to an embodiment of the present disclosure.
Figure 43 is a diagram for explaining device control and user status input operations using voice commands according to an embodiment of the present disclosure.
It should be noted that throughout the drawings, like reference numerals are used to illustrate identical or similar elements, features and structures.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings.

In describing the embodiments, description of technical content that is well known in the technical field to which the present invention belongs and that is not directly related to the present invention will be omitted. This is to convey the gist of the present invention more clearly without obscuring it by omitting unnecessary explanation.

For the same reason, some components are exaggerated, omitted, or schematically shown in the accompanying drawings. Additionally, the size of each component does not entirely reflect its actual size. In each drawing, identical or corresponding components are assigned the same reference numbers.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to provide common knowledge in the technical field to which the present invention pertains. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

At this time, it will be understood that each block of the processing flow diagrams and combinations of the flow diagram diagrams can be performed by computer program instructions. These computer program instructions can be mounted on a processor of a general-purpose computer, special-purpose computer, or other programmable data processing equipment, so that the instructions performed through the processor of the computer or other programmable data processing equipment are described in the flow chart block(s). It creates the means to perform functions. These computer program instructions may also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory It is also possible to produce manufactured items containing instruction means that perform the functions described in the flowchart block(s). Computer program instructions can also be mounted on a computer or other programmable data processing equipment, so that a series of operational steps are performed on the computer or other programmable data processing equipment to create a process that is executed by the computer, thereby generating a process that is executed by the computer or other programmable data processing equipment. Instructions that perform processing equipment may also provide steps for executing the functions described in the flow diagram block(s).

Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). Additionally, it should be noted that in some alternative execution examples it is possible for the functions mentioned in the blocks to occur out of order. For example, it is possible for two blocks shown in succession to be performed substantially at the same time, or it is possible for the blocks to be performed in reverse order depending on the corresponding function.

At this time, the term '~unit' used in this embodiment refers to software or hardware components such as FPGA (field-programmable gate array) or ASIC (Application Specific Integrated Circuit), and '~unit' refers to what role perform them. However, '~part' is not limited to software or hardware. The '~ part' may be configured to reside in an addressable storage medium and may be configured to reproduce on one or more processors. Therefore, as an example, '~ part' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or may be further separated into additional components and 'parts'. Additionally, components and 'parts' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

In specifically describing the embodiments of the present disclosure, various wireless communication technologies will be mentioned, but the main point claimed in the present specification does not significantly depart from the scope disclosed in the present specification to other communication systems and services with similar technical background. It can be applied to the extent that it is not, and this will be possible at the discretion of a person with skilled technical knowledge in the relevant technical field.

FIG. 1A illustrates an implementation example of a smart hotel control system according to an embodiment of the present disclosure.

Referring to FIG. 1A, the smart hotel control system includes a control device 20 with a gateway function, at least one device 15 that can be connected to the control device 20 by wire or wirelessly, and a remote controller (Remote Controller: Remocon) (30). The user can transmit a command for device control or service request to the control device 20 using a remote input device such as the remote controller 30 or a mobile terminal 35 equipped with a remote control function. The remote controller 30 may be configured as a regular remote control for controlling TV functions. The mobile terminal 35 may be a tablet computer, smartphone, or wearable device equipped with an application that performs TV functions and management functions. As an example, the remote controller 30 or the mobile terminal 35 may use wireless communication such as at least one of Infrared Ray (IR), Bluetooth, WiFi, Zigbee, and Z-wave. Communication technology can be used to communicate with the control device 20.

The control device 20 may be composed of a gateway function unit 22 in charge of in-room management, a TV function unit (TV Native) 24, and a TV display 26. The TV function unit 24 performs typical TV functions, communicates with the remote controller 30, and can directly control the TV display 26. The gateway functional unit 22 transmits control commands necessary for device control or service request to the corresponding entity based on communication with the TV functional unit 24. The device control means controlling the operation of devices 15 registered in the smart hotel control system. The service request means requesting room service of the smart hotel control system from the hotel server 40. Here, the hotel server 40 refers to a management server that can be located outside the room to which the smart hotel control system shown is applied. Additionally, the controlled devices 15 may include at least one of a power supply device, a lighting device, a temperature controller, a curtain device, a door lock, and a vacuum cleaner.

As an example, the remote controller 30 transmits a signal corresponding to the user's key input to the control device 20 (102). The control device 20 identifies whether the signal from the remote controller 30 is a device control or a service request, and if it is a device control, transmits a corresponding control command to at least one device to be controlled 15 ( 104a). In the case of a service request, a service request command is transmitted to the hotel server 40 that manages the hotel rooms of the smart hotel control system (104b). When the processing result in response to the service request or device control is received by the control device 20 from the hotel server 40 or device 15, the control device 20 outputs the processing result through the TV display 26. It can be done (106). The processing result may include, for example, an operation status for a specific device or a service execution result corresponding to the service request. As an example, the control device 20 may output the processing results through a display of a mobile terminal 35 such as a tablet.

FIG. 1B illustrates another implementation example to which a smart hotel control system according to an embodiment of the present disclosure is applied.

Referring to FIG. 1B, the smart hotel control system includes a gateway 22a, a TV device 24a, at least one device 15 that can be wired or wirelessly connected to the gateway 22a, or a TV device. It may be composed of a remote controller 30 that can be connected to (24a) by wire or wirelessly. Here, the TV device 24a is configured to include the TV function unit 24 and the TV display 26 shown in FIG. 1A.

The user can transmit commands for device control or service request to the gateway 22a or the TV device 24a using a remote input device such as a remote controller 30 or a mobile terminal 35 equipped with a remote control function. . The remote controller 30 may be configured as a regular remote control for controlling TV functions. The gateway 22a communicates with the remote controller 30 directly or through the TV device 24a, which performs typical TV functions, and can control the TV display of the TV device 24a. The gateway 22a transmits control commands necessary for device control or service request to the corresponding entity based on communication with the remote controller 30.

As an example, the remote controller 30 transmits a signal corresponding to the user's key input through the TV device 24a or directly to the gateway 22a (102). The gateway 22a identifies whether the signal from the remote controller 30 is device control or a service request, and if it is device control, transmits a corresponding control command to at least one device to be controlled 15 (104a) ). In the case of a service request, a service request command is transmitted to the hotel server 40 of the smart hotel control system (104b). When a processing result in response to the service request or device control is received from the hotel server 40 or the device 15, the gateway 22a can output the processing result through the display of the TV device 24a (106 ). The processing result may include, for example, an operation status for a specific device or a service execution result corresponding to the service request. As an example, the gateway 22a may output the processing results through a display of a mobile terminal 35 such as a tablet.

In the above, in the case where the gateway functional unit 22 and the TV functional unit 24 are provided in one device 20 (FIG. 1a), the gateway 22a and the TV device 24a are physically distinct entities. Although the implementation case (FIG. 1b) has been described separately, the gateway functional unit 22 and the gateway 22a may actually be configured to function the same way. Therefore, hereinafter, the gateway 22 in this specification should be understood to refer to the gateway functional unit 22 in FIG. 1A or the gateway 22a in FIG. 1B. Likewise, the TV function unit 24 should be understood as referring to the TV function unit 24 in FIG. 1A or the TV device 24a in FIG. 1B.

Figure 2 shows an example of remote control through a TV display according to an embodiment of the present disclosure.

Referring to FIG. 2, the TV display 26 responds to a request through the remote controller 30 while displaying a TV image and displays a control menu for remote control of the smart hotel control system, as an example, a plurality of widgets 202, 204, 206, and 208. ) can be displayed. As an example, the widget 202 is a screen for controlling the temperature in the room and may include a current temperature, a set temperature, an end key, a temperature increase (+) key, and a temperature decrease (-) key. The widget 204 is a screen for controlling lighting for each zone in the room, and may include lighting on/off status for a specific zone, a zone movement key, and an on/off key. The widget 206 is a screen for opening and closing a curtain, and the widget 208 includes keys corresponding to a plurality of functions that can function in quick mode.

When the TV display 26 is deactivated because the TV function unit 24 is in a standby status or power-off state (hereinafter referred to as display off), the user uses the shortcut key of the remote controller 30. After activating the TV display 26 using the (hot-key), display widgets for room control of the smart hotel control system again using the remote controller 30, and select one of the widgets to select the desired room. Control can be implemented.

FIG. 3 illustrates an input unit of the remote controller 30 including shortcut keys for room control of a smart hotel control system according to an embodiment of the present disclosure.

Referring to FIG. 3, the input unit 305 of the remote controller 30 is at least one shortcut key for service-specific input of room control in the smart hotel control system, for example, a temperature increase key [TEMPERATURE: +] for temperature control. (30a) and temperature reduction key [TEMPERATURE: -] (30b) and ON key [LIGHT ON] (30c) and OFF key [LIGHT OFF] (30d) for lighting control and Do Not Disturb (DO NOT DISTURB: DND) Do not disturb key [DO NOT DISTURB] (30e) for requesting service, and cleaning request key (MAKE UP ROOM: MUR) [MAKE UP ROOM] (30f) for requesting cleaning service. It can contain at least one.

The user can transmit a service-specific input to the gateway 22 or the TV function unit 24 through any one of the shortcut keys 30a to 30f of the remote controller 30 even when the TV display 26 is deactivated. . Accordingly, even when the user is not watching TV, the user can simply adjust the lighting and temperature and request room cleaning using the remote controller 30 that includes the service-specific shortcut keys as described above.

Figure 4a shows the functional configuration of a smart hotel control system according to an embodiment of the present disclosure. Here, it should be noted that among the various components, reference numbers are assigned to components that perform functions according to embodiments of the present disclosure.

Referring to FIG. 4A, a gateway 22, a TV function unit 24, a remote controller 30, and a management server 40 are shown. The TV function unit 24 communicates with the remote controller 30 according to the TV's own (TV Native) function and controls the TV display 26 (not shown). Gateway 22 may be connected to a hotel server 40, which may be located outside of the guest room.

The hotel server 40 includes a presentation function unit, a service function unit 418, a data access unit, and a communication unit 416. The communication unit 416 communicates with the gateway 22 through wired or wireless communication means. For example, it may receive a service request for room service from the gateway 22 and transmit the resulting processing result to the gateway 22. there is. The service function unit 418 processes services according to the service request.

The gateway 22 includes a service web application program interface (API), subscription/notification unit 404, REST (Representational State Transfer) engine, web engine, control service management unit 420, and room service management unit 426. , a device management unit 428, a communication unit 430, and an OS (Operation System) device driver/network controller.

The subscription/notification unit 404 manages information on devices subscribed to the gateway 22, and transmits information or messages requiring notification to the TV function unit 24 (424), allowing the user to recognize the information or message. You can have it printed out. The web engine 412 communicates with the TV function unit 24, for example, receives a device control or service request command from the TV function unit 24, and sends the command to a corresponding entity, for example, the control service management unit 420. Alternatively, it can be delivered to the room service management department (426).

The control service management unit 420 manages control services that require device control. When a device control command is received from the TV function unit 24, the control service management unit 420 determines at least one device 15 involved in executing the command. Then, the control service manager 420 transmits a control command for executing the command to the determined at least one device 15 through the device manager 428 (422). The control command may be transmitted through the communication unit 430, for example, using a communication method such as WiFi, Zigbee, Z-Wave, Bluetooth, or IR.

When a service request command is received from the TV function unit 24, the room service management unit 426 transmits the command to the hotel server 40 (414), and processes corresponding to the command from the hotel server 40. When the result is received, the processing result is transmitted to the TV function unit 24 through the web engine 412 (410).

The TV function unit 24 includes a web client, a command conversion/response analysis unit 408, a shortcut key processing unit 406, a display control unit 432, and a reception unit 434. The remote controller 30 consists of an input unit (not shown) consisting of a number of keys that can be operated by the user, and a transmission unit 402 that transmits signals input through the keys. The TV function unit 24 may receive a signal from the remote controller 30 through the receiver 434. If the signal corresponds to a shortcut key input, the signal is transmitted to the shortcut key processing unit 406. The shortcut key processing unit 406 transmits the shortcut key code corresponding to the signal to the command conversion/response analysis unit 408. The command conversion/response analysis unit 408 generates a command for device control or service request corresponding to the shortcut code and transmits it to the gateway 22, and receives and analyzes the response corresponding to the command from the gateway 22. You can do it (410). The display control unit 432 receives information or messages requiring notification from the gateway 22 and outputs them through the TV display 26. Additionally, non-visible output corresponding to the information or message, such as voice, sound, music, beep sound, vibration, etc., may be provided to the user through the TV function unit 24. If the remote controller 30 further includes a receiving unit for communication with the TV functional unit 24 or is comprised of a smartphone, tablet, or wearable device, the remote controller 30 transmits from the transmitting unit of the TV functional unit 24. Depending on the feedback request, feedback corresponding to the information or message can be provided to the user through visible output (e.g. text or symbols) or non-visible output (e.g. voice, sound, music, beep sound, vibration). You can.

In one embodiment, the gateway 22 includes a receiving unit, a transmitting unit, and a receiving unit that functions in the same manner as the receiving unit 434, the transmitting unit, and the shortcut key processing unit 406, so that the key input signal can be received and processed directly from the remote controller 30. It may further include a shortcut key processing unit. The description of the receiving unit, transmitting unit, and shortcut key processing unit included in the gateway 22 is the same as before, so it will be omitted.

FIG. 4B shows the functional configuration of the remote controller 30 according to an embodiment of the present disclosure.

Referring to FIG. 4B, the remote controller 30 includes a control unit 440, an input unit 442, a communication unit 444, a storage unit 446, and an output unit 448. The control unit 440 is composed of a processor for controlling operations by the input unit 442, communication unit 444, storage unit 446, and output unit 448.

The input unit 442 may include at least one of a magnetic sensor, an acceleration sensor, a gyro sensor, a key panel, a touch screen, and a microphone. Here, the key panel may be configured to include at least one shortcut key, as in the input unit 305 of FIG. 3, as an example.

The communication unit 444 may include at least one of a Bluetooth module, a Wi-Fi module, a ZigBee module, a Z-wave module, and an infrared communication (IR) module, and a remote controller 30 and a gateway 22 or a TV function unit 24. ) is responsible for communication between

The storage unit 446 stores information about devices 15 registered in the smart hotel control system in the control target list. As an example, the control target list may include at least one of the name, model name, manufacturer, function, status, and location of each device. The storage unit 446 includes at least one control menu for each device and at least one control signal corresponding to each control menu. Here, the control menu is a command for operating the device. For example, the control menu for a lighting device includes at least one of the control items of on, off, and brightness increase (+) / decrease (-), and each control item includes The control signal for is stored in the storage unit 446. As another example, the storage unit 446 may include control items such as on, off, temperature increase (+)/decrease (-), and corresponding control signals for a thermostat.

The output unit 448 includes at least one of a speaker, a display, and a vibration motor, and outputs feedback about device control or a service request in the form of at least one of sound, visible message, and vibration under the control of the control unit 440. You can.

FIG. 5A is a flowchart illustrating an operation for determining a shortcut code according to an embodiment of the present disclosure. The depicted flow may be performed by the TV function unit 24 as an example.

Referring to FIG. 5A, in step 505, the TV function unit 24 receives a key input from the remote controller 30 and determines a code corresponding to the key input. In step 510, the TV function unit 24 determines whether the determined code is a shortcut code. If the determined code is included in a pre-stored shortcut code table, the TV function unit 24 may determine that the determined code corresponds to a shortcut key. <Table 1> below shows an example of a shortcut code table.

Name TV SW Mapping IR/BT BT Page ID Report ID Usage ID (2Byte)
little endian ROOM CONTROL ROOM CONTROL BT Only 0xFF70 0xF7 0x0176 TEMPERATURE + TEMPERATURE + BT Only 0xFF70 0xF7 0x177 TEMPERATURE - TEMPERATURE - BT Only 0xFF70 0xF7 0x0178 LIGHT ON LIGHT ON BT Only 0xFF70 0xF7 0x0179 LIGHT OFF LIGHT OFF BT Only 0xFF70 0xF7 0x0180 DO NOT DISTURB DO NOT DISTURB BT Only 0xFF70 0xF7 0x0181 MAKE UP ROOM MAKE UP ROOM BT Only 0xFF70 0xF7 0x0182

In the example of <Table 1>, the shortcut codes correspond to [ROOM CONTROL], [TEMPERATURE: +], [TEMPERATURE: -], [LIGHT ON], [LIGHT OFF], [DO NOT DISTURB], and [MAKE UP ROOM]. and is transmitted from the remote controller 30 to the TV function unit 24 using Bluetooth. The Bluetooth signal corresponding to each shortcut code consists of Page ID, Report ID, and Usage ID.

If the determined code is not a shortcut code, the TV function unit 24 proceeds to step 515 and performs the TV's own functions corresponding to the code, such as changing channels, adjusting volume, displaying menus, etc. On the other hand, if the determined code is a shortcut code, in step 520, the TV function unit 24 determines the identifier of the device or service mapped to the shortcut code based on predetermined mapping information, and matches the shortcut code to the determined key code. Convert it to a command corresponding to the identifier of the device or service. For example, among the shortcut codes shown in <Table 1>, [ROOM CONTROL], [TEMPERATURE: +], [TEMPERATURE: -], [LIGHT ON], and [LIGHT OFF] correspond to device control and are used to control at least one device. It can be converted into a command containing an identifier. Additionally, [DO NOT DISTURB] and [MAKE UP ROOM] correspond to service requests and can be converted into commands that include the identifier of the service.

In step 525, the command is transmitted to the gateway 22. In a standby state in which the TV's own functions are not being executed, the TV display 26 may remain inactive until the shortcut key input is received and the command is transmitted. That is, the TV function unit 24 can process the shortcut key input and command without activating the TV display. In another embodiment, the TV function unit 24 activates the TV display 26 in an inactive state when a shortcut key input is received and displays a message indicating the status of the requested device control or service request, “Device control/service request has been entered. ." can be output through the TV display (26).

When the processing result corresponding to the command is received from the gateway 22 in step 530, the TV function unit 24 outputs the processing result to the TV display 26 in step 535. At this time, when the above processing result is received, if the TV function is not being performed and the TV display 26 is deactivated (i.e., the display is off), the TV function unit 24 activates the TV display 26 to display a black screen. and output a message such as a phrase or symbol corresponding to the processing result on the black screen.

Referring to the example in <Table 1>, as a result of processing corresponding to the shortcut key of [TEMPERATURE: +] or [TEMPERATURE: -], the TV display can display the current temperature and the set temperature. As a result of processing corresponding to the shortcut key of [LIGHT ON] or [LIGHT OFF], the TV display can display the lighting on/off status for each zone or specific zone in the room. As a result of processing corresponding to [DO NOT DISTURB] or [MAKE UP ROOM], the TV displays “Do not disturb request has been applied.” Alternatively, a statement such as “MAKE UP request has been received” can be displayed.

Figure 5b is a flowchart showing the operation of processing a command according to an embodiment of the present disclosure. The depicted flow may be performed by gateway 22 as an example.

Referring to FIG. 5B, in step 540, the gateway 22 receives a command for smart hotel control from the TV function unit 24, and in step 545, it determines whether the command is for device control or a service request. do. For example, the gateway 22 may determine according to the unique code of the command, or whether the command includes an identifier of at least one device or an identifier of a service.

If it is determined that the command is for device control, in step 550, the gateway 22 determines at least one target device to be controlled according to the command based on pre-stored information. For example, if the command instructs device control corresponding to the shortcut key of [TEMPERATURE: +] or [TEMPERATURE: -], the target devices may be air conditioners, heaters, and temperature controllers located in areas within the room. As another example, when the command instructs device control corresponding to the shortcut key of [LIGHT ON] or [LIGHT OFF], lights located in areas within the room may be the target devices. In step 555, the gateway 22 transmits a corresponding control command to the determined at least one target device. For example, the control command may be at least one of temperature increase, temperature decrease, lighting on, and lighting off. In step 560, a processing result corresponding to the control command is received from the at least one target device, or a status report is received, and in step 575, the gateway 22 transmits the processing result to the TV function unit 24. , so that the processing results are output through the TV display 26.

If it is determined that the command is for a service request, in step 565, the gateway 22 transmits the command to the hotel server 40 to request execution of the service corresponding to the command. When a processing result corresponding to the execution of the service is received from the hotel server 40 in step 570, the gateway 22 transmits the processing result to the TV function unit 24 in step 575, and the processing result is displayed on the TV display. It is output through (26).

Figure 6 is a flowchart showing the operation of processing a shortcut key input according to an embodiment of the present disclosure. The depicted flow may be performed by gateway 22 as an example.

Referring to FIG. 6, in step 605, the gateway 22 receives a key input from the remote controller 30 directly or through the TV function unit 24 and determines a code corresponding to the key input. In step 610, the gateway 22 determines whether the determined code is a shortcut code. If the determined code is included in a pre-stored shortcut code table, the gateway 22 may determine that the determined code corresponds to a shortcut key. An example of a shortcut code table is as shown in <Table 1>.

If the determined code is not a shortcut code, the gateway 22 proceeds to step 615 and performs its own function corresponding to the code. On the other hand, if the determined code is a shortcut code, in step 620, the gateway 22 determines whether the shortcut code is for device control or a service request based on predetermined mapping information.

If it is determined that the shortcut code is for device control, in step 630, the gateway determines at least one target device to be controlled according to the shortcut key code. For example, if the shortcut code is [TEMPERATURE: +] or [TEMPERATURE: -], the target devices may be air conditioners, heaters, and temperature controllers located in areas within the room. As another example, when the shortcut code is [LIGHT ON] or [LIGHT OFF], lights located in areas within the room may be the target devices.

In step 635, the gateway 22 transmits a corresponding control command to the determined at least one target device. For example, the control command may be at least one of temperature increase, temperature decrease, lighting on, and lighting off. In step 640, a processing result corresponding to the control command is received or a status report is received from the at least one target device, and in step 645, the gateway 22 outputs the processing result through the TV display 26. .

If it is determined that the shortcut code is for a service request, in step 625, the gateway 22 transmits the command to the hotel server 40 to request execution of the service corresponding to the command. When a processing result corresponding to execution of the service is received from the hotel server 40 in step 640, the gateway 22 outputs the processing result through the TV display 26 in step 645.

Figure 7 is a flowchart showing an operation of displaying a shortcut key input or processing result according to an embodiment of the present disclosure. The illustrated flow may be performed by the TV function unit 24 or the gateway 22 as an example, and will be described below as being performed by the TV function unit 24.

Referring to FIG. 7, in step 705, the TV function unit 24 receives a shortcut key input from the remote controller 30, or receives information or a message for notification from the gateway 22 or the hotel server 40, for example. Receive processing results corresponding to the transmitted command. In step 710, the TV function unit 24 determines whether the TV display 26 is in a standby state (i.e., in an inactive state), i.e., the display is off. If the TV display 26 is activated, the TV function unit 24 can immediately output a request corresponding to the shortcut key input or a phrase indicating the processing result through the TV display 26 in step 730. . In one embodiment, the text may be displayed in a designated area within the TV display, for example, on the right or bottom right, in an area small enough not to interfere with the TV image. Visible output, such as a symbol or small image, or invisible output, such as sound or vibration, may be provided along with or in place of the above phrase, and the phrase/symbol/image may be displayed for a predetermined period of time and then deleted. there is.

If the TV display 26 is in a standby state, in step 715, the TV function unit 24 first activates the TV display 26 to display a black screen on the TV display 26, and in step 720, the request content or A text indicating the processing result is output on the black screen. Since the TV image is not being output, the text may be displayed at a relatively large size on the TV display 26. In step 725, the TV function unit 24 may disable the TV display 26 and place it in a standby state after a phrase corresponding to the request content or processing result is displayed for a predetermined period of time.

In one embodiment, TV function 24 may prioritize notification messages from gateway 22. As an example, level 1, the lowest priority, may include processing results for lighting or curtain-related commands. Level 4, the highest priority, may include notification events such as security alerts, fire, door opening, etc. The TV function unit 24 can differentiate the exposure time according to the priority of the notification message. For example, a level 4 notification message blinks for 10 seconds and is output to the TV display 26. As another example, a level 1 notification message is output to the TV display 26 without blinking for 5 seconds.

Upon receipt of a notification message related to important information or security, the TV function unit 24 may display text corresponding to the notification message and additionally output sound. When a notification message related to a time-dependent service, such as a laundry service, is received, an additional notification sound or sound may be output. Additionally, when a notification message related to lighting control is received, the TV function unit 24 displays a phrase corresponding to the notification message on the screen, for example, “Light is on in the living room,” or the corresponding message on the layout diagram. The location of the area can be displayed.

Figure 8 is a signal flow diagram showing a device control or service request processing operation according to an embodiment of the present disclosure.

Referring to FIG. 8, in step 805, the remote controller 30 detects a shortcut key input by the user and transmits a signal corresponding to the shortcut key input to the TV function unit 24. In step 810, the TV function unit 24 converts the shortcut key input into an API command and transmits the API command to the gateway 22. The gateway performs step 815 if the command is for device control, and performs step 835 if the command is for a service request.

Process 815 includes the following sub-processes. In subprocess 820, the gateway 22 transmits a control command for device control to at least one device 15 related to the device control. In subprocess 825, the at least one device 15 transmits a processing result corresponding to the control command to the gateway 22 in response to completion of execution of the control command, or according to a periodic/non-periodic reporting method. In sub-process 830, the gateway 22 transmits the processing result to the TV function unit 24. The processing result corresponding to device control may indicate a change in the state of the target device (temperature change or lighting on/off, etc.).

Process 835 includes the following sub-processes. In sub-process 840, the gateway 22 transmits a command for a service request to the hotel server 40. In sub-process 845, the hotel server 40 can receive the processing result for the service request from the operator, and transmits the processing result to the gateway 22 in sub-process 850. In subprocess 855, the gateway 22 transmits the processing result to the TV function unit 24. The processing result corresponding to the service request may be a service status change, for example, “Make up Room has been completed.”

In step 860, when the TV display 26 is in a standby state, the TV function unit 24 activates the TV display 26 and outputs the processing result through the TV display 26. After the processing result is displayed for a predetermined period of time, the TV function unit 24 may restore the state of the TV display 26, that is, deactivate it, in step 860. When the processing result is received, if the TV display 26 is activated and is outputting TV images according to the TV's own function, the TV function unit 24 displays the processing result within a designated small area of the TV display 26. can be displayed.

Figure 9 shows the functional structure of the gateway 22 according to an embodiment of the present disclosure.

Referring to FIG. 9, the gateway 22 includes a web framework (905), a service framework (Service Framework) (910), and a core/base framework (Core & Base Framework) (915). It is composed. The web framework 905 includes a high-speed CGI (Common Gateway Interface) module for communication with the TV functional unit 24, a web push engine, and a REST engine. The service framework 910 includes an energy service module, a control service module, and a room service module. The core/base framework 915 includes a mode module, zone module, accounting module, system management module, device module, service module, and communication module.

The TV function unit 24 converts the shortcut key input received from the remote controller 30 into an API command and transmits it to the web framework 905 of the gateway 22. The REST engine of the web framework 905 analyzes the API command, determines a service corresponding to the API command, and calls the control service module or room service module of the service framework 910. The control service module obtains detailed information corresponding to the device ID to be controlled according to the API command from the device module of the core/base framework 915, and requests the service module to provide a control service for the device to be controlled. The room service module of the service framework 910 transmits a service ID according to the API command to the hotel server 40 and receives a processing result for the service ID. In one embodiment, the hotel server 40 notifies the command of the service ID by displaying it on the hotel manager's control console or web page, and receives a processing result from the hotel manager.

When the API command instructs lighting control for zones within the room, the zone module of the core/base framework 915 controls lighting corresponding to the zone ID included in the API command. When the API command instructs group control of devices in the room, the mode module determines the mode for the group control, obtains a mode ID, and performs group control corresponding to the obtained mode ID.

Examples of API commands received by the gateway 22 are described as follows.

/devices/{device_id}/temperatures is a command to set and get specific information of temperatures, and an example of the request format is as follows.

"Temperatures": [

{

"id": "id1",

"desired": 3.0;

"unit": "Celsius"

},

{

"id": "id2",

"desired": 4.0;

"unit": "Celsius"

}

]

/devices/{device_id}/thermostat is a command to set and get specific information of thermostat. An example of the request format is as follows.

"Thermostat":

{

"thermostatMode":

[

"thermostat_cool"

],

"fanMode":

[

"fan_on_low"

]

}

/zones/{zone_id} is a command to set and get general information of a zone light device. An example of the request format is as follows.

"Zone": {

"lightState": "On"

}

/room is a command to set and get room information, and an example of the request format is as follows.

"Room" :{

"housekeeping" : true/false,

"needSendNotification":true/false

}

"Room" :{

"doNotDisturb" : true/false ;

"needSendNotification":true/false

}

Figure 10 shows a procedure for executing a device control command in the gateway 22 according to an embodiment of the present disclosure.

Referring to FIG. 10, the gateway 22 includes a web framework 905, a service framework 910, and a core/base framework 915.

The web client of the TV function unit 24 receives a shortcut key input from the remote controller 30 using, for example, Bluetooth (1005). The web client transmits the command corresponding to the shortcut key input to the high-speed CGI module in the web framework 905 linked to the corresponding CGI thread (1010). The high-speed CGI module transmits a request corresponding to the command to the REST engine (1015). The REST engine identifies that the request is for device control and transmits the control request to the control service module of the service framework 910 (1020).

In response to the control request, the control service module obtains detailed information such as device type, name, and connection corresponding to the device to be controlled from the device module in the core/base framework 915 (1025), and sends the information to the service module. Control services such as power on/off, temperature up/down, and curtain open/close of the device to be controlled are requested (1030). The control service request is transmitted from the service module to the communication module, and the communication module converts the control service request into a control command suitable for the communication protocol of the device, such as ZigBee or Z-Wave, and transmits it to the device ( 1035).

FIG. 11 shows a procedure for receiving a device state change result from the gateway 22 according to an embodiment of the present disclosure.

Referring to FIG. 11, the gateway 22 includes a web framework 905, a service framework 910, and a core/base framework 915.

The device may transmit a status change result (device status changed) to the gateway 22 in response to a control command from the gateway 22 or periodically/non-periodically (1105). When the status change result is received, the communication unit of the core/base framework 915 generates a device status changed event. The service module transmits the device state change event to the control service module of the service framework 910 (1110), and the control service module transmits the device state change event to the web push engine of the web framework 905 (1110). 1115). The web push engine transmits a notification according to the device status change event to the REST engine (1120), and the REST engine notifies the TV function unit 24 of a response including the status change result in response to the notification (1125) ). The TV function unit 24 may output the status change result to a TV display and/or, if possible, transmit a notification message including the status change result to the remote controller 30 via Bluetooth (1130). If the remote controller 30 has an output means such as a speaker or display, the remote controller 30 can output the status change result so that the user can perceive it.

<Table 2> below shows examples of state change events.

Event Description PowerStateChangeEvent Indicates changes in the power state of the device, on->off, off->on. (This event occurs when there is a change in the power state of device. On to Off, Off to On) ModeStateChangeEvent Indicates a change in the operating mode of the device. (This event occurs when there is a change in the operation mode of the device) DoorStateChangeEvent Indicates that the refrigerator door is open. (This event occurs when refrigerator door is opened.) TemperatureChangeEvent Indicates that the temperature of the device has changed. (This event occurs when there is a change in the temperature of device.) OperationStateChangeEvent Indicates that an operation error has occurred in the device. (This event occurs when there is an operation error in the device.) BatteryLevelChangeEvent Indicates that the battery needs to be recharged. (This event occurs when there is a need to charge the battery.) MotionDetectionEvent Indicates that movement has been detected. (This event occurs when motion is detected.) FanModeChangeEvent Indicates that the fan mode for temperature control has been changed. (This event occurs when fan mode of thermostat is changed.) FanStateChangeEvent Indicates that the fan status for temperature control has changed. (This event occurs when fan state of thermostat is changed.) ThermostatModeChangeEvent Indicates that the mode for temperature control has changed. (This event occurs when mode of the thermostat is changed.) ThermostatSetPointChangeEvent Indicates that the setting value for temperature control has been changed. (This event occurs when Set Point of thermostat is changed.)

Below, an example of a status change notification transmitted from a web push engine is shown.

{

"LongPollingNotification": {

"Events": [

{

"SubDevices": [

{

"Operation": {

"power": "On"

},

"id": 1

}

],

"eventTime": "2015-06-09T12:25:51",

"resourceURI": "/devices/a747a355-5304-445e-a0ef-80372a01361c/subdevices/1/operation",

"uuid": "ef84592b:5"

},

{

"SubDevices": [

{

"Operation": {

"power": "On"

},

"id": 1

}

],

"eventTime": "2015-06-09T12:25:51",

"resourceURI": "/devices/298a29bd-9ef8-423c-a6cf-99ea238eb935/subdevices/1/operation",

"uuid": "ef84592b:10"

},

{

"SubDevices": [

{

"Operation": {

"power": "On"

},

"id": 2

}

],

"eventTime": "2015-06-09T12:25:51",

"resourceURI": "/devices/ac433122-b434-4cb3-bebe-4983aa0ce49e/subdevices/2/operation",

"uuid": "ef84592b:11"

},

"eventTime": "2015-06-09T12:25:51",

"resourceURI": "/devices/7bb0760c-e1de-4502-a4a1-cd80e1b6002b/subdevices/1/operation",

"uuid": "ef84592b:2"

}

],

"subscriptionId": "9f3452d1-a93e-48f8-8362-5e96dc935eb8"

}

}

FIG. 12 is a diagram for explaining a device control processing procedure according to an embodiment of the present disclosure.

Referring to FIG. 12, the remote controller 30 detects an input for a shortcut key for device control, for example, [TEMPERATURE:+] (30a), and sends a key input signal corresponding to the detected key input to the gateway ( 22) and transmit it (1202). If the TV display 26 is in a disabled state (1204), the gateway 22 activates the TV display 26 to indicate that "[TEMPERATURE:+] has been entered." Or, you can print something like “It increases the room temperature.”

The gateway 22 transmits a temperature increase control command to the temperature controller, which is the target device 15, corresponding to the key input signal (1206). As an example, the control command may instruct to increase the temperature by 1 degree, or to increase the existing set temperature by 1 degree. The temperature controller performs heating according to the control command and transmits the processing result to the gateway 22 (1208). As an example, the processing result may indicate completion of processing, or may indicate the current temperature or set temperature. Then, the gateway 2 outputs a phrase corresponding to the processing result, for example, [current temperature 21 degrees / set temperature 23 degrees] on the TV display 26 (1210). However, this is only an example and notification of status change may be configured differently depending on various embodiments.

Figure 13 is a diagram for explaining a service request processing procedure according to an embodiment of the present disclosure.

Referring to FIG. 13, the remote controller 30 detects an input for a shortcut key for a service request, for example, [MAKE UP ROOM] (30f), and sends a key input signal corresponding to the detected key input to the gateway ( 22) and transmit it (1302).

The gateway 22 transmits a service request corresponding to the key input signal to the management server 40 (1306). As an example, the service request may include a service ID corresponding to the MAKE UP ROOM service. If the TV display 26 is in a deactivated state (1304), the gateway 22 may activate the TV display 26 to output a phrase such as “[MAKE UP ROOM] service has been requested” (1308). . The management server 40 processes the service request and transmits the processing result to the gateway 22 (1310). Then, the gateway 2 sends a phrase corresponding to the processing result, such as “[MAKE UP ROOM]” “The service has been processed.” is output to the TV display 26.

Figure 14 shows a screen of the TV display 26 notifying a change in the status of a service request according to an embodiment of the present disclosure. Here, an example of a housekeeping service request is shown.

Referring to FIG. 14, the TV display 26 is in a standby state and is deactivated (1405). At this time, the housekeeping status is “No request.” When a shortcut key input of [DO NOT DISTURB] is received through the remote controller 30 while the TV display 26 is inactive (1410), the TV function unit 24 activates the TV display 26 and displays the TV. Through (26), a phrase indicating the housekeeping status corresponding to the shortcut key input, for example, “Do not disturb / Applied successfully,” can be displayed (1415). At this time, the housekeeping status becomes “Do not disturb.” Additionally, the TV display 26 may further display a message for changing the requested housekeeping status, for example, “Press DO NOT DISTURB button repeatedly to set on or off.” The information about the housekeeping status is transmitted to the hotel server 40 through the gateway 22.

In screen 1415, either [RETURN], [EXIT], or [POWER] is input through the remote controller 30, or a predetermined time (for example, 5 seconds) is input without input through the remote controller 30. ) has elapsed (1420), the TV function unit 24 deactivates the TV display 26 to remove the phrase and restore the standby state (1425). At this time, the housekeeping status is still “Do not disturb”.

In screen 1415, when the shortcut key input of [DO NOT DISTRUB] is received again (1430) through the remote controller 30, the TV function unit 24 changes the text on the TV display 26 to “Do not disturb / Canceled successfully.” and change the housekeeping service status to “No request” (1435). The information about the change in housekeeping status is transmitted to the hotel server 40 through the gateway 22. Likewise, the TV display 26 may further display a message for changing the housekeeping status, for example, “Press DO NOT DISTRUB button repeatedly to set on or off.”

In screen 1435, either [RETURN], [EXIT], or [POWER] is input through the remote controller 30, or a predetermined time (for example, 5 seconds) is input without input through the remote controller 30. ) has elapsed (1440), the TV function unit 24 deactivates the TV display 26 to remove the phrase and restore the standby state (1425). At this time, the housekeeping status is still “No request”.

Figure 15 shows a screen of the TV display 26 notifying a temperature change according to an embodiment of the present disclosure.

Referring to FIG. 15, while the TV display 26 is in a standby state and is inactive (1505), a shortcut key related to temperature setting is input through the remote controller 30, for example, [TEMPERATURE: +] or [TEMPERATURE: -]. When an input of is received (1510), the TV function unit 24 activates the TV display 26 and displays a phrase indicating the temperature control state corresponding to the shortcut key input through the TV display 26, for example, “Current 21°C.” / Set 23℃" can be displayed. (1515)

In screen 1515, when an input of [TEMPERATURE: +] or [TEMPERATURE: -] is received through the remote controller 30, the TV function unit 24 issues a command corresponding to the input, for example, increase temperature or decrease temperature. The command corresponding to is transmitted to the gateway 22. Then, the gateway 22 transmits a control command corresponding to a temperature increase or temperature decrease to at least one of the corresponding devices, that is, an air conditioner, a heater, and a temperature controller. In one embodiment, the gateway 22 determines that the user is located in an area where the control device 20 is installed, for example, the living room, and transmits the control command to the air conditioner, heater, and thermostat related to the living room. there is.

In screen 1515, either [RETURN], [EXIT], or [POWER] is input through the remote controller 30, or a predetermined time (for example, 5 seconds) is input without input through the remote controller 30. ) has elapsed, or if a shortcut key input related to temperature is not received through the remote controller 30 for a predetermined period of time (1520), the TV function unit 24 deactivates the TV display 26 to remove the above phrase. and restore to standby state (1525).

FIGS. 16A and 16B illustrate a screen of the TV display 26 that outputs processing results with the TV function activated according to an embodiment of the present disclosure.

Referring to FIG. 16A, the TV display 26 is activated and outputs TV images according to the TV's own functions (1605). When one of the shortcut keys, for example, [TEMPERATURE: +], is input through the remote controller 30 while the TV display 26 is activated, the TV function unit 24 inputs the shortcut key on the TV image. A message (1615a) containing a phrase corresponding to, for example, displays “Current 21°C / Set 23°C” (1615). The message 1615a can be processed to be semi-transparent so as not to interfere with the TV image. In screen 1615, either [RETURN], [EXIT], or [POWER] is input through the remote controller 30, or a predetermined time (for example, 5 seconds) is input without input through the remote controller 30. ) has elapsed (1620), the TV function unit 24 removes the text from the screen of the TV display 26 and continues to display the original TV image (1625).

Referring to FIG. 16b, when one of the shortcut keys, for example, [TEMPERATURE: +], is input through the remote controller 30 while the TV display 26 is activated (1605), the TV function unit 24 ) is a message 1630a including a phrase corresponding to the shortcut key input in a predetermined area on the screen of the TV display 26, for example, the right side or bottom right, for example, "Current 21℃ / Set 23℃ " (1630). The message 1630a occupies a relatively small area so as not to disturb the TV image, and, for example, may be displayed translucently on the TV image. As another example, the TV function unit 24 may output the TV image by reducing or partially removing the TV image on the screen of the TV display 26, and display the text in the remaining area generated by reducing the TV image. In screen 1630, either [RETURN], [EXIT], or [POWER] is input through the remote controller 30, or a predetermined time (for example, 5 seconds) is input without input through the remote controller 30. ) has elapsed (1635), the TV function unit 24 removes the phrase from the screen of the TV display 26, restores the original TV image, and displays it (1640).

Figure 17 shows a method of processing shortcut key input according to an embodiment of the present disclosure.

Referring to FIG. 17, when a specific shortcut key, for example, [LIGHT ON] (30c) or [LIGHT OFF] (30d), is input (1700) through the remote controller 30, the TV display 26 is displayed in the room. Prints a layout including zones. Each time the same shortcut key is input, the TV display 26 can sequentially change and emphasize the areas to be controlled on the layout. For example, when [LIGHT ON] or [LIGHT OFF] (1700) is input for the first time, zone #1, which is set as default on the layout diagram, is displayed with emphasis (e.g., flashing, expansion, movement, cursor placement, etc.) (1705) ), if the same shortcut key is entered again, area #2 is emphasized (1710), and if the same shortcut key is entered again, area #3 is emphasized (1715).

With the desired area selected, the user inputs a key corresponding to Exit or OK through the remote controller 30 or waits without any action for a designated timeout period to select a device corresponding to the desired area. Control, that is, lighting on/off, can be performed. As an example, a confirmation key input is received from the remote controller 30 while a layout diagram such as screen 1710 is displayed by repeated input 1700 of [LIGHT OFF] (30d), or no input is received for 5 seconds. If not, the TV function unit 24 transmits a command to turn off the lighting for zone #2 to the gateway 22. Accordingly, the gateway 22 transmits a control command to turn off the lighting to the lighting device in zone #2. As an example, the gateway 22 detects that a confirmation key input is received from the remote controller 30 or no input is received for 5 seconds while the layout diagram as shown on screen 1710 is displayed, and the A control command to turn off the lighting is transmitted to the lighting device.

Figure 18 is a flowchart showing a lighting control operation according to an embodiment of the present disclosure.

Referring to FIG. 18, in step 1805, the TV function unit 24 receives a key input from the remote controller 30 and determines a code corresponding to the key input. In step 1810, the TV function unit 24 determines whether the determined code corresponds to lighting on/off. If the determined code has a code value corresponding to lighting on/off, and the determined code does not correspond to lighting on/off, the TV function unit 24 performs a function corresponding to the code in step 1835. Perform.

On the other hand, if the determined code corresponds to lighting on/off, in step 1815, the TV function unit 24 determines which area to emphasize among the areas in the room. The zone may have a zone ID of a default value, for example #1, or may be determined as a zone where the lighting is currently in an off or on state, or may have a zone ID next to the previously highlighted zone. In process 1820, the TV function unit 24 outputs a layout diagram including zones within the guest room through a TV display, and emphasizes (eg, blinks, colors, etc.) the determined zones. If the same key input is not received until the predetermined timeout period elapses in step 1825, the TV function unit 1830 stops outputting the layout diagram on the TV display and restores the TV display in step 1830.

Figure 19 shows shortcut key input by a mobile terminal operating as a remote controller according to an embodiment of the present disclosure. Here, an example of a mobile terminal implemented as a smartphone 1900 is shown.

Referring to FIG. 19, the smartphone 1900 is a mobile terminal equipped with a remote control application capable of communicating with the TV function unit 24. By executing the application, remote control of the smart hotel as described above is performed. At least one shortcut key can be printed. Additionally, the smartphone 1900 can operate as a room key linked to a hotel room door lock. The user can connect to the gateway 22 through the smartphone 1900 to authenticate the smartphone 1900 and download shortcut key settings for the hotel room. Then, the smartphone 1900 provides a shortcut key input screen and layout diagram optimized for each hotel room, allowing the user to control the hotel room more easily.

As another embodiment, the smartphone 1900 may support simple shortcut key input according to the number of touches, slide direction, or motion input by the user while executing its own function (e-book in the illustrated example). According to the example shown, when the smartphone 1900 detects a right-directed slide input 1905 while executing its own function, it determines that the shortcut key for [LIGHT ON] has been input, and the left-directed slide input 1910 is detected. When detected, it is determined that the shortcut key for [LIGHT OFF] has been entered, and when an upward slide input (1915) is detected, it is determined that the [TEMPERATURE: +] shortcut key has been entered, and when a downward slide input (1920) is detected. When this happens, it is determined that the shortcut key for [TEMPERATURE: -] has been entered.

The smartphone 1900 can transmit a shortcut key input by the user to the gateway 22 or the TV function unit 24, in the same way as the remote controller 30 described above. In addition, when the processing result of the control command or the status change result for the hotel room is received from the gateway 22 or the TV function unit 24, the smartphone 1900 displays the processing result or status change result on its screen or TV display. It can be displayed through (26).

Figure 20 shows other examples of the remote controller 30 according to an embodiment of the present disclosure.

As shown, a tablet computer 2000 and a wearable device 2005 that can connect a session with the gateway 22, as well as a TV and a mobile terminal (not shown) can be implemented with the remote controller 30. The remote controller 30 implemented as described above can output voice, sound, beep sound, vibration, etc. in response to the processing result feedback 2010 from the TV function unit 24 or the gateway 22.

In the above, embodiments for controlling devices in a hotel room by providing shortcut keys to a remote controller have been described. In the above-described embodiment, the product size of the remote controller was limited, so there was a limit to the number of devices for executing control and service requests. Moreover, because shortcut keys with fixed functions were provided, there was a problem that it was difficult to add new devices or services.

The embodiment described later supports soft mapping of shortcut keys to the remote controller. In other words, it can provide a guide for adaptive shortcut key mapping using the limited keypad of the remote controller.

Figure 21 is a diagram for explaining a shortcut key mapping guide according to an embodiment of the present disclosure.

Referring to FIG. 21, the remote controller 30 is provided with a shortcut key guide key 30g, and in response to an input 2105 of the shortcut guide key 30g, the TV display 26 displays a shortcut key mapping guide 2110. do. The shortcut key mapping guide 2110 may include an image representing at least a portion of the input unit of the remote controller 30 and a control menu composed of menu items indicating functions corresponding to at least some keys of the remote controller. In the illustrated example, the shortcut key mapping guide 2110 includes the [Open Door] function corresponding to the volume up key of the remote controller 30, the [Lock Door] function corresponding to the volume down key, and the [Open Curtain] function corresponding to the channel movement keys. ] function and the [Close Curtain] function's menu items (i.e. soft menu keys). In the illustrated example, the mapping relationship between each key and the corresponding menu item is indicated by a line connecting the image of the key and the text of the menu item. In one embodiment, the mapping relationship can be displayed by listing the names of keys and the names of menu items corresponding to them side by side. In one embodiment, the mapping relationship can be displayed by including the name of the corresponding menu item in the image of the key.

The TV display 26 may be instructed to output the shortcut key mapping guide 2110 by the TV function unit 24 or the gateway 22 that detects input through the remote controller 30. The shortcut key mapping guide 2110 is mapped to the shortcut guide key and includes keys that can be adaptively configured according to surrounding environments such as room conditions, temperature, date, season, guest profile, etc. The keys provided by the shortcut key mapping guide 2110 are called guided keys, and the guided keys operate to perform the guided function only while the shortcut key mapping guide 2110 is maintained on the TV display 26. .

If no input or guided key input is received from the remote controller 30 for a certain period of time (2115) after the shortcut key mapping guide 2110 is displayed, the TV display 26 displays the shortcut key mapping guide 2110. With removal, the keys of the remote controller 30 are restored to their original functions. After the shortcut key mapping guide 2110 is removed, the TV display 26 may return to the screen before the shortcut key mapping guide 2110 was output. As an example, the previous screen may be a display off or a TV image.

If a guided key input is detected by the remote controller 30 while the shortcut key mapping guide 2110 is displayed, (2125) the gateway 22 is notified of the key input from the remote controller 30, and the guided key input is detected by the remote controller 30. Performs functions corresponding to key input. In the illustrated example, when the key input 2125 for [next channel] among the guided keys [volume up], [volume down], [previous channel], and [next channel] is detected by the remote controller 30, the gateway (22) receives the key input signal for the key input from the remote controller 30 and instructs the curtain device 2130 to perform [Closing Curtain], which is a function corresponding to the [Next Channel].

The TV display 26 may continue to maintain the shortcut key mapping guide 2110 while the guided function is performed. The shortcut key mapping guide 2110 may be maintained until an Exit or Return key is input, or a predetermined time (for example, 5 seconds) elapses without a key input being detected.

Figure 22 shows an overall flowchart for providing a shortcut key mapping guide according to an embodiment of the present disclosure.

Referring to FIG. 22, in step 2205, the remote controller 30 detects a user input for a shortcut guide key and generates and transmits a key input signal. In step 2210, the gateway 22 receives the key input signal and, if necessary, adaptively maps shortcut keys and corresponding functions to be included in the shortcut key mapping guide, considering the surrounding environment. In step 2215, the gateway 22 generates information on a shortcut key mapping guide indicating the mapped functions and transmits the information to the TV display 26 so that the shortcut key mapping guide is displayed on the TV display 26.

In step 2220, while the shortcut key mapping guide is being displayed, if a user input through one of the keys guided by the shortcut key mapping guide is received from the remote controller 30, the gateway 22 performs a function mapped to the guided key. Control the corresponding device to perform. In process 2225, if no user input is detected through the remote controller 30 for a certain period of time, no user input for a guided key is detected, or the end/cancel key is input, the gateway 22 displays the TV display ( 26) Remove the shortcut mapping guide. In process 2230, the gateway 22 restores the functions of the keys of the remote controller 30 to their original state. After the shortcut mapping guide ends, the guided keys [Volume Up], [Volume Down], [Previous Channel], and [Next Channel] operate to perform their original functions.

Shortcut key mapping according to an embodiment of the present disclosure may be provided according to the direction in which the remote controller 30 is facing, in addition to or instead of the surrounding environment.

FIG. 23 illustrates an example of providing a shortcut key mapping guide according to the direction of the remote controller 30 according to an embodiment of the present disclosure.

Referring to FIG. 23, there is a case where a user input is detected while the remote controller 30 is facing the TV display 26 (i.e., the gateway 22), and a case where the user input is detected when the remote controller 30 is facing the device(s) 15 to be controlled through a shortcut key. When an input is detected, different shortcut key mapping guides may be provided. For example, the remote controller 30 may be directed to the direction in which the infrared (IR) transmitter of the remote controller 30 or the top of the remote controller 30 is facing ( Direction information 2310 representing 2305 can be transmitted to the gateway 22, and the TV display 26 displays devices located in the direction 2305 toward which the remote controller 30 is facing, under the control of the gateway 22. A shortcut key mapping guide containing menu items for control can be printed.

Figures 24A to 24C are diagrams for explaining an operation procedure for providing a shortcut key mapping guide according to the direction of the remote controller 30 according to an embodiment of the present disclosure.

Referring to FIG. 24A, a door lock 15a, a stand light 15b, and a curtain 1 (15c) are located to the left 2405 of the remote controller 30. To the right (2415) of the remote controller (30), a mood light (15d), a temperature controller (15e), and curtain 2 (15f) are located.

When the remote controller 30 is facing the left direction 2405 and an input 2410 for the shortcut guide key is detected, the TV display 26 displays the device located in the left direction 2405 as shown in FIG. 24B. A shortcut key mapping guide 2425 including control menus for fields 15a, 15b, and 15c is output. The shortcut mapping guide 2425 includes menu items of [Turn on stand], [Open door], [Lock door], [Open curtain 1], and [Close curtain 1].

When the remote controller 30 is facing in the right direction 2415 and an input 2420 for the shortcut guide key is detected, the TV display 26 is displayed in the right direction 2415, as shown in FIG. 24C. A shortcut key mapping guide 2430 including control menus for the devices 15d, 15e, and 15f is output. The shortcut key mapping guide 2430 includes menu items such as [Open Curtain 2], [Close Curtain 2], [Turn off mood light], [Raise temperature], and [Lower temperature].

When a key input corresponding to a guided key is detected while the shortcut key mapping guide 2425 or 2430 of FIG. 24B or FIG. 24C is displayed, the gateway 22 provides control to the device corresponding to the key input 2425. Send command 2440. When the [Previous Channel] key 2435 is input in the shortcut key mapping guide 2425 of FIG. 24B, the gateway 22 opens the Curtain 1 device (15c) to perform [Open Curtain 1], which is a function corresponding to the [Previous Channel] key. ) sends an opening control command (2440) to ).

If the shortcut key mapping guides 2425 and 2430 include menu items for service requests, the gateway 22 may transmit a service request 2445 to the hotel server 25 in response to input of the menu items.

Figure 25 shows a flowchart of an operation for providing an adaptive shortcut key mapping guide according to an embodiment of the present disclosure. As an example, the illustrated operation can be performed by the gateway 22 or the TV function unit 24, which can directly or indirectly receive a key input signal from the remote controller 30.

Referring to FIG. 25, in step 2505, the gateway 22 receives a key input signal corresponding to a key input from the remote controller 30. The key input signal may include a key code corresponding to the input key and additionally a geomagnetic value or orientation information measured by the remote controller 30 at the time of the key input. In step 2510, the gateway 22 determines whether the key input signal has a key code corresponding to a shortcut guide key.

If, as a result of the determination, the key code is not corresponding to the shortcut key guide key, the gateway 22 proceeds to step 2540 and determines whether the control menu provided by the shortcut key mapping guide is displayed. If the control menu of the shortcut key mapping guide is displayed, in step 2545, the gateway 22 performs the control function mapped therein in response to key input of the guided shortcut key. On the other hand, if the control menu of the shortcut key mapping guide is not displayed, the gateway 22 performs a general function corresponding to the key input in step 2550.

Meanwhile, if the determination result in step 2510 is a key code corresponding to a shortcut guide key, in step 2515, the orientation information of the remote controller 30 is determined based on the geomagnetic value included in the key input signal or included in the key input signal. Identify the oriented information provided. For example, the orientation information may be an azimuth on X-Y coordinates indicating the location and direction of the remote controller 30. For example, the geomagnetic value measured by the remote controller 30 has X-Y coordinate values, and the azimuth is calculated based on the X-Y coordinate values.

In step 2520, the gateway 22 compares the orientation information with device coordinates indicating the locations of devices in the room, and selects at least one device located in the direction toward which the remote controller 30 is facing according to the comparison result in step 2525. do. In step 2530, the gateway 22 maps the control menu and shortcut keys for the selected device, and in step 2535, transmits information about a shortcut key mapping guide including the control menu and shortcut keys for the selected device to the TV display 26. Thus, a shortcut key mapping guide is displayed on the TV display 26.

FIG. 26 illustrates a signal flow diagram for providing an adaptive shortcut key mapping guide by the remote controller 30 according to an embodiment of the present disclosure. Here, the network entity that processes the input by the remote controller 30 may be the gateway 22, the control device 20, or the TV function unit 24. In the following, for convenience of explanation, the gateway 22 is referred to as the gateway 22. This will be explained as an operation.

Referring to FIG. 26, in step 2600, the gateway 22 establishes a connection with at least one device 15 registered in the smart hotel control system and updates information about the device 15 as a control target device in step 2605. And, in step 2610, a control target list including information on control target devices is transmitted to the remote controller 30. Here, the control target list may be transmitted from the gateway 22 to the remote controller 30 periodically, by an event trigger, or in response to a request from the remote controller 30. For example, the control target list may be updated and transmitted to the remote controller 30 when a new device is connected or an existing device is disconnected. The control target list is information about each control target device and may include at least one of name, model name, manufacturer, function, status, and location. In this embodiment, the control target list includes at least the location of each device.

<Table 3> below shows an example of a control target list.

device location relative position light 1 130°SE Left side of curtain 1 (90°E) curtain 1 180°S Right side of light 1 (270°W) thermostat 50°NE To the right of light 2 (90°E)

As illustrated in <Table 3>, the control target list includes the name of each device, location information based on the true north direction, and/or relative location information based on other devices. The location information may be determined based on the gateway 22 or the TV device 24, for example.

In step 2615, the remote controller 30 detects a key input by the user and determines directional information. For example, the orientation information may be an azimuth on X-Y coordinates indicating the direction in which the remote controller 30 is facing. In step 2620, the remote controller 30 selects at least one device 15 located in the direction toward which the remote controller 30 is based based on the orientation information and the control target list. In step 2625, the remote controller 30 outputs a shortcut key mapping guide including a control menu predetermined for the selected device 15 through the display. The control menu provides mapping information for the function(s) of the selected device 15 and user input(s) for performing the function(s). The remote controller 30 can output the shortcut key mapping guide through its display. For this purpose, the remote controller 30 may consist, for example, of a smartphone or tablet computer with its own display. As an optional embodiment, the remote controller 30 may transmit information about the shortcut key mapping guide to the gateway 22 so that the gateway 22 outputs the shortcut key mapping guide to the TV display 26.

As an example, in step 2625, the shortcut key mapping guide may be provided to the user through voice with or without a display. As an example, the remote controller 30 may output the name of the selected device 15 and at least one command that can be provided by the selected device as a voice.

Table 4 below shows an example of control menus and control signals corresponding to each device.

device Control menu control signal light 1 Volume up/down keys On/Off motion award speed/size brightly under darkly curtain 1 Previous/next channel keys OpenClose motion left speed/size move left right move right

Referring to <Table 4>, the control menu corresponding to light 1 includes key code(s) indicating the volume up/down keys of the remote controller 30 used to control light 1, and the key code(s) that indicate the volume up/down keys used to control light 1. It defines the motion input that can be used, and the control signal corresponding to light 1 is the on/off signal corresponding to the volume up/down key, and the [bright]/[dark] control signal corresponding to the motion input in the up/down direction. Includes. In addition, the control menu corresponding to Curtain 1 defines key code(s) indicating the previous/next channel keys of the remote controller 30 used to control Curtain 1, and motion inputs that can be used to control Curtain 1, , the control signal corresponding to curtain 1 includes an open/close signal corresponding to the previous/next channel key, and a [move left]/[move right] control signal corresponding to a motion input in the left/right direction.

As an example, the degree or scale of control by a control signal may be determined according to the motion speed and/or size of the remote controller 30. For example, when the remote controller 30 detects that the remote controller 30 is moving upward, it can control light 1 to brightness corresponding to the speed or degree of movement in the upward direction. For example, when the upward movement speed or movement degree (i.e., movement distance) exceeds a predetermined threshold, a control signal commanding to adjust light 1 to 90% brightness is output. As another example, when the remote controller 30 detects that it is moving to the left, the remote controller 30 transmits a control signal commanding curtain 1 to continue moving to the left, and the remote controller 30 stops moving. A control signal commanding to stop controlling Curtain 1 is transmitted. For example, when the leftward movement speed of the remote controller 30 exceeds the second threshold, the remote controller 30 may transmit a control signal commanding to open curtain 1 by 80% in the leftward direction. .

When the remote controller 30 detects a user input for one of the user inputs guided by the shortcut key mapping guide in step 2630, it generates a control command instructing a function corresponding to the user input in step 2635. As an example, the user input may include at least one of a key input, a motion input, and a touch input for at least one key guided by the shortcut key mapping guide among the keys of the remote controller 30. In step 2640, the control command is transmitted through the gateway 22 or the TV function unit 24, or directly to the device 15 that can perform the function corresponding to the key input.

FIG. 27 is a signal flow diagram for providing an adaptive shortcut key mapping guide when multiple devices are in the same direction according to an embodiment of the present disclosure. Here, the gateway 22 that processes input by the remote controller 30 may be replaced by the TV function unit 24 or the control device 20.

Referring to FIG. 27, in step 2700, the gateway 22 establishes a connection with at least one device 15 registered in the smart hotel control system and updates information about the device 15 as a control target device in step 2705. And, in step 2710, a control target list including information on control target devices is transmitted to the remote controller 30. Here, the control target list may be transmitted from the gateway 22 to the remote controller 30 periodically, by an event trigger, or in response to a request from the remote controller 30. For example, the control target list may be updated and transmitted to the remote controller 30 when a new device is connected or an existing device is disconnected. The control target list is information about each control target device and may include at least one of name, model name, manufacturer, function, status, and location. In this embodiment, the control target list includes at least the location of each control target device.

In process 2715, the remote controller 30 detects user input and determines orientation information. For example, the orientation information may be a geomagnetic value measured by the remote controller 30 or an azimuth on X-Y coordinates indicating the direction the remote controller 30 is facing. In process 2720a, the remote controller 30 identifies a plurality of candidate devices located in the direction toward which the remote controller 30 is headed based on the orientation information and the control target list, and provides information about the candidate devices through a display, voice, etc. Notifies the user through. For example, the candidate devices may be devices included in the control target list. As an example, the display of the remote controller 30 displays symbols (e.g., small pictures) of the plurality of candidate devices, and user input (e.g., key input, motion input, touch input, Mapping information of at least one of the voice inputs may be output.

As an example, the remote controller 30 transmits information about the plurality of candidate devices to the gateway 22, so that the gateway 22 outputs a selection menu for selecting the candidate devices to the TV display 26. You can. As an example, the selection menu may include mapping information of symbols of the candidate devices and user input (e.g., at least one of key input, motion input, touch input, and voice input) mapped to the candidate devices. . As another example, the remote controller 30 may output the list of candidate devices in voice.

In step 2720b, the remote controller 30 detects a user input for selecting a control target device among the candidate devices, and selects the device 15 corresponding to the user input in step 2725. For example, the user input may be an input for a key of the remote controller 30 corresponding to one of the candidate devices. For example, the user input may be a motion input or a voice input indicating one of the candidate devices.

In step 2730, the remote controller 30 outputs a shortcut key mapping guide including a control menu predetermined for the selected device 15 through the display. The control menu provides mappings to the function(s) of the selected device 15 and keys on the remote controller 30 to perform the function(s). The remote controller 30 can output the shortcut key mapping guide through its display. For this purpose, the remote controller 30 may consist, for example, of a smartphone or tablet computer with its own display. As an optional embodiment, the remote controller 30 may transmit information about the shortcut key mapping guide to the gateway 22 so that the gateway 22 outputs the shortcut key mapping guide to the TV display 26.

When the remote controller 30 detects a user input for one of the user inputs guided by the shortcut key mapping guide in step 2735, it generates a control command instructing a function corresponding to the user input in step 2740. In step 2645, the control command is transmitted to the device 15 capable of performing a function corresponding to the user input through the gateway 22 or the TV function unit 24 or directly.

FIG. 28 is a flowchart showing the operation of the remote controller 30 to provide a shortcut key mapping guide according to an embodiment of the present disclosure.

Referring to FIG. 28, in step 2805, the remote controller 30 detects a key input by the user and determines a code corresponding to the key input. In step 2810, the remote controller 30 determines whether the determined code is a key code corresponding to a shortcut guide key. If the determined code is not the key code of the shortcut key guide key, the remote controller 30 proceeds to step 2850 and determines whether the control menu provided by the shortcut key mapping guide is displayed. If the control menu of the shortcut key mapping guide is being displayed, the remote controller 30 proceeds to process 2835. On the other hand, if the control menu of the shortcut key mapping guide is not displayed, the remote controller 30 performs a general function corresponding to the key input in step 2855.

Meanwhile, if the determination in step 2810 is that the key code corresponds to the shortcut guide key, the remote controller 30 measures the geomagnetic value in step 2815 and determines orientation information. For example, the orientation information may be an azimuth indicating the direction the remote controller 30 is facing. As another example, the orientation information may be the measured geomagnetic value.

In step 2820, the remote controller 30 transmits a key input signal including the directional information to the gateway 22. In step 2825, the remote controller 30 receives information on a shortcut key mapping guide including a control menu mapped to at least one control target device from the gateway 22, and displays the shortcut key mapping guide in step 2830. The control menu may provide mapping of the function(s) of the controlled device and key(s) on the remote controller 30 for performing the function(s).

In step 2835, the remote controller 30 detects a key input, and in step 2840, it determines whether the detected key input corresponds to one of the keys guided by the shortcut key mapping guide. If it is not a guided key input, in step 2855 the remote controller 30 performs the normal function corresponding to the key input. On the other hand, if a guided key input is detected, a key input signal indicating the key input is transmitted to the gateway 22 in step 2840, so that the gateway 22 controls a control command indicating a function corresponding to the key input. Send it to the target device.

Figure 29 is a flowchart showing the operation of the gateway 22 to provide a shortcut key mapping guide according to an embodiment of the present disclosure. Here, the gateway 22 that processes input by the remote controller 30 may be replaced by the TV function unit 24 or the control device 20.

Referring to FIG. 29, in step 2905, the gateway 22 updates a control target list including information on control target devices whenever a device is registered, released, or changed in the smart hotel control system. In step 2910, the gateway 22 receives a key input signal including directional information from the remote controller 30. In step 2915, the gateway 22 selects at least one control target device located in the direction toward which the remote controller 30 is based, based on the orientation information and the control target list, and performs a predetermined control on the selected device. Map the menu. In step 2920, the gateway 22 transmits information on a shortcut key mapping guide including a control menu mapped to the selected device to the remote controller 30. In step 2925, the gateway 22 receives a key input signal for one of the keys guided by the shortcut key mapping guide from the remote controller 30, and in step 2930, a control command instructing a function corresponding to the key input signal is provided. is transmitted to the corresponding control target device.

FIG. 30 illustrates a signal flow diagram for controlling a device corresponding to directional information by the gateway 22 according to an embodiment of the present disclosure. Here, the gateway 22 that processes input by the remote controller 30 may be replaced by the TV function unit 24 or the control device 20.

Referring to FIG. 30, in step 3000, the gateway 22 establishes a connection with at least one device 15 registered in the smart hotel control system and updates information about the device 15 as a control target device in step 3005. Construct a control target list.

In process 3010, the remote controller 30 detects a key input by the user and determines directional information. For example, the orientation information may be a geomagnetic value measured by the remote controller 30 or an azimuth indicating the direction the remote controller 30 is facing. In step 3015, the remote controller 30 transmits the directional information to the gateway 22 in a key input signal. The key input signal may include the orientation information and a key code corresponding to the detected key input.

In step 3020, the gateway 22 compares the orientation information with the location of the controlled device in the control target list, selects at least one controlled device located in the direction toward which the remote controller 30 is headed, and selects the selected Map predetermined control menus for devices. In step 3025, the gateway 22 transmits information on a shortcut key mapping guide including a control menu mapped to the selected device to the remote controller 30. In step 3030, the remote controller 30 displays a control menu included in the shortcut key mapping guide.

In step 3035, the remote controller 30 detects a key input corresponding to one of the keys guided by the shortcut key mapping guide, and transmits a key input signal corresponding to the detected key input to the gateway 22 in step 3040. do. In step 3045, the gateway 22 generates a control command instructing a function corresponding to the key input, and transmits the control command to the corresponding control target device in step 3050.

FIG. 31 is a flowchart illustrating the operation of the gateway 22 to display a control menu of a shortcut key mapping guide according to an embodiment of the present disclosure. Here, the gateway 22 that processes input by the remote controller 30 may be replaced by the TV function unit 24 or the control device 20.

Referring to FIG. 31, in step 3105, the gateway 22 updates a control target list including information on control target devices whenever a device is registered, released, or changed in the smart hotel control system. When a key input signal including directional information is received from the remote controller 30 in step 3110, the gateway 22 moves in the direction toward which the remote controller 30 is headed based on the directional information and the control target list in step 3115. At least one control target device is selected and a control menu including predetermined functions for the selected device is mapped.

In step 3120, the gateway 22 displays a shortcut key mapping guide including the control menu on the TV display 26. In step 3125, the gateway 22 receives a key input signal for one of the keys guided by the shortcut key mapping guide from the remote controller 30, and in step 3130, a control command instructing a function corresponding to the key input signal is provided. is created and transmitted to the corresponding control target device.

In the above, an embodiment in which a shortcut key guide key is provided on a remote controller linked to a TV has been described. However, for more efficient smart hotel control, a dedicated remote controller with shortcut keys can be used.

Figures 32a and 32b illustrate an input unit of a remote controller configured exclusively for shortcut keys according to an embodiment of the present disclosure.

Referring to FIG. 32A, the remote controller 3200 is configured to include a device key 3205, a service key 3210, a binary control key 3215, and a multiple control key 3220. . The device key 3205 is used to select a device to be controlled (i.e., a control target device), and the service key 3210 is used to select a service to be requested. It is used to power on/off or lock/unlock the control target device selected by the binary control key 3215, or to request (set)/cancel the service selected by the service key 3210, and is a multi-control key (3220) is used to control the temperature of the controlled device, the brightness of the light, and the degree of opening/closing the curtain with a grade value.

Referring to Figure 32b, the remote controller 3230 includes a device key 3235, a service key 3240, and a control/request key 3245, and can control the control target device according to a combination of key input and motion input. It may further include a sensor unit 3250 and a speaker 3255. The sensor unit 3250 may be configured as an acceleration/gyro/magnetic field sensor. The device key 3235 is used to select a device to be controlled (i.e., a control target device), and the service key 3240 is used to select a service to be requested. The control/request key 3245 is used to power on/off or lock/unlock the control target device, or to request (set)/cancel the service selected by the service key 3210.

The remote controller 3230 delivers a list of candidate devices that can be controlled to the user through the TV display 26 or the speaker 3255 when the device key 3235 is input. As an example, the TV display 26 may output images (pictures) of devices located in the direction toward which the remote controller 3230 faces in response to the input of the device key 3235. As an example, the remote controller 3230 may output the names of devices located in the direction toward which the remote controller 3230 faces as a voice (sound) in response to the input of the device key 3235. Devices located in the direction toward which the remote controller 3230 faces are determined based on the geomagnetic value measured by the sensor unit 3250 and the control target list configured by the gateway 22. The remote controller 3230 may determine a function to be performed by the control device in response to the movement detected by the sensor unit 3250.

FIGS. 33A and 33B are diagrams for explaining examples of use of a remote controller 3230 dedicated to shortcut keys according to an embodiment of the present disclosure.

Figure 33a shows an example of an operation for adjusting the brightness of a light in a situation where multiple devices are present in the room. Referring to FIG. 33A, when a press input on the device key 3325 is detected while the remote controller 3230 is facing the light 3310 that is to be controlled, the remote controller 3230 selects the device in the control target list. Among them, “lights, curtains,” which are a plurality of devices 3310 and 3315 located in a direction corresponding to the directional information, are output as voices through a speaker. In a situation where a plurality of devices 3310 and 3315 are detected, the remote controller 3230 may determine a control target device in response to a motion input.

As a specific example, if leftward motion 3320 is detected while pressing the device key 3325 is maintained, the remote controller 3230 outputs “light selection” as a voice to inform the user that the light has been selected. Although not shown, if rightward motion is detected while the pressing input of the device key 3325 is maintained, the remote controller 3230 may output “curtain selection” as a voice. When the pressing input of the device key 3325 is released, the remote controller 3230 finally determines the selected device, a light in the example shown, as the control target device.

When a press input of the control/request key 3335 is detected while the light is selected, the remote controller 3230 waits for a motion input to control the function of the light. If upward motion 3325 is detected while the press input of the control/request key 3335 is maintained, the remote controller 3230 sets a brightness value corresponding to the magnitude of the motion, for example, “brightness 10.” It is output as a voice, and the light 3310 is controlled to a brightness of 10. When the press input on the control/request key 3335 is released while a specific brightness value is selected, the light 3310 maintains the brightness value controlled by the remote controller 3320.

Figure 33b shows an example of an operation for requesting a towel in a situation where a large number of fixtures are present in the room. Referring to FIG. 33b, when a press input on the service key 3340 is detected while the remote controller 3230 is facing the towel 3355, which is the object to be controlled, the remote controller 3230 responds to the pointing information. “Towel, toothpaste”, which are service target equipment (3350, 3355) located in the direction, is output as a voice through the speaker. In a situation where a plurality of fixtures 3350 and 3355 are detected, the remote controller 3230 may determine a service target fixture in response to a motion input.

As a specific example, if downward motion 3345 is detected while the service key 3340 is pressed and maintained, the remote controller 3230 outputs “towel selection” as a voice to inform the user that a towel has been selected. Although not shown, if motion in the upward or right direction is detected while the pressing input of the service key 3340 is maintained, the remote controller 3230 may output “toothpaste selection” as a voice. When the press input of the service key 3340 is released, the remote controller 32300 determines the finally selected fixture, in the example shown, “towel” as the service target fixture.

When a press input of the control/request key 3335 is detected while a towel is selected, the remote controller 3230 outputs “towel request complete” as a voice, and also sends a service request signal of “towel request” to the gateway 22. By transmitting , the gateway 22 can request the hotel server 40 to add a towel.

Figure 34 is a flowchart showing the operation of providing a shortcut key mapping guide considering room conditions according to an embodiment of the present disclosure. Here, the network entity that processes the input by the remote controller 30 may be the gateway 22, the control device 20, or the TV function unit 24. In the following, for convenience of explanation, the gateway 22 is referred to as the gateway 22. This will be explained as an operation. Also, of course, the remote controller 30 can be replaced with the remote controller 3200 of FIG. 32A or the remote controller 3230 of FIG. 32B.

Referring to FIG. 34, in step 3405, the gateway 22 updates a control target list including information on control target devices whenever a device is registered, released, or changed in the smart hotel control system. In process 3410, which can be optionally performed, the gateway 22 obtains a guest profile from the hotel server 40. The guest profile may include at least one of the guest's gender, age, presence or absence of infants, and previous history. Here, the previous history may include functions frequently used during the guest's previous stay.

When a key input signal including directional information is received from the remote controller 30 in step 3415, the gateway 22 identifies room conditions such as room mode, time, season, and guest status in step 3420, which can be optionally performed. do. For example, the guest status may include at least one of check-in, sleeping status, bathroom use status, and TV watching status.

In step 3425, the gateway 22 selects at least one control target device located in the direction toward which the remote controller 30 is based based on at least one of the orientation information, the control target list, the guest profile, and the room situation, and Map a predetermined control menu to the selected device.

In step 3430, the gateway 220 displays a shortcut key mapping guide including the control menu through the display of the TV display 26 or the remote controller 30. In step 3435, the gateway 22 is guided by the shortcut key mapping guide. A key input signal for one of the keys is received from the remote controller 30, and in step 3440, a control command instructing a function corresponding to the key input signal is transmitted to the corresponding control target device.

Figures 35A to 35C are diagrams for explaining provision of a shortcut guide that is adaptive over time according to an embodiment of the present disclosure.

Figure 35a shows a shortcut key mapping guide 3510 that can be provided through the display of the TV display 26 or the remote controller 30 in response to input of a shortcut guide key at 8:00 AM. , As shown, it includes device control items such as [Turn on cooling] and [Open curtains], which are each mapped to specific keys of the remote controller 30, and service request items such as [Wake-up] and [Morning]. do. As an example, the device control items may be mapped to volume up/down keys, and the service request items may be mapped to previous/next channel keys.

Figure 35B illustrates a shortcut key mapping guide 3520 that can be provided in response to input of a shortcut guide key at 10:00 PM, a function that is likely to be used to prepare for sleep as shown. Includes service request items such as [Stop cooling], [Close curtains], [Sleep], and [Night]. As an example, [Stop cooling] and [Close curtains] can be mapped to volume up/down keys, and [Sleep] and [Night] for controlling sleep and nighttime can be mapped to previous/next channel keys.

Figure 35c shows a shortcut key mapping guide 3530 that can be provided in response to input of a shortcut guide key at 3:00 AM, and as shown, [ Includes device control items such as [Hallway ON], [Open curtain], [Toilet ON], and [Light ON]. As an example, [Hallway ON] and [Open curtain] may be mapped to volume up/down keys, and [Toilet ON] and [Light ON] may be mapped to previous/next channel keys. Specifically, during the early morning hours, the [Light ON] function to turn on the light in the bathroom direction is prioritized.

Additionally, the shortcut mapping guide may include seasonally appropriate functions. As an example, in the case of winter, the shortcut key mapping guide may include device control items for operating the heating function, and in the case of summer, the shortcut key mapping guide may include device control items for operating the cooling function. You can.

In one embodiment, the shortcut key mapping guide may be adaptively configured according to the guest profile. For example, if the guest's age is older, for example, if they are in their 50s or older, the shortcut key mapping guide may be composed of a silver mode that focuses on larger fonts, simpler functions, and group control. The shortcut key mapping guide in silver mode includes a smaller number of menu items than the shortcut key mapping guide in normal mode, and each menu item can be configured to control devices in groups rather than individually. As an example, the shortcut key mapping guide in silver mode may consist of keys mapped to [sleep state] and [wake-up state], and in response to the guided key input of [sleep state], stop cooling, close curtains, and sleep with the hotel server. Related functions, such as status notification, can be performed all at once.

In one embodiment, the shortcut key mapping guide can be adaptively configured to reflect not only time and season, but also the user's status determined in an active manner. As an example, a sleep sensor (Sleep), which can be located under the head of the bed or pillow, detects whether the user is asleep, and the shortcut key mapping guide includes functions corresponding to when the user is detected to be asleep. It can be configured.

Figures 36A and 36B are diagrams for explaining the provision of a shortcut key mapping guide reflecting the user's status according to an embodiment of the present disclosure.

Referring to FIG. 36A, the sleep sensor 3600 is located under the head of the bed or the pillow, periodically detects whether the user is asleep, and notifies the result to the gateway 22. (3605) Gateway 22 ) receives a key input signal for a shortcut guide key from the remote controller 30 in a situation in which the user is recognized as being in a sleeping state (3615), and displays a shortcut key mapping guide (3620) corresponding to the sleeping state on the TV display (26). ) is displayed. As examples, the shortcut key mapping guide 3620 corresponding to the sleeping state may include menu items such as [Hallway ON], [Open Curtain], [Toilet ON], and [Light ON].

In one embodiment, the shortcut key mapping guide can be adaptively configured depending on the room mode. For example, when a housekeeper enters the room, the room mode becomes the housekeeping state. If an input to a shortcut guide key is detected while the room mode is in a cleaning state, the shortcut key mapping guide may be configured to include functions for the cleaning manager. As an example, the shortcut mapping guide can be adaptively configured according to various room modes, that is, guest mode and inspector mode.

FIG. 37 is a diagram illustrating the provision of an adaptive shortcut key mapping guide according to room mode according to an embodiment of the present disclosure.

Referring to FIG. 37, when the cleaning manager enters the room using his or her master key, the gateway 22 receives a report of the cleaning manager's entry from the door lock and changes the room mode to the cleaning state. When a key input signal corresponding to a shortcut guide key is received from the remote controller 30 in the cleaning state, the gateway 22 displays a shortcut key mapping guide 3705 containing functions for device inspection and cleaning on the TV display 26. Display. As an example, the shortcut key mapping guide 3705 for cleaning status includes device control items such as [cooling check], [curtain check], [lighting check], and [battery check] and service request items such as [cleaning complete]. It can be included.

In one embodiment, the shortcut key mapping guide may include menu items arranged in the order of frequently used functions according to room statistics information.

As described above, various environmental factors such as guest age, time, season, and frequency of use have been explained to adaptively configure the shortcut key mapping guide, but the shortcut key mapping guide can be constructed by combining at least one of these environmental factors. Of course. For example, the shortcut key mapping guide may be configured to include frequently used functions in response to the guest's age, time, and season.

Figure 38 is a diagram for explaining a shortcut key mapping guide configured according to shortcut key usage history according to an embodiment of the present disclosure.

Referring to FIG. 38, a key input signal for a shortcut guide key is received from the remote controller 30, and a shortcut key mapping guide 3805 to be displayed on the TV display 26 in response to receiving the key input signal is the previous shortcut key. It can be configured according to usage history. As an example, menu items 3810, 3815, 3820, and 3825 included in the shortcut mapping guide 3805 can execute a predetermined number of most recently used functions. As an example, menu items 3810, 3815, 3820, and 3825 included in the shortcut key mapping guide 3805 may execute a predetermined number of frequently used functions. In the example shown, the frequently used functions include [open curtain] (3810), [close curtain] (3815), [turn on light] (3820), and [turn off light] (3825), and the above functions ( 3810,3815,3820,3825) are mapped to [TEMPERATURE: +], [TEMPERATURE: -], [LIGHT ON], and [LIGHT OFF], respectively.

As an example, the menu items 3810, 3815, 3820, and 3825 included in the shortcut mapping guide 3805 may indicate frequently used functions in the room regardless of the guest profile. As an example, the menu items 3810, 3815, 3820, and 3825 included in the shortcut key mapping guide 3805 may indicate functions frequently used by the current guest in the past, considering the guest profile.

The menu items 3810, 3815, 3820, and 3825 include images representing the actual input unit of the remote controller 30, names of functions corresponding to each shortcut key symbol on the input unit, and lines connecting the shortcut keys and names. It may be configured to include. In this way, by displaying the name of each function by connecting it to the corresponding shortcut key symbol with a line, the user can intuitively recognize the shortcut key on the remote controller 30 corresponding to the desired function.

Figure 39 illustrates a display example of a shortcut key mapping guide using a room image according to an embodiment of the present disclosure.

Referring to FIG. 39, the shortcut key mapping guide 3910 includes an image representing the actual input unit of the remote controller 30, the name of the function corresponding to each shortcut key symbol on the input unit, and lines connecting the shortcut keys and functions. It can be configured to include. Specifically, the shortcut key on the input unit may be connected to the symbol or image object of the corresponding control target device with a line. In the illustrated example, the TV display 26 outputs a room drawing or an actual photo of the room as a background 3905, and displays a shortcut mapping guide 3810 overlaid on the background 3905.

As an example, the shortcut key mapping guide 3910 includes symbols for the volume up key and volume down key of the remote controller 30, where the symbols for the volume up key and volume down key are the names of the corresponding functions, such as [Open] and It is connected by a line to at least one of the text boxes 3920 and 3925 of [Close] and the symbol/image 3920a indicating the curtain in the background 3905.

As an example, the shortcut key mapping guide 3910 includes symbols for the TV key and external input (SOURCE) key of the remote controller 30, and the symbols for the TV key and external input key are the names of the corresponding functions [ON]. and the text boxes 3915 and 3930 of [On] and the symbols/images 3920a and 3930a indicating stand lighting and mood lighting in the background 3905, respectively, by a line.

As an example, the shortcut key mapping guide 3910 includes symbols of the previous channel key and the next channel key of the remote controller 30, and the symbols of the previous channel key and the next channel key are the names of the corresponding functions, such as [Upload] and It is connected by a line to at least one of the text boxes 3935 and 3940 of [Lower] and the symbol/image 3935a indicating the temperature controller in the background 3905.

FIG. 40 illustrates an input unit of a remote controller including shortcut keys corresponding to controlled devices according to an embodiment of the present disclosure.

Referring to FIG. 40, the input unit 4010 of the remote controller 4005 includes shortcut keys corresponding to controlled devices, such as [CURTAIN], [THERMO], and [LIGHT]. , [DOOR] may be included. When the user inputs a shortcut key for the device he or she wants to control, a shortcut key mapping guide for controlling the function of the device may be output on the TV display 26 or the display of the remote controller 4005 (not shown). For example, the shortcut key mapping guide corresponding to the shortcut key of [Curtain] may include menu items of [Open Curtain] and [Close Curtain]. For example, the shortcut key mapping guide corresponding to the shortcut key of [temperature controller] may include menu items of [increase temperature] and [decrease temperature]. For example, the shortcut key mapping guide corresponding to the shortcut key for [Lighting] may include menu items for [Turn on lighting] and [Turn off lighting]. For example, the shortcut key mapping guide corresponding to the shortcut key of [Door] may include menu items of [Open] and [Lock].

As an embodiment, each shortcut key mapping guide may further include guidance text for motion input corresponding to the menu items or may include replacement for the menu items. For example, the shortcut key mapping guide corresponding to the shortcut key for [Curtain] may further include the following guidance phrases: [Motion: Up (↑)] for [Open Curtain] and [Motion: Down (↓)] for [Close Curtain]. You can. For example, the shortcut key mapping guide corresponding to the shortcut key of [temperature controller] further includes the following guidance phrases: [motion: left (←)] for [increase temperature] and [motion: right (→)] for [decrease temperature]. can do.

Figure 41 is a diagram for explaining a curtain control operation using a shortcut key of a remote controller according to an embodiment of the present disclosure.

Referring to FIG. 41, when an input 4110 for the shortcut key of [Curtain] of the remote controller 4005 is detected, the remote controller 4005 sends a key input signal corresponding to the input 4110 to the gateway 22. send. The gateway 22 displays a shortcut key mapping guide 4115 including menu items for controlling the curtain on the TV display 26 in response to receiving the key input signal. The shortcut key mapping guide 4115 includes menu items of [Open inner curtain] mapped to the volume up key of the remote controller 4005, [Close inner curtain] mapped to the volume down key, and [External curtain] mapped to the previous channel key. Contains the menu items of [Open Curtain] and [Close External Curtain], which are mapped to the following channel keys.

If an input 4120 for the next channel key of the remote controller 4005 is detected while the shortcut key mapping guide 4115 is being displayed, the gateway 22 controls the closing of the external curtain in response to the input 4120. By sending a command, the outer curtain executes closing (4125).

As an embodiment that can be implemented additionally or alternatively, the shortcut key mapping guide 4115 may further include guidance text for motion input for controlling functions of each device, or may include alternative menu items. For example, [Open inner curtain] is displayed (or replaced) with the guidance text [Motion: Up (↑)], and [Close inner curtain] is displayed with the guidance text [Motion: Down (↓)]. becomes (or is replaced). If the remote controller 4005 is detected to move in an upward direction while the shortcut mapping guide 4115 is displayed, a control command of “open” is sent to the inner curtain. Similarly, if the remote controller 4005 is detected to move in a downward direction while the shortcut mapping guide 4115 is being displayed, a control command of “close” is sent to the inner curtain.

As another example, [Open external curtain] is displayed (or replaced) with the guidance text [Motion: Left (←)], and [Close external curtain] is displayed with the guidance text [Motion: Right (→)]. (or replaced). If the remote controller 4005 is detected moving in the left direction while the shortcut mapping guide 4115 is displayed, a control command of “open” is transmitted to the outer curtain. Similarly, when the remote controller 4005 detects movement in the right direction while the shortcut mapping guide 4115 is displayed, a control command of “close” is transmitted to the external curtain.

Figure 42 is a diagram for explaining a control operation of a temperature controller using a shortcut key of a remote controller according to an embodiment of the present disclosure.

Referring to FIG. 42, when an input 4210 for the shortcut key of [temperature controller] of the remote controller 4005 is detected, the remote controller 4005 sends a key input signal corresponding to the input 4210 to the gateway 22. send to The gateway 22 displays a shortcut key mapping guide 4215 including menu items for controlling the thermostat on the TV display 26 in response to receiving the key input signal. The shortcut key mapping guide 4215 includes menu items of [FAN HIGH] mapped to the volume up key of the remote controller 4005, [FAN LOW] mapped to the volume down key, and [Raise Temperature] mapped to the previous channel key. ], and includes the menu items of [Reduce temperature], which are mapped to the following channel keys.

If an input 4220 for the next channel key of the remote controller 4005 is detected while the shortcut key mapping guide 4215 is being displayed, the gateway 22 responds to the input 4220 and sends the temperature controller to lower the temperature. By transmitting a control command, the thermostat lowers the set temperature from the currently set 23 degrees to 22 degrees (4225).

As an embodiment that can be implemented additionally or alternatively, the shortcut key mapping guide 4215 may further include guidance text for motion input for controlling functions of each device or may include alternative menu items. For example, [FAN HIGH] is displayed with the guidance text [Motion: Up (↑)], and [FAN LOW] is displayed with the guidance text [Motion: Down (↓)]. If the remote controller 4005 is detected to be moving in an upward direction while the shortcut mapping guide 4215 is displayed, a control command of “speed up” is transmitted to the blower (FAN). Similarly, if the remote controller 4005 is detected moving in a downward direction while the shortcut mapping guide 4215 is displayed, a control command of “reduce speed” is sent to the blower.

As another example, [Raising temperature] is displayed with the guidance text [Motion: Left (←)], and [Lowering temperature] is displayed with the guidance text [Motion: Right (→)]. If the remote controller 4005 is detected to move in the left direction while the shortcut mapping guide 4215 is displayed, a control command of “raise temperature” is transmitted to the thermostat. Similarly, when the remote controller 4005 detects movement in the right direction while the shortcut key mapping guide 4215 is displayed, a control command of “lower temperature” is transmitted to the temperature controller.

Figure 43 is a diagram for explaining device control and user status input operations using voice commands according to an embodiment of the present disclosure.

Referring to FIG. 43 , when a user's voice command 4305 is input to the remote controller 30, the remote controller 30 transmits the voice command 4305 to the gateway 22. The gateway 22 analyzes the voice command 4305 and outputs a shortcut key mapping guide 4310, 4315, and 4320 including a control menu corresponding to the voice command 4305 to the TV display 26. For example, the voice command 4305 includes “open the curtains,” “close the curtains,” “hot,” “cold,” “lower the temperature,” “sleep,” “dark,” “turn on the lights,” “open the door,” It could be at least one of the following: “Lock the door.”

For example, if the voice command 4305 is “Open the curtain” or “Close the curtain,” the shortcut key mapping guide 4315 displayed on the TV display 26 may include menu items of [Open the curtain] and [Close the curtain]. You can.

For example, when the voice command 4305 is “sleep,” the shortcut key mapping guide 4310 displayed on the TV display 26 includes menu items for device control such as [Stop cooling], [Close curtain], and [Sleep]. ], [Night] may include menu items for service requests.

[ It can include the menu items of [FAN HIGH], [FAN LOW], [Raise temperature], and [Decrease temperature].

As an embodiment that can be implemented additionally or alternatively, each shortcut key mapping guide (4310, 4315, 4320) may further include guidance text for motion input corresponding to control menus. For example, the control menus of the shortcut mapping guide 4310, [Stop cooling], [Close curtain], [Sleep], and [Night] include [Motion: Up (↑)], [Motion: Down (↓)], [ It can be displayed together with the guidance phrases [Motion: Left (←)] and [Temperature Decrease], respectively.

Various embodiments of the present invention may, in certain respects, be implemented as computer readable code on a computer readable recording medium. A computer-readable recording medium is any data storage device capable of storing data that can be read by a computer system. Examples of computer readable recording media include read only memory (ROM), random access memory (RAM), and compact disk-read only memory. memory: CD-ROM), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission over the Internet). It can be included. Computer-readable recording media may also be distributed across networked computer systems, such that computer-readable code is stored and executed in a distributed manner. Additionally, functional programs, codes, and code segments for achieving various embodiments of the present invention can be easily interpreted by programmers skilled in the field to which the present invention is applied.

Additionally, it will be appreciated that the devices and methods according to various embodiments of the present invention can be implemented in the form of hardware, software, or a combination of hardware and software. Such software may be stored on, for example, volatile or non-volatile storage devices such as ROM, whether erasable or rewritable, or memory such as RAM, memory chips, devices or integrated circuits, or For example, it may be stored in a storage medium that is optically or magnetically recordable and readable by a machine (eg, a computer), such as a compact disk (CD), DVD, magnetic disk, or magnetic tape. Methods according to various embodiments of the present invention may be implemented by a computer or a portable terminal including a control unit and memory, and this memory stores a program or programs including instructions for implementing embodiments of the present invention. It will be appreciated that this is an example of a suitable machine-readable storage medium.

Accordingly, the present invention includes a program containing code for implementing the device or method described in the claims of this specification and a machine-readable storage medium (such as a computer) storing such a program. Additionally, such programs may be transmitted electronically through any medium, such as communication signals transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

Additionally, devices according to various embodiments of the present invention can receive and store programs from a program providing device that is connected wired or wirelessly. The program providing device includes a program containing instructions for the program processing unit to perform a preset content protection method, a memory for storing information necessary for the content protection method, and a device for performing wired or wireless communication with the graphics processing unit. It may include a communication unit and a control unit that transmits the corresponding program to the transmitting and receiving device at the request of the graphics processing unit or automatically.

The embodiments of the present invention disclosed in the specification and drawings are merely provided as specific examples to easily explain the technical content of the present invention and to facilitate understanding of the present invention, and are not intended to limit the scope of the present invention. In addition, the embodiments according to the present invention described above are merely illustrative, and those skilled in the art will understand that various modifications and equivalent scopes of the embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the following patent claims.

Claims (33)

In a service-specific input/output method,
determining, by a remote controller, orientation information indicating a direction in which the remote controller is facing in response to a first user input sensed by the remote controller;
selecting, by the remote controller, a first device based on the determined orientation information and location information of devices included in a pre-stored control target list, wherein the first device is located in the direction toward which the remote controller faces;
The remote controller maps between at least one button key included in the remote controller and at least one control item corresponding to at least one function of the first device, such that a control menu is displayed on the display of the second device. transmitting the control menu including mapping information to the second device, wherein the first device, the second device, and the remote controller are different from each other,
detecting, by the remote controller, a second user input corresponding to one of the at least one button key, wherein the one button key is one of the at least one control item included in the control menu; Corresponds to any one control item,
The remote controller transmitting, by the remote controller, the control command indicating the one control item to the first device based on the second user input so that the first device performs a function corresponding to the control command. A method characterized by inclusion. The method of claim 1, wherein selecting the first device comprises:
When a plurality of devices corresponding to the directional information exist, the method is characterized in that the at least one device is selected based on relative location information of devices included in the control target list. The method of claim 1, wherein selecting the first device comprises:
displaying information about a plurality of devices corresponding to the directional information;
detecting a motion input corresponding to one of the displayed plurality of devices;
A method comprising selecting the first device corresponding to the sensed motion input. The method of claim 1, wherein the first user input is:
A method comprising inputting a shortcut guide key included in an input unit of the remote controller, a device selection key for selecting a control target device, and one of a plurality of device keys corresponding to the control target devices. The method of claim 1, wherein the control menu is:
Menu items corresponding to the at least one button keys of the remote controller and indicating the at least one function that can be performed by the first device, and
A method comprising at least one of guidance phrases indicating an input method for each control item. The method of claim 1, wherein the control menu is:
A method characterized in that it is configured considering at least one of time zone, season, guest profile, and room mode. The method of claim 1, wherein the control menu is:
Symbols representing at least some keys of the at least one button key of the remote controller,
Menu items indicating the at least one function that can be performed by the first device,
and the mapping information associating the at least one button key with the menu items. The method of claim 1, wherein the second user input is:
A method comprising at least one of key input, motion input, touch input, and voice input guided by the control menu. The method of claim 1, further comprising displaying a control menu adaptively configured according to the devices placed in the room and the room situation in response to the first user input,
The control menu is,
Symbols representing at least some of the at least one key of the remote controller, menu items indicating functions that can be performed by at least one device disposed in the room, and at least some of the keys A method comprising mapping information associating said menu items.
delete delete delete delete delete delete delete delete delete In a remote controller that provides service-specific input and output,
transceiver; and
A controller comprising:
determine orientation information indicating a direction in which the remote controller is facing in response to a first user input sensed by the remote controller;
Selecting a first device based on the determined orientation information and location information of devices included in a pre-stored control target list, where the first device is located in the direction toward which the remote controller is headed,
Using the transceiver, mapping between at least one button key included in the remote controller and at least one control item corresponding to at least one function of the first device such that a control menu is displayed on the display of the second device. transmit the control menu including mapping information to the second device, where the first device, the second device, and the remote controller are different from each other,
Detect a second user input corresponding to one of the at least one button key, where the one button key corresponds to one of the at least one control item included in the control menu. respond,
Using the transceiver, the control command indicating the one control item is set to be transmitted to the first device based on the second user input so that the first device performs a function corresponding to the control command. remote controller.
delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images