WO2020145515A1

WO2020145515A1 - Electronic device and control method therefor

Info

Publication number: WO2020145515A1
Application number: PCT/KR2019/017067
Authority: WO
Inventors: 한성주
Original assignee: 삼성전자주식회사
Priority date: 2019-01-08
Filing date: 2019-12-05
Publication date: 2020-07-16
Also published as: KR20200086115A

Abstract

An electronic device is disclosed. The present electronic device comprises: a memory; a communication interface including circuitry; and a processor for controlling the communication interface to: layer each of a plurality of sub-spaces included in a predetermined space into a plurality of layers; map a home device included in each of the layered sub-spaces to the each of the sub-spaces and store same in the memory; and when a user command is input, transmit a control signal for controlling a home device mapped to a sub-space to the home device, on the basis of identification information of the sub-space and identification information of the home device, the user command including the identification information of the sub-space and the identification information of the home device.

Description

Electronic device and control method thereof

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an apparatus and a control method for controlling a home appliance remotely.

Conventionally, in order to remotely control a plurality of products, it is possible to classify and control by a product name or a unique ID of the product. There is no problem in usability in classifying by product name (refrigerator, air conditioner, cleaning robot, etc.), but in the case of using the same product, that is, using multiple air conditioners, the product must be classified and controlled through a unique ID. However, such a unique ID is not easy to use, and the user directly assigns the name of the corresponding device through user setting.

In the prior art, when controlling a device through a remote device, in order to control a specific device, it is inconvenient to memorize a unique ID corresponding to each device, or a user must set a name for classification between devices. Even in the integrated control of a device included in a specific area, there was a inconvenience in that a user must specify a group between devices.

The present disclosure has been devised to improve the above-described problems, and an object of the present disclosure is to provide an electronic device and a control method thereof for layering a plurality of sub-spaces and mapping household appliances to at least one sub-space of the layered sub-spaces have.

In order to achieve the above object, a memory, a communication interface including circuitry, and a plurality of sub-spaces included in a predetermined space are layered into a plurality of layers, and each sub-space The included home appliance is mapped to each layered sub-space and stored in the memory. When a user command is input, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, the sub-space It includes a processor for controlling the communication interface to transmit a control signal for controlling the home appliance is mapped to the home appliance.

Here, the processor may identify each of the plurality of subspaces as a first layer or a second layer based on the predetermined structure of the space, and the second layer may be a lower layer of the first layer.

In addition, when the home appliance is mapped to a sub-space belonging to the lowest layer among the plurality of layers, the processor is a control target including identification information for each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance. A word may be generated, and the generated control target word may be mapped to the home appliance and stored in the memory.

Here, when the voice command including the control target word is input, the processor may control the communication interface to transmit a control signal for controlling at least one home appliance mapped to the control target word to the home appliance. have.

In addition, when a voice command including the control target word is input, the processor is configured to simultaneously control a plurality of home appliances belonging to different subspaces based on identification information of at least one layer included in the control target word. The communication interface may be controlled to transmit a control signal to the plurality of home appliances.

In addition, the electronic device may further include a display, and the processor may select a UI for selecting at least one of the plurality of home appliances when a plurality of home appliances belonging to different sub-spaces are identified based on the control target word. The display can be controlled to provide.

In addition, a floor plan including sub-spaces belonging to the lowest layer among the plurality of layers and identification information of household appliances belonging to the preset space may be displayed, and one of the identification information of the displayed household appliances may be sub-spaces. When a user command to map to one of the input is input, a control target word including identification information for each of the lowest layer and the upper layer of the lowest layer and identification information of the home appliance may be generated, and the generated control target Words may be mapped to the home appliance and stored in the memory.

In addition, the plan view may include at least one of a plan view generated by an external device, a plan view created by a user, a plan view generated through a preset application, or a plan view received by an external server.

In addition, when the identification information of the sub-space is not included in the user command, the processor sends control signals for controlling all home appliances corresponding to the identification information of the home appliance included in the user command to the home appliances. The communication interface can be controlled to transmit to.

In addition, when the identification information of the home appliance is not included in the user command, the processor transmits a control signal for controlling all home appliances belonging to the subspace to the home appliances based on the identification information of the subspace. The communication interface can be controlled to transmit.

On the other hand, in the control method of an electronic device according to an embodiment of the present disclosure, layering each of a plurality of sub-spaces included in a predetermined space into a plurality of layers, the household electrical appliance included in each sub-space Mapping to each layered sub-space and storing in a memory, and when a user command is input, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, the home appliance mapped to the sub-space And transmitting a control signal for controlling the device to the home appliance.

Here, the layering step may identify each of the plurality of sub-spaces as a first layer or a second layer based on the structure of the preset space, and the second layer may be a lower layer of the first layer. It can be hierarchical.

Further, in the storing in the memory, when a household appliance is mapped to a sub-space belonging to the lowest layer among the plurality of layers, identification information of each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance are mapped. A control target word may be generated, and the generated control target word may be mapped to the home appliance and stored in the memory.

In addition, in the step of transmitting the control signal to the household appliance, when a voice command including the control target word is input, a control signal for controlling at least one household appliance mapped to the control target word is sent to the household appliance. Can transmit.

In addition, in the step of transmitting the control signal to the household electrical appliance, when a voice command including the control target word is input, it belongs to different subspaces based on identification information on at least one layer included in the control target word. A control signal for simultaneously controlling a plurality of home appliances may be transmitted to the plurality of home appliances.

The control method may further include providing a UI for selecting at least one of the plurality of home appliances when a plurality of home appliances belonging to different sub-spaces are identified based on the control target word.

In addition, the control method may further include displaying a floor plan including sub-spaces belonging to the lowest layer among the plurality of layers and identification information of home appliances belonging to the preset space, and storing the memory in the memory. When a user command for mapping one of the displayed identification information of the household appliance to one of the sub-spaces is input, identification information for each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance are input. A control target word may be generated, and the generated control target word may be mapped to the home appliance and stored in the memory.

In addition, in the step of transmitting the control signal to the household appliance, if the identification information of the subspace is not included in the user command, all household appliances corresponding to the identification information of the household appliance included in the user command are controlled. The control signal for doing so may be transmitted to the home appliances.

On the other hand, in a non-transitory computer readable medium storing computer instructions for causing the electronic device to perform an operation when executed by a processor of the electronic device according to an embodiment of the present disclosure, the operation is included in a predetermined space Layering each of the plurality of sub-spaces into a plurality of layers, mapping household appliances included in each sub-space to each of the layered sub-spaces, and storing them in a memory; and when a user command is input, the user And transmitting a control signal for controlling the home appliance mapped to the subspace to the home appliance based on the identification information of the subspace included in the command and the home appliance identification information.

1 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

FIG. 2 is a block diagram illustrating a specific configuration of the electronic device of FIG. 1.

3 is a diagram for describing a layered subspace according to an embodiment.

4 is a diagram for explaining a process of generating a control target word in the embodiment of FIG. 3.

5 is a diagram for explaining a layered subspace according to another embodiment.

6 is a diagram for explaining a process of generating a control target word in the embodiment of FIG. 5.

7 is a view for explaining another process of generating a control target word in the embodiment of FIG. 5.

8 is a diagram for describing an operation of mapping a plurality of sub-spaces and a plurality of household appliances.

9 is a diagram for describing a control target word corresponding to a plurality of home appliances in the embodiment according to FIG. 8.

10 is a view for explaining an embodiment of controlling a home appliance corresponding to the lowest layer.

11 is a view for explaining an embodiment of controlling a home appliance corresponding to a layer other than the lowest layer.

12 is a view for explaining another embodiment of controlling a household appliance corresponding to a layer other than the lowest layer.

13 is a view for explaining a control operation for a control command that does not include a subspace.

14 is a view for explaining a control operation for a control command not including a sub-space and a home appliance.

15 is a view for explaining a basic plan view and a modified plan view.

16 is a view for explaining a UI showing a plan view and a home appliance.

17 is a view for explaining a UI for mapping a floor plan and a home appliance.

18 is a view for explaining a final UI to which a floor plan and a home appliance are mapped.

19 is a flowchart illustrating an operation of mapping a sub-space included in a control target space and a home appliance.

20 is a flowchart for analyzing a user's voice and explaining a control operation corresponding to the user's voice.

21 is a diagram for describing an electronic device according to an embodiment of the present disclosure.

Before describing the present disclosure in detail, the description method of the present specification and drawings will be described.

First, terms used in the specification and claims are selected by considering general functions in various embodiments of the present disclosure. However, these terms may vary depending on the intention of a person skilled in the art, legal or technical interpretation, and the appearance of new technologies. Also, some terms are arbitrarily selected by the applicant. These terms may be interpreted as meanings defined in the present specification, and may be interpreted based on the general contents of the present specification and common technical common knowledge in the art without specific term definitions.

In addition, the same reference numbers or reference numerals in each drawing attached to the present specification denote parts or components that perform substantially the same function. For convenience of explanation and understanding, different embodiments will be described using the same reference number or sign. That is, even if all the components having the same reference number are shown in the plurality of drawings, the plurality of drawings does not mean one embodiment.

In addition, in this specification and claims, terms including ordinal numbers, such as “first” and “second”, may be used to distinguish between components. This ordinal number is used to distinguish the same or similar components from each other, and the meaning of the term should not be interpreted due to the ordinal number. The terms are only used to distinguish one component from other components. For example, the components combined with the ordinal number should not be limited in the order of use or arrangement by the number. If necessary, each ordinal number may be used interchangeably.

In the present specification, a singular expression includes a plural expression unless the context clearly indicates otherwise. In this application, "includes." Or "composed." Terms such as intended to designate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, one or more other features or numbers, steps, operation, component, part, or It should be understood that the possibility of the presence or addition of these combinations is not excluded in advance.

Since the present embodiments can apply various conversions and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, it should be understood to include all conversions, equivalents, or substitutes included in the scope of the disclosed ideas and techniques. In the description of the embodiments, when it is determined that the detailed description of the related known technology may obscure the subject matter, the detailed description is omitted.

In an embodiment of the present disclosure, terms such as “module”, “unit”, and “part” are terms used to refer to a component that performs at least one function or operation, and the component is hardware or software. It can be implemented or can be implemented as a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc. are integrated with at least one module or chip, except that each needs to be implemented with individual specific hardware. Can be implemented as

In addition, in an embodiment of the present disclosure, when a part is connected to another part, this includes not only a direct connection, but also an indirect connection through another medium. In addition, the meaning that a part includes a certain component means that other components may be further included instead of excluding other components unless otherwise specified.

Referring to FIG. 1, the electronic device 100 may include a memory 110, a communication interface 120, and a processor 130.

The electronic device 100 may be a TV, desktop PC, laptop, smartphone, tablet PC, server, or the like. Meanwhile, the above-described example is only an example for describing the electronic device and is not necessarily limited to the above-described device.

The memory 110 may be implemented as an internal memory such as a ROM (eg, electrically erasable programmable read-only memory (EEPROM)), RAM included in the processor 130, or The processor 130 may be implemented as a separate memory.

The memory 110 may store control information, identification information of a plurality of sub-spaces included in the control target space, and identification information of the home appliance. In addition, mapping information that maps the identification information of the sub-space to the identification information of the home appliance may be stored. In addition, the mapping information may store a control target word for controlling the home appliance.

Here, the control target word may be a word stored in the memory 110 for a user to control a specific household appliance. For example, in order to control the A air conditioner in the living room, the user may set "living room air conditioner" as a control target word. In addition, when the voice recognition device recognizes that the user's voice includes "living room air conditioner", it may be determined to control the air conditioner A. The memory 110 may store a plurality of words to be controlled as described above.

The communication interface 120 is a component that performs communication with various types of external devices according to various types of communication methods.

The communication interface 120 may control the home appliance according to a user control command. The communication interface 120 may transmit a control signal to the home appliance included in the user command based on the identification information of the home appliance stored in the memory 110. Then, the communication interface 120 may remotely transmit a control signal to at least one home appliance.

In addition, the communication interface 120 may communicate with an external server to receive information on the control target space. The communication interface 120 may communicate with an external server to receive floor plan information corresponding to the control target space. As a method of communicating with an external server, both wireless or wired communication methods can be used.

The processor 130 may perform overall control operations of the electronic device. Specifically, the processor functions to control the overall operation of the electronic device.

The processor 130 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital image signals, but is not limited thereto, and the central processing unit (central processing unit (CPU)), microcontroller unit (MCU), micro processing unit (MPU), controller, application processor (AP), or communication processor (CP), ARM It may include one or more of the processors, or may be defined by the term.In addition, the processor may be implemented with a system on chip (SoC), a large scale integration (LSI) with an embedded processing algorithm, or a field programmable (FPGA). gate array).

The processor 130 may layer each of the plurality of sub-spaces included in the preset space into a plurality of layers, and map the home appliance included in each sub-space to each of the layered sub-spaces to memory 110 To be stored in, when a user command is input, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, to transmit a control signal for controlling the home appliance mapped to the sub-space to the home appliance It may include a processor 130 for controlling the communication interface 120.

Here, the processor 130 may identify each of the plurality of sub-spaces as a first layer or a second layer based on a structure of a predetermined space, and the second layer may be a lower layer of the first layer.

The preset space may be a control target space, and the processor 130 may receive a user input including information about the preset space through the communication interface 120. The structure of the preset space may be determined according to a pre-stored hierarchical structure, or may be determined according to a user input. The sub-space is independent of the hierarchy, and may mean each of all spaces. In addition, each subspace may be connected to an upper layer and a lower layer according to a hierarchical structure. The detailed layering operation and the hierarchical structure will be described later in FIGS. 3 and 5. 3 and 5, the first layer corresponds to the top layer, the second layer corresponds to the lower layer of the first layer, and the third layer is the lower layer of the second layer and may be the lowest layer.

In addition, when the household electrical appliance is mapped to a sub-space belonging to the lowest layer among the plurality of layers, the processor 130 may control a control target word including identification information for each of the lower layer and the upper layer of the lowest layer and identification information of the household appliance. The generated control target word may be mapped to the home appliance and stored in the memory 110.

Here, the identification information for each of the lower layer and the upper layer of the lowest layer may include identification information of a subspace corresponding to each layer. In addition, the processor 130 may receive an input for mapping at least one sub-space corresponding to the lowest layer from the user and at least one home appliance through the communication interface 120. Then, the processor 130 may acquire the mapping information by analyzing the received user input. Further, the mapping information may be a mapping layer, identification information of a subspace corresponding to the mapping layer, identification information of the mapped household appliance, and a control target word of the mapped household appliance. The mapping layer may be to analyze the hierarchical structure of the subspace selected by the user. Here, the hierarchical structure that the electronic device 100 identifies (or analyzes) may be a sub-space layer and a sub-space upper layer.

Detailed operations for generating the control target word will be described later in FIGS. 4 and 6.

Here, when a voice command including a control target word is input, the processor 130 controls the communication interface 120 to transmit a control signal for controlling at least one home appliance mapped to the control target word to the home appliance. Can.

When the processor 130 receives the user voice through the microphone 170, the processor 130 may perform a voice recognition operation on the received user voice. Then, the processor 130 may obtain text information as a result of the speech recognition operation. Then, the processor 130 may determine a control target word corresponding to the acquired text information. The processor 130 may compare the control target word stored in the memory 110 and text information corresponding to the user's voice. When the processor 130 determines that the user's voice has a specific control target word, the processor 130 may determine the home appliance corresponding to the specific control target word as the control device.

The processor 130 may analyze the user voice to identify the control device, and transmit a control signal including a user control command to the identified control device.

In addition, when a voice command including a control target word is input, the processor 130 is configured to simultaneously control a plurality of home appliances belonging to different subspaces based on identification information of at least one layer included in the control target word. The communication interface 120 may be controlled to transmit a control signal to a plurality of home appliances.

The identification information for the layer may include layer information and identification information of a subspace corresponding to the layer. For example, each layer may be connected to an upper and lower layer, and each layer may include at least one subspace.

The processor 130 may control a plurality of home appliances based on one user voice. A plurality of different household appliances may be mapped to one sub-space. A plurality of home appliances may be mapped to one sub-space, and a plurality of home appliances may be mapped to different sub-spaces, respectively. For example, the first device and the second device may be mapped to the first sub-space, and according to another embodiment, the third device is mapped to the second sub-space and the fourth device is mapped to the third sub-space. Can.

The operation of identifying one control device in response to the user voice will be described later in FIG. 10. And, the operation of identifying two or more control devices in response to the user's voice will be described later in FIGS. 11 to 14.

Also, the electronic device 100 may further include a display 160, and the processor 130 may identify at least one of the plurality of home appliances if a plurality of home appliances belonging to different sub-spaces are identified based on the control target word. The display 160 may be controlled to provide a UI for selecting.

The above-described UI may include an image in which a sub-space corresponding to a hierarchical structure and a layer is displayed, and an image corresponding to a plurality of household appliances. The processor 130 may receive identification information of the home appliance selected by the user through the communication interface 120.

When the processor 130 analyzes a user's voice and identifies a plurality of home appliances as a control device, the processor 130 may display a UI that induces the user to select a specific control device. Through the above-described UI, the processor 130 may determine whether the user's intention is to control a plurality of home appliances or whether there is a mistake in a user's voice command. Here, when the processor 130 receives an input that the user does not select a specific control device, the processor 130 may determine that all of the plurality of home appliances identified as the control device are controlled, and the plurality of home appliances may be Control signals can be transmitted.

In addition, a floor plan including sub-spaces belonging to the lowest layer among a plurality of layers and identification information of household appliances belonging to a preset space may be displayed, and one of the identification information of the displayed household appliances is mapped to one of the sub-spaces When a user command to be input is input, a control target word including identification information for each of the lowest layer and the upper layer of the lowest layer and identification information of the home appliance can be generated, and the generated control target word is mapped to the home appliance to memory Can be stored in (110).

The floor plan may refer to a drawing including information on a specific space. For example, the floor plan may include the arrangement structure of the space and the name of the space. The electronic device 100 may store identification information of a sub-space corresponding to the floor plan information in the memory 110.

Further, the floor plan may include at least one of a floor plan generated by an external device, a floor plan created by a user, a floor plan generated through a preset application, or a floor plan received by an external server.

The floor plan may be stored in the memory 110, and the processor 130 may identify whether the floor plan corresponding to the space input by the user as the control target space is stored in the memory 110. Then, when the processor 130 identifies that there is no floor plan corresponding to the control target space in the memory 110, the floor plan may be received through an external server. When the processor 130 cannot identify the floor plan corresponding to the control target space in the memory 110 and the external server, the floor plan may be directly received from the user. For example, the processor 130 may receive the floor plan information drawn by the user and may receive the floor plan generated from the external device.

Details of the plan view will be described later with reference to FIGS. 15 to 18.

In addition, when the user command does not include the identification information of the sub-space, the processor 130 transmits a control signal for controlling all the home appliances corresponding to the identification information of the home appliance included in the user command to the home appliances. So that the communication interface 120 can be controlled.

When the processor 130 determines that the user voice does not include any sub-space identification information, the processor 130 may analyze the identification information of the home appliance included in the user voice. In addition, the processor 130 may control the identified home appliance. Here, when the processor 130 recognizes a plurality of identified home appliances, the processor 130 may control all of the plurality of home appliances. Here, when the processor 130 identifies that the user voice does not include both the identification information of the subspace and the identification information of the household appliance, the processor 130 may control all household appliances.

In addition, when the user command does not include identification information of the home appliance, the processor 130 transmits a control signal for controlling all home appliances belonging to the subspace to the home appliances based on the identification information of the subspace. The communication interface 120 can be controlled.

When the processor 130 identifies that the user's voice contains only the identification information of the sub-space, and there is no identification information of the household appliance to identify the household appliance, the processor 130 controls the household appliance corresponding to the sub-space. Can. Here, there may be one household appliance corresponding to the sub-space, or a plurality of household appliances.

Meanwhile, it has been described that a user input method according to an embodiment of the present disclosure is a method through voice. However, according to another embodiment, the user input may be received by a user method through a user interface (eg, a button, a touch screen). The electronic device 100 may receive an input for controlling a specific control device from the user through the user interface 140.

Meanwhile, the electronic device 100 according to an embodiment of the present disclosure may be divided into a mapping operation and a control operation. The electronic device 100 may generate a plurality of control target words through a mapping operation and store them in the memory 110 and control a specific home appliance using the control target words stored in the memory 110. have. In particular, the electronic device 100 may generate one or more control target words in one household appliance using the layered subspaces. When a plurality of control target words are generated, a specific home appliance can be controlled by various control commands of the user. If there is only one control target word referring to a specific home appliance, the user may confuse the control target word over time. However, since a plurality of words to be controlled are stored in the memory 110 based on the layered subspace, the electronic device 100 may have a high probability of identifying a specific home appliance from the user's voice.

In addition, since the electronic device 100 stores a plurality of words to be controlled in the memory 110 by reflecting the layered subspace, the electronic device 100 uses the layered subspace information to store not only a specific household appliance but also a plurality of words. It can control the home appliances at the same time. The electronic device 100 may provide convenience to a user in controlling a plurality of household appliances at the same time.

Meanwhile, in this specification, it has been described that a plurality of words to be controlled corresponding to one household appliance are generated. However, it may be implemented in a form in which only one control target word is generated in one household appliance. Here, the word to be controlled may include information corresponding to all layers. For example, in the embodiment of FIG. 6, the word to be controlled may be "home-living-sofa-device". Here, if the electronic device 100 identifies that the user's voice includes some of the words to be controlled, the electronic device 100 may control the corresponding control device. When the electronic device 100 identifies at least one of a house, a living room, a sofa, or a device in the user's voice, it may be determined that the user has uttered a command for controlling the corresponding control device. In the above-described manner, the electronic device 100 may control a plurality of household appliances. In the above-described embodiment, the electronic device 100 may control a specific home appliance when a user voice including the lowest layer and home appliance identification information is received. Specifically, when the electronic device 100 recognizes the "sofa-device", the electronic device 100 may control a specific home appliance. Then, when the electronic device 100 recognizes the “living room”, all control target words including the living room may be identified, and all of a plurality of household appliances corresponding to the identified control target word may be controlled. The electronic device 100 simultaneously stores hierarchical information corresponding to each sub-space, and thus can easily control a plurality of household appliances.

Referring to FIG. 2, an electronic device 100 according to an embodiment of the present disclosure includes a memory 110, a communication interface 120, a processor 130, a user interface 140, an input/output interface 150, and a display 160 ) And the microphone 170.

Among the operations of the memory 110, the communication interface 120, and the processor 130, duplicate descriptions of the same operations as described above will be omitted.

The memory 110 may refer to a storage device implemented in various types, such as random access memory (RAM) 111, read-only memory (ROM) 112, FLASH MEMORY 113, and DISK 114. The memory 110 may mean a storage device or a storage device that temporarily or permanently preserves data. Further, the memory 110 may store various software such as an operating system (O/S) or an application of the electronic device 100.

The RAM 111 may refer to a device capable of reading and writing by accessing an arbitrary area. The RAM 111 may be implemented as any one of DRAM (Dynamic RAM), SRAM (Static RAM), SDRAM (Synchronous Dynamic RAM), and FeRAM (Ferroelectric Random Access Memory).

The ROM 112 may be a nonvolatile memory device in which data is not lost even when the power is turned off. ROM 112 may be implemented as One Time Programmable ROM (OTPROM), Programmable ROM (PROM), Erasable and Programmable ROM (EPROM), Electrically Erasable and Programmable ROM (EPMROM), mask ROM, flash ROM, and FLASH MEMORY 113 Can.

The FLASH MEMORY 113 may be a non-volatile memory device capable of electrically erasing and rewriting data. FLASH MEMORY 113 may be implemented as NAND flash or NOR flash according to an internal method.

The DISK 114 may be implemented as a magnetic disk or an optical disc. The magnetic disk may be a storage device using a magnetic field, and may be implemented as a floppy disk or hard disk drive (HDD). Further, the optical disk may be a storage device using light reflection, and may be implemented in the form of an optical disk drive.

Meanwhile, the memory 110 may be implemented in various ways not shown. For example, the memory 110 may be implemented in the form of a solid-state drive (SDD) or a solid state disk (SDD).

On the other hand, in the case of a memory embedded in the electronic device 100, volatile memory (eg, RAM 111), non-volatile memory (eg, ROM 112, FLASH MEMORY 113), hard disk It may be implemented as at least one of a drive (HDD) or a solid state drive (SSD). In the case of a memory that can be detached from the electronic device 100, a memory card (eg, compact flash (CF), secure digital (SD), micro secure digital (micro-SD), mini secure digital (mini-SD)) , xD (extreme digital), MMC (multi-media card, etc.), may be implemented in the form of an external memory (eg, USB memory) connectable to a USB port.

In the above description, an example of the implementation of the memory 110 is disclosed, but is not limited thereto.

The communication interface 120 is a component that performs communication with various types of external devices according to various types of communication methods. The communication interface 120 includes a Wi-Fi module 121, a Bluetooth module 122, an infrared communication module 123, and a wireless communication module 124. The processor 130 may communicate with various external devices using the communication interface 120. Here, the external device is an electronic device such as a TV, an image processing device such as a set-top box, an external server, a control device such as a remote control, a sound output device such as a Bluetooth speaker, a lighting device, a smart cleaner, a household appliance such as a smart refrigerator , IOT home manager and the like server. Then, the communication interface 120 may include circuitry for performing the above-described operation.

The Wi-Fi module 121 and the Bluetooth module 122 perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi module 121 or the Bluetooth module 122, various connection information such as an SSID and a session key may be first transmitted and received, and communication information may be used to transmit and receive various information.

The infrared communication module 123 performs communication according to an infrared data association (IrDA) technology that wirelessly transmits data in a short distance using infrared rays between the city light beam and the millimeter wave.

The wireless communication module 124 includes Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A, in addition to the Wi-Fi module 121 and the Bluetooth module 122 described above. It means a module that performs communication according to various communication standards such as (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

In addition, the communication interface 120 may include at least one of a local area network (LAN) module, an Ethernet module, or a wired communication module performing communication using a pair cable, a coaxial cable, or an optical fiber cable.

According to an example, the communication interface 120 may use the same communication module (eg, Wi-Fi module) to communicate with an external server and an external server, such as a remote control.

According to another example, the communication interface 120 may use different communication modules (eg, Wi-Fi modules) to communicate with external devices and external servers, such as a remote control. For example, the communication interface 120 may use at least one of an Ethernet module or a WiFi module to communicate with an external server, or a BT module to communicate with an external device such as a remote control. However, this is only an example, and the communication interface 120 may use at least one communication module among various communication modules when communicating with a plurality of external devices or external servers.

Meanwhile, the communication interface 120 may additionally include a tuner and a demodulator according to an implementation example.

A tuner (not shown) may receive a radio frequency (RF) broadcast signal by tuning a channel selected by a user or all pre-stored channels among radio frequency (RF) broadcast signals received through an antenna.

The demodulator (not shown) may receive and demodulate the digital IF signal (DIF) converted by the tuner to perform channel decoding and the like.

The processor 130 controls overall operations of the electronic device 100 using various programs stored in the memory 110. Meanwhile, the processor 120 according to an embodiment of the present disclosure may be implemented as at least one of the main CPU 131, a graphics processing unit (GPU) 132, or a neural processing unit (NPU) 133. In addition, at least one of the main CPU 131, a graphics processing unit (GPU) 132, or a neural processing unit (NPU) 133 may communicate with each other through a bus such as a RAM 111 or a ROM 112 corresponding to the memory 110. Can be connected.

The main CPU 131 may control an operating system (O/S) of the electronic device 100 using a command set for booting the system stored in the ROM 112. Specifically, when a turn-on command is input and power is supplied, the main CPU 131 copies the O/S stored in the memory 110 to the RAM 111 according to the command stored in the ROM 112, and copies the O/S. Run it to boot the system. When booting is completed, the main CPU 131 may perform various operations by copying various application programs stored in the memory 110 to the RAM 111 and executing the application programs copied to the RAM 111.

The main CPU 131 accesses the memory 110 to boot using O/S stored in the memory 110. In addition, the main CPU 131 may perform various operations using various programs and content data stored in the memory 110.

The GPU 132 may correspond to a high-performance processing device for graphic processing, and may be a specialized electronic circuit designed to accelerate the generation of an image in a frame buffer to process and change memory quickly and output it to a screen. Further, the GPU 132 may mean a Visual Processing Unit (VPU).

The NPU 133 may correspond to an AI chipset (or AI processor) and may be an AI accelerator. The NPU 133 may correspond to a processor chip optimized for performing deep neural networks. Meanwhile, the NPU 133 may correspond to a processing device that executes a deep learning model on behalf of the GPU 132, and the NPU 133 may correspond to a processing device that executes a deep learning model together with the GPU 132. It might be.

Meanwhile, in FIG. 2, the main CPU 131, the GPU 132, and the NPU 133 are all displayed, but in actual implementation, the processor 130 is at least one of the main CPU 131, the GPU 132, or the NPU 133. It can be implemented and operated as one.

Meanwhile, the processor 130 may perform a graphic processing function (video processing function). For example, the processor 130 may generate a screen including various objects, such as icons, images, and text, using an operation unit (not shown) and a rendering unit (not shown). Here, the calculation unit (not shown) may calculate attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen based on the received control command. Also, the rendering unit (not shown) may generate screens of various layouts including objects based on attribute values calculated by the calculation unit (not shown). In addition, the processor 130 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion for video data.

Meanwhile, the processor 130 may process audio data. Specifically, the processor 130 may perform various processes such as decoding or amplifying audio data, noise filtering, and the like.

The user interface 140 may be implemented as a device such as a button, a touch pad, a mouse and a keyboard, or may be implemented as a touch screen capable of performing the above-described display function and manipulation input function. Here, the button may be various types of buttons, such as a mechanical button, a touch pad, a wheel, etc., formed in an arbitrary region such as a front portion, a side portion, or a rear portion of the main body of the electronic device 100.

The input/output interface 150 includes HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, and VGA (Video Graphics Array) ports. It may be any one of an RGB port, D-subminiature (D-SUB), and digital visual interface (DVI).

HDMI is an interface capable of transmitting high-performance data for AV devices that input and output audio and video signals. DP is a full HD class of 1920x1080, ultra-high resolution screen such as 2560x1600 or 3840x2160, and 3D stereoscopic image, and digital voice can also be delivered. Thunderbolt is an input/output interface for high-speed data transmission and connection, and PCs, displays, and storage devices can all be connected in parallel through a single port.

The input/output interface 150 may input/output at least one of audio and video signals.

According to an implementation example, the input/output interface 150 may include a port for inputting and outputting only an audio signal and a port for inputting and outputting only a video signal as separate ports, or a port for inputting and outputting both audio and video signals.

The electronic device 100 is implemented as a device that does not include a display, and can transmit a video signal to a separate display device.

The electronic device 100 may transmit a corresponding voice signal to an external server for voice recognition of the voice signal received from the external device.

In this case, the communication module for communication with the external device and the external server may be implemented as one. For example, a communication module for communication with an external device and an external server may be the same as a Wi-Fi module.

The communication module for communication with the external device and the external server may be implemented separately. For example, an external device may communicate using a Bluetooth module, and an external server may communicate using an Ethernet modem or Wi-Fi module.

The microphone 170 may receive a user's voice in an activated state. For example, the microphone 170 may be formed as an integrated body integrated with the upper side, the front side, and the side of the electronic device 100. The microphone 170 is a microphone that collects user voice in analog form, an amplifier circuit that amplifies the collected user voice, an A/D conversion circuit that samples the amplified user voice and converts it into a digital signal, and noise components from the converted digital signal It may include a variety of configurations, such as filter circuit to remove the.

Meanwhile, the electronic device 100 may additionally include a microphone 170. The microphone 170 is configured to receive a user voice or other sound and convert it into audio data. In this case, the microphone 170 may convert the received analog user voice signal into a digital voice signal and transmit it to the electronic device 100.

The electronic device 100 according to an embodiment of the present disclosure may transmit the digital voice signal received by the voice recognition server. In this case, the voice recognition server may convert a digital voice signal into text information using STT (Speech To Text). In this case, the voice recognition server may transmit text information to another server or electronic device in order to perform a search corresponding to the text information, and in some cases, it may also perform a direct search.

Meanwhile, the electronic device 100 according to another embodiment of the present disclosure may directly convert a digital voice signal to text information by applying a STT (Speech To Text) function, and transmit the converted text information to an external server.

The speaker (not shown) may be a component that outputs not only various audio data processed by the input/output interface 150 but also various notification sounds or voice messages.

Meanwhile, the electronic device 100 does not necessarily include all of the components disclosed in FIG. 2, and may be formed of only some components according to an implementation example.

3 is a diagram for describing a layered subspace according to an embodiment.

The electronic device 100 may include information on a control target space and a subspace. The space to be controlled may mean a space corresponding to the largest category among spaces that a user wants to control. For example, if a user wants to control all devices in a house (or building), the space to be controlled may be a house (or building). And, if the user wants to control all the devices on the first floor in the building, the space to be controlled can be the first floor in the building.

According to FIG. 3, it can be explained that a control target space is a building, and a plurality of sub-spaces are divided into three layers. The embodiment according to FIG. 3 describes that it is layered into three layers. The first layer, which is the uppermost layer, may be an ABC building. In addition, the second layer, which is a lower layer of the first layer, may be one to five layers. The upper layer, the first layer, may be connected (or included) with a plurality of sub-spaces (1st to 5th floors). In addition, the third layer, which is a lower layer of the second layer, may be each room number. For example, the third layer corresponding to the second layer (the first floor) may include room 101 and room 102.

The sub-space may be ABC building, 1st to 5th floor, each room number. Also, the electronic device 100 may layer a plurality of sub-spaces and connect them to upper and lower layers. Also, the electronic device 100 may store a relationship of a plurality of sub-spaces connected to an upper layer and a lower layer in the memory 110.

Referring to FIG. 4, the electronic device 100 may generate a control target word according to a user input. It is assumed that the electronic device 100 has received an input that the control target space is the ABC building, and an input for mapping the room 101 and the device on the first floor. When the electronic device 100 receives a user input for mapping (connecting) a specific sub-space (room 101) to a device, the electronic device 100 may identify mapping information. The mapping information may be a mapping layer, identification information of a sub-space corresponding to the mapping layer, identification information of the mapped household appliance, and a control target word of the mapped household appliance. The mapping layer may be to analyze the hierarchical structure of the subspace selected by the user. Here, the hierarchical structure that the electronic device 100 identifies (or analyzes) may be a sub-space layer and a sub-space upper layer.

For example, when the user maps the room 101 and the device, the electronic device 100 identifies the sub-space (room 101) selected by the user, and the hierarchy of the sub-space (room 101) selected by the user is removed. It can be identified that it is a third layer. Then, the electronic device 100 may identify the upper layer (second layer) of the sub-space (room 101) selected by the user, thereby identifying the sub-space (first layer) corresponding to the upper layer. Then, the electronic device 100 may identify whether the upper layer (second layer) of the subspace (room 101) selected by the user includes the upper layer. The electronic device 100 may identify the top layer (first layer) of the sub-space (room 101) selected by the user. Also, the electronic device 100 may identify a sub-space (ABC building) corresponding to the top layer (first layer). The electronic device 100 may identify all upper layers (second layer, first layer) of the sub space (room 101) selected by the user, and sub spaces (first floor, ABC building) corresponding to each upper layer. ).

Also, the electronic device 100 may generate a control target word by using the obtained information of a plurality of subspaces. Here, the electronic device 100 may generate a plurality of control target words corresponding to one device. The electronic device 100 may generate a plurality of control target words by combining identification information of the acquired subspace. The combination method combines each subspace with device identification information (type, name, identification number, user-defined name), combines two of each subspace with device identification information, and three of each subspace with It may be a method of combining device identification information. Here, if the plurality of identified sub-spaces is N, starting from the method of combining the device identification information with one of the sub-spaces, the N-combination scheme is ranging from the method of combining the N and device identification information of each sub-space. All can be used. In addition, the electronic device 100 may generate a control target word only with the identification information of the household electrical appliance without including the identification information of the subspace.

For example, it is assumed that the electronic device 100 has identified ABC building, 1st floor, and Room 101 as sub-spaces. The electronic device 100 may generate a control target word by combining ABC building, 1st floor, and Room 101, respectively. The electronic device 100 may generate control target words such as “Room 101-device”, “1st floor-device”, and “ABC building-device” by combining each subspace and device identification information. Then, the electronic device 100 uses a method of combining two of each sub-space and device identification information, such as "1st floor-Room 101-device", "ABC building-Room 101-device", "ABC building -1st floor-device". Then, the electronic device 100 may generate a control target word such as “ABC building-1st floor-Room 101-device” by using a method of combining device identification information with three of each subspace. In addition, the electronic device 100 may generate a control target word such as “device” using only the identification information of the household electrical appliance without including the identification information of the subspace.

Also, the electronic device 100 may store all the generated control target words in the memory 110.

Referring to FIG. 5, a space to be controlled is a house, and various sub-spaces included in the house can be described. Also, the electronic device 100 may layer a plurality of sub-spaces. The house may be a sub-space of the uppermost layer, and the sub-space corresponding to the lower layer of the house may be a living room, a kitchen, a large room, a small room, or a study room. Further, the sub-space corresponding to the lower layer of the living room may be a sofa and a TV, and the sub-space corresponding to the lower layer of the kitchen may be a sink and a dining table. In addition, the sub-spaces corresponding to the lower layers of the large room, the small room, and the study room may be window and door sides, respectively.

Referring to FIG. 5, the sub-space corresponding to the first layer is a house, and the sub-space corresponding to the second layer may be a living room, a kitchen, a large room, a small room, or a study, and the sub-space corresponding to the third layer is a sofa. , TV, sink, dining table, window side (actually three sub-spaces corresponding to the window side), door side (actually three sub-spaces corresponding to the door side).

Referring to FIG. 6, it is assumed that the electronic device 100 has received a user input mapping a device and a subspace (sofa) corresponding to the third layer. The electronic device 100 may acquire mapping information in the manner described in FIG. 4. The electronic device 100 may identify the mapping layer as a third layer, a second layer, or a first layer. Also, the electronic device 100 may identify the subspace corresponding to the mapping layer as a sofa (third layer), a living room (second layer), and a house (first layer).

Then, the electronic device 100 may acquire a plurality of words to be controlled. For example, it is assumed that the electronic device 100 identifies a house, a living room, and a sofa as a sub-space. The electronic device 100 may generate a control target word by combining a house, a living room, and a sofa, respectively. The electronic device 100 may generate control target words such as “sofa-device”, “living-device”, and “home-device” by combining each subspace and device identification information. In addition, the electronic device 100 uses a method of combining two of each sub-space with device identification information, such as "living room-sofa-device", "home-sofing-device", "home-living-device" A word to be controlled can be generated. In addition, the electronic device 100 may generate a control target word such as “home-living room-sofa-device” using a method of combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “device” using only the identification information of the household electrical appliance without including the identification information of the subspace.

Referring to FIG. 7, it is assumed that the electronic device 100 has received a user input mapping a device and a subspace (window side) corresponding to the third layer. The electronic device 100 may acquire mapping information in the manner described in FIG. 4. The electronic device 100 may identify the mapping layer as a third layer, a second layer, or a first layer. Also, the electronic device 100 may identify the subspace corresponding to the mapping layer as a window side (third layer), a small room (second layer), and a house (first layer).

Then, the electronic device 100 may acquire a plurality of words to be controlled. For example, it is assumed that the electronic device 100 identifies a house, a small room, and a window side as a sub-space. The electronic device 100 may generate a control target word by combining a house, a small room, and a window side. The electronic device 100 may generate control target words such as “window-device”, “small room-device”, and “home-device” by combining each subspace and device identification information. In addition, the electronic device 100 uses two methods of combining each of the sub-spaces and device identification information, such as "small room-window-device", "home-window-device", "home-small room-device" It is possible to generate a control target word such as. Then, the electronic device 100 may generate a control target word such as "home-small room-window-device" using a method of combining three of each subspace with device identification information. In addition, the electronic device 100 may generate a control target word such as “device” using only the identification information of the household electrical appliance without including the identification information of the subspace.

Referring to FIG. 8, the electronic device 100 may identify a plurality of household appliances that are mapped to a plurality of sub-spaces. Specifically, the electronic device 100 may map at least one household appliance to one subspace. The electronic device 100 may map a plurality of household appliances in one sub-space.

Assume an embodiment in which a plurality of

household appliances

201, 202, 203, 204, and 205 are mapped. Among the sub-spaces, the home appliance corresponding to the sofa may be a first device (air conditioner 201) and a second device (light fixture 202). In addition, the home appliance corresponding to the TV in the sub-space may be a third device (light fixture 203). In addition, the home appliance corresponding to the dining table among the sub-spaces may be a fourth appliance (light fixture 204). Further, the home appliance corresponding to the window side (the window side of the small room) among the sub-spaces may be the fifth device (air conditioner 205). Each sub-space may be mapped to a plurality of household appliances 201,202,203,204,205.

Referring to FIG. 9, the electronic device 100 may generate a control target word according to the mapping relationship disclosed in FIG. 8.

The "device" disclosed in FIGS. 4 and 6 may include identification information of a home appliance. The identification information of the home appliance may be any one of the type, name, identification number, and user-defined name of the home appliance. For example, it is assumed that the identification information is set to the type of home appliance. Here, identification information corresponding to the first device 201 and the fifth device 205 is an air conditioner, and identification information corresponding to the second device 202, the third device 203, and the fourth device 204 is It can be a light fixture.

The electronic device 100 may generate control target words 901 corresponding to the first device 201. The electronic device 100 may generate control target words such as “sofa-air conditioner”, “living room air conditioner”, and “home-air conditioner” by combining each subspace and device identification information. In addition, the electronic device 100 uses a method of combining two of each sub-space with device identification information, such as "living room-sofa-air conditioning", "home-sofing-air conditioning", "house-living room-air conditioning" A word to be controlled can be generated. Then, the electronic device 100 may generate a control target word such as "home-living room-sofa-air conditioner" using a method of combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “air conditioner” using only the identification information of the household electrical appliance without including the identification information of the subspace.

The electronic device 100 may generate control target words 902 corresponding to the second device 202. The electronic device 100 may generate control target words such as “sofa-light”, “living-light”, and “house-light” by combining each sub-space and device identification information. Then, the electronic device 100 uses a method of combining device identification information with two of each sub-space, such as "living-sofa-light", "house-sofing-light", "house-living-light" A word to be controlled can be generated. In addition, the electronic device 100 may generate a control target word, such as "home-living room-sofa-light", by combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “light” using only the identification information of the household appliance without including the identification information of the subspace.

The electronic device 100 may generate control target words 903 corresponding to the third device 203. The electronic device 100 may generate control target words such as “TV-light”, “living-light”, and “house-light” by combining each sub-space and device identification information. In addition, the electronic device 100 uses a method of combining two of each sub-space with device identification information, such as "living room-TV-light", "home-TV-light", "home-living-light" A word to be controlled can be generated. Then, the electronic device 100 may generate a control target word such as "home-living room-TV-light fixture" using a method of combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “light” using only the identification information of the household appliance without including the identification information of the subspace.

The electronic device 100 may generate control target words 904 corresponding to the fourth device 204. The electronic device 100 may generate control target words such as “dining table-light”, “kitchen-light”, and “house-light” by combining each sub-space and device identification information. Then, the electronic device 100 uses a method of combining two of each sub-space with device identification information, such as "kitchen-dining table-light", "house-dining-light", "house-kitchen-light" A word to be controlled can be generated. Then, the electronic device 100 may generate a control target word such as "home-kitchen-dining-light" using a method of combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “light” using only the identification information of the household appliance without including the identification information of the subspace.

The electronic device 100 may generate control target words 905 corresponding to the fifth device 205. The electronic device 100 may generate control target words such as “window-light”, “small room-light”, and “house-light” by combining each sub-space and device identification information. In addition, the electronic device 100 uses two methods of each sub-space and device identification information to combine "small room-window-light", "house-window-light", "home-small room-light" It is possible to generate a control target word such as. Then, the electronic device 100 may generate a control target word such as "home-small room-window-light" using a method of combining three of each sub-space with device identification information. In addition, the electronic device 100 may generate a control target word such as “light” using only the identification information of the household appliance without including the identification information of the subspace.

In the embodiment according to FIG. 10, when the electronic device 100 recognizes a sub-space corresponding to the lowest layer by user input, the electronic device 100 may be identified as controlling only one control device. Also, the electronic device 100 may identify a specific device among a plurality of electronic devices according to a relationship according to a hierarchical structure.

Referring to FIG. 10, it is assumed that the electronic device 100 has received a user voice through the microphone 170. The electronic device 100 may analyze the user's voice to obtain text information corresponding to the user's voice. Also, the electronic device 100 may compare the control target word in which some of the acquired text information is stored in the memory 110. In addition, when some of the acquired text information matches the control target word stored in the memory 110, the electronic device 100 may identify the home appliance corresponding to the control target word.

The electronic device 100 assumes that the user has received a voice “Turn on the sofa air conditioner” through the microphone 170. The memory 110 stores a control target word “sofa-air conditioner”, and the electronic device 100 may determine that the user's voice matches the control target word of the first device 201. The electronic device 100 may determine that the user's voice controls the first device 201, and may perform an operation of turning on the power of the first device 201.

In the embodiment according to FIG. 11, when the electronic device 100 recognizes a sub-space corresponding to a layer other than the lowest layer by user input, the electronic device 100 may identify that it controls a plurality of control devices. .

The electronic device 100 assumes that the user has received a voice saying "Turn on the living room light" through the microphone 170. The memory 110 stores a word to be controlled called “living room-light”, and the electronic device 100 has a user's voice as a word to be controlled by the second device 202 and a word to be controlled at the third device 203. It can be judged to match. The electronic device 100 may determine that the user's voice controls both the second device 202 and the third device 203, and turns on the power of the second device 202 and the third device 203. You can perform the operation.

In the embodiment according to FIG. 12, when the electronic device 100 recognizes a sub-space corresponding to the uppermost layer by user input, the electronic device 100 may be identified as controlling a plurality of control devices.

The electronic device 100 assumes that the user has received a voice "Turn on the house air conditioner" through the microphone 170. The memory 110 stores a control target word “home-air conditioner”, and the electronic device 100 has a user's voice as a control target word of the first device 201 and a control target word of the fifth device 205. It can be judged to match. The electronic device 100 may determine that the user's voice controls both the first device 201 and the fifth device 205, and turns on the power of the first device 201 and the fifth device 205. You can perform the operation.

In the embodiment according to FIG. 13, when the electronic device 100 recognizes a user input that does not include information on a subspace, the electronic device 100 may identify that it controls a plurality of control devices.

The electronic device 100 assumes that the user has received a voice "Turn on air conditioning" through the microphone 170. The memory 110 stores a control word called “air conditioner”, and the electronic device 100 has a user's voice matching the control word of the first device 201 and the control word of the fifth device 205. You can judge that. The electronic device 100 may determine that the user's voice controls both the first device 201 and the fifth device 205, and turns on the power of the first device 201 and the fifth device 205. You can perform the operation.

In the embodiment according to FIG. 14, when the electronic device 100 recognizes a user input that does not include identification information of a subspace and identification information of a home appliance, the electronic device 100 is identified as controlling a plurality of control devices can do.

The electronic device 100 assumes that the user has received a voice “turn on” through the microphone 170. Here, the electronic device 100 may determine that the user's voice is intended to control all the

home appliances

201, 202, 203, 204, and 205. Then, the electronic device 100 may perform an operation of turning on the power of all the

home appliances

201, 202, 203, 204, and 205.

15 is a view for explaining a basic plan view and a modified plan view.

Referring to FIG. 15, the electronic device 100 may store information on the basic plan view in the memory 110. Alternatively, the electronic device 100 may receive information about the basic floor plan from the external server. The electronic device 100 may generate a hierarchical structure of each subspace using information on the basic floor plan.

Also, the electronic device 100 may reflect the additional input of the user based on the basic plan view. For example, when the user wants to further subdivide the space based on the structure corresponding to the basic floor plan, the electronic device 100 may generate a modified floor plan by reflecting the user's input. Also, the electronic device 100 may generate a hierarchical structure corresponding to FIG. 5 using information corresponding to the modified plan view disclosed in FIG. 15.

16 is a view for explaining a UI showing a plan view and a home appliance.

Referring to FIG. 16, the electronic device 100 may provide a modified plan view disclosed in FIG. 15 and a UI that simultaneously displays a plurality of home appliances. The UI may display an icon indicating a plurality of household appliances, and the icon may be different for each type of device. The device identification number may be displayed on the icon.

17 is a view for explaining a UI for mapping a floor plan and a home appliance.

Referring to FIG. 17, the electronic device 100 may receive a user's mapping input based on a plan view and a UI in which a plurality of home appliances are displayed. The user may map a plurality of home appliances and a specific sub-space, and the electronic device 100 may provide a UI that induces mapping of the sub-space corresponding to the lowest layer. In addition, the electronic device 100 may receive a user input for mapping an icon corresponding to the home appliance to a specific sub-space.

Referring to FIG. 18, the electronic device 100 may provide a final UI reflecting a user's mapping input. The final UI may display through the icon item that a user input that maps identification information of a specific sub-space and a home appliance is reflected. That is, an icon including an identification number of the home appliance and an image corresponding to the type of home appliance may be included in the final UI.

Referring to FIG. 19, the electronic device 100 may receive a user input for starting an application (S1905). Then, the electronic device 100 may receive a user input for setting a control target space (S1910). Then, the electronic device 100 may determine whether the floor plan corresponding to the control target space is stored in the memory 110 (S1915). Here, when the electronic device 100 identifies that the floor plan corresponding to the control target space is stored in the memory 110, the electronic device 100 may provide the floor plan (S1935 ).

When the electronic device 100 identifies that the floor plan corresponding to the control target space is not stored in the memory 110, the electronic device 100 determines whether the floor plan corresponding to the control target space is stored in the external server. It can be judged (S1920). Here, if the electronic device 100 identifies that the floor plan corresponding to the control target space is not stored in the external server, the electronic device 100 may directly receive information about the floor plan from the user (S1925). The user may directly draw a floor plan or provide separate floor plan information to the electronic device 100. Meanwhile, if the electronic device 100 identifies that the floor plan corresponding to the control target space is stored in the external server, the electronic device 100 may receive the floor plan from the external server (S1930).

When the electronic device 100 receives the plan information in the above-described manner, the electronic device 100 may provide the plan information through the display (S1935).

Then, the electronic device 100 may identify a controllable home appliance (S1940). Then, the electronic device 100 may receive a user input (selection) of a household appliance corresponding to a specific sub-space included in the control target space (S1945). Then, the electronic device 100 may map at least one sub-space among the specific sub-space and the sub-space corresponding to the upper layer of the specific sub-space and the home appliance (S1950). Then, the electronic device 100 may store at least one subspace and mapping information of the home appliance in the memory 110 (S1955).

Referring to FIG. 20, the electronic device 100 may layer a plurality of subspaces (S2005) and receive a user input for mapping a specific household appliance to the layered subspace (S2010). Then, when the electronic device 100 receives the user's voice (S2015), the electronic device 100 may determine whether the user voice includes identification information of the subspace (S2020).

If the electronic device 100 identifies that the user voice does not include the identification information of the sub-space, the electronic device 100 may determine whether the user voice includes the identification information of the home appliance (S2025). Here, if the electronic device 100 identifies that the user's voice does not include identification information of the home appliance, the electronic device 100 may control the home appliance mapped to all sub-spaces (S2030). Here, when the electronic device 100 identifies that the user's voice includes identification information of the home appliance, the electronic device 100 can control the home appliance included in the user's voice among the home appliances mapped to all sub-spaces. Yes (S2035).

When the electronic device 100 identifies that the user voice includes identification information of the subspace, the electronic device 100 may determine whether the user voice includes identification information of the home appliance (S2040). Here, if the electronic device 100 identifies that the user's voice does not include identification information of the home appliance, the electronic device 100 displays all home appliances mapped to a specific sub-space (sub-space included in the user's voice). It can be controlled (S2045). Here, if the electronic device 100 identifies that the user's voice includes identification information of the home appliance, the electronic device 100 displays the user's voice among the home appliances mapped to a specific sub-space (sub-space included in the user's voice). It is possible to control the home appliance included in (S2050).

Meanwhile, in the method of controlling an electronic device according to an embodiment of the present disclosure, each of the plurality of subspaces included in the preset space may be layered into a plurality of layers (S2105).

Then, the home appliance included in each sub-space may be mapped to each layered sub-space and stored in the memory 110 (S2110).

Then, when a user command is input, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, a control signal for controlling the home appliance mapped to the sub-space may be transmitted to the home appliance (S2115). ).

Here, the step of layering (S2105) may identify each of the plurality of sub-spaces as a first layer or a second layer based on a structure of a predetermined space, and the second layer may be a lower layer of the first layer. Can.

In addition, in the step of storing in the memory 110 (S2110 ), when a household appliance is mapped to a sub-space belonging to the lowest layer among a plurality of layers, identification information for each of the lower layer and upper layers of the lowest layer and identification information of the household appliance A control target word may be generated, and the generated control target word may be mapped to the home appliance and stored in the memory 110.

In addition, in the step of transmitting a control signal to the household appliance (S2115 ), when a voice command including a control target word is input, a control signal for controlling at least one household appliance mapped to the control target word may be transmitted to the household appliance. have.

In addition, in the step of transmitting a control signal to the household appliance (S2115 ), when a voice command including a control target word is input, a plurality of belonging to different subspaces based on identification information of at least one layer included in the control target word A control signal for simultaneously controlling home appliances may be transmitted to a plurality of home appliances.

Further, the control method may further include providing a UI for selecting at least one of the plurality of home appliances when a plurality of home appliances belonging to different sub-spaces are identified based on the control target word.

In addition, the control method may further include displaying a floor plan including sub-spaces belonging to the lowest layer among the plurality of layers and identification information of home appliances belonging to the preset space, and storing the information in the memory 110 When a user command for mapping one of the displayed household appliance identification information to one of the sub-spaces is input, a control target word including identification information for each of the lowest layer and the upper layer of the lowest layer and identification information of the household appliance is input. The generated control target word may be mapped to the home appliance and stored in the memory 110.

In addition, the step of transmitting a control signal to the home appliance (S2115) is to control all home appliances corresponding to the identification information of the home appliance included in the user command when the user command does not include the subspace identification information. The control signal may be transmitted to household appliances.

On the other hand, the control method of the electronic device 100 as shown in FIG. 21 may be executed on the electronic device 100 having the configuration of FIG. 1 or 2, and may also be executed on the electronic device 100 having the other configuration.

Meanwhile, the methods according to various embodiments of the present disclosure described above may be implemented in an application form that can be installed in the existing electronic device 100.

Further, the methods according to various embodiments of the present disclosure described above may be implemented only by software upgrade or hardware upgrade of the existing electronic device 100.

In addition, various embodiments of the present disclosure described above may be performed through an embedded server provided in the electronic device 100 or an external server of the electronic device 100.

Meanwhile, the control method of the electronic device 100 according to the above-described embodiment may be implemented as a program and provided to the electronic device 100. In particular, a program including a control method of the electronic device 100 may be stored and provided in a non-transitory computer readable medium.

On the other hand, in the non-transitory computer readable medium storing computer instructions for causing the electronic device to perform an operation when executed by the processor 130 of the electronic device according to an embodiment of the present disclosure, the operation is performed in a predetermined space. Layering each of the included sub-spaces into a plurality of layers, mapping the household electrical appliances included in each sub-space to each layered sub-space and storing the memory 110 in the memory 110, and when a user command is input And, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, may include transmitting a control signal for controlling the home appliance mapped to the sub-space to the home appliance.

In addition, various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. According to a hardware implementation, embodiments described in the present disclosure include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) ), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions. In some cases, the embodiments described herein may be implemented by the processor 120 itself. According to the software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules can perform one or more functions and operations described herein.

Meanwhile, computer instructions for performing a processing operation in the electronic device 100 according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. Can. The computer instructions stored in the non-transitory computer readable medium allow the specific device to perform processing operations in the electronic device 100 according to various embodiments described above when executed by a processor of the specific device.

The non-transitory computer-readable medium refers to a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specific examples of non-transitory computer-readable media may include CDs, DVDs, hard disks, Blu-ray disks, USBs, memory cards, and ROMs.

Although the preferred embodiments of the present disclosure have been described and described above, the present disclosure is not limited to the specific embodiments described above, and it is usually in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications can be made by a person who has knowledge of, and these modifications should not be individually understood from the technical idea or prospect of the present disclosure.

Claims

Memory;

A communication interface including circuitry; And

Each of the plurality of sub-spaces included in the preset space is layered into a plurality of layers,

The home appliance included in each sub-space is mapped to each layered sub-space and stored in the memory,

When a user command is input, the control signal for controlling the home appliance mapped to the subspace is transmitted to the home appliance based on the identification information of the subspace included in the user command and the home appliance identification information. An electronic device comprising a processor for controlling a communication interface.
According to claim 1,

The processor,

Based on the structure of the predetermined space, each of the plurality of sub-spaces is identified as a first layer or a second layer,

The second layer is an electronic device that is a lower layer of the first layer.
According to claim 1,

The processor,

When a household electrical appliance is mapped to a sub-space belonging to the lowest layer among the plurality of layers, a control target word including identification information for each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance is generated; An electronic device that maps the generated control target word to the home appliance and stores it in the memory.
According to claim 3,

The processor,

When a voice command including the control target word is input, the electronic device controls the communication interface to transmit a control signal for controlling at least one home appliance mapped to the control target word to the home appliance.
According to claim 4,

The processor,

When a voice command including the control target word is input, a plurality of control signals for simultaneously controlling a plurality of home appliances belonging to different sub-spaces based on identification information for at least one layer included in the control target word The electronic device that controls the communication interface to transmit to the home appliance.
According to claim 4,

Display; further includes,

The processor,

When a plurality of home appliances belonging to different sub-spaces are identified based on the control target word, the electronic device controls the display to provide a UI for selecting at least one of the plurality of home appliances.
According to claim 1,

Display; further includes,

The processor,

A floor plan including sub-spaces belonging to the lowest layer among the plurality of layers and identification information of home appliances belonging to the preset space are displayed,

When a user command for mapping one of the displayed household appliance identification information to one of the sub-spaces is input, identification information for each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance are included. An electronic device that generates a control target word and maps the generated control target word to the home appliance and stores it in the memory.
The method of claim 7,

The top view,

An electronic device comprising at least one of a floor plan generated by an external device, a floor plan created by a user, a floor plan generated through a preset application, or a floor plan received by an external server.
According to claim 1,

The processor,

If the user command does not include the identification information of the sub-space, the communication to transmit a control signal for controlling all the home appliances corresponding to the identification information of the home appliance included in the user command to the home appliances An electronic device that controls the interface.
According to claim 1,

The processor,

If the user command does not include the identification information of the home appliance, the communication interface to transmit a control signal for controlling all the home appliances belonging to the subspace based on the identification information of the subspace to the home appliances To control, an electronic device.
In the control method of the electronic device,

Layering each of the plurality of sub-spaces included in the preset space into a plurality of layers;

Mapping the household electrical appliances included in each sub-space to each of the layered sub-spaces and storing them in a memory; And

When a user command is input, based on the identification information of the sub-space included in the user command and the identification information of the home appliance, transmitting a control signal for controlling the home appliance mapped to the sub-space to the home appliance Control method including ;.
The method of claim 11,

The layering step (layering),

Based on the structure of the predetermined space, each of the plurality of sub-spaces is identified as a first layer or a second layer,

The second layer is a lower layer of the first layer, the control method.
The method of claim 11,

The step of storing in the memory,

When a household appliance is mapped to a sub-space belonging to the lowest layer among the plurality of layers, a control target word including identification information for each of the lowest layer and upper layers of the lowest layer and identification information of the household appliance is generated; The generated control target word is mapped to the home appliance and stored in the memory.
The method of claim 13,

The step of transmitting the control signal to the home appliance,

When a voice command including the control target word is input, a control method for transmitting a control signal for controlling at least one home appliance mapped to the control target word to the home appliance.
The method of claim 14,

The step of transmitting the control signal to the home appliance,

When a voice command including the control target word is input, a plurality of control signals for simultaneously controlling a plurality of home appliances belonging to different sub-spaces based on identification information of at least one layer included in the control target word The control method, which is transmitted to household appliances.