WO2022030860A1

WO2022030860A1 - Electronic device for controlling target electronic device in iot environment, and method related thereto

Info

Publication number: WO2022030860A1
Application number: PCT/KR2021/009762
Authority: WO
Inventors: 이강수; 송기섭
Original assignee: 삼성전자 주식회사
Priority date: 2020-08-04
Filing date: 2021-07-28
Publication date: 2022-02-10
Also published as: KR20220017057A

Abstract

An electronic device comprises: at least one communication circuit; a display; a processor operatively connected to the at least one communication circuit and the display; and a memory operatively connected to the processor. The memory may store instructions enabling, during execution, the processor to: receive a first user input for requesting the registration of an IR controlee device, the IR controlee device meaning a device controlled by an IR device; discover a target electronic device using the at least one communication circuit; identify that the discovered target electronic device is a cloud controlee device, the cloud controlee device meaning a device controlled by an IoT server; and output, through the display, a first user interface indicating that the discovered target electronic device is the cloud controlee device.

Description

Electronic device for controlling target electronic device in IOT environment and method related thereto

Various embodiments disclosed in this document relate to a technology for registering and controlling a target electronic device in an Internet of things (IoT) environment.

In the IoT environment, intelligent services that create new values in human life by collecting and analyzing data generated from connected objects can be provided. IoT is a smart home, smart building, smart city, smart car or connected car, smart grid, health care, smart home appliance, or advanced medical service field through convergence and compounding between existing IT (information technology) technology and various industries. can be applied

A target electronic device (or may be referred to as a 'target device') included in the IoT environment may be controlled in various ways. For example, an infrared (IR) device such as an artificial intelligence (AI) speaker may control the target electronic device by transmitting an IR signal to the target electronic device. The function of controlling the target electronic device through the IR device may be referred to as an 'IR control function'. As another example, an IoT server or a cloud server managing the target electronic device may control the target electronic device by directly transmitting a command signal to the target electronic device. The function of controlling the target electronic device through the IoT server may be referred to as a 'cloud control function'.

The IoT server may allocate a virtual ID (identifier) to a target electronic device registered in the IoT server. The target electronic device may be registered in the IoT server as an IR controlee device that can be controlled by the IR control function or registered in the IoT server as a cloud controlee device that can be controlled by the cloud control function. Therefore, even if the same target electronic device, the IoT server may generate different IDs depending on the type of control function. When different IDs are generated in the same target electronic device, the IoT server may not recognize the corresponding target electronic device as the same device.

In addition, the IR signal may not receive a feedback signal from the target electronic device due to the nature of the protocol, and in the absence of the IR signal, a situation may occur in which the target electronic device cannot be controlled.

An electronic device according to an embodiment disclosed in this document includes at least one communication circuit, a display, a processor operatively connected to the at least one communication circuit and the display, and a memory operatively connected to the processor. wherein, when the memory is executed, the processor receives a first user input requesting registration of an IR (infrared) controlled device, the IR controlled device means a device controlled by the IR device, , a device that searches for a target electronic device using the at least one communication circuit, identifies that the found target electronic device is a cloud control target device, and the cloud control target device is controlled by an IoT server and may store instructions for outputting a first user interface (UI) indicating that the found target electronic device is the cloud control target device through the display.

The server included in the IoT environment according to an embodiment disclosed in this document includes a communication interface configured to communicate with an electronic device, a processor operatively connected to the communication interface, and a memory operatively connected to the processor, The memory stores a database for a target electronic device registered as a cloud control target device in the server, and the processor performs a first request to register a target electronic device found by the electronic device as an IR control target device. A registration request message is received from the electronic device, and the first registration request message includes information on at least one of a device type, a manufacturer, a model name, and a unique identifier (UID) of the searched target electronic device, and the first registration Based on the information included in the request message and the database stored in the memory, it is identified that the found target electronic device is a cloud control target device, and a first response message indicating that the found target electronic device is the cloud control target device is generated. It may be set to be transmitted to the electronic device.

The method of the electronic device according to an embodiment disclosed in this document includes the operation of receiving a first user input requesting registration of an IR control target device, the IR control target device means a device controlled by the IR device, An operation of searching for a target electronic device, an operation of identifying that the found target electronic device is a cloud control target device, the cloud control target device means a device controlled by an IoT server, and the searched target electronic device is the cloud control target device It may include outputting a first user interface indicating that it is a device.

According to various embodiments of the present disclosure, the electronic device may guide the user to register the target electronic device, which the user wants to register as the IR control target device, as the cloud control target device.

According to various embodiments disclosed herein, the electronic device may recognize a device registered as an IR control target device and a device registered as a cloud control target device as the same device.

According to various embodiments disclosed in this document, the electronic device may compensate for the shortcomings of the IR control function through the cloud control function.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;

2 illustrates an IoT system according to various embodiments.

3 illustrates an IoT system for controlling a target electronic device according to various embodiments.

4 is a flowchart illustrating an operation of an electronic device for guiding registration of a target electronic device according to various embodiments of the present disclosure;

5 illustrates a user interface for guiding registration of a target electronic device according to various embodiments of the present disclosure;

6 is a flowchart illustrating an operation of an electronic device for registering a target electronic device according to various embodiments of the present disclosure;

7 is a signal flow diagram for identifying whether a target electronic device supports a cloud function, according to various embodiments of the present disclosure;

8 is a flowchart illustrating an operation of an electronic device for identifying whether a target electronic device is a control target device according to various embodiments of the present disclosure;

9 is a signal flow diagram for identifying whether a target electronic device is a control target device according to various embodiments of the present disclosure;

10 is a signal flow diagram for registering a target electronic device as an IR control target device according to various embodiments of the present disclosure;

11 illustrates another example of a user interface for guiding registration of a target electronic device according to various embodiments of the present disclosure;

12 illustrates a user interface for controlling a target electronic device according to various embodiments of the present disclosure;

13 is a block diagram and a flowchart for controlling a target electronic device according to various embodiments of the present disclosure;

14 illustrates a signal flow diagram for processing a channel change command in accordance with various embodiments.

15 is a flowchart illustrating an operation of an IoT server for processing a channel change command according to various embodiments of the present disclosure;

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 shows an IoT system 200 . At least some of the components of FIG. 2 may be omitted, and components not shown may be further included.

Referring to FIG. 2 , the IoT system 200 according to an embodiment includes a plurality of data networks 216 or 246 (eg, the first network 198 or the second network 199 of FIG. 1 ) connectable. including electronic devices. For example, the IoT system 200 includes a first IoT server 210 (eg, the server 108 of FIG. 1 ), a first node 220 , a voice assistance server 230 , It may include at least one of the second IoT server 240 (eg, the server 108 of FIG. 1 ), the second node 250 , or the devices 221,222,223,224,225,236,237,251,252,253.

According to an embodiment, the first IoT server 210 includes a communication interface 211 (eg, the interface 177 or communication module 190 of FIG. 1 ), a processor 212 (eg, the processor of FIG. 1 ) 120), or the storage unit 213 (eg, the memory 130 of FIG. 1). The second IoT server 240 is a communication interface 241 (eg, the interface 177 or communication module 190 of FIG. 1 ), a processor 242 (eg, the processor 120 of FIG. 1 ), or storage It may include at least one of the units 243 (eg, the memory 130 of FIG. 1 ). The voice assistant server 230 includes a communication interface 231 (eg, interface 177 or communication module 190 of FIG. 1 ), a processor 232 (eg, processor 120 of FIG. 1 ), Alternatively, it may include at least one of the storage unit 233 (eg, the memory 130 of FIG. 1 ). "IoT server" in this document, for example, based on a data network (eg, data network 216 or data network 246), a relay device (eg, the first node 220 or the second node ( 250)), or directly without a relay device, remotely control and/or monitor one or more devices (eg, devices 221,222,223,224,225,251,252,253). A “device” herein means a sensor, home appliance, office electronic device, or A device for performing a process, the type is not limited. A device that receives the control command and performs an operation corresponding to the control command may be referred to as a “target device” or a “target electronic device”. The IoT server may be referred to as a central server in that it selects a target device from among a plurality of devices and provides a control command.

According to an embodiment, the first IoT server 210 may communicate with the

devices

221 , 222 , and 223 through the data network 216 . The data network 216 may refer to a network for long-distance communication, such as, for example, the Internet or a computer network (eg, LAN or WAN), or may include a cellular network.

According to an embodiment, the first IoT server 210 may be connected to the data network 216 through the communication interface 211 . The communication interface 211 may include a communication device (or a communication module) for supporting communication of the data network 216 , and may be integrated into one component (eg, a single chip), or may include a plurality of separate components. It can be implemented with components (eg, a plurality of chips). The first IoT server 210 may communicate with the

devices

221 , 222 , and 223 through the first node 220 . The first node 220 may receive data from the first IoT server 210 through the data network 216 and transmit the received data to at least some of the

devices

221 , 222 , and 223 . Alternatively, the first node 220 may receive data from at least some of the

devices

221 , 222 , and 223 , and transmit the received data to the first IoT server 210 through the data network 216 . The first node 220 may serve as a bridge between the data network 216 and the

devices

221 , 222 , 223 . Meanwhile, in FIG. 2 , the first node 220 is illustrated as one, but this is merely exemplary, and the number is not limited.

A “node” in this document may be an edge computing system, or may be a hub device. According to an embodiment, the first node 220 may support wired and/or wireless communication of the data network 216 , and may also support wired and/or wireless communication with the

devices

221 , 222 , and 223 . . For example, the first node 220 is a short-range communication network such as at least one of Bluetooth, Wi-Fi, Wi-Fi direct, Z-wave, Zig-bee, Insteon, X10, or IrDA (infrared data association). Although it can be connected to the

devices

221 , 222 , and 223 through the communication type, there is no limitation. The first node 220 may be located (or located) within an environment, such as, for example, a home, an office, a factory, a building, an off-site branch, or other type of premises. Accordingly, the

devices

221 , 222 , and 223 may be monitored and/or controlled by the service provided by the first IoT server 210 , and the

devices

221 , 222 , and 223 may directly connect to the first IoT server 210 . It may not be required to have the capability of full network communication (eg Internet communication) for

Devices

221 , 222 , 223 are shown as implemented as electronic devices within a home environment, such as, for example, light switches, proximity sensors, or temperature sensors, although this is illustrative and not restrictive.

According to an embodiment, the first IoT server 210 may support direct communication with the

devices

224 and 225 . Herein, “direct communication” may refer to communication not through a relay device such as the first node 220, for example, communication through a cellular communication network and/or a data network.

According to an embodiment, the first IoT server 210 may transmit a control command to at least some of the

devices

221 , 222 , 223 , 224 and 225 . Here, the "control command" may mean data that causes a controllable device to perform a specified operation, and the specified operation is an operation performed by the device, including output of information, sensing of information, reporting of information, Alternatively, it may include management (eg, deletion, or creation) of information, and there is no limitation on the type. For example, the processor 212 generates a control command from an external (eg, at least some of the voice assistant server 230 , the second IoT server 240 , the external system 260 , or the

devices

221 , 222 223 , 224 , 225 ). It is possible to obtain information (or a request) to perform the operation, and generate a control command based on the obtained information. Alternatively, the processor 212 may generate a control command based on a result of monitoring at least some of the

devices

221 , 222 , 223 , 224 and 225 satisfying a specified condition. The processor 212 may control the communication interface 211 to transmit a control command to the target device.

According to one embodiment, the processor 212 , the processor 232 , or the processor 242 is a central processing unit (CPU), a digital signal processor (DSP), an application processor (AP), a communication processor (CP), or the like. It may be implemented as a combination of one or more of a general-purpose processor, a graphic processing unit (GPU), a graphics-only processor such as a vision processing unit (VPU), or an artificial intelligence-only processor such as a neural processing unit (NPU). Those skilled in the art will understand that the above-described processing unit is merely an example, and the processor 212 executes instructions stored in the memory 213 and is not limited as long as it is an arithmetic means capable of outputting the executed result.

According to an embodiment, the processor 212 may configure a web-based interface based on the API 214 or expose a resource managed by the first IoT server 210 to the outside. . The web-based interface may support communication between the first IoT server 210 and an external web service, for example. The processor 212 may, for example, allow an external system 260 to control and/or access the

devices

221 , 222 , 223 . External system 260 may be, for example, an independent system that is not associated with, or is not part of, system 200 . The external system 260 may be, for example, an external server or a web site. However, security for access to the resources of the

devices

221 , 222 , 223 from the external system 260 or the first IoT server 210 may be required. According to an embodiment, the processor 212 may expose an API endpoint (eg, a universal resource locator (URL)) based on the API 214 to the outside. As described above, the first IoT server 210 may transmit a control command to a target device among the

devices

221 , 222 , and 223 . On the other hand, the description of the communication interface 241, the processor 242, and/or the storage unit 243 (eg, the API 244, and/or the database 245) of the second IoT server 240, Substantially the same as the description of the communication interface 211 , the processor 212 , and/or the storage 213 (eg, the API 214 , and/or the database 215 ) of the first IoT server 210 . can do. In addition, the description of the second node 250 may be substantially the same as the description of the first node 220 . The second IoT server 240 may transmit a control command to a target device among the devices 251,252 and 253 . The first IoT server 210 and the second IoT server 240 may be operated by the same service provider in one embodiment, but may be operated by different service providers in another embodiment.

According to an embodiment, the voice assistant server 230 may transmit/receive data to and from the first IoT server 210 through the data network 216 . The communication interface 231 communicates with the smart phone 236 (eg, the electronic device 101 of FIG. 1 ) or the AI speaker 237 through a data network (not shown) and/or a cellular network (not shown). can be done The smart phone 236 or the AI speaker 237 may include a microphone, obtain a user voice, convert it into a voice signal, and transmit the voice signal to the voice assistant server 230 . The processor 232 may receive a voice signal from the smart phone 236 or the AI speaker 237 through the communication interface 231 . The processor 232 may process the received voice signal based on the stored model 234 . The processor 232 may generate (or confirm) a control command using the processing result based on information stored in the database 235 . According to an embodiment, the storage units 213 , 233 , and 243 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory, etc.), RAM (random access memory), SRAM (static random access memory), ROM (read-only memory), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only) memory), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of non-transitory storage medium, and the type is not limited.

3 illustrates an IoT system 300 for controlling a target electronic device 350 according to various embodiments. The device type of the target electronic device is not limited to the example illustrated in FIG. 3 . In this document, a 'target electronic device' may include various electronic devices (eg, home appliances) that can be controlled in an IoT environment.

Referring to FIG. 3 , the IoT server 310 , the voice assistant server 320 , the electronic device 330 , and the AI speaker 340 are the first IoT server 210 (or the second IoT server) of FIG. 2 , respectively. 240)), the voice assistant server 230, the smart phone 236, and the AI speaker 237 may include the same or similar configuration, and may perform the same or similar functions as these. The AI speaker 340 is an example of an IR device, and the IR device capable of transmitting an IR signal is not limited to the AI speaker 340 .

According to an embodiment, the memory of the IoT server 310 (eg, the storage unit 213 in FIG. 2 ) stores an account database (DB) 312 , a device DB 314 , and a program DB 316 . can be saved The account DB 312 may include account information corresponding to at least one or more users using the IoT environment or account information corresponding to a user group. According to an embodiment, the user account of the electronic device 330 and the user account of the AI speaker 340 included in the account DB 312 may be the same. The device DB 314 may include information on at least one target electronic device (eg, the target electronic device 350 ) corresponding to the user account. For example, the device DB 314 may include a device type (eg, a TV, a refrigerator, a washing machine, a light, an air conditioner, or a fan) of the at least one target electronic device, and an area (eg, a living room) in which the at least one target electronic device is located. , room, bathroom, kitchen, or hallway), a manufacturer or brand of at least one target electronic device, a model name of at least one target electronic device, at least one target electronic device unique identifier (UID) and/or at least one may include at least one of information on a control function (eg, an IR control function or a cloud control function) supported by the target electronic device. The program DB 316 may include information on content (or a broadcast program) output from the target electronic device 350 such as a TV. For example, the program DB 316 may include channel information, channel use history information, or a channel schedule.

The IoT server 310 may acquire a user command for controlling the target electronic device 350 based on various methods. In an embodiment, the IoT server 310 may obtain a user command through a user's voice input. For example, in operation 301 , the AI speaker 340 may obtain a voice input from the user. In operation 302 , the AI speaker 340 may transmit the acquired voice input to the voice assistant server 320 . 3 illustrates an example of acquiring a user's voice input through the AI speaker 340, although not shown, according to another embodiment, the electronic device 330 acquires a voice input and transmits the acquired voice input to a voice assistant server It can be transmitted to (320). The voice assistant server 320 may analyze the user command corresponding to the voice input and transmit the analyzed user command to the IoT server 310 in operation 303 .

In another embodiment, the IoT server 310 may obtain a user command through the user interface 304 provided by the electronic device 330 . For example, the electronic device 330 receives a user input for controlling the target electronic device 350 through the user interface 304 , and in operation 305 , transmits information corresponding to the received user input to the IoT server 310 . can be sent to

The IoT server 310 may control the target electronic device 350 based on various methods. The control function for controlling the target electronic device 350 may include a cloud control function and an IR control function. The IR control function allows an IR device such as the AI speaker 340 (eg, a device supporting an IR function or an IR protocol) to transmit an IR signal (or a signal based on the IR protocol) to the target electronic device 350 to target the target electronic device 350 . It may be referred to as a function of controlling the electronic device 350 . For example, according to the IR control function, in operation 306 , the IoT server 310 may transmit a command signal corresponding to the user command to the AI speaker 340 . In operation 307 , the AI speaker 340 may transmit an IR signal corresponding to the received command signal to the target electronic device 350 . The cloud control function may be referred to as a function in which the IoT server 309 directly transmits a control command signal to the target electronic device 350 to control the target electronic device 350 . For example, in operation 308 , the IoT server 310 may directly transmit a command signal corresponding to a user command to the target electronic device 310 . The cloud control function may be based, for example, on an open connectivity foundation (OCF) standard or based on a message queuing telemetry transfer (MQTT) protocol.

An operation of registering the target electronic device 350 as an IR controlee device is as follows. The electronic device 330 may obtain information on the device type (eg, TV), manufacturer (or brand), and/or model name of the IR control target device that the user wants to register through a user input. The electronic device 330 may control the AI speaker 340 to transmit an IR signal including a specified command (eg, change channel) using a protocol based on the selected device type, manufacturer, and/or model name. For example, the electronic device 330 may request the AI speaker 340 to transmit an IR signal including a specified command through the IoT server 310 . For another example, the electronic device 330 may use the AI speaker 340 through a short-range communication network (eg, the first network 198 of FIG. 1 ) or a telecommunication network (eg, the second network 199 of FIG. 1 ). ) may request to transmit an IR signal containing the specified command. According to an embodiment, the AI speaker 340 may receive a protocol based on the device type, manufacturer (or brand) and/or model name of the IR control target device from the IoT server 310 . The target electronic device 350 may perform a specified command included in the IR signal received from the AI speaker 340 . The user of the electronic device 330 may visually confirm that the target electronic device 350 normally performs the specified command. The electronic device 330 may obtain a user input corresponding to a user's confirmation and request the IoT server 310 to register the target electronic device 350 . The IoT server 310 allocates an identifier (ID) to the target electronic device 350 , and controls the target electronic device 350 based on the ID of the AI speaker 340 and the ID of the target electronic device 350 . can do. When the target electronic device 350 is registered as a cloud control target device, the electronic device 330 does not use an IR signal through the AI speaker 340 but through data exchange with the IoT server 310 , the target electronic device 350 ) can be registered as a cloud control target device. For example, the electronic device 330 searches for the target electronic device 350 through the cloud control application or service, and sets the target electronic device 350 to the IoT server based on the account of the electronic device 330 or the user's account. 310) as a cloud control target device.

Since the method of registering the cloud control target device and the IR control target device are different from each other, when the user wants to register the target electronic device 350 as the IR control target device, the target electronic device 350 performs the cloud control function. Even if it can support or is already registered in the IoT server 310 as a cloud control target device, the IoT server 310 performs the ID of the target electronic device 350 according to the cloud control function and the target electronic device 350 according to the IR control function. ) can be created differently. If the ID of the target electronic device 350 is generated differently, the IoT server 310 may not recognize the target electronic device 350 as a single device. In addition, since the target electronic device 350 cannot transmit a feedback signal for the IR signal due to the characteristics of the IR protocol, the electronic device 330 or the user of the electronic device 330 checks whether the target electronic device 350 operates normally. It may not be easy.

When the target electronic device 350 that the user wants to register as the IR control target device can support the cloud control function, the electronic device 330 according to various embodiments sets the target electronic device 350 to the cloud control target device. , or if it has already been registered in the IoT server 310 as a cloud control target device, it may guide the target electronic device 350 to be controlled as a cloud control target device. In addition, the IoT server 310 according to various embodiments controls the target electronic device 350 based on information stored in the device DB 314 and the program DB 316 , and an error occurs or additional information is required. In this case, feedback may be provided to the electronic device 330 . For example, when the target electronic device 350 is registered as an IR control target device and a cloud control target device and an error for the IR control signal is generated, the IoT server 310 performs the AI speaker 340 and/or the electronic device Feedback may be provided at 330 .

4 to 5 describe an operation for guiding registration of a target electronic device according to various embodiments of the present disclosure. 4 is a flowchart illustrating an operation of an electronic device for guiding registration of a target electronic device. 5 illustrates a user interface for guiding registration of a target electronic device. The operations illustrated in FIG. 4 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 . For example, the processor of the electronic device (eg, the processor 120 of FIG. 1 ) may perform the operations of the electronic device by executing instructions stored in the memory (eg, the memory 130 of FIG. 1 ). have.

Referring to FIG. 4 , in operation 410 , the electronic device may receive a first user input requesting registration of an IR control target device (eg, user input 511 of FIG. 5 ). For example, referring to FIG. 5 , the electronic device receives a user input for requesting addition of an IR-controlled device on the first screen 501 output through a display (eg, at least a part of the display module 160 of FIG. 1 ). (511) can be received. According to an embodiment, the user executes an application for IR control in the electronic device and performs a device addition function to register at least a target electronic device (eg, the target electronic device 350 of FIG. 3 ) as an IR control target device. action can be performed for For example, the application for IR control may be an application related to an external electronic device that generates an IR control signal (eg, the AI speaker 340 of FIG. 3 ).

According to an embodiment, the first user input may include an input multiple times. In other words, in addition to the user input 511 for requesting addition of the IR control target device, the electronic device receives a user input for selecting at least one of the device type, manufacturer (or brand) and/or model name of the device the user wants to register. can be obtained additionally. For example, referring to FIG. 5 , the electronic device displays a first list 512 indicating a plurality of device types on the second screen 502 , and one device type (eg: A user input 513 for selecting TV) may be received. Alternatively, the electronic device displays a second list 514 indicating a plurality of brands corresponding to the selected device type on the third screen 503 , and in the second list 514 , one brand (eg, brand 1 ( A user input 515 for selecting Brand 1)) may be received. Although not shown, according to an embodiment, the electronic device displays a screen including at least one model name based on a brand (eg, Brand 1) corresponding to the user input 515 , and one model name may receive an input from a user who selects .

In operation 420 , the electronic device searches for a target electronic device (eg, the target electronic device 350 of FIG. 3 ) in response to the first user input. For example, the electronic device may search for a target electronic device corresponding to the device type and brand selected by the

user inputs

513 and 515 . In an embodiment, the electronic device may search for a target electronic device based on a short-range communication protocol other than IR communication. The short-range communication protocol may include, for example, a Bluetooth communication protocol.

In operation 430, the electronic device may identify that the found target electronic device is a cloud control target device. For example, the electronic device transmits registration information (eg, device type, manufacturer, and/or model name) of the found target electronic device to the IoT server (eg, the IoT server 310 of FIG. 3 ), and the searched target electronic device Information indicating whether the device is a cloud control target device may be received from the IoT server.

In operation 440, the electronic device may output a first UI indicating that the found target electronic device is a cloud control target device. For example, referring to FIG. 5 , the electronic device may output the first UI 516 on the fourth screen 504 . According to an embodiment, the first UI 516 may include information notifying that the target electronic device selected to request registration of the IR control target device is an electronic device capable of operating as the cloud control target device. According to an embodiment, the first UI 516 may include information on whether to register the selected target electronic device as an IR control target device or as a cloud control target device to request registration of the IR control target device. have. According to an embodiment, the first UI 516 may display that the target electronic device selected to request registration of the IR control target device is registered as the cloud control target device.

Although the above description assumes that the electronic device searches for a device selected by the device type, manufacturer (or brand), and/or model name by the user, according to another embodiment, the electronic device may be determined by the device type, manufacturer (or brand). ) and a model name, after searching for at least one target electronic device through a plurality of communication protocols, one target electronic device may be selected from among the at least one searched target electronic device according to a user input.

For example, after receiving the user input 511 requesting addition of the IR control target device, the electronic device obtains information on at least one target electronic device from the at least one target electronic device through a short-range communication protocol, Device types, manufacturers, and/or model names of at least one target electronic device may be identified based on the obtained information. According to an embodiment, the electronic device activates at least one communication module (eg, the communication module 180 of FIG. 1 ) in response to receiving the user input 511 and searches for at least one target electronic device A signal (eg, a beacon signal) may be transmitted and a response signal may be received from at least one target electronic device. The electronic device outputs a list (eg, the first list 512 or the second list 514 ) indicating the device type and/or manufacturer of at least one target electronic device through the display, and selects one device from the output list.

User inputs

513 and 515 for selecting a type and/or brand may be received. The electronic device may identify whether the target electronic device selected by the user input is a cloud control target device. In this case, the electronic device transmits registration information (eg, at least one of device type, manufacturer, model name, and/or UID) of the target electronic device selected based on

user inputs

513 and 515 to the IoT server (eg, IoT of FIG. 3 ) The information may be transmitted to the server 310 ) and information indicating whether the selected target electronic device is a cloud control target device may be received from the IoT server.

6 is a flowchart illustrating an operation of an electronic device for registering a target electronic device according to various embodiments of the present disclosure; The operations illustrated in FIG. 6 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 . The operations illustrated in FIG. 6 may be performed after operation 420 of FIG. 4 .

Referring to FIG. 6 , in operation 610 , the electronic device may identify the device type of the found target electronic device (eg, the target electronic device 350 of FIG. 3 ). According to an embodiment, information indicating the device type of the target electronic device may be obtained while the electronic device searches for the target electronic device. For example, the electronic device may receive a data packet indicating the device type of the target electronic device from the target electronic device. As another example, the electronic device may acquire the device type of the target electronic device based on a user input for selecting the device type of the target electronic device (eg,

user inputs

513 and 515 of FIG. 5 ). The electronic device may perform subsequent operations only with respect to the target electronic device indicating the same device type as the device type (eg, TV) selected by the user.

In operation 620, the electronic device may identify whether the device to be registered by the user and the target electronic device found by the electronic device are the same by determining that the found target electronic device is a control target device. An example for determining that the found target electronic device is a control target device will be described later with reference to FIGS. 8 to 9 .

In operation 630 , the electronic device may receive information indicating that the found target electronic device is a device supporting a cloud control function from an IoT server (eg, the IoT server 310 of FIG. 3 ). For example, the electronic device transmits registration information (eg, at least one of device type, manufacturer, model name, and/or UID) of the found target electronic device to the IoT server, and the target electronic device found from the IoT server performs a cloud control function. Information indicating that it is a supported device may be received from the IoT server. As another example, the electronic device may receive information indicating that the found target electronic device is a device previously registered in the IoT server from the IoT server.

In operation 640 , the electronic device may output a first UI (eg, the first UI 516 of FIG. 5 ) indicating that the found target electronic device is a device supporting the cloud control function. For example, it may indicate that the found target electronic device may operate as a cloud control target device or is registered as a cloud control target device.

In operation 650, the electronic device may identify whether a user input requesting to register the found target electronic device as an IR control target device is received.

When a user input requesting to register the found target electronic device as an IR control target device (eg, 'YES' in the first UI 516 of FIG. 5 ) is received, in operation 660 , the electronic device sets the searched target electronic device as an IR A procedure for registering as a control target device may be performed.

If a user input requesting to register the found target electronic device as an IR control target device is not received (eg, 'NO' in the first UI 516 of FIG. 5 ), in operation 670 , the electronic device selects the found target electronic device It can be registered as a cloud-controlled device. If the found target electronic device is already registered as the cloud control target device, the electronic device may end the procedure of registering the found target electronic device as the cloud control target device.

7 is a signal flow diagram for identifying whether a target electronic device supports a cloud function, according to various embodiments of the present disclosure; The operations of FIG. 7 may be, for example, an example of operation 630 of FIG. 6 .

Referring to FIG. 7 , in operation 705 , the electronic device 701 (eg, the electronic device 330 of FIG. 3 ) includes registration information on the found target electronic device (eg, the target electronic device 350 of FIG. 3 ). may transmit a first registration request message to the IoT server 702 (eg, the IoT server 310 of Fig. 3). The registration information may include, for example, the device type, manufacturer (or brand) of the searched target electronic device, Information on at least one of a model name and/or UID may be included.

In operation 710, the IoT server 702 may identify whether the found target electronic device supports the cloud control function based on registration information included in the first registration request message. For example, the IoT server 702 detects a database (eg, the device DB 314 of FIG. 3 ) stored in the IoT server 702 , and thus the device type, manufacturer, and/or model name indicated by the registration information is cloud It can be identified whether the control function is supported. For another example, the IoT server 702 detects a database (eg, the device DB 314 of FIG. 3 ) stored in the IoT server 702 , thereby indicating the device type, manufacturer, model name and/or registration information indicated by the IoT server 702 . It may be identified whether a target electronic device matching at least one of UIDs is registered.

In operation 715 , the IoT server 702 may transmit a first response message in response to the first registration request message. The first response message may include, for example, information indicating that the device type, manufacturer, and/or model name of the found target electronic device supports the cloud control function. As another example, the first response message may include information on whether the found target electronic device is registered as a cloud control target.

8 to 9 illustrate an operation for identifying whether a target electronic device is a control target device, according to various embodiments.

8 is a flowchart illustrating an operation of an electronic device for identifying whether a target electronic device is a control target device. The operations shown in FIG. 8 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 . The operations illustrated in FIG. 8 may be an example of operation 620 of FIG. 6 .

Referring to FIG. 8 , in operation 810 , the electronic device may request to transmit an IR signal to the target electronic device through an AI speaker (eg, the AI speaker 340 of FIG. 3 ). For example, the electronic device may request an AI speaker to transmit an IR signal to the target electronic device through the IoT server (eg, the IoT server 310 of FIG. 3 ). According to an embodiment, the IR signal may include a specified command (eg, change channel). According to an embodiment, operation 810 may be performed before the electronic device searches for a target electronic device. As another example, operation 810 may be performed when a plurality of target electronic devices are found.

In operation 820, the electronic device may request a response signal from the target electronic device through a short-range communication protocol. According to an embodiment, operation 820 may be performed together with operation 420 of FIG. 4 . For example, a signal transmitted to search for a target electronic device may include information requesting a response signal.

In operation 830, the electronic device may receive a response signal from the target electronic device. Since the target electronic device cannot transmit an IR signal, the electronic device may receive a response signal from the target electronic device through a short-range communication protocol.

In operation 840 , the electronic device may identify whether the received response signal includes at least part of the same information as the IR signal transmitted in operation 810 . For example, the electronic device may identify whether the received response signal includes information about a specified command included in the IR signal.

If the received response signal includes at least some of the same information as the IR signal, in operation 850, the electronic device may determine that the target electronic device that has transmitted the response signal is the IR control target device. In other words, the electronic device may identify that the target electronic device including at least part of the same information as the IR signal among the target electronic devices found through the short-range communication protocol is the same as the IR control target device that the user wants to register.

If the received response signal does not include the same information as the IR signal, in operation 860, the electronic device determines that the target electronic device that has transmitted the response signal is not the IR control target device.

9 is a signal flow diagram for identifying whether a target electronic device is a control target device.

Referring to FIG. 9 , a first target electronic device 902 may refer to a device capable of supporting an IR control function (eg, the target electronic device 350 of FIG. 3 ). The second target electronic device 903 may mean a device that cannot support a specified IR control function. For example, the first target electronic device 902 and the second target electronic device 903 may be different device types or may support different IR protocols.

In operation 905 , the electronic device 901 (eg, the electronic device 330 of FIG. 3 ) may transmit a transmission command signal to the IR device 904 (eg, the AI speaker 340 of FIG. 3 ). The transmit command signal may include information instructing the IR device 904 to transmit a command signal based on the IR protocol (eg, the IR signal of FIG. 8 ).

In operation 910 , the IR device 904 may transmit a command signal (eg, the IR signal of FIG. 8 ) based on the IR protocol to the first target electronic device 902 . The command signal may include, for example, a designated command (eg, change channel). In operation 915 , the IR device 904 may transmit the same signal as the command signal transmitted to the first target electronic device 902 to the second target electronic device 903 . According to an embodiment, operations 910 and 915 may be performed as one operation. For example, the IR device 904 may transmit a specified command (eg, change a channel) in a specified direction (eg, one or more directions) a specified number of times (eg, one or more times).

In operation 920, the first target electronic device 902 may process the received IR signal. The first target electronic device 902 may identify the specified command by processing the IR signal, and store at least a portion of the specified command for a specified time. On the other hand, since the second target electronic device 903 does not support the IR protocol supported by the electronic device 901 , it may not be able to process the received IR signal (operation 922 ).

In operations 925 and 930 , the electronic device 901 may transmit a response request signal to the found target

electronic devices

902 and 903 . According to an embodiment, the electronic device 901 may transmit a response request signal based on a short-range communication protocol (eg, Bluetooth) using a communication module (eg, the communication module 190 of FIG. 1 ). According to an embodiment, the electronic device 901 may simultaneously perform operations 925 and 930 . For example, the electronic device 910 may broadcast a response request signal.

In operation 935 , the first target electronic device 902 may transmit a pre-stored specified command to the electronic device 901 together with a response signal. According to an embodiment, the response signal may be transmitted based on a short-range communication protocol. According to an embodiment, the first target electronic device 902 may reduce unnecessary storage space consumption by deleting the specified command after transmitting the response signal.

In operation 937 , the second target electronic device 903 may transmit a response signal to the electronic device 901 based on a short-range communication protocol. Since the second target electronic device 903 failed to process the received IR signal, the response signal transmitted from the second target electronic device 903 may not include a designated command for processing the IR signal (eg, For example, 'empty' or 'fail' information included).

The electronic device 901 is a device for registering the first target electronic device 902 as an IR control target device based on the received response signal and for registering the second target electronic device 903 as an IR control target device It can be determined that it is not a device.

10 to 11 illustrate an operation for registering a target electronic device as an IR control target device according to various embodiments of the present disclosure.

10 is a signal flow diagram for registering a target electronic device as an IR control target device. 11 illustrates a user interface for guiding registration of a target electronic device. The operations illustrated in FIG. 10 may be performed after operation 660 of FIG. 6 .

Referring to FIG. 10 , in operation 1005 , the electronic device 1001 (eg, the electronic device 330 of FIG. 3 ) transmits a second registration request message to the IoT server 1002 (eg, the IoT server 310 of FIG. 3 ). ) can be sent to The second registration request message may include information requesting to register a target electronic device (eg, the target electronic device 350 of FIG. 3 ) as an IR control target device. In an embodiment, the second registration request message may include information on at least one of a device type, a manufacturer, a brand, a model name, and/or a UID of the target electronic device. In an embodiment, the second registration request message may include information on an area in which the target electronic device is located. A region may be, for example, a virtual space allocated in a home or office, such as a bedroom, a kitchen, a living room, or a bathroom. For example, the electronic device 1001 may register at least one virtual space in the IoT server 1002 and transmit information about the virtual space in which the target electronic device is located in the second registration request message.

In operation 1010 , the IoT server 1002 may identify whether a device having the same device type as the found target electronic device exists in the area including the location of the found target electronic device. For example, the IoT server 1002 may retrieve a database (eg, the device DB 314 or the account DB 312 of FIG. 3 ) in response to receiving the second registration request message. If a target electronic device (eg, a TV) located in a specific area (eg, living room) is already registered in the IoT server 1002 as a cloud control target device, the IoT server 1002 is the target indicated by the second registration request message. A device having the same area and device type as the electronic device may be identified as already existing.

If there is no device having the same device type in the same area as the searched target electronic device, the IoT server 1002 registers the searched target electronic device as an IR control target device, and in operation 1035, the IoT server 1002 performs registration A message indicating completion may be transmitted to the electronic device 1001 .

If a device having the same device type exists in the same area as the searched target electronic device, the IoT server 1002 may transmit a second response message 1015 to the electronic device 1001 . The second response message 1015 may include information indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located. For example, the existence of a device having the same device type as the found target electronic device in the same area as the area in which the searched target electronic device is located includes that the target electronic device is registered in the IoT server 1002 with the cloud control function can do.

In operation 1020 , the electronic device 1001 may output a second UI for guiding registration of the target electronic device based on the second response message received from the IoT server 1002 and receive a second user input. . For example, referring to FIG. 11 , the electronic device 1001 displays a second UI 1110 indicating that a device of the same type exists in the area of the searched (or selected) target electronic device on the fifth screen 1101 of the display. ) can be printed.

When a user input requesting to continue the registration procedure of the target electronic device (eg, 'YES' of the second UI 1110) is received, in operation 1025, the electronic device 1001 sends a third registration request message to the IoT server (1002) can be transmitted. The third registration request message may include, for example, information that is at least partially identical to that of the second registration request message.

In operation 1030 , the IoT server 1002 may determine a priority for a cloud control function and an IR control function among functions of the target electronic device. According to an embodiment, the IoT server 1002 may determine a priority based on at least one of a user's setting of the electronic device 1001 , a user's preference, or a use history. According to an embodiment, the priority of the IR control function may be set higher than the priority of the cloud control function. For example, the user may set the IR control function to be preferentially used as a method for controlling the function of the target electronic device registered as the cloud control function. When the priority is determined, the IoT server 1002 may register the found target electronic device as an IR control target device, and transmit a message indicating that registration of the IR control target device is completed in operation 1035 .

12 illustrates a user interface for controlling a target electronic device according to various embodiments of the present disclosure; If the configuration of the application screen 1200 shown in FIG. 12 is only an example, the number, function, device type, and/or arrangement order of target electronic devices included in the application screen 1200 may be changed.

Even if the target electronic device (eg, the target electronic device 350 of FIG. 3 ) is registered as an IR control target device, the electronic device (eg, the electronic device 330 of FIG. 3 ) may enable the target electronic device to support the cloud control function. By providing a user interface indicating that there is, it is possible to provide a control environment suitable for the user.

Referring to FIG. 12 , the electronic device may output an application screen 1200 for controlling target electronic devices included in the IoT environment through the display. The application screen 1200 may include graphic user interfaces (GUIs) 1201 , 1202 , 1203 , and 1204 indicating information on a plurality of target electronic devices. When a user input for selecting one of the plurality of

GUIs

1201, 1202, 1203, and 1204 is received, the electronic device displays a control screen of the target electronic device corresponding to the selected GUI (eg, 1210, 1220, 1230, or 1240) can provide

In an embodiment, the

GUIs

1201 , 1202 , 1203 , and 1204 included in the application screen 1200 may indicate control functions supported by the target electronic device. For example, the first GUI 1201 may indicate that the target electronic device (eg, a fan) supports an IR control function. As another example, the second GUI 1202 may indicate that the target electronic device (eg, air conditioner) supports both an IR control function and a cloud control function (eg, OCF).

In an embodiment, the application screen 1200 may further include a GUI 1205 for an IR device (eg, an AI speaker) to control the target electronic device through an IR control function. For example, when the user controls a target electronic device (eg, a fan) that supports only the IR control function through an IR device (eg, an AI speaker), the IoT server 310 is an IR device (eg, an AI speaker) can request to transmit a signal to control a target electronic device (eg, a fan) that supports only the IR control function.

According to an embodiment, the display of the electronic device (eg, the display module 160 of FIG. 1 ) may include a rollable or foldable display. The electronic device may display a user interface (eg, the application screen 1200) differently based on a rollable or foldable state of the display. For example, in a state in which the display of the electronic device is rolled or folded (eg, the display area of the display is visually reduced when the user looks at it), the application screen including the

GUIs

1201 , 1202 , 1203 , and 1204 . Only (1200) can be displayed. As another example, in a state in which the display of the electronic device is unfolded (eg, a state in which the display area of the display is visually enlarged when the user looks at it), the application screen 1200 including the

GUIs

1201 , 1202 , 1203 , and 1204 . ) and/or at least one of control screens (eg, 1210 , 1220 , 1230 , or 1240 ) of the target electronic device corresponding to the

GUIs

1201 , 1202 , 1203 , and 1204 may be displayed.

13 to 15 illustrate an operation for controlling a target electronic device according to various embodiments of the present disclosure. 13 to 15 exemplify an operation of controlling a specified operation (eg, changing a channel) of the target electronic device 1304 (eg, TV) based on the cloud control function, but the device type of the target electronic device and the target electronic device Operations that may be performed are not limited to the example illustrated in FIG. 13 .

13 shows a block diagram and a flowchart for controlling a target electronic device.

Referring to FIG. 13 , the AI speaker 1301 , the voice assistance server 1302 , the IoT server 1303 , and the target electronic device 1304 are the AI speaker 340 and the voice assistance server 320 of FIG. 3 , respectively. ), the IoT server 310 , and the target electronic device 350 may perform the same or similar functions, and may include the same or similar configuration as these. According to an embodiment, the voice assistance server 1302 and the IoT server 1303 may be configured as one server.

The voice assistance server 1302 may include a voice recognition module 1304 , a language understanding module 1305 , and a utterance processing module 1306 for each function. The 'modules' included in the voice assistance server 1302 may include hardware or software. For example, the modules included in the voice assistance server 1302 may be a part of the model 234 stored in the storage 233 of FIG. 2 , or may be an instruction set executed by the processor 232 . .

The controller 1307, the communication interface 1309, the device DB 1308, and the program DB 1310 included in the IoT server 1303 are the processor 212, the communication interface 211 of FIG. The same or similar functions to the device DB 314 and the program DB 316 may be performed.

In an embodiment, the AI speaker 1301 may receive a voice input (eg, 'play xxx program') from the user. When the voice input is received, in operation 1320 , the AI speaker 340 may transmit the received voice input to the voice recognition module 1304 of the voice assistance server 1302 .

The voice recognition module 1304 may convert the received voice input into text data, and transmit the converted data to the language understanding module 1305 in operation 1325 . The language understanding module 1305 may analyze a natural language corresponding to the voice input through the transmitted data, and transmit the analysis result to the function-specific speech processing module 1306 in operation 1330 . The function-specific speech processing module 1306 may recognize a function intended by the natural language through pre-learned data. In operation 1335 , the function-specific speech processing module 1306 may transmit data indicated by the recognized user intention to the controller 1307 of the IoT server 1303 .

The controller 1307 may determine whether the user intent can be performed based on the received data. For example, the controller 1307 may determine whether the target electronic device 1304 indicated by the user intention exists, whether the target electronic device 1304 supports a cloud control function, or a channel corresponding to the user intention exists. . To determine whether the user intention can be performed, the controller 1307 may load data from the device DB 1308 in operation 1340 , and load data from the program DB 1310 in operation 1345 . An example of an operation of determining whether a user intention can be performed will be described later with reference to FIG. 15 . If it is determined that the user intention can be performed, the controller 1307 may transmit a command signal corresponding to the user intention to the communication interface 1309 in operation 1350 . In operation 1355 , the communication interface 1309 may transmit a command signal to the target electronic device 1304 . In one embodiment, the communication interface 1309 may transmit a command signal based on the OCF standard.

The IoT server 1303 determines whether the user intention corresponding to the voice input can be performed based on the database (eg, the device DB 1308 and the program DB 1310) stored in the IoT server 1402, so that the user intention is You can provide feedback if it cannot be done. A signal flow diagram for providing feedback is described below in FIG. 14 .

14 shows a signal flow diagram for processing a channel change command.

Referring to FIG. 14 , in response to a user input (eg, voice input), in operation 1405 , the AI speaker 1401 (eg, the AI speaker 1301 of FIG. 13 ) sends a channel change command to the IoT server 1402 ( Example: It can be transmitted to the IoT server 1303 of FIG. 13 ). For example, the channel change command may be transmitted to the IoT server 1402 based on the method shown in FIG. 13 .

14 shows an embodiment in which the AI speaker 1401 transmits a channel change command based on a voice input, but according to other embodiments, the channel change command is transmitted to an electronic device such as a smartphone (eg, 330 in FIG. 3 ) may be transmitted to the IoT server 1402 through For example, the electronic device receives a user's voice input requesting a channel change or receives a touch input through a GUI (eg, 1240 in FIG. 12 ), and sends a channel change command corresponding to the received input to the IoT server 1402 ) can be passed as The electronic device may transmit the channel change command directly to the IoT server 1402 or through the AI speaker 1402 or a voice assistant server (eg, 320 in FIG. 3 ).

In operation 1410 , the IoT server 1402 may process the received command. For example, the IoT server 1402 may process a command based on the operation of the controller 1307 shown in FIG. 13 .

If it is determined that the channel change command cannot be performed, in operation 1415 , the IoT server 1402 may transmit a feedback message to the AI speaker 1401 . The feedback message may indicate, for example, that the target electronic device does not exist, that the target electronic device cannot support a cloud control function, or that a channel corresponding to a user intention does not exist. The feedback message may include, for example, voice feedback.

In another embodiment, the IoT server 1402 may transmit a feedback message to the electronic device (eg, 330 of FIG. 3 ). In this case, the IoT server 1402 may transmit a feedback message through the AI speaker 1402 or directly to the electronic device. The feedback message transmitted to the electronic device may include at least one of voice, video, vibration, and LED.

15 is a flowchart illustrating an operation of an IoT server for processing a channel change command. The operations shown in FIG. 15 may be performed by the IoT server 1303 of FIG. 13 or may be performed by the controller 1307 .

Referring to FIG. 15 , in operation 1505 , the IoT server may receive a channel change command. For example, the IoT server receives a channel change command based on a touch input from an electronic device (eg, the electronic device 330 of FIG. 3 ) or a voice assistance server (eg, the voice assistance server 320 of FIG. 3 ). A channel change command based on a voice command may be received from the electronic device (eg, the electronic device 330 of FIG. 3 ) or an AI speaker (eg, the AI speaker 1301 of FIG. 13 ).

In operation 1510, the IoT server may identify whether a target electronic device (eg, a TV) corresponding to the channel change command exists. For example, the IoT server may identify whether a device capable of performing a channel change command exists by detecting a device DB (eg, the device DB 1308 of FIG. 13 ). If the target electronic device corresponding to the channel change command does not exist, in operation 1535 , the IoT server may transmit a feedback message.

If the target electronic device corresponding to the channel change command exists, in operation 1515 , the IoT server may identify whether the target electronic device supports the cloud control function. For example, the IoT server may identify whether the target electronic device supports the cloud control function by detecting the function of the target electronic device stored in the device DB. If the target electronic device does not support the cloud control function, the IoT server may transmit a feedback message in operation 1535 .

If the target electronic device supports the cloud control function, in operation 1520 , the IoT server may identify whether a channel corresponding to the command exists. For example, by detecting the program DB (eg, the program DB 1310 of FIG. 13 ), the IoT server may identify whether a channel on which a program (eg, an xxx program) intended by the user is being broadcast exists. If there is no channel corresponding to the command, in operation 1535 , the IoT server may transmit a feedback message.

If a channel corresponding to the command exists, in operation 1525 , the IoT server may select one channel from among a plurality of channel numbers corresponding to the command. For example, the IoT server may select a channel based on at least one of a user setting or a usage history. If there is only one channel corresponding to the command, the IoT server may not perform operation 1525 .

In operation 1530, the IoT server may transmit a signal instructing to change to the selected channel to the target electronic device. According to an embodiment, when the IoT server receives a channel change command through the AI speaker, the IoT server may generate and transmit an IR signal for changing the channel of the target electronic device to the AI speaker.

As described above, the electronic device (eg, the electronic device 330 of FIG. 3 ) according to an embodiment includes at least one communication circuit (eg, the wireless communication module 192 of FIG. 1 ) and a display (eg, FIG. 1 ). of a display module 160), a processor operatively coupled to the at least one communication circuit and the display (eg, the processor 120 of FIG. 1), and a memory operatively coupled to the processor (eg, FIG. 1 memory 130), wherein, when executed, the processor receives a first user input requesting registration of an IR-controlled device, and the IR-controlled device is controlled by the IR device. means a device to be used, searches for a target electronic device using the at least one communication circuit, and identifies that the found target electronic device (eg, the target electronic device 350 of FIG. 3 ) is a cloud control target device (identify), the cloud control target device means a device controlled by an IoT server (eg, the IoT server 310 of FIG. 3 ), and a first indicating that the found target electronic device is the cloud control target device Instructions for outputting a user interface (eg, the first UI 516 of FIG. 5 ) through the display may be stored.

According to an embodiment, in the instructions, the processor transmits a first registration request message including information on the device type and manufacturer of the found target electronic device to the IoT server, and the device type of the found target electronic device and receiving a first response message indicating that the manufacturer supports the cloud control function from the IoT server, and identifying the found target electronic device as the cloud control target device based on the received first response message have.

According to an embodiment, the instructions may cause the processor to search for the target electronic device based on a Bluetooth communication protocol, and receive a data packet from the target electronic device while searching for the target electronic device. .

According to an embodiment, the instructions receive, before the processor searches for the target electronic device, a second user input for selecting a device type of the target electronic device, and determines that the device type indicated by the data packet is the It is possible to identify whether the device type is the same as the device type selected by the second user input, and determine whether the found target electronic device is a control target device based on a command included in the data packet.

According to an embodiment, the instructions transmit, before the processor searches for the target electronic device, an IR signal including a specified command, and the command included in the data packet is included in the IR signal. It is possible to determine whether the found target electronic device is the control target device based on whether a specified command and at least a part thereof are identical to each other.

According to an embodiment, the instructions include, when the processor receives a third user input requesting to register the searched target electronic device as the IR control target device while the first UI is output, the searched target electronic device If a procedure for registering a device as the IR control target device is performed, and the third user input is not received while the first UI is output, the searched target electronic device can be registered as the cloud control target device have.

According to an embodiment, the instructions include information on a device type of the found target electronic device and a region in which the target electronic device is located in order for the processor to perform a procedure for registering the IR control target device A second registration request message is transmitted to the IoT server, and a second response message indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located is transmitted to the IoT server and a second UI indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located (eg, the second UI 1110 of FIG. 11 ) may be output through the display.

According to an embodiment, the instructions include: receiving, by the processor, a fourth user input requesting registration of the found target electronic device, and requesting registration of the found target electronic device while the second UI is output A third registration request message may be transmitted to the IoT server, and a message indicating that the found target electronic device is registered as the IR control target device may be received from the IoT server.

According to an embodiment, the instructions are configured by the processor in a graphical user interface (eg,

GUIs

1201 , 1202 , 1203 of FIG. 12 , or 1204)) may be output through the display.

According to an embodiment, the electronic device further includes a microphone configured to receive a voice input, and the instructions include: the processor obtains a voice input for requesting a channel change of the target electronic device through the microphone; A channel change command corresponding to the acquired voice input may be transmitted to the IoT server, and a feedback message for the channel change command may be received from the IoT server.

A server (eg, the IoT server 310 of FIG. 3 ) included in the IoT environment according to an embodiment disclosed in this document is a communication interface configured to communicate with an electronic device (eg, the electronic device 330 of FIG. 3 ). (eg, communication interface 211 of FIG. 2 ), a processor operatively coupled with the communication interface (eg, processor 212 of FIG. 2 ), and a memory operatively coupled with the processor (eg, storage of FIG. 2 ) unit 213), wherein the memory stores a database for a target electronic device (eg, the target electronic device 350 of FIG. 3 ) registered as a cloud control target device in the server, the processor comprising: A first registration request message for requesting registration of the target electronic device found by the electronic device as an IR control target device is received from the electronic device, and the first registration request message includes a device type and a manufacturer of the found target electronic device. , a model name and information on at least one of a unique identifier (UID), and based on the information included in the first registration request message and the database stored in the memory, identifying that the found target electronic device is a cloud control target device and a first response message indicating that the found target electronic device is the cloud control target device may be configured to be transmitted to the electronic device.

According to an embodiment, after transmitting the first response message, the processor receives a second registration request message requesting registration of the found target electronic device from the electronic device, and the second registration request message includes information on the device type, manufacturer, and location of the searched target electronic device, and an area in which the searched target electronic device is located based on information included in the second registration request message and a database stored in the memory It is identified that a device having the same device type as the found target electronic device exists in the same area as the detected target electronic device, and a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located. It may be configured to transmit the indicated second response message to the electronic device.

According to an embodiment, after transmitting the second response message, the processor receives a third registration request message requesting registration of the found target electronic device from the electronic device, and Priority of the cloud control function and the IR control function may be determined among functions, and a message indicating that the found target electronic device is registered as the IR control target device may be configured to be transmitted to the electronic device.

According to an embodiment, the processor receives a channel change command for the target electronic device, and based on the received channel change command and a database stored in the memory, the target electronic device corresponding to the channel change command It may be configured to identify whether there exists, to identify whether a target electronic device corresponding to the channel change command supports the cloud control function, and to identify whether a channel corresponding to the channel change command exists.

According to an embodiment of the present disclosure, the processor may be configured to be configured to be configured to be configured to be configured such that a target electronic device corresponding to the channel change command does not exist, a target electronic device corresponding to the channel change command does not support the cloud control function, or the channel change command If there is no channel corresponding to , it may be configured to transmit a feedback message.

The method of the electronic device (eg, the electronic device 330 of FIG. 3 ) according to an embodiment disclosed in this document includes an operation (eg, the electronic device 330 of FIG. 3 ) of receiving a first user input requesting registration of an IR control target device (eg, of FIG. 4 ) In operation 410), the IR control target device refers to a device controlled by an IR device, and searching for a target electronic device (eg, operation 420 in FIG. 4 ) is performed when the searched target electronic device is cloud-controlled In an operation of identifying a target device (eg, operation 430 of FIG. 4 ), the cloud control target device refers to a device controlled by an IoT server, and a first indicating that the found target electronic device is the cloud control target device It may include an operation of outputting a user interface (eg, operation 440 of FIG. 4 ).

According to an embodiment, the identifying that the found target electronic device is the cloud control target device includes transmitting a first registration request message including information on the device type and manufacturer of the found target electronic device to the IoT server. operation (eg, operation 705 of FIG. 7 ), and an operation of receiving a first response message indicating that the device type and manufacturer of the found target electronic device support the cloud control function from the IoT server (eg, operation of FIG. 7 ) 715), and identifying that the found target electronic device is the cloud control target device based on the received first response message.

According to an embodiment, the searching for the target electronic device includes searching for the target electronic device based on a Bluetooth communication protocol and receiving a data packet from the target electronic device, Before searching for a device, transmitting an IR signal including a specified command (eg, operation 810 in FIG. 8 ), and the command included in the data packet is at least a portion of the specified command included in the IR signal The method may further include an operation (eg, operation 840 of FIG. 8 ) of determining whether the found target electronic device is a control target device based on whether .

According to an embodiment, when receiving a second user input requesting registration of the found target electronic device as the IR control target device while the first UI is output, the method sets the searched target electronic device to the IR The method further comprising performing a procedure for registering as a control target device, wherein performing the procedure for registering the found target electronic device as the IR control target device includes: a device type of the found target electronic device and the target An operation of transmitting a second registration request message including information on an area in which the electronic device is located to the IoT server (eg, operation 1005 of FIG. 10 ), the searched target in the same area as the area in which the electronic device is located An operation of receiving a second response message indicating that a device having the same device type as that of the electronic device exists from the IoT server (eg, operation 1015 of FIG. 10 ), in the same area as the area in which the searched target electronic device is located Outputting a second UI indicating that a device having the same device type as the target electronic device exists, and receiving a third user input requesting registration of the found target electronic device while the second UI is output , an operation of transmitting a third registration request message requesting registration of the found target electronic device to the IoT server (eg, operation 1025 of FIG. 10 ), and indicating that the found target electronic device is registered as the IR control target device It may include an operation of receiving a message from the IoT server (eg, operation 1035 of FIG. 10 ).

According to an embodiment, the method may further include outputting a graphic user interface indicating that the registered target electronic device is the IR control target device and the cloud control target device.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims

In an electronic device,

at least one communication circuit;

display;

a processor operatively coupled to the at least one communication circuit and the display; and

a memory operatively coupled to the processor, wherein the memory, when executed, causes the processor to:

Receives a first user input requesting registration of an IR (infrared) control target device, the IR control target device means a device controlled by the IR device,

searching for a target electronic device using the at least one communication circuit;

Identifies that the found target electronic device is a cloud control target device, and the cloud control target device means a device controlled by an IoT server (internet of things), and

and storing instructions for outputting a first user interface (UI) indicating that the found target electronic device is the cloud control target device through the display.
The method according to claim 1, wherein the instructions are performed by the processor,

Transmitting a first registration request message including information on the device type and manufacturer of the searched target electronic device to the IoT server,

receiving, from the IoT server, a first response message indicating that the device type and manufacturer of the found target electronic device support the cloud control function; and

and to identify that the found target electronic device is the cloud control target device based on the received first response message.
The method according to claim 1, wherein the instructions are performed by the processor,

searching for the target electronic device based on a Bluetooth communication protocol, and

receive a data packet from the target electronic device while searching for the target electronic device.
The method according to claim 3, wherein the instructions are performed by the processor,

receiving a second user input for selecting a device type of the target electronic device before searching for the target electronic device;

identify whether the device type indicated by the data packet is the same as the device type selected by the second user input; and

and determine whether the found target electronic device is a control target device based on a command included in the data packet.
The method according to claim 4, wherein the instructions are performed by the processor,

Before searching for the target electronic device, transmit an IR signal including a specified command,

and determine whether the found target electronic device is the control target device based on whether the command included in the data packet is at least partially identical to the specified command included in the IR signal.
The method according to claim 1, wherein the instructions are performed by the processor,

When a third user input requesting to register the found target electronic device as the IR control target device is received while the first UI is output, a procedure for registering the found target electronic device as the IR control target device is performed. do,

and register the searched target electronic device as the cloud control target device when the third user input is not received while the first UI is output.
The method according to claim 6, wherein the instructions are for the processor to perform a procedure for registering as the IR control target device,

transmitting a second registration request message including information on a device type of the found target electronic device and an area in which the target electronic device is located to the IoT server;

receiving a second response message from the IoT server indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located; and

and outputting, through the display, a second UI indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located.
The method according to claim 7, wherein the instructions are performed by the processor,

receiving a fourth user input requesting registration of the searched target electronic device while the second UI is output;

transmitting a third registration request message requesting registration of the found target electronic device to the IoT server,

and receiving a message indicating that the found target electronic device is registered as the IR control target device from the IoT server.
The method of claim 8, wherein the instructions are performed by the processor,

and outputting a graphic user interface (GUI) indicating that the registered target electronic device is the IR control target device and the cloud control target device through the display.
The method according to claim 1,

a microphone configured to receive voice input;

The instructions cause the processor to

obtaining a voice input requesting a channel change of the target electronic device through the microphone;

transmitting a channel change command corresponding to the obtained voice input to the IoT server, and

to receive a feedback message for the channel change command from the IoT server.
A method for an electronic device, comprising:

receiving a first user input requesting registration of an IR (infrared) control target device, wherein the IR control target device means a device controlled by the IR device;

searching for a target electronic device;

identifying that the found target electronic device is a cloud control target device, wherein the cloud control target device means a device controlled by an IoT server (internet of things); and

and outputting a first user interface (UI) indicating that the found target electronic device is the cloud control target device.
The method of claim 11 , wherein the identifying that the found target electronic device is the cloud control target device comprises:

transmitting a first registration request message including information on a device type and a manufacturer of the found target electronic device to the IoT server;

receiving, from the IoT server, a first response message indicating that a device type and a manufacturer of the found target electronic device support the cloud control function; and

and identifying that the found target electronic device is the cloud control target device based on the received first response message.
The method of claim 11 , wherein the searching for the target electronic device comprises:

searching for the target electronic device based on a Bluetooth communication protocol; and

receiving a data packet from the target electronic device;

transmitting an IR signal including a specified command before searching for the target electronic device; and

The method further comprising determining whether the found target electronic device is a control target device based on whether the command included in the data packet is at least partially identical to the specified command included in the IR signal.
12. The method of claim 11,

When a second user input requesting to register the found target electronic device as the IR control target device is received while the first UI is output, a procedure for registering the found target electronic device as the IR control target device is performed. Further comprising an action to perform,

The operation of performing a procedure for registering the found target electronic device as the IR control target device includes:

transmitting a second registration request message including information on a device type of the found target electronic device and an area in which the target electronic device is located to the IoT server;

receiving, from the IoT server, a second response message indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located;

outputting a second UI indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located;

receiving a third user input requesting registration of the found target electronic device while the second UI is output;

transmitting a third registration request message requesting registration of the found target electronic device to the IoT server; and

and receiving, from the IoT server, a message indicating that the found target electronic device is registered as the IR control target device.
15. The method of claim 14,

and outputting a graphic user interface (GUI) indicating that the registered target electronic device is the IR control target device and the cloud control target device.