KR20200085603A - the Electronic Device Controlling the Internet-of-Thing Device and the Method for Controlling the Internet-of-Thing Device - Google Patents

Abstract

An electronic device includes: an electromagnetic (EM) sensing circuit receiving an EM signal of at least one IoT device; a communication circuit capable of communicating with an external device; a memory storing a database on the at least one IoT device; and a processor operatively connected to the EM sensing circuit, the communication circuit, and the memory. The processor forms a communication channel with an external network device through the communication circuit and checks whether an EM service is available with respect to the at least one IoT device connected to the network device through the communication channel. The processor can be set such that, in a case where the EM service is available, the processor acquires authority related to controlling the at least one IoT device from the network device or an external server, receives from the network device or the external server a list of devices that can be controlled by the authority or analysis information related to the recognition of the EM signal, uses the EM sensing circuit to recognize the at least one IoT device based on the device list or the analysis information, and executes a function corresponding to the scope of the authority by using the at least one recognized IoT device. In addition, various embodiments identified through the specification are possible.

Description

The electronic device controlling the Internet-of-Thing Device and the Method for Controlling the Internet-of-Thing Device

Various embodiments disclosed in this document relate to an electronic device that controls an IoT device and a control method of the Internet of Things device.

Devices in TVs, refrigerators, or speakers can emit their own electromagnetic (EM) signals. The EM signal may have a unique waveform depending on the device type or model name. Using the EM signal, it may be possible to identify the device that generated the EM signal. For example, products included in the same product group manufactured by the same manufacturer may generate the same EM signal for each model. The electronic device recognizing the device may recognize the model name of each electronic device by using the EM signal generated from each device, and may control the device based on the recognized information.

When the electronic device recognizes a nearby internet-of-thing (hereinafter referred to as IoT) device using the EM signal, in the state in which the device corresponding to the EM signal is previously registered in the IoT server operated based on the user account, Related services can be provided. When a user moves to another place (for example, a hotel or a pension), the surrounding IoT device may be registered as another user's account, and in this case, the electronic device does not control the surrounding IoT device through an EM signal. Can't.

An electronic device according to an embodiment disclosed in the present disclosure includes an EM sensing circuit that receives an electromagnetic (EM) signal of at least one IoT device, a communication circuit capable of communicating with an external device, and the at least one IoT device And a memory for storing a database relating to the EM sensing circuit, the communication circuit, and a processor operatively connected to the memory, wherein the processor forms a communication channel with an external network device through the communication circuit, Through the communication channel, it is checked whether or not an EM service is possible for the at least one IoT device connected to the network device, and when the EM service is enabled, the at least one IoT device is provided from the network device or an external server. Obtaining authority regarding control, receiving a list of devices controllable by the authority from the network device or the external server, or analysis information related to the recognition of the EM signal, and using the EM sensing circuit, the list of devices Alternatively, it may be set to recognize the at least one IoT device based on the analysis information, and to execute a function corresponding to the scope of the authority, by using the recognized at least one IoT device.

An electronic device according to various embodiments disclosed in the present document may allow a user to recognize an IoT device using an EM signal in a new location, and control the IoT device based on another communication method based on the recognized information. In this case, the electronic device can quickly and rapidly control the surrounding IoT devices without a separate registration process.

The electronic device according to various embodiments disclosed in the present disclosure may authenticate a user through a network device and grant authority regarding control of the IoT device in a preset range or a range granted by an administrator of the network device.

The electronic device according to various embodiments disclosed in the present disclosure may receive analysis information corresponding to an authority to be granted, so that the recognition and control of IoT devices in the vicinity using the EM signal can be rapidly processed. In addition, various effects that can be directly or indirectly identified through this document may be provided.

1 illustrates an IoT management system according to various embodiments.
2 is a block diagram of a control electronic device according to various embodiments of the present disclosure.
3 is a configuration diagram illustrating a procedure of identifying nearby IoT devices using a control electronic device according to various embodiments of the present disclosure.
4 is a configuration diagram of an EM sensing circuit in accordance with various embodiments.
5 is a flowchart illustrating a method of controlling an IoT device according to various embodiments of the present disclosure.
6 is a signal flow diagram of an IoT control method according to various embodiments.
7 illustrates a method of controlling an IoT device using email according to various embodiments.
8 illustrates a device recognition method based on a device list according to various embodiments.
9 illustrates a device recognition method using an optimization model according to various embodiments.
10 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, an electronic device according to various embodiments of the present disclosure will be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

1 illustrates an IoT management system according to various embodiments.

Referring to FIG. 1, the IoT system 100 includes an IoT server 101, a network device 102, a control electronic device 103, at least one IoT device 104, a master device 105 and a network 106 It may include. The IoT server 101, the network device 102, the control electronic device 103, the at least one IoT device 104, and the master device 105 may transmit and receive data to and from each other through the network 106.

The IoT server 101 may store various information necessary for managing at least one IoT device 104. The IoT server 101 performs an operation required to manage the at least one IoT device 104 according to a request signal of the network device 102, the control electronic device 103 or the at least one IoT device 104, The result of the calculation can be provided to the device that has transmitted the request signal. For example, the IoT server 101 may be an IoT cloud server (eg, Samsung Connect server).

According to an embodiment, the IoT server 101 may store user account information and information on EM signals generated in each of the at least one IoT device 104 as a database 141a. The IoT server 101 is based on information transmitted from the control electronic device 103 or the network device 102 or information provided from an external device managed by the manufacturer, and information related to the recognition of the EM signal (eg, sampling Data or an analysis engine) and at least one IoT device 104. For example, the IoT server 101 may include a profile (eg, a model name, or a communication connection method) of each of the at least one IoT device 104 registered through an EM signal according to a user's account, at least one IoT device 104 ), and/or AP (access point) (eg, network device 102) information to which the IoT device 104 is connected may be stored.

According to various embodiments, the IoT server 101 may provide an EM service based on a registered user account. In the EM service, the control electronic device 103 recognizes at least one or more IoT devices 104 in the vicinity through an EM signal, and functions designated through the recognized IoT device 104 (for example, playing music through a speaker device) Or, it may be a service that provides an environment for controlling to execute). The IoT server 101 may store and link at least one IoT device 104 in advance based on a user account. When the device corresponding to the EM signal is previously registered in the IoT server 101 operated based on the user account, the user can use the EM service.

According to various embodiments, the IoT server 101 may store a list (hereinafter, a device list) of at least one IoT device 104 connected to the network device 102. For example, the device list may be collected through the control electronic device 103.

The control electronic device 103 may receive EM signals of at least one IoT device 104 included in a network space covered by the network device 102 and analyze the received EM signals. The control electronic device 103 may transmit the analyzed information to the IoT server 101. The IoT server 101 may store and store the device list and the received information. For example, the IoT server 101 may include identification information of each IoT device 104 connected to the network device 102 (eg, a model name) and analysis information of EM signals or EM signals of each device (eg, a sampling method) , Analysis engine or discriminant model).

The network device 102 may be a device that connects a network of a peripheral device and an external device (for example, the IoT server 101) through short-range wireless communication or wired communication in a designated space. Short-range wireless communication includes, for example, wireless fidelity (Wi-Fi), Wi-Fi Direct, light fidelity (Li-Fi), Bluetooth, Bluetooth low energy (BLE), Zigbee, near field communication (NFC), and MST ( magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). Wired communication may include, for example, a local area network (LAN), power line communication, or plain old telephone service (POTS). For example, the network device 102 may be an AP device for Wi-Fi communication. For another example, network device 102 may be a router for an Internet connection.

The control electronic device 103 may be a device that controls at least one IoT device 104 according to a set authority. The control electronic device 103 may display a user interface for controlling the at least one IoT device 104 through a display. The control electronic device 103 may transmit a control signal for controlling the at least one IoT device 104 to the at least one IoT device 104 in response to a user input. The control signal may be transmitted through direct communication between the control electronic device 103 and the at least one IoT device 104, or may be transmitted through the network device 102 or the IoT server 101. For example, the control electronic device 103 may be a smart phone or a tablet PC device.

According to various embodiments, the control electronic device 103 may recognize the at least one IoT device 104 using a unique EM signal generated from each of the at least one IoT device 104. At least one IoT device 104 may generate EM signals, each having a unique frequency. When the control electronic device 103 approaches the at least one IoT device 104 within a specified distance (eg, about 5 cm), the control electronic device 103 may collect an EM signal through an antenna and a sensing circuit.

According to various embodiments of the present disclosure, the control electronic device 103 may obtain authority for controlling the at least one IoT device 104 from other control devices based on user account information. For example, another control electronic device (hereinafter referred to as master device 105) registered with the first user's account is EM for at least one IoT device 104 disposed in a space covered by the network device 102. It may be a device capable of registering a signal and controlling at least one IoT device 104 without limitation of authority. The IoT server 101 includes user account information of the master device 105, identification information of the network device 102, a list of at least one registered IoT device 104, and related information (eg, model name, or communication connection method) Can be stored in the database.

The control electronic device 103 registered as the account of the second user acquires control authority for at least one IoT device 104 disposed in a space covered by the network device 102, and then, according to the authority, the IoT device It may be a guest device capable of controlling the 104. The control electronic device 103 acquires the control authority from the IoT server 101 or the master device 105 while establishing a communication channel with the network device 102 to control the at least one IoT device 104. Can. The control electronic device 103 may control at least one IoT device 104 to the extent permitted by the control authority. When the communication channel between the control electronic device 103 and the network device 102 ends, the control electronic device 103 may lose the control authority.

According to various embodiments, the control electronic device 103 or the network device 102 may transmit the location information of the control electronic device 103 or the network device 102 to the IoT server 101. The IoT server 101 may allow the control authority when the location information matches information stored in the database.

In one embodiment, the control authority may be defined together with user account information of the master device 105 registered in the IoT server 101, or may be defined through setting through a user interface displayed on the master device 105. .

Hereinafter, a discussion will be mainly focused on the case where the control electronic device 103 is a device that receives and controls the control of the IoT device 104, but is not limited thereto.

According to various embodiments, the master device 105 is based on the EM signal generated by the at least one IoT device 104 before the control electronic device 103 establishes a communication channel with the network device 102, At least one IoT device 104 may be registered with the EM service. The master device 105 may transmit an analysis result of the EM signal sensed by at least a part of the at least one IoT device 104 to the IoT server 101. According to an embodiment, when there are a plurality of IoT servers 101, the master device 105 may determine the IoT server 101 to deliver the analysis result of the EM signal.

According to an embodiment, the control electronic device 103 or the master device 105 may determine the IoT server 101 to deliver the analysis result of the EM signal based on the information of the running application. For example, when the Samsung Pay application is running on the master device 105, the master device 105 may transmit the received EM signal analysis result to the Samsung Pay server.

According to another embodiment, the control electronic device 103 or the master device 105 analyzes the EM signal based on the location information of the control electronic device 103 or the master device 105 and information obtained from the peripheral device. You can decide which server will deliver the results. For example, if the master device 105 is connected to an AP used at home, information can be transmitted to a Samsung Connect server, and if it is located in a shopping mall as a result of determination based on a GPS signal, information can be transferred to a Samsung Pay server. Can.

At least one IoT device 104 may be connected to the network device 102 through wireless or wired communication. The at least one IoT device 104 may be controlled by the control electronic device 103 or the master device 105 that has obtained control authority. According to various embodiments, the at least one IoT device 104 may each generate a unique EM signal. The at least one IoT device 104 may include various electronic components therein, and may generate EM signals of various frequencies due to electromagnetic interference (EMI) generated from the electronic components. have.

2 is a block diagram of a control electronic device according to various embodiments of the present disclosure. 2 is exemplary and is not limited thereto.

2, the control electronic device 103 may include a processor 120, a display 160, a memory 170, a communication circuit 190, and an EM sensing circuit 200, respectively. According to various embodiments, the master device 105 of FIG. 1 may have the same or similar configuration to the control electronic device 103.

The processor 120 may be operably connected to the display 160, the communication circuit 190, and the EM sensing circuit 200. The processor 120 may perform an operation necessary for the operation of the control electronic device 103.

According to various embodiments, the processor 120 transmits information (hereinafter, device recognition information) generated based on the EM signal detected by the EM sensing circuit 200 to the IoT server 101 through the communication circuit 190. Can be controlled.

The display 160 may display content according to the operation of the control electronic device 103. According to various embodiments, the display 160 may display a user interface required for controlling at least one IoT device 201 and 202.

The memory 170 may store various information necessary for the operation of the control electronic device 103. In one embodiment, the memory 170 may store a device list of at least one IoT device 104, EM signal characteristics, or analysis information of an EM signal (eg, a sampling method, an analysis engine, or a discrimination model).

The communication circuit 190 may transmit information possessed by the control electronic device 103 to the server (eg, the IoT server 101) through the network 106. The communication circuit 190 may transmit the EM signal and related information received by the EM sensing circuit 200 to the IoT server 101 and receive a result.

The EM sensing circuit 200 may detect an electromagnetic (EM) signal generated by at least one IoT device (eg, the first IoT device 201 and the second IoT device 202). According to an embodiment, the EM sensing circuit 200 may generate device recognition information based on the EM signal. For example, the device identification information may include information on the waveform of the EM signal and information on a profile (eg, model name, or communication connection method) of at least one IoT device 201 and 202 that emits the EM signal. have.

For example, the EM sensing circuit 200 receives the first EM signal EM1 from the first IoT device 201, and uses the amplitude and phase of the waveform of the first EM signal EM1 to first EM signal It is possible to generate device recognition information regarding (EM1). The EM sensing circuit 200 may provide device recognition information regarding the first EM signal EM1 to the processor 120. The EM sensing circuit 200 receives the second EM signal EM2 from the second IoT device 202, and uses the amplitude and phase of the waveform of the second EM signal EM2 to the second EM signal EM2. Device identification information about the device. The EM sensing circuit 200 may provide device identification information regarding the second EM signal EM2 to the processor 120.

For another example, the EM sensing circuit 200 may detect the EM signal and generate detection information. The EM sensing circuit 200 may provide detection information to the processor 120. The processor 120 may generate device recognition information using the detection information. For example, the device identification information may include information on the waveform of the EM signal and information on a profile (eg, model name, or communication connection method) of at least one IoT device 201 and 202 that emits the EM signal. have.

According to an embodiment, the processor 120 may transmit device identification information to the IoT server 101. The processor 120 may receive the analyzed information from the IoT server 101. For example, the processor 120 may provide information regarding the profile (eg, model name, or communication connection method) of the IoT devices 201 and 202, and information regarding the operation status and command execution function of the IoT devices 201 and 202. I can receive it. According to another embodiment, the processor 120 analyzes the device recognition information from the inside of the control electronic device 103, and information on the profile (eg, model name or communication connection method) of the IoT devices 201 and 202 , It is also possible to analyze information on the operation status and command execution function of the IoT devices 201 and 202.

3 is a configuration diagram illustrating a procedure of identifying nearby IoT devices using a control electronic device according to various embodiments of the present disclosure. 3 is exemplary and is not limited thereto.

Referring to FIG. 3, IoT devices 201, 202, 203, or 204 may be disposed around the control electronic device 103. For example, such IoT devices 201, 202, 203 or 204 may include a TV, refrigerator, Bluetooth speaker or printer. According to an embodiment, the IoT devices 201, 202, 203, or 204 may include various electronic sub-components therein. The IoT devices 201, 202, 203, or 204 can generate various frequency signals due to electromagnetic interference (EMI) generated from internal electronic components. For example, the IoT devices 201, 202, 203, or 204 may generate EM signals (eg, f1, f2, f3, or f4) each having a unique frequency. In one embodiment, the EM signal may be a signal within a frequency range of 0 to 1 MHz.

According to various embodiments of the present disclosure, when the control electronic device 103 approaches the IoT device of any one of the IoT devices 201, 202, 203, or 204, the control electronic device 103 displays the EM sensing circuit 200. Through this, it is possible to detect EM signals (eg, f1, f2, f3, or f4).

According to various embodiments, the processor 120 of the control electronic device 103 uses a machine learning (ML) method to profile (eg, model name, or communication) of the IoT devices 201, 202, 203, or 204. Connection method).

According to various embodiments of the present disclosure, the control electronic device 103 may store and store the type and model name of the IoT device according to the characteristics of EM signals of various IoT devices 201, 202, 203 or 204 in an internal memory.

According to various embodiments, the processor 120 may execute a specific application based on identification information of IoT devices 201, 202, 203, or 204. For example, when the first IoT device 201 is identified as a TV, the processor 120 may automatically execute an application related to the remote control and automatically perform a connection with the TV (communication connection method activation). . By the operation of the user bringing the control electronic device 103 close to the first IoT device 201, the control electronic device 103 may enter a stand-by state capable of controlling a TV that is an IoT device.

According to an embodiment, the EM sensing circuit 200 may provide only the detection information having the strongest reception strength among EM signals generated by the IoT devices 201, 202, 203, or 204 to the processor 120. For example, when the control electronic device 103 sets and senses the closest TV among IoT devices 201, 202, 203, or 204 in the living room as a target device, the control electronic device 103 is generated in the TV. By detecting that the intensity of the EM signal is strongest, only the EM signal generated by the TV can be sensed.

According to an embodiment, the EM sensing circuit 200 may process only the EM signals generated from IoT devices 201, 202, 203 or 204 located within a certain distance from the control electronic device 103 among the sensed EM signals. 120). The control electronic device 103 may check whether the IoT devices 201, 202, 203, or 204 are devices in the vicinity of the control electronic device 103 using short-range communication such as BLE, WiFi, or NAN. For example, the control electronic device 103 may prevent the TV in the room from being sensed by checking the location information of the TV in the living room. Accordingly, sensing and analysis efficiency can be improved by preventing input of unnecessary EM signals. Also, the accuracy of sensing the target device among the IoT devices 201, 202, 203, or 204 by the control electronic device 103 may be improved.

4 is a configuration diagram of an EM sensing circuit in accordance with various embodiments.

Referring to FIG. 4, the control electronic device 103 includes an antenna 410 and an EM sensing circuit 200 for detecting an EM signal expressed in an IoT device (eg, the first IoT device 201 in FIG. 2 ). It can contain. According to various embodiments, the master device 105 may have the same or similar configuration to the control electronic device 103. According to one embodiment, the processor 120 of the control electronic device 103 uses the detection information provided from the EM sensing circuit 200 to surrounding IoT devices (eg, the first IoT device 201 in FIG. 2 ). Can be identified.

According to various embodiments, the EM sensing circuit 200 includes a transimpedance amplifier (TIA) 210 (eg, a transimpedance amplifier), a band pass filter (BPF) 220 (a band pass filter), and a variable gain amplifier (VGA). 230 (eg, a variable gain amplifier), an analog digital converter (ADC) 240 and a micro controller unit (MCU) 250.

According to an embodiment, the antenna 410 may collect EM signals generated from nearby IoT devices (eg, the first IoT device 201 of FIG. 2 ). The TIA 210 may amplify the EM signal received from the antenna 410. According to one embodiment, the BPF 220 may filter the signal amplified and received from the TIA 210 around a specific frequency of interest defining a characteristic pattern. According to an embodiment, the VGA 230 may output a signal at a constant level over a preset gain range in order to improve the noise characteristic of the filtered signal and the external interference signal cancellation characteristic. According to an embodiment, the ADC 240 may convert an analog signal provided from the VGA 230 into a digital signal and provide it to the MCU 250.

According to an embodiment, the MCU 250 may compare the frequency table stored in the memory (eg, the memory 170 of FIG. 2) using the EM signal. The MCU 250 may identify the IoT device (eg, the first IoT device 201 in FIG. 2) based on the comparison and provide the identified device recognition information to the processor 120.

According to another embodiment, the MCU 250 may provide the EM signal (detection information) to the processor 120 without additional analysis. The processor 120 may compare the frequency table stored in the memory using the EM signal. The processor 120 may identify the IoT device (eg, the first IoT device 201 in FIG. 2) based on the comparison. According to an embodiment, the processor 120 of the control electronic device 103 may identify the target device using the detection information provided from the EM sensing circuit 200. According to another embodiment, the processor 120 may transmit the detection information generated in the target device to the IoT server (eg, the IoT server 101 of FIG. 1 ), and analyze it through the IoT server 101.

5 is a flowchart illustrating a method of controlling an IoT device according to various embodiments of the present disclosure.

Referring to FIG. 5, in operation 510, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. Short-range wireless communication includes, for example, wireless fidelity (Wi-Fi), Wi-Fi Direct, light fidelity (Li-Fi), Bluetooth, Bluetooth low energy (BLE), Zigbee, near field communication (NFC), and MST ( magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). Wired communication may include, for example, a local area network (LAN), power line communication, or plain old telephone service (POTS).

For example, the network device 102 may be an AP device for Wi-Fi communication. For another example, network device 102 may be a router for an Internet connection.

In operation 520, the control electronic device 103 communicates with the network device 102 to emulate at least one IoT device connected to the network device 102 (eg, the first IoT device 201 in FIG. 2 ). Service availability can be checked. In the EM service, the control electronic device 103 recognizes the surrounding IoT device (eg, the first IoT device 201 in FIG. 2) based on the EM signal, and the recognized IoT device (eg, the first IoT in FIG. 2 ). It may be a service that controls the device 201 to execute a designated function.

For example, the control electronic device 103 may transmit a request signal to the network device 102 as to whether the EM service is supported. The network device 102 may check the authentication information included in the request signal and, if the authentication information is valid, transmit a response signal indicating that EM service support is possible.

For another example, the network device 102 may generate a broadcast signal or a beacon signal indicating that EM service is possible. The control electronic device 103 may transmit a request signal for starting an EM service to the network device 102 in response to a broadcast signal or a beacon signal generated from the network device 102. The network device 102 may check the authentication information included in the request signal and, if the authentication information is valid, transmit a response signal indicating that EM service support is possible.

In operation 530, when the EM service is enabled, the control electronic device 103 is authorized to control the IoT device (eg, the first IoT device 201 in FIG. 2) from the network device 102 or the IoT server 101. Can be obtained.

According to various embodiments, the control electronic device 103 may set user account information (eg, ID and password) preset in order to obtain the authority of the EM service in the network space covered by the network device 102 (hereinafter, a guest) Account information). The control electronic device 103 transmits user account information to the network device 102 and obtains authority regarding control of the IoT device (eg, the first IoT device 201 in FIG. 2) through a designated authentication process. Can. In one embodiment, guest account information may be set by the network device 102 or the master device 105 in FIG. 1.

According to various embodiments, in operation 535, a list of devices controllable by the authority or analysis information related to the recognition of the EM signal may be received. The device list may include identification information (eg, a model name) of the IoT device (eg, the first IoT device 201 in FIG. 2) that can be controlled by authority. The device list may additionally store installation information, setting information, installation location, or communication method of the IoT device (eg, the first IoT device 201 in FIG. 2 ).

The analysis information related to the recognition of the EM signal may include an EM signal characteristic or an analysis model of the EM signal (eg, a sampling method, an analysis engine or an analysis program).

According to an embodiment, the analysis information may include information on resources used for analysis of the EM signal. The control electronic device 103 may obtain information on a resource for providing EM service based on the obtained authority. The resource information may include logic for processing a received EM signal or selection of a classifier optimized for a specific IoT device, or information related to an application associated with a specific IoT device.

According to various embodiments, the analysis information may be stored and managed in the IoT server 101 or the network device 102. For example, the analysis information calculated by the master device 105 may be transmitted to the IoT server 101, and the IoT server 101 may store analysis information in the internal memory or transmit it to the network device 102 Can be saved.

In operation 540, the control electronic device 103 may recognize the IoT device (eg, the first IoT device 201 in FIG. 2) based on the device list or analysis information using the EM sensing circuit 200. . For example, when the user places the control electronic device 103 and the IoT device (for example, the first IoT device 201 in FIG. 2) adjacently (for example, within about 5 cm), the control electronic device 103 The EM sensing circuit 200 may detect an EM signal generated from an IoT device (eg, the first IoT device 201 of FIG. 2 ).

The control electronic device 103 may process the EM signal generated from the IoT device (eg, the first IoT device 201 in FIG. 2) based on the received device list or analysis information, thereby increasing recognition speed and accuracy. . For example, the control electronic device 103 may increase the recognition speed by processing only the EM signal corresponding to the device included in the device list. For another example, the control electronic device 103 may recognize the IoT device (eg, the first IoT device 201 in FIG. 2) by executing a discrimination model included in the analysis information. The control electronic device 103 may select a classifier according to the discrimination model and select logic to process the EM signal.

In operation 550, the control electronic device 103 may execute a function corresponding to the range of the obtained authority, using the recognized IoT device (eg, the first IoT device 201 in FIG. 2).

For example, when the IoT device (eg, the first IoT device 201 in FIG. 2) is a TV, when the user approaches the control electronic device 103 at a distance capable of recognizing the EM signal of the TV, control The designated communication (eg, WiFi Direct, mirroring) between the electronic device 103 and the TV is connected, and the video being played on the control electronic device 103 can be continuously played on the TV. When the video being played is continuously played on the TV, the control electronic device 103 may change to a screen off state.

For another example, when the IoT device (eg, the first IoT device 201 in FIG. 2) is a speaker, when the user approaches the control electronic device 103 at a distance capable of recognizing the EM signal of the speaker, The designated communication (eg, BT communication) is connected between the control electronic device 103 and the speaker, and the music being played in the control electronic device 103 can be continuously played in the speaker.

As another example, when the IoT device (eg, the first IoT device 201 in FIG. 2) is a refrigerator, when the user approaches the control electronic device 103 at a distance capable of recognizing the EM signal of the refrigerator , A designated communication (eg, WiFi Direct, or mirroring) between the control electronic device 103 and the refrigerator is connected, and information on food ingredients found in the control electronic device 103 can be displayed on the display of the refrigerator. According to various embodiments, the control electronic device 103 may include a list of IoT devices (eg, the first IoT device 201 in FIG. 2) stored therein and an IoT device recognized after obtaining the permission (eg, the second in FIG. 2 ). 1 For the overlapping device in the list of IoT devices 201, a control signal may be provided to the newly recognized device.

According to various embodiments of the present disclosure, when the control electronic device 103 deviates from the coverage allowed by the network device 102, the obtained authority may be returned.

6 is a signal flow diagram of a method for controlling an IoT device according to various embodiments of the present disclosure.

Referring to FIG. 6, in operation 610, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. For example, the network device 102 may be an AP device for Wi-Fi communication.

In operation 615, the control electronic device 103 may transmit a request signal confirming whether the EM service is supported to the network device 102. The request signal may include authentication information for a user using the control electronic device 103.

In operation 620, the network device 102 may transmit a response signal indicating that EM service support is possible.

The network device 102 may check the authentication information and, if the authentication information is valid, transmit a response signal indicating that EM service support is possible. According to an embodiment, the authentication information may be registered to the network device 102 through the master device 105.

In operation 630, the control electronic device 103 may receive preset guest account information (eg, ID and password) to obtain the authority of the EM service in the network space covered by the network device 102. For example, the control electronic device 103 may receive guest account information from a user.

In operation 635, the control electronic device 103 may transmit guest account information to the network device 102. According to various embodiments, according to the guest account information, the authority for the EM service acquired by the control electronic device 103 may be changed through a subsequent operation.

In operation 640, the network device 102 may perform an authentication process based on the guest account information. The network device 102 may authenticate guest account information based on pre-stored information or authenticate the guest account information through the IoT server 101.

In operation 645, when the authentication information is valid, the network device 102 may transmit an authentication signal indicating that EM service support is possible to the control electronic device 103.

In operation 650, the control electronic device 103 may compare the guest account information and the account information (hereinafter, set account information) set in connection with the EM service in the control electronic device 103.

In operation 670, the control electronic device 103 may request permission for the EM service from the IoT server 101 when the guest account information and the setting account information do not match. For example, if the guest account information and the setting account information do not match, the IoT device in the space (eg, a hotel, pension, or relative's house) that the user of the control electronic device 103 does not normally use (eg, a province) It may be a state in which the first IoT device 201 of 2 is to be controlled.

According to various embodiments of the present disclosure, in operation 675, the IoT server 101 may check with the master device 105 whether to allow permission setting to the control electronic device 103. For example, the IoT server 101 may check the master device 105 to request permission based on the permission request 670 requested by the control electronic device 103.

According to various embodiments, in operation 680, the IoT server 101 may receive a response regarding the permission setting from the master device 105.

In operation 685, when the IoT server 101 receives a response regarding permission authorization from the master device 105, the IoT server 101 may set access rights for the IoT device (eg, the first IoT device 201 in FIG. 2). . According to an embodiment, the IoT server 101 may provide the control electronic device 103 with analysis information (eg, resource information) related to the recognition of the EM signal or the device list controllable by the access authority.

According to various embodiments, the IoT server 101 may transmit device list or analysis information (eg, resource information) to the network device 102. The network device 102 provides a device list or analysis information (eg, resource information) to the control electronic device 103 through a designated authentication process (eg, verifying the location of the control electronic device 103 or checking a user account). can do.

In operation 690, the control electronic device 103 may provide an EM service. If the guest account information and the setting account information match, the control electronic device 103 may start the EM service without requesting a separate authority. For example, when the guest account information and the setting account information match, the IoT device in the space (eg, home, or office) where the user of the control electronic device 103 normally uses or a registered space (eg, home or office) : It may be in a state to control the first IoT device 201 of FIG. 2.

The control electronic device 103 may provide an EM service based on the obtained access authority and analysis information (including resource information) when the guest account information and the setting account information do not match. When the obtained authority limits control to the IoT device (eg, the first IoT device 201 in FIG. 2 ), the EM service may be provided within the limited authority range. For example, among TVs, speakers, air conditioners, and boilers, when control of TVs and speakers is allowed, the control electronic device 103 may control the TVs and speakers through EM services. On the other hand, the control electronic device 103 cannot control the air conditioner and the boiler through the EM service.

7 illustrates a method of controlling an IoT device using an email address according to various embodiments. In FIG. 7, an IoT control method using an email address is exemplarily illustrated, but is not limited thereto. For example, the IoT device may be controlled using account information or a phone number.

Referring to FIG. 7, in operation 710, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. For example, the network device 102 may be an AP device for Wi-Fi communication.

In operation 720, the control electronic device 103 may receive a preset email address (or account information, phone number) in order to obtain the authority of the EM service in the network space covered by the network device 102. For example, the control electronic device 103 may receive an email address from a user or use information stored in a memory (eg, memory 170) of the control electronic device 103. The control electronic device 103 may form a communication channel using the network device 102 and designated network account information (eg, ID and password). When a communication channel is formed, the control electronic device 103 may display a user interface capable of receiving an email address (or account information, phone number). The control electronic device 103 may receive an email address (or account information, phone number) for using the EM service through the user interface.

In operation 725, the control electronic device 103 may transmit the received email address (or account information, phone number) to the network device 102.

In operation 730, the network device 102 may transmit an invitation request signal including the received email address (or account information, phone number) to the IoT server 101.

In operation 740, the IoT server 101 responds to the invitation request signal and receives an email address (or a push message based on account information, an application notification or a text message based on a phone number) for an EM service. Can send.

In operation 750, the control electronic device 103 may check whether the user accepts the invitation through an email (or a push message or a text message).

In operation 755, the control electronic device 103 may request permission from the IoT server 101 when the user accepts the invitation, via email (or push message or text message).

According to various embodiments, in operation 760, the IoT server 101 may determine whether permission setting is permitted to the master device 105.

According to various embodiments, in operation 765, the IoT server 101 may receive a response regarding permission setting.

In operation 770, when the IoT server 101 receives a response regarding permission authorization from the master device 105, the IoT server 101 may set access authority for the IoT device. According to an embodiment, the IoT server 101 may provide the control electronic device 103 with analysis information (eg, resource information) related to the recognition of the EM signal or the device list controllable by the access authority.

According to various embodiments of the present disclosure, the IoT server 101 may transmit a list of controllable devices based on location information to the control electronic device 103 or the network device 102 and analysis information (eg, resource information) related to the recognition of the EM signal. Can provide.

In one embodiment, the control electronic device 103 may transmit location information to the IoT server 101 using communication through the network device 102 or separate communication (eg, cellular communication). The IoT server 101 may provide the control electronic device 103 with device information corresponding to the received location information and analysis information (eg, resource information) related to the recognition of the EM signal.

In operation 780, the control electronic device 103 may provide an EM service. For example, the control electronic device 103 may control a nearby IoT device (eg, the first IoT device 201 in FIG. 2) based on the received analysis information.

8 illustrates a device recognition method based on a device list according to various embodiments.

Referring to FIG. 8, in the first state 801, when the control electronic device 103 obtains the authority of the EM service in the network space covered by the network device 102, the control electronic device 103 uses the EM signal 811 Control of the IoT device (eg, the first IoT device 201 of FIG. 2) may be performed. For example, the processor 120 of the control electronic device 103 may analyze the EM signal based on the pre-stored EM information 801a. The EM information 801a may include analysis information for other IoT devices, as well as IoT devices around the control electronic device 103. When receiving the EM signal 811, the processor 120 compares the stored EM information 801a with the received EM signal 811 for all searchable devices (eg, first to Nth devices). Goodness of fit can be calculated.

In the second state 802, the control electronic device 103 is a device list 810 relating to at least one IoT device 104 included in the network space covered by the network device 102 from the IoT server 101 Can receive. The device list 810 may be stored in advance in the IoT server 101 through the master device 105. According to an embodiment, the master device 105 may recognize the EM signal of at least one IoT device 104 included in the network space covered by the network device 102 and analyze the EM signal. The master device 105 may transmit the analyzed information to the IoT server 101, and the IoT server 101 may generate and store a device list 810 based on the received information.

In the second state 802, the control electronic device 103 may use the device list 810 to reduce consumption resources required to process the EM signal 821 and improve device recognition performance. For example, the processor 120 of the control electronic device 103 may configure the updated EM information 802a based on the device list 810. The updated EM information 802a may include analysis information specialized for IoT devices around the control electronic device 103. When receiving the EM signal 821, the processor 120 may search for a device (eg, first to third devices) included in the device list 810 among all searchable devices (eg, first to Nth devices). For, the fitness can be calculated by comparing the updated EM information 802a with the received EM signal 821. The processor 120 may select, through the device list 810, a classifier (or classification model) optimized for a specific IoT device, or select appropriate logic to process the received EM signal 821. According to an embodiment, the EM information 802a is stored in the memory 170 and can be referenced by the processor 120.

According to various embodiments, the processor 120 may recognize an IoT device (eg, the first IoT device 201 in FIG. 2) through, for example, a GMM (Gaussian mixture model) discrimination model. The GMM discrimination model may be configured by combining individual models for each IoT device (eg, the first IoT device 201 in FIG. 2 ). For example, a discrimination model for each of the N IoT devices exists independently of each other, and a combination of them may constitute a total discrimination model.

For example, the control electronic device 103 is connected to the network equipment 102 (eg, AP) of a specific space, and the device list 810 of IoT devices capable of supporting EM services connected to the network equipment 102 Can receive. When the device 1, the device 2, and the device 3 are registered in the device list 810, among the GMM discrimination models stored in the control electronic device 103, the devices 1, 2, and 3 included in the device list 810 IoT devices can be recognized by optimizing the corresponding GMM discrimination model.

9 illustrates a device recognition method based on a device discrimination model according to various embodiments.

Referring to FIG. 9, when the control electronic device 103 obtains the authority of an EM service in a network space covered by the network device 102, the control electronic device 103 uses the EM signal 911 to at least one IoT device 104 You can perform control on.

The control electronic device 103 is a device list 910 and devices related to at least one IoT device 104 included in a network space covered by the network device 102 from the IoT server 101 or the network device 102. The discrimination model 920 may be received. The device list 910 and the device determination model 920 may be stored in advance in the IoT server 101 or the network device 102 through the master device 105. According to one embodiment, the master device 105 recognizes the EM signal 911 of at least one IoT device 104 included in the network space covered by the network device 102, and receives the EM signal 911. Can be analyzed. The master device 105 transmits analysis information (eg, information 920 regarding the device discrimination model) to the IoT server 101, and the IoT server 101 based on the received information, the device list 910 and The device discrimination model 920 may be generated and stored. Alternatively, the IoT server 101 may transmit and store the device list 910 and the device determination model 920 to the network device 102.

According to various embodiments, the control electronic device 103 may use the device list 910 and the device discrimination model 920 to reduce resource consumption required to process the EM signal 911 and improve device recognition performance. have.

For example, the processor 120 of the control electronic device 103 may configure the updated EM information 901a based on the device list 910 and the device determination model 920. The updated EM information 901a may include analysis information specialized for IoT devices around the control electronic device 103. If there is a device discrimination model 920, the device recognition process optimized through learning may be omitted, and the computation time required for device recognition may be reduced, and the memory used, as compared to the case of only the device list 810 as shown in FIG. 8. , Power can be lowered. In addition, device recognition performance may be improved.

According to an embodiment, the EM information 901a is stored in the memory 170 and can be referenced by the processor 120.

According to an embodiment, the discrimination model 920 may be a GMM discrimination model. The GMM discrimination model may be configured by combining individual models for each of the at least one IoT device 104. For example, a discrimination model for each of the N IoT devices exists independently of each other, and a combination of these may constitute a GMM discrimination model for all N devices.

According to another embodiment, the discrimination model 920 may be a discrimination model based on deep learning, such as deep neural networks (DNNs) or convolutional neural networks (CNNs). The deep learning-based discrimination model, unlike the GMM discrimination model, may be composed of one discrimination model that calculates the suitability of all N devices at once. Through the master device 105, a discrimination model based on deep learning may be stored in the IoT server 101 or the network device 102. When the control electronic device 103 downloads a deep learning-based discrimination model from the IoT server 101 or the network device 102, the control electronic device 103 can calculate by applying the appropriateness calculation logic in the second half of the discrimination model only to the corresponding devices. have.

According to various embodiments of the present disclosure, the control electronic device 103 checks the device list 910 of the new at least one IoT device 104 that has obtained permission, and an application associated with each device (eg, device-specific application, integrated application) ) Can be downloaded or run.

10 is a block diagram of an electronic device 1001 in a network environment 1000 according to various embodiments. An electronic device according to various embodiments disclosed in the present disclosure may be various types of devices. Electronic devices include, for example, portable communication devices (eg smartphones), computer devices (eg personal digital assistants (PDAs), tablet PCs (tablet PCs), laptop PCs (desktop PCs, workstations, or servers), It may include at least one of a portable multimedia device (eg, an e-book reader or MP3 player), a portable medical device (eg, heart rate, blood sugar, blood pressure, or body temperature meter), a camera, or a wearable device. (E.g. watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-devices (HMD)), fabrics or garments (e.g. electronic clothing), body attachments (e.g. : Skin pad or tattoo), or a bio-implantable circuit In some embodiments, the electronic device is, for example, a television, a digital video disk (DVD) player, an audio device, an audio accessory device (E.g. speakers, headphones, or headset), refrigerator, air conditioner, cleaner, oven, microwave, washing machine, air purifier, set-top box, home automation control panel, security control panel, game console, electronic dictionary, electronic key, camcorder Or, it may include at least one of the electronic picture frame.

In another embodiment, the electronic device is a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR) (eg, a black box for a vehicle/ship/airplane), a car infotainment device (E.g. head-up displays for vehicles), industrial or household robots, drones, automated teller machines (ATMs), point of sales (POS) devices, measuring devices (e.g. water, electricity, or gas measuring devices), Or it may include at least one of an Internet of Things device (eg, a light bulb, a sprinkler device, a fire alarm, a thermostat, or a street light). The electronic device according to an embodiment of the present disclosure is not limited to the above-described devices, and also, for example, a plurality of smartphones equipped with a measurement function of personal biometric information (eg, heart rate or blood sugar) The functions of the devices can be provided in combination. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

Referring to FIG. 10, in the network environment 1000, the electronic device 1001 (eg, the control electronic device 103 of FIG. 1) is connected to the electronic device 1002 through the first network (eg, short-range wireless communication) 1098. ) (E.g., at least one IoT device 104 of FIG. 1), or through a second network (e.g., network 106 of FIG. 1) 1099, an electronic device (e.g., the master device of FIG. 1) (105)) 1004 or a server (eg, IoT server 101 of FIG. 1) 1008. According to an embodiment, the electronic device 1001 may communicate with the electronic device 1004 through the server 1008.

According to an embodiment, the electronic device 1001 may include a bus 1010, a processor 1020 (eg, the processor 120 of FIG. 2), a memory 1030) (eg, the memory 170 of FIG. 2), Input device 1050 (eg, microphone or mouse), display device (eg, display 160 of FIG. 2) 1060, audio module 1070, sensor module 1076, interface 1077, haptic module ( 1079), a camera module 1080, a power management module 1088, and a battery 1089, a communication module 1090 (eg, the communication circuit 190 of FIG. 2), and a subscriber identification module 1096 Can. In some embodiments, the electronic device 1001 may omit at least one of the components (eg, the display device 1060 or the camera module 1080) or additionally include other components.

The bus 1010 may include circuits that connect the components 1020-1090 to each other and transfer signals (eg, control messages or data) between the components.

The processor 1020 may be one of a central processing unit (CPU), an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP) of a camera, or a communication processor (CP). Or more. According to one embodiment, the processor 1020 may be implemented as a system on chip (SoC) or a system in package (SiP). The processor 1020 may control, for example, at least one other component (eg, hardware or software component) of the electronic device 1001 connected to the processor 1020 by driving an operating system or an application program. , It can perform various data processing and operation. The processor 1020 loads and processes the command or data received from at least one of other components (eg, the communication module 1090) into the volatile memory 1032, and stores the result data in the non-volatile memory 1034 Can.

The memory 1030 may include a volatile memory 1032 or a non-volatile memory 1034. The volatile memory 1032 may be configured of, for example, random access memory (RAM) (eg, DRAM, SRAM, or SDRAM). The non-volatile memory 1034 includes, for example, programmable read-only memory (PROM), one time PROM (OTPROM), erasable PROM (EPROM), electrically EPROM (EEPROM), mask ROM, flash ROM, flash memory, HDD (hard disk drive), or solid state drive (SSD). In addition, the non-volatile memory 1034 may be an internal memory 1036 disposed therein or a stand-alone type exterior that can be used only when necessary, depending on the connection form with the electronic device 1001 It may be configured as a memory 1038. The external memory 1038 is a flash drive, for example, compact flash (CF), secure digital (SD), micro-SD, mini-SD, extreme digital (xD), multi-media card (MMC) , Or a memory stick. The external memory 1038 may be functionally or physically connected to the electronic device 1001 through wired (eg, cable or universal serial bus (USB)) or wireless (eg, Bluetooth).

The memory 1030 may store, for example, instructions or data related to at least one other software component of the electronic device 1001, for example, the program 1040. The program 1040 may include, for example, a kernel 1041, a library 1043, an application framework 1045, or an application program (interchangeably "application") 1047.

The input device 1050 may include a microphone, mouse, or keyboard. According to an embodiment, the keyboard may be connected to a physical keyboard or may be displayed as a virtual keyboard through the display device 1060.

The display device 1060 may include a display, a hologram device, or a projector and a control circuit for controlling the device. The display may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. . The display may be implemented to be flexible, transparent, or wearable according to an embodiment. The display may include a touch circuitry that can sense a user's touch, gesture, proximity, or hovering input or a pressure sensor (interchangeably "force sensor") that can measure the intensity of pressure on the touch. Can. The touch circuit or the pressure sensor may be implemented integrally with the display, or may be implemented with one or more sensors separate from the display. The hologram device may show a stereoscopic image in the air using interference of light. The projector can display an image by projecting light on the screen. The screen may be located, for example, inside or outside the electronic device 1001.

The audio module 1070, for example, can convert sound and electric signals in both directions. According to an embodiment of the present disclosure, the audio module 1070 acquires sound through an input device 1050 (eg, a microphone), or an output device (not shown) included in the electronic device 1001 (eg, a speaker or Sound through an external electronic device (e.g., electronic device 1002 (e.g., wireless speaker or wireless headphones) or electronic device 1006 (e.g., wired speaker or wired headphones)) connected with the electronic device 1001 Can output

The sensor module 1076 measures or detects an operating state (eg, power or temperature) inside the electronic device 1001 or an external environmental state (eg, altitude, humidity, or brightness), for example, An electrical signal or data value corresponding to the measured or sensed state information may be generated. The sensor module 1076 includes, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, and a color sensor (for example, an RGB (red, green, blue) sensor) , IR (infrared) sensor, biometric sensor (e.g. iris sensor, fingerprint sensor, or heartbeat rate monitoring (HRM) sensor, electronic nose sensor, electromyography (EMG) sensor, electroencephalogram (EGG) sensor, electrocardiogram (ECG) Sensor), a temperature sensor, a humidity sensor, an illuminance sensor, or an ultra violet (UV) sensor. The sensor module 1076 may further include a control circuit for controlling at least one sensor included therein. In some embodiments, the electronic device 1001 may control the sensor module 1076 using a processor 1020 or a processor (eg, a sensor hub) separate from the processor 1020. In the case of using a separate processor (eg, a sensor hub), the electronic device 1001 does not wake the processor 1020 while the processor 1020 is in a sleep state, and operates the sensor module by operating a separate processor. At least a portion of the operation or state of 1076 can be controlled.

Interface 1077, according to an embodiment, HDMI (high definition multimedia interface), USB, optical interface (optical interface), RS-232 (recommended standard 232), D-sub (D-subminiature), MHL (mobile) It may include a high-definition link (SD) interface, an SD card/multi-media card (MMC) interface, or an audio interface. The connection terminal 1078 may physically connect the electronic device 1001 and the electronic device 1006. According to an embodiment, the connection terminal 1078 may include, for example, a USB connector, an SD card/MMC connector, or an audio connector (eg, a headphone connector).

The haptic module 1079 may convert electrical signals into mechanical stimuli (eg, vibration or movement) or electrical stimuli. For example, the haptic module 1079 may provide the user with stimuli related to tactile or motor sensations. The haptic module 1079 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1080 may photograph still images and videos, for example. The camera module 1080, according to an embodiment, may include one or more lenses (eg, wide-angle and telephoto lenses, or front and rear lenses), an image sensor, an image signal processor, or a flash (eg, a light emitting diode or xenon lamp) (xenon lamp), etc.).

The power management module 1088 is a module for managing power of the electronic device 1001, and may be configured, for example, as at least a part of a power management integrated circuit (PMIC).

The battery 1089 may be recharged by an external power source, including, for example, a primary cell, a secondary cell, or a fuel cell, to supply power to at least one component of the electronic device 1001.

The communication module 1090, for example, establishes a communication channel between the electronic device 1001 and an external device (eg, the first external electronic device 1002, the second external electronic device 1004, or the server 1008). And wired or wireless communication through the established communication channel. According to one embodiment, the communication module 1090 includes a wireless communication module 1092 or a wired communication module 1094, and among them, a first network 1098 (eg, Bluetooth or IrDA) using a corresponding communication module A short-range communication network such as (infrared data association) or a second network 1099 (eg, a telecommunication network such as a cellular network) may communicate with an external device.

The wireless communication module 1092 may support cellular communication, short-range wireless communication, or GNSS communication, for example. Cellular communication is, for example, long-term evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), Wireless Broadband (WiBro) ), or GSM (Global System for Mobile Communications). Short-range wireless communication includes, for example, wireless fidelity (Wi-Fi), Wi-Fi Direct, light fidelity (Li-Fi), Bluetooth, Bluetooth low energy (BLE), Zigbee, near field communication (NFC), and MST ( magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). The GNSS may include, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System (“Beidou”) or Galileo (the European global satellite-based navigation system). In this document, "GPS" may be used interchangeably with "GNSS".

According to one embodiment, when the wireless communication module 1092 supports cellular communication, for example, the identification and authentication of the electronic device 1001 within the communication network using the subscriber identification module 1096 is performed. can do. According to an embodiment, the wireless communication module 1092 may include a CP separate from the processor 1010 (eg, AP). In this case, the CP may, for example, replace the processor 1020 while the processor 1020 is in an inactive (eg, sleep) state, or the processor 1020 while the processor 1020 is in an active state. Together, at least some of the functions related to at least one of the components 1010-1096 of the electronic device 1001 may be performed. According to an embodiment, the wireless communication module 1092 may include a cellular communication module, a short-range wireless communication module, or a plurality of communication modules that support only a corresponding communication method among GNSS communication modules.

The wired communication module 1094 may include, for example, a local area network (LAN), power line communication, or plain old telephone service (POTS).

The first network 1098 includes, for example, Wi-Fi Direct or Bluetooth capable of transmitting or receiving commands or data through a wireless direct connection between the electronic device 1001 and the first external electronic device 1002. It can contain. The second network 1099 may be, for example, a telecommunication network (eg, a local area network (LAN)) capable of transmitting or receiving commands or data between the electronic device 1001 and the second external electronic device 1004. Computer networks, such as wide area networks (WANs), Internet, or telephone networks.

According to various embodiments, the command or the data may be transmitted or received between the electronic device 1001 and the second external electronic device 1004 through a server 1008 connected to the second network. Each of the first and second external electronic devices 1002 and 1004 may be the same or a different type of device from the electronic device 1001. According to various embodiments, all or some of the operations executed in the electronic device 1001 may be executed in another one or a plurality of electronic devices (for example, the electronic devices 1002 and 1004) or the server 1008. According to an example, when the electronic device 1001 needs to perform a function or service automatically or by request, the electronic device 1001 may execute the function or service itself, or in addition, at least associated therewith. Some functions may be requested from other devices (eg, electronic devices 1002, 1004, or server 1008.) Other electronic devices (eg, electronic devices 1002, 1004, or server 1008) may be requested. A function or an additional function may be executed, and the result may be transmitted to the electronic device 1001. The electronic device 1001 may provide the requested function or service by processing the received result as it is or additionally. For example, cloud computing, distributed computing, or client-server computing technology can be used.

An electronic device (eg, the control electronic device 103 of FIG. 1) according to various embodiments receives an electromagnetic (EM) signal of at least one IoT device (eg, at least one IoT device 104 of FIG. 1) EM sensing circuit (e.g., EM sensing circuit 200 of FIG. 2), a communication circuit capable of performing communication with an external device (e.g., communication circuit 190 of FIG. 2), the at least one IoT device A memory for storing a database (eg, memory 170 of FIG. 2), the EM sensing circuit, the communication circuit, and a processor operatively connected to the memory (eg, processor 120 of FIG. 2), The processor forms a communication channel with an external network device (for example, the network device 102 of FIG. 1) through the communication circuit, and through the communication channel, to the at least one IoT device connected to the network device. Check whether the EM service is available, and if the EM service is available, obtain authority to control the at least one IoT device from the network device or an external server (eg, the IoT server 101 of FIG. 1). And receives the device list controllable by the authority or the analysis information related to the recognition of the EM signal from the network device or the external server, and based on the device list or the analysis information using the EM sensing circuit. It may be set to recognize the at least one IoT device, and to execute a function corresponding to the scope of the authority, using the recognized at least one IoT device.

According to various embodiments, the EM service may be a service that controls the at least one IoT device recognized through the EM signal to execute a designated function.

According to various embodiments, the processor may transmit a request signal including authentication information to the network device through the communication channel. When receiving a response signal corresponding to the request signal through the communication channel, the processor may determine that the EM service is possible.

According to various embodiments, the electronic device further includes a display displaying content, and the processor may display a user interface for inputting user account information to obtain the authority on the display. The processor may acquire authority regarding control of the at least one IoT device based on the user account information input to the user interface. When the input user account information does not match the user account information related to the EM service stored in the memory, the processor may request permission to control the at least one IoT device from the server.

According to various embodiments, the processor may transmit location information of the electronic device or connection information with the network device to the server through the communication circuit. The processor may receive the device list or the analysis information based on the location information or the connection information from the server through the communication circuit.

According to various embodiments, the electronic device further includes a display for displaying content, and the processor may display a user interface for inputting user's email information on the display. The processor may perform authentication with the server based on the email of the user, and obtain the authority based on the authentication result.

The control method of the IoT device according to various embodiments is performed in an electronic device (for example, the control electronic device 101 of FIG. 1) and through a communication circuit of the electronic device (for example, the communication circuit 190 of FIG. 2 ). , An operation of forming a communication channel with an external network device (eg, the network device 102 of FIG. 1 ), the at least one IoT device connected to the network device through the communication channel (eg, at least one of the FIG. 1) For the above IoT device 104, an operation of checking whether an EM service is possible, when the EM service is enabled, the network device (for example, the network device 102 in FIG. 1) or an external server (for example, FIG. Obtaining authority regarding control of the at least one IoT device from the IoT server 101 of 1, the network device (eg, the network device 102 of FIG. 1) or the external server (eg, FIG. 1) Receiving the analysis information related to the recognition of the EM signal or the device list or the device controllable by the authority from the IoT server 101, using the EM sensing circuit (EM sensing circuit 200 of FIG. 2) of the electronic device The method includes recognizing the at least one IoT device based on the device list or the analysis information, and using the recognized at least one IoT device to execute a function corresponding to the scope of the authority. can do.

According to various embodiments, the EM service may be a service that controls the at least one IoT device recognized through the EM signal to execute a designated function.

According to various embodiments, the operation of determining whether the control is possible may include an operation of transmitting a request signal including authentication information to the network device through the communication channel.

According to various embodiments, the operation of determining whether the control is possible may include an operation of determining that the EM service is possible when a response signal corresponding to the request signal is received through the communication channel.

According to various embodiments, the operation of obtaining the authority related to the control may include displaying a user interface for inputting user account information to obtain the authority on the display of the electronic device. The operation of obtaining the authority related to the control may include an operation of obtaining the authority related to the control of the at least one IoT device based on the user account information input to the user interface. The operation of obtaining the authority related to the control may include the authority related to the control of the at least one IoT device to the server when the input user account information does not match the user account information related to the EM service stored in the memory. It may include the requesting action.

According to various embodiments, the control method may further include an operation of deleting information on the authority when the communication channel is terminated.

A network device according to various embodiments (eg, the network device 102 of FIG. 1) includes a communication circuit capable of performing communication with an external device, a memory, and a processor operatively connected to the communication circuit and the memory And the processor forms a communication channel with a first electronic device (eg, the control electronic device 103 of FIG. 1) through the communication circuit, and through the communication circuit, at least one from the first electronic device. Receives a signal requesting the authority of the control of the IoT device (e.g., at least one IoT device 104 of FIG. 1), and through the communication circuit, an external server (e.g., IoT server 101 of FIG. 1) The signal may be transmitted to, and the information related to the authority may be received from the external server through the communication circuit, and the information may be transmitted to the first electronic device through the communication circuit.

It should be understood that various embodiments of the document and terms used therein are not intended to limit the technology described in this document to specific embodiments, and include various modifications, equivalents, and/or substitutes of the corresponding embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar elements. Singular expressions may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and/or B", "A, B or C" or "at least one of A, B and/or C", etc. are all of the items listed together. Possible combinations may be included. Expressions such as "first," "second," "first," or "second," can modify the components, regardless of order or importance, to distinguish one component from another component It is used but does not limit the components. When it is stated that one (eg, first) component is “connected (functionally or communicatively)” to another (eg, second) component or is “connected,” the component is the other It may be directly connected to the component, or may be connected through another component (eg, the third component).

In this document, "adapted to or configured to" is changed to be "appropriate for," having the ability to "appropriate," for example, in hardware or software. It can be used interchangeably with "made to do," "to do," or "designed to do." In some situations, the expression "a device configured to" may mean that the device "can" with other devices or parts. For example, the phrase “processor configured (or configured) to perform A, B, and C” refers to a dedicated processor (eg, embedded processor) or memory device (eg, memory 1030) to perform the corresponding operations. By executing one or more stored programs, it may mean a general-purpose processor (eg, CPU or AP) capable of performing the corresponding operations.

As used herein, the term "module" includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. Can. The "module" may be an integrally configured component or a minimum unit performing one or more functions or a part thereof. The "module" may be implemented mechanically or electronically, for example, an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), known or to be developed in the future, performing certain operations, or It may include a programmable logic device.

Instructions stored on a computer-readable storage medium (eg, memory 1030) in the form of a program module, at least a portion of a device (eg, modules or functions thereof) or method (eg, operations) according to various embodiments Can be implemented as When the instruction is executed by a processor (for example, the processor 1020), the processor may perform a function corresponding to the instruction. Computer-readable recording media include hard disks, floppy disks, magnetic media (eg magnetic tapes), optical recording media (eg CD-ROMs, DVDs, magnetic-optical media (eg floptical disks), internal memory, etc. The instructions may include code generated by a compiler or code executable by an interpreter.

Each component (for example, a module or a program module) according to various embodiments may be composed of a singular or a plurality of entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be omitted. It may further include. Alternatively or additionally, some components (eg, modules or program modules) may be integrated into one entity, performing the same or similar functions performed by each corresponding component before being integrated. Operations performed by a module, program module, or other component according to various embodiments may be sequentially, parallel, repetitively, or heuristically executed, at least some operations may be executed in a different order, omitted, or other operations This can be added.

Claims (20)

In the electronic device,
An EM sensing circuit that receives an electromagnetic (EM) signal of at least one IoT device;
A communication circuit capable of communicating with an external device;
A memory storing a database related to the at least one IoT device; And
And a processor operatively connected to the EM sensing circuit, the communication circuit, and the memory.
The processor
Through the communication circuit, to form a communication channel with an external network device,
Through the communication channel, it is confirmed whether the EM service is possible for the at least one IoT device connected to the network device,
If the EM service is available, obtain authority for control of the at least one IoT device from the network device or an external server,
Receiving a list of devices controllable by the authority or analysis information related to the recognition of the EM signal from the network device or the external server,
Recognizing the at least one IoT device based on the device list or the analysis information by using the EM sensing circuit,
An electronic device that is set to execute a function corresponding to the scope of the authority, by using the recognized at least one IoT device. The electronic device of claim 1, wherein the EM service controls the at least one IoT device recognized through the EM signal to execute a designated function. The method of claim 1, wherein the processor
An electronic device that transmits a request signal including authentication information to the network device through the communication channel. The method of claim 3, wherein the processor
When receiving a response signal corresponding to the request signal through the communication channel, the electronic device determines that the EM service is possible. According to claim 1,
Further comprising a display for displaying the content,
The processor
An electronic device displaying a user interface for inputting user account information to obtain the authority on the display. According to claim 5,
The processor
An electronic device that acquires authority regarding control of the at least one IoT device based on the user account information input to the user interface. The method of claim 6,
The processor
If the input user account information does not match the user account information related to the EM service stored in the memory, an electronic device requesting the server for authority regarding control of the at least one IoT device. The method of claim 1, wherein the processor
An electronic device that transmits location information of the electronic device or connection information with the network device to the server through the communication circuit. The method of claim 8, wherein the processor
An electronic device that receives the device list or the analysis information based on the location information or the connection information from the server through the communication circuit. According to claim 1,
Further comprising a display for displaying the content,
The processor
An electronic device displaying a user interface for inputting user's email information on the display. The method of claim 10,
The processor
An electronic device that performs authentication with the server based on the email of the user and acquires the authority based on the authentication result. In the network device,
A communication circuit capable of communicating with an external device;
Memory; And
And a processor operatively connected to the communication circuit and the memory.
The processor,
A communication channel with the first electronic device through the communication circuit,
Through the communication circuit, the first electronic device receives a signal requesting the authority to control at least one IoT device,
Transmit the signal to an external server through the communication circuit,
Through the communication circuit, receiving information related to the authority from the external server,
A network device that transmits the information to the first electronic device through the communication circuit. In the control method of the IoT device performed in the electronic device,
Forming a communication channel with an external network device through a communication circuit of the electronic device;
Checking whether or not an EM service is possible for at least one IoT device connected to the network device through the communication channel;
If the EM service is available, obtaining an authority regarding control of the at least one IoT device from the network device or an external server;
Receiving analysis information related to recognition of an EM signal or a list of devices controllable by the authority from the network device or the external server,
Recognizing the at least one IoT device based on the device list or the analysis information using an EM sensing circuit of the electronic device; And
And executing a function corresponding to the scope of the authority using the recognized at least one IoT device. The method of claim 13, wherein the EM service,
A control method that is a service that controls the at least one IoT device recognized through the EM signal to execute a designated function. The method of claim 13, wherein the operation of checking whether the control is possible is
And transmitting, via the communication channel, a request signal including authentication information to the network device. The method of claim 15, wherein the operation of determining whether the control is possible is
And receiving, through the communication channel, a response signal corresponding to the request signal, determining that the EM service is possible. The method of claim 13, wherein the operation of obtaining the authority related to the control is
And obtaining a user interface on the display of the electronic device to display a user interface for inputting user account information. The method of claim 17, wherein the operation of obtaining the authority related to the control is
And obtaining an authority related to the control of the at least one IoT device based on the user account information input to the user interface. The method of claim 18, wherein the operation of obtaining the authority related to the control is
And if the input user account information does not match the user account information related to the EM service stored in the memory, requesting authority to control the at least one IoT device from the server. The method of claim 13,
And when the communication channel is terminated, deleting information on the authority.

Images