WO2021065558A1

WO2021065558A1 - Information processing device, information processing method, electrical appliance, and electrical appliance processing method

Info

Publication number: WO2021065558A1
Application number: PCT/JP2020/035398
Authority: WO
Inventors: 健太郎井田; 保乃花尾崎; 将吾川田
Original assignee: ソニー株式会社
Priority date: 2019-10-04
Filing date: 2020-09-18
Publication date: 2021-04-08

Abstract

The present invention pertains to: an Information processing device and an information processing method whereby electrical appliances can be easily registered; and an electrical appliance and an electrical appliance processing method. The information processing device sets the location at which the electrical appliance is arranged, outputs a trigger signal, being a trigger for the electrical appliance to respond, and associates and registers the location and the electrical appliance that responded to the trigger signal. The electrical appliance detects the trigger signal from the information processing device, outputs a changed trigger signal, which is different from the trigger signal, in response to the detection of the trigger signal, and outputs a response signal being a response to the trigger signal or outputs a response request signal that requests a response using the response signal. Alternatively, the electrical appliance detects a changed trigger signal output from another electrical appliance that has detected a trigger signal from the information processing device and, in response to the detection of the changed trigger signal, outputs another changed trigger signal and outputs a response signal or a response request signal. This technology can, for example, be applied to registration of electrical appliances.

Description

Information processing equipment and information processing methods, and electrical equipment and processing methods for electrical equipment

The present technology relates to an information processing device and an information processing method, and an electric device and a processing method of the electric device. In addition, it relates to an electric device and a processing method of the electric device.

For example, in Patent Document 1, a feature amount is calculated from a measured value of a sensor arranged in the vicinity of a home appliance (household electric appliance), and the feature amount when the home appliance is in a predetermined state and the state of the home appliance are described. A technique for estimating the state of home appliances from the features by learning the correspondence is described.

Japanese Unexamined Patent Publication No. 2014-132732

For electric devices such as home appliances, in order to control multiple electric devices in an integrated manner, it is necessary to register the electric devices to be controlled.

However, it is troublesome for the user to manually register each of the electric devices to be controlled.

This technology was made in view of such a situation, and makes it easy to register electrical equipment.

The information processing device of the present technology includes a setting unit that sets a place where an electric device is installed, an output unit that outputs a trigger signal that is a trigger for the electric device to make a response, the place, and the trigger. It is an information processing device including a registration unit that registers in association with the electric device that has responded to a signal.

The information processing method of the present technology is to set a place where an electric device is installed, output a trigger signal which is a trigger for the electric device to make a response, and to the place and the trigger signal. It is an information processing method including registering in association with the electric device that has made a response.

In the information processing device and the information processing method of the present technology, the place where the electric device is installed is set, and a trigger signal which is a trigger for the electric device to make a response is output. Then, the location and the electric device that has responded to the trigger signal are associated and registered.

The first electric device of the present technology includes a detection unit that detects a trigger signal that is a trigger for performing a response from an information processing device, and a change trigger that is different from the trigger signal in response to the detection of the trigger signal. It is an electric device that includes an output unit that outputs a signal and outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to detection of the trigger signal.

The first processing method of the electric device of the present technology is different from the trigger signal depending on the detection of the trigger signal which is the trigger for performing the response from the information processing apparatus and the detection of the trigger signal. An electric device including outputting a change trigger signal and outputting a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to detection of the trigger signal. It is a processing method of.

In the first electrical device and processing method of the present technology, a trigger signal, which is a trigger for performing a response, is detected from the information processing device, and a change trigger different from the trigger signal is detected in response to the detection of the trigger signal. A signal is output. Then, in response to the detection of the trigger signal, a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal is output.

The second electric device of the present technology detects a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device. A unit and an output unit that outputs another change trigger signal in response to the detection of the change trigger signal, and a response signal that is a response to the trigger signal in response to the detection of the change trigger signal, or the said It is an electric device that outputs a response request signal that requests a response by a response signal.

The second processing method of the electric device of the present technology is to output a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device. The response signal, which is a response to the trigger signal, or the response, depending on the detection, the output of another change trigger signal in response to the detection of the change trigger signal, and the detection of the change trigger signal. It is a processing method of an electric device including outputting a response request signal for requesting a response by a signal.

In the second electric device and processing method of the present technology, a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device. Is detected, and another change trigger signal is output in response to the detection of the change trigger signal. Then, in response to the detection of the change trigger signal, a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal is output.

The information processing device, the first electric device, and the second electric device can be realized by causing a computer to execute a program.

The program can be provided by transmitting via a transmission medium or by recording on a recording medium.

It is a figure which shows the structural example of one Embodiment of the electric device control system to which this technique is applied. It is a figure which shows the example of the display screen of the control device 11. It is a figure explaining the example of the registration process performed in the electric device control system 10. It is a block diagram which shows the structural example of the control device 11. It is a block diagram which shows the structural example of an electric device 12. It is a figure explaining the communication between a control device 11 and an electric device 12. It is a flowchart explaining an example of processing of a control device 11. It is a flowchart explaining an example of processing of an electric device 12. It is a figure which shows the example of the combination of the modal of the change trigger signal, and the input device which accepts the input of the change trigger signal. It is a figure which shows the example of the response request signal. It is a figure which shows the example of the format of a response signal. It is a figure which shows the example of the allocation of a place for 8 bits as a place information. It is a figure which shows the example of the assignment of the type of an electric device 12 with respect to 8 bits as device information. It is a figure which shows the example of the allocation of a device for 16 bits as device information. It is a figure which shows the example of the profile list which a control device 11 registers a registration place and an electric device 12 in association with each other. It is a figure which shows the example of the registration screen displayed by the control device 11. The first registration method of detecting an electric device (non-compatible device) to which this technology is applied by the electric device (compatible device) 12 to which this technology is applied and registering it in the profile list of the control device 11 will be described. It is a figure. It is a figure explaining the 2nd registration method which detects a non-corresponding device by a corresponding device 12, and registers it in the profile list of a control device 11. It is a block diagram which shows the structural example of one Embodiment of the computer to which this technique is applied.

FIG. 1 is a diagram showing a configuration example of an embodiment of an electric device control system to which the present technology is applied.

In recent years, various electric devices have become smarter, and in response to the trend of IoT (Internet of Things), technology for integrated control (integrated control) of multiple electric devices including indoor white goods has been developed. It is requested.

As a technology for integrated control of multiple electric devices, for example, DLNA (registered trademark) (registered trademark) that connects so-called black goods, especially AV (AudioVisual) devices via a network, and shares and plays back contents. Mechanisms such as Digital Living Network Alliance) have been developed 15 years in advance.

On the other hand, for so-called white goods, standards for integrated control of multiple white goods have not yet been developed and established.

In the future, it is expected that remote control and remote acquisition of the state of the power supply, etc. will be required as integrated control of various electric devices including black goods and white goods.

In performing integrated control of various electric devices, the existence of the electric device to be controlled and the place where the existing electric device is installed are recognized, and the electric device is installed. It is necessary to register it in association with the location.

For example, when a TV (television receiver) is installed in each of the living room and the bedroom, the user intends to turn on the power of the TV in the living room in the living room. In order to turn on the power of the TV in the living room by remote control, it is necessary to register the TV in the living room in association with the living room where the TV is installed. ..

However, for example, with DLNA (registered trademark), there is no way to recognize where each AV device on the network is installed in the real world.

In the electric device control system 10 of FIG. 1, by detecting an electric device so as to perform a ball thrust, not only an electric device compatible with IoT but also an electric device not compatible with IoT can be detected and registered. And.

The electrical device control system 10 of FIG. 1 automatically recognizes electrical devices installed in each indoor room by cooperating with a mobile terminal such as a smartphone, for example.

That is, the electric device control system 10 automatically detects white goods, black goods, and other electric devices installed in each place (room), for example, using a smartphone as a host.

Therefore, in the electric device control system 10, the smartphone generates and outputs, for example, a sound as a trigger signal that becomes a trigger for the electric device to respond.

That is, the smartphone asks the user who owns the smartphone to move to the place where the electric device to be registered is installed, and outputs a sound as a trigger signal at that place.

An electric device detects a sound as a trigger signal by an input device (sensor) of the electric device, and changes another trigger signal different from the trigger signal according to the detection. Output from the output device that has. As a result, the electric device outputs a change trigger signal like a billiard in response to the detection of the trigger signal.

The change trigger signal is a signal in which the data format, data content, communication method, modal, etc. are changed from the original trigger signal so that a device that cannot receive the original trigger signal can receive and detect it. The change trigger signal may be a signal having the same modal as the sound as the trigger signal, that is, a sound, or another modal signal having a different modal, for example, light or the like.

According to the output of the change trigger signal, the change trigger signal reaches the electric device at a position relatively far from the smartphone where the trigger signal output by the smartphone does not reach, and it is possible to detect such an electric device. Become.

Further, the change of another modal signal whose modal is different from that of the sound as a trigger signal According to the trigger signal, there is no input device that accepts (senses) the input of the sound as a trigger signal, but the input accepts the input of another modal signal. It becomes possible to detect a change trigger signal in an electric device having a device.

In the electric device control system 10, the electric device that has detected the trigger signal or the change trigger signal returns a response to the trigger signal to the smartphone.

In the smartphone, the place where the trigger signal is output and the electric device that responded to the trigger signal are registered in association with each other.

As described above, in the electric device control system 10, the electric device that outputs the trigger signal from the smartphone at the predetermined place and responds to the trigger signal is designated as the electric device installed at the predetermined place. It is registered in association with the location of.

In FIG. 1, the electric device control system 10 includes a control device 11 and electric devices 12-1 to 12-5 as a plurality of electric devices.

The control device 11 is, for example, a smartphone, and registers the electric device and the place where the electric device is installed in association with each other, and remotely controls the electric device or the like by using the registered contents.

Electrical devices 12-1 to 12-5 are, for example, electrical devices installed in the kitchen. For example, the electric device 12-1 is a refrigerator, the electric device 12-2 is a microwave oven, the electric device 12-3 is a gas stove, the electric device 12-4 is a ventilation fan, and the electric device 12 -5 is an electric kettle.

Here, the electric devices 12-1 to 12-5 are also described as the electric devices A to E, respectively. Further, the electric devices 12-1 to 12-5 are collectively referred to as the electric device 12.

The electric device 12 has an input device and an output device as needed, in addition to its original function.

An input device is a device that accepts an input of a physical quantity, for example, a sensor that senses a physical quantity. Input devices include, for example, various sensors such as a microphone (microphone) that senses sound, a camera that senses light, a motion sensor that senses a person, an odor sensor that senses odor, and a temperature sensor that senses temperature. is there.

An output device is a device that outputs a physical quantity that an input device can accept input. Output devices include speakers that output sound, light emitting devices such as LEDs (light emission diodes) that output light, and actuators that move objects.

The electric device 12 has a necessary input device and an output device, and also has a function of performing control device communication as needed.

The control device communication is wireless communication (may include wired communication in part) by a predetermined communication method that can be performed by the control device 11. The electric device 12 having a function of performing control device communication can perform communication (control device communication) with the control device 11.

Here, the communication interface that performs communication by the predetermined communication method that can be performed by the control device 11 and the communication interface that performs communication other than the communication by the predetermined communication method are radio waves that serve as a medium in the communication. It is a device that accepts the input of the above, and is a device that outputs the radio wave, and is included in the input device and the output device from such a viewpoint.

In FIG. 1, the electric device 12-1 which is a refrigerator has a function of performing control device communication (control device communication function). Further, the electric device 12-1 has a camera, a microphone, and a motion sensor as input devices, and has a speaker and a light emitting device as output devices.

The electric device 12-2, which is a microwave oven, has a control device communication function. Further, the electrical device 12-2 has a microphone as an input device and a speaker as an output device.

The electric device 12-3, which is a gas stove, does not have a control device communication function. Further, the electric device 12-3 has a camera and an odor sensor as an input device, and has a speaker and a light emitting device as an output device.

The electric device 12-4, which is a ventilation fan, has a control device communication function. Further, the electrical device 12-4 has a camera and a temperature sensor as an input device, and a speaker as an output device.

The electric device 12-5, which is an electric kettle, has neither a control device communication function, an input device, nor an output device.

The present technology can be applied to at least an electric device 12 having an input device and an output device among the input device, the output device, and the control device communication function.

Here, it is assumed that this technology is applied to at least an electric device 12 having an input device and an output device, and the electric device 12 to which this technology is applied is also referred to as a compatible device. Further, the electric device 12 to which the present technology is not applied is also referred to as a non-compliant device.

In FIG. 1, the electric devices 12-1 to 12-4 are compatible devices because they have an input device and an output device, and the electric devices 12-5 are non-compatible devices because they do not have an input device and an output device. is there.

In the electric device control system 10, when the user operates the control device 11 so as to register the electric device, the control device 11 displays a predetermined display screen.

FIG. 2 is a diagram showing an example of a display screen of the control device 11.

In the control device 11, the control device 11 is brought to a place where the electric device to be registered is located, and the message "Take the smartphone to the place to be registered and touch the screen" prompting the user to touch the screen at that place. Please do "is displayed.

Further, the control device 11 displays a selection menu for selecting a location.

When the user wants to register the electric device 12 installed in the kitchen, he / she selects the kitchen from the selection menu. The control device 11 sets the location selected from the selection menu (here, the kitchen) to the registration location where the electrical equipment to be registered is installed.

The user moves to the kitchen with the control device 11 according to the message displayed on the display screen.

The order of selecting the kitchen from the selection menu and moving to the kitchen with the control device 11 is not particularly limited.

The user touches the screen of the control device 11 after selecting the kitchen from the selection menu and moving to the kitchen with the control device 11.

In the electric device control system 10, when the screen of the control device 11 is touched, a registration process for registering the electric device is performed.

FIG. 3 is a diagram illustrating an example of registration processing performed by the electric device control system 10.

The control device 11 outputs, for example, a specific sound (for example, a sound such as "pawn") as a trigger signal that becomes a trigger for the electric device to respond in response to the user touching the screen.

The control device 11 receives a response signal as a response to the trigger signal by the control device communication, and registers the kitchen as the registration place and the electric device in association with each other according to the response signal.

The sound as a trigger signal is detected by the electric device 12-1 (A) having a microphone as an input device capable of sensing the sound and the electric device 12-2 (B).

The electrical device 12-1 that has detected the sound as a trigger signal performs necessary internal processing in response to the detection of the sound as a trigger signal, and outputs a change trigger signal as another trigger signal.

Since the electric device 12-1 has a speaker and a light emitting device as output devices, it outputs a modal change trigger signal that can be output from each of the speaker and the light emitting device, that is, sound and light as the change trigger signal.

Further, since the electric device 12-1 has a control device communication function, the response signal to the trigger signal is transmitted by the control device communication in response to the detection of the sound as the trigger signal.

The control device 11 receives the response signal transmitted from the electric device 12-1 by the control device communication, and associates the electric device 12-1 (A) with the kitchen, which is the registration place, according to the response signal. And register.

The response signal includes device information (for example, "refrigerator") indicating an electric device to be registered in association with the registration location, and the control device 11 associates the device information with the registration location. Recognize the electrical equipment to register.

The electric device 12-2 that detects the sound as a trigger signal also performs the same processing as that of the electric device 12-1.

That is, the electric device 12-2 (B) performs necessary internal processing in response to the detection of the sound as the trigger signal, and outputs the change trigger signal as another trigger signal.

Since the electric device 12-2 has a speaker as an output device, it outputs a modal change trigger signal that can be output from the speaker, that is, a sound as a change trigger signal.

The control device 11 receives the response signal transmitted from the electric device 12-2 by the control device communication, and associates the electric device 12-2 (B) with the kitchen, which is the registration place, according to the response signal. And register.

On the other hand, as an input device, the electric devices 12-3 to 12-5 that do not have a microphone capable of sensing sound include sound as a trigger signal output by the control device 11, and the electric devices 12-1 and 12-2. Cannot detect the sound as the change trigger signal output by.

However, the electrical devices 12-3 and 12-4 have a camera capable of sensing light as an input device.

Therefore, in the electric devices 12-3 and 12-4, the light as the change trigger signal output by the electric device 12-1 can be detected.

Among the electric devices 12-3 and 12-4, the electric device 12-4 (D) having the control device communication function responds to the detection of the change trigger signal and has a trigger signal (change trigger) corresponding to the change trigger signal. The response signal to the trigger signal that is the source of the signal) is transmitted by the control device communication.

That is, the electric device 12-4 (second electric device) having the control device communication function receives light as a change trigger signal output by the electric device 12-1 (first electric device) in response to the detection of the trigger signal. In response to the detection of, the response signal is transmitted by the control device communication.

The control device 11 receives the response signal transmitted from the electric device 12-4 by the control device communication, and associates the electric device 12-4 (D) with the kitchen, which is the registration place, according to the response signal. And register.

Since the electric device 12-3 (C) that has detected the change trigger signal does not have the control device communication function, even if the change trigger signal is detected, the response signal cannot be transmitted by the control device communication.

Therefore, the electric device 12-3 outputs a response request signal for requesting the response of the response signal from the output device of itself (electrical device 12-3) to the electric device having the control device communication function.

Since the electric device 12-3 has a speaker and a light emitting device as an output device, a response request signal is output from one or more of the speaker and the light emitting device. For example, the electric device 12-3 outputs light as a response request signal from the light emitting device.

The response request signal can include device information of an electric device (electric device 12-3 in FIG. 3) that requests a response of the response signal by the response request signal.

The light as the response request signal output from the electric device 12-3 (C) is detected by the electric devices 12-1 and 12-4 having a camera capable of sensing the light.

Of the electric devices 12-1 and 12-4 that have detected the light as the response request signal output from the electric device 12-3, the electric device 12-1 having the control device communication function is the light as the response request signal. In response to the detection of, the response signal including the device information of the electric device 12-3 (C) included in the response request signal is transmitted by the control device communication.

That is, in the electric device 12-1 (second electric device) having the control device communication function, the electric device 12-3 (third electric device) detects light as a change trigger signal from the electric device 12-1. In response to the detection of light as the response request signal output in response to the above, the response signal of the electric device 12-3 is transmitted by the control device communication.

The control device 11 receives the response signal of the electric device 12-3 (C) transmitted from the electric device 12-1 by the control device communication, and the response signal includes the device information according to the response signal. The electric device 12-3 (C) is registered in association with the kitchen, which is the registration place.

As described above, according to the registration process performed by the electric device control system 10, the electric device can be easily registered. That is, the user simply takes the control device 11 to a place where the electric device to be registered is installed, selects the place from the selection menu, and touches the screen of the control device 11 to select the control device 11. The location selected from the menu and the electrical equipment installed at that location can be registered in association with each other.

Note that the electrical devices that can be registered in the registration process shown in FIG. 3 are only compatible devices, and non-compatible devices cannot be registered. That is, for example, in the registration process, the corresponding devices 12-1 to 12-4 can be registered, but the non-compatible electric devices 12-5 cannot be registered. Registration of non-compatible devices is performed manually by the user or by a method described later.

FIG. 4 is a block diagram showing a configuration example of the control device 11 of FIG.

In FIG. 4, the control device 11 includes an input unit 21, an output unit 22, a storage unit 23, a trigger generation unit 24, a control unit 25, a network unit 26, and an I / F (interface) unit 27.

The input unit 21 is operated by the user and supplies an operation signal corresponding to the operation to the control unit 25 via the I / F unit 27. For example, the input unit 21 has a touch panel 31 and a button 32, and supplies an operation signal corresponding to the operation of the touch panel 31 and the button 32 (for the user) to the control unit 25 via the I / F unit 27. ..

The output unit 22 outputs a predetermined physical quantity according to the trigger signal supplied from the trigger generation unit 24 via the I / F unit 27 and the control of the control unit 25. For example, the output unit 22 has a display 41 and a speaker 42. The display 41 displays an image by outputting light according to the control of the control unit 25. The speaker 42 outputs a sound as a trigger signal supplied from the trigger generation unit 24 and a sound according to the control of the control unit 25.

The storage unit 23 stores various data. For example, the storage unit 23 stores a profile list or the like registered in association with the electric device 12 supplied from the control unit 25 (profile control unit 51 of the control unit 25) and the place where the electric device 12 is installed. To do.

The trigger generation unit 24 functions as a generation unit that generates a trigger signal that serves as a trigger for the electric device 12 to respond. The trigger generation unit 24 generates a trigger signal according to the control of the control unit 25, and supplies the trigger signal to the output unit 22 via the I / F unit 27.

The control unit 25 controls the blocks constituting the control device 11 and performs various other processes.

For example, the control unit 25 refers to the profile list stored in the storage unit 23, and networks the control signals for controlling the electric devices 12 set at each location according to the operation signals supplied from the input unit 21. Send to unit 26. Further, for example, the control unit 25 controls the output unit 22 to display an image or output a sound.

Further, for example, the control unit 25 controls the trigger generation unit 24 according to the operation signal supplied from the input unit 21 to generate the trigger signal. Further, for example, the control unit 25 functions as a setting unit for setting a place (registration place) to be registered in the profile list according to an operation signal supplied from the input unit 21. Further, for example, the control unit 25 has a profile control unit 51. The profile control unit 51 associates the electrical device 12 that has responded to the trigger signal in response to the response signal supplied from the network unit 26 with the location (registration location) set by the control unit 25, and stores the storage unit 51. It functions as a registration unit to be registered in the profile list stored in 23.

The network unit 26 performs control device communication by a predetermined communication method. For example, the network unit 26 transmits a control signal by control device communication in response to the control of the control unit 25. Further, for example, the network unit 26 receives the response signal transmitted from the electric device 12 capable of communicating with the control device and supplies the response signal to the control unit 25 (profile control unit 51).

In the present embodiment, for example, wireless LAN via an access point, mobile communication such as 4G, and TCP / IP communication via the Internet are adopted as control device communication.

The I / F unit 27 is an interface for inputting / outputting signals (data) to the input unit 21, the output unit 22, the trigger generation unit 24, and the control unit 25.

FIG. 5 is a block diagram showing a configuration example of the electrical device 12 of FIG.

FIG. 5 shows a configuration example of the electric device 12 as a corresponding device.

In FIG. 5, the electrical device 12 includes an input unit 61, an output unit 62, a storage unit 63, a trigger detection unit 64, a trigger generation unit 65, a control unit 66, a network unit 67, and an I / F unit 68.

The input unit 61 has one (type) or more input devices that accept input of physical quantities. In FIG. 5, the input unit 61 has a microphone 71, a camera 72, and a temperature sensor 73 as input devices. The microphone 71 receives (senses) sound as vibration of air and outputs sound as an electric signal. The camera 72 receives (sensing) light, performs photoelectric conversion, and outputs an image as an electric signal. The temperature sensor 73 receives (senses) a temperature and outputs an electric signal corresponding to the temperature. The electric signal output by the input device included in the input unit 61 is also referred to as sensor data. The sensor data output by the microphone 71, the camera 72, and the temperature sensor 73 as input devices included in the input unit 61 is supplied to the trigger detection unit 64 via the I / F unit 68.

The output unit 62 has one or more output devices that output physical quantities. In FIG. 5, the output unit 62 has a speaker 81, an LED 82, and a display 83 as output devices.

The speaker 81 outputs sound. For example, the speaker 81 outputs a sound as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.

LED82 outputs (emits) light. For example, the LED 82 outputs light as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.

The display 83 outputs light as an image (displays an image). For example, the display 83 outputs light as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.

The storage unit 63 stores various data. For example, the storage unit 63 stores the device information of the electric device 12, the input device and the output device of the electric device 12, and the profile of the electric device 12 which is other information related to the electric device 12.

The trigger detection unit 64 detects a trigger signal, a change trigger signal, and a response request signal from the sensor data supplied from the input unit 61 via the I / F unit 68, and the trigger signal, the change trigger signal, and the response request. The sensor data detected as a signal is supplied to the control unit 66.

The trigger generation unit 65 generates a change trigger signal and a response request signal according to the control of the control unit 66, and supplies the change trigger signal and the response request signal to the output unit 62 via the I / F unit 68.

The control unit 66 controls the blocks constituting the electric device 12 and performs various other processes.

The control unit 66 includes a trigger analysis unit 91, a profile control unit 92, and a sensor data analysis unit 93.

The trigger analysis unit 91 analyzes the sensor data from the trigger detection unit 64 and recognizes whether the sensor data is a trigger signal, a change trigger signal, or a response request signal.

When the sensor data from the trigger detection unit 64 is a trigger signal or a change trigger signal, the control unit 66 controls the trigger generation unit 65 to generate a change trigger signal or a response request signal, if necessary. Therefore, in the electric device 12, the change trigger signal and the response request signal are generated and output in response to the detection of the trigger signal or the change trigger signal.

Further, when the sensor data from the trigger detection unit 64 is a trigger signal or a change trigger signal, the control unit 66 generates a response signal as necessary and causes the network unit 67 to transmit it. Therefore, the electrical device 12 generates and transmits a response signal in response to the detection of the trigger signal or the change trigger signal.

When the sensor data from the trigger detection unit 64 is a response request signal, the control unit 66 generates a response signal of another electric device 12 that has requested a response of the response signal by the response request signal, if necessary. Then, it is transmitted to the network unit 67. Therefore, in the electric device 12, the response signal of the other electric device 12 is generated and transmitted in response to the detection of the response request signal from the other electric device 12.

The profile control unit 92 controls reading and writing of the profile to the storage unit 63. The control unit 66 uses the device information and the like of the electric device 12 included in the profile read from the storage unit 63 by the profile control unit 92 to generate a response signal including the device information and the like.

The sensor data analysis unit 93 analyzes the sensor data output by the input unit 61, if necessary.

The network unit 67 communicates with the control device. For example, the network unit 67 transmits a response signal by control device communication in response to the control of the control unit 66. Further, for example, the network unit 67 receives the control signal transmitted from the control device 11 and supplies the control signal to the control unit 66. The control unit 66 controls the electric device 12 in response to a control signal from the network unit 67.

Note that the network unit 67 can perform communication other than control device communication. However, the electric device 12 cannot communicate with the control device 11 (by radio waves) unless it communicates with the control device.

The I / F unit 68 is an interface for inputting / outputting signals (data) to the input unit 61, the output unit 62, the trigger detection unit 64, the trigger generation unit 65, and the control unit 66.

The electrical device 12 as a corresponding device has an input unit 61 having one or more input devices and an output unit 62 having one or more output devices. However, it is not essential that the electric device 12 as a corresponding device has a control device communication function. Therefore, in the electric device 12 as a corresponding device, the network unit 67 is not provided, or even if the network unit 67 is provided, the network unit 67 can only perform communication other than the control device communication. is there.

FIG. 6 is a diagram illustrating communication between the control device 11 and the electric device 12.

As described with reference to FIG. 4, the control device 11 controls communication via an access point (mobile communication such as wireless LAN and 4G) as control device communication and TCP / IP communication via the Internet. It is used for device communication.

The electric device 12 on which the control device communication function is mounted can perform control device communication with the control device 11.

The electric device 12 on which the communication function of the control device communication is not implemented cannot perform the control device communication with the control device 11.

FIG. 7 is a flowchart illustrating an example of processing of the control device 11.

The process according to the flowchart of FIG. 7 is started by, for example, the user setting the control device 11 in the device registration mode for registering the electric device 12.

In step S111, the control device 11 displays, for example, a message prompting the user to touch the screen and a selection menu for selecting a location on the display 41 as shown in FIG. 2, and the process is performed in step S112. Proceed to.

In step S112, the control device 11 determines whether or not the location has been selected from the selection menu by the user, and if it is determined that the location has not been selected, the process returns to step 112.

If it is determined in step S112 that the location has been selected, the process proceeds to step S113.

In step S113, the control device 11 determines whether or not the screen (of the display 41) has been touched, and if it is determined that the screen has not been touched, the process returns to step S113.

Further, in step S113, when it is determined that the screen has been touched, that is, for example, the user selects the location "kitchen" from the selection menu, and then brings the control device 11 to the kitchen to display the screen. If touched, the process proceeds to step S114.

Here, in the present embodiment, the touch of the screen is adopted as a signal to notify the control device 11 that the user has moved to the place selected from the selection menu. The utterance of a predetermined phrase or the like can be adopted as a signal to notify the control device 11 that the user has moved to a place selected from the selection menu.

In step S114, the control device 11 sets the location selected from the selection menu in the control unit 25 as the registration location for registering the electric device, and the process proceeds to step S115.

In step S115, the control device 11 generates a trigger signal in the trigger generation unit 24, outputs a specific sound as the trigger signal from the speaker 42, and the process proceeds to step S116.

In step S116, the control device 11 determines whether or not the network unit 26 has received the response signal to the trigger signal transmitted from the electric device 12 by the control device communication.

If it is determined in step S116 that the response signal has not been received, the process proceeds to step S120.

If it is determined in step S116 that the response signal has been received, the process proceeds to step S117, and the control device 11 displays a registration screen for registering the electric device 12 represented by the device information included in the response signal. It is displayed on 41.

Then, the process proceeds from step S117 to step S118, and the control device 11 determines whether or not the user has performed a registration operation for registering the electric device 12 represented by the device information included in the response signal on the registration screen. judge.

If it is determined in step S118 that the registration operation has been performed, the process proceeds to step S119.

In step S119, the control device 11 associates the registration location with the electrical device 12 represented by the device information included in the response signal in the profile control unit 51, registers the registration location in the profile list stored in the storage unit 23, and processes the registration. Goes to step S120.

If it is determined in step S118 that the registration operation has not been performed, the process skips step S119 and proceeds to step S120.

Therefore, when it is inappropriate to register the electric device 12 represented by the device information included in the response signal in association with the registration location, for example, the electrical device 12 represented by the device information included in the response signal is placed in the registration location. In the case of an electric device that is not installed, the user does not perform the registration operation so that the electric device 12 that is inappropriate to be registered in association with the registration location is registered in association with the registration location. Can be prevented.

In step S120, the control device 11 determines whether or not a predetermined time has elapsed since the trigger signal was output in step S115.

If it is determined in step S120 that the predetermined time has not elapsed, the process returns to step S116, and the processes after step S116 are repeated thereafter.

Further, in step S120, when it is determined that the predetermined time has elapsed, the control device 11 ends the process.

As described above, in the control device 11, the registration location is set and the trigger signal is generated according to the touch of the screen by the user. Further, in the control device 11, the registration location is associated with the electric device 12 that has responded to the trigger signal, that is, the electric device 12 represented by the device information included in the response signal to the trigger signal, and is registered in the profile list. To.

Therefore, the user can easily register the electric device 12 associated with the registration location by simply bringing the control device 11 to the registration location and touching the screen at the registration location.

Further, in the control device 11, after registering the registration location and the electric device 12 in the profile list in association with each other, the same (type) electric device 12 can be placed in a plurality of places by referring to the profile list. When installed, the electrical equipment 12 at each location can be controlled individually (independently). For example, when the same TV is installed in each of the living room and the bedroom, it is possible to turn on the power of only the TV in the bedroom.

Here, as the sound as the trigger signal, for example, a single sound (“pip”), a periodic sound (“pip pip pip”), a voice of a specific phrase (“Hi Sony”), or the like can be adopted. ..

In addition, for example, in the voice agent (smart speaker, etc.) provided by each company, the voice of the keyword (for example, "OK Google", "Alexa") that triggers the start of voice recognition is selected from the trigger signal or the selection menu. It can be adopted as a signal to notify the control device 11 that the user has moved to the designated place.

When the voice of the keyword that triggers the start of voice recognition of the voice agent provided by each company is adopted as a trigger signal or a signal to notify the control device 11 that the user has moved to the place selected from the selection menu. , An application that adds a function of linking with the control device 11 by using the SDK or Web API of the voice agent provided by each company, for example, referring to the profile list stored in the control device 11 and being registered in the profile list. It is possible to manufacture and provide a plug-in or the like as an application for controlling an electric device 12.

Further, in the control device 11, the voice agent provided by each company can detect the response voice that responds (feedback) to the keyword that triggers the start of voice recognition. In this case, in the control device 11, in response to the detection of the response voice, an electric device such as a voice agent that uses a keyword for which the response voice is responded as a trigger for starting voice recognition is located at the place where the response voice is detected. It is possible to recognize that it is installed and register the electric device in association with the place where the response voice is detected.

Here, sound is adopted as the trigger signal, but as the trigger signal, a physical quantity other than sound that can be output by any output device of the control device 11, that is, the display 41 in FIG. 4 It is possible to adopt the light that can be output by the device and the radio wave of the control device communication that can be output by the network unit 26.

FIG. 8 is a flowchart illustrating an example of processing of the electric device 12.

In step S131, the electrical device 12 determines whether or not it has an output device capable of accepting a modal sound input of the trigger signal, that is, a microphone 71.

If it is determined in step S131 that the microphone 71 is possessed, the process proceeds to step S132, and the electric device 12 determines whether or not the trigger signal is detected by the trigger detection unit 64.

If it is determined in step S132 that the trigger signal has been detected, that is, if the sound as the trigger signal is collected (sensed) by the microphone 71 and detected by the trigger detection unit 64, the process proceeds to step S133. move on.

In step S133, the electric device 12 generates a change trigger signal in the trigger generation unit 65, outputs (broadcasts) the change trigger signal from the output unit 62, and the process proceeds to step S134.

As described above, the change trigger signal is output as if billiards were performed by the trigger signal.

Here, the output unit 62 can output the change trigger signal from a part or all of the output devices included in the output unit 62. For example, as shown in FIG. 5, when the output unit 62 has the speaker 81, the LED 82, and the display 83, when the change trigger signal is output from all of the speaker 81, the LED 82, and the display 83, Sound as a change trigger signal is output from the speaker 81, and light as a change trigger signal is output from the LED 82 and the display 83. The electric device 12 recognizes the output device of the electric device 12 from the profile of the electric device 12 stored in the storage unit 63, and outputs a change trigger signal from the output device recognized in this way. be able to.

The sound change trigger signal is a modal signal that is the same as the sound trigger signal, and can reach the range where the sound trigger signal does not reach, instead of the sound trigger signal. Therefore, according to the sound change trigger signal, it is possible to prompt the response of the electric device 12 installed in the range where the sound trigger signal does not reach.

The light change trigger signal is another modal signal whose modal is different from that of the sound trigger signal, and does not have a microphone 71 which is an input device that accepts sound input, but a camera 72 which is an input device that accepts light input. It can be detected by the electric device 12 having the device. Therefore, according to the light change trigger signal, it is possible to prompt the response of the electric device 12 which does not have the microphone 71 but has the camera 72.

In step S134, the electric device 12 sets the reissue prevention flag to TRUE, and the process proceeds to step S135.

The reissue prevention flag is set to FALSE of TRUE and FALSE before the process of FIG. 8 is started. The reissue prevention flag is set to TRUE in step S134 when the change trigger signal is output in step S133 after the process of FIG. 8 is started. When the reissue prevention flag is set to TRUE, the output of the change trigger signal in step S133 and the generation of the change trigger signal are restricted thereafter. This makes it possible to prevent the change trigger signal from being recursively (repeatedly) output in the electrical device 12.

In step S135, the electric device 12 determines whether or not the control device communication is possible.

If it is determined in step S135 that control device communication is possible, the process proceeds to step S136.

In step S136, the electric device 12 generates a response signal including the device information of the electric device 12 and other necessary information of the electric device 12. Further, the electric device 12 transmits the response signal of the electric device 12 to the control device 11 by causing the network unit 67 to perform the control device communication, and the process ends. In the electric device 12, the information included in the response signal is read from the profile of the electric device 12 stored in the storage unit 63.

If it is determined in step S135 that control device communication is not possible, the process proceeds to step S137.

In step S137, the electric device 12 requests the other electric device 12 to respond to the trigger signal of the electric device 12 (the electric device 12 that has detected the trigger signal) in the trigger generation unit 65. To generate. Further, the electric device 12 outputs (broadcasts) a response request signal from the output unit 62, and the process ends.

Here, the output unit 62 can output the response request signal from a part or all of the output devices included in the output unit 62. For example, as shown in FIG. 5, when the output unit 62 has the speaker 81, the LED 82, and the display 83, and outputs a response request signal from all of the speaker 81, the LED 82, and the display 83, Sound as a response request signal is output from the speaker 81, and light as a response request signal is output from the LED 82 and the display 83. The electric device 12 recognizes the output device of the electric device 12 from the profile of the electric device 12 stored in the storage unit 63, and outputs a response request signal from the output device recognized in this way. be able to.

The response request signal can include information similar to the response signal, that is, device information of the electric device 12 that outputs the response request signal.

As described above, electricity having a microphone 71 capable of receiving an input of a sound trigger signal and installed within a range in which the sound trigger signal output by the control device 11 can be reached from the control device 11. The device 12 outputs a change trigger signal in response to the detection of the sound trigger signal from the control device 11.

Further, when the electric device 12 has the control device communication function, the response signal including the device information of the electric device 12 is transmitted to the control device 11 by the control device communication.

Further, when the electric device 12 does not have the control device communication function, a response request signal for requesting a response signal to another electric device 12 is output from the output device of the electric device 12.

The electric device 12 that outputs the response request signal is referred to as the request electric device 12. When the electric device 12 having the control device communication function detects the response request signal output by the request electric device 12, the response signal of the request electric device 12 is generated by the control device communication by the electric device 12 having the control device communication function. It is transmitted to the control device 11.

On the other hand, if it is determined in step S132 that the trigger signal has not been detected, the process proceeds to step S138, and the electrical device 12 determines whether or not the change trigger signal has been detected in the trigger detection unit 64.

If it is determined in step S138 that the change trigger signal has been detected, the process proceeds to step S139, and the electrical device 12 determines whether the reissue prevention flag is FALSE.

If it is determined in step S139 that the reissue prevention flag is FALSE, the process proceeds to step S133, and the same process as described above is performed thereafter.

If it is determined in step SS139 that the reissue prevention flag is not FALSE, the process skips steps S133 and S134 and proceeds to step S135, and the same process as described above is performed below.

Therefore, an electric device having a microphone 71 capable of receiving an input of a sound trigger signal and detecting a change trigger signal output by another electric device 12 in response to detection of the sound trigger signal output by the control device 11. In 12, a change trigger signal (another change trigger signal) different from the change trigger signal is output in response to the detection of the change trigger signal from the other electric device 12. However, in the electric device 12 that has detected the change trigger signal, the change trigger signal has already been output when the reissue prevention flag is not set to FALSE, that is, according to the detection of the past trigger signal or the change trigger signal. If so, no further change trigger signal is output.

Further, when the electric device 12 that has detected the change trigger signal has the control device communication function, the response signal including the device information of the electric device 12 is transmitted to the control device 11 by the control device communication.

Further, when the electric device 12 that has detected the change trigger signal does not have the control device communication function, the response request signal requesting the response of the response signal is output from the output device of the electric device 12.

The response signal of the request electric device 12, which is the electric device 12 that outputs the response request signal, that is, the response signal of the electric device 12 that has detected the change trigger signal is the request electric device 12 that has the control device communication function. When the response request signal output by is detected, it is transmitted to the control device 11 by the control device communication by the electric device 12 having the control device communication function.

On the other hand, if it is determined in step S138 that the change trigger signal has not been detected, the process proceeds to step S140, and the electrical device 12 determines whether or not the trigger detection unit 64 has detected the response request signal.

If it is determined in step S138 that the response request signal has not been detected, the process returns to step S132.

If it is determined in step S138 that the response request signal has been detected, the process proceeds to step S141, and the electric device 12 determines whether or not the control device communication is possible.

If it is determined in step S141 that control device communication is possible, the process proceeds to step S142.

In step S142, the electric device 12 generates a response signal of the request electric device 12 that outputs the response request signal in response to the detection of the response request signal. Further, the electric device 12 transmits the response signal of the requesting electric device 12 to the control device 11 by causing the network unit 67 to perform the control device communication, and the process ends.

On the other hand, if it is determined in step S141 that the control device communication is not possible, the process ends.

As described above, when the electric device 12 (other electric device) having the control device communication function detects the response request signal of the request electric device 12, the request electric device 12 responds to the detection of the response request signal. Instead, the response signal of the requested electric device 12 is transmitted to the control device 11 by the control device communication.

That is, since the requesting electric device 12 does not have the control device communication function, it outputs a response request signal, but if the electric device 12 that has detected the response request signal has the control device communication function, it responds. In response to the detection of the request signal, the response signal of the request electric device 12 is transmitted to the control device 11 by the control device communication.

Therefore, in the control device 11, not only the electric device 12 having the control device communication function but also the electric device 12 having no control device communication function can be registered according to the response signal.

When the response request signal from the request electric device 12 includes the device information of the request electric device 12, the electric device 12 that has detected the response request signal has the request electric device 12 included in the response request signal. A response signal including the device information of the above can be transmitted to the control device 11.

Further, when the response request signal from the request electric device 12 does not include the device information or the like of the request electric device 12, the electric device 12 that has detected the response request signal includes the device information or the like of the request electric device 12. The response signal that is not received is transmitted to the control device 11. In this case, the control device 11 can recognize the existence of the requested electric device 12 that does not have the control device communication function, but cannot recognize the device information or the like of the requested electric device 12. In this case, the device information and the like of the requested electric device 12 can be manually input by the user by operating the control device 11.

On the other hand, if it is determined in step S131 that the microphone 71 is not provided, the process proceeds to step S142, and the electric device 12 determines whether or not the trigger detection unit 64 has detected the change trigger signal.

If it is determined in step S142 that the change trigger signal has been detected, the process proceeds to step S139, and the above-described process is performed below.

Here, step S142 is performed when it is determined in step S142 that the electric device 12 does not have the microphone 71. Therefore, the change trigger signal detected (determined) in step S142 is a modal signal other than sound (for example, light), which is a modal signal that can be received by the input device of the electric device 12. is there.

From the above, in the electric device 12 having no microphone 71 capable of receiving the input of the sound trigger signal, the sound other than the sound output by the other electric device 12 in response to the detection of the sound trigger signal output by the control device 11 When the modal change trigger signal is detected, a change trigger signal (another change trigger signal) different from the change trigger signal is output in response to the detection of the change trigger signal from the other electric device 12. However, in the electric device 12 that has detected the change trigger signal, when the reissue prevention flag is TRUE, that is, when the change trigger signal has already been output in response to the detection of the past change trigger signal. Does not output any further change trigger signals.

Further, when the electric device 12 that has detected the change trigger signal other than the sound has the control device communication function, the response signal including the device information of the electric device 12 is transmitted by the control device communication in the electric device 12. It is transmitted to the control device 11.

Further, when the electric device 12 that has detected the change trigger signal other than the sound does not have the control device communication function, the response request signal is output from the output device of the electric device 12.

The response signal of the request electric device 12, which is the electric device 12 that outputs the response request signal, that is, the response signal of the electric device 12 that has detected the change trigger signal other than the sound is requested by the electric device 12 having the control device communication function. When the response request signal output by the electric device 12 is detected, it is transmitted to the control device 11 by the control device communication by the electric device 12 having the control device communication function.

On the other hand, if it is determined in step S142 that the change trigger signal has not been detected, the process proceeds to step S143, and the electric device 12 determines whether or not the response request signal has been detected in the trigger detection unit 64.

If it is determined in step S143 that the response request signal has not been detected, the process returns to step S142.

If it is determined in step S143 that the response request signal has been detected, the process proceeds to step S141, and the above-described processing is performed below.

Therefore, in the electric device 12 having no microphone 71, when the response request signal of the requesting electric device 12 is detected, the same processing as that of the electric device 12 having the microphone 71 is performed.

That is, when the electric device 12 (another electric device) that does not have the microphone 71 detects the response request signal of the request electric device 12, when it has the control device communication function, the request electricity corresponds to the detection of the response request signal. Instead of the device 12, the response signal of the requested electric device 12 is transmitted to the control device 11 by the control device communication.

As described above, the control device 11 sets the registration location and outputs a trigger signal that serves as a trigger for the electric device 12 to respond. Then, the registration location and the electric device 12 for which the response signal to the trigger signal is received are registered in association with each other.

On the other hand, in the electric device 12 having a microphone 71 capable of receiving sound, which is a modal of the trigger signal, and within the range where the trigger signal from the control device 11 can reach, the trigger signal from the control device 11 is detected. A change trigger signal is output according to the detection of the trigger signal. Further, a response signal or a response request signal is output according to the detection of the trigger signal.

Further, in the electric device 12 which is modal of the trigger signal and does not have the microphone 71 capable of accepting sound, and the electric device 12 which has the microphone 71 but is not within the reach of the trigger signal from the control device 11. A change trigger signal output by another electric device that has detected a trigger signal from the control device 11 is detected, and another change trigger signal is output in response to the detection of the change trigger signal. Further, a response signal or a response request signal is output according to the detection of the change trigger signal.

Therefore, in the control device 11, with respect to the electric device 12 installed at the registration place, not only the electric device 12 having an input device capable of accepting the modal of the trigger signal but also the electric device 12 having no such input device. Even if there is, it can be easily registered in association with the registration location.

Here, when this technology is not applied, when the electric device 12 is remotely controlled, for each electric device 12, the place where the electric device 12 is installed and an input device such as a sensor mounted on the electric device 12 are used. It is necessary for the user to manually register the necessary profile of the electric device 12 other than the location in the control device 11.

However, when registering the required profile of the electric device 12 manually, IT (Information Technology) literacy is required. Therefore, unless the user has a certain level of knowledge, the required profile of the electric device 12 can be registered. It may be difficult to register manually. Further, manual registration is a burden for the user.

In addition, although the electric device 12 is currently being converted to IoT, for the time being, the electric device 12 that has been converted to IoT, that is, the electric device 12 that is equipped with the control device communication function, has been converted to IoT. It is expected that the environment in which electrical equipment 12 such as white goods that are not used will continue to coexist.

For the electric device 12 on which the control device communication function is mounted, the necessary profile of the electric device 12 can be registered by performing the control device communication with the control device 11, but the control device communication function is mounted. For the electric device 12 that has not been performed, it is necessary to manually register the necessary profile of the electric device 12.

According to this technology, a smartphone as a control device 11 is taken to a registration place, and an electric device as a corresponding device installed at the registration place is performed as a simple operation, for example, by touching a screen. 12 can be registered.

According to DLNA (registered trademark), it is possible to detect electric devices on the network such as TVs and recording devices, but it is not possible to detect the location where each electric device on the network is installed. Therefore, for example, when TVs of the same model exist as electrical devices on the network in each of a plurality of places (rooms), the user tries to remotely control the TV in the room in which he / she is located, and in another room, for example. It was inconvenient because the TV was sometimes controlled remotely.

In the present technology, the electric device 12 is registered in association with the place (registration place) where the electric device 12 is installed. Therefore, for example, the electric device 12 of the same model is installed in each of the plurality of places. If so, the electrical device 12 at a specific location can be easily remotely controlled.

FIG. 9 is a diagram showing an example of a combination of the modal of the change trigger signal and the input device that accepts the input of the change trigger signal.

As the modal of the change trigger signal, the same modal sound as the trigger signal can be adopted. The sound as the change trigger signal can be received (sensed) by the microphone that senses the sound. When a modal sound having the same modal as the trigger signal is adopted as the modal of the change trigger signal, the output of the sound change trigger signal can be regarded as a retransmission or relay of the sound trigger signal.

Other modal changes trigger signals include light as the blinking LED of the power supply, physical movement, light as the blinking IR of the LED that outputs IR (infrared light) used in remote commanders, etc., Bluetooth. Signals transmitted / received via (registered trademark) communication, signals transmitted / received via LAN, signals transmitted / received via ZigBee (registered trademark) communication, and the like can be adopted. Here, the physical movement is the movement of an object caused by driving the object by a mechanical mechanism, for example, the movement of opening and closing the lid and the door, the movement of rotating a rotary table such as a microwave oven, and the return type. A push button-like shape is a dented / popped out movement.

The light as the blinking LED of the power supply etc. and the physical movement can be input by the RGB camera that receives visible light. The light as the blinking of the IR of the LED can be received by the IR camera that receives the IR or the light receiving part of the remote commander. Signals sent and received via Bluetooth® communication can be input via the Bluetooth® communication interface. Signals sent and received on a LAN can be input by the LAN interface. Signals sent and received in ZigBee® communication can be input by the ZigBee® communication interface.

FIG. 10 is a diagram showing an example of a response request signal.

When the modal of the response request signal is the same modal sound as the trigger signal, a sound that can be distinguished from the trigger signal, that is, an arbitrary sound different from the trigger signal can be adopted as the response request signal. ..

For example, as shown in FIG. 10, when the sound trigger signal is a single "pip", the sound response request signal can be a "pip" that is a repetition of the single "pip". .. In addition, as the sound response request signal, an arbitrary sound different from the trigger signal, such as a sound having a pitch or length different from that of the sound trigger signal, or a chord containing the sound trigger signal as one sound, should be adopted. Can be done.

In the electric device (requested electric device) 12 that outputs the response request signal, as shown in FIG. 10, the device information of the requested electric device 12 and other information related to the requested electric device 12, for example, the requested electric device 12 is a refrigerator. It is possible to output a sound as a response request signal including information such as having a human sensor as an input device.

In the electric device 12 having the control device communication function, when the response request signal including the information about the request electric device 12 is detected, the response signal including the information about the request electric device 12 is transmitted to the control device 11 by the control device communication. can do.

When a response request signal that does not include information about the requested electric device 12 is detected in the electric device 12 that has the control device communication function, a response signal that notifies the existence of the requested electric device 12 that does not have the control device communication function is sent. , It is transmitted to the control device 11 by the control device communication.

FIG. 11 is a diagram showing an example of the format of the response signal.

FIG. 11 shows an example of a packet format as a response signal.

In FIG. 11, the packet as a response signal is configured by arranging 8-bit location information, 8-bit device information, and 16-bit device information from the beginning.

The location information is the location where the trigger signal or the electrical device 12 (hereinafter, also referred to as the response electrical device 12) that outputs the response signal in response to the detection of the change trigger signal output in response to the detection of the trigger signal is installed. Represents. The location information is included in the response signal when it is included in the profile of the response electrical device 12 stored in the storage unit 63 of the response electrical device 12. When the response signal includes location information, the control device 11 selects one of the registered location and the location represented by the location information included in the response signal according to, for example, a user's operation, and responds to electricity. It is registered in association with the device 12.

The device information represents the type of response electrical device 12 (for example, a category such as "refrigerator" or "fan").

The device information represents an input device and an output device included in the response electric device 12.

Note that the response signal can include the profile of the response electrical device 12 other than the location information, the device information, and the device information.

FIG. 12 is a diagram showing an example of location allocation for 8 bits as location information.

In FIG. 12, for example, 00000000 as location information indicates that the location is unknown. Further, for example, 00000001, 00000010 and 00000011 as location information represent kitchen 1, kitchen 2, and kitchen 3, respectively. The kitchen 1, the kitchen 2, and the kitchen 3 are, for example, a kitchen existing in a separate room or a specific place in the kitchen of one room (for example, when the kitchen is divided into two sections by a workbench of an Irish kitchen). Each section, etc.) is represented.

FIG. 13 is a diagram showing an example of assignment of the type of the electric device 12 to 8 bits as device information.

In FIG. 13, for example, 00000000 as device information indicates that the type is unknown (Unknown). Further, for example, 00000001 as device information indicates that the type is a refrigerator.

FIG. 14 is a diagram showing an example of device allocation for 16 bits as device information.

In FIG. 14, for example, the control device communication interface is assigned to the first bit Bit1 (from the least significant bit or the most significant bit) of the 16-bit device information. A camera, a microphone, a speaker, a motion sensor, a temperature sensor, and an odor sensor are assigned to the 2nd to 7th bits of the 16-bit device information, Bit2 to Bit7, respectively. Bits Bit8 to Bit16 of the 8th to 16th bits of the 16-bit device information are reserved.

When each bit of the device information is, for example, 1 of 0 and 1, it means that the electric device 12 has an input device or an output device assigned to the bit.

FIG. 15 is a diagram showing an example of a profile list in which the control device 11 registers the registration location and the electrical device 12 in association with each other.

In the control device 11, the type of the response electric device 12 and the registration location are associated with each other and registered in the profile list according to the response signal of the response electric device 12. Further, in the profile list, if necessary, the presence / absence of each input device and each output device in the response electric device 12 can be registered in association with (the type of) the response electric device 12.

In FIG. 15, 0s and 1s in the fields of input device and output device (device name) indicate that they do not have the input device or output device represented by the corresponding fields, and that they have, respectively.

FIG. 16 is a diagram showing an example of a registration screen displayed by the control device 11.

The registration screen is displayed on the control device 11 in step S117 of FIG. 7, and is also displayed according to a user operation or the like.

The registration screen has a "location" column, a "device name" column, a "type" column, a "function setting" button, a "no future discovery" check box, a "registration" button, and a "cancel" button.

In the "Location" column, the location where the (registered) electrical device 12 to be registered in the profile list is installed is displayed. In the "Location" field, a location is entered according to the user's operation. When the control device 11 displays the registration screen in step S117, the registration location set in step S114 is input by default in the "location" field.

In "Device name", the device name of the electrical device 12 registered in the profile list is displayed. In the "device name", the device name is input according to the operation of the user. The device name of the electric device 12 is the name of the electric device 12, and the electric devices 12 of the same type can be distinguished by giving different device names to the electric devices 12 of the same type. For example, in the kitchen, when an electric device 12 of the type "fan", that is, a fan is installed in front of the stove and in front of the sink, the device name "in front of the stove" is attached to the fan in front of the stove. By attaching the device name "Fan in front of the sink" to the fan in front of the sink, it is possible to distinguish between the two fans installed in the kitchen.

In "Type", the type of the electrical device 12 to be registered in the profile list is displayed. In "Type", the type is input according to the operation of the user. Further, when the control device 11 displays the registration screen in step S117, and the response signal of the response electric device 12 includes device information indicating the type of the response electric device 12, the "type" column is filled with the device information. Response The type represented by the device information included in the response signal of the electrical device 12 is input by default.

The "function setting" button is operated when the setting screen is displayed on the control device 11.

The "Do not discover in the future" check box is, for example, when the control device 11 displays the registration screen in response to the response signal of the response electrical device 12 in step S117, the user does not need to register the response electrical device 12. Then, the response electric device 12 is checked when it is desired to limit the display of the registration screen. When the "Do not discover in the future" check box is checked and the "Register" button is operated on the registration screen displayed for the response electrical device 12, the control device 11 then outputs a response signal for the response electrical device 12. Even if it is received, the display of the registration screen is restricted. In this case, it is possible to prevent the registration screen from being repeatedly displayed for the electric device 12 that the user has determined that registration is unnecessary.

The "Register" button is operated when registering the contents of the registration screen in the profile list. The "Cancel" button is operated when canceling the registration of the contents of the registration screen to the profile list.

On the setting screen displayed when the "function setting" button is operated, it is possible to set a function (unique function) peculiar to the electric device 12 to be registered in the profile list. For example, the user controls the functions (for example, power ON / OFF, microwave oven reheating, air conditioner temperature, etc.) of the electric device 12 that is remotely controlled by the control device 11 by operating the setting screen. The state (for example, power state and usage state) of the electric device 12 monitored by the device 11 can be set. By setting the state of the electric device 12 to be monitored by the control device 11, when the state of the electric device 12 changes, the electric device 12 can notify the control device 11 of information regarding the change in the state.

The setting screen also has a "save" button and a "cancel" button. The "Save" button is operated when saving the setting contents of the setting screen, and the "Cancel" button is operated when canceling the setting contents of the setting screen.

The UI (user interface) of the so-called learning remote controller (remote commander) is linked to the setting screen, and the IR pattern of the functions (power ON / OFF, etc.) of the electrical device 12 set on the setting screen in that UI. Can be learned. Further, the UI of the learning remote controller displays a profile list, and the electric device 12 to be remotely controlled by the UI of the learning remote controller can be selected from the electric devices 12 registered in the profile list.

FIG. 17 shows the first registration in which an electric device (non-compatible device) to which the present technology is applied is detected by the electric device (compatible device) 12 to which the present technology is applied and registered in the profile list of the control device 11. It is a figure explaining the method.

Since the non-compatible device does not particularly react to the trigger signal or the change trigger signal, even if the trigger signal is output from the control device 11, it cannot be registered in the profile list. Here, the non-compliant equipment includes electrical equipment to which the present technology can be applied, but has not yet been applied, and electrical equipment to which the present technology cannot be applied. An electric device to which this technology cannot be applied is, for example, an electric device 12-5 which is an electric kettle in FIG. 1, which cannot communicate with a control device and is an input device such as a camera or a microphone. , And an electrical device that does not have at least one of an output device such as a speaker.

In the first registration method, for example, in a corresponding device (electrical device) 12 having at least one of a thermo camera and a motion sensor, the position of a person is detected from an image taken by the thermo camera, for example. To. Further, in the compatible device 12, the position of the person detected from the image taken by the thermo camera and the position of the person detected by the motion sensor are time-integrated, and the person stays according to the result of the time integration. The location of the residence is specified. The corresponding device 12 estimates that some non-compatible device exists at the staying point (equipment estimation), and notifies the control device 11 of the device estimation result indicating that the device exists by the control device communication or the like.

When the control device 11 receives the notification of the device estimation result from the compatible device 12, it opens (displays) the registration screen (FIG. 16) and prompts the user to register the non-compatible device (in the profile list). In this case, in the profile list, the registration location associated with the compatible device 12 that estimates the existence of the non-compatible device is registered as the default registration location of the non-compatible device and is displayed on the registration screen. For non-compatible devices, the user inputs the device name and type on the registration screen.

In the control device 11, the user checks the "Do not discover in the future" check box on the registration screen (displayed) opened (displayed) for the non-compliant device presumed to exist in a certain retention point P. As a result, it is restricted that the registration screen is subsequently opened for non-compliant devices presumed to exist at the retention point P. In this case, for example, it is possible to prevent the registration screen from being repeatedly opened due to an erroneous estimation of the existence of a non-compatible device and such an erroneous estimation.

As described above, in the first registration method, it is presumed from the behavior of the person that some non-compatible device exists in the staying place where the person stays, and the user is prompted to register the non-compatible device. Non-compliant devices are registered.

In the first registration method, a person is detected in order to identify the place where the person stays. As described above, as a sensor (input device) that can be used for detecting a person, there are, for example, a motion sensor, a camera, and other sensors. Examples of the motion sensor include a far-infrared sensor, an ultrasonic sensor, a barometric pressure sensor, and a carbon dioxide sensor. Examples of the camera include an RGB camera, a thermo camera, and a depth sensor. Other sensors include pressure sensors located on the floor.

FIG. 18 is a diagram illustrating a second registration method in which a non-compatible device is detected by the compatible device 12 and registered in the profile list of the control device 11.

In the second registration method, for example, in the corresponding device 12 having the thermo camera, the time change of the temperature is detected from the image taken by the thermo camera. Further, the corresponding device 12 estimates that some non-compatible device exists (equipment estimation) at the place where the temperature changes according to the time change of the temperature, and the control device determines the device estimation result indicating that the device exists. Notify the control device 11 by communication or the like.

Upon receiving the notification of the device estimation result from the corresponding device 12, the control device 11 opens the registration screen (FIG. 16) and performs the same processing as in the case of the first registration method.

As described above, in the second registration method, it is estimated that some non-compatible device exists at the place where the temperature changes from the time change of the temperature, and the user is prompted to register the non-compatible device. Non-compliant devices are registered.

In the second registration method, a physical quantity other than temperature can be sensed, and the existence of a non-compatible device can be estimated according to the change in the physical quantity.

As a sensor (input device) that senses a physical quantity used for estimating the existence of a non-compatible device in the second registration method, for example, a thermo camera, an RGB camera, or a depth camera can be adopted. According to the thermo camera, for example, the existence of the non-compatible device can be estimated from the heat generated by the power source of the non-compatible device and the heat of the heat source of the non-compatible device for cooking. For the RGB camera, for example, using a database that stores the standard pattern used for image recognition, the captured image taken by the RGB camera is matched with the standard pattern, and the non-compatible device as the subject reflected in the captured image is recognized. By doing so, the existence of non-compatible devices can be estimated. In the depth camera, for example, distance measurement is performed by the method adopted by Microsoft Kinect, and the three-dimensional shape of the non-compatible device as the object of distance measurement is recognized from the distance obtained by the distance measurement. , The existence of non-compliant devices can be estimated.

Here, in the first and second registration methods, it is possible to estimate the existence of non-compatible devices using a plurality of types of input devices. For example, in the first and second registration methods, in addition to the motion sensor described with reference to FIGS. 17 and 18, an RGB camera that receives visible light is used, and image recognition for an image taken by the RGB camera is performed. Then, the existence of the non-compatible device can be estimated, and the model of the non-compatible device can be estimated by using the recognition result of the image recognition.

Further, on the registration screen (FIG. 16) of the control device 11, the user can manually input all the items and register any electric device in the profile list.

Further, as the control device 11, in addition to adopting a smartphone, a TV, a PC (Personal Computer), an AR (augmented reality) / VR (virtual reality) glass, a wearable device such as a smart watch, etc. are adopted. be able to.

Next, a part or all of the series of processes of the control device 11 and the electric device 12 described above can be performed by hardware or by software. When a series of processes is performed by software, the programs constituting the software are installed on a general-purpose computer or the like.

FIG. 19 is a block diagram showing a configuration example of an embodiment of a computer on which a program for executing the above-mentioned series of processes is installed.

The program can be recorded in advance on the hard disk 905 or ROM 903 as a recording medium built in the computer.

Alternatively, the program can be stored (recorded) in the removable recording medium 911 driven by the drive 909. Such a removable recording medium 911 can be provided as so-called package software. Here, examples of the removable recording medium 911 include a flexible disc, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disc, a DVD (Digital Versatile Disc), a magnetic disc, and a semiconductor memory.

The program can be installed on the computer from the removable recording medium 911 as described above, or can be downloaded to the computer via a communication network or a broadcasting network and installed on the built-in hard disk 905. That is, for example, the program transfers wirelessly from a download site to a computer via an artificial satellite for digital satellite broadcasting, or transfers to a computer by wire via a network such as LAN (Local Area Network) or the Internet. be able to.

The computer has a built-in CPU (Central Processing Unit) 902, and the input / output interface 910 is connected to the CPU 902 via the bus 901.

When a command is input by the user by operating the input unit 907 or the like via the input / output interface 910, the CPU 902 executes a program stored in the ROM (Read Only Memory) 903 accordingly. .. Alternatively, the CPU 902 loads the program stored in the hard disk 905 into the RAM (Random Access Memory) 904 and executes it.

As a result, the CPU 902 performs processing according to the above-mentioned flowchart or processing performed according to the above-mentioned block diagram configuration. Then, the CPU 902 outputs the processing result from the output unit 906 or transmits it from the communication unit 908, and further records it on the hard disk 905, if necessary, via the input / output interface 910.

The input unit 907 is composed of a keyboard, a mouse, a microphone, and the like. Further, the output unit 906 is composed of an LCD (Liquid Crystal Display), a speaker, or the like.

Here, in the present specification, the processing performed by the computer according to the program does not necessarily have to be performed in chronological order in the order described as the flowchart. That is, the processing performed by the computer according to the program also includes processing executed in parallel or individually (for example, parallel processing or processing by an object).

Further, the program may be processed by one computer (processor) or may be distributed processed by a plurality of computers. Further, the program may be transferred to a distant computer and executed.

Further, in the present specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..

The embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.

For example, this technology can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.

In addition, each step described in the above flowchart can be executed by one device or shared by a plurality of devices.

Further, when one step includes a plurality of processes, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

Further, the effects described in the present specification are merely examples and are not limited, and other effects may be obtained.

Note that this technology can have the following configurations.

<1>
A setting unit that sets the location where electrical equipment is installed,
An output unit that outputs a trigger signal, which is a trigger for the electric device to respond, and an output unit.
An information processing device including a registration unit that registers the location and the electrical device that has responded to the trigger signal in association with each other.
<2>
Equipped with a communication unit for communication
The communication unit receives a response signal, which is a response to the trigger signal, transmitted by the electric device capable of performing the communication, and receives the response signal.
The information processing device according to <1>, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
<3>
The communication unit receives the response signal of the electric device transmitted by another electric device that has detected the response request signal of the electric device requesting the response by the response signal.
The information processing device according to <2>, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
<4>
The communication unit
The response signal of the second electric device transmitted by the second electric device that has detected the change trigger signal output by the first electric device in response to the detection of the trigger signal.
Alternatively, the response of the third electric device transmitted by the second electric device that has detected the response request signal requesting the response of the response signal output by the third electric device in response to the detection of the change trigger signal. Signal The information processing apparatus according to <2> or <3>, wherein the registration unit registers the location and the second electric device or the third electric device in association with each other in accordance with the response signal.
<5>
The information processing apparatus according to <4>, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
<6>
The information processing device according to any one of <1> to <5>, wherein the trigger signal is sound.
<7>
Setting the location where electrical equipment is installed and
To output a trigger signal, which is a trigger for the electric device to respond,
An information processing method including registering the location in association with the electrical device that has responded to the trigger signal.
<8>
A detector that detects a trigger signal, which is a trigger for making a response, from an information processing device.
It is provided with an output unit that outputs a change trigger signal different from the trigger signal in response to the detection of the trigger signal.
An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the trigger signal.
<9>
The electrical device according to <8>, which limits the output of the change trigger signal according to the detection of the change trigger signal after the output of the change trigger signal.
<10>
Further equipped with a communication unit capable of communicating with the information processing device,
The electrical device according to <8> or <9>, wherein the communication unit transmits the response signal.
<11>
The electrical device according to <8> or <9>, which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
<12>
The detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
The electric device according to <10>, wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
<13>
The electrical device according to any one of <8> to <12>, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
<14>
Detecting a trigger signal from an information processing device that triggers a response,
In response to the detection of the trigger signal, a change trigger signal different from the trigger signal is output, and
A processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the trigger signal.
<15>
A detection unit that detects a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device.
It is provided with an output unit that outputs another change trigger signal in response to the detection of the change trigger signal.
An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the change trigger signal.
<16>
Further equipped with a communication unit capable of communicating with the information processing device,
The electrical device according to <15>, wherein the communication unit transmits the response signal.
<17>
The electrical device according to <15>, which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
<18>
The detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
The electric device according to <16>, wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
<19>
The electrical device according to any one of <15> to <18>, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
<20>
To detect a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for making a response from the information processing device.
To output another change trigger signal in response to the detection of the change trigger signal,
A processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the change trigger signal.

10 Electrical equipment control system, 11 Control device, 12-1 to 12-5 Electrical equipment, 21 Input unit, 22 Output unit, 23 Storage unit, 24 Trigger generation unit, 25 Control unit, 27 Network unit, 28 I / F unit , 31 touch panel, 32 buttons, 41 display, 42 speaker, 51 profile control unit, 61 input unit, 62 output unit, 63 storage unit, 64 trigger detection unit, 65 trigger generation unit, 66 control unit, 67 network unit, 68 I / F section, 71 microphone, 72 camera, 73 temperature sensor, 81 speaker, 82 LED, 83 display, 91 trigger analysis section, 92 profile control section, 93 sensor data analysis section, 901 bus, 902 CPU, 903 ROM, 904 RAM , 905 hard disk, 906 output unit, 907 input unit, 908 communication unit, 909 drive, 910 input / output interface, 911 removable recording medium

Claims

A setting unit that sets the location where electrical equipment is installed,
An output unit that outputs a trigger signal, which is a trigger for the electric device to respond, and an output unit.
An information processing device including a registration unit that registers the location and the electrical device that has responded to the trigger signal in association with each other.
Equipped with a communication unit for communication
The communication unit receives a response signal, which is a response to the trigger signal, transmitted by the electric device capable of performing the communication, and receives the response signal.
The information processing device according to claim 1, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
The communication unit receives the response signal of the electric device transmitted by another electric device that has detected the response request signal of the electric device requesting the response by the response signal.
The information processing device according to claim 2, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
The communication unit
The response signal of the second electric device transmitted by the second electric device that has detected the change trigger signal output by the first electric device in response to the detection of the trigger signal.
Alternatively, the response of the third electric device transmitted by the second electric device that has detected the response request signal requesting the response of the response signal output by the third electric device in response to the detection of the change trigger signal. Receive the signal,
The information processing device according to claim 2, wherein the registration unit registers the location and the second electric device or the third electric device in association with each other in response to the response signal.
The information processing device according to claim 4, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
The information processing device according to claim 1, wherein the trigger signal is sound.
Setting the location where electrical equipment is installed and
To output a trigger signal, which is a trigger for the electric device to respond,
An information processing method including registering the location in association with the electrical device that has responded to the trigger signal.
A detector that detects a trigger signal, which is a trigger for making a response, from an information processing device.
It is provided with an output unit that outputs a change trigger signal different from the trigger signal in response to the detection of the trigger signal.
An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the trigger signal.
The electric device according to claim 8, wherein after the output of the change trigger signal, the output of the change trigger signal is restricted according to the detection of the trigger signal.
Further equipped with a communication unit capable of communicating with the information processing device,
The electrical device according to claim 8, wherein the communication unit transmits the response signal.
The electric device according to claim 8, which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
The detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
The electric device according to claim 10, wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
The electrical device according to claim 8, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
Detecting a trigger signal, which is a trigger for making a response, from an information processing device
In response to the detection of the trigger signal, a change trigger signal different from the trigger signal is output, and
A processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the trigger signal.
A detection unit that detects a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device.
It is provided with an output unit that outputs another change trigger signal in response to the detection of the change trigger signal.
An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the change trigger signal.
Further equipped with a communication unit capable of communicating with the information processing device,
The electrical device according to claim 15, wherein the communication unit transmits the response signal.
The electrical device according to claim 15, which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
The detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
The electric device according to claim 16, wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
The electrical device according to claim 15, wherein the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
To detect a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for making a response from the information processing device.
To output another change trigger signal in response to the detection of the change trigger signal,
A processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the change trigger signal.