JP2017046295A - Equipment operation confirmation system and remote control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily and surely confirm that control object equipment to be remotely controlled has performed an operation.SOLUTION: In an equipment operation confirmation system including a remote control device for remotely controlling control object equipment and an operation confirmation device for detecting the operation state of the control object equipment, the remote control device includes: a control signal output part for transmitting a control signal for causing the control object equipment to execute a predetermined function; a first confirmation information communication part for receiving an operation confirmation signal indicating the operation state of the control object equipment detected by the operation confirmation device; and an operation confirmation notification part for notifying a user of a confirmation result indicating that the control object equipment has performed an operation corresponding to the control signal on the basis of the operation state of the control object equipment included in the received operation confirmation signal. An operation confirmation device includes: an operation detection part attached to the control object equipment for acquiring a measurement value indicating the operation state of the control object equipment; and a second confirmation information notification part for transmitting an operation confirmation signal consisting of the information of the operation state of the control object equipment including the acquired measurement value.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a device operation confirmation system and a remote control device, and in particular, when a user remotely controls a home appliance such as an air conditioner, the device operation confirmation system and home appliance that allow the user to confirm the operation state of the home appliance. The present invention relates to a remote control device that performs remote control of equipment.

Conventionally, a remote control system that remotely controls the operation of home appliances such as an air conditioner and a television by using a remote controller that outputs an infrared signal has been used.
In addition, a remote control system that transmits information for controlling home appliances from a mobile terminal to a remote controller via a network such as a LAN or the Internet, and that allows users who are outdoors or in different rooms to remotely control home appliances is also used. Has been.

  Also, the remote control code of the manufacturer of the electrical device to be operated is acquired by the mobile phone via the Internet, the command for the acquired remote control code is transmitted to the remote control station by the radio wave signal RF, and the command received by the remote control station is decoded. Then, a remote control system for remotely controlling a plurality of household electric appliances in a house by a single remote control station by converting the infrared signal IR to control the electrical equipment and transmitting to the electrical equipment is also proposed. (See Patent Document 1).

  In addition, the remote control device that transmits the infrared light for operating the remote control device turns on and off the infrared LED by detecting the current change of the camera and the AC power supplied to the remote control device. The operation state of the remote controlled device (operation) is obtained by taking an image including an infrared light LED with a camera and comparing the image data taken before and after transmitting the infrared light. , Stop), and a remote control system that transmits the confirmed operating state to a user's mobile phone or the like has been proposed (see Patent Document 2).

  In addition, in order to preset a remote control signal for controlling a device of a specific manufacturer in a remote controller with a preset function, a user inputs a signal of one key of a dedicated remote controller for controlling the device of that manufacturer, and the input signal If the analyzed transmission format etc. exists in the preset memory data stored in the ROM in advance, the input key and other keys, including the input keys, should correspond to the keys on the dedicated remote controller. There has been proposed a remote control device for uniformly setting signals of a remote controller with a preset function (see Patent Document 3).

JP 2007-116484 A JP 2008-182400 A Japanese Patent Laid-Open No. 5-103375

However, in a conventional system for remotely controlling home appliances, after a user performs a control operation, a user who is not near the home appliances directly confirms whether or not the controlled home appliance has operated as requested. I could not.
In the system of Patent Document 2, although the operation state of the remote control device can be confirmed based on the lighting state of the infrared LED taken by the camera, the operation state of the remote control device itself is directly determined. If the infrared LED is out of order, the correct operation cannot be confirmed.
Moreover, it is necessary to provide a camera and a motion detection device, which makes the system expensive.

In addition, when using a dedicated remote control device that has been used in the past, which only outputs an infrared signal for remote control and cannot be operated without a camera, the operating state of the control target device cannot be confirmed.
Even if the remote control device has a function of remotely controlling a plurality of home appliances in advance, when used to control a specific home appliance, information such as the model number of the specific home appliance is used by the user. It is necessary for the user to set and register information on a specific home appliance by performing a key input operation of a specific remote control of the specific home appliance as in Patent Document 3, and as a remote control device, The burden of the user's setting operation before using it was heavy.

  Therefore, the present invention has been made in consideration of the above circumstances, and easily performs initial setting of control signals to be output to a plurality of home appliances that are actually remotely controlled, and is subject to control. It is an object of the present invention to provide a device operation confirmation system and a remote control device that allow a user who is not near the home appliance to easily and surely confirm that the home appliance has actually operated.

  The present invention is a device operation confirmation system comprising a remote control device for remotely controlling a device to be controlled by a predetermined control signal, and an operation confirmation device for detecting an operation state of the device to be controlled, the remote control device Wirelessly transmits a control signal output unit for wirelessly transmitting a control signal for causing the control target device to execute a predetermined function, and an operation confirmation signal indicating an operation state of the control target device detected by the operation check device. And the operation corresponding to the control signal transmitted from the control target device to the control target device based on the operation state of the control target device included in the received operation check signal. An operation confirmation notifying unit for notifying a user of a confirmation result indicating that the operation confirmation device is attached to the device to be controlled, and the operation state of the device to be controlled is provided. And a second confirmation information communication unit for wirelessly transmitting the operation confirmation signal including information on an operation state of the control target device including the acquired measurement value. It is an object of the present invention to provide a device operation confirmation system characterized by comprising the above.

In addition, the operation detection unit is configured to operate vibration generated when the control target device performs a predetermined function, flow of air generated when the control target device performs a predetermined function, and the control target device operates. At least one of at least one of a current value, a temperature of the device to be controlled, an illuminance around the device to be controlled, and a sound generated when the device to be controlled performs a predetermined function A measurement value is obtained.
According to this, since the measurement value based on the vibration generated when the control target device executes a predetermined function is acquired, it can be detected that the control target device actually operates, The operating state of the target device can be confirmed reliably.
The remote control device further includes a display unit and an audio output unit, and the operation confirmation notifying unit displays the confirmation result on the display unit and the audio output from the audio output unit. The user is notified by either one or both.
According to this, since the confirmation result is notified by at least one of display and sound, the user can easily understand that the control target device has operated by viewing either the display or sound. And it can be confirmed reliably.

  The remote control device further includes a server that performs data communication with the remote control device via a network, the remote control device further includes an external device communication unit that communicates with the server, and the external device communication unit includes the first confirmation. The information communication unit transmits the operation state information of the control target device included in the operation confirmation signal received to the server, and the server analyzes the received operation state information of the control target device and displays the analysis result. The operation confirmation notifying unit transmits to the remote control device, and notifies the user of the confirmation result of the operation state of the control target device based on the received analysis result.

The mobile terminal further includes a mobile terminal that performs data communication with the remote control device and the server via a network, and the mobile terminal sends a control request to the control target device input from the mobile terminal via the server. Transmitting to the remote control device, and a control signal output unit of the remote control device outputs a control signal for executing a function corresponding to the control request to the control target device based on the received control request Then, the server transmits an analysis result obtained by analyzing the received operation state information of the control target device to the mobile terminal, and the mobile terminal determines the control target device based on the received analysis result. An operation state confirmation result is output.
According to this, since the confirmation result of the operation state of the control target device is output from the mobile terminal, the user who owns the mobile terminal can be far away even if the user is not in the room where the control target device is installed. Even when the user is out, the operation state of the control target device can be easily and reliably confirmed.

  In addition, the remote control device and the operation confirmation device communicate predetermined information by short-range wireless communication. Here, the short-range wireless communication may use data communication using Bluetooth.

Further, the remote control device further includes a storage unit, and device setting information in which a plurality of control signals for remotely controlling each control target device is set in the storage unit for each of the plurality of control target devices in advance. The control signal output unit sequentially outputs control signals for controlling all the control target devices stored in the storage unit at regular intervals, and based on the one control signal output, When the control target device to which the operation check device is attached executes a predetermined function, the operation detection unit of the operation check device indicates a measurement value indicating the operation state of the control target device caused by executing the function. When the second confirmation information communication unit transmits the operation confirmation signal including the acquired measurement value, and the first confirmation information communication unit of the remote control device receives the operation confirmation signal, The storage unit stores device confirmation correspondence information that associates the control target device with the function executed with the operation check device attached to the control target device, and controls the control target device with the function executed. The control signal that can be set is initialized.
According to this, the initial setting of the control signal can be easily performed in the remote control device.

  Further, the present invention provides a control signal output unit that wirelessly transmits a control signal for causing a control target device to execute a predetermined function, and a control target device detected by an operation check device attached to the control target device. The control target device based on the information on the operation state of the control target device included in the received operation check signal and the confirmation information communication unit that wirelessly receives the operation check signal indicating the operation state of the control target device. There is provided a remote control device comprising an operation confirmation notifying unit for notifying a user of a confirmation result indicating that an operation corresponding to a control signal transmitted to the control target device is performed.

  According to this invention, when a control signal for controlling the control target device is transmitted from the remote control device, the operation confirmation device attached to the control target device detects the operation state of the control target device, and is detected. An operation confirmation signal indicating the operation state is transmitted to the remote control device, and the remote control device notifies the user of a confirmation result indicating that the device to be controlled has performed an operation corresponding to the control signal. Even if the operation of the device is not directly monitored, even if the control target device itself is not provided with means for notifying the operation state, the operation state of the control target device can be easily and reliably confirmed.

It is a block diagram of the configuration of an embodiment of the device operation confirmation system of the present invention. It is a block diagram of a configuration of an embodiment of a remote control device of the present invention. It is a block diagram of the configuration of an embodiment of the operation check device of the present invention. It is explanatory drawing of one Example of the information memorize | stored in the memory | storage part of this invention. It is explanatory drawing of one Example of the detection item of the control object apparatus in the operation confirmation apparatus of this invention. It is explanatory drawing of the operation confirmation process (1st Example) when a user inputs operation. It is explanatory drawing of the operation confirmation process (2nd Example) when a user inputs operation using a dedicated remote control. It is explanatory drawing of the operation confirmation process (3rd Example) in the case of automatically transmitting temperature information as operation confirmation information from a monitoring object apparatus. It is explanatory drawing of the operation confirmation process (4th Example) when a user inputs voice. It is explanatory drawing of the operation confirmation process (5th Example) when the user who is outdoors controls a control object apparatus remotely. It is a sequence diagram of one Example of the process (6th Example) which initializes the control signal for controlling a control object apparatus to a remote control. It is a sequence diagram of one Example of the operation confirmation process when a user controls a control object apparatus by voice input. It is a sequence diagram of one Example of the operation check process when the user who is outdoors controls the control target device remotely.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, this invention is not limited by description of the following examples.
<Configuration of equipment operation confirmation system>
FIG. 1 is a block diagram showing the configuration of an embodiment of the device operation confirmation system according to the present invention.
In FIG. 1, a device operation check system according to the present invention mainly includes a server (SV) 1, a portable terminal (TE) 2, a remote control device (RMC) 3, a control target device (HE) 4, and an operation check device (CE). It is composed of five.
In this invention, when the user 7 performs an operation input or the like for executing a desired function to the control target device HE4 installed in the user-owned house, the operation check device (CE5) attached to the device Based on the acquired detection information, the user is notified that the device HE4 has executed the function using the remote control device (RMC3) or the portable terminal (TE2) possessed by the user. And

Hereinafter, the server 1 is also referred to as SV, the mobile terminal 2 as TE, the remote control device 3 as remote control or RMC, the control target device 4 as HE, and the operation check device 5 as checker or CE.
The server SV1 is a device having functions and information for supporting remote control using the remote control device RMC3 and the portable terminal TE2, and is installed in a management center or the like at a position different from the user's home, and is a network such as the Internet. 10 is connected to RMC 3 and TE 2 to perform data communication.
For example, as will be described later, the server SV1 includes a voice recognition function, a search function for a control signal corresponding to the recognized voice, and detection information (information on the operation state of the control target device) acquired by the operation detection unit of the operation confirmation device CE5. An analysis function is provided, and in order to realize this function, spoken language conversion information, control signal information for remotely controlling a control target device HE4 that is different for each manufacturer, information for determining the operation state of HE4 from detection information, etc. Is stored in advance.
For example, when the server SV1 receives information on the operation state of the HE4 from the RMC3, the server SV1 analyzes the information and transmits the analysis result to the RMC3.

As the network 10, in addition to a public network such as the Internet, a dedicated network that can be used only by a specific terminal may be used, and either a wired communication or a wireless communication may be used as a communication form.
However, it is preferable that the communication with the communication device used by moving such as the portable terminal TE2 is performed wirelessly.
In the following embodiment, communication via the network 10 is described as being performed by wireless communication using a wireless signal (wis).
The mobile terminal TE2 is a communication device possessed by the user, and corresponds to, for example, a mobile phone, a tablet terminal, a notebook computer, and the like, and is connected to the network 10 by predetermined wireless communication.
TE2 performs data communication with server SV1 and RMC3. For example, a control request for HE4 input at TE2 is transmitted to RMC3 via server SV1.

In this invention, when the user is out, the portable terminal TE2 is used as a device for performing activation, stop, setting, operation check, etc., on the home appliance (control target device) installed in the user's home. .
For example, in TE2, if an input operation is performed to activate an air conditioner that is one of HE4, a control signal for requesting activation is transmitted to the air conditioner. When the air conditioner is activated, the air conditioner is activated. The operation confirmation result is notified to TE2.

It is assumed that the remote control device RMC3, the control target device HE4, and the operation check device CE5 are installed in the user's home.
The remote control device RMC3 is a device for remotely controlling the control target device HE4 by a predetermined control signal, and corresponds to a so-called remote controller (hereinafter also referred to as a remote controller).
The control target device HE4 corresponds to a home appliance such as an air conditioner, and generally one or a plurality of home appliances that can be controlled by a remote controller are installed in each room of one house.
The HE4 includes not only devices installed in a room in the house but also devices installed in a site outside the building, such as a surveillance camera and an outdoor light. When HE4 is installed outside the building, CE5 attached to HE4 is also installed outside the building.

In addition, when a plurality of control target devices HE4 are installed in the home, generally, a separate dedicated remote controller is used for each control target device HE4. However, the RMC 3 of the present invention has one RMC3. This corresponds to a general-purpose remote controller that can control the HE4 and has a so-called preset function.
The control signal (irc) output from the RMC 3 uses directional infrared rays (IR) as in the conventional dedicated remote controller.
However, the control signal irc is not limited to infrared rays, and other radio signals may be used.

When controlling HE4 using infrared rays, it is preferable to install RMC3 in each room where HE4 is installed so that infrared rays are output toward the light receiving unit of HE4.
For example, if RMC3 is arranged in one room such as a living room, and three control target devices HE such as an air conditioner and a TV are installed in the room, RMC3 Initially set so that control signals to be controlled can be output.
In addition, in the present invention, the RMC 3 has a function of performing data communication with the operation check device CE5 attached to the operation target device HE4 as described later.

As described above, if RMC3 and HE4 are arranged in the same room, the distance between RMC3 and CE5 attached to HE4 is a relatively close distance that can be seen (for example, a distance of about 5 m). Therefore, it is preferable that the RMC 3 and the CE 5 perform data communication by so-called short-range wireless communication.
As the short-range wireless communication, any of existing communication technologies may be used. For example, wireless communication such as Bluetooth, ZigBee, or Z-Wave can be used.
However, among these wireless communications, it is preferable to use data communications using Bluetooth from the viewpoint of the penetration rate in Japan.
In the following embodiments, data communication between the RMC 3 and the CE 5 is performed by wireless communication using Bluetooth.

The operation check device CE5 is a device (checker) for detecting the operation state of the control target device HE4, and is associated with one control target device HE4.
The operation check device CE5 is, for example, a device having the same size as a cash card or a frisk case, and is attached in contact with the outer surface of the housing of the associated HE4. Or you may attach in the housing | casing of HE4 and you may attach between a power plug and an outlet socket.
In addition to home appliances that can be remotely controlled, CE5 is attached to devices that cannot be remotely controlled but whose operation status is to be monitored (for example, conventional lighting devices that can be turned on and off with a push button switch, electric heaters, etc.) May be.
Further, in order to allow the user to easily change the device that the user wants to confirm the operation of, for example, a double-sided tape or a magnet is attached to the CE 5 so that the structure of the CE 5 can be easily detached from the HE 4. preferable.

The operation check device CE5 mainly includes a sensor for obtaining a predetermined measurement value indicating the operation state of the HE4, and information on the operation state of the HE4 including the measurement value detected by the sensor (operation check signal ocs). ) Is transmitted to the RMC 3.
For example, when the CE 5 includes an acceleration sensor, the vibration can be detected by the acceleration sensor. However, when the HE 4 to which the CE 5 is attached starts and performs a predetermined function, when some vibration occurs, the acceleration is detected. Since the sensor outputs information (vibration detection information) indicating that vibration has occurred, the sensor transmits an operation confirmation signal ocs including vibration detection information indicating the operation state.

As described above, the operation confirmation signal ocs is output as a wireless signal such as Bluetooth, and is received by the paired RMC 3.
Therefore, in order to control the operation of the HE4, the control signal irs such as an infrared ray output from the RMC 3 or the dedicated remote controller is used, whereas in order to check the operation state of the HE4, the CE5 attached to the HE4. The operation confirmation signal ocs output from is used.
The CE 5 may be built in the home appliance HE to be sold from the beginning, but since the CE 5 can be sold as a relatively small, light, and inexpensive device, it is already installed in the house and It may be retrofitted to the conventional home appliance HE4 that does not have the function of data communication with the RMC 3, and the operation of the conventional home appliance HE4, which has previously been difficult to check the operation from a remote location, can also be confirmed. .

  In the present invention, in order for the user to confirm the operation, it is necessary to newly introduce RMC3 and CE5. However, the control signal output from RMC3 and the control signal output from the conventional dedicated remote controller are used. Since infrared rays of the same unified standard are used, even when the user performs an operation to control the HE4 using a dedicated remote controller, the RMC 5 receives the operation confirmation signal ocs output from the CE 5 to receive the operation confirmation signal ocs. The operation can be confirmed, and it is not necessary to replace the HE4 or the dedicated remote controller with a new product having an operation confirmation function, and an existing home appliance can be used effectively.

In addition, at the time of purchase, it is unknown which room of the purchased user the RMC 3 is installed in, and it is also unknown what control target device HE4 exists in the room where the RMC 3 is installed.
Therefore, in order to be able to output the control signal irs that can control the HE4 to be controlled using the RMC3 after the RMC3 is installed, the RMC3 is provided with any home appliances of as many manufacturers as possible that are currently on the market. It is preferable to store in advance device setting information in which a control signal for HE is set. Further, the operation confirmation signal ocs output from the CE 5 is initialized in advance to which operation state the HE 4 corresponds to, and before the operation confirmation processing is actually performed using the RMC 3 and the CE 5, the control is performed. Information (device confirmation correspondence information) that associates the target device HE4 with the CE 5 attached to the HE 4 needs to be stored in the RMC 3. In addition, for a HE that is not stored, such as a new model HE, the user needs to set and input a control signal for the HE.

  In addition, when the user is at home and controls HE4 using a dedicated remote controller, or when the user's mobile terminal TE is used at home and the wireless LAN used by the communication device only in the home is used, the operation of HE4 is performed. When the confirmation is performed, the TE 2 and the RMC 3 only need to have a function capable of connecting to the home wireless LAN.

<Configuration of remote control device (RMC)>
FIG. 2 is a block diagram showing the configuration of an embodiment of the remote control device RMC3 of the present invention.
As described above, the RMC 3 of the present invention wirelessly communicates with the SV1 and the TE2 via the network 10, and also performs short-range wireless communication with the CE5 via Bluetooth, and further controls the HE4 with infrared rays. It has a function of outputting irs.
In FIG. 2, the RMC 3 mainly includes a control unit 31, a data input unit 32, a display unit 33, a voice input unit 34, a voice output unit 35, an operation check notification unit 36, an external device communication unit 37, a control signal output unit 38, A confirmation information communication unit 39 and a storage unit 50 are provided.

The control unit 31 is a part that executes each function of the RMC of the present invention, and is mainly realized by a microcomputer including a CPU, a ROM, a RAM, an I / O controller, a timer, and the like.
The CPU organically operates various hardware based on a program stored in a ROM or the like, thereby executing the information communication function, the operation confirmation function, and the like of the present invention.
The data input unit 32 is a part where the user inputs data, selects a function of the RMC 3, and the like, and may use a key, a touch panel, or the like.
The display unit 33 is a part that displays information necessary for executing the functions of the RMC 3. An LCD, an organic EL display, or the like is used to display a data input screen, a function selection screen, an operation confirmation screen, and the like.

The voice input unit 34 is a part for inputting user's voice, and corresponds to a microphone.
For example, if the user generates a word for starting HE4 (air conditioner power on) toward the microphone, the control signal irs for turning on the power of the air conditioner corresponding to the recognized voice is recognized after the word is recognized as voice. It is output from the control signal output unit 38 of the RMC.
However, when the HE4 is not remotely controlled by voice, the voice input unit 34 may not be provided.
The voice output unit 35 is a part that outputs synthesized voice, and corresponds to a speaker.
Examples of the synthesized speech to be output include RMC operation explanation, guidance of data to be set or input, error notification, HE operating state notification, speech recognition result notification, and the like.

The operation confirmation notifying unit 36 is a part that informs the user of the result of confirming the operation of the device HE that has been remotely controlled by the user based on the operation state of the HE 4 sent from the SV 1 or the CE 5. For example, the user is notified of a confirmation result indicating that the HE 4 has performed an operation corresponding to the control signal transmitted to the HE 4.
The operation confirmation notifying unit 36 generates the contents of the confirmation result to be notified to the user, and the confirmation result is selected from the sound output from the sound output unit 35, the display on the display unit 33, the data transmission to the TE2, etc. The user is notified by at least one of the methods.
The method for notifying the user may be set to one in advance, but the method by which the user is notified may be changed.
Moreover, you may perform by the notification method previously matched with the control method of HE performed by the user.
For example, when the user inputs a control request by voice, the operating state of the HE is notified by voice, and when remotely controlled using the TE2 outdoors, the HE is connected to the TE2 via the external device communication unit 37. The operation state may be transmitted as data.

The external device communication unit 37 is a part that performs data communication with the server SV1 and the mobile terminal TE2 possessed by the user via the network 10. Information on the operation state of the HE 4 included in the operation confirmation signal ocs received by the confirmation information communication unit 39 is transmitted to the server SV1.
Also, for the TE2, data communication is performed using the radio signal wis, a control request for the HE input in the TE2 is received from the server SV, and the operation status of the HE generated by the operation check notification unit 36 is confirmed. Information is transmitted to TE2 via server SV.
Although not shown in FIG. 1, a router is provided in the premises 11 between the RMC 3 and the network 10. For example, when the RMC 3 is installed for each room, the router or a plurality of RMCs 3 may be connected wirelessly. A home LAN using a wired connection may be formed, and data communication may be performed between the plurality of RMCs 3 and the SV1 and the TE2 via a router.

The control signal output unit 38 is a part that wirelessly outputs a control signal irs for causing the control target device HE4 to execute a predetermined function.
As described above, the control signal irs may be an infrared ray that has been conventionally used to remotely control most home appliances.
However, the control signal is not limited to infrared, and may be any wireless signal. For example, WiFi, Bluetooth (registered trademark), ZigBee, Z-Wave, or the like may be used.
Further, the RMC 3 identifies the control target device HE based on the control request input from the user, and selects the control signal irs corresponding to the content of the control request from the device setting information of the device HE stored in advance. Then, the selected control signal irs is output.
When the HE4 receives the control signal irs, the HE4 confirms that the control signal irs is transmitted to itself, and then executes an operation associated with the control signal irs in advance.

The confirmation information communication unit 39 corresponds to the first confirmation information communication unit described above, and is a part that performs data communication with the operation confirmation device CE5. The confirmation information communication unit 39 mainly receives the operation confirmation signal ocs transmitted from the CE5 wirelessly.
The operation confirmation signal ocs is a signal indicating the operation state of the HE 4 detected by the CE 5. For example, it is a signal for transmitting operation confirmation information as will be described later with reference to FIG.
In addition, as described later, vibration detection information (operation start information) acquired by an acceleration sensor, temperature information acquired by a temperature sensor, illuminance information acquired by an illuminance sensor, sound acquired by a microphone, and air volume sensor The acquired air volume information, the current value acquired by the current sensor, and the like are included.
If the RMC 3 and the CE 5 are installed in the same room, the distance between the RMC 3 and the CE 5 is considered to be about several meters to several tens of meters. Therefore, the communication between the RMC 3 and the CE 5 is 50 m. What is necessary is just to perform wireless communication by Bluetooth capable of the following data communication.

The storage unit 50 stores information and programs necessary for the RMC 3 to execute a predetermined function. The storage unit 50 is a semiconductor storage element such as ROM, RAM, or flash memory, a storage device such as HDD or SSD, a DVD, or the like. These storage media are used.
The storage unit 50 mainly includes device setting information 51, device confirmation correspondence information 52, confirmation result notification information 53, control signal irs54, operation confirmation signal ocs55, control signal information 56, voice recognition request 57, voice recognition result 58, detection. An analysis request 59 and a detection analysis result 60 are stored.

The device setting information 51 is set and stored in advance for each of the plurality of control target devices HE4 in association with each HE4 and a plurality of control signals for remotely controlling the HE4. For example, the device setting information 51 is currently used. Information about home appliances of major manufacturers is stored.
Since controlled devices such as new devices and devices that are no longer used are added or deleted every day, the user stores control signal information for each device HE as needed via the network 10. It is preferable to connect to the device management server that receives the information regarding the necessary HE and update the device setting information 51.

FIG. 4A shows an explanatory diagram of an embodiment of the device setting information 51.
Here, the device setting information 51 is stored in association with device information for specifying each device and a plurality of control signal information (irs).
The device information includes a manufacturer name and a model name. For example, the air conditioner of Company A stores a plurality of control signal information (IR-a001, IR-a002,...) Previously associated with the device information. The
Here, the control signal information includes, for example, a control signal for turning on the device HE, a control signal for turning off the device HE, a control signal for setting a timer, and a control signal for changing the operation state. This is information for identification.
Also, even if the air conditioner has the same model name, if the manufacturer is different, the control signal information for turning on the air conditioner is different. Even if the manufacturer name is the same company A, if the model name is different, the power of the device is turned on. The control signal information for entering may be different.

The device confirmation correspondence information 52 is setting information in which the control target device HE4 and the operation confirmation device CE5 attached to the HE4 are associated with each other. By executing predetermined initial setting processing as described later, It recognizes which CE 5 is attached to the HE 4, and sets device confirmation correspondence information 52 that associates the HE 4 with the CE 5.
FIG. 4B shows an embodiment of the device confirmation correspondence information 52.
This information 52 mainly includes a CE identification number ID and device information HE.
In order to set the device confirmation correspondence information 52, device setting information 51 and operation confirmation information 85 to be described later are used.

For example, when a predetermined control signal irs is transmitted from the RMC 3, it is assumed that the device HE4 that has received the control signal irs operates.
At this time, since the device HE4 analyzes the received irs and recognizes that it is a control signal for itself, it executes a function associated with the received irs in advance.
For example, when the HE 4 is an air conditioner and recognizes that the control signal irs for turning on the air conditioner has been received, the air conditioner turns on its own power.
When HE4 is an air conditioner, and CE5 including a vibration detection unit including an acceleration sensor is attached to this air conditioner, when the air blower starts after the power is turned on, the vibration and wind direction when the blower blades rotate The vibration when the plate that changes is operated is detected by the acceleration sensor of CE5.
This detected vibration is acquired, for example, as a changing coordinate value (x, y, z), and is transmitted from the CE 5 to the RMC 3 as the operation confirmation information 85.
The operation confirmation information 85 also includes a CE identification number ID for distinguishing the CE 5 that is the sender.

When the RMC 3 transmits the control signal irs, it is known from the device setting information 51 to which device HE4 (manufacturer, model) the transmitted control signal irs corresponds. When the operation confirmation information 85 indicating that the device HE4 has been operated is sent from the CE 5 to the device HE4 that has transmitted the control signal irs, the identification number ID included in the information 85 is specified. It can be seen that CE5 is attached.
By the series of processes as described above, the device information of HE4 and the CE5 attached to HE4 are associated with each other, and device confirmation correspondence information 52 as shown in FIG. 4B is set.

The confirmation result notification information 53 is information indicating the confirmation result of the operation state of the HE 4, and based on the operation confirmation signal ocs indicating the operation state of the HE 4 transmitted from the CE 5 by the operation confirmation notification unit 36 described above. This is information notified to the user.
This information 53 is notified to the user by any one or more of voice, display, and data transmission.
The confirmation result notification information 53 is information such as “the air conditioner has been activated by the user's operation on the air conditioner”, for example.

As described above, the control signal irs54 is an infrared signal output to the control target device HE4, and a control signal corresponding to the HE4 actually installed in the home is selected from the device setting information 51 and output. Is done.
As described above, the operation confirmation signal ocs55 is a signal transmitted from the operation confirmation device CE5, for example, a signal corresponding to the Bluetooth standard.
The operation confirmation signal ocs includes operation confirmation information 85 indicating the operation state of the HE 4 to which the CE 5 is attached.
When the operation confirmation signal ocs is received, the operation confirmation information 85 included in the signal ocs is checked to check the information (identification number ID) of the CE 5 that has transmitted the signal ocs and the device HE4 to which the CE 5 is attached. And information (sensor detection information CHV) related to the current operation state of.
By using these pieces of information (ID, CHV) and the device confirmation correspondence information 52, it is possible to confirm what operation state the device HE that has performed remote control is currently in.

The control signal information 56 is information for specifying the control signal irs to be transmitted, and is information transmitted mainly from the server SV1, as will be described later.
For example, as shown in FIG. 12 to be described later, when the server SV1 recognizes a control request included in the voice generated by the user, the control signal for executing the control content requested by the user is specified as a result of the voice recognition. Since the information to be transmitted is transmitted from the SV 1 to the RMC 3, the external device communication unit 37 stores it as the control signal information 56.
Further, when the user makes a control request for reducing the sound of the television, when the control request is transmitted to the server SV, the server SV indicates that the control request is a request for reducing the sound of the television. After the recognition, control signal information 56 indicating that the control signal irs for controlling to reduce the sound of the television should be output is transmitted from SV1 to RMC3.

Furthermore, as shown in FIG. 13 to be described later, when the user performs an operation of remotely controlling the HE 4 using the TE 2, the same control signal information 56 is transmitted from the SV 1 to the RMC 3.
When the RMC 3 receives this control signal information 56, the control signal output unit 38 outputs the control signal irs specified by the control signal information 56.

The voice recognition request 57 is data for requesting the server SV1 to recognize the voice data when the voice uttered by the user is input from the voice input unit 34.
When a voice is input, it is temporarily stored as voice data in the storage unit 50, a voice recognition request including the voice data is generated, and transmitted to the server SV1 by the external device communication unit 37.

The voice recognition result 58 is information indicating the result of voice recognition performed by the server SV1.
When the voice recognition request 57 is transmitted to the server SV1, the server SV1 executes voice data recognition included in the request, acquires control signal information corresponding to the recognized voice, and the server SV1 Data including the acquired control signal information 56 is transmitted to the RMC 3 as a voice recognition result.
The server SV1 has a voice recognition function, and further includes a database that associates the recognized voice with control signal information corresponding to a word that the recognized voice means.
For example, if the requested voice data is “air conditioner power on”, the server recognizes that the voice data is “air conditioner power on” and the control signal corresponding to the recognized voice Information is obtained by searching the database.
When the control signal information corresponding to the recognized voice is acquired, the voice recognition result including the control signal information 56 capable of executing “air conditioner power on” is transmitted from the server SV to the RMC 3. The result 58 is stored in the storage unit 50.

The detection analysis request 59 is information that requests the server SV1 to analyze the operation state of the HE4 based on the operation confirmation signal ocs received from the CE5.
For example, when a coordinate measurement value (vibration information) due to vibration is sent from the acceleration sensor of CE5 as the operation confirmation signal ocs, a detection analysis request 59 including this coordinate value is transmitted to the server SV1. Upon receiving this detection analysis request 59, the server SV1 checks whether or not the HE4 has been operated by checking the contents of the coordinate values, and transmits an analysis result indicating whether or not the HE4 has been operated to the RMC 3.
However, if the RMC 3 can determine the operation of the HE 4 based on the contents of the operation confirmation signal ocs, the detection analysis request 59 may not be transmitted to the server SV1.

The detection analysis result 60 is information transmitted from the server SV1 as a reply to the detection analysis request 59 transmitted to the server SV1.
The detection analysis result 60 includes, for example, a result (presence / absence of motion) of analysis by the server SV based on information (coordinate values) of the acceleration sensor received as vibration information.
Further, when the server SV1 receives the temperature value information from the temperature sensor, for example, when the temperature value is higher than a predetermined threshold value, it is determined that the device has been operated, and when it is lower than the threshold value, the server SV1 operates. The detection analysis result 60 including the presence / absence of the operation of the device is transmitted from SV1 to RMC3.
When the voice recognition process using the server SV1 or the detection analysis process using the server SV1 is not used, the voice recognition request 57 and the detection analysis request 59 are not sent to the server SV1, and the result of the voice recognition result 58 is the result. It is not necessary to use the detection analysis result 60.

<Configuration of operation check device>
FIG. 3 shows a configuration block diagram of an embodiment of the operation check device CE5.
In FIG. 3, the operation confirmation device CE5 mainly includes a control unit 71, a confirmation information communication unit 72, a confirmation information generation unit 73, an operation detection unit 74, a battery 75, a remaining amount detection unit 76, and a storage unit 80.
The control unit 71 is realized mainly by a microcomputer including a CPU, a ROM, a RAM, an I / O controller, a timer, and the like, and is a part that executes the functions of the CE 5 by operating various hardware.

The confirmation information communication unit 72 corresponds to the second confirmation information communication unit described above, and is a part that communicates with the remote control device RMC3. For example, the operation state of the HE 4 that includes the measurement value acquired by the sensor of the operation detection unit 74 The operation confirmation signal ocs including the information (sensor detection information) is transmitted to the RMC 3 wirelessly.
As described above, since RMC 3 and CE 5 are relatively close to each other, data communication is performed by short-range wireless communication such as Bluetooth.
The confirmation information generating unit 73 is a part that generates the contents of the operation confirmation signal ocs to be transmitted to the RMC 3. The operation confirmation signal ocs includes operation confirmation information 85 as described later.

The operation detection unit 74 is a part that detects the operation of the control target device HE4, and acquires a predetermined measurement value indicating the operation state of the HE4.
The CE 5 is attached to the device HE 4 whose operation is to be confirmed. When the HE 4 receives the control signal irs and performs an operation corresponding to the irs, the operation detection unit 74 detects the operation state of the HE 4. .
The motion detection unit 74 includes a sensor for detecting the motion of the HE4, for example, a vibration detection unit 741 for detecting vibration, a temperature detection unit 742 for detecting temperature, and illuminance detection for detecting illuminance. Unit 743, an air flow detection unit (air flow sensor) 744 that detects the flow of air generated when HE 4 performs a predetermined function, and a current detection unit (current sensor) that detects a current value that flows when HE 4 operates 745, at least one of the sensors is provided.

The vibration detection unit 741 is an acceleration sensor, detects vibration generated when the HE 4 performs a predetermined function, and acquires a measurement value corresponding to the vibration.
Since this detected vibration is considered to be a three-dimensional displacement, if a displacement of a predetermined value or more occurs with respect to the three-dimensional coordinate values (x, y, z) of the acceleration sensor, it is detected that the vibration has occurred. The
When the CE 5 includes the acceleration sensor 741, the operation confirmation information 85 including the coordinate values acquired from the acceleration sensor 741 is generated and transmitted to the RMC 3.

The temperature detection unit 742 is a temperature sensor, detects a temperature change that occurs when the HE 4 operates, and acquires a temperature measurement value.
For example, when a component that generates heat when the HE 4 operates is provided, the presence or absence of the operation can be determined based on the difference between the temperature when the HE 4 is not operating and the temperature when the HE 4 is operating.
Therefore, the temperature value is acquired from the temperature sensor 742 at regular time intervals or whenever there is a request from the RMC 3, and operation confirmation information 85 including the temperature value is generated and transmitted to the RMC 3.
In addition, a temperature threshold value at which it can be determined that the HE4 has operated is stored in advance, and when the temperature value acquired from the temperature sensor 742 becomes higher than the threshold value, it is determined that the HE4 has started, and the operation As the confirmation information 85, information indicating that the HE 4 has been activated may be transmitted to the RMC 3.

The illuminance detection unit 743 is an illuminance sensor, and mainly detects the brightness (illuminance value) around the HE4 when it is lit and when it is not lit when the HE4 to be controlled is a lighting device. In the case of a lighting device having a light control function, the brightness at the time of light control may be detected.
When lighting on / off control of a lighting device is performed, generally, the brightness of the space when turned on and the brightness of the space when turned off are greatly different. The presence or absence of operation can be determined.
Therefore, the illuminance value is acquired from the illuminance sensor 743 at regular time intervals or whenever there is a request from the RMC 3, operation confirmation information 85 including the illuminance value is generated and transmitted to the RMC 3.
In addition, a threshold value of illuminance that can be determined that the HE4 has operated is stored in advance, and when the illuminance value acquired from the illuminance sensor 743 is greater than the threshold value, it is determined that the lighting device HE4 has been controlled to be turned on. Then, information indicating that the lighting device HE4 is turned on may be transmitted to the RMC 3.

Although three sensors (vibration, temperature, and illuminance) are shown as the motion detection unit 74, the present invention is not limited to this, and other sensors may be used.
For example, a humidity sensor, an air flow sensor, a current sensor, a microphone, or the like may be used, a sensor that can measure both temperature and humidity may be used, and a combination of any one or more of these sensors. A sensor may be provided as the motion detection unit 74.
The microphone inputs sound generated from the HE4 when the HE4 performs a predetermined function, stores the sound input from the microphone, and confirms the volume, height, change, etc. of the sound. Thus, it is possible to detect the start, stop, failure, or execution of a predetermined function of the HE4.

The battery 75 is a part that supplies power to each component of the CE 5, and is a part that mainly supplies power for detecting data communication with the RMC 3 and the operation of the HE 4.
The remaining amount detection unit 76 is a part that detects the remaining capacity (battery remaining amount) of the battery, and may include information indicating the remaining battery amount in the operation confirmation information 85 that is transmitted to the RMC 3 as will be described later. .
By transmitting the remaining battery level information to the RMC 3, in addition to confirming the operation of the HE4, it is possible to notify the user of the necessity of replacing the CE5 battery.
The CE 5 is preferably provided with an input unit such as a key switch (not shown) for initial setting of connection with the RMC 3.

The storage unit 80 stores information and programs necessary for executing the communication function and the operation detection function of the CE 5, and includes a semiconductor storage element such as a ROM, a RAM, and a flash memory, a storage device such as an HDD and an SSD, Other storage media are used.
The storage unit 80 stores, for example, an identification number 81, a sensor type number 82, sensor detection information 83, battery remaining amount information 84, and operation confirmation information 85.
FIG. 4C shows an example of the operation confirmation information 85 stored in the storage unit 80, generated by the confirmation information generation unit 73, and transmitted to the RMC 3.
The operation confirmation information 85 is information used for confirming the operation state of the HE4, and is information included in the operation confirmation signal ocs transmitted from the CE5 to the RMC3.
Further, the operation confirmation information 85 includes, for example, an identification number ID81, a sensor identification number SSN82, sensor detection information CHV83, and battery remaining amount information BTR84.

Here, the identification number ID81 is a number for distinguishing the CE5, and a different number is given to each CE5.
The sensor type number SSN 82 is a number for distinguishing the sensors included in the CE 5, and a different number is given for each type of sensor.
In FIG. 4C, for example, when the acceleration sensor 741 is provided, 001 is assigned as the SSN 82.
The illuminance sensor is given SSN = 002, the temperature sensor is given SSN = 003, the air volume sensor is given SSN = 004, the current sensor is given SSN = 005, and the humidity sensor is given SSN = 006.
When two or more types of different sensors are provided in one CE5, different SSNs are assigned to the same identification number ID for each sensor. Can be distinguished.

The sensor detection information CHV83 is information acquired from each sensor of the motion detection unit 74, and includes measurement values measured by each sensor. Alternatively, when it is possible to determine the operation confirmation of HE4 by CE5 alone, the result of the operation confirmation may be included instead of the measurement value or together with the measurement value.
For example, the coordinate value (x, y, z) in the case of the acceleration sensor 741, the temperature value in the case of the temperature sensor 742, the illuminance value in the case of the illuminance sensor 743, and the humidity value in the case of the humidity sensor are used as the sensor detection information 83. Memorized.
The remaining battery level information BTR84 is information indicating the remaining battery level of the battery 75, and is a measured value of power (or current, voltage) indicating the remaining level and information indicating the remaining level (high remaining amount, low remaining amount). Etc.) may be included.
Such operation confirmation information 85 shown in FIG. 4C is generated, included in the operation confirmation signal ocs, and transmitted from the CE 5 to the RMC 3.

FIG. 5 shows an explanatory diagram of an embodiment of the operation content confirmed by the combination of the control target device HE4 to which the CE 5 is attached and the operation detection unit 74 of the CE 5.
In FIG. 5, nine home appliances are shown as the control target device HE4, and each home appliance shows what operation is detected by any of the three sensors (acceleration, illuminance, temperature). ing.
For example, CE5 which has an acceleration sensor is attached to an air conditioner, and means starting and a stop of an air conditioner are confirmed from the information (coordinate value) acquired by the acceleration sensor.
When a change in the predetermined coordinate value is detected from the acceleration sensor, it can be confirmed that the air conditioner has started. Alternatively, when the change of the coordinate value is no longer detected from the acceleration sensor, it can be confirmed that the air conditioner has stopped.

Moreover, CE5 which has an illuminance sensor is attached to an illuminating device, and it can be confirmed by the illuminance value acquired by the illuminance sensor whether the illuminating device was turned on (ON) or turned off (OFF).
Further, the CE 5 having a temperature sensor is attached to the television, and it can be confirmed whether the television is activated (ON) or stopped (OFF) based on the temperature value acquired by the temperature sensor.
Furthermore, CE 5 having an acceleration sensor is attached to the opening / closing door of the refrigerator, and it is confirmed whether the opening / closing door of the refrigerator is operated in the opening direction or the closing direction by the coordinate value acquired by the acceleration sensor. it can.
It is also possible to confirm whether or not the door remains open for a long time by attaching a temperature sensor inside the refrigerator door and measuring the temperature change with the temperature sensor for a certain time or more.

The home appliance HE to which the CE 5 is attached is not limited to the one shown in FIG. 5, and the sensor of the operation detection unit 74 of the CE 5 attached to the HE 4 is not limited to that shown in FIG.
For example, CE5 equipped with a microphone may be attached to a washing machine or a self-propelled cleaner in addition to an acceleration sensor, and CE5 equipped with an acceleration sensor and a temperature sensor may be attached to a rice cooker. .

<Example showing an outline of the operation check process>
FIG. 6 to FIG. 10 are explanatory diagrams of an embodiment of the operation check process of the present invention.
Here, an embodiment will be described in which the air conditioners HE1 and RMC3 are installed in one room, and the operation of the air conditioner is confirmed.

(First embodiment)
FIG. 6 is an explanatory diagram of an embodiment in which operation confirmation is performed when the HE 4 is remotely operated by an input operation on the RMC 3 by a user in the room where the RMC 3 is installed.
In FIG. 6, it is assumed that an air conditioner HE is installed in one room of the home 11, a checker CE is attached to the air conditioner HE, and an RMC 3 is arranged in the same room.
The checker CE includes an acceleration sensor.
Furthermore, the RMC 3 shall check the operation of the air conditioner HE without communicating with the server SV.

It is assumed that the user 7 in the same room inputs an operation for starting the air conditioner using the data input unit 32 of the RMC 3.
When the control unit 31 of the RMC 3 detects the input operation and determines that the detected operation means activation of the air conditioner, the control signal output unit 38 controls the control signal irs01 indicating the activation request of the air conditioner. Is output.
When the control signal irs01 is received by the light receiving unit of the air conditioner HE, the air conditioner HE automatically turns on the power and activates the air conditioning function based on a setting such as a predetermined temperature condition.
When the air conditioning function of the air conditioner is activated, the drive motor of the air conditioner starts to operate, causing vibrations in the air conditioner body.

The checker CE attached to the air conditioner HE detects this vibration.
That is, coordinate values that change due to vibration detected by the acceleration sensor 741 of the checker CE are acquired.
After that, the confirmation information generation unit 73 generates operation confirmation information 85 as shown in FIG. 4C including the sensor detection information CHV83 including the acquired coordinate values, and the confirmation information communication unit 72 generates an operation confirmation signal ( ocs01) and transmitted to RMC3.
When the RMC 3 receives the operation confirmation signal ocs01 and checks the sensor detection information 83 and the like included in the signal to confirm that the air conditioner is operating, the RMC 3 uses the display unit 33 and the audio output unit 34. Then, information indicating that the air conditioner has started a desired operation (confirmation result notification information) is output. The user can confirm the operation of the air conditioner by displaying the output information or viewing the sound. In addition, as shown in the Example mentioned later, you may transmit a confirmation result to portable terminal TE2 which a user possesses.

Through the series of processes described above, even if the air conditioner itself is a conventional air conditioner that does not have an operation confirmation function, the user can simply perform an input operation for starting the same air conditioner as before. The corresponding operation check can be easily and reliably performed.
In the first embodiment, for ease of explanation, the RMC 3 receives the operation confirmation information 85 including the coordinate value acquired from the acceleration sensor, and the RMC 3 performs the operation confirmation by itself. However, as described above, the operation confirmation information 85 including the coordinate value may be transmitted to the server SV1, and the server SV1 may analyze the coordinate value and confirm the operation.

(Second embodiment)
FIG. 7 shows an explanatory diagram of an embodiment in which operation confirmation is performed when a user in the room performs an input operation for starting the air conditioner using the conventional remote controller for air conditioner 8.
Here, the point that the dedicated remote controller is used as the remote controller for remotely controlling the air conditioner is different from the first embodiment using the RMC 3.
As in FIG. 6, it is assumed that the air conditioner HE and the RMC 3 are installed in the same room of the home 11 and the checker CE is attached to the air conditioner HE.
The air conditioner dedicated remote controller (ARC) 8 is a remote controller attached at the time of purchasing the air conditioner, has only a function of outputting a control signal corresponding to the input operation, and can be used to operate only the air conditioner. .
First, it is assumed that the user 7 inputs an operation for starting the air conditioner using the dedicated remote controller (ARC) 8.
At this time, the dedicated remote controller 8 outputs a control signal irs01 requesting activation of the air conditioner.

Upon receiving this control signal irs01, the air conditioner HE automatically turns on the power and activates the air conditioning function.
The operation after the activation of the air conditioning function is the same as that in FIG. 6. When the vibration of the air conditioner is detected by the checker CE, an operation confirmation signal ocs01 is transmitted. Further, when the signal ocs01 is received by the RMC 3, information indicating that the operation of the air conditioner has started is output by display or sound. The user can confirm the operation of the air conditioner by viewing this display or sound.
In this way, even when the user performs remote control of the air conditioner using the dedicated remote controller 8 that has been used conventionally, the user can easily and reliably confirm the operation of the air conditioner. it can. In addition, as shown in the Example mentioned later, you may transmit a confirmation result to portable terminal TE2 which a user possesses.

(Third embodiment)
FIG. 8 is an explanatory diagram of an embodiment in which the user is automatically notified of the temperature information corresponding to the home appliance HE that is the monitoring target device.
Here, it does not confirm the operation with respect to the control input performed by the user, but shows a case where, for example, the current operation state periodically transmitted from the HE is confirmed after the home appliance HE starts the operation.
In FIG. 8, it is assumed that a home appliance (for example, a refrigerator) serving as the monitoring target device HE4 is installed in the house 11, and a checker CE5 including a temperature sensor is attached to the HE4.
Also, temperature information is acquired by a temperature sensor at regular intervals (for example, every 1 hour, 6 hours, or every 24 hours), and an operation confirmation signal ocs including the temperature information is transmitted from CE5 to RMC3.

When the RMC 3 receives the operation confirmation signal ocs including the temperature information, the received temperature information is displayed on the display unit 33.
Alternatively, when a predetermined set temperature indicating an abnormality in HE4 is preset and stored in RMC3 and the temperature information received by RMC3 is higher than the preset set temperature, it is determined that a temperature abnormality has occurred in HE4. The user is notified by the sound displayed on the display unit 33 or the sound output from the sound output unit 35.
Alternatively, in CE5, a predetermined set temperature is set and stored in advance, temperature information is constantly monitored by a temperature sensor, and when the acquired temperature information is higher than the set temperature preset in CE5, the current measured temperature The operation confirmation signal ocs including information indicating that the temperature has risen above the set temperature may be transmitted to the RMC 3.

  According to this, when a temperature abnormality occurs in the monitoring target HE4, in particular, even if there is no instruction input from the user, it is automatically detected that the temperature abnormality has occurred in the HE4 from the CE5 to the RMC3. Since the transmission is performed, it is possible to easily notify the user of the abnormality of HE4.

In this example, the CE 5 including the temperature sensor is attached to the HE 4 to notify the temperature abnormality. However, the present invention is not limited to this. For example, when a CE5 including a vibration sensor is attached, when the user 4 is not remotely controlled, a large vibration that is different from normal occurs in the HE4, or when the HE4 operates. For example, when the vibration no longer occurs, the HE 4 may be notified that a vibration abnormality has occurred.
In addition, similarly, it is possible to notify the humidity abnormality and the illuminance abnormality.
In addition to notifying the abnormality in the RMC 3, the fact that the abnormality has occurred in the HE 4 may be transmitted to the mobile terminal TE 2 owned by the user.

(Fourth embodiment)
FIG. 9 shows an explanatory diagram of an embodiment of the operation confirmation process when the user in the house 11 remotely controls the control target device HE by emitting a voice. FIG. 12 shows a sequence diagram of this operation confirmation process.
Here, it is assumed that the control target device HE is an air conditioner, and the checker CE attached to the air conditioner is provided with a vibration sensor.
In addition, it is assumed that the user US7 utters a voice requesting to start the air conditioner, such as “power-on of the air conditioner”, to the RMC 3.

First, in step a21 in FIG. 12, the user outputs a sound for starting the air conditioner. In step b21, this sound is received by the microphone 34 of the RMC 3.
The received voice is digitized, and in step b22, a voice recognition request including the digitized voice data is transmitted to the server SV1 via the network 10.

When the server SV1 receives this voice recognition request in step c21, voice recognition processing is executed in step c22.
In the speech recognition processing, first, speech information generated by the user is converted into, for example, a Japanese character string, the meaning of the character string is analyzed, and what kind of speech is input is recognized.
Thereafter, in step c23, information on a large number of control signals stored in advance in the server SV1 is searched to check whether there is a control signal corresponding to the recognized voice.
The server SV1 is assumed to store in advance a database in which control signals corresponding to various HEs and voice information corresponding to each control signal are associated.
It is checked whether or not voice information that can be matched with the recognized voice exists in the database. If there is voice information that can be matched, control signal information corresponding to the voice information is acquired.
In step c24, the server SV1 transmits the voice recognition result including the acquired control signal information to the RMC 3 via the network 10.

In step b23, when the RMC 3 receives the voice recognition result, in step b24, the RMC 3 extracts control signal information corresponding to the input voice from the received recognition result. In step b25, a control signal (air conditioner activation request) irs01 corresponding to the input voice is output to the air conditioner HE.
In step d21, when the air conditioner HE4 receives the control signal irs01, the air conditioner HE4 starts an operation corresponding to the control signal in step d22.
When the air conditioner HE starts up and starts air blowing, a predetermined vibration is generated.

In step e21, the vibration sensor included in the checker CE5 attached to the air conditioner detects this vibration.
In step e22, the CE 5 generates an operation confirmation signal ocs including vibration information (for example, coordinate values) that is information indicating the operation state of the HE 4, and transmits the operation confirmation signal ocs from the CE 5 to the RMC 3.
When the RMC 3 receives the operation confirmation signal ocs in step b26, the detection analysis request including the vibration information acquired from the signal ocs is transmitted to the server SV1 via the network 10 in step b27.

In step c25, when the server SV1 receives the detection analysis request, in step c26, vibration analysis processing (coordinate values) indicating the operation state of the HE4 included in the reception information is performed.
When it is determined by the vibration analysis process that vibrations indicating that the air conditioner has started up are generated, in step c27, SV1 sends a detection analysis result indicating that the air conditioner start-up vibrations have been generated to RMC3. Send.

In step b28, when the RMC 3 receives the detection analysis result, in step b29, the operation check notification unit 36 generates and outputs the check result notification information 53 based on the received analysis result. In the case of FIG. 9, in response to the user's voice input, information indicating that the air conditioner has started operation (air conditioner operation start information) is notified to the user by voice or display.
In step a22, the user US7 can confirm that the air conditioner has been operated based on the voice uttered by the user US7 by viewing this display or voice.
Thus, even when the user inputs a control request for HE by voice, the CE can notify the user of the operating state of HE by detecting the vibration of HE.

(5th Example)
FIG. 10 is an explanatory diagram of an example of the operation check process when the user 7 who is out of the house 11 remotely controls the control target device HE in the house 11 by using the mobile terminal TE2 possessed by the user 7 Indicates. FIG. 13 shows a sequence diagram of this operation confirmation process.
Here, as in FIG. 9, it is assumed that the control target device HE is an air conditioner, and the checker CE attached to the air conditioner is provided with a vibration sensor.
In addition, the user 7 goes out with the TE2, and the TE2 stores in advance information on all HEs installed in the user's home 11 (device name, installation location, control function information, etc.). It is assumed that an application program that can be remotely controlled is provided.

In step a41 in FIG. 13, the user 7 displays a screen for controlling HE on the display screen of TE2 and performs a control input operation that signifies an air conditioner activation request while on the go.
In step a42, the air conditioner activation request (control request information) for the air conditioner present in the user's home is transmitted from the TE2 to the server SV1 via the network 10.

In step c41, when the SV1 receives the air conditioner activation request, it determines the content of the control request and recognizes it as an activation request for the air conditioner.
Thereafter, in step c42, a large number of control signal information stored in advance in the database of the server SV1 is searched to check whether there is control signal information corresponding to the recognized control request.
It is assumed that a database in which control requests to various HEs and control signal information corresponding to each control request are associated with each other is stored in advance in the server SV1.
It is checked whether or not control signal information that can match the recognized control request exists in the database, and if there is control signal information that can match, the control signal information 56 is acquired.
In step c43, the server SV1 transmits the determination result including the acquired control signal information 56 to the RMC 3 via the network 10.

Thereafter, the process from the actual output of the control signal by the RMC 3 to the transmission of the analysis result by the server SV1 is the same as in the embodiment of FIGS.
In step b41, when the RMC 3 receives the determination result including the control signal information 56, in step b42, the RMC 3 extracts the control signal information 56 and outputs the control signal irs01 to the air conditioner HE. That is, based on the control request (air conditioner activation request) transmitted from TE2, a control signal irs01 for executing a function corresponding to the control request is output to HE.

In step d41, when the air conditioner HE receives the control signal irs01, the air conditioner HE starts an operation corresponding to the control signal in step d42.
When the air conditioner starts up and starts blowing air, a predetermined vibration is generated.
In step e41, when the vibration sensor included in the checker CE attached to the air conditioner detects this vibration, in step e42, an operation confirmation signal ocs including vibration information (for example, coordinate values) indicating the operation state of the HE4 is generated. Then, the data is transmitted from CE5 to RMC3.
When the RMC 3 receives the operation confirmation signal ocs in step b43, the detection analysis request including the vibration information acquired from the ocs is transmitted to the server SV1 via the network 10 in step b44.

In step c44, when the server SV1 receives the detection analysis request, in step c45, the server SV1 performs vibration analysis processing using the received vibration information (coordinate values).
If it is determined by the vibration analysis process that vibration indicating that the air conditioner has started is generated, in step c46, the server SV1 indicates a detection analysis result indicating that the start vibration of the air conditioner has been generated as RMC3. Send to.

In step b45, the RMC 3 receives the detection analysis result. Further, in step c47, the server SV1 transmits HE operation state confirmation result notification information to TE2 possessed by the user 7.
Here, since the server SV1 has received the air conditioner activation request transmitted from TE2, the user is likely to have TE2 at present, and the detection analysis result is used to inform the user of the analysis result quickly. May be transmitted directly to TE2, which is the transmission source of the air conditioner activation request, instead of RMC3.

In step a43, when the TE2 receives the confirmation result notification information from the server SV1, information (air conditioner operation start information) indicating that the air conditioner has started to operate in response to the user's input operation is obtained by voice or display. Notify the user. The user 7 can confirm that the air conditioner has been operated by viewing this display or sound.
When the TE 2 receives the detection analysis result directly, the confirmation result of the operation state of the HE 4 may be output based on the analysis result using screen display on the application, sound, or the like.
As described above, when the user who has gone out uses the TE 2 to remotely control the HE 4 in the house, the CE 5 can detect the vibration of the HE 4 to notify the user of the operation state of the HE 4. it can.

(Sixth embodiment)
In FIG. 11, the remote control device RMC3 of the present invention, the operation confirmation device CE5, and the control target device HE4 to which the CE5 is attached are associated with each other, the HE to which the CE is attached is determined, and output from the RMC to the HE The sequence diagram of the Example which initializes the control signal which should be shown is shown.
In FIG. 11, it is assumed that RMC 3 and HE 4 are already arranged in the home 11, but CE 5 is not yet attached to HE 4.
First, in step a1, the user (US) 7 performs an input operation to activate the RMC 3. For example, the user performs an operation to turn on the power to the RMC 3.

When the power is turned on, the RMC 3 starts up the hardware and executes a predetermined function when the power is turned on in step b1.
In step b2, the RMC 3 is in a state where it can execute various functions, and therefore outputs information indicating that an initial setting is requested to the user.
For example, an initial setting request message such as “Please perform the initial setting of the connection between the checker and the remote controller and the network connection” is output by voice or display.

When the user 7 confirms the initial setting request message in step a2, the initial setting operation is performed on the RMC 3 in step a3.
The initial setting operation means, for example, that the user performs an input operation for requesting a connection process with the checker CE5 and a connection process with the network 10 using the data input unit 32 of the RMC 3.
In step b3, when such initial setting input is made, the RMC 3 connects the RMC 3 to the network 10 in a step b4 so that data communication with an external device such as a server SV is possible.
If there is a router, set up a connection for data communication with the router.

In step a4, the user performs an input operation for requesting connection with the RMC 3 to the checker CE5.
For example, when the checkers CE5 and RMC3 perform Bluetooth data communication, the user inputs a CE5 connection request so that the Bluetooth connection can be established.
In step c1, when a checker connection request is input, in step c2, the CE 5 performs pairing processing in order to enable data communication with the RMC 3.
Similarly, the RMC 3 receives the initial setting input and performs pairing processing with the CE 5 in step b5.
In this pairing process, for example, RMC 3 and CE 5 transmit a connection request signal to each other, transmit a response signal for permitting connection to the connection request signal from the other party, and enable subsequent data communication. And

In step b6, when the network connection and the pairing with the CE 5 are completed, the RMC 3 notifies the user that the preparation for attaching the checker CE 5 is completed.
For example, a message such as “Please attach the checker to the device whose operation you want to check” is displayed or voiced.

In step a5, the user 7 confirming this notification attaches the checker CE to the control target device HE4 whose operation is to be confirmed.
For example, when HE4 is an air conditioner, CE5 is attached to a portion where vibration is likely to occur when the air conditioner is operating. As an attachment position, you may attach to the inside of a housing | casing other than the surface of the housing | casing of an air-conditioner.
In step a6, after the user 7 attaches the CE 5, the RMC 3 performs an input operation for requesting an initial setting of a control signal (irs) for remotely controlling the HE 4.
This is performed in order to associate CE5 with HE4 to which CE5 is attached, to identify the model of HE4 to which CE5 is attached, and to determine a control signal (irs) for controlling HE4. For example, the user 7 may perform voice input or data input such as “initialize a manufacturer xxx air conditioner”.

When a control signal initial setting request is input to the RMC 3, in step b7, from the control signal output unit 38 of the RMC 3, any HE4 stored in the device setting information 51 of the storage unit 50 is controlled. The control signal irs is sequentially output at regular intervals.
Since the device setting information 51 for a large number of HEs 4 is stored in the storage unit 50 in advance, for example, a representative control signal that activates each HE 4 is selected from the information 51 and 1 Output sequentially.
Of the plurality of control signals sequentially output from the RMC 3, when the HE 4 to which the CE 5 is attached performs a predetermined function by receiving the control signal based on one output control signal, the CE 5 The operation detection unit 74 acquires a measurement value indicating the operation state of the HE4 caused by the execution of the above function by the HE4, and the confirmation information communication unit 72 of the CE5 transmits an operation confirmation signal ocs including the acquired measurement value. To do.

Therefore, the RMC 3 waits for the operation confirmation signal ocs from the CE 5 to be received for a certain period (for example, several seconds) after outputting one control signal irs.
If the operation confirmation signal ocs is not received even after a certain period of time has elapsed, the output control signal irs is considered not to be a signal for controlling the HE 4 to which the CE 5 is attached.
In this case, after the predetermined period has elapsed, the control signal irs selected next is output.
Similarly, if the operation confirmation ocs is not received even after a certain period of time has passed after the control signal irs is output, the process of outputting the next control signal irs is continued.

Even if the HE4 to which the CE5 is attached receives the control signal irs output from the RMC 3, it does not execute any function unless it is a control signal for itself set in advance.
However, when the control signal irs output to control itself is received in step d1, the operation associated with the received control signal irs is started in step d2.
For example, when HE4 is an air conditioner and the received control signal irs is a signal for starting the air conditioner, the air conditioner starts its operation and executes a function such as blowing.
Thus, when HE4 starts operation | movement, starting information, such as a vibration and temperature, is acquired by the various sensors with which CE5 attached to HE4 was equipped.
That is, in step c3, CE5 detects that HE4 has operated.

In step c4, the CE 5 that has detected the operation transmits an operation confirmation signal ocs including the acquired activation information (operation confirmation information 85 such as vibration) to the RMC 3.
In step b8, when the confirmation information communication unit 39 of the RMC 3 receives the operation confirmation signal ocs, the CE identification number ID 81 is acquired from the operation confirmation information 85 included in this signal.
Furthermore, when the operation confirmation signal ocs is received, the device confirmation correspondence information 52 that associates the HE 4 that has executed the above function with the CE 5 attached to the HE 4 is stored in the storage unit 50.
Further, in step b7, the RMC 3 knows which HE4 the output control signal irs is to control, so that the CE5 that has transmitted the operation confirmation signal ocs starts operation by the control signal irs. It can be determined that it is attached to the HE4.

That is, the correspondence relationship between CE5 and HE4 to which CE5 is attached is determined, model information of HE4 is specified from device setting information 51 of HE4, and control signal information for controlling HE4 is also unique. To be determined.
As a result, in step b9, as shown in FIG. 4B, model confirmation correspondence information 52 in which the identification number ID of CE5 and the model information of HE4 are associated with each other is stored in the storage unit 50. A control signal that can control the HE 4 that has been executed can be initialized in the RMC 3.

In step b10, the RMC 3 outputs a message (initial setting completion notification) indicating that the initial setting has been completed using display or sound.
In step a7, the user 7 confirms this initial setting completion notification (for example, a notification such as “the initial setting for checking the operation of the checker and the control target device is finished”). Setting is completed.
Thereafter, as in the first to fifth embodiments shown in FIGS. 6 to 10 described above, the HE operation can be easily and reliably confirmed.

  1 server (SV), 2 mobile terminal (TE), 3 remote control device (RMC), 4 controlled device (HE), 5 operation check device (CE), 7 user, 8 dedicated remote control (ARC), 10 network, 11 home, 31 control unit, 32 data input unit, 33 display unit, 34 audio input unit, 35 audio output unit, 36 operation confirmation notification unit, 37 external device communication unit, 38 control signal output unit, 39 confirmation information communication unit, 50 storage unit, 51 device setting information, 52 device confirmation correspondence information, 53 confirmation result notification information, 54 control signal (irs), 55 operation confirmation signal (ocs), 56 control signal information, 57 voice recognition request, 58 voice recognition result 59 Detection analysis request, 60 Detection analysis result, 71 Control unit, 72 Confirmation information communication unit, 73 Recognition information generation unit, 74 operation detection unit, 75 rechargeable battery, 76 remaining amount detection unit, 80 storage unit, 81 identification number, 82 sensor type number, 83 sensor detection information, 84 battery remaining amount information, 85 operation confirmation information, 741 Vibration detection unit (acceleration sensor), 742 Temperature detection unit (temperature sensor), 743 Illuminance detection unit (illuminance sensor), 744 Air flow detection unit (air flow sensor), 745 Current detection unit (current sensor)

Claims (9)

A device operation confirmation system comprising: a remote control device that remotely controls a device to be controlled by a predetermined control signal; and an operation confirmation device that detects an operation state of the device to be controlled.
The remote control device wirelessly transmits a control signal for causing the control target device to execute a predetermined function, and an operation indicating the operation state of the control target device detected by the operation check device Based on the first confirmation information communication unit that wirelessly receives the confirmation signal and the operation state of the control target device included in the received operation confirmation signal, the control target device transmits the control signal to the control target device. An operation confirmation notification unit for notifying a user of a confirmation result indicating that a corresponding operation has been performed;
The operation check device is attached to the control target device and acquires a predetermined measurement value indicating the operation state of the control target device; and the operation state of the control target device including the acquired measurement value A device operation confirmation system, comprising: a second confirmation information communication unit that wirelessly transmits the operation confirmation signal including the above information. The motion detector is
Vibration generated when the control target device executes a predetermined function, temperature of the control target device, illuminance around the control target device, sound generated when the control target device executes a predetermined function, Obtaining at least one measurement value of an air flow generated when the control target device performs a predetermined function and a current value flowing when the control target device operates; The apparatus operation confirmation system according to claim 1, wherein The remote control device further includes a display unit and an audio output unit,
The operation confirmation notifying unit notifies the user of the confirmation result by one or both of display on the display unit and sound output from the sound output unit. The device operation confirmation system described. A server that performs data communication with the remote control device via a network;
The remote control device further includes an external device communication unit that communicates with the server,
The external device communication unit transmits information on the operation state of the control target device included in the operation confirmation signal received by the first confirmation information communication unit to the server,
The server analyzes the received operation state information of the control target device and transmits the analysis result to the remote control device,
The device operation confirmation system according to claim 1, wherein the operation confirmation notification unit notifies a user of a confirmation result of an operation state of the control target device based on the received analysis result. A portable terminal that performs data communication with the remote control device and the server via a network;
The mobile terminal transmits a control request for the control target device input in the mobile terminal to the remote control device via the server,
The control signal output unit of the remote control device outputs a control signal for executing a function corresponding to the control request to the control target device based on the received control request,
The server transmits an analysis result obtained by analyzing the received operation state information of the control target device to the mobile terminal,
The device operation confirmation system according to claim 4, wherein the portable terminal outputs a confirmation result of an operation state of the device to be controlled based on the received analysis result.   The apparatus operation confirmation system according to claim 1, wherein the remote control device and the operation confirmation device communicate predetermined information by short-range wireless communication.   The apparatus operation confirmation system according to claim 6, wherein the short-range wireless communication is data communication using Bluetooth. The remote control device further includes a storage unit,
In the storage unit, for each of a plurality of devices to be controlled, device setting information in which a plurality of control signals for remotely controlling each device to be controlled is stored in advance,
The control signal output unit sequentially outputs control signals for controlling all control target devices stored in the storage unit at regular intervals,
When the control target device to which the operation check device is attached executes a predetermined function based on the one output control signal, the operation detection unit of the operation check device executes the function. Obtain a measured value indicating the operating state of the device to be controlled
The second confirmation information communication unit transmits the operation confirmation signal including the acquired measurement value,
When the first confirmation information communication unit of the remote control device receives the operation confirmation signal, the storage unit includes a control target device in which the function is executed and an operation confirmation device attached to the control target device. 2. The device operation confirmation system according to claim 1, wherein the device confirmation correspondence information associated is stored, and a control signal capable of controlling the device to be controlled on which the function is executed is initialized. A control signal output unit that wirelessly transmits a control signal for causing the control target device to execute a predetermined function;
A confirmation information communication unit that wirelessly receives an operation confirmation signal indicating an operation state of the control target device detected by the operation confirmation device attached to the control target device;
A confirmation result indicating that the control target device has performed an operation corresponding to the control signal transmitted to the control target device based on the information on the operation state of the control target device included in the received operation check signal. A remote control device comprising: an operation confirmation notifying unit for notifying to.

Images