JP2021004980A - Life support multi-remote control and life support multi-remote control system - Google Patents

Abstract

To provide a life support multi-remote control and a life-support multi-remote control system, which can perform appropriate life support control with improved voice recognition precision when the life support control for a user, which includes control of a plurality of electronic apparatuses in a house, is to be performed.SOLUTION: A life support multi-remote control comprises: a microphone unit 11; a speaker unit 12; a voice recognition unit 20 for determining whether collected voice is a content on control of a plurality of electronic apparatuses and voice-recognizing the voice by machine learning of the voice which a user uses when the voice is determined to be the content on the control of the plurality of electronic apparatuses; and a control unit 18 which connects a system to an external voice recognition unit 30a for performing general-purpose voice recognition when the voice recognition unit 20 determines that the voice is not the content on the control of the plurality of electronic apparatuses, acquires a voice recognition result by the external voice recognition unit 30a and performs life-support control for the user, which includes the control of the electronic apparatus, on the basis of the voice recognition result by the voice recognition unit 20 or the external voice recognition unit 30a.SELECTED DRAWING: Figure 1

Description

The present invention is a life support multi-remote controller and a life support multi that can improve voice recognition accuracy and perform appropriate life support control when performing life support control for a user including control of a plurality of electronic devices in a house. Regarding the remote control system.

Conventionally, electronic devices in a house have been controlled by infrared communication using individual remote controls. When controlling a plurality of electronic devices using individual remote controllers corresponding to each electronic device, the operation is complicated because it is necessary to operate the remote controller for each electronic device to be controlled. For this reason, there is a device that uses voice recognition technology to control a plurality of home appliances and other housing equipment with a single device (see Patent Document 1).

In addition, there is also one in which an individual remote control operation screen is virtually displayed on the input / output screen of a mobile device such as a smartphone, and one portable device enables virtual operation on a plurality of electronic devices.

JP-A-2015-171006

However, when using a multi-remote control app that performs virtual operations on multiple electronic devices with one mobile device, after unlocking the screen of the mobile device, select the multi-remote control app, and then select the electronic device to be controlled. , It is necessary to press the instruction button on the virtual operation screen for the displayed electronic device, and the number of operation actions increases, so that the operation becomes complicated and it takes time to complete the operation. In particular, for elderly people and the like, the operation of mobile devices is complicated, which makes the operation difficult and time-consuming.

On the other hand, since the multi-remote controller using voice recognition does not have complicated physical operations and only voice input, it is possible to easily operate a plurality of electronic devices.

However, when trying to control a plurality of electronic devices by a multi-remote controller using voice recognition, there is a problem that proper control may not be performed. Specifically, the current voice recognition may not be able to identify the electronic devices placed in the house. For example, in voice recognition for voice control instructions such as "Turn off the lights in the room of the eldest son!" And "Turn off the lights in the room of Mr. XX!", The eldest son and Mr. XX are not identified, and after all, the control target. Lighting cannot be specified.

The present invention has been made to solve the above-mentioned problems of the prior art, and is appropriate for improving voice recognition accuracy when performing life support control for a user including control of a plurality of electronic devices in a house. It is an object of the present invention to provide a life support multi-remote controller and a life support multi-remote controller system capable of performing various life support controls.

In order to solve the above problems, the present invention is a life support multi-remote control that is connected to a plurality of electronic devices in a house and interactively controls the life support of a user who uses the plurality of electronic devices, and is a voice. A microphone unit that collects sound, a speaker unit that outputs sound, and whether or not the sound collected by the microphone unit is related to the control of the plurality of electronic devices, and the sound is the plurality of electrons. When it is determined that the content is related to the control of the device, the voice recognition unit that recognizes the voice by machine learning of the voice used by the user, the voice recognition unit, and the voice are related to the control of the plurality of electronic devices. If it is determined that the content is not the content, the microphone unit is provided on the network and is connected to an external voice recognition unit that performs general-purpose voice recognition for the collected voice, and the voice recognition result by the external voice recognition unit is acquired. It is characterized by including a control unit that performs life support control for the user, including control of the electronic device, based on the voice recognition result by the voice recognition unit or the external voice recognition unit.

Further, in the above invention, the control unit is characterized in that the life support control result is output as voice from the speaker unit.

Further, the present invention is characterized in that, in the above invention, the control unit includes a display output unit that displays and outputs a life support control state.

Further, the present invention is characterized in that, in the above invention, the physical operation unit that accepts a human operation is provided, and the control unit guides the operation by the physical operation unit within the interactive life support control by voice. To do.

Further, in the above invention, the present invention includes a storage unit for storing the usage history of the electronic device, and the control unit is the speaker based on the usage history of the electronic device regardless of the presence or absence of voice input. It is characterized in that the use of the electronic device is voice-guided through the unit.

Further, the present invention is characterized in that, in the above invention, the control unit voice-guides a recommended action via the speaker unit based on the result of using the electronic device.

Further, in the above invention, the present invention includes a human body detection sensor for detecting a human body, and the control unit is based on the usage history of the electronic device at least when the human body detection sensor detects a person. It is characterized in that the use of the electronic device is voice-guided via the speaker unit, and when there is no response to the voice guidance, it is notified to the outside as if an abnormality has occurred.

Further, in the above invention, the present invention includes a human body detection sensor that detects a human body, and the control unit is based on the usage history of the electronic device at least when the human body detection sensor detects a person. It is characterized in that the use of the electronic device is voice-guided via the speaker unit, and when there is no response to the voice guidance, an abnormality is notified to the outside as if an abnormality has occurred, and the voice-guided electronic device is controlled. It is characterized by.

Further, in the above invention, the present invention includes a human body detection sensor for detecting a human body, and the control unit is the electronic device regardless of the presence or absence of voice input when the human body detection sensor detects a person. When the use of the electronic device is voice-guided via the speaker unit based on the usage history of the human body and the human body detection sensor does not detect a person, the usage history of the electronic device regardless of the presence or absence of voice input. It is characterized in that an inquiry is made to the user's portable device based on the above, and life support control for the electronic device is performed based on the inquiry result.

Further, in the above invention, in the above invention, the user carries a beacon that transmits a weak radio wave that identifies the user, and when the control unit detects the weak radio wave of the beacon, all the connected devices are connected. The electronic device is turned on, and when the weak radio wave of the beacon cannot be detected, all the connected electronic devices are turned off.

Further, the present invention comprises the life support multi-remote control according to any one of the above inventions, and an external voice recognition unit provided on the network and performing general-purpose voice recognition for the sound collected by the microphone unit. It is characterized by having an external voice recognition server connected to the life support multi-remote remote control.

Further, in the above invention, the present invention includes a management server that manages the usage history and usage result of the life support multi-remote controller and remotely controls the life support multi-remote controller based on the usage history and the usage result. It is characterized by that.

According to the present invention, when performing life support control for a user including control of a plurality of electronic devices in a house, it is possible to improve voice recognition accuracy and perform appropriate life support control.

FIG. 1 is a functional block diagram showing a configuration of a life support multi-remote controller system including a life support multi-remote controller according to the present embodiment. FIG. 2 is a perspective view of the life support multi-remote controller. FIG. 3 is a flowchart showing an example of life support processing control processing by voice input. FIG. 4 is an explanatory diagram for explaining life support processing control processing by voice input. FIG. 5 is an explanatory diagram illustrating an example of a recording process, which is one of the life support control processes by autonomous voice guidance. FIG. 6 is an explanatory diagram illustrating an example of blood pressure measurement, which is one of the life support control processes by autonomous voice guidance. FIG. 7 is an explanatory diagram illustrating an example of blood pressure measurement and voice guidance, which is one of the life support control processes by autonomous voice guidance. FIG. 8 is an explanatory diagram illustrating an example of life support control processing using a beacon. FIG. 9 is an explanatory diagram illustrating an example of safety confirmation, which is one of the life support control processes by human detection. FIG. 10 is a block diagram showing an example of a life support multi-remote controller system having a plurality of life support multi-remote controllers. FIG. 11 is a diagram showing an example of the usage history of the management server. FIG. 12 is a diagram showing an example of the usage history of the management server. FIG. 13 is a diagram showing an example of the usage result of the management server.

Hereinafter, preferred embodiments of the life support multi-remote controller and the life support multi-remote controller system according to the present invention will be described in detail with reference to the accompanying drawings.

<Configuration of life support multi-remote control system>
FIG. 1 is a functional block diagram showing a configuration of a life support multi-remote controller system 101 including a life support multi-remote controller 1 according to the present embodiment. Further, FIG. 2 is a perspective view of the life support multi-remote controller 1. In the life support multi-remote controller system 101, a life support multi-remote controller 1 and a blood pressure measuring device 2, a television 3, a recorder 4, an air conditioner 5, and a lighting 6 as electronic devices (home appliances) are arranged in the house 100. .. The blood pressure measuring device 2, the television 3, the recorder 4, the air conditioner 5, and the lighting 6 are connected to the life support multi-remote controller 1. This connection is preferably a wireless connection. Further, the life support multi-remote controller 1 is connected to the external voice recognition server 30, the management server 40, and the mobile device 50 via the external network N.

As shown in FIG. 1, the life support multi-remote controller 1 includes a microphone unit 11, a speaker unit 12, a physical operation unit 13, a display output unit 14, a human body detection sensor 15, a storage unit 16, a communication unit 17, a control unit 18, and a battery. Has 19. The microphone unit 11 collects sound. As shown in FIG. 2, for example, the microphone unit 11 is provided on the lower side of the housing of the life support multi-remote controller 1. In addition, the speaker unit 12 outputs sound. As shown in FIG. 2, for example, the speaker unit 12 is provided on the upper side of the housing of the life support multi-remote controller 1.

The physical operation unit 13 is a button or the like that is operated by a person. For example, as shown in FIG. 2, the “red”, “yellow”, “green”, and “blue” selection buttons 13a and the cross key 13b used in a conventional TV remote controller or the like.

The display output unit 14 displays and outputs the life support control state. For example, as shown in FIG. 2, the display output unit 14 is five LEDs arranged in a straight line. For example, this LED lights up in green when it is in a standby state such as voice input, and blinks in green with a time lag in the linear direction when controlling an electronic device or the like, and the control is completed. In the case of, it lights up in red for a predetermined time. If it is not necessary to consider problems in terms of strength and power consumption, a two-dimensional display such as a liquid crystal display may be used. In this case, characters may be displayed.

The human body detection sensor 15 is a sensor that detects the human body around the life support multi-remote controller 1. The storage unit 16 is a storage device including a hard disk device, a non-volatile memory, or the like, and stores the usage history 16a and the usage result 16b.

The communication unit 17 is a communication interface for communicating with the blood pressure measuring device 2, the television 3, the recorder 4, the air conditioner 5, the lighting 6, the external voice recognition server 30, the management server 40, the mobile device 50, and the like via the external network N. Is. The communication unit 17 includes short-range wireless communication such as WiFi (registered trademark) and bluetooth (registered trademark), LTE communication, and infrared communication. The television 3 can output video through an HDMI (registered trademark) interface, but in this case, it is preferable to use a wireless HDMI interface. That is, the life support multi-remote controller 1 is preferably connected by wireless communication in order to ensure portability. Therefore, the life support multi-remote controller 1 is powered by the battery 19. It may be connected to a commercial power line. The communication unit 17 has a function of receiving radio waves from the beacon 7 that transmits weak radio waves that identify the user.

The control unit 18 is a control unit that controls the entire life support multi-remote controller 1, and includes a voice recognition unit 20, a life support control unit 22, a voice generation unit 23, an operation reception processing unit 24, and a display output processing unit 25. The control unit 18 stores the programs corresponding to these functional units in a storage device such as a non-volatile memory or a magnetic disk device, loads these programs into the memory, and executes the programs on the CPU. The process will be executed.

When the voice collected by the microphone unit 11 is related to the control of a plurality of electronic devices (television 3 or the like), the voice recognition unit 20 performs voice recognition and converts it into character data. The voice recognition unit 20 recognizes the voice by machine learning of the voice used by the user. The voice recognition unit 20 is built based on, for example, the Julius voice recognition engine.

The voice recognition unit 20 has a determination unit 21, and the determination unit 21 determines whether or not the sound collected by the microphone unit 11 is related to the control of a plurality of electronic devices (television 3, etc.). As a result of this determination, if the content is related to the control of the electronic device, the voice recognition process of the voice recognition unit 20 is performed. In addition, except for the contents related to the control of the electronic device, the control unit 18 accesses the external voice recognition server 30 and causes the external voice recognition unit 30a in the external voice recognition server 30 to perform the voice recognition process to perform the voice recognition process. Get the result. The external voice recognition unit 30a performs general-purpose voice recognition processing, and is, for example, a voice recognition cloud service of Alexa (registered trademark). When making a high-speed connection with the cloud, it is preferable to use edge computing.

The life support control unit 22 performs life support control for the user, including control of an electronic device such as a television 3, based on the voice recognition result by the voice recognition unit 20 or the external voice recognition unit 30a. The life support control by the life support control unit 22 includes, for example, a television program search process by connecting to the Internet, in addition to the control of electronic devices.

The voice generation unit 23 converts the character data output by the life support control unit 22 into voice data, and outputs the voice via the speaker unit 12. This voice output includes voice guidance and life support control results.

The operation reception processing unit 24 sends the input information from the physical operation unit 13 to the life support control unit 22. The display output processing unit 25 performs a process of causing the display output unit 14 to output a life support control result or the like by the life support control unit 22.

The control unit 18 provides voice guidance on the use of the electronic device via the speaker unit 12 based on the usage histories 16a and 40a of the electronic device such as the television 3 regardless of the presence or absence of voice input. Further, the control unit 18 is not limited to the usage histories 16a and 40a, and may provide voice guidance based on the scheduling registered in advance.

Further, the control unit 18 may perform voice guidance of the recommended action via the speaker unit 12 based on the usage results 16b and 40b of the electronic device. The usage results 16b and 40b are measurement results by the blood pressure measuring device 2 and the like. The usage histories 16a and 40a and the usage results 16b and 40b are the same information, and may be stored in both the life support multi-remote controller 1 side and the management server 40 side, or may be stored in either one. It may be.

Further, when at least the human body detection sensor 15 detects a person, the control unit 18 provides voice guidance on the use of the electronic device via the speaker unit 12 based on the usage histories 16a and 40a of the electronic device, and the voice guides the use of the electronic device. If there is no response to the guidance, the person may be notified to the outside as if an abnormality has occurred. Further, at this time, the electronic device may be notified to the outside and the voice-guided electronic device may be controlled.

Further, when the human body detection sensor 15 detects a person, the control unit 18 uses the electronic device via the speaker unit 12 based on the usage histories 16a and 40a of the electronic device regardless of the presence or absence of voice input. When the human body detection sensor 15 does not detect a person, the user's portable device 50 is inquired based on the usage histories 16a and 40a of the electronic device regardless of the presence or absence of the voice input, and the inquiry result is also obtained. In addition, life support control for electronic devices may be performed.

Further, the control unit 18 turns on all the connected electronic devices when the weak radio wave of the beacon 7 is detected, and turns off all the connected electronic devices when the weak radio wave of the beacon 7 cannot be detected. You may do so.

In this embodiment, when the voice data is related to the control of the electronic device, the user learns the voice recognition peculiar to the control of the electronic device. Therefore, the voice recognition with high accuracy is performed for the control of the electronic device. On the other hand, when the voice data is other than the content related to the control of the electronic device, since the general-purpose external voice recognition is performed, it is possible to perform fine-grained and highly accurate voice recognition. That is, in this embodiment, since voice recognition is performed by combining voice recognition having a peculiarity of controlling an electronic device and general-purpose voice recognition, the overall voice recognition accuracy can be remarkably improved. ..

<Example of life support control processing by voice input>
FIG. 3 is a flowchart showing an example of life support processing control processing by voice input. Further, FIG. 4 is an explanatory diagram illustrating a life support processing control process by voice input. As shown in FIGS. 3 and 4, the control unit 18 determines whether or not voice data has been input (step S1). The voice data input determination may be the input of a wake word or the pressing of a button instructing the start of voice input (not shown). If no voice data is input (step S1; No), this determination process is repeated.

On the other hand, if the voice data is input (step S1; Yes), the determination unit 21 determines whether or not the voice data is related to the control of the electronic device (step S2). If the voice data is related to the control of the electronic device (step S2; Yes), the voice recognition unit 20 performs voice recognition (step S3). On the other hand, if the voice data is not related to the control of the electronic device (step S2; No), the external voice recognition unit 30a performs voice recognition (step S4).

After that, the life support control unit 22 performs life support control for the user based on the voice recognition result by the voice recognition unit 20 or the external voice recognition unit 30a (step S5). For example, when there is a voice input of "power on the TV", the content is related to the control of the electronic device, so the voice recognition unit 20 performs voice recognition, and the life support control unit 22 turns on the power of the TV 3. Control to do.

After that, the life support control unit 22 outputs the voice output of the life support control result via the speaker unit 12 (step S6). Further, the life support control unit 22 updates the usage histories 16a and 40a (step S7), and ends this process.

<Example of life support control processing (recording processing) by autonomous voice guidance>
FIG. 5 is an explanatory diagram illustrating an example of a recording process, which is one of the life support control processes by autonomous voice guidance. As shown in FIG. 5, first, the life support control unit 22 refers to the usage histories 16a and 40a (step S11), and for example, the viewing history of the 8:04 channel every Sunday night, which is the history immediately after the current time. To get. Here, when the detection result of the human body detection sensor 15 is acquired (step S12) and the detection result is without a human body, the user cannot watch the 8:04 channel every Sunday night.

Therefore, the life support control unit 22 makes an inquiry to the user's mobile device 50 via the network N, "Do you want to watch the usual program?" (Step S13), and answers that the inquiry result is "I want to watch". If this is the case, the program recording of “every Sunday at 8:04 pm” is executed for the recorder 4 (step S14). Further, the life support control unit 22 updates the usage histories 16a and 40a of the television 3 and the recorder 4 under this control (step S15), and ends this process.

<Example of life support control processing (blood pressure measurement) by autonomous voice guidance>
FIG. 6 is an explanatory diagram illustrating an example of blood pressure measurement, which is one of the life support control processes by autonomous voice guidance. As shown in FIG. 6, first, the life support control unit 22 refers to the usage histories 16a and 40a (step S21), and acquires, for example, the blood pressure measurement performed immediately after the current time. Then, the life support control unit 22 provides voice guidance saying "Please measure the blood pressure" via the speaker unit 12 (step S22). After that, the blood pressure measurement result is sent from the blood pressure measuring device 2 (step S23).

However, since it is not known who measured the blood pressure, the life support control unit 22 sent the speaker unit 12 to "Who is the current measurer? Taro's red button, Jiro's green button, If you are Hanako, please press the yellow button. "(Step S24).

Here, the life support control unit 22 identifies the user corresponding to the pressed button via the operation reception processing unit 24 (step S25). After that, the life support control unit 22 updates the usage histories 16a and 40a of the blood pressure measuring device 2 (step S26), and further stores the measurement results as the usage results 16b and 40b together with the specified user (step S27). Further, for example, a voice output stating "Mr. Taro's average blood pressure this month was 135 mmHg" is output (step S28), and this process is completed.

<Example of life support control processing (blood pressure measurement and voice guidance) by autonomous voice guidance>
FIG. 7 is an explanatory diagram illustrating an example of blood pressure measurement and voice guidance, which is one of the life support control processes by autonomous voice guidance. As shown in FIG. 7, first, the life support control unit 22 refers to the usage histories 16a and 40a (step S31), and acquires, for example, the blood pressure measurement performed immediately after the current time. Then, the life support control unit 22 provides voice guidance saying "Please measure the blood pressure" via the speaker unit 12 (step S32). After that, the blood pressure measurement result is sent from the blood pressure measuring device 2 (step S33).

When the measurement result of the sent blood pressure measurement significantly deviates from the standard deviation of the latest blood pressure value or exceeds the threshold value, the life support control unit 22 gives voice guidance to take an antihypertensive agent (step S34).

After that, the life support control unit 22 updates the usage histories 16a and 40a of the blood pressure measuring device 2 (step S35), further stores the measurement results as the usage results 16b and 40b (step S36), and ends this process.

<Example of life support control processing using beacon>
FIG. 8 is an explanatory diagram illustrating an example of life support control processing using the beacon 7. As shown in FIG. 8, the life support control unit 22 first determines whether or not the radio wave of the beacon 7 is received (step S41). When the life support control unit 22 receives the radio wave of the beacon 7, all the electronic devices are turned on (step S42). However, the blood pressure measuring device 2 excludes this process for the sake of energy saving. On the other hand, when the radio wave of the beacon 7 is not received, all the electronic devices are turned off (step S43). This is the state corresponding to the user being out. After that, the usage history is updated (step S44), and this process ends. When the user's beacon 7 is detected, the speaker unit 12 may output a voice saying "Go home".

<Example of life support control processing (safety confirmation and electronic device control) by human detection>
FIG. 9 is an explanatory diagram illustrating an example of safety confirmation and electronic device control, which is one of the life support control processes by human detection. In the above example, the life support control for spending a comfortable life was performed, but in this example, the electronic device control for the user's safety confirmation process and the user's abnormality handling is performed.

As shown in FIG. 9, first, when the human body detection sensor 15 detects the human body (step S51), the life support control unit 22 determines whether or not the air conditioner 5 is operating with reference to the usage history 16a. (Step S52). When the air conditioner 5 is not operating, the life support control unit 22 provides voice guidance from the speaker unit 12 asking "Should I turn on the air conditioner?" (Step S53).

When there is no response to this voice guidance (step S54), the life support control unit 22 considers that an abnormality has occurred in the user and sends the notification destination 60 such as a security company or a relative via the network N and the management server 40. In addition to notifying the user that an abnormality has occurred (step S55), the process of operating the air conditioner 5 (step S56) is performed.

In step S51, the superposition condition may be that the detection value of the temperature sensor (not shown) or the temperature sensor of the air conditioner 5 is outside the optimum temperature. Further, in step S52, the operation of the air conditioner 5 may be checked directly. Further, the notification process in step S55 may be output directly to the notification destination 60 without going through the management server 40.

<Example of life support control processing (safety confirmation) by human detection>
FIG. 10 is an explanatory diagram illustrating an example of safety confirmation, which is one of the life support control processes by human detection. Also in this example, the safety confirmation process of the user is performed.

As shown in FIG. 10, first, the life support control unit 22 determines whether it is the time zone for watching the television 3 with reference to the usage history 16a (step S61). The time zone for watching TV 3 is, for example, the time from 8:00 to 9:00 pm every Sunday when there is a one-hour viewing history of 8:04 channel every Sunday. The life support control unit 22 monitors the television 3 based on the usage history 16a or directly when the human body detection sensor 15 detects the human body during the time zone for watching the television 3 (step S62). When the TV 3 is not attached (step S63), the speaker unit 12 provides voice guidance asking "Should I turn on the usual TV?" (Step S64).

When there is no response to this voice guidance (step S65), the life support control unit 22 assumes that an abnormality has occurred in the user and sends the notification destination 60 such as a security company or a relative via the network N and the management server 40. , Notifies the user that an abnormality has occurred (step S55). In this case, the television 3 is not turned on because it does not deal with an abnormality for the user.

<Example of a life support multi-remote controller system with multiple life support multi-remote controllers>
FIG. 11 is a block diagram showing an example of the life support multi-remote controller system 201 having a plurality of life support multi-remote controllers 1. As shown in FIG. 11, the house 100 is, for example, an individual house for the elderly, and is provided with one multi-remote controller 1 and an electronic device group 110 such as a television and an air conditioner as in FIG. On the other hand, the housing facility 200 has residential areas 200a to 200c in which elderly people live, like an elderly home, and each residential area 200a to 200c is provided with a life support multi-remote controller 1 and an electronic device group 110, respectively. Has been done. User A resides in the house 100, and users B1, B2, and B3 reside in the living units 200a to 200c, respectively.

The life support multi-remote controller 1 in the house 100 and the life support remote controller 1 of each of the living units 200a to 200c are connected to the network N. The life support remote controller 1 of each of the residential units 200a to 200c may be connected to the external network N after being connected to the intranet in the residential facility 200. Further, an external voice recognition server 30, a management server 40, and a notification destination 60 are connected to the network N. Here, the management server 40 has a remote control unit 40c.

The remote control unit 40c of the management server 40 particularly controls electronic devices for confirming the safety of a plurality of users A and B1 to B3 operating the plurality of life support multi-remote controllers 1 and for dealing with abnormalities of the users A and B1 to B3. I do. The management server 40 manages the usage history 40a and the usage result 40b of each life support multi-remote controller 1, and the remote control unit 40c remotely controls each life support multi-remote controller 1 based on the usage history 40a and the usage result 40b. Then, the safety of a plurality of users A, B1 to B3 is confirmed, and the electronic device is controlled to deal with the abnormality of the users A, B1 to B3.

FIG. 11 is a diagram showing an example of the usage history 40a of the management server 40. The usage history 40a holds a history of ON / OFF, operation time, and state of the electronic device for each item of the electronic device such as a television, an air conditioner, and lighting. In FIG. 12, the latest history is displayed at the top. Further, FIG. 13 is a diagram showing an example of the usage result 40b of the management server 40. The usage result 40b holds measurement results such as user information, blood pressure, pulse rate, and body weight. The determination "N" in FIG. 13 indicates that there is no abnormality, and the determination "D" indicates that there is an abnormality. In FIG. 13, the health condition of the user with the user ID “35” is abnormal, and the remote control unit 40c performs small-scale remote control with an emphasis on watching.

The remote control unit 40c refers to, for example, the latest usage history 40a of FIG. 12, and grasps that the TV is attached, the air conditioner is not attached, and the lighting is turned on, and as described above, this user If the human body detection sensor 15 of the multi-remote controller 1 detects the human body, the voice guidance "Do you want to turn on the air conditioner?" Is given, and if there is no response, the user is notified that an abnormality has occurred. Notify 60 to that effect. Further, in this case, the control necessary for dealing with the abnormality, that is, the remote control for operating the air conditioner is performed.

It should be noted that each configuration shown in the above embodiment is a schematic function, and does not necessarily have to be physically shown. That is, the form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically distributed / integrated in an arbitrary unit according to various loads and usage conditions. Can be configured.

The life support multi-remote controller and the life support multi-remote control system according to the present invention are used in the case of performing life support control for a user including control of a plurality of electronic devices in a house, and improve voice recognition accuracy to provide appropriate life support. It is useful when performing control.

1 Life support multi-remote control 2 Blood pressure measuring device 3 TV 4 Recorder 5 Air conditioner 6 Lighting 7 Beacon 11 Microphone unit 12 Speaker unit 13 Physical operation unit 13a Select button 13b Cross key 14 Display output unit 15 Human body detection sensor 16 Storage unit 16a, 40a History 16b, 40b Usage result 17 Communication unit 18 Control unit 19 Battery 20 Voice recognition unit 21 Judgment unit 22 Life support control unit 23 Voice generation unit 24 Operation reception processing unit 25 Display output processing unit 30 External voice recognition server 30a External voice recognition unit 40 Management server 40c Remote control unit 50 Portable device 60 Notification destination 100 Residential 101,201 Life support multi-remote control system 110 Electronic device group 200 Residential facility 200a-200c Residential part A, B1 to B3 User N network

Claims (12)

It is a life support multi-remote controller that is connected to a plurality of electronic devices in a house and interactively controls the life support of a user who uses the plurality of electronic devices.
A microphone that collects sound and
The speaker section that outputs audio and
It is determined whether or not the sound collected by the microphone unit is related to the control of the plurality of electronic devices, and when it is determined that the sound is related to the control of the plurality of electronic devices, the sound is transmitted. A voice recognition unit that recognizes voice by machine learning of voice used by the user,
When the voice recognition unit determines that the voice is not related to the control of the plurality of electronic devices, the external voice recognition unit is provided on the network and performs general-purpose voice recognition for the voice collected by the microphone unit. Connect, acquire the voice recognition result by the external voice recognition unit, and perform life support control for the user including the control of the electronic device based on the voice recognition result by the voice recognition unit or the external voice recognition unit. A life support multi-remote that is characterized by having a control unit. The life support multi-remote controller according to claim 1, wherein the control unit outputs a life support control result by voice from the speaker unit. The life support multi-remote controller according to claim 1 or 2, wherein the control unit includes a display output unit that displays and outputs a life support control state. Equipped with a physical operation unit that accepts human operations
The life support multi-remote controller according to any one of claims 1 to 3, wherein the control unit guides an operation by the physical operation unit within an interactive life support control by voice. A storage unit for storing the usage history of the electronic device is provided.
Any of claims 1 to 4, wherein the control unit voice-guides the use of the electronic device via the speaker unit based on the usage history of the electronic device regardless of the presence or absence of voice input. Life support multi-remote control described in one. The life support multi-remote controller according to any one of claims 1 to 5, wherein the control unit voice-guides a recommended action via the speaker unit based on the result of using the electronic device. .. Equipped with a human body detection sensor that detects the human body
When at least the human body detection sensor detects a person, the control unit provides voice guidance on the use of the electronic device via the speaker unit based on the usage history of the electronic device, and responds to the voice guidance. The life support multi-remote controller according to any one of claims 1 to 6, wherein if there is no such as, an abnormality is notified to the outside as if it has occurred. Equipped with a human body detection sensor that detects the human body
When at least the human body detection sensor detects a person, the control unit provides voice guidance on the use of the electronic device via the speaker unit based on the usage history of the electronic device, and responds to the voice guidance. The life according to any one of claims 1 to 6, characterized in that, in the absence of the above, the electronic device is notified to the outside as if an abnormality has occurred and the electronic device that has been voice-guided is controlled. Support multi-remote control. Equipped with a human body detection sensor that detects the human body
When the human body detection sensor detects a person, the control unit provides voice guidance on the use of the electronic device via the speaker unit based on the usage history of the electronic device regardless of the presence or absence of voice input. When the human body detection sensor does not detect a person, the user's mobile device is inquired based on the usage history of the electronic device regardless of the presence or absence of voice input, and the electronic device is inquired based on the inquiry result. The life support multi-remote device according to any one of claims 1 to 6, wherein the life support control is performed. The user carries a beacon that transmits a weak radio wave that identifies the user.
When the control unit detects the weak radio wave of the beacon, it turns on all the connected electronic devices, and when the weak radio wave of the beacon cannot be detected, it turns off all the connected electronic devices. The life support multi-remote controller according to any one of claims 1 to 9, which is characterized. One or more life support multi-remote controllers according to any one of claims 1 to 8.
It is characterized by having an external voice recognition unit provided on the network and performing general-purpose voice recognition for the voice collected by the microphone unit, and an external voice recognition server connected to the life support multi-remote remote control. Life support multi-remote system. The eleventh aspect of claim 11, wherein a management server that manages the usage history and usage result of the life support multi-remote controller and remotely controls the life support multi-remote controller based on the usage history and the usage result is provided. Life support multi-remote control system.

Images