JP2002199470A - Home automation through interactive virtual robot system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a home automation by an interactive virtual robot system that controls the security management of houses, robots and the entire digital house electrical appliance network on behalf of dwellers. SOLUTION: Sound collection microphones, lond speaker, human body sensing and remote units are installed to each living space. Users' voices are recognized as voice information, and confirmation of instruction commands and execution start declaration or the like are replied directly in voice or on a monitor in drawings or characters or replied by the Internet or by mail. The interactive virtual robot and its system can attain temperature humidity management of central heating, video recording reservation, management of a fully automatic washing machine, lighting/ extinguishment of lighting fixtures, locking of doors, and supervision, alarming and report after sensing of fine or gas leakage by various sensors and also can attain management of for nursing devices.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to home automation by an interactive virtual robot system.

[0002]

2. Description of the Related Art Some home robots have been devised and are now in a practical stage. Typical ones are cleaning robots and nursing robots, but these robots are generally single-function types, with image recognition functions for recognizing the range of action and for detecting obstacles, various sensors, and bi- or multi-legs (wheels and multi-legs). (Including endless trajectories), and have the size and shape adapted to the purpose. At present, versatile autonomous bipedal walking robots (humanoids) are being developed with the aim of miniaturization and high performance, and the spread to general households is being developed. If it is assumed that the size is reduced, there is a limit to the size reduction.

[0003]

It is not easy for an elderly person, a handicapped person, or a care-requirer to operate the above robots. Due to the need for agility, there is a danger in operating the elderly, disabled, or care recipient alone. Also, preparing a single-function robot for each application in an ordinary household is not economical or realistic in terms of living space, and it is necessary to learn the operation method of each robot in order to properly use the robot according to the purpose of use. There is a heavy burden on the elderly and disabled.

On the other hand, with the shrinking birthrate and aging population, it is necessary not only to use robots instead of limbs, but also to consider coexistence with humans in a more mental part. Room temperature setting, lighting on / off, video absence recording, etc. by air-conditioning equipment from the outside are practically implemented by digital home appliance network technology, but it is only control of the equipment and must be performed by the required human operation. No.

An object of the present invention is to provide home automation by means of an interactive virtual robot system that controls security of a general home and controls a plurality of robots and the entire digital home network on behalf of humans.

[0006]

According to the present invention, in order to solve the above-mentioned problems, a microphone for collecting instruction instructions, a speaker for response, a human body detector, a locking device, and a detector for detecting abnormal intrusion are provided for each living space (each room). A sensor, one or more image monitors, and one personal computer for operating the interactive virtual robot system are provided.

According to the present invention, a location and a response destination are specified for an instruction command generated simultaneously in different living spaces (different rooms), and then the voice of the user is recognized as voice information, and a confirmation request for the instruction command is issued. The present invention is characterized in that the execution start declaration and its result are reported directly from a speaker provided for each living space (each room) by voice synthesis, and a response or report by a moving image or text is displayed on a monitor screen.
(FIGS. 1 and 2)

In the present invention, by giving a pseudo-personality to the image monitor in the response (for example, giving a male or female or a mascot-like appearance and sound by CG from the monitor screen and speakers), It is characterized by having more natural means of communication with humans, with difficult expressions and movements.

According to the present invention, even the elderly, the disabled, and the care-requirer need only give an instruction command to the interactive virtual robot system in words (use a remote control unit for control if utterance is impaired). It is characterized by realizing control of home appliances or automation of security on digital home networks and digital home appliances networks.

The present invention is characterized in that it is possible to realize effective and convenient home automation at a low price in the mental part of an elderly person, a handicapped person or a user living alone and also from the viewpoint of crime prevention. In this case, the single-function robot is not necessarily required, and only the combination of the interactive virtual robot system of the present invention and various sensors for security may be used.

If the mental part is supplemented, for example, weather data (temperature, humidity, atmospheric pressure, weather forecast)
From the return time, when the user utters "I'm here" from the instruction and command collection microphone, I refer to the conversation database by voice recognition and say "go home" for the keyword "I'm here". It can be realized by outputting a response such as "go home during the hot weather" from the speaker at the location where the temperature is "hot" or "cold" from the temperature.

[0012] From these speech recognition and keyword reference to a conversation database, associative processing, and speech synthesis, communication at the level of everyday conversation is sufficiently possible.

On the other hand, from the point of view of crime prevention, when an abnormality is detected from the lock sensor and the window sensor, the interactive virtual robot system performs sounding of alarms inside and outside the room and communication with the police and the like. With these mental parts and the security function for security, it is possible to provide comfort and security especially for the elderly and women living alone.

In the present invention, a human body sensing device (for example, a sound wave,
Infrared, heat detectors and video recognition)
If there is no movement and no response to the safety confirmation from the interactive virtual robot system after a certain allowable time has passed, an abnormal situation has occurred to the head of the household, the target person to be notified, the neighboring residents, fire and police as an accident. It is characterized by reporting.

According to the present invention, when a house collapses due to an earthquake or the like, the location of each user is recorded as room data by the human body detecting device, and connected to a personal computer on which an interactive virtual robot system operates. The media in the dedicated heat-resistant, water-resistant, shock-resistant housing with a built-in battery, and a reading device and a wireless transmission device for transmitting the layout and occupancy information useful for rescue work are transmitted by radio waves.

According to the present invention, when a plurality of single-function robots exist in the same living space, the interactive virtual robot system has a higher authority, and intervenes a user's instruction command so that the single-function robots can behave in an overlapping manner or malfunction. Can be controlled.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic diagram of an entire two-storey living space. 1 is a personal computer on which an interactive virtual robot system operates, and each room has 2 and 3
A microphone for collecting instruction instructions is installed. Now, 1st floor D
The figure shows a case where a user in a room instructs an interactive virtual robot system to invite a visitor who has come to the entrance to a specific self-propelled robot. In another room
The instruction command collecting microphone of No. 3 is also effective, but in this example, the interactive virtual robot system detects that only the voice information from the room D on the first floor contains a keyword such as “confirmation of a visitor”. Reference numeral 6 denotes a multi-control unit (repeater) for collecting and distributing audio input / output and image data for each room.

The image monitors 4 and 5 shown in FIG. 1 are not always necessary, and may be replaced with a general television receiver other than the dedicated monitor even when the monitor is installed.

FIG. 2 shows that the interactive virtual robot system that senses the instruction sends a confirmation request to the user in the room D on the first floor using the instruction instruction collecting microphone 7 and the speaker 8, and then acknowledges. Indicates that

At this time, if there are 9 image monitors, C
The image indicated by 0008 by G is displayed.

FIG. 3 shows an outline of the operation of the interactive virtual robot system when there is a robot that is already executing the instruction command. In this living space, there are two autonomous bipedal walking robots. One is in room A on the first floor and the other is in room D on the second floor. The robot 10 senses from the robot identification signal obtained from the antenna, and gives an instruction wirelessly from the antenna 10 to the robot 12 that is in the shortest reachable range at the entrance commanded. The interactive virtual robot system detects that the robot 12 has reached the entrance from the position information obtained from the antenna 13, and releases the lock.

FIG. 4 is a module configuration diagram of the interactive virtual robot application. Each module indicated by 14 starts processing when detecting voice or signal information from microphones or sensors installed for several times in each room indicated by 15. It should be noted that the interactive virtual robot system individually corresponds to the user in each room.

[0023]

According to the present invention, the living space itself is a robot, and even an elderly person, a handicapped person, or a person in need of nursing care can control devices such as a television, a video, an air conditioner, and a microwave oven on a digital home appliance network simply by words. Can be handled.

In addition to words, instructions can be given by a keyboard or a control unit.

In addition to being able to operate these digital home appliances networks from the outside with the Internet or a portable terminal,
It is also possible to make a confirmation inquiry as to whether or not the video recorder is operating normally after the designated time of the video recording.

In addition to the fire and gas leak check, the locked state of the entrance and the window can be confirmed only by words.

In addition, it is possible to check the safety of a home that supports the elderly or the elderly living alone, or to automatically report when an abnormality is detected.

Further, even a user such as a mechanical robot having anxiety or resistance to the existence itself can be introduced without any problem.

Further, by displaying a character or a virtual human image on the image monitor, it is possible to reduce the loneliness of living alone by becoming a partner of a conversation in addition to displaying a reaction to an instruction command or transmitting a sign language to a hearing-impaired person.

Further, by having control rights for various single-function robots and monitoring or providing information, the safety can be further improved.

Further, command control can be performed so that a plurality of various single-function robots do not operate in response to an instruction command.

In addition, the present invention can be used as an in-vehicle robot, an office robot, or an intelligent building robot as an application other than a residential living space.

[0033]

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an instruction command path for an interactive virtual robot system.

FIG. 2 is a diagram illustrating a response path from an interactive virtual robot system.

FIG. 3 is a diagram illustrating a case where the interactive virtual robot system controls another robot.

FIG. 4 is a module configuration diagram of the interactive virtual robot system.

[0034]

[Explanation of symbols]

Reference Signs List 1 personal computer on which interactive virtual robot system operates 2 microphone in room where instruction was given 3 microphone installed in each room 4 image monitor of room where instruction was given to display characters and virtual human images 5 installed in each room Image monitor 6 Multi-control unit that collects and distributes each information of voice, image and sensor 7 Microphone for final confirmation in the room that sensed the instruction 8 Speaker for response in the room that sensed the instruction 9 Instruction An image information display monitor in a room that senses the situation 10 A position information sensing sensor and wireless pointing antenna for a single-function robot 11 A position information sensing sensor and wireless antenna that wirelessly gives a single-function robot 12 A unit that actually receives instructions and acts Functional robot 13 And antenna for wireless indication

[0035]

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G06F 3/16 340 G06F 3/16 340A G08B 21/00 G08B 21/00 21/02 21/02 G10L 13 / 00 G10L 3/00 Q 15/00 R 15/28 551R 15/24 551S 15/22 571G 571T F term (reference) 3F059 DB04 DB09 DD08 DD11 DD18 FA05 FA10 FB12 FC08 FC15 5C086 AA01 AA02 AA13 AA22 AA29 BA04 CA11 CA12 CB CB26 DA02 DA08 EA45 5D015 AA05 KK01 KK04 LL06 LL07 5D045 AB15 AB26 5K048 BA12 CA08 DB01 DB05 EA11 EB02 EB14 EB15 FB08 FC01 HA01 HA02 HA21

Claims (7)

[Claims] 1. A sound collecting microphone and a speaker installed in each living space (room) and a human body sensing device (for example, a sound wave, an infrared ray, a heat sensor or image recognition) and a remote control unit, and each space (room). For each individually generated instruction command, the location and response destination are specified, the voice of the user is recognized as voice information, and a confirmation request for the instruction command, an execution start declaration, and the result are reported for each living space (room). Report by voice directly from a speaker installed in the computer or response or report by moving image or text on the monitor screen, and furthermore, a confirmation request (a password, etc.) for a voice instruction command from a telephone or an instruction command given via the Internet (Web). And the execution start declaration and the result, the former is a voice, the latter is a non-independent Type interactive virtual robot system. 2. General control of a digital home appliance network including room temperature / humidity control of an air conditioner or central heating, reservation of video recording, reservation of time for a fully automatic washing machine, turning on / off of lights, equipment for nursing care (for example, electric type) 2. The interactive virtual robot system according to claim 1, wherein control of the bed is possible. 3. A method for controlling opening / closing and locking / unlocking of doors and windows, and judging information from various sensors for detecting abnormal intrusion, fire and gas leakage, and enabling security control such as monitoring, alarming, and reporting. Item 2. The interactive virtual robot system according to item 1. 4. When a judgment is made based on the sensor set forth in claim 1 that senses that an elderly person or a care recipient needs to stay in a bathroom or toilet for an abnormally long time, a report to the head of the household or the person to be notified should be made. The interactive virtual robot system according to claim 1, wherein an emergency notification is sent to an adjacent resident or a fire department or police. 5. Even if a house collapses due to an earthquake or the like, information on whereabouts (room) of a person immediately before the collapse is sequentially recorded and updated. 2. The interactive virtual robot system according to claim 1, wherein a rescue guide can be provided by providing information from a battery and a radio wave transmitting device. 6. An object to avoid duplication of an instruction command which may occur when a plurality of robots for each purpose having voice recognition, such as a care robot and a cleaning robot, are present in the same living space, and to execute the instruction command. 2. The interactive virtual system according to claim 1, wherein a control function for issuing an execution command to one of the robots in the shortest reach range to the ground and an emergency stop or avoidance action instruction for preventing an accident due to a malfunction of the robot can be performed. Robot system. 7. Giving a personality in a simulated manner (for example, giving a male or female or mascot-like appearance and sound through a monitor screen and a speaker by CG) is effective as a living alone and a talking partner with an elderly person, and is a mental The interactive virtual robot system according to claim 1, which can be supported from the side.