JP2003014293A - Water heating appliance - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a water heating appliance in which information release of a human body sensor is facilitated while utilizing a remote controller displaying the hot water supply set temperature, or the like, of the water heating appliance. SOLUTION: Since the operating switch of a remote controller and a controller are interlocked such that operation of a human body sensor is stopped by turning the operating switch off, operating switch of the human body sensor can be prevented from being missed to turn off after taking a bath. An extra operating switch for detecting human body is not required because the human body sensor is operated by turning the operating switch of the water heating appliance on and since a state detectable of human body is brought about without fail upon operating the water heating appliance, the switch is prevented from being missed to turn on. Furthermore, operability is enhanced because operation can be stopped and information can be released without going to the bathroom and since a remote controller is utilized for display, an extra informing section is not required.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hot water apparatus having a human body detection sensor that monitors a bathroom or the like and, when an abnormality occurs in the movement of a human body, issues an alarm to another person at a remote place. .

[0002]

2. Description of the Related Art Conventionally, a human body detection sensor is installed in a bathroom,
The inside of the bathroom is continuously monitored, and when there is no movement of people in the bathroom, the sensor sends a signal to the alarm section of the sensor installed in a remote location such as the kitchen, and the alarm section issues a buzzer alarm. Was there. And when there is an alarm notification,
In some cases, the notification is released by a notification release switch provided in the notification unit. On the other hand, the bathroom is provided with a remote controller for controlling the combustion of the hot water equipment from a remote position, and in recent years, a remote controller for the combustion control has been installed in a place other than the bathroom such as a kitchen. Therefore, it is convenient to use the remote controller to operate and display the notification unit of the human body detection sensor in the same case.

[0003]

However, if the remote controller for operating the hot water equipment and displaying the hot water supply temperature is simply provided with the notifying section of the human body detection sensor and the operation switch,
There is a problem that the operation becomes individual and complicated. Also,
In order to cancel the notification after the warning is issued by the human body detection sensor, it has been adopted to provide a switch for cancellation or use an intercom to perform the cancellation. However, this method requires separate switches, which increases the size of the remote control case. It is also possible to release the notification by entering and leaving the bathroom without providing switches, but in this method, it is necessary to go to the bathroom one by one to perform the releasing operation, which is troublesome.

In view of the above problems, it is an object of the present invention to provide a hot water device in which the human body detection sensor can be easily released while using a remote controller for displaying the hot water supply set temperature of the hot water device. .

[0005]

In order to solve the above-mentioned problems, the hot water equipment of the present invention is provided with a main body of a hot water equipment having a built-in heat exchanger and a burner, and a main body of the hot water equipment for controlling combustion from a remote position in a bathroom. A bath remote control, a kitchen remote control installed in a place other than the bathroom, a human body detection sensor that monitors the bathroom by connecting to the hot water equipment body or the remote control of the hot water equipment, and the main power supply to the hot water equipment body provided on both remote controls. A display device for displaying an operation switch to be supplied, a set hot water temperature, etc., and a control device for activating and deactivating the human body detection sensor, wherein the operation switch is turned on to activate the human body detection sensor, The first feature is that the operation switch and the control device are interlocked so that the operation of the human body detection sensor is stopped by turning off the operation switch. There. According to the first feature, the operation switch and the control device are linked so as to stop the operation of the human body detection sensor by turning off the operation switch of the remote controller, thereby forgetting to turn off the operation switch of the human body detection sensor after bathing. Can be prevented. In addition, by operating the human body detection sensor by turning on the operation switch of the hot water equipment, there is no need to provide a separate operation switch for human body detection, and the human body can be detected by operating the hot water equipment. This will prevent forgetting to turn on the switch. Here, the operation of the human body detection sensor means placing the human body detection sensor in a state in which it can exhibit the function of detecting the movement of the human body. Specifically, it is to start imaging and process an image to determine the presence or absence of motion. Furthermore, according to the present invention, the operation can be stopped and the notification can be canceled without going to the bathroom, and the operability is improved. Further, by utilizing the remote controller for displaying, it is not necessary to separately provide a notification unit.

Further, the hot water equipment of the present invention comprises a hot water equipment body having a built-in heat exchanger and a burner, a remote bath controller for controlling the combustion of the hot water equipment body from a remote location, and a kitchen installed in a place other than the bathroom. A remote control, a human body detection sensor that monitors the bathroom by connecting to the main body of the hot water equipment or the remote control of the hot water equipment, and an operating switch that is provided on both remote controls to supply main power to the main body of the hot water equipment and set hot water temperature etc. Display means, a control device for activating and deactivating the human body detection sensor, and means for informing the display means of an image and a sound for warning when the human body detection sensor determines that the human body is stopped. When the operation switch is turned on to activate the human body detection sensor, and when the operation switch is turned off, the human body detection sensor is deactivated. And a second feature in that in conjunction with the operation switch and the control device to release the notification image and sound. According to the second feature, in addition to the above features, by interlocking the operation switch and the control device so as to stop the operation of the human body detection sensor by turning off the operation switch and release the image and sound notification, It is not necessary to separately provide a switch for canceling the notification after the alarm notification. Furthermore, the alarm notification can be canceled without going to the bathroom, which improves the operability.

Further, the hot water equipment of the present invention comprises a hot water equipment body having a heat exchanger and a burner built therein, a remote bath controller for controlling the combustion of the hot water equipment body from a remote location, and a kitchen installed in a place other than the bathroom. A remote control, a human body detection sensor that monitors the bathroom by connecting to the main body of the hot water equipment or the remote control of the hot water equipment, and an operating switch that is provided on both remote controls to supply main power to the main body of the hot water equipment and set hot water temperature, etc. A display unit, a control device that activates and deactivates the human body detection sensor, a unit that notifies the display unit of a warning image and sound when the human body detection sensor determines whether the human body is stopped, and a monitoring area for a predetermined time. An image pickup device that picks up images at intervals and a motion amount calculator that calculates the amount of movement of the human body as a difference in the amount of received light by comparing both images before and after the predetermined time interval. And a motion presence / absence determining means for determining the presence / absence of motion by the motion amount computing means, and a determining means for determining the motion of the human body by the motion presence / absence determining means, and detecting the human body by turning on the operation switch. A third feature is that the sensor is operated, the human body detection sensor is stopped by turning off the operation switch, and the operation switch and the control device are interlocked with each other so as to cancel the notification of the image and the sound. According to the third feature, in addition to the features described above, by capturing an actual image and continuously processing the image data, the movement of the human body can be detected quickly and reliably, and the alarm notification is ensured. Can be achieved. In addition, it is possible to reliably judge the movement of the bather.

[0008]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall configuration diagram showing an embodiment of the present invention. FIG. 2 is a block diagram of an electric circuit showing an embodiment of the present invention. FIG. 3 is a circuit diagram showing the configuration of an image core circuit that constitutes one pixel of the image detection unit of the human body detection sensor. FIG. 4 is an explanatory diagram showing the relationship between the imaging range of the sensor, the detection range, and the detection area. Figure 5
3 is a control flowchart showing an embodiment of the present invention. FIG. 6 is a flowchart of human body stoppage detection showing an embodiment of the present invention. FIG. 7 is an explanatory diagram of an embodiment showing the relationship between the human body detection sensor, the hot water equipment, and the remote controller.
FIG. 8 is a block diagram of electric control of another embodiment showing the relationship among the human body detection sensor, the hot water equipment, and the remote controller. FIG. 9 is an enlarged view of the storage unit showing an embodiment. (A) of FIG.
Is a diagram showing a current image and a previous image of an object moved to the lower right, (b) is a diagram showing the brightness of the previous image for each pixel, (c)
FIG. 4 is a diagram showing the brightness of the current image for each pixel. FIG. 11 is a diagram showing a difference image showing changes in brightness and darkness in pixels corresponding to image boundaries. FIG. 12 is an electric circuit block diagram showing one embodiment, and FIG. 13 is a flowchart of human body monitoring showing one embodiment. FIG. 14 is an electrical block diagram showing the relationship between the remote controller and the human body detection sensor. FIG. 15 is an electric circuit diagram showing the connection relationship between the remote controller, the hot water equipment, and the human body detection sensor according to another embodiment. FIG. 16 is an electrical block diagram showing the display relationship.

FIG. 1 shows an outline of an embodiment of the present invention, in which a bathtub 2 and a washroom 3 are provided inside a bathroom 1. Reference numeral 4 is an entrance to the bathroom 1. Reference numeral 5 denotes a human body sensor, which will be described in detail later, but is attached to the upper portion of the inner wall surface of the bathroom 1. Specifically, it is attached at an upper position of the bathroom wall surface facing the bathroom wall surface in contact with the longitudinal direction of the bathtub 2. To the hot water equipment 40, a bath remote control 60 installed in a bathroom and a kitchen remote control 70 installed in a kitchen for operating the hot water equipment 40 from a remote position are connected. Although the human body sensor 5 is attached to the wall surface of the bathroom 1 in the present embodiment, the human body sensor 5 is not limited to this example and may be attached to the ceiling surface of the bathroom 1. The human body sensor 5 has an imaging device using an artificial retina, and is composed of a human body detection sensor 51 that images the movement of the human body in the bathroom 1 and performs image processing, and an infrared sensor 52 that detects the human body by heat detection by infrared rays. is doing. The image pickup device picks up an image of a monitoring area such as a bathroom at predetermined time intervals.

A bath remote controller 60 for remotely controlling the hot water equipment 40 is installed in the bathroom 1, and a kitchen remote controller 70 for remotely controlling the hot water equipment 40 is installed in the kitchen. Here, the hot water device 40 is a device for heating hot water and supplying it to a bathtub or the like, and specifically includes a bath kettle with a water heater, a heater with a water heater, a hot water heater, a water heater, and the like. ing. The hot water equipment may not only use gas as a fuel but may also use oil as a fuel. Regarding the connection of the warm water equipment 40, the remote controllers 60 and 70, and the human body detection sensor 51, in the one shown in FIG. 1 showing one embodiment of the present invention,
First, the hot water equipment 40 and the kitchen remote controller 70 are connected to the cable 41.
Then, the kitchen remote controller 70 and the bath remote controller 60 are connected by the cable 41, and the bath remote controller 60 and the human body detection sensor 51 are connected by the cable 41. Then, the remote controller 6 for controlling the water heater, etc.
0 and 70 have a display unit such as a liquid crystal display panel for notifying that there is a bather in the bathroom 1. When the human body sensor 5 detects the bather and outputs a detection signal, the display unit lights up. And so on. The display unit is not limited to the one described above, and when the bather does not move for a certain period of time, it is presumed that he or she is sleeping in the bathtub or has fallen down. If no response is received within the specified time, the kitchen remote control 7
At 0, the alarm sound or voice is used to notify the alarm to others such as family members.

The hot water equipment 40 has a built-in heat exchanger and burner, and is provided with various sensors for control. A hot water supply drop pipe 46 is connected from the hot water equipment 40 to the bathtub 2. Further, the power source for operating the human body sensor 5 is introduced from the power plug 47 of the water heating device 40, and the controller 42 of the water heating device 40.
It is supplied after being stepped down and lowered in voltage through a transformer (not shown).

FIG. 2 shows a specific structure of the human body sensor 5 which is composed of a human body detection sensor 51 using an artificial retina chip and an infrared sensor 52. Human body detection sensor 51
Is an image pickup device 6 for picking up an image of the monitoring area at predetermined time intervals,
The control device 7 is composed of a microcomputer that controls the imaging device 6 and processes and determines a captured image. In addition, the controller 7 and the remote controller 6 described above.
0 and 70 are transmitted and received by a communication unit 53 such as a communication IC described later. Further, in addition to the human body detection sensor 51, an infrared sensor 52 is provided in the same case body, and the control device 7 thereof is shared so as to mutually complement the monitoring when the bathroom 1 is dark.

The image pickup unit 8 of the image pickup device 6 has a vertical length of 128 ×
It is composed of an image detection unit 9 having a resolution of 128 pixels horizontally, an imaging lens 10, a scanner 11, a multiplexer 12, and a scanner drive control unit 13. The image detection unit 9 may use vertical 32 pixels × horizontal 32 pixels, or may perform image detection processing with a part of a large number of pixels. The pixels of the image detection unit 9 have 256 levels of monochrome “level 0 (black) to 2”, respectively.
It is represented by 256 gradations of 55 (white).

Then, in the image pickup section 8, the image in the bathroom is formed on the image detection section 9 by the image forming lens 10. The scanner 11 is drive-controlled by the scanner drive control unit 13, and the scanner drive control unit 13 controls each pixel row of the image detection unit 9 so as to be sequentially in a light receiving state (ON state) at regular intervals. . The photocurrents simultaneously output from the pixels in one column in the light receiving state are combined into a single electric signal by the multiplexer 12 and amplified by the amplifier 14 before being output as an analog voltage. The converter of the control unit 7 is used to convert analog data into digital data.

Further, each pixel of the image detecting section 9 is composed of a pixel core circuit 17 as shown in FIG. The pixel core circuit 17 includes a light receiving element 18, a charge storage circuit 19, and a sensitivity variable circuit 20, and a sensitivity variable terminal 21.
The reset terminal 22 is connected to the scanner 11, and the photocurrent output terminal 23 is connected to the multiplexer 12.

In FIG. 2, the gain adjustment unit 16 checks the image average value (image brightness) in the image output unit 15, and if the image average value is out of the appropriate range, the amplifier 14 causes the image pickup device 6 to operate. In addition to adjusting the gain, the scanner drive control unit 13 adjusts the storage time of the image detection unit 9 to perform light control so that an image with appropriate brightness can be obtained. This dimming may be performed for each of the divided detection areas described later.

In the image pickup device 6 using the artificial retina, the image average value is the gradation (0 gradation (black) to 255 gradation (white) of 256 gradations) in all the pixels that constitute the image detecting section 9. It is an average value and is expressed by a value of 0 to 255. This image average value is determined by the gain of the amplifier 14 and the accumulation time of the image detector 9. Here, the gain corresponds to the aperture of the camera, and the accumulation time corresponds to the shutter speed of the camera. Therefore, in order to obtain an appropriate image average value of the image pickup device 6, it is only necessary to fix the gain to an appropriate value and adjust the accumulation time. Alternatively, an appropriate accumulation time may be fixed and the gain may be adjusted.

Then, in FIG. 2, at least an image detecting section 9 for performing image pickup, a scanner 11, and a scanner driving section 1
3 and the gain adjusting unit 16 are configured by one chip.
This chip is called an artificial retina chip. Further, a control device 7 is provided on the back surface of the chip, and the control device 7 is composed of a microcomputer incorporating various kinds of software.
The area dividing means 24 for dividing the detection area for performing the detection processing into a plurality of areas is incorporated as software.

Specifically, as shown in FIG. 4, the point table 25 for processing the image information input to the control device 7 is divided into a plurality of areas. That is, the imaging capability range (corresponding to the entire point table 25) that can be detected by the human body detection sensor 51 is defined as a detection area 26 that requires image processing and a non-detection area 27 that does not perform image processing.
It is divided into and. That is, the entire imaging capability range is not set as the detection area. As a result, a part of the detection processing area where detection processing can be performed is used as a sensor detection area for actually detecting and processing, thereby limiting the image processing range and accelerating the image processing speed. Further, as shown in FIG. 4, the detection area 26 is replaced with an entrance area 29 and a wash area 3
The area is divided into three areas of 0 and the bathtub area 31. The division of the detection area 26 is not limited to this example, and the detection area 26 may be divided into two areas, an entrance area 29 and an area other than the entrance area 29. For example, the washing area 30 and the bath area 31 may be combined into one area. In the case of a bathroom, the entrance area 29 is an area located inside the bathroom and near an entrance door to the bathroom. The washing area 30 mainly means an area of a floor portion where the head and body are washed, and the bath area 31 means an area where the bath is located. Image information is sequentially input to the control device 7 for each of the areas divided in this way, and processing such as detection and calculation is performed for each area.

The imaging lens 10, the image pickup device 6 and the control device 7 constituting the human body sensor 51 are housed together with the infrared sensor 52 in one case, and attached to a wall surface or the like as a human body sensor set. The mounting position may be such that the entire bathroom 1 including the entrance / exit 4 to the bathroom is included in the viewing angle.

Then, the detection output of the image pickup device 6 and the detection output of the infrared sensor 52 are input to the determination means 32, respectively. The determination unit 32 is configured to comprehensively determine the presence or absence of a bather in the bathroom, the movement of the bather, and the like based on the output from the image pickup device 6 and the output from the infrared sensor 52.

The image detected by the artificial retina is image-processed as follows. The control device 7 for controlling and processing the image,
Image information is received from all the pixels forming the image detection unit 9 at regular intervals, and when the image information is received at regular intervals, the image information is arithmetically processed and the determination means 32 determines the movement of the bather. is there.

Next, an image processing method for extracting the movement of a person from the image captured by the artificial retina 21 will be described. Upon receiving the image information at predetermined time intervals, the control device 7 including a microcomputer analyzes the movement of the bather from the image information according to a predetermined analysis algorithm and monitors the movement of the bather.

Specifically, as shown in FIG. 10A, the image (bright image) P of a square object is changed from position P1 to position P2.
Suppose you moved to. At this time, if a bright pixel is represented by a symbol B and a dark pixel is represented by a symbol D, the previous image is represented by FIG. 10 (b) and the current image is represented by FIG. 10 (c). The images before and after this are temporarily stored by the image storage means 115 in FIG. The captured images are sequentially updated so that the latest two images are always stored. Then, the motion amount calculating means 111 compares the two images for each of the divided areas, and for each pixel (x, y) of each area, the previous image p
Received light amount Pp (x, y) of the current image n and received light amount Pn (x, y) of the current image n
The difference (motion amount) D (x, y) = Pn (x, y) -Pp (x, y) from y) is calculated, and the calculation result can be obtained as a difference image as shown in FIG. In the difference image of FIG. 11, a pixel having a positive difference D (x, y) is represented by a + symbol, a negative pixel is represented by a − symbol, and a pixel having a D (x, y) of zero is represented by a 0 symbol. There is. By capturing the sum of such differences,
Whether or not there is motion can be determined for each area, and this determination is performed by the motion presence / absence determining means 114. If there is no motion amount, it is determined that there is no motion, and if there is motion amount, it is determined that there is motion.

On the other hand, the motion presence / absence detection unit 112 detects whether or not there is a motion in each divided region. That is, the captured image captured by the imaging device 6 is read by the control device 7 at regular intervals of the entrance area 29, the wash area 30 and the bathtub area 31, and the image data is analyzed to show a moving area. Is detected. This detection may be performed, for example, by detecting the area where the above-described amount of movement has occurred as a moving area. Alternatively, the change in voltage caused by the movement of a person may be detected, and the changed area may be determined as the moving area and the detected area may be detected. Then, whether or not the area in which the motion is occurring corresponds to the area specified in advance is determined by the specific area corresponding determination means 113. The specific area means the bath area 31 or the wash area 30, and is an area excluding the entrance area 29. Whether or not the moving area is the specific area depends on, for example, whether or not the signals match, or by sequentially searching other detection areas and determining that if there is no movement in the area other than the specific area, it corresponds to the specific area. There is. In such a search, the state is sequentially transited based on the presence / absence of a motion and the signal of the region having the motion, and the search is performed in the microcomputer.

Further, the human body detection sensor 51 is provided with a sensitivity adjustment circuit (not shown) for automatically adjusting the sensitivity,
The detection accuracy is increased by increasing the sensitivity when the bathroom is dark and decreasing the sensitivity when the bathroom is bright.

Next, determination of whether or not a person has entered the bathroom 1 will be described with reference to FIG. First, the operation switch 140 of the kitchen remote controller 70 of the hot water equipment 40 is operated to turn it on (step S0). By this ON operation, the human body detection sensor 51 starts to operate. Acting here means
It means placing the human body detection sensor in a state where it can exhibit the function of detecting the movement of the human body. Specifically, it is to start imaging and perform arithmetic processing of image data to determine whether or not a human body moves. By turning on the operation switch, the human body detection sensor 51 is operated in association with the hot water supply operation to the bath, so that it is possible to prevent forgetting to turn on the sensor. When a person begins to enter the bathroom 1, the infrared sensor 52 in a standby state first detects a human body and turns on (step S1) and a timer is set (step S2), and the human body detection sensor 51 is washed within a fixed time. When a person is detected in step S3, it is determined that the person has entered the room (step S3).
4). In this entry determination, it takes time for the human body detection sensor 51 to detect a human body, and it takes time to calculate the amount of movement, or when the bathroom 1 is dark, the monitoring sensitivity is low. Sensor 52
After the detection by the human body detection sensor 51, the human body detection sensor 51 also detects a person, thereby compensating for the weak point of the human body detection sensor 51 and ensuring the entry of the room.

Further, even when the user exits the bathroom 1, if the infrared sensor 52 is turned off (No in step S5) and the human body detection sensor 51 does not detect the amount of movement (in step S6). If no), it is determined that the user has exited the bathroom 1 (step S7). If only the infrared sensor 52 is stopped at the entrance, it will be turned off, and it may be erroneously determined that the user has exited. This is complemented by the use of sensors.

Even if the human body detection sensor 51 does not detect a person in the washroom 3 (NO in step S3), it detects a person in the bathtub 2 (step S3).
8) If both the infrared sensor 52 and the human body detection sensor 51 detect a person within a predetermined time (step S
9, S10), it is determined that the user has entered the room (step S4). In addition, after it is determined that the user has entered the room, a timer may be set so that the detection duration of the sensor corresponds to the average bathing time.

The attachment of the human body detection sensor 51 is
The position is the ceiling or the upper part of the wall surface of the bathroom 1, and this position is the optimum position where the movement of a person in the bathroom having the washroom 3 and the bathtub 2 can be overlooked in a standard bathroom. Human body sensor 5
By housing the human body detection sensor 51 and the infrared sensor 52, which compose the above, in one case, they can be easily attached and inspected.

Next, a connection structure of another embodiment between respective members such as a sensor and a remote controller which constitute the entire apparatus will be described with reference to FIG. The bath remote controller 60 and the kitchen remote controller 70 are connected to the controller 90 of the controller in the hot water equipment 40 by a cable 41 of a wired remote controller.

The human body detection sensor 51 is a cable 41.
Is connected to the bath remote controller 60. The bath remote controller 60 is provided with a connecting terminal 85 for connecting the cable 41, and power for operating the human body detection sensor 51 is supplied from the bath remote controller 60. The connection between the human body detection sensor 51 and the hot water equipment 40 or the remote controls 60, 70 is not limited to the above example, and as shown in FIG. 8, a kitchen remote controller connected to the hot water equipment 40 via the communication IC from the human body detection sensor 51. 7
You may connect from 0 through the bath remote controller 60. In addition, the kitchen remote controller 70 and the bath remote controller 60 are connected via the communication IC.
The hot water equipment 40 may be connected in this order. Alternatively, as shown in FIG. 15, the human body detection sensor 51 and the hot water device 40 may be directly connected via a communication IC, similarly to the connection between the bath remote controller 60 and the kitchen remote controller 70.

In FIG. 7, the control unit 90 includes a water heater control unit 91 for controlling the hot water equipment 40, and a speaker or the like provided on each of the remote controllers 60 and 70 which is operated by an abnormality detection signal from the human body detection sensor 51. Notification means 61, 71
Is provided with a notification operation unit 92 for operating the above, and a notification canceling unit 93 for canceling the notification by the notification means. The notification operation unit 92 and the notification canceling unit 93 may be provided on the sensor side or the remote controller side. This can reduce the control load on the hot water equipment side.

Further, the bath remote controller 60 is provided with an intercom switch 62, an operation switch 63 for operating the hot water equipment, a liquid crystal display plate for displaying, a display means 64 such as a touch panel. Further, the kitchen remote controller 70 is provided with an intercom switch, an operation switch 73 for operating the hot water equipment, and a display means 74 for display. Further, it is recommended that the notifying means 61 and 71 provided for each remote controller for notifying the voice are constituted by a speaker and a voice IC.

Further, when the notification is not canceled, the telephone transmission section 1 for transmitting to a specific telephone number for emergency contact.
00 may be provided in the control unit 90.

FIG. 8 shows a human body detection sensor 51 and each remote controller 6
It is an example of a circuit diagram showing a communication connection relationship between the 0.70 and the hot water equipment 40, and this embodiment is connected using a communication IC. The human body detection sensor 51 includes, in addition to the above-described imaging device 6, a control device 7 and a communication unit 53 including a communication IC for communication.
Is provided. This communication unit 53 is an analog communication unit 55.
And the digital communication unit 56, and the analog communication unit 55 is, for example, ASK (amplitude shift keying).
It may be configured by a method. Further, the digital communication unit 56 may employ, for example, a QPSK (quadri phase shift keying) system or a digital high-speed modulation system such as M16QAM, GFSK, or BPSK.

In the bath remote controller 60, in addition to the operation switches described above, a display means 64 comprising a dot matrix display section, a bath remote controller controlling section 65, the same analog communication section 66 comprising a communication IC for communication, and digital communication. A section 67 is provided. Further, the bath remote controller 60 is provided with a voice IC 68 for notification and a PCM codec 69 on a speaker 61. This PCM codec 69
For example, PCM (pulse code such as ADPCM, DPCM)
modulation) method, which encodes and decodes audio information and video information.

Further, the intercom switch 62 of the bath remote control 60 is for pressing a call button to bring it into a call state with the speaker of the intercom provided in the kitchen remote control 70. It may also be used as a microphone switch. Then, when the intercom stops are detected, or when an alarm is issued by the notification means, the intercom can be used to talk between the bath and the kitchen without pressing the call button. An intercom operating means 120 is provided. The intercom operating means 120 is programmed in the microcomputer as software, and the microcomputer itself may be provided in the bath remote controller, or may be provided in the human body detection sensor 51 or the controller of the hot water equipment. . In FIG. 12, the human body detection sensor 5
1 is programmed in the microcomputer of the controller 7. The remote control case of the bath remote control 60 is provided with a connection terminal 85 for connecting the cable 41. The human body detection sensor is passed through the bath remote control 60 via the kitchen remote control 70 connected to the hot water equipment 40 by the cable 41. A power supply for operation is supplied to 51.

Further, the human body detection sensor 51 is provided with a data storage unit 54 including a voice storage unit and an image storage unit described later. The data storage unit 54 may be provided on the remote controller side. In the kitchen remote controller 70, in addition to the operation switches 73 described above, a display unit 74 including a dot matrix display unit, a kitchen remote controller control unit 75, an analog communication unit 76 including a communication IC for analog communication, and a communication IC for digital communication are provided. The digital communication unit 77 is provided.
Reference numeral 78 denotes a voice IC which is an IC for notifying the speaker 71 or the like. 79 is a PCM codec. Further, the intercom switch 62 of the kitchen remote controller 70 is in a call state with the speaker of the intercom provided in the bath remote controller 60 by pressing the call button. It may also be used as a microphone switch. Then, similarly to the above, when the stop of the movement of the human body is detected, or when the alarm by the notifying means is issued, the call between the bath and the kitchen is enabled and the intercom can be talked without pressing the call button. It is designed to work. The hot water equipment 40 is provided with the above-described control unit 90, hot water supply control unit 91, an analog communication unit 95 including a communication IC for communication, a transformer 96 for lowering the commercial power supply voltage, and the like.

The analog communication section 55 and the digital communication section 56 of the human body detection sensor 51 are connected to the bath remote controller 60.
The analog communication unit 66 and the digital communication unit 67 of the bath remote controller 60 are connected to the analog communication unit 66 and the digital communication unit 67 of the bath remote controller 60, and the analog communication unit 76 and the digital communication unit 77 of the kitchen remote controller 70 connect the hot water device 40. It is connected to the analog communication unit 95. The cable 41 between these communication parts uses a power superposition type two-core cable,
The signal for the sensor and the control signal for the normal hot water supply control may be superimposed and transmitted.

FIG. 9 is an explanatory diagram showing the contents of the data storage section 54 provided in the human body detection sensor for operating the human body detection sensor and informing the notification means.

In FIG. 9, a voice storage unit 101 stores voice data for informing the voices to the above-mentioned remote control notifying means 61, 71, and is an EEPROM.
Etc. The voice storage unit 101 has at least an operation request notification voice storage unit 107 that stores voice data for notifying a bather of a request to move the body with a message “Please move”, and a bath. The alarm notification voice storage unit 108 stores voice data for issuing an alarm to another person when the movement of the person stops and a predetermined time elapses. . Further, the operation request notification voice storage section 107 and the notification means 61, 71 constitute an operation request notification means.

An image storage unit 102 stores image display data for displaying an image for human body detection on the display means 64, 74. This image storage unit 102
Is for displaying a function necessary for human body detection by an image. For example, an operation image storage unit 103 for storing image data for displaying a screen required for initial operation of human body detection on a display unit, a human body Image storage unit 104 for storing image data for displaying the state in which the movement of the display unit is stopped, and an image storage unit for notification for storing image data for displaying the state in which the notification unit is notified on the display unit. 105 and other storage unit 106 for storing data necessary for displaying other images. The other storage unit 106 stores a plurality of still image data in order to display a moving image. The moving image is not an actual captured image of the human body but a pseudo image showing that the human body is moving, such as an image of a moving doll animation. We are trying to protect privacy by anthropomorphizing not only moving images but also still images. The still image can be displayed by using one of the still images.

Although the image storage unit 102 is provided on the human body detection sensor 51 side in this embodiment, the present invention is not limited to this example, and as shown in FIG. 16, the remote controller side, for example, the bath remote controller 60 of the bath remote controller 60. The microcomputer of 65 may be provided integrally or separately. Then, the bath remote controller control unit 65 calls the image data from the other storage unit 106 of the image storage unit 102 to display the image data on the display unit 6.
The motion image display means 133 for displaying at 4 and 74 is programmed. The motion image display means 133 is operated by a signal of motion amount detection by the motion amount calculation means 111. And a plurality of sheets (for example, 5
By sequentially displaying (still) still images on the screen of the display means at regular time intervals, a moving image can be formed due to the afterimage phenomenon.

Further, the bath remote controller control unit 65 calls the data of one still image corresponding to the stopped state from the plurality of still images in the other storage unit 106 of the image storage unit 102, and displays it. The stop image display means 134 for displaying at 64 and 74 is programmed. The display by the stop image display means 134 is released by turning off the operation switch 129 (140) provided on the remote controller.

Further, the stop image display means 134 is adapted to be operated by a signal for judging the stop of the human body by the judging means 32. The bath remote controller control unit 65 is programmed with a switching unit 135 for releasing the display by the stop image display unit 134, activating the motion image display unit 133, and switching to a moving image. Switching means 13
5 is specifically operated by a signal from the operation switch 129 of the remote controller. Operation switch 12
The stop image display may be canceled by turning off 9 and then the operation switch may be turned on to display the motion image by detecting the motion amount. FIG. 15 shows an embodiment of the present invention. Each remote controller 60, 70 is provided with operation switches 129, 141 for supplying main power to the hot water equipment body 40. Then, the control device 7 for the human body detection sensor 51 is operated by the operation switches 129 and 141 via the interlocking means 141.
Is controlled. That is, the operation switch 12
The operation switch and the control device 7 are interlocked with each other so that the human body detection sensor 51 is activated by turning on the operation buttons 9 and 141, and the human body detection sensor 51 is turned off by turning off the operation switches 129 and 141.

When the human body detection operation is performed, the operation switch of the remote controller is operated in advance to detect the human body detection sensor 5.
An initial screen image required for the operation is called from the operation image storage unit 103 on the first side and displayed on the display units 64 and 74, and a specific screen is selected from the screen to start the operation. From the second time, these may be stored and used. Simultaneously with the operation, a part of the voice data is called from the voice storage unit 101 on the human body detection sensor 51 side, and the notification means 6 such as a speaker is called.
1 and 71 are used to notify by voice.

Next, when the entry determination is made as described above, as shown in FIG. 6, the human body stop detection flow is entered, and the image of the human body is picked up by the image pickup device 6 at a predetermined time interval as described above ( In step S11), the captured previous image and the current image after a predetermined time are temporarily stored in the control device 7 (step S12).

Next, the motion amount calculating means 111 programmed in the control device 7 calculates the difference (motion amount) between the light receiving amount of the previous image and the light receiving amount of the current image for each pixel in each area. (Step S13). When the movement of the human body is detected by the movement amount calculation, the image data is called from the image storage unit 102, and the movement image display unit 133 causes the display unit 6 to display.
A moving image is displayed on pages 4 and 74 (step S2).
1). This moving image may be composed of, for example, an animation of moving a hand and an image of moving a body up and down, left and right. Specifically, it may be composed of a plurality of still-state pictorial images having slightly different pictures. Then, the display plates of the display means 64, 74 are used as a liquid crystal display portion of the matrix, so that the light and dark (white, black) of each dot forming the matrix are combined to form a plurality of symbols, It is recommended to display the pattern repeatedly on the screen in a fixed order to display the still image in a pseudo manner as if it were a moving image using the afterimage phenomenon. On the other hand, the motion presence / absence detection unit 112 detects a region in which motion is occurring (step S1).
4).

Then, these pieces of information are sent to the judging means 32 of the control device 7. In the judging means 32, the specific area matching judging means 113 judges whether or not the area in which the motion is occurring corresponds to a previously specified area, that is, the bathtub area 31 or the washing area 30. Further, in parallel with the determining means 32, the motion presence / absence determining means 114 determines whether or not there is a motion.

When the area in which the motion is occurring corresponds to the bathtub area 31 or the wash area 30 (in the case of YES in step S15) and when it is determined that there is no motion (in the case of YES in step S16) ), It is estimated that the bather has fallen in the bathroom, and it is determined that the movement of the person has stopped (step S17). By this stop determination, the next notification alarm step is performed.

If it is determined that there is movement in the bathtub or the wash area (No in step S16), the imaging, calculation, and determination are repeated at predetermined time intervals and repeated as described above. is there. Further, in step S15, when the area where the motion is occurring is other than the bathtub or the wash area (in the case of NO in step S15), and it is determined that there is no motion thereafter (in the case of YES in step S18) The infrared sensor 52 is turned off (step S1).
It is determined that the user has exited the bathroom on the precondition that the answer is YES in 9) (step S20). Further, when the area in which the motion is occurring is other than the bathtub or the wash area (in the case of No in step 15) and the motion continues after that (in the case of No in step S18)
Is likely to be active near the entrance to the bathroom, so it is continuously monitored. As described above, even when the vehicle stops at the entrance area, it is not determined that the vehicle has stopped, so that an alarm due to an erroneous determination is not generated.

Next, the human body monitoring flow shown in FIG. 13 will be described. When the stop determination is made as described above (step S30), the stop determination signal is output,
The moving image is stopped and the stopped image display means 13
4 operates, and an image showing the stopped state is displayed on the display means 64, 7.
4 is displayed (step S30). That is, the moving image is stopped and the still image is displayed. As a result, the bather is conscious of starting to move, etc.
Family members can know the condition of the bathroom before the alarm. This still image is configured by using one still image that constitutes a part of the above-mentioned moving image, and the image creation is simplified by sharing the image. Further, by making the display section of the remote control a dot matrix display, even if the image is shared, the displacement of the pattern is less likely to occur, and it is easy to confirm the image from the outside.

The control device 7 for the human body detection sensor 51
The timer means 117 provided in step S31 starts the stop count operation (step S31). The timer means 117 is started by a stop determination signal from the determination means 32 and counts a predetermined time. This predetermined time is divided into two steps, and the predetermined time of the first step is, for example, 90 seconds,
The predetermined time of the second stage following this is set to 30 seconds. The predetermined time is not limited to this example, and can be arbitrarily set other than this.

Then, the timer means 117 and the display means 6
In relation to Nos. 4 and 74, the timer means 117 uses the clock function of the microcomputer of the control means of the human body detection sensor 51 to count the time under normal conditions. This time display is displayed on the display means 64 of the bath remote controller 60 by the time display means 130 of the microcomputer of the bath remote controller 60 provided in the bath remote controller 60. Further, the microcomputer of the bath remote control unit 65 is provided with the timer means 117 after the stop determination.
After the set time has elapsed from the start of counting by the display means 6
Count display means 13 for displaying the count on 4
1 is provided. Specifically, the count display means 131 starts to display a number on the display means 64 after 60 seconds have elapsed after the stop determination, until the predetermined time of 90 seconds, which is the first step, has elapsed. During the period, that is, from the start of the display, the count status is displayed by numbers for 30 seconds. It is recommended that the count display be counted down from 30 every 1 second. Thereby, the bather can instantly grasp the remaining time until the later notification of the operation request. In addition, the microcomputer of the bath remote controller 65 has a display means 64.
There is provided a switching display means 132 for switching the time display from the time display to the count display.

In FIG. 13, when the set time elapses after the stop determination (Yes in step S40), the count display means 131 causes the display means 64,
A numerical value is displayed on 74 (step S41). Instead of numerical values, different pictorial diagrams may be displayed according to the passage of time. Although the count is started here, by delaying the display of the count only by the set time from the start of the count, which is the time when the stop is determined, the bather may feel anxiety that the count will start immediately after the stop. Can be wiped off.
Further, in response to an operation request described later, when the movement is started, the timer is released, the count display itself can be omitted, and the number of times of switching to the clock display can be reduced.

Further, when the motionless state continues for the first predetermined time (90 seconds) (step S33), a motion request signal is output from the human body detection sensor 51 side (step S33).
34), the bath remote controller 60 notifies the bather of the operation request (step S35). Regarding this notification procedure, the previously stored information corresponding to the stopped scene is read from the operation request notification voice storage unit 107 of the voice storage unit 101 side of the human body detection sensor 51 and the stopped image storage unit 104 of the image storage unit 102. Then, the data is transmitted via the analog communication unit 55 and the digital communication unit 56, and the remote control unit is notified by voice and displayed as an image.

More specifically, this notification may be made, for example, by voice information and a character image such as "There is no movement in the bathroom. Please move." This is to prevent the false alarm of the human body detection sensor by requesting the bather to move in the bathtub because the motion may stop if the user stays still in the bathtub. This notification is given after a while after it is soaked in the bathtub and does not move, that is, after the stop determination and after a predetermined time elapses. Therefore, the operation request is not made immediately after being immersed in the bathtub.

When the human body detection sensor 51 detects the movement of a person within the above predetermined time after the stop determination (step S3)
(No in 2), it can be assumed that the bather is alive and the timer is canceled (step S42). And at the same time,
In response to the detection signal obtained by detecting the movement of the human body, the display of the still image by the still image display means 134 is canceled (step S43). After being released, the moving image display means 133
Therefore, the moving image may be displayed again. This allows family members in remote locations to know that they have started moving after the stop.

Then, even after the operation request is notified (step S35), if the still stopped state continues for the second predetermined time (30 seconds) (Yes in steps S36 and 37), An abnormal state is determined, an abnormality detection signal is output from the determination unit 32, and the alarm notification voice storage unit 108 and the image storage unit 1 of the voice storage unit 101 are output.
Information stored in advance for notifying another person of an abnormal state is transmitted from the notification image storage unit 105 of No. 02 via the communication unit 53, and the notification units 61 and 71 of each remote controller are audibly alarmed and the display unit is displayed. Images are displayed on 64 and 74 (step S38).

This alarm (step S38) is specifically made by, for example, voice information and a character image such as "please go to the bathroom". As a result, the abnormality information of the human body detected by the human body detection sensor 51 can be simultaneously issued to the kitchen as well as the bathroom.

This alarm signal is transmitted as shown in FIG. 8 via the communication section composed of the communication IC. That is, the voice storage unit 101 and the image storage unit 10 provided in the human body detection sensor 51.
2, the voice and the image data are called according to the above-mentioned signals and transmitted to the kitchen remote controller 70 via the analog and digital communication units 66 and 76, and the notification means 71 and the display means such as a speaker provided in the kitchen remote controller 70. Notification and display at 74. Image detection and processing is performed in each of the areas 2 described above.
Since it is performed every 9, 30, and 31, the response speed for notification and display will be accelerated.

Since the intercom is already in a call-enabled state, a bather who does not move but can speak is as long as he or she can speak in an emergency in an abnormal state without pressing the call button. It is convenient to be able to contact the family outside the bathroom immediately.

When the human body detection sensor 51 detects the movement of a person within a predetermined time after the notification of the operation request (step S3)
(No in 6), the bather can be inferred to be in good health, and the timer is canceled similarly to the above (step S44). At the same time, in response to the detection signal from the detection of the movement of the human body, the display of the stop image by the stop image display means 134 is canceled (step S45). After being released, the moving image may be displayed again on the display means 64, 74 of the remote controller. As a result, the state of the bathroom up to the alarm notification can be grasped from a remote place.

After the alarm is given, a family member rushes to the bathroom and rescues. The notification and cancellation of the stop image display may be performed by turning off the operation switch 129 (140) (step S39). The operation of the human body detection sensor 51 is also stopped via the interlocking means 141 when the operation switch is turned off. Thus, the sensor can be stopped and the alarm notification can be canceled immediately. Further, when the alarm is issued, by turning off the operation switch 140 of the kitchen remote controller, the sensor operation can be stopped and the alarm can be released without going to the bathroom. By utilizing the remote controller for controlling the hot water equipment 40, it is not necessary to separately provide switches for sensors.

The above-described embodiment shows a preferred embodiment of the present invention, and the present invention is not limited to this, and various design changes can be made within the range. Further, although the system bathroom has been described in the present embodiment, the present invention is not limited to this example, and the system bathroom can be installed in other existing bathrooms. Furthermore, the human body detection sensor is C
A CD camera may be used. Further, although the human body detection sensor and the notifying means are connected by wire, they may be connected by wireless.

[0067]

As described above, according to the present invention, the operation switch and the control device are interlocked so as to stop the operation of the human body detection sensor by turning off the operation switch of the remote controller.
It is possible to prevent forgetting to turn off the operation switch of the human body detection sensor after bathing. In addition, by operating the human body detection sensor by turning on the operation switch of the hot water equipment, it is not necessary to separately provide an operation switch for human body detection, and the human body can be detected by operating the hot water equipment. This will prevent forgetting to turn on the switch. Furthermore, according to the present invention, the operation can be stopped and the notification can be canceled without going to the bathroom, and the operability is improved. Also,
By utilizing the remote control to display, it is not necessary to provide a notification section separately. In addition, the present invention provides a switch for canceling the notification after the alarm notification by interlocking the operation switch and the control device so as to stop the operation of the human body detection sensor by turning off the operation switch and cancel the notification of the image and the sound. There is no need to provide it separately. Further, the present invention is
By capturing the actual image and continuously processing the image data, it is possible to detect the movement of the human body quickly and reliably,
It is possible to ensure the alarm notification. In addition, it is possible to reliably judge the movement of the bather.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram showing an embodiment of the present invention.

FIG. 2 is a block diagram of an electric circuit showing an embodiment of the present invention.

FIG. 3 is a circuit diagram showing a configuration of an image core circuit that constitutes one pixel of an image detection unit of a human body detection sensor.

FIG. 4 is an explanatory diagram showing a relationship between an image pickup range of a sensor, a detection range, and a detection region.

FIG. 5 is a flowchart showing an embodiment of the present invention.

FIG. 6 is a flowchart showing a flow of human body monitoring of the present invention.

FIG. 7 is a block diagram showing an embodiment of the entire apparatus of the present invention.

FIG. 8 is a block diagram showing another embodiment showing a communication relationship.

FIG. 9 is a block diagram showing an outline of a storage unit.

10A is a diagram showing a current image and a previous image of an object moved to the lower right, FIG. 10B is a diagram showing brightness and darkness of the previous image for each pixel, and FIG. It is a figure which shows the brightness of an image for every pixel.

FIG. 11 is a diagram showing a difference image showing a change in lightness and darkness in a pixel corresponding to an image boundary.

FIG. 12 is an electric circuit block diagram showing one embodiment.

FIG. 13 is a flowchart of human body monitoring showing an embodiment.

FIG. 14 is an electrical block diagram showing another embodiment.

FIG. 15 is an electric block diagram showing another embodiment of the present invention.

FIG. 16 is an electrical block diagram showing an embodiment of the present invention.

[Explanation of symbols]

1 bathroom 2 bathtubs 3 washroom 4 doorways 5 human body sensor 6 Imaging device 7 Control device 9 Image detector 15 Image output section 17 Image core circuit 24 area dividing means 26 Detection area 29 Entrance area 30 washroom area 31 Bath area 32 Judgment means 40 Hot water equipment 41 cable 42 Controller 47 Power plug 51 Human body detection sensor 52 infrared sensor 54 data storage unit 55 Analog Communication Department 56 Digital Communications Department 60 bath remote control 61 Notification means 62 Release means 66 Analog communication unit 67 Digital Communications Department 70 kitchen remote control 71 Notification means 76 Analog communication unit 77 Digital Communications Department 85 terminals 90 Control unit 100 telephone call department 101 voice memory 102 image storage unit 103 Operation image storage unit 104 still image storage unit 105 Notification image storage unit 106 Other storage section 107 operation request notification voice storage unit 108 Alarm notification voice storage unit 111 Motion amount calculation means 112 Motion Presence / Absence Area Detection Means 113 Specific Area Applicability Determination Means 114 motion presence / absence determining means 115 image storage means 116 Entrance area applicable determination means 117 timer means 120 Intercom operation means 129 Run switch 130 time display means 131 count display means 132 switching display means 133 motion image display means 134 Stop image display means 135 switching means 140 operation switch 141 interlocking means

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Shinji Narimasa             93 Edo-cho, Chuo-ku, Kobe-shi, Hyogo Stock Association             Company Noritsu (72) Inventor Kenji Kawai             93 Edo-cho, Chuo-ku, Kobe-shi, Hyogo Stock Association             Company Noritsu (72) Inventor Yasuhide Ikeuchi             93 Edo-cho, Chuo-ku, Kobe-shi, Hyogo Stock Association             Company Noritsu (72) Inventor Takayuki Ueda             93 Edo-cho, Chuo-ku, Kobe-shi, Hyogo Stock Association             Company Noritsu F-term (reference) 2D005 FA00                 3L024 CC06 DD01 DD11 DD21 EE03                       EE05 EE08 EE10 EE11 FF09                       FF18 GG38 GG41 GG42 HH02                 5C086 AA22 BA04 CA12 CA28 CB16                       CB36 DA02 DA15 DA16 DA33                       EA11 EA45 FA06                 5C087 AA02 AA03 AA09 AA25 AA37                       AA42 BB03 DD03 DD08 DD24                       EE05 EE06 EE08 EE16 FF30                       GG65

Claims (3)

[Claims] 1. A water heater main body having a built-in heat exchanger and a burner, a remote bath controller for controlling the combustion of the water heater main unit from a remote location, a kitchen remote controller installed in a place other than the bathroom, and the water heater main body. Alternatively, a human body detection sensor that is connected to the remote controller of the hot water equipment to monitor the bathroom, an operating switch that is provided on both remote controls to supply main power to the main body of the hot water equipment, and a display unit that displays the set hot water temperature and the like,
A control device for activating and deactivating the human body detection sensor, wherein the human body detection sensor is activated by turning on the operation switch, and the human body detection sensor is deactivated by turning off the operation switch. A hot water device characterized in that the control device and the control device are interlocked with each other. 2. A hot water equipment body having a built-in heat exchanger and a burner, a remote bath controller for controlling the combustion of the hot water equipment body from a remote location, a kitchen remote control installed outside the bathroom, and the hot water equipment body. Alternatively, a human body detection sensor that is connected to the remote controller of the hot water equipment to monitor the bathroom, an operating switch that is provided on both remote controls to supply main power to the main body of the hot water equipment, and a display unit that displays the set hot water temperature and the like,
A control device for activating and deactivating the human body detection sensor, and means for informing the display means of an image and a sound for warning when the human body detection sensor determines that the human body is stopped. The human body detection sensor is operated by turning on the switch, the human body detection sensor is stopped by turning off the operation switch, and the operation switch and the control device are interlocked so as to cancel the notification of the image and sound. Hot water equipment. 3. A hot water equipment body having a built-in heat exchanger and a burner, a remote bath controller for controlling the combustion of the hot water equipment body from a remote location, a kitchen remote control installed in a place other than the bathroom, and the hot water equipment body. Alternatively, a human body detection sensor that is connected to the remote controller of the hot water equipment to monitor the bathroom, an operating switch that is provided on both remote controls to supply main power to the main body of the hot water equipment, and a display unit that displays the set hot water temperature and the like,
A control device that activates and deactivates the human body detection sensor, a means that notifies the display means of an image and a sound for warning when the human body detection sensor determines the human body is stopped, and an image of the monitoring area is taken at predetermined time intervals. An image pickup device; and a motion amount calculation means for calculating the motion amount of the human body as a difference in the amount of received light by comparing both images before and after the predetermined time interval,
The motion amount calculating means includes a motion presence / absence determining means for determining presence / absence of motion, and a determining means for determining the motion of a human body by the motion presence / absence determining means, and the human body detection sensor is activated by turning on the operation switch. A hot water apparatus characterized in that an operation switch and the control device are interlocked with each other so that the human body detection sensor is operated when the operation switch is turned off and the notification of an image and a sound is released.