JP5760315B2 - Image determination device - Google Patents

Description

  The present invention relates to a security system using an image determination device.

2. Description of the Related Art Conventionally, there has been proposed a video monitoring apparatus that takes an image of an elderly person living alone with a camera and determines whether there is an abnormality. Further, there has been proposed a technique for performing mosaic processing on a captured image in order to protect the privacy of a person captured by a camera.
(For example, patent document 1).

JP 2002-142214 A

  However, the conventional video monitoring apparatus has a problem that it takes time and effort because the abnormality detection of the subject is always photographed by the camera and monitored by another monitor. In particular, it is complicated when there are a plurality of subjects.

If it demonstrates corresponding to the code | symbol of drawing showing one Example, the image determination apparatus of Claim 1 will be described. The imaging device (2) which images an image in a predetermined imaging range from a 1st direction, and a 1st object person's The height information and the height information of the second subject are obtained, and the imaging is performed when one of the first subject and the second subject within the predetermined imaging range moves from the predetermined imaging range. A processing device (14) that performs imaging by a device, identifies the one based on the height information, and identifies the other of the first subject and the second subject within the predetermined imaging range ; It has.
The image determination device according to claim 2, wherein the imaging device captures an image of the head of the other subject, and the processing device detects an image of the head of the other subject from an image captured by the imaging device. The size is identified, and whether the other subject is abnormal is identified. The image determination apparatus according to claim 3 includes a communication unit (3) that transmits an image captured by the imaging device to another device when the processing device identifies the abnormality of the first subject. ing. According to a fourth aspect of the present invention, there is provided an image determination apparatus comprising a speaker (10) for outputting sound toward the other subject. The image determination apparatus according to claim 5 includes a microphone (9) for recording the voice of the other target person, and the processing apparatus determines that the other target person is abnormal based on the voice recorded by the microphone. Identify whether or not.

The image determination apparatus according to claim 6, wherein, the processor is to obtain the respective height of the second subject and said first subject as the height information.

The image determination apparatus according to claim 7, wherein, the processor is to obtain the height information according to the imaging result of the first subject and the second subject by the imaging device.

The image determination device according to claim 8 , wherein the imaging device images a structure, and the processing device has a height of at least one of the first object person and the second object person based on the imaged structure object. I have information.

In the image determination device according to the ninth aspect , the imaging device captures images separately for the first subject and the second subject.

The image determination apparatus according to claim 10 includes an interface unit (8) for cooperating with an electrical appliance when the processing apparatus cannot determine that the first target person or the second target person is normal . The image determination device according to claim 11 includes a pyroelectric sensor (6) capable of detecting the first subject and the second subject, and the imaging device is based on a detection result of the pyroelectric sensor. The one subject who moves from the predetermined imaging range is imaged.

  In addition, in order to explain the present invention in an easy-to-understand manner, it has been described in association with the reference numerals of the drawings representing one embodiment. However, the present invention is not limited to this, and the configuration of the embodiment described later is appropriately improved. Alternatively, at least a part may be replaced with another component. Further, the configuration requirements that are not particularly limited with respect to the arrangement are not limited to the arrangement disclosed in the embodiment, and can be arranged at a position where the function can be achieved.

  According to the present invention, it is possible to ensure the privacy of the subject and to determine the state of the subject with a simple configuration.

It is a block diagram of image discriminating device 1 of this embodiment. It is a figure which shows the principal part of the image discrimination device 1 of this Embodiment. 2 is a diagram illustrating a configuration of an imaging unit 2. FIG. It is a figure which shows the change of the magnitude | size of the head according to the attitude | position of a subject. FIG. 5A is a diagram showing a change in the size of an image formed by the wide-angle lens system, and FIG. 5A is a diagram showing the distance from the front focal point of the wide-angle lens system to the subject's head and the size of the image; FIG. 5 (b) is a diagram obtained by converting FIG. 5 (a) to a height from the floor. It is a figure which shows the change rate of the magnitude | size of the image based on FIG. It is a flowchart in the case of installing an image determination apparatus in a living room. It is a figure which shows the case where a subject is in the walk area | region of a living room. It is a figure which shows the case where an object person is near the closet. It is a figure which shows the change of the magnitude | size of the image of a subject's head imaged by an image pick-up element according to a subject's position. It is a flowchart showing operation | movement of an image determination apparatus. It is a figure which shows the influence of the distortion of a wide angle lens system according to the prospective angle with a subject. It is a figure showing the state where the subject person is sitting on the chair in front of the desk. It is a still image when the subject is determined to be abnormal.

-First embodiment-
The image determination apparatus according to the present embodiment can be installed in a room such as a house or office, and the case where it is installed in a living room will be described below.

  FIG. 1 is a block diagram of an image discriminating apparatus 1 according to the present embodiment, and FIG. 2 is a diagram showing a main part of the image discriminating apparatus 1. As shown in FIGS. 1 and 2, the image discrimination device 1 measures the illuminance in the living room when the imaging unit 2 that performs imaging, the communication unit 3 that communicates with other devices, and the imaging unit 2 performs imaging. Illuminance meter 4, LED 5 (Light Emitting Diode) that illuminates the subject in the living room when the illuminance measured by the illuminometer 4 is low, pyroelectric sensor 6 that discriminates the presence or absence of the subject, and image discrimination device 1 includes a setting unit 7 for performing various settings, an interface unit 8 for cooperating with a living lighting device or an appliance, a microphone 9 for recording the voice of the subject, and a speaker 10 for speaking to the subject. In addition, the image discrimination device 1 includes a flash memory 11 that is a storage medium that stores captured images and position information at specific points in the living room when the subject is in the living room, a crystal oscillator, and an integrated circuit for timing. And a calendar unit 12 that automatically measures calendar information such as year, month, day, hour, minute, and second and stores the schedule of the subject person.

  The image discrimination device 1 is connected to a lithium ion battery as a backup power source when a primary power source (in this embodiment, a household power source) is not supplied due to a power failure or the like. The backup power source is not limited to a lithium ion battery, and a capacitor or the like may be used for household solar power generation or a lithium ion battery.

  The CPU 14 controls the entire image discrimination device 1 and is electrically connected to each component. Needless to say, the CPU 14 and the setting unit 7 are electrically connected even when the setting unit 7 is a remote controller.

(Imaging unit 2)
The imaging part 2 is provided in the center part of the ceiling of a living room, and mainly images a subject's head. In the present embodiment, the height of the ceiling of the living room is 2.6 m.

  FIG. 3 is a diagram illustrating a configuration of the imaging unit 2.

  As shown in FIG. 3, the image pickup unit 2 has a three-group wide-angle lens system, a low-pass filter, an image pickup device such as a CCD or a CMOS, and a circuit board that drives and controls the image pickup device. The image pickup device of the present embodiment has a size of 23.7 mm × 15.9 mm, a number of pixels of 4000 × 3000 (12 million pixels), and the size of one pixel is 5.3 μm, but is not limited thereto. It is not a thing.

  The aforementioned wide-angle lens system includes a first group having two negative meniscus lenses, a second group having a positive lens, a cemented lens, and an infrared cut filter, and a third group having two cemented lenses. The diaphragm is arranged between the second group and the third group. The wide-angle lens system of this embodiment has a focal length of 6.188 mm and a maximum field angle of 80 degrees.

  The wide-angle lens system is not limited to the three-group configuration, and the number of lenses, the lens configuration, the focal length, and the angle of view of each group can be changed as appropriate.

  FIG. 5 is a diagram showing changes in the size of the image formed by the wide-angle lens system, and FIG. 5A is a diagram showing the distance from the front focal point of the wide-angle lens system to the head of the subject and the size of the image. FIG. 5B is a diagram in which FIG. 5A is converted to a height from the floor.

  The wide-angle lens system of the present embodiment has a focal length of 6.188 mm as described above, and when the diameter of the subject's head is 200 mm, from the front focal point of the wide-angle lens system to the position of the subject's head. When the distance is 1000 mm (when the subject is standing), the size of the subject's head imaged on the image sensor of the imaging unit 2 is 1.238 mm, and the subject's head position is 300 mm. When the distance from the front focal point of the wide-angle lens system to the position of the subject's head is 1300 mm, the size of the subject's head that forms an image on the image sensor of the imaging unit 2 is 0.952 mm, which is 0. It can be seen that the size of the .286 mm (23.1%) image changes.

  Similarly, when the distance from the front focal point of the wide-angle lens system to the position of the subject's head is 2000 mm (when the subject is in the middle waist), the size of the subject's head that forms an image on the imaging device of the imaging unit 2. When the position of the subject's head is lowered by 300 mm, the size of the subject's head that forms an image on the image sensor of the imaging unit 2 is 0.538 mm, which is 0.081 mm ( 13.1%) It can be seen that the image size changes, and the change in the image size decreases as the distance from the front focal point of the wide-angle lens system to the subject's head increases.

  As described above, according to the image determination apparatus 1 of the present embodiment, when the size of the subject's head is known, the subject is determined from the front focus of the wide-angle lens system based on the size of the subject's head image. Therefore, it is possible to determine the posture of the subject (standing, lying in the middle, falling down) and the change in posture while maintaining the privacy of the subject.

  FIG. 6 is a diagram showing the rate of change in the size of the image based on FIG. 5, and shows the rate of change in the size of the image formed by the wide-angle lens system every time the subject's head position changes by 100 mm. ing.

  Since the rate of change of the image size when the distance from the front focal point of the wide-angle lens system to the position of the subject's head is 1000 mm to 100 mm is as large as 9.1%, the image identification device 1 of the present embodiment has Therefore, if the height difference is about 100 mm, a plurality of subjects can be identified from the height difference.

  On the other hand, when the distance from the front focal point of the wide-angle lens system to the position of the subject's head is away from 2000 mm to 100 mm, the change rate of the image size is as small as 4.8%. However, although details will be described later, according to the image determination device 1 of the present embodiment, a change in the posture of the subject is detected even when the distance from the front focal point of the wide-angle lens system to the position of the subject's head is increased. can do.

  5 and 6 both show graphs in the case where the subject is at a low angle of view of the wide-angle lens system (directly below the wide-angle lens system), and the subject is at the peripheral view angle position of the wide-angle lens system. Unlike the graphs of 5 and 6, it is affected by distortion according to the prospective angle with the subject. The effect of this distortion will be described later.

  The light beam incident on the wide-angle lens system enters the image sensor through a low-pass filter, and the circuit board converts the output of the image sensor into a digital signal, which is converted into a digital signal by an image processing control unit configured with an ASIC. The image signal is subjected to image processing such as white balance adjustment, sharpness adjustment, gamma correction, gradation adjustment, and image compression such as JPEG. A JPEG-compressed still image is recorded in the flash memory 11. If it is desired to record a moving image, the image signal may be MPEG processed and recorded in the flash memory 11.

  FIG. 4 is a diagram illustrating changes in the size of the head according to the posture of the subject. As shown in FIG. 4, when the imaging unit 2 is provided on the ceiling of the living room and the position of the subject's head is photographed, when the subject is standing, the size of the head is large (left side), When the subject is lying down, the head size is taken small (right side), and when the photographer is in the middle waist, the head size is smaller than when standing, but larger than when lying down. Imaged (center). In the present embodiment, it is determined whether the subject is normal or abnormal based on the state of the subject, that is, the size of the head according to the Z direction. Thus, since the focus is on the size of the subject's head along the Z direction, the privacy of the subject can be protected.

  If the subject is abnormal and falls to the floor, adding a zoom lens to the above-mentioned wide-angle lens system enables continuous eye-to-eye imaging and pattern matching. It is possible to determine whether the eyeball is open, whether the eyeball is moving, whether the mouth is moving, and whether the mouth is breathing.

  Further, contrast AF is known in which a high frequency component of a signal from an image sensor is extracted and a lens position where the maximum frequency component is detected is detected to perform focus detection. Also in the present embodiment, contrast AF may be applied and a part of the wide-angle lens system may be adjusted to an optimum position.

  Imaging by the imaging unit 2 usually only requires 48 still images per day if set to about once every 30 minutes, and the power supplied to the image determination device 1 and the recording area of the flash memory 11 can be determined. Can be saved. Further, the shooting interval may be changed according to the time according to the date and time information from the calendar unit 12. Specifically, the daytime may be set at an interval of 30 minutes, and the nighttime may be set at an interval of 20 minutes. Note that if the imaging device is a CMOS, the mechanical shutter is omitted, and an electronic shutter (rolling shutter) is used, no sound is generated during shooting and the subject's sleep is not hindered.

  Alternatively, a short moving image of about 3 to 5 seconds may be taken instead of a still image.

  When an abnormality is detected from an image captured by the CPU 14, the imaging unit 2 performs about 100 continuous images per minute or about 100 images at 15-second intervals according to a command from the CPU 14. To. The shooting interval may be set using the setting unit 7 described above.

  When the imaging unit 2 captures a still image, the imaging time, ISO sensitivity, and the like are determined by the illuminance detected by the illuminometer 4, and when the living room is dark, the ISO sensitivity is increased and the imaging time is lengthened. In addition, when the image determination apparatus 1 is provided in the bedroom and the subject turns off when the subject sleeps, the subject is illuminated by the LED 5, or the interface unit 8 cooperates with the lighting fixture in the bedroom, What is necessary is just to illuminate several seconds (about 3 seconds) so that the brightness required for imaging | photography may be ensured. If the position of the subject is confirmed by the pyroelectric sensor 6 and the position of the LED 5 is adjusted by a driving device (not shown) so that illumination light can be irradiated to the confirmed position, the subject can be efficiently illuminated. The LED 5 may be provided on the ceiling or at an arbitrary position in the bedroom, or a light source other than the LED may be used. It should be noted that the LED 5 can be omitted if a bedroom lighting fixture is sufficient. Moreover, you may employ | adopt LED lighting as a lighting fixture of a bedroom.

  Furthermore, the still image when the subject is imaged only requires an image that can detect the abnormality of the subject, and is different from the still image that is normally viewed. For this reason, when photographing in a dark room, the infrared cut filter disposed in the wide-angle lens system may be retracted by a retracting mechanism (not shown) to secure the amount of light.

(Communication part 3)
The communication unit 3 includes an antenna, a transmission unit, a reception unit, and the like. In the present embodiment, the communication unit 3 can be provided at the corner of the living room, and communicates the presence / absence of the abnormality of the subject to other designated devices (personal relatives such as a mobile phone or a security company personal computer). At the same time, it receives voice information from other devices.
When there is no abnormality in the subject, the communication unit 3 transmits a message indicating that there is no abnormality together with the date and time information to the designated other device, but does not transmit the captured image. Thereby, the privacy of the subject can be protected. As will be described later, when an abnormality occurs in the subject, an image can be transmitted under a predetermined condition.
(Pyroelectric sensor 6)
The pyroelectric sensor 6 is an infrared sensor that detects infrared rays emitted by a person and outputs a detection result to the CPU 14. In the present embodiment, the pyroelectric sensor 6 is arranged to detect infrared rays through a wide-angle lens system. A plurality of pyroelectric sensors 6 may be provided in the living room.

  The CPU 14 may instruct the imaging unit 2 to take an image when detecting that the subject has entered the living room from the output of the pyroelectric sensor 6, and may then take an image at 30-minute intervals. In addition, when the target person leaves the living room for about several minutes and returns, there is no need to reset the timing.

When the CPU 14 detects from the output of the pyroelectric sensor 6 that the subject is not in the living room, the CPU 14 controls the imaging unit 2 so as not to perform imaging even at the timing of imaging. Note that the CPU 14 is designated via the communication unit 3 when the subject does not enter the living room for several days (there is no other room), and the absence stored in the schedule stored in the calendar unit 12 does not exist. Notify other devices that the subject is absent and that there is a possibility of abnormality.
(Calendar part 12)
As described above, the calendar unit 12 automatically measures calendar information such as year, month, day, hour, minute, and second, and stores the schedule of the target person. The schedule of the target person may be input from the setting unit 7, and the date and time (period) and the destination may be input to the microphone 9. In this case, the voice recognition function is provided in the calendar unit 12, but the system does not increase in size because it is only necessary to prepare a simple voice dictionary of date and destination. In addition, the scheduled input may be performed by inputting voice to the microphone 9 in response to a question (when and where) from the speaker 10.

  The calendar unit 12 informs the subject of the next day's schedule via the speaker 10 at night, and contacts the next morning again.

The CPU 14 may set an alarm clock or display the schedule on the television via the interface unit 8 in accordance with the schedule input to the calendar unit 12. In addition, if the user wants to watch TV, the TV may be switched on automatically or the program to be watched can be recorded.
(Calibration)
FIG. 7 is a flowchart when the image determination apparatus of the present embodiment is installed in a living room. Hereinafter, installation of the image determination apparatus will be described with reference to the flowchart of FIG.

  In step 1, a communication device that communicates the presence or absence of an abnormality of the target person is designated. For example, a mobile device such as a cellular phone of a close relative, a personal computer and a personal computer of a security company can be designated. Moreover, a privacy level can be set between the close relative and the security company. For example, if there is no problem even if the privacy level is lowered with respect to a close relative or the like, it is possible to permit transfer of an image at the time of abnormality, cancel mask processing described later, or lower the mask processing level. On the other hand, when the privacy level is set higher than that of the close relative to the security company, image transfer can be prohibited even when an abnormality occurs, or only image transfer masked by mask processing described later can be permitted.

  Based on the designation in step 1, the CPU 14 communicates with the designated device whether or not the subject is abnormal through the communication unit 3.

  In step 2, connected devices such as a television, an audio and a clock are designated. Specifically, it is connected to, for example, a television by wire or wireless via the interface unit 8, and the action schedule stored in the calendar unit 12 is displayed on the television, or the television schedule is reserved at the date and time reserved in the calendar unit 12. Turn on the switch or record the reserved program. Similarly, the audio switch is turned on at the date and time reserved in the calendar unit 12 and the alarm of the clock is audible.

  In step 3, the CPU 14 stores the relationship between the representative position of the living room and the position of the subject's head in the flash memory 11.

  FIG. 8 is a diagram illustrating a case where the subject is in a living walking area (an area in the X direction and the Y direction in which a sofa, a table, a chair, and the like are not provided).

  For example, as illustrated in FIG. 8, the CPU 14 captures the head when the subject is standing in the living room with the imaging unit 2 and associates the position and size of the head in the Z direction when the subject is standing. And stored in the flash memory 11. At this time, the CPU 14 also recognizes positions in the X direction and the Y direction where the subject is likely to stand in the living room. Specifically, a position where there is no sofa, table, chair, or the like is a position where the subject is likely to stand. Furthermore, in addition to the size of the subject's head in the Z direction, an analogy is made from an image obtained by imaging the size of the head in the range Z1 that is slightly higher than the position of the subject's head and Z2 that is slightly lower, The estimated size of the head may also be stored. By doing in this way, the tolerance | permissible_range of the head size when a subject is normal can be set.

  FIG. 9 is a diagram illustrating a case where the subject is near the closet.

  When the subject is close to the closet, it can be standing or crouching. For this reason, as shown in FIG. 9, the CPU 14 captures an image of the head when the subject is crouched by the imaging unit 2, and stores the position of the height Z <b> 3 and the size in the flash memory 11 in association with each other. In addition, the CPU 14 sets the size of the head in the range from the height Z1 to Z2 as the allowable range in the vicinity of the press-in. Even in the allowable range of the heights Z1 to Z2, if the size of the subject's head is not more than the height Z3 for a long time, there is a possibility that an abnormality has occurred in the subject. In such a case, the CPU 14 continuously images the head by the imaging unit 2 and determines that the head is normal if the head is moving by pattern matching, and makes an inquiry by the speaker 10 when the head is not moving. ing.

  FIG. 10 is a diagram illustrating a change in the size of the image of the head of the subject imaged by the imaging device in accordance with the position of the subject person. Here, it is assumed that the center of the imaging element coincides with the optical axis center of the wide-angle lens system.

  Even when the target person shown in FIG. 8 is standing in the living room, the size of the head imaged by the imaging unit 2 changes when standing near the door and when standing directly under the imaging unit 2. End up.

  As shown in FIG. 10, the size of the image, the distance L1 from the center of the image sensor, and the angle θ1 from the center of the image sensor are known from the image captured at P1 of the image sensor. The distance L1 from the center of the image sensor is a parameter representing the distance between the front focal point of the wide-angle lens system and the head of the subject. In addition, the angle θ1 from the center of the image sensor is a parameter that represents the expected angle of the wide-angle lens system with respect to the subject. As described above, even when the subject is in the same posture, the size of the image captured on P1 of the image sensor differs from the size of the image captured on P2 of the image sensor. For this reason, the CPU 14 corrects the size of the captured image in accordance with the distances L1 and L2 from the center of the image sensor and the angles θ1 and θ2 from the center of the image sensor. In the case of the same posture, correction is performed so that the size of the image picked up by P1 of the image pickup device is substantially equal to the size of the image picked up by P2 of the image pickup device. Parameters relating to this correction are also stored in the flash memory 11. In the above description, the position of the target person is detected based on the position of the image picked up by the image pickup device. Instead, light is emitted toward the target person and the light reflected by the target person is received. Thus, the distance between the imaging unit 2 and the subject may be detected.

  As described above, the image determination apparatus 1 according to the present embodiment can detect the positional relationship between the imaging unit 2 and the target person (the distance to the target person and the prospective angle with the target person). Even so, the posture of the subject can be detected with high accuracy.

  If there are a plurality of subjects, the height and the size of the heads also differ. Therefore, the size of the head corresponding to the position of the head in the Z direction and the position information in the X and Y directions are stored in the flash memory 11 for each subject. Remember me. In this case, images of a plurality of subjects may be taken simultaneously by the imaging unit 2 or may be taken separately.

  Furthermore, the height and head size (for example, diameter) of a plurality of subjects may be input by the setting unit 7 and stored in the flash memory 11. The flash memory 11 stores the heights and head sizes of a plurality of subjects. For example, when the first subject enters the living room from the door, the imaging unit 2 images the head of the first subject. Then, the CPU 14 can recognize from the size of the captured image and the height information stored in the flash memory 11 that the first subject has entered the living room. As described above, by storing the heights of a plurality of subjects in the flash memory 11, even if there is no difference in the size of the head, the plurality of subjects can be identified while maintaining privacy using the height difference. it can.

  However, there is a problem that the subject cannot be identified because the height difference does not substantially occur when the subject is lying in the middle or lying down. Even in such a case, a particular problem arises when one subject is left in the living room.

  The CPU 14 can determine the person who has left the living room by taking an image of the subject who goes out of the living room near the door using the output of the pyroelectric sensor 6, and as a result remains in the living room. A person can discriminate. As described above, the imaging unit 2 according to the present embodiment captures the subject before the subject moves outside the imaging range of the imaging unit 2, so that not only the presence or absence of a person remaining in the living room, You can identify the people who remain.

  In addition, a template image of the subject (for example, an image of the subject's head taken by the imaging unit 2) is stored in the flash memory 11, and template matching is performed to identify the subject who has fallen. Also good.

  Note that when the subject enters the living room, the subject can be accurately identified based on his / her height by taking an image when the subject is near the imaging unit 2.

  Instead of inputting the height of the subject and the size of the head, a living structure (for example, a door) and the subject are imaged, and the size of the structure (for example, the height of the door is 2 m, If the width is 1 m), the height of the subject and the size of the head may be estimated from the structure. In this case, the size of the structure may be recorded in the flash memory 11, and the imaging unit 2 preferably images each subject person in the same posture (standing state).

  Further, when the subject is a child, the height increases and the size of the head increases, so for example, a reference still image may be taken every year. Even when the room layout is changed, the relationship between the head size corresponding to the position of the head in the Z direction of the subject and the position information in the X and Y directions may be updated.

  Further, the CPU 14 causes the flash memory 11 to store the time and time zone that the subject spends in the living room on weekdays and holidays based on the output of the pyroelectric sensor 6.

  In step 4, the captured image is subjected to mask processing. Note that this step may be omitted when the subject does not desire mask processing. Mask processing, for example, lowers the overall resolution of the captured image, puts a mosaic in a part other than the head or lowers the resolution, detects a flesh-colored part from the captured image, and puts a mosaic in the flesh-colored part. You can lower it.

In step 5, settings such as a time interval for capturing an image and a sound volume from the speaker 10 are confirmed. Further, the CPU 14 controls the volume of the TV and audio to be lowered via the interface unit 8 when audio is played from the speaker 10 or when the subject's words are collected from the microphone 9.
(Operation flowchart)
FIG. 11 is a flowchart showing the operation of the image determination apparatus of the present embodiment, and the description will be continued based on this flowchart.

  The CPU 14 determines whether the subject is in the living room based on the output of the pyroelectric sensor 6 (step 1). The CPU 14 proceeds to step 2 when the subject is in the living room, and repeats step 1 when the subject is not in the living room.

The CPU 14 controls the calendar unit 12 to start measuring time (step 2). This step 2 is a step for setting an imaging interval of a still image when the subject is normal in connection with step 8 described later.
The CPU 14 determines whether or not the number of still images is a predetermined number (step 3). This step 3 is for taking the following measures when it is difficult to determine the state of the subject as will be described later and the state of the subject cannot be determined even if the still images of the subject are continuously captured. It is a step. In the present embodiment, for example, 300 to 500 still images are taken a predetermined number of times, and the shooting time is set to about 3 to 5 minutes.

  CPU14 confirms a subject's position from the output of the image pick-up element of the imaging part 2 (step 4). This is because the influence of the aberration of the wide-angle lens system is corrected according to the position of the subject. Hereinafter, the influence of the aberration of the wide-angle lens system will be described.

As described above, the wide-angle lens system of the present embodiment is designed with an angle of view of 80 degrees and a focal length of 6.188 mm. Therefore, the height of the ceiling of the living room is 2.6 m and the height of the subject is 1 Assuming .6 m, the image acquisition range of the imaging unit 2 is within a circle (about 100 m ² ) with a radius of 5.67 m centered directly below the wide-angle lens system. For this reason, if it is a normal room size, the subject's head can be imaged with the wide-angle lens system of this embodiment wherever the subject is in the room.

  When the subject is near the wide-angle lens system (when the angle of view is low), the size of the subject's head image is proportional to f · tanθ (f is the focal length). The relationship between the height and the size (diameter) of the image is as shown in FIG. 5 (b). When the head height changes 300mm from the position of the floor 400mm to the position of the floor 100mm, the change of the image is 68μm. The number of pixels is about 12 pixels. Therefore, the image discrimination device 1 according to the present embodiment can detect that the height of the subject's head has changed by 300 mm when the subject is near the wide-angle lens system.

  Next, a case where the subject is at an intermediate angle of view (about 70 degrees of view) will be considered. FIG. 12 is a diagram showing the relationship between the angle of view and the distortion of the wide-angle lens system. As shown in FIG. 12, the distortion increases as the angle of view increases, and is −50% at an angle of view of 70 degrees. Influenced by the degree of distortion. For this reason, even when the distance from the front focal point of the wide-angle lens system is the same, the size of the image near the angle of view of 70 degrees is larger than the size of the image when the subject is near the wide-angle lens system. Will be almost halved. However, since the change in the size of the image when the height position of the subject's head changes by 300 mm in the vicinity of the angle of view of 70 degrees is about 6 pixels in terms of the number of pixels, the image discrimination device 1 of the present embodiment. Can detect that the height of the subject's head has changed by 300 mm even in the vicinity of an angle of view of 70 degrees. In this case, the image discriminating apparatus 1 detects the subject's head obliquely from above, so that the head size is corrected in consideration of the aspect ratio of the head according to the prospective angle from the wide-angle lens system. Also good.

  Finally, consider the case where the subject is at the most peripheral view angle position (near the view angle of 80 degrees). As shown in FIG. 12 described above, it is affected by distortion of about -80% near an angle of view of 80 degrees. The magnification is about 20% of the center of the angle of view. In addition, since the distance from the front focal point of the wide-angle lens system to the subject's head is longer than when the subject is at the center of the angle of view, the image size changes when the head height position changes. It gets smaller. Specifically, when the subject is near an angle of view of 80 degrees, the change in the size of the image when the head height changes by 300 mm is about one pixel in terms of the number of pixels. For this reason, it becomes difficult for the image discriminating apparatus 1 according to the present embodiment to detect that the height of the subject's head has changed by 300 mm near an angle of view of 80 degrees. However, the most peripheral view angle position of the wide-angle lens system is the corner of the room even in the living room, and there are components such as windows and doors with known sizes. For this reason, in this Embodiment, while imaging the window and door in the corner of a room, the height is measured and matched with the imaging result. That is, by associating the position of the subject's head with the position of a structure such as a window or door, it is possible to detect a change in the position of the subject's head even at the most peripheral angle of view of the wide-angle lens system.

  If a plurality of wide-angle lens systems are provided, the detection accuracy when the subject is in the corner of the room can be increased, and a wider living room can be accommodated.

When the number of shootings determined in Step 3 is within 300 to 500, the CPU 14 captures a still image in Step 5 and calculates an image feature amount in Step 6. Specifically, the size of the head in the Z direction is calculated from the captured still image in association with the X and Y directions. (Whether to describe a specific calculation method)
The CPU 14 determines whether it is possible to determine the state of the subject from the position of the subject in the X and Y directions and the calculated head size (step 7).

  FIG. 13 is a diagram illustrating a state in which a subject is sitting on a chair with a desk in front. As shown in FIG. 13, when the subject is sitting on a chair, the subject is normal, and when something abnormal occurs in the subject and leans against the chair or is lying on the desk. In some cases, it is difficult to determine whether the subject is normal or abnormal because there is little change in the size of the head. As described above, the image discriminating apparatus 1 can discriminate a height difference of about 100 mm. However, when the prospective angle between the wide-angle lens system and the subject is large, or when the subject is sitting on a chair. Step 7 is provided because the distance to the wide-angle lens system becomes large.

  In such a case, the CPU 14 returns to step 3 because it is impossible to determine whether or not the subject is normal, and takes several hundreds of still images in a few minutes as described above, and the subject's as shown by the dotted line. Focus on the head and determine whether the head is moving.

  If the CPU 14 determines that the state of the subject can be determined by a predetermined number of times of imaging, the CPU 14 determines the state of the subject in step 8.

  When the CPU 14 determines that the subject is in a normal state, the CPU 14 waits until a predetermined time (for example, 15 minutes from the start of timing) elapses in Step 9 and then returns to Step 1. Note that the CPU 14 specifies in advance that there is no abnormality every time set by the setting unit 7 (for example, every 7 hours at 7 am, 3 pm, or 11:00 pm) even when the subject is normal. Communicating to a connected device.

  When the CPU 14 determines that the subject is in an abnormal state, the CPU 14 proceeds to step 10.

  FIG. 14 is a still image when the subject is determined to be abnormal. As shown in FIG. 14, the X and Y directions of the living room are on the floor surface of the living room where the height of the subject's head is lower than Z2 regardless of the walking area. In such a case, since the size of the subject's head is significantly smaller than the size of the head in the walking area, the CPU 14 determines that the subject is abnormal.

  The CPU 14 communicates with the device specified in advance in step 10 that the subject is abnormal.

  The CPU 14 determines whether or not there is a request for an image from a cellular phone such as a close relative or a personal computer set with a low privacy level (step 11), and if there is an image request, after transferring the image in step 12 Then, it waits for an instruction from the designated device (step 13). Note that the CPU 14 prohibits the transfer of a still image captured when it is determined to be normal even when the image is transferred in step 12, and transfers the image when it is determined to be abnormal. This ensures the privacy of the subject.

  If there is no image request, the CPU 14 proceeds to step 13 and waits for an instruction from the designated device. Note that when the image determination apparatus according to the present embodiment transfers an image, it can handle either a still image or a moving image.

  On the other hand, if the CPU 14 determines in step 3 that the predetermined number of imaging has been exceeded, the CPU 14 proceeds to step 14 and asks the subject using the speaker 10 "Is it all right" or "How is it?" . At this time, the CPU 14 performs control so as to lower (or mute) the volume of a device such as an audio source via the interface unit 8.

  The CPU 14 collects the voice of the subject via the microphone 9 (step 15), and performs voice analysis using a voice dictionary (not shown) (step 16). In this case, the spoken words of the subject are “ok”, “what?”, “Feel bad”, “help”, etc., so the speech dictionary does not become large (complex) There is no big voice analysis that analyzes conversations.

  In addition, the speaker 10 and the microphone 9 are driven toward a position where the subject is present by a driving device (not shown) (for example, a stepping motor), so that the questioning by the speaker 10 and the voice collection by the microphone 9 can be efficiently performed. Can do.

  When the CPU 14 recognizes a word representing normality from the subject, the CPU 14 returns to Step 1, and when there is no word representing the abnormality or a response from the subject, the subject determines that the subject is abnormal and proceeds to Step 10 ( Step 17).

Prior to the notification of abnormality in step 10, an inquiry may be made by the microphone 9 as described in step 14. In this way, it is possible to communicate a more specific state to a device designated in advance, such as not only that the subject is abnormal, but also that the head hurts and cannot speak.
-Modification-
In the embodiment described above, the imaging unit 2 is provided on the ceiling and the subject's head is imaged from above, but the imaging unit 2 may be provided in the living room or bedroom so that the subject can be photographed from the side. By imaging the subject from the side, it becomes easy to discriminate movements of the eyes, mouth, nose, and the like. Furthermore, if it is determined whether or not the subject is normal using both the still image of the imaging unit 2 provided on the ceiling and the still image obtained by capturing the subject from the side, a more accurate determination can be made. .

  In the above-described embodiment, the pyroelectric sensor 6 determines whether or not the subject is in the living room. However, the imaging interval by the imaging unit 2 is shortened, and it is determined whether or not the subject is in the living room based on the imaging result. In this case, the pyroelectric sensor 6 can be omitted.

  In the above-described embodiment, the image determination device according to the present embodiment is provided in a living room or a bedroom. However, the image determining apparatus can be widely applied to offices, schools, and the like as well as a corridor, a toilet, and a bathroom. be able to.

Claims (11)

An imaging device that captures an image in a predetermined imaging range from the first direction;
The height information of the first subject and the height information of the second subject are obtained, and one of the first subject and the second subject within the predetermined imaging range moves from the predetermined imaging range. A processing device for performing imaging by the imaging device when identifying the image, identifying the one based on the height information, and identifying the other of the first subject and the second subject within the predetermined imaging range And an image determination apparatus. The imaging device images the head of the other subject,
The said processing apparatus identifies the magnitude | size of the other subject's head from the image which the said imaging device imaged, and identifies whether the said other subject is abnormal. Image determination device.   The image determination apparatus according to claim 2, further comprising a communication unit that transmits the processed image to another device when the processing apparatus identifies the abnormality of the first subject.   The image determination apparatus according to claim 1, further comprising a speaker that outputs sound toward the other target person. A microphone for recording the voice of the other subject,
5. The image determination device according to claim 1, wherein the processing device identifies whether the other target person is abnormal based on the sound recorded by the microphone. 6.   6. The image according to claim 1, wherein the processing device obtains respective heights of the first target person and the second target person as the height information. Judgment device.   The said processing apparatus has acquired the said height information according to the imaging result of the said 1st subject and the said 2nd subject by the said imaging device, The any one of Claim 1 to 5 characterized by the above-mentioned. The image determination apparatus according to item. The imaging device images the structure;
The said processing apparatus has acquired the height information of at least one of the said 1st subject person and the said 2nd subject person based on the imaged structure, The any one of Claim 1 to 5 characterized by the above-mentioned. The image determination apparatus according to claim 1.   The image determination apparatus according to any one of claims 1 to 8, wherein the imaging apparatus captures images of the first subject and the second subject separately. The interface unit for cooperating with an electric appliance when the said processing apparatus cannot judge the said 1st subject or the said 2nd subject as normal, The interface part for cooperating with an electrical appliance is provided. The image determination apparatus described in 1. Comprising a pyroelectric sensor capable of detecting the first subject and the second subject;
The image according to any one of claims 1 to 10, wherein the imaging device images the one subject who moves from the predetermined imaging range based on a detection result of the pyroelectric sensor. Judgment device.