JP2001243472A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor which eliminates the trouble to manually set an area and is free from misdetection due to the discrepancy between recording area information and the position of a specific object of image processing in an image. SOLUTION: IR reflecting tapes 15 are stuck at specific positions of the four corners of a bed 4 in specific adjacence relations. An area automatic setting process part 14 having recognized the IR reflecting tapes 15 reflecting infrared rays from an image picked up by a camera 11 performs a marker recognizing process for outputting the shapes of the IR reflecting tapes 15 and their center point coordinates, an area discriminating process for outputting detected area information showing which area each pixel in the image belongs to, and an automatic area setting process which is carried out on receiving the output of the area discriminating process.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, such as an image processing apparatus for elderly care, for automatically notifying a care receiver that an abnormal condition has occurred.

[0002]

2. Description of the Related Art An image processing apparatus for elderly care has been devised which detects an abnormal state that has occurred in a care recipient such as the elderly who needs care. This device employs a technique of dividing an image captured by a camera into several areas, and using the attribute information of the areas to determine an abnormality. Until now, as a means for designating this area, manual setting was performed while watching the image on the monitor.

[0003]

However, if a movable object such as a bed is a designated object of an area, and the designated object moves due to a layout change or the like, the area information and the image designated and recorded before the movement are moved. Since the position of the above specified object is inconsistent, which affects the abnormality determination, the system administrator has to manually reset the area for each movement, which is troublesome.

If a person who does not know the necessity of the resetting moves the designated object in the area, he or she does not notice the mismatch between the recorded area information and the position of the designated object on the image. However, there is a problem that the detection result of the abnormal state is continuously affected.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to eliminate the trouble of manually setting an area, and to reduce recording area information and image processing objects on an image. An object of the present invention is to provide an image processing apparatus which does not cause a detection error due to a mismatch with the position of a designated object.

[0006]

In order to achieve the above object, according to the first aspect of the present invention, when an area to be image-processed is separated from another area at a place where an image is taken by a camera, the area to be image-processed is divided into two areas. It is characterized by comprising means for arranging a marker for identification and detecting the marker, and means for identifying the position of the area for image processing based on the detection of the marker.

According to a second aspect of the present invention, in the first aspect of the present invention, a reflective tape for reflecting infrared light from infrared illuminating means is used as the marker, and the position of the marker is determined based on a camera image including the reflected light of the reflective tape. Is specified.

According to a third aspect of the present invention, in the first aspect of the present invention, the marker is constituted by a light source, and an arrangement position of the light source is a boundary between an area to be subjected to image processing and another area. Is detected by a light source sensor.

According to a fourth aspect of the present invention, in the second aspect of the present invention, the reflective tapes having a plurality of shapes are arranged in an area to be subjected to image processing in a predetermined order.

According to a fifth aspect of the present invention, in any one of the first to fourth aspects of the present invention, a plurality of markers are arranged at a boundary position between the image processing target area and another area, and coordinate points of the positions of these markers are determined. The image processing apparatus further comprises a function of performing image processing for drawing the outermost shape by connecting the outermost shape, and regarding the outermost shape obtained by the image processing as the outer shape of the area to be image-processed.

According to a sixth aspect of the present invention, in the third aspect of the present invention, the plurality of light sources arranged in the image processing area are sequentially switched on and off, and only one light source is turned on.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to an embodiment applied to an image processing apparatus for elderly care. (Embodiment 1) As shown in FIG. 1, the configuration of an image processing apparatus for nursing care for the elderly according to the present embodiment is mounted on a ceiling 2 of a room 1 and a camera 11 for imaging the floor side. Illuminating device 12 using an infrared LED that illuminates the image with infrared light, an image processing unit that processes an image captured by camera 11, a determination processing unit that determines the state of the cared person based on the image processing result, and a determination by the determination processing unit An image-related processing unit 13 including a reporting unit that issues a report based on
An area automatic setting processing unit 14 that automatically sets an area to be subjected to image processing and gives the area information to the image-related processing unit 13 as information for performing the determination processing of the determination processing unit.

As the camera 11, for example, a camera using a CCD element having sensitivity to infrared rays is used. The area automatic setting processing unit 14 is provided with a floor-side surface, that is, a floor surface 3.
Means for automatically setting the area of the bed 4 and the area of the bed 4 placed on the floor 3 by using the marker as the area identification means and the lighting device 12 and detecting the marker. The camera 11 is used as the above.

As the marker of the present embodiment, as shown in FIG. 1, an illumination device 12 and a reflection tape (hereinafter referred to as an IR reflection tape) 15 that can reflect infrared rays attached to four corners of the bed 4 are used. This IR reflection tape 15
For example, as shown in FIGS. 2 (a) to 2 (c), four types of shapes such as a square, a circle, a cross, and a triangle are prepared.

As shown in FIG. 3, these are pasted at specific adjoining positions on the four corners of the bed 4 at specific positions. The specific adjacency relationship means that, for example, the IR reflection tapes 15 that are adjacent to each other so as to form a circle, a cross, or a triangle clockwise from a square.
Are related.

The specific position of the bed 4 is affixed so that, for example, a circle and a cross come to the head side.

FIG. 4 is a flowchart showing the flow of the automatic area setting processing of the automatic area setting processing section 14. As shown in this flowchart, the IR reflection tape 15 as a marker is recognized from the image acquired by the camera 11.

The processing in the automatic area setting processing section 14 is roughly divided into a marker recognizing process for outputting the shape of the IR reflection tape 15 and its center point coordinates shown in FIG. 5, and receiving the output, as shown in FIG. The area identification process of outputting detection area information indicating which area each pixel on the image belongs to, and the output of the area identification process is compared with the currently set recording area. , As a result of this comparison, if the areas are the same,
The area automatic setting process ends as it is. If they are different, the process consists of updating the recording area and ending.

Next, the IR reflection tape (marker) recognition processing will be described in detail with reference to FIG.

In this marker recognition processing, first, high-luminance pixels having a luminance equal to or higher than a certain threshold are selected from the image obtained by the camera 11, and labeling processing is performed on these high-luminance pixels thus selected. The degree of similarity with the shape of the IR reflection tape 15 is calculated, and based on this calculation, the area having the highest degree of similarity for each shape is defined as a region of that shape. Then, the coordinates of the center point of these areas are calculated, and the coordinates and the shape of the IR reflection tape 15 are set as paired information, which is transferred to the next area identification processing.

The similarity is determined by a known method such as pattern matching, and the center point coordinate is determined by a known method of determining the position of the center of gravity or the like.

Next, the area identification processing will be described in detail with reference to FIG.

In this area identification processing, first, the equation of the side of the quadrangle is calculated from the shape of the IR reflective tape 15 obtained from the above marker recognition processing, the coordinates of the center point thereof, and the condition of the adjacency relation of the IR reflective tape 15 shape. . The coordinates constituting the side are calculated using the equation obtained by this calculation. Then, based on this calculation result, for each pixel on the image, it is inside the coordinates of the side of the rectangle, or
Determine if it is outside and identify the area. This information is transferred to the comparison process with the next recording area.

The square obtained here is an area in which the cared person M exists in the first place, so that it can be easily determined.
Since the distortion of the camera lens cannot be completely removed, the shape need not be a clean rectangle, and may be a slightly crushed rectangle.

As described above, the illuminating device 12 and the IR reflecting tape 15 as a marker are used as means for identifying the area.
By using these four types of IR reflective tapes 15 and sticking these IR reflective tapes 15 to specific positions of the bed 4 in a specific adjacency, the area for image processing can be automatically processed. Setting is possible.

In the image-related processing section 13, the judgment processing section determines whether or not the cared person M exists in the area from the image of the area based on the setting contents of the area to be processed. Alternatively, a process is performed in which an abnormal movement of the care receiver in the area is determined, and the determination result is reported to the nursing room or the like by the reporting unit. (Embodiment 2) In the above-described embodiment, if the adjacency is mistaken when attaching the IR reflecting tape 15 having four shapes to the specific fixed position of the bed 4, the correct area automatic setting processing as shown in FIG. There is a possibility that the area cannot be identified in the unit 15.

Therefore, the image processing apparatus for aged care of the present embodiment has the same configuration as that of the first embodiment, except that the area identification processing in the automatic area setting processing section 15 is different from that of the first embodiment. There are features. The drawings of the configuration, the entire flowchart of the area automatic setting processing section 15, and the flowchart of the marker identification processing are referred to FIGS. 1, 4, and 5 of the first embodiment.

Next, the area identification processing of the automatic area setting processing section 15 in this embodiment will be described in detail with reference to FIG.

First, in the area identification processing of this embodiment,
The coordinates of the center points of the four IR reflection tapes 15 obtained in the IR reflection tape recognition process in the previous stage are used as information. The equations of the straight lines of all combinations connecting the center point coordinates are calculated, and are set as candidates for the sides of the rectangle.

From these candidates, a straight line having no intersection other than the center point coordinates between the straight lines is obtained.
Since a straight line having an intersection other than the center point coordinates is a diagonal line,
A straight line other than the straight line is defined as a side of the rectangle.

Next, the coordinates of the pixels constituting the sides of the rectangle are calculated, and the area is identified based on whether the pixel is inside or outside the pixel.

As described above, in the area identification processing,
By using a calculation method in which all points are image-processed and connected by image processing software processing to draw an outermost shape (a group of lines having no intersection) and regard this as the outer shape of the bed 4, the first embodiment is used. As described above, four types of IR reflective tapes 15 are provided, and the area can be set in a specific adjacent relationship without using the condition of sticking to the specific position of the bed 4. Can be eliminated.

Although the operation of the image-related processing section 13 is not described in the present embodiment, it is the same as in the first embodiment. (Embodiment 3) The image processing apparatus for nursing care for the elderly according to the present embodiment captures a camera 21 attached to the ceiling 2 of a room 1 and an image of the floor side taken by the camera 21 as shown in FIG. , 2 and an image-related processing unit 22 that performs the same image processing, judgment processing, and notification processing, and an area automatic setting processing unit 23 that automatically sets the area of the bed 4 and the area of the floor 3. Be composed.

The area identifying means used in this embodiment is shown in FIG.
The light sources 24 such as LEDs mounted on the four corners of the bed 4 are used as markers and used as light source sensors for detecting the light sources 24 as shown in FIG.

The entire processing flow of the automatic area setting processing section 23 is as shown in FIG.
From the image acquired by the camera 21, the marker (light source 2)
Recognize 4).

The marker recognition process of the present embodiment is shown in FIG.
And the output of the light source recognition process is the light source 24
Are the coordinates of the center point.

In response to this output, similar to the second embodiment, FIG.
The area identification processing shown in FIG.

However, in the present embodiment, the center point of the IR reflection tape 15 in FIG. The output of this area identification processing is detection area information indicating which area each pixel on the image belongs to. This output is compared with the currently set recording area. As a result of the comparison, if the areas are the same, the area automatic setting process is terminated. If they are different, the recording area is updated and the processing ends.

Next, the light source (marker) recognition processing of FIG. 10 which is a feature of this embodiment will be described in detail. First, a high-luminance pixel having a luminance equal to or higher than a certain threshold is selected from an obtained image obtained by imaging with the camera 21. Labeling processing is performed on these pixels. The four regions obtained by the labeling process are defined as regions of the light source 24. Then, the center point coordinates of each area are calculated by a known method, and the center point coordinates are used as information, and are passed to the next area identification process. The details of the area identification processing in FIG.
This is the same as the second embodiment by replacing the center point of the R reflection tape 15 with the center point of the light source 24.

As described above, the light source 24 is used as a marker.
By using the camera 21 as a light source sensor for detecting the light source 24, it is possible to automatically identify and set an area to be subjected to image processing.

The operation of the image-related processing section 22 of the present embodiment is the same as that of the first embodiment, and will not be described.

Note that an infrared LED may be used as the light source 24 so that the care receiver does not notice it, and of course, a light source such as LEDE that emits visible light may be used. If an illumination device 25 composed of an infrared LED is provided on the ceiling 2 for nighttime photographing or the like, the bed 4 can be controlled by a camera 21 using a CCD element.
The movement of the cared person above can be imaged, and monitoring for care can be performed around the clock without being noticed by the cared person. (Embodiment 4) The image processing apparatus for elderly care according to the present embodiment includes a camera 31 mounted on a ceiling 2 of a room 1, an image-related processing unit 32, an area of a bed 4 and a floor 3 as shown in FIG. An area automatic setting processing unit 33 for automatically setting the area of interest, an area (marker) identifying means including light sources 34 attached to the four corners of the bed 4, and a two-dimensional distance measurement for detecting the light sources 34 Possible PSD sensor 35
It is composed of

The processing flow of the area automatic setting processing section 33 of this embodiment is as shown in FIG.

First, in this embodiment, the lighting control of each light source 34 is performed under the control of the automatic area setting processing unit 33, and the light sources 34 to be turned on are sequentially switched one by one.

The light from the light source 34 is received, the position of the light source 34 is detected by the PSD sensor 35, and the x and y coordinates are calculated.

Here, the x-coordinate and y-coordinate calculated by the PSD sensor 35 are associated with the x-coordinate and y-coordinate of the floor-side image picked up by the camera 31, and the calculated coordinate points are picked up by the camera 31. The images are associated with each other, and the x-coordinate and the y-coordinate obtained by the calculation are named and stored.

As described above, the x coordinate and the y coordinate are calculated for all the light sources 34 while changing the light sources 34 to be turned on one by one.

When the coordinates of the four light sources 34 are obtained, area identification processing is performed using the coordinates as information. The area identification processing of this embodiment is as shown in FIG. However, in the present embodiment, the center point of the IR reflection tape 15 in FIG.
The output of the area identification processing in this embodiment is
Is detection area information indicating to which area each pixel on the image obtained by the imaging in (1) belongs.

In response to this output, a comparison is made with the currently set recording area. As a result of the comparison, if the areas are the same, the area automatic setting process is terminated. If not, update the recording area and exit. FIG.
The details of the area identification processing are the same as those of the second embodiment by replacing the center point of the IR reflection tape 15 with the center point of the light source.

As in the present embodiment, as a sensor for detecting the light source 34 as a marker, when a PSD element whose light source position specifying accuracy is lower than that of a CCD element is used, the light source 34
Is controlled so that only one light source is turned on at a time, and the range of the region can be accurately determined without being affected by the mutual light of the plurality of light sources 34.

The operation of the image-related processing section 32 of this embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

It is to be noted that an infrared LED may be used as the light source 34 so that the care-receiver does not notice it. Of course, a light source such as LEDE that emits visible light may be used. If the ceiling 2 is provided with an illuminating device 36 composed of an infrared LED for nighttime photographing or the like, the bed 4 can be controlled by the camera 31 using a CCD element.
The movement of the cared person above can be imaged, and monitoring for care can be performed around the clock without being noticed by the cared person.

[0053]

According to the first aspect of the present invention, when an area to be image-processed is separated from another area at a place where a camera takes an image, an identification marker is arranged in the area to be image-processed and the marker is detected. And means for identifying the position of the area for image processing based on the detection of the means, so that the area to be identified can be automatically recognized,
Therefore, if there is a change in the area, it is possible to perform automatic resetting, so that there is no need to manually reset the area to be processed as a result, and the recorded area information and the image on the image are eliminated. There is an effect that it is possible to realize an image processing apparatus free from a detection error or the like due to a mismatch with the position of the processing target area.

According to a second aspect of the present invention, in the first aspect of the present invention, a reflective tape for reflecting infrared light from infrared illuminating means is used as the marker, and the position of the marker is determined based on a camera image including the reflected light of the reflective tape. Since the mark can be clearly identified even in the dark, the area can be automatically recognized and automatically reset at night. In addition, since the reflected light of the reflective tape having a high luminance is detected, the boundary of the area is clearly displayed, and by accurately detecting the identification mark, the area to be image-processed can be accurately recognized.

According to a third aspect of the present invention, in the first aspect of the present invention, the marker is constituted by a light source, and an arrangement position of the light source is a boundary between an area to be image-processed and another area. Is detected by the light source sensor, so that the marker can be clearly recognized even in the dark, the area can be automatically recognized and automatically reset at night, and the area boundary is detected because the light of the light source with high brightness is detected. By being clearly projected and accurately detecting the identification marker, the area can be accurately recognized.

According to a fourth aspect of the present invention, in the second aspect of the present invention, the plurality of reflective tapes are arranged in an area to be subjected to image processing in a predetermined order. It can be distinguished and provide information useful for abnormality judgment.

The invention according to claim 5 is the invention according to claims 1 to 4.
In any one of the inventions described above, a plurality of markers are arranged at a boundary position between the area to be image-processed and another area, and image processing for drawing the outermost shape by connecting coordinate points of the positions of these markers is performed. A function is provided that regards the obtained outermost shape as the outer shape of the area to be processed.Therefore, there is no need to assign specific adjacency conditions or mounting position conditions to the points where markers are placed, providing simple construction. In addition, it is possible to provide an image processing apparatus that does not have an area setting error due to an incorrect mounting condition as described above.

According to a sixth aspect of the present invention, in the third aspect of the present invention, the plurality of light sources disposed in the image processing area are sequentially switched on and off, and only one light source is turned on. This makes it easier for the software to locate the light source.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a first embodiment of the present invention.

FIG. 2 is an explanatory diagram of a shape of a reflective tape used in the above.

FIG. 3 is an explanatory diagram of a reflective tape according to the first embodiment.

FIG. 4 is a flowchart for explaining the operation of the area automatic setting processing unit according to the first embodiment;

FIG. 5 is a flowchart of a marker recognition process in the area automatic setting processing unit according to the first embodiment.

FIG. 6 is a flowchart of an area identification process in the area automatic setting processing unit according to the first embodiment;

FIG. 7 is an explanatory diagram of the above problem.

FIG. 8 is a flowchart of an area identification process of an automatic area setting processing unit according to the second embodiment of the present invention.

FIG. 9 is a configuration diagram of a third embodiment of the present invention.

FIG. 10 is a flowchart of an area identification process of the area automatic setting processing unit in the above.

FIG. 11 is a configuration diagram of a fourth embodiment of the present invention.

FIG. 12 is a flowchart of an area identification process in the area automatic setting processing unit according to the third embodiment.

[Explanation of symbols]

 1 room 2 ceiling 3 floor 4 bed 11 camera 12 lighting device 13 image-related processing unit 14 area automatic setting processing unit 15 IR reflection tape

 ──────────────────────────────────────────────────の Continued on the front page (72) Inventor Kenichi Hagio 1048 Kazumasa Kadoma, Osaka Prefecture Matsushita Electric Works, Ltd. F term (reference) 5C054 AA01 CA04 CA05 FC03 FF03 FF06 HA19 5C087 DD03 DD30 EE18 FF01 FF04 GG02 GG06 GG19 GG51 GG54 GG61 5L096 AA11 BA02 BA18 CA03 CA17 CA18 DA03 FA14 FA18 FA46 FA69 GA34 GA51 HA02 JA03

Claims (6)

[Claims] And a means for locating an identification marker in the area to be image-processed and detecting the marker when the area to be image-processed is separated from other areas at a place where the camera captures an image. Means for identifying a position of an area for image processing based on the detection. 2. The method according to claim 1, wherein the marker is a reflective tape that reflects infrared light from infrared illuminating means, and the position of the marker is specified from an image of a camera including the reflected light of the reflective tape. Image processing device. 3. The marker according to claim 1, wherein the marker is constituted by a light source, the position of the light source is defined as a boundary between an area to be image-processed and another area, and light from the light source is detected by a light source sensor. Item 2. The image processing apparatus according to Item 1. 4. The image processing apparatus according to claim 2, wherein the reflection tapes having a plurality of shapes are arranged in an image processing target area in a predetermined order. 5. An image processing for arranging a plurality of markers at a boundary position between an area to be subjected to image processing and another area, connecting coordinate points of the positions of these markers to draw the outermost shape, and obtaining the image processing. 2. A function for assuming the outermost contour as a contour of an area to be image-processed.
The image processing apparatus according to any one of claims 1 to 4. 6. The image processing apparatus according to claim 3, wherein the lighting of a plurality of light sources arranged in the image processing target area is sequentially switched, and only one light source is turned on.