EP1354303A2 - Method and apparatus for detecting objects - Google Patents
Method and apparatus for detecting objectsInfo
- Publication number
- EP1354303A2 EP1354303A2 EP02768271A EP02768271A EP1354303A2 EP 1354303 A2 EP1354303 A2 EP 1354303A2 EP 02768271 A EP02768271 A EP 02768271A EP 02768271 A EP02768271 A EP 02768271A EP 1354303 A2 EP1354303 A2 EP 1354303A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- monitored area
- pattern
- image
- reference image
- live image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 57
- 238000005286 illumination Methods 0.000 claims description 21
- 230000008859 change Effects 0.000 claims description 20
- 230000009471 action Effects 0.000 claims description 12
- 230000003068 static effect Effects 0.000 claims description 7
- 229910052704 radon Inorganic materials 0.000 claims description 2
- SYUHGPGVQRZVTB-UHFFFAOYSA-N radon atom Chemical compound [Rn] SYUHGPGVQRZVTB-UHFFFAOYSA-N 0.000 claims description 2
- 230000003595 spectral effect Effects 0.000 claims 3
- 238000001514 detection method Methods 0.000 abstract description 27
- 238000010586 diagram Methods 0.000 description 10
- 238000004458 analytical method Methods 0.000 description 5
- 238000010191 image analysis Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000001228 spectrum Methods 0.000 description 4
- 238000001914 filtration Methods 0.000 description 3
- 230000000977 initiatory effect Effects 0.000 description 3
- 230000000873 masking effect Effects 0.000 description 3
- 230000005855 radiation Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000009499 grossing Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Definitions
- the present invention relates to object detection, and more specifically, to object intrusion and/or presence detection within a monitored area or region.
- Such systems monitor a user-defined area to detect when an object enters or passes through a monitored area.
- Such systems typically include an image capture device ⁇ (typically a video camera or still camera) capable of capturing an image of the monitored . area and, if required, a device for digitizing the captured images. The digitized images are analyzed in an attempt to detect whether an object has entered the monitored area.
- image capture device ⁇ typically a video camera or still camera
- a device for digitizing the captured images The digitized images are analyzed in an attempt to detect whether an object has entered the monitored area.
- There are many different known methods and algorithms for analyzing digitized images for determining when an object has entered a monitored area One of the most common methods is generally referred to as a change detection method.
- Change detection is often accomplished by examining the difference between a current live image and a reference image, where the reference image contains only the static background of the monitored area.
- a reference image can be thought of as a representation of the monitored area as it would appear if no transitory objects were in view.
- Change detection algorithms often take two digitized images as input and return the locations in the field of view where differences between the images are identified.
- Object detection systems are commonly used in environments that have dynamic lighting conditions. For example, in industrial settings, moving shadows can be cast on a monitored area or region, which can cause significant changes in ambient lighting conditions. Many existing object detection systems, including those that use change detection algorithms to detect objects, can be challenged by such shadows and/or other dynamic lighting conditions.
- the present invention overcomes many of the disadvantages of the prior art by providing an object detection system that is less susceptible to dynamic lighting conditions, and/or more sensitive to three-dimensional object motion and/or presence. This is preferably accomplished by projecting one or more static or dynamic patterns onto the monitored area, capturing one or more live images of the monitored area including the one or more patterns, and detecting objects in the monitored area by detecting changes in the one or more patterns in selected captured images.
- a single pattern is projected onto the monitored area.
- One or more live images of the monitored area are then captured at selected times, and analyzed to detect changes in the projected pattern.
- the changes in the pattern may indicate a topographical change in the monitored area, and thus the entry or movement of an object in the monitored area. Because the. pattern is projected onto the monitored area, changes in the ambient lighting conditions may have less effect on the efficacy of the object detection system.
- a moire interference pattern is used to help detect objects in the monitored area.
- Moire interference patterns are particularly sensitive to relative motion between the two or more underlying patterns that are used to create the moire interference pattern. As such, the use of moire interference patterns can be highly effective in detecting objects that intrude into a monitored area.
- a moire interference pattern may be created in any number of ways. For example, two or more similar patterns may be projected onto the monitored area from offset illumination positions. Alternatively, or in addition, one pattern may be projected onto the monitored area, while another may be imposed by a patterned grating positioned in the image plane of the image capture device. Yet another way of creating a moire interference pattern is to capture two images of the same area having a single projected pattern, and digitally or optically rotating or otherwise changing the position of one of the images relative to the other to create a moire interference pattern. Any number of other methods may also be used to create a moire interference pattern, as desired.
- one or more live images of the monitored may be captured at selected times. The images may then be analyzed to detect changes in the moire interference pattern. Changes in the moire interference pattern may indicate a topographical change in the monitored area and thus the entry or movement of an object in the monitored area.
- An advantage of using moire interference patterns is that shadows and/or other changes in ambient lighting conditions may have little or no effect on the position, frequency or other characteristics of the moire interference pattern. To help prevent the projected pattern from being overwhelmed by ambient light, it is contemplated that a portion of the spectrum or lighting frequency that is not typically found in the ambient lighting conditions may be used to project the one or more patterns on the monitored area, such as near infrared.
- the present invention may be used to monitor a user-defined safety zone for the intrusion of people or other objects.
- numerous other applications are also contemplated including security, recording, and other monitoring and/or detection applications.
- Figures 1 A- IB are schematic diagrams showing one illustrative object detection system in accordance with the present invention.
- FIGS. 2A-2B are schematic diagrams showing other illustrative object detection systems in accordance with the present invention.
- Figures 3A-3B depict two example patterns that can be used in accordance with some embodiments of the present invention
- Figures 4A-4B depict two examples of patterns that can be used in accordance with other embodiments of the present invention
- Figures 5A-5C depict an example of moire interference phenomena in accordance with the present invention
- Figures 6A-6C depict an illustrative reference image, live image and comparison image, respectively, in accordance with one embodiment of the present invention
- Figure 7 is a flow diagram showing an illustrative method in accordance with present invention
- Figure 8 is a flow diagram showing another illustrative method in accordance with the present invention.
- Figure 9 is a flow diagram showing yet another illustrative method in accordance ' with the present invention.
- the present invention provides an object detection system that may be lessi susceptible to dynamic lighting conditions, and or may be more sensitive tc c-bjeet motion and/or presence than prior art systems.
- Figures 1 A- IB are schematic diagrams showing a first illustrative object detection system in accordance with the present invention.
- the illustrative object detection system of Figures 1 A includes an illumination source 2, an image capture device 4, an image storage device 6, and a processing device 8.
- the illumination source 2, image capture device 4, image storage device 6, and processing device 8 are integrated into a common device, while in other embodiments, separate devices are provided, as desired.
- the illumination source 2 is located above a monitored area 14, such as near a ceiling.
- the illumination source 2 illuminates the monitored area 14 with a desired pattern.
- the pattern may be generated by, for example, projecting through a patterned grating, projecting interference patterns where the interference fringes are formed by a phasor or wavelength shifting, projecting a pattern using a scanning mechanism, or any - 5 other suitable method.
- the pattern may be static or dynamic.
- a dynamic pattern is ones where the spatial position of the light areas and dark areas is moving, and vgeneral the * ' movement is periodic in nature.
- Thesfreque ⁇ e ofmovement of the mirror may deteimine:tthet.>. frequency of interference fringe movement. . Itsis: contemplated that the mdhit ⁇ red,areBL l ⁇ 4?c ⁇ may be recitang ar roundjOranjy. other sha'pe; -asidesired. As shown in Figure 'lBy-the!'- illustrative monitored area 14 extends around three side of a machine 18.
- the illumination-source 2 maybe any type of illumihation s
- a'.suitablei illumination source 2 may be an infrared source. Using a portion of the spectrum, not '. . ordinarily found in the ambient lighting conditions, such as the near infrared,! may help ' keep the projected pattern from being overwhelmed by the ambient lighting conditions, and may also help enhance the differentiation between the projected pattern and other
- the image capture device may be a sensor (CCD or the like) that is attuned to a desired spectrum, such as the spectrum of the illumination source.
- the illumination source 2 preferably projects at least one pattern on the monitored area 14.
- the pattern used may depend on the particular application at hand.
- the pattern may be any pattern that has transitions between areas that have illumination (e.g. light areas) and areas that lack illumination (e.g. dark areas).
- the average distance between transitions should be approximately the same size as the smallest object for which detection is desired, ⁇ ⁇ • 5 although this is not required.
- suitable patterns included striped or checker board patterns where illuminated and non-illuminated areas alternate. , Some illustrative •patterns are shown in Figures 3A-3B and. Figures:4A-4B, but any suitable pattern -may be ⁇ ised.-,
- the reference' image is preferably st ⁇ ed;-at;least temporarily, in theimageistorageidevice .6. ;
- a new reference image may.be; captured periodically, if desired. Once/a reference, image; is captured, the. image; captureidevice ' 4. may 'Capture successive livesimages ofthe :;.
- images. are. preferably stored; atleasttdrnporarilyi' in the image storagedevioe ⁇ .
- the ⁇ image' storagedevice 6 mayiprovide the 'reference image and the live images to / the.; processing device 8. for; processing.
- the processing device 8 preferably analyzes.the live images to detect changes in
- the monitored area is divided into' a ⁇ number of image segments called mask windows.
- the size of each mask window is ' preferably chosen so that it is no bigger than the approximate size of the smallest object for which detection is desired. While objects smaller than the mask window may be detected, the probability of detecting such objects decreases with object size.
- 25 position of the various mask windows may be chosen so that the entire area to be monitored is covered by overlapping mask windows.
- the image area that corresponds to each mask window may be analyzed separately for object detection, if desired.
- the analysis method that is used to analyze the various mask windows may differ across the image, and the triggered response may vary depending on which mask window detects an object, if desired.
- the comparison between a reference image and a live image can be accomplished in any number of ways.
- One method is to simply do a pixel-by-pixel comparison of the images, such as by subtracting one image from the other. If there is no entry or movement of objects in the monitored area, the projected pattern in the two images will substantially cancel out. However, if there is entry or movement of an object in the monitored area, part of the projected pattern shown in one image may be shifted or otherwisedeformed relative:t ⁇ ; thepattern ⁇ shownin the other image.
- a threshold value ' > may be ' used to help, determineif there' is . sufficient difference between the reference image and.a live image to; indicate.! a detected obj feet, as further described below.. ⁇ • • • • • .
- Another method for comparing ' one image toi another is to calculate a difference ' "gref.' between he value, ofithe brightness levels .corresponding to the light area's of th .. pattern.(such as. in amask window),. and tshe.ival ⁇ e ' .®f the brightness, levels corresponding to the dark areas inthe maskwindow, of the-refef ence image. )
- a similar calculation may be made for the masklwindows of a live image.. Whenever the : second calculation is, ⁇ different from the first calculation:b a specified amount,, a change may be inferred..
- Yet another method for comparing one image to another is to measure a correlation between each pixel and some neighboring pixels and/or a correlation between selected features, and then compare the correlation values. Whenever the correlation values are different by a specified amount, a change may be inferred.
- the image analysis may extract the moire spatial frequency and phase using a Fourier transform.
- Other image analysis techniques may also be used including, for example, unsharp masking, thresholding, contrast segmentation, filtering processing, skeletonization processing, multi-resolution analysis, deformable contour modeling, image clustering, morphology, etc.
- the reference and/or live images may be preprocessed , ' before they are compared.
- the reference image and/or live images may be provided to a filter that helps removes speckle, provides smoothing, changes overall intensity, or otherwise cleans-up the images.
- Changes that are detected in the illuminated pattern may indicate a topographical change within the monitored area 14, and thus entry or movement of an object in the monitored area 14.
- the processing device 8 may sound an .alarm,. shut down the machine 18, and/or provide some other alarm or action. Images of the monitored area with the detected object present may be retained for subsequent analysis, and/or sent to a monitoring station if desired.
- Figures 2A-2B are schematic diagrams showing yet other illustrative object detection systems in accordance with the present invention.
- the illumination source 2 includes a radiation source 20, an obj ective proj ection lens 22, and a patterned grating 24.
- the patterned grating 24 provides the desired pattern on the monitored area 14. It is contemplated that any pattern suitable for creating a moire interference pattern may be used. Some suitable patterns are shown in Figures 4A-4B. Rather than providing a separate patterned grating, the illumination source 2 itself may be configured to provide the desired pattern, if desired.
- the image capture device 4 captures a first image of the monitored area 14 through a second grating 26.
- the second grating 26 may be any type of grating, filter or mask that produces the desired pattern.
- the second grating 26 may be provided by the CCD pixel array of the image capture device 4 itself.
- the first grating 24 and the second grating 26 preferably collectively produce a live image that including a moire interference pattern therein.
- the second pattern may be imposed digitally on the live image after the live image has been captured, if desired.
- the image capture device 4 transmits the live image to an image storage device 28, which in the embodiment shown, may also include a processing device.
- the position of the illumination source 2 and the image capture device 4 are preferably spaced from each other by a distance. This distance can be small to large. This space may help encourage a change in the pattern that reaches the image capture device 4 when a topographical change occurs in the monitored area 14. Typically, the space should be larger as the resolution of the projected pattern is increased.
- a warning device 30 may be attached to the image storage device 28, and may be activated upon detection of an object.
- two illumination sources 36 and 38 are provided for projecting two separate patterns on the monitored area 14.
- Illumination source 36 includes a radiation source 40, an objective projection lens 42, and a patterned grating 44.
- the illumination source 36 preferably projects a first pattern on the monitored area 14.
- illumination source 38 includes a radiation source 46, an objective projection lens 48, and a patterned grating 50. Illumination source 38 preferably proj ects a second pattern on the monitored area 14. The first pattern and the second pattern preferably collectively cause a moire interference pattern to be formed on the monitored area 14.
- Image capture device 4 is used to capture a live image of the monitored area 14. Like above, the image capture device 4 may include an image storage device and a processing device. The live images are preferably analyzed to detect changes in the moire interference pattern over time. Changes in the moire interference pattern may indicate a topographical change in the monitored area 14 and thus the entry or movement of an object in the monitored area 14.
- the illustrative embodiments shown in Figures 2 A-2B both cause a moire interference pattern to be provided in the resulting live image.
- the image analysis may be similar to that discussed above with respect to Figures 1 A-1B.
- the image analysis may extract the moire spatial frequency and phase using a Fourier transform.
- Other image analysis techniques may also be used including, for example, unsharp masking, thresholding, contrast segmentation, filtering processing, skeletonization processing, multi-resolution analysis, deformable contour modeling, image clustering, morphology, etc.
- a radon filter may be oriented perpendicular to the moire interference bands, and any loss of correlation between the filtered results from the reference image and the live image may indicate a change in the moire interference bands.
- Figures 5A-5C depict an example of moire interference phenomena in accordance with the present invention.
- Figure 5 A shows an image of a first pattern projected onto a monitored area.
- the first pattern includes a number of parallel lines extending in the vertical direction.
- Figure 5B shows an image of the monitored area with a second pattern superimposed on the first pattern.
- the second pattern includes a number of parallel lines extending in a direction that is radially offset relative to the vertical direction, hi the illustrative embodiment shown, the surface of the monitored area is spherical in shape, resulting in a number of curved moire interference bands 50.
- Figure 5C shows an image of the monitored area with an object 52 positioned in the monitored area.
- the object 52 causes a change in the moire interference bands relative to Figure 5B.
- the moire interference bands are highly sensitive to topographical changes in the monitored area, which in the embodiment shown, is illustrated by the introduction of the three-dimensional object 52 into the monitored area.
- Figures 6A-6C depict an illustrative reference image, live image and comparison image, respectively, where only a single pattern is projected onto the monitored area and no grating is positioned between the monitored area and the image capture device.
- the image shown in Figure 6A is a reference image of the monitored area.
- the image shown in Figure 6B is an image of the monitored area when a hand is placed in the monitored area.
- the image shown in Figure 6C is an image that results from the comparison (e.g. subtraction) of the image shown in Figure 6A and the image shown in Figure 6B.
- the image shown in Figure 6C highlights the object, including its boundary, within the monitored area.
- virtual interference bands appear in and around the object.
- FIG. 7 is a flow diagram showing an illustrative method in accordance with present invention.
- the illustrative method is entered at step 70, wherein a threshold value is selected.
- Control is then passed to step 72.
- Step 72 illuminates a monitored area with a pattern.
- the pattern may be any suitable pattern.
- Step 74 then captures a reference image of the monitored area.
- the reference image preferably contains only the static background of the monitored area, with no transitory objects present.
- the reference image can be captured/updated upon manual initiation, as shown at 88.
- Step 76 then captures a live image of the monitored area.
- Step 78 compares the reference image and the live image to determine a difference parameter.
- the comparison of the reference image and the live image can be accomplished in any number of ways. One method is to simply do a pixel-by-pixel comparison of the images, such as by subtracting one image from the other. If there is no entry or. movement of objects in the monitored area, the projected pattern in the two images will substantially cancel out. However, if there is entry or movement of an object inthe monitored area, part of the projected pattern shown in one image may be shifted or otherwise deformed relative to the pattern shown in the other image.
- Another method is to calculate a difference "gref ' between the value of the brightness levels corresponding to the light areas of the pattern (such as in a mask, window), and the value of the brightness levels corresponding to the dark areas in the mask window of the reference image. A similar calculation may be made for the mask windows of the live image.
- Yet another method is to measure a correlation between each pixel and some neighboring pixels and/or a correlation between selected features, and then compare the correlation values.
- Other illustrative methods include extracting the moire spatial frequency and phase using a Fourier transform, unsharp masking, thresholding, contrast segmentation, filtering processing, skeletonization processing, multi-resolution analysis, deformable contour modeling, image clustering, morphology, etc. These comparison methods are meant to be only illustrative, and that any suitable method may be used to compare the images or selected characteristics of the images, depending on the application.
- the reference and/or live images may be preprocessed before they are compared.
- the reference image and/or live images may be provided to a filter that helps removes speckle, provides smoothing, changes overall intensity, or otherwise cleans-up the images.
- Step 80 determines if the differences identified in step 78 exceed the threshold value specified in step 70. If the differences exceed the threshold value, control is passed to step 82. Step 82 signals that an object is present in the monitored area. In some embodiments, an action is then taken, such as sounding an alarm, shutting down a machine, and/or providing some other alarm or action. If the differences do not exceed the threshold value, control is passed to step 84. Step 84 signals that an object is not present in the monitored area, and control is passed to step 86. Step 86 determines if an updated reference image is desirable. Under some circumstances, such as when the lighting conditions are dynamic in or around the monitored area, it may be advantageous to periodically update the reference image.
- Step 74 updates the reference image with the previous live image. Alternatively, a new reference image may be captured, if desired, so long as no objects have entered the monitored area. If it is determined that an updated reference image is not needed, control is passed to step 76, wherein a new live image is captured.
- FIG 8 is a flow diagram showing another illustrative method in accordance with the present invention.
- the illustrative method is entered at step 90, wherein a threshold value is selected.
- Control is then passed to step 92.
- Step 92 illuminates a monitored area with a first pattern.
- Control is then passed to step 94.
- Step 94 imposes a second pattern relative to the first pattern.
- Step 94 may, for example, illuminate the monitored area with the second pattern, or a grating may be placed between the monitored area and an image capture device, as desired.
- Step 96 then captures a reference image of the monitored area.
- the reference image preferably contains only the static background of the monitored area, with no transitory objects present.
- the reference image can be captured/updated upon manual initiation, as shown at 110.
- Step 98 captures a live image of the monitored area.
- Step 100 compares the reference image and the live image to determine selected differences.
- Step 102 determines if the differences identified in step 100 exceed the threshold value specified in step 90. If the differences exceed the threshold value, control is passed to step 104.
- Step 104 signals that an object is present in the monitored area, hi some embodiments, an action is then taken, such as. sounding an alarm, shutting down a machine, and/or providing some other alarm or action. If the differences do not exceed the threshold value, control is passed to step 106.
- Step 106 signals that an object is not present in the monitored area, and control is passed to step 108.
- Step 108 determines if an updated reference image is desirable. Under some circumstances, such as when the lighting conditions are dynamic in or around the monitored area, it may be advantageous to periodically update the reference image. If it is determined that an updated reference image is desirable, control is passed to step 96. Step 96 updates the reference image with the previous live image. Alternatively, a new reference image maybe captured, if desired, so long as no objects have entered the monitored area. If it is determined that an updated reference image is not needed, control is passed to step 98, wherein a new live image is captured.
- FIG. 9 is a flow diagram showing yet another illustrative method in accordance with the present invention.
- the illustrative method is entered at step 120, wherein a threshold value is selected. Control is then passed to step 122.
- Step 122 illuminates a monitored area with at least one pattern.
- Step 124 captures a reference image of two or more mask windows of the monitored area. Each mask window preferably corresponds to a sub-area or region within the monitored area.
- the reference , image can be captured/updated upon manual initiation, as shown at 140.
- Step 126 captures a live image of each mask window within the monitored area. Then, for each mask window, step 128 compares the reference image and the live image to determine differences therebetween. In some embodiments, selected mask windows of the reference image and the live image are compared using different compare algorithms. Step 130 determines if any of the differences identified in step 128 exceed the threshold value specified in step 120. In some embodiments, each mask window or group of mask windows has a different threshold value.
- Step 132 signals that an object is present in the monitored area.
- an action is then taken, such as sounding an alarm, shutting down a machine, and/or providing some other alarm or action.
- the action taken niay depend on which mask window detects an object. For example, for one mask window, the action may include sounding an alarm, while for another mask window the action may include shutting down a machine within the monitored area.
- control is passed to step 134.
- Step 134 signals that an object is not present in the monitored area, and control is passed to step 136.
- Step 136 determines if an updated reference image is desirable. If it is determined that an updated reference image is desirable, control is passed to step 124. Step 124 updates the reference image with the previous live image. Alternatively, a new reference image may be captured, if desired, so long as no objects have entered the monitored area. If it is determined that an updated reference image is not needed, control is passed to step 126, wherein a new live image is captured of the mask windows of the monitored area. While the invention is susceptible to various modifications, and alternative forms, specific examples thereof have been shown in the drawings and are herein described in detail. It should be understood, however, that the invention is not to be limited to the particular forms or methods disclosed, but to the contrary, the invention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the appended claims.
Landscapes
- Image Analysis (AREA)
- Burglar Alarm Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US26292501P | 2001-01-19 | 2001-01-19 | |
| US262925P | 2001-01-19 | ||
| PCT/US2002/001120 WO2002103649A2 (en) | 2001-01-19 | 2002-01-18 | Method and apparatus for detecting objects |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1354303A2 true EP1354303A2 (en) | 2003-10-22 |
| EP1354303B1 EP1354303B1 (en) | 2005-05-25 |
Family
ID=28675146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP02768271A Expired - Lifetime EP1354303B1 (en) | 2001-01-19 | 2002-01-18 | Method and apparatus for detecting objects |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP1354303B1 (en) |
| AT (1) | ATE296471T1 (en) |
| DE (1) | DE60204280T2 (en) |
-
2002
- 2002-01-18 DE DE60204280T patent/DE60204280T2/en not_active Expired - Lifetime
- 2002-01-18 EP EP02768271A patent/EP1354303B1/en not_active Expired - Lifetime
- 2002-01-18 AT AT02768271T patent/ATE296471T1/en not_active IP Right Cessation
Non-Patent Citations (1)
| Title |
|---|
| See references of WO02103649A3 * |
Also Published As
| Publication number | Publication date |
|---|---|
| DE60204280D1 (en) | 2005-06-30 |
| EP1354303B1 (en) | 2005-05-25 |
| ATE296471T1 (en) | 2005-06-15 |
| DE60204280T2 (en) | 2006-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6841780B2 (en) | Method and apparatus for detecting objects | |
| US7176440B2 (en) | Method and apparatus for detecting objects using structured light patterns | |
| US6469734B1 (en) | Video safety detector with shadow elimination | |
| KR101808587B1 (en) | Intelligent integration visual surveillance control system by object detection and tracking and detecting abnormal behaviors | |
| US7167575B1 (en) | Video safety detector with projected pattern | |
| US10102427B2 (en) | Methods for performing biometric recognition of a human eye and corroboration of same | |
| JP3827426B2 (en) | Fire detection equipment | |
| US10595014B2 (en) | Object distance determination from image | |
| EP1766581A1 (en) | Method for detecting desired objects in a highly dynamic environment by a monitoring system | |
| CA2275893C (en) | Low false alarm rate video security system using object classification | |
| WO2000034913A1 (en) | Method for rejection of flickering lights in an imaging system | |
| US7593586B2 (en) | Method and system for reducing artifacts in image detection | |
| EP1354303B1 (en) | Method and apparatus for detecting objects | |
| JP2003121556A (en) | Apparatus and method for detection of object | |
| CN110782495B (en) | Apparatus and method for creating and monitoring safe areas in workspaces | |
| JP6093270B2 (en) | Image sensor | |
| JP6133700B2 (en) | Image sensor | |
| JP6155106B2 (en) | Image sensor | |
| JP7262412B2 (en) | Image processing device and image processing program | |
| WO2012065241A1 (en) | System and method for video recording device detection | |
| Hamza et al. | Virtual moire interference approach for an industrial safety monitoring system | |
| HK1245750A1 (en) | System of monitoring handrail for a passenger conveyer device, passenger conveyer device and monitoring method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20030717 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
| AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
| 17Q | First examination report despatched |
Effective date: 20040330 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 Ref country code: LI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED. Effective date: 20050525 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 Ref country code: CH Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REF | Corresponds to: |
Ref document number: 60204280 Country of ref document: DE Date of ref document: 20050630 Kind code of ref document: P |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050825 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050825 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050825 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050905 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20051027 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20060118 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20060131 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20060131 |
|
| ET | Fr: translation filed | ||
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20060228 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050525 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 15 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 16 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 17 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20200131 Year of fee payment: 19 Ref country code: GB Payment date: 20200129 Year of fee payment: 19 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20200128 Year of fee payment: 19 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 60204280 Country of ref document: DE |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20210118 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210803 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210118 |