EP1037181A2 - Method and system for monitoring an interior - Google Patents
Method and system for monitoring an interior Download PDFInfo
- Publication number
- EP1037181A2 EP1037181A2 EP00105069A EP00105069A EP1037181A2 EP 1037181 A2 EP1037181 A2 EP 1037181A2 EP 00105069 A EP00105069 A EP 00105069A EP 00105069 A EP00105069 A EP 00105069A EP 1037181 A2 EP1037181 A2 EP 1037181A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- interior
- picture
- trespassing
- area
- shadow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19641—Multiple cameras having overlapping views on a single scene
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19647—Systems specially adapted for intrusion detection in or around a vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19652—Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
Definitions
- the invention relates to a method for monitoring an interior, in particular the interior of a vehicle, and for locating an object trespassing into said interior.
- the method comprises the steps of: detecting an object trespassing into said interior in the case that there is a shadow caused by the trespassing object in a picture of the interior taken when monitoring it, determining the location of that section of the interior which has in the picture been covered by said shadow, and estimating the location of the trespassed object in the interior from said determined location of said section in the interior.
- the invention further relates to a system for carrying out said method.
- Fig. 5 for example shows a three dimensional illustration of the principles known in the art on which the present invention is based. More specifically, Fig. 5 shows a monitored interior, for example of a vehicle, into which an object 3 has penetrated. The object sticks out through a monitored plain 2 of said interior.
- a shadow 4' caused by said object 3 is recognised in an infrared or radar picture taken by an optical image sensor 1' for monitoring the interior.
- the presence of the object 3 in the interior can be detected by the presence of a shadow 4' in said picture.
- the location where said object 3 has penetrated into said interior can roughly be estimated when comparing said picture with a background image of said interior which has previously been taken by said optical image sensor 1' but not being disturbed by any penetrating object. More specifically, the location/position of the shadow 4' in said picture roughly indicates the location of the penetrating object in the interior.
- Fig. 6 shows a system known in the art for carrying out the above described method.
- the system comprises said fix-positioned optical image sensor 1' for monitoring said interior.
- it comprises a storage means 20 for storing the pictures taken by said optical image sensor and in particular for storing the background image also taken by said optical image sensor.
- the system further comprises detecting means 30 for comparing the picture with the background image and for detecting an object trespassing into said interior in the case that there is a shadow in the picture covering at least one part of the picture which in the case of no disturbance would show the corresponding part of said background image.
- a quite similar method and system is for example known from DE 41 17 774 A1.
- Said document discloses a method for monitoring an area in order to detect and determine target objects in a sequence of images taken by a fixed positioned camera and evaluated by an evaluation circuit.
- a first image taken by said camera is filtered and stored as a start background image in a background window storage means.
- the stored start background image is subsequently divided into a plurality of sectors having equal sizes.
- Each image subsequently taken by said camera is stored in an additional window storage means and like said start background image divided into the same number of sectors having the same size.
- Each sector of a subsequent image is correlated with the co-ordinated sector of said start background image. The results of said correlation process are used to roughly calculate the position of said target objects within said area.
- said object is solved by providing the criteria that a decision for the detection of the object is only taken, if the determined section is located in at least a part of a predetermined relevant area of the interior through which trespassing of an object into the interior is most likely expected.
- a whole interior is monitored in order to recognize undesired objects including subjects trespassing into said interior.
- the monitored interior is subdivided into several predetermined areas being differently classified regarding the probability that trespassing of an object into the interior is expected.
- the areas of the interior considered to have a high probability that the trespassing of an object is expected through them are hereinafter referred to as relevant areas.
- the decision is - according to the invention - only taken if the section of the interior covered by the shadow in the picture is located in at least a part of these predetermined relevant areas of the interior through which trespassing of an object into the interior is most likely expected. In that way the certainty of the decision is increased.
- the relevant area is a window area or at least an area comprising an edge of a window since trespassing of an object through a window into the interior, in particular of a vehicle is most likely expected. To the contrary, trespassing of an object through less relevant areas like the ceiling or the floor of a vehicle, is less likely.
- the determined section allows the conclusion that a part of the trespassing object has already entered the interior through the window area whereas simultaneously another cohesive part of the object still remains outside the vehicle.
- parts of the body of a person for example the head or an arm has trespassed into the interior of the vehicle for example through the window, whereas the remaining part of the body of the person is still outside of the vehicle.
- Such a shadow is quite different from a shadow of an object which has trespassed into the interior as a whole, for example a ball which has been thrown into the interior of the vehicle; such a shadow would only cover inward areas of the vehicle.
- the trespassing object is not a person since there is no part of the shadow covering external areas of the vehicle. In that way the form and location of the shadow in the picture allow conclusions about the trespassing object, in particular, as to whether a person or a thing has entered the interior.
- the determination of the location of the section in the interior comprises the step of comparing said picture with a background image showing the interior from the same angle as the picture but not being disturbed by any object which has trespassed into said interior.
- the background image can be adapted to changes in the relevant area of the interior.
- the background image of the relevant section within the interior may be taken when a system for carrying out the method is primarily installed.
- the look of said window area may change, for example due to a seat belt which has not been coiled up correctly.
- said change in the look of the window area is not interpreted as a shadow caused by an object which has trespassed into the interior.
- Such a misinterpretation is advantageously avoided by providing and using an updated background image which has been adapted to changes in the relevant section of the interior.
- the update is done during each restart of the alarm system according to the invention.
- an alarm signal is generated and forwarded to an alarm station upon the decision for the detection of an object within the interior has been taken.
- the method is not only able to detect an object which has trespassed into the interior but also to determine its penetration into the interior.
- Fig. 1 illustrates the principle of the present invention.
- optical image sensor 1' mounted to the body of the vehicle, for example to the ceiling of the vehicle from inside.
- the optical image sensor 1' takes radar or infrared pictures of an area 2 of the interior, preferably upon infrared flashing. Since trespassing of an undesired object 3 into the interior of the vehicle is a most likely expected through relevant areas of the interior like a window area 2 of the vehicle the optical image sensor 1' is preferably focused to said window area 2.
- one optical image sensor 1' is sufficient.
- an undesired object 3 actually trespasses into the interior of the vehicle through said window area 2 it causes a shadow 4' in a picture taken by said optical image sensor 1'. Consequently, the existence of a shadow in a picture taken by said optical image sensor generally allows the conclusion that an object has entered the interior of the vehicle. Said shadow may in particular be recognised when comparing the picture with a background image of the same area of the interior which has previously also been taken by said optical image sensor 1' from the same angle and which is not disturbed by any trespassing object.
- a further optical image sensor 1'' is provided for additionally monitoring said window area 2 from a different angle.
- the penetrating object 3 causes a further shadow 4'' in a picture taken by said further optical image sensor 1'' as shown in Fig. 1, irrespective as to whether the object 3 just sticks out through a plain spanned by the window area 2 or as to whether the object has already completely entered the interior (not shown).
- the more precise location of the penetrating object 3 can now be determined by calculating and evaluating the intersection of two fictitious lightening cones 5', 5''.
- these cones are fictitious truncated cones wherein the tip of each of said truncated cones is located in the centre of one of said optical image sensors 1', 1'' and wherein these cones are restricted by the shadow 4', 4'' being co-ordinated to said optical image sensor and acting as conic section, respectively.
- the location of the object 3 in the monitored area 2 of the interior is determined by the intersection 10 of said shadows 4' and 4''.
- penetration of the object into the interior is determined by the maximum distance of the intersection 10 of said truncated cones to the plain spanned by said window area 2.
- auxillary Fig. 2 shows a side-view of the arrangement shown in Fig. 1.
- Said projecting area 6 is preferably perpendicular to the monitored window area / plain 2 of the vehicle and preferably comprises the centres of said optical image sensors 1' and 1''.
- Fig. 3 represents a view onto said fictitious projecting area from the indicated line of sight. Consequently, the 3-dimensional illustration of Fig. 1 is reduced to a 2-dimensional illustration which facilitates explanation of the determination of the location and the penetration of the object.
- Fig. 3 shows a cross-sectional view through a car body 8 of the vehicle wherein the external area 9' of the vehicle and its interior 9'' consequently lie on opposite sides of said car body.
- the car body 8 comprises the window area 2 through which penetration of an object is most likely expected.
- one optical image sensor is sufficient for estimating the location of a penetrated object, because its location can be estimated by evaluating the location of its shadow 4', 4'' in a picture.
- the location of the shadow is in particular defined by its edge 4'a, 4''a, favourably indicated in Fig. 3 by a fictitious line 5'a, 5''a corresponding to the longest section of a line reaching from the centre of an optical image sensor 1', 1'' to the furthermost point of the edge 4'a, 4''a of the respective shadow.
- Said fictitious line 5'a, 5''a may be considered as being part of the surface area of the truncated cones 5', 5'' described in Fig. 1.
- the different possible locations 3, 3', 3'' represent different penetrations P, P', P'' of the object 3 into the interior of the vehicle, respectively.
- the present invention provides a further optical image sensor 1'' for monitoring the window area 2 additionally from a different angle than sensor 1'.
- the trespassing object 3 will then additionally cause a further shadow 4'' on a further picture taken by said further optical image sensor 1''.
- the locations of said optical image sensors 1' and 1'' differ from each other and preferably monitor the window area 2 from opposite directions. Consequently, the fictitious lines 5'a and 5''a have an intersection 10, in particular when they are projected into the projecting plain.
- intersection 10 allows a more precise determination of the location of the trespassing object 3 (see object 3 drafted in solid lines) with regard to the width of said window area. More specifically, in the projecting plain there is only one location of the object 3 (drafted in solid lines) which is co-ordinated to said intersection; that specific location can be considered as the precise location where the object has actually entered the window area 2. Moreover, that specific location allows a more precise determination of the penetration P of the object.
- Fig. 4 shows the system for carrying out the method according to the invention. It comprises at least the two fix-positioned optical image sensors 1, 1'' for monitoring the interior from different angles, respectively. It further comprises a storage means 20 being adapted to store at least the two background images and / or the pictures taken by said two optical image sensors 1', 1'', respectively. The pictures as well as their respective background images are provided to a detecting means 20 which is able to compare and evaluate at least these two pictures and their respective background images. Said detecting means 30 takes a decision that an object 3 has trespassed into the interior (of the vehicle) only if the section of the interior covered in the picture by the shadow is at least part of a predetermined relevant area of the interior. Said detecting means may further comprise locating means (not shown) for estimating the location of the object.
- the pictures and their respective background images may be further analysed in a calculating means 40 in order to more precisely determine the location and the penetration of said object 3 in the interior. More specifically, said calculating means 40 is adapted to calculate the penetration of the trespassing object 3 into the interior or the distance between the trespassing object and at least of said optical image sensors by evaluating the intersection 10 of the fictitious truncated cones 5', 5'' or of the fictitious lines 5'a, 5''a mentioned above.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Emergency Alarm Devices (AREA)
- Image Processing (AREA)
Abstract
Description
- The invention relates to a method for monitoring an interior, in particular the interior of a vehicle, and for locating an object trespassing into said interior. The method comprises the steps of: detecting an object trespassing into said interior in the case that there is a shadow caused by the trespassing object in a picture of the interior taken when monitoring it, determining the location of that section of the interior which has in the picture been covered by said shadow, and estimating the location of the trespassed object in the interior from said determined location of said section in the interior. The invention further relates to a system for carrying out said method.
- Such methods and systems are known in the art.
- Fig. 5 for example shows a three dimensional illustration of the principles known in the art on which the present invention is based. More specifically, Fig. 5 shows a monitored interior, for example of a vehicle, into which an
object 3 has penetrated. The object sticks out through a monitoredplain 2 of said interior. - In the case that the
object 3 has entered the interior a shadow 4' caused bysaid object 3 is recognised in an infrared or radar picture taken by an optical image sensor 1' for monitoring the interior. Expressed in other words, the presence of theobject 3 in the interior can be detected by the presence of a shadow 4' in said picture. - The location where said
object 3 has penetrated into said interior can roughly be estimated when comparing said picture with a background image of said interior which has previously been taken by said optical image sensor 1' but not being disturbed by any penetrating object. More specifically, the location/position of the shadow 4' in said picture roughly indicates the location of the penetrating object in the interior. - Fig. 6 shows a system known in the art for carrying out the above described method. For detecting the
object 3 penetrating into the interior the system comprises said fix-positioned optical image sensor 1' for monitoring said interior. Moreover, it comprises a storage means 20 for storing the pictures taken by said optical image sensor and in particular for storing the background image also taken by said optical image sensor. - The system further comprises detecting means 30 for comparing the picture with the background image and for detecting an object trespassing into said interior in the case that there is a shadow in the picture covering at least one part of the picture which in the case of no disturbance would show the corresponding part of said background image.
- A quite similar method and system is for example known from DE 41 17 774 A1. Said document discloses a method for monitoring an area in order to detect and determine target objects in a sequence of images taken by a fixed positioned camera and evaluated by an evaluation circuit.
- A first image taken by said camera is filtered and stored as a start background image in a background window storage means. The stored start background image is subsequently divided into a plurality of sectors having equal sizes. Each image subsequently taken by said camera is stored in an additional window storage means and like said start background image divided into the same number of sectors having the same size. Each sector of a subsequent image is correlated with the co-ordinated sector of said start background image. The results of said correlation process are used to roughly calculate the position of said target objects within said area.
- Starting from that disclosure it is the object of the present invention to improve the method and the system for monitoring an interior and for locating an object trespassing into said interior in the way that a decision that an object has in fact trespassed into the interior is ensured.
- Said object is solved by the subject matters of
claims - Starting from the method known in the art said object is solved by providing the criteria that a decision for the detection of the object is only taken, if the determined section is located in at least a part of a predetermined relevant area of the interior through which trespassing of an object into the interior is most likely expected.
- According to the present invention a whole interior is monitored in order to recognize undesired objects including subjects trespassing into said interior. The monitored interior is subdivided into several predetermined areas being differently classified regarding the probability that trespassing of an object into the interior is expected. The areas of the interior considered to have a high probability that the trespassing of an object is expected through them are hereinafter referred to as relevant areas.
- The quality of the infrared or radar pictures taken for monitoring the interior is often very bad with the result that not each shadow shown in the picture does in fact represent an undesired object which has trespassed into the interior. Consequently, a decision about the presence of an undesired object in the interior taken due to the existence of a shadow in the picture is uncertain.
- In order to overcome that deficiency the decision is - according to the invention - only taken if the section of the interior covered by the shadow in the picture is located in at least a part of these predetermined relevant areas of the interior through which trespassing of an object into the interior is most likely expected. In that way the certainty of the decision is increased.
- By defining that criteria the decision that an object has in fact trespassed into the interior is ensured because, to the contrary, trespassing of an object through other less relevant areas of the interior is more unlikely or impossible.
- According to a first embodiment of the invention it is advantageous that the relevant area is a window area or at least an area comprising an edge of a window since trespassing of an object through a window into the interior, in particular of a vehicle is most likely expected. To the contrary, trespassing of an object through less relevant areas like the ceiling or the floor of a vehicle, is less likely.
- It is of particular interest that the determined section allows the conclusion that a part of the trespassing object has already entered the interior through the window area whereas simultaneously another cohesive part of the object still remains outside the vehicle. In that case it is assumed that parts of the body of a person (object), for example the head or an arm has trespassed into the interior of the vehicle for example through the window, whereas the remaining part of the body of the person is still outside of the vehicle. Such a shadow is quite different from a shadow of an object which has trespassed into the interior as a whole, for example a ball which has been thrown into the interior of the vehicle; such a shadow would only cover inward areas of the vehicle. In latter case it is assumed that the trespassing object is not a person since there is no part of the shadow covering external areas of the vehicle. In that way the form and location of the shadow in the picture allow conclusions about the trespassing object, in particular, as to whether a person or a thing has entered the interior.
- It is advantageous that the determination of the location of the section in the interior comprises the step of comparing said picture with a background image showing the interior from the same angle as the picture but not being disturbed by any object which has trespassed into said interior.
- It is further advantageous that the background image can be adapted to changes in the relevant area of the interior. The background image of the relevant section within the interior may be taken when a system for carrying out the method is primarily installed. However, in the case, that for example the interior of a vehicle is monitored the look of said window area may change, for example due to a seat belt which has not been coiled up correctly. In that situation it is important that said change in the look of the window area is not interpreted as a shadow caused by an object which has trespassed into the interior. Such a misinterpretation is advantageously avoided by providing and using an updated background image which has been adapted to changes in the relevant section of the interior. Advantageously the update is done during each restart of the alarm system according to the invention.
- Advantageously an alarm signal is generated and forwarded to an alarm station upon the decision for the detection of an object within the interior has been taken.
- Favourably the method is not only able to detect an object which has trespassed into the interior but also to determine its penetration into the interior.
- The above defined object of the invention is further solved by a system for carrying out the method described above. The advantages of said system correspond to the advantages of said method.
- The following figures accompany the description, wherein
- Fig. 1
- shows a 3-dimensional illustration of the method for detecting and locating an object trespassing into an interior according to the present invention;
- Fig. 2
- shows side-view of Fig. 1;
- Fig. 3
- shows a projection of Fig. 1 into a projecting plain shown in Fig. 2;
- Fig. 4
- shows a system according to the present invention.
- Fig. 5
- shows a 3-dimensional illustration of the principles known in the art on which the present invention is based.
- Fig. 6
- shows a system for carrying out the principles known in the art.
- In the following a preferred embodiment of the invention is described in more detail by referring to figures 1 to 4.
- Fig. 1 illustrates the principle of the present invention.
- In order to monitor an interior, in particular the interior of a vehicle there is at least one optical image sensor 1' mounted to the body of the vehicle, for example to the ceiling of the vehicle from inside. The optical image sensor 1' takes radar or infrared pictures of an
area 2 of the interior, preferably upon infrared flashing. Since trespassing of anundesired object 3 into the interior of the vehicle is a most likely expected through relevant areas of the interior like awindow area 2 of the vehicle the optical image sensor 1' is preferably focused to saidwindow area 2. - For only generally locating the trespassing object one optical image sensor 1' is sufficient. In the case that an
undesired object 3 actually trespasses into the interior of the vehicle through saidwindow area 2 it causes a shadow 4' in a picture taken by said optical image sensor 1'. Consequently, the existence of a shadow in a picture taken by said optical image sensor generally allows the conclusion that an object has entered the interior of the vehicle. Said shadow may in particular be recognised when comparing the picture with a background image of the same area of the interior which has previously also been taken by said optical image sensor 1' from the same angle and which is not disturbed by any trespassing object. - However, in order to more precisely locate the penetrating
object 3 according to the present invention a further optical image sensor 1'' is provided for additionally monitoring saidwindow area 2 from a different angle. The penetratingobject 3 causes a further shadow 4'' in a picture taken by said further optical image sensor 1'' as shown in Fig. 1, irrespective as to whether theobject 3 just sticks out through a plain spanned by thewindow area 2 or as to whether the object has already completely entered the interior (not shown). The more precise location of the penetratingobject 3 can now be determined by calculating and evaluating the intersection of two fictitious lightening cones 5', 5''. More specifically, these cones are fictitious truncated cones wherein the tip of each of said truncated cones is located in the centre of one of said optical image sensors 1', 1'' and wherein these cones are restricted by the shadow 4', 4'' being co-ordinated to said optical image sensor and acting as conic section, respectively. The location of theobject 3 in the monitoredarea 2 of the interior is determined by theintersection 10 of said shadows 4' and 4''. Moreover, penetration of the object into the interior is determined by the maximum distance of theintersection 10 of said truncated cones to the plain spanned by saidwindow area 2. - The more precise determination of the location of the object and its penetration is now explained in more detail by referring to figures 2 and 3.
- For improving the intelligibility of Fig. 3, auxillary Fig. 2 shows a side-view of the arrangement shown in Fig. 1. When the arrangement in Fig. 1 is looked at from the line of sight indicated by the arrow 7 in Fig. 2 one can imagine that it is projected onto a fictitious projecting
area 6 shown in Fig. 2. Said projectingarea 6 is preferably perpendicular to the monitored window area /plain 2 of the vehicle and preferably comprises the centres of said optical image sensors 1' and 1''. - Fig. 3 represents a view onto said fictitious projecting area from the indicated line of sight. Consequently, the 3-dimensional illustration of Fig. 1 is reduced to a 2-dimensional illustration which facilitates explanation of the determination of the location and the penetration of the object.
- Fig. 3 shows a cross-sectional view through a
car body 8 of the vehicle wherein the external area 9' of the vehicle and its interior 9'' consequently lie on opposite sides of said car body. Thecar body 8 comprises thewindow area 2 through which penetration of an object is most likely expected. - As already indicated above one optical image sensor is sufficient for estimating the location of a penetrated object, because its location can be estimated by evaluating the location of its shadow 4', 4'' in a picture. The location of the shadow is in particular defined by its edge 4'a, 4''a, favourably indicated in Fig. 3 by a fictitious line 5'a, 5''a corresponding to the longest section of a line reaching from the centre of an optical image sensor 1', 1'' to the furthermost point of the edge 4'a, 4''a of the respective shadow. Said fictitious line 5'a, 5''a may be considered as being part of the surface area of the truncated cones 5', 5'' described in Fig. 1.
- However, that estimation of the location of the object by its shadow is only a rough one when the
window area 2 is wide in comparison to thewidth 3a of the penetratingobject 3. As can be seen from Fig. 3 there are severalpossible locations 3, 3', 3'' where theobject 3 could have entered the window area. (see dotted and solid lines in Fig. 3). In all said different entry locations theobject 3 would have caused the same furthermost point of the edge of the shadow. - Furthermore, the different
possible locations 3, 3', 3'' represent different penetrations P, P', P'' of theobject 3 into the interior of the vehicle, respectively. - In order to more precisely determine the location and the penetration of the object into said interior the present invention provides a further optical image sensor 1'' for monitoring the
window area 2 additionally from a different angle than sensor 1'. Thetrespassing object 3 will then additionally cause a further shadow 4'' on a further picture taken by said further optical image sensor 1''. When only considering said further picture and in particular evaluating fictitious line 5''a connecting the centre of said further optical image sensor 1'' with the far edge 4a of shadow 4'' a similar rough estimation about the location and penetration of theobject 3 would be received as described above. - However, the locations of said optical image sensors 1' and 1'' differ from each other and preferably monitor the
window area 2 from opposite directions. Consequently, the fictitious lines 5'a and 5''a have anintersection 10, in particular when they are projected into the projecting plain. - As can be seen from Fig. 3 calculation and evaluation of said
intersection 10 allows a more precise determination of the location of the trespassing object 3 (seeobject 3 drafted in solid lines) with regard to the width of said window area. More specifically, in the projecting plain there is only one location of the object 3 (drafted in solid lines) which is co-ordinated to said intersection; that specific location can be considered as the precise location where the object has actually entered thewindow area 2. Moreover, that specific location allows a more precise determination of the penetration P of the object. - Fig. 4 shows the system for carrying out the method according to the invention. It comprises at least the two fix-positioned
optical image sensors 1, 1'' for monitoring the interior from different angles, respectively. It further comprises a storage means 20 being adapted to store at least the two background images and / or the pictures taken by said two optical image sensors 1', 1'', respectively. The pictures as well as their respective background images are provided to a detectingmeans 20 which is able to compare and evaluate at least these two pictures and their respective background images. Said detectingmeans 30 takes a decision that anobject 3 has trespassed into the interior (of the vehicle) only if the section of the interior covered in the picture by the shadow is at least part of a predetermined relevant area of the interior. Said detecting means may further comprise locating means (not shown) for estimating the location of the object. - The pictures and their respective background images may be further analysed in a calculating means 40 in order to more precisely determine the location and the penetration of said
object 3 in the interior. More specifically, said calculating means 40 is adapted to calculate the penetration of thetrespassing object 3 into the interior or the distance between the trespassing object and at least of said optical image sensors by evaluating theintersection 10 of the fictitious truncated cones 5', 5'' or of the fictitious lines 5'a, 5''a mentioned above. - The invention has substantially been described by referring to the interior of the vehicles, but it shall be pointed out that the principles claimed in the present invention are further applicable to other interiors.
Claims (11)
- Method for monitoring an interior, in particular the interior of a vehicle, and for locating an object (3) trespassing into said interior, comprising the steps of:detecting an object (3) trespassing into said interior in the case that there is a shadow (4') caused by the trespassing object (3) in a picture of the interior taken when monitoring it;determining the location of that section of the interior which has in the picture been covered by said shadow (4'); andestimating the location of the trespassed object (3) in the interior from said determined location of said section in the interior;
characterized in thata decision for the detection of the object (3) is only taken, if the determined section is located in at least a part of a predetermined relevant area (2) of the interior through which trespassing of an object (3) into the interior is most likely expected. - Method according to claim 1 characterized in that the predetermined relevant area (2) is a window area or at least an area comprising an edge of a window.
- Method according to claim 2, characterized in that the decision for the detection is only taken, if the determined section allows the conclusion that a part of the trespassing object (3) has already entered the interior through the window area (2) whereas simultaneously another cohesive part of the object still remains outside the vehicle in front of the window area.
- Method according to one of the preceding claims characterized in that the step of determinating the location of the section comprises the step of comparing said picture with a background image showing the interior from the same angle as the picture but not being disturbed by any object (3) which has trespassed into said interior.
- Method according to claim 4, characterized in that said background image is adapted to changes in the interior upon each restart of a system for carrying out the method.
- Method according to one of the preceding claims, characterized in that an alarm signal is generated upon the decision for the detection has been taken.
- Method for determining the penetration of an object trespassing into an interior, comprising the steps of:carrying out the method according to one of claims 1 to 6 at least twice wherein the pictures are taken from different angles, respectively;selecting for each of said angles preferably the longest section of a line (5'a, 5''a) in the interior or in the surface area of a respective fictitious truncated cone (5', 5'') the tip of which lies in the centre of an optical image sensor (1', 1'') taking the pictures and which is restricted by the area of the shadow (4', 4'') in the respective picture acting as conic section;projecting said selected lines (5'a, 5''a) into a projecting area (6) substantially perpendicular to the area of the taken pictures and comprising at least the centre of one optical image sensor; andcalculating the perpendicular distance of the intersection 10 of said lines to the area of the taken pictures, wherein said distance represents the penetration (P) of the object into the interior.
- Method for determining the penetration of an object into the interior of a vehicle, comprising the steps of:carrying out the method according to one of claims 1 to 6 at least twice, however taking the pictures from different angles, respectively;determining a fictitious truncated cone (5', 5'') for each of said shadows, the tip of said cone lying in the centre of the optical image sensor (1', 1'') and the cone being restricted by the area of the shadow in the picture acting as conic section, respectively;determining the intersection (10) of said fictitious truncated cones; andcalculating the maximal perpendicular distance of said intersection (10) to the area of the taken pictures, wherein said distance represents the penetration of the object into the interior or calculating the distance from said intersection to at least one of the centres of said angles.
- System for monitoring an interior, in particular the interior of a vehicle, and for locating an object (3) trespassing into the interior, the system comprising:a fix-positioned optical image sensor (1') for taking a background image and a picture of the interior wherein the background image has been taken before said picture and is not disturbed by any trespassing object; anda storage means (20) for storing at least said background image;a detecting means (30) for detecting an object trespassing into said interior in the case that there is a shadow (4') in said picture, the shadow being caused by said object (3) and covering at least a section of said interior in the picture; anda locating means for estimating the location the object in the interior by determining the location of said section caused by said object in the picture;
characterised in thatsaid detecting means (30) is adapted to take a decision for the detection of the object only if the located section is located in at least a part of a predetermined relevant area (2) of the interior through which trespassing of an object into the interior is most likely expected. - System according to claim 9, characterized in that the locating means comprises a comparing means (40) for comparing said picture with a background image showing the interior from the same angle as the picture but not being disturbed by any object which has trespassed into said interior.
- System according to claim 9 or 10, characterized in thatthe system comprises at least one further fix-positioned optical image sensor (1'') for monitoring the interior from a different angle and for taking a further background image and a furter picture of the interior from said different angle;said storage means (20) is adapted to further store at least the further background image;said locating means are adapted to additionally estimating the location of the object by evaluating at least one further picture and background image of the interior; anda calculating means (40) is adapted to calculate the penetration of the trespassing object (3) into the interior or the distance between the trespassing object and at least one of said optical image sensors (1', 1'') by evaluating the intersection of fictitious truncated cones or lines within these cones, wherein the tip of each of said cones is assumed to lie in the centre of one of said optical image sensors whereas the bottom of a cone is assumed to be represented by the shadow hidden for the respective optical image sensor, respectively.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19911108 | 1999-03-12 | ||
DE19911108 | 1999-03-12 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1037181A2 true EP1037181A2 (en) | 2000-09-20 |
EP1037181A3 EP1037181A3 (en) | 2005-01-19 |
Family
ID=7900776
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP00105069A Withdrawn EP1037181A3 (en) | 1999-03-12 | 2000-03-10 | Method and system for monitoring an interior |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP1037181A3 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002073086A1 (en) * | 2001-03-14 | 2002-09-19 | Honeywell International Inc. | Object detection |
WO2006131647A2 (en) * | 2005-06-08 | 2006-12-14 | Sagem Securite | Method for analysing a presence in a space |
ITMI20120526A1 (en) * | 2012-03-30 | 2013-10-01 | Ararat S S | ANTI-THEFT SYSTEM |
ITUB20159152A1 (en) * | 2015-11-26 | 2017-05-26 | Emilio Ciardiello | NEW DETECTOR OF INTRUSION TO MATRIX OF DISCRETE SENSORS TO THE INFRARED AREA PLACED ON THE FOCAL PLAN OF A SINGLE LENS AND ABLE TO FIND THE PRESENCE, IN THE CONTROLLED ENVIRONMENT, OF WARM BODIES, MEN, ANIMALS OR THINGS, AS WELL AS TO PROVIDE INFORMATION ABOUT THEIR NUMBER, DIMENSIONS, THEIR INSTANT POSITION, THE MOVEMENT DIRECTION AND THE SPEED. |
CN108507470A (en) * | 2018-03-08 | 2018-09-07 | 东莞市光劲光电有限公司 | A method of measuring LED light source spatial coordinate location |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2311602A (en) * | 1996-03-27 | 1997-10-01 | Rover Group | A sensing system for a vehicle |
DE19621612A1 (en) * | 1996-05-31 | 1997-12-11 | C Vis Computer Vision Und Auto | Method of optical free space monitoring, esp. for monitoring track areas in railway stations for objects not normally present |
DE19709799A1 (en) * | 1997-03-10 | 1998-09-17 | Bosch Gmbh Robert | Device for video surveillance of an area |
-
2000
- 2000-03-10 EP EP00105069A patent/EP1037181A3/en not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2311602A (en) * | 1996-03-27 | 1997-10-01 | Rover Group | A sensing system for a vehicle |
DE19621612A1 (en) * | 1996-05-31 | 1997-12-11 | C Vis Computer Vision Und Auto | Method of optical free space monitoring, esp. for monitoring track areas in railway stations for objects not normally present |
DE19709799A1 (en) * | 1997-03-10 | 1998-09-17 | Bosch Gmbh Robert | Device for video surveillance of an area |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7200246B2 (en) | 2000-11-17 | 2007-04-03 | Honeywell International Inc. | Object detection |
WO2002073086A1 (en) * | 2001-03-14 | 2002-09-19 | Honeywell International Inc. | Object detection |
WO2006131647A2 (en) * | 2005-06-08 | 2006-12-14 | Sagem Securite | Method for analysing a presence in a space |
FR2887061A1 (en) * | 2005-06-08 | 2006-12-15 | Sagem | METHOD FOR ANALYZING A PRESENCE IN A SPACE |
WO2006131647A3 (en) * | 2005-06-08 | 2007-02-01 | Sagem Defense Securite | Method for analysing a presence in a space |
US7742175B2 (en) | 2005-06-08 | 2010-06-22 | Sagem Securite | Method of analyzing a presence in a space |
ITMI20120526A1 (en) * | 2012-03-30 | 2013-10-01 | Ararat S S | ANTI-THEFT SYSTEM |
ITUB20159152A1 (en) * | 2015-11-26 | 2017-05-26 | Emilio Ciardiello | NEW DETECTOR OF INTRUSION TO MATRIX OF DISCRETE SENSORS TO THE INFRARED AREA PLACED ON THE FOCAL PLAN OF A SINGLE LENS AND ABLE TO FIND THE PRESENCE, IN THE CONTROLLED ENVIRONMENT, OF WARM BODIES, MEN, ANIMALS OR THINGS, AS WELL AS TO PROVIDE INFORMATION ABOUT THEIR NUMBER, DIMENSIONS, THEIR INSTANT POSITION, THE MOVEMENT DIRECTION AND THE SPEED. |
CN108507470A (en) * | 2018-03-08 | 2018-09-07 | 东莞市光劲光电有限公司 | A method of measuring LED light source spatial coordinate location |
Also Published As
Publication number | Publication date |
---|---|
EP1037181A3 (en) | 2005-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5521634A (en) | Automatic detection and prioritized image transmission system and method | |
US8200024B2 (en) | Image monitoring system | |
JP4598653B2 (en) | Collision prediction device | |
US9137498B1 (en) | Detection of mobile computing device use in motor vehicle | |
CN101303735A (en) | Method for detecting moving objects in a blind spot region of a vehicle and blind spot detection device | |
JP2000059764A (en) | Vehicle position detecting device | |
US20060139164A1 (en) | Composite intrusion detection sensor | |
US6404484B1 (en) | Method for examining distance data and device thereof | |
JP2000030197A (en) | Device for detecting warm body | |
US11535242B2 (en) | Method for detecting at least one object present on a motor vehicle, control device, and motor vehicle | |
US10703271B2 (en) | Vehicle display device, vehicle display method, and recording medium for displaying images | |
JP2004533964A (en) | Optical identification method and apparatus for vehicle door open state | |
JP2002099906A (en) | Object-recognizing device | |
JP2001211466A (en) | Image processing system having self-diagnostic function | |
US7392118B2 (en) | System and method for monitoring the external environment of a motor vehicle | |
US20240303852A1 (en) | Methods and systems for detecting vessels | |
CN108151714A (en) | automotive system with motion detection capability | |
EP1037181A2 (en) | Method and system for monitoring an interior | |
KR101449288B1 (en) | Detection System Using Radar | |
JP2001021345A (en) | Obstacle detecting device | |
CN116252712A (en) | Driver assistance apparatus, vehicle, and method of controlling vehicle | |
JP4687850B2 (en) | Surveillance camera system | |
JP3806508B2 (en) | Parking lot image monitoring device | |
JP4601376B2 (en) | Image abnormality determination device | |
WO2022029860A1 (en) | Moving body tracking system, moving body tracking device, program and moving body tracking method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE |
|
AX | Request for extension of the european patent |
Free format text: AL;LT;LV;MK;RO;SI |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
AKX | Designation fees paid | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20050720 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: 8566 |