US20200142042A1 - Target object detection apparatus - Google Patents
Target object detection apparatus Download PDFInfo
- Publication number
- US20200142042A1 US20200142042A1 US16/659,175 US201916659175A US2020142042A1 US 20200142042 A1 US20200142042 A1 US 20200142042A1 US 201916659175 A US201916659175 A US 201916659175A US 2020142042 A1 US2020142042 A1 US 2020142042A1
- Authority
- US
- United States
- Prior art keywords
- dirt
- light
- target object
- detection apparatus
- object detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
-
- G01S17/026—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/04—Systems determining the presence of a target
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4804—Auxiliary means for detecting or identifying lidar signals or the like, e.g. laser illuminators
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
- G01S2007/4975—Means for monitoring or calibrating of sensor obstruction by, e.g. dirt- or ice-coating, e.g. by reflection measurement on front-screen
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
Definitions
- One or more embodiments of the disclosure relate to a target object detection apparatus for projecting and receiving light onto and from a target object to detect presence or absence of the target object and a distance from the target object detection apparatus to the target object.
- One or more embodiments of the disclosure particularly relate to a technique of detecting dirt on an optical window serving as a light outlet or light inlet of a target object detection apparatus.
- a target object detection apparatus such as an on-vehicle laser radar causes a light emitter to project measurement light onto a predetermined range.
- the target object detection apparatus then causes a light receiver to receive the reflected light from a target object in the predetermined range.
- the target object detection apparatus thus detects presence or absence of the target object and a distance from the target object detection apparatus to the target object, based on a light reception signal output from the light receiver.
- the light emitter includes a light emitting element such as a laser diode.
- the light receiver includes a light receiving element such as a photodiode.
- the target object detection apparatus components of an optical system and components of an electrical system are housed in a casing that shields light.
- the casing has an optical window.
- the optical window is made of a light transmissive material, such as glass or resin, that allows transmission of light.
- the optical window serves as a light outlet through which light goes out of the casing or a light inlet through which light enters the casing.
- the target object detection apparatus is mounted to, for example, a vehicle such that the optical window is directed to a predetermined range where a target object is detected. Measurement light emitted from the light emitter thus transmits through the optical window, and then is projected onto the predetermined range. In addition, the reflected light from the target object in the predetermined range transmits through the optical window, and then is received by the light receiver.
- JP 2012-192775 A, JP 2005-010094 A, and JP 2018-072288 A each propose a technique of detecting dirt on an optical window.
- a target object detection apparatus disclosed in JP 2012-192775 A changes a direction of laser light emitted from a light emitting element to a vertically downward direction, and detects presence or absence of dirt on an optical window, based on whether a light receiving element detects reflected light from a road surface. Upon detection of the presence of the dirt on the optical window, the target object detection apparatus displays a warning about the presence of the dirt.
- a target object detection apparatus disclosed in JP 2005-010094 A determines that an optical window (apparatus surface) is dirty on condition that, of a plurality of laser light beams emitted from light emitting elements, laser light beams, the number of which is equal to or more than a predetermined number, are high in strength to such an extent that a measurement time from the emission to reception of the corresponding reflected light is shorter than a predetermined time and a pulse of the corresponding reflected light exceeds an upper threshold value.
- the target object detection apparatus displays the presence of the dirt on an abnormality display.
- a target object detection apparatus disclosed in JP 2018-072288 A measures distances from the target object detection apparatus to a target object for each of pixels in a detection field-of-view of the target object detection apparatus fronting on a predetermined range through an optical window. The distances thus measured are stored in a memory. The target object detection apparatus then calculates an area of a pixel group corresponding to a distance from the target object to a surface of the optical window, of the distances stored in the memory. In other words, the target object detection apparatus calculates an area of dirt on the optical window. The target object detection apparatus transmits to a steering system a notification signal for decelerating a vehicle or a notification signal for stopping a vehicle, in accordance with the area thus calculated.
- a target object detection apparatus Upon detection of presence of dirt on an optical window, a target object detection apparatus known in the related art has displayed the presence of the dirt to urge a user to remove the dirt from the optical window.
- the target object detection apparatus displays the presence of the dirt, which may make the user feel burdensome in some instances. If such minor dirt is manually removed in accordance with the display about the presence of the dirt on the optical window, a wasteful effort is required in some instances.
- the cleaning fluid is wasted in some instances. If the target object detection apparatus displays presence of dirt on the optical window each time dirt adheres to the optical window, the user is apt to leave the dirt since the user feels removal of the dirt burdensome. If the left dirt is, for example, dense dirt adhering to substantially the entire optical window, the dirt may continuously exert an adverse influence on the detection performance of the target object detection apparatus.
- One or more embodiments of the disclosure provide a target object detection apparatus capable of closely detecting a state of dirt on an optical window, thereby taking appropriate measures against the dirt on the optical window.
- a target object detection apparatus includes: a light emitter configured to emit measurement light; a light receiver configured to receive reflected light from a target object in a predetermined range onto which the light emitter projects the measurement light, the light receiver being configured to output a light reception signal according to a light reception state; an object detector configured to detect presence or absence of the target object or a distance from the target object detection apparatus to the target object, based on the light reception signal output from the light receiver; an optical window including a light transmissive material that allows transmission of light and serving as a light outlet for the measurement light or a light inlet for the reflected light; a dirt detector configured to detect presence or absence of dirt on the optical window, based on the light reception signal; and a notifier configured to provide a notification about the presence of the dirt on the optical window.
- the dirt detector detects, based on the light reception signal output from the light receiver, dirt levels in units of segments in a detection field-of-view of the target object detection apparatus fronting on the predetermined range through the optical window, and detects a density and an extent of the dirt, based on the dirt levels.
- the notifier provides a notification about a result of detection by the dirt detector as to the dirt.
- the dirt detector detects, based on a light reception signal output from the light receiver, dirt levels in units of segments in the detection field-of-view of the target object detection apparatus fronting on the predetermined range, where the target object detection apparatus detects the target object, through the optical window.
- the dirt detector detects a density and an extent of the dirt, based on the dirt levels. Therefore, the dirt detector closely detects a state of dirt, such as a position of dense dirt and a position of sparse dirt, in the entire detection field-of-view of the target object detection apparatus, that is, in the entire light transmission region of the optical window.
- the notifier provides a notification about the state of the dirt on the optical window thus closely detected.
- a user or an external apparatus therefore takes appropriate measures against the dirt. For example, the user or external apparatus removes the dirt from the optical window or leaves the dirt as it is.
- the light emitter may include a plurality of light emitting elements
- the light receiver may include a plurality of light receiving elements.
- the target object detection apparatus may further include a light scanner configured to scan the predetermined range with the measurement light emitted from each light emitting element or to guide the reflected light to the light receiver.
- the dirt detector may calculate a sum of the dirt levels and an average value of dirt levels in segments where the dirt extends, in each segment group that is a subset of segments adjoining one another, and may detect the density and extent of the dirt, based on the sum and the average value.
- the dirt detector may detect the density and extent of the dirt on the entire optical window, based on a result of detection in each segment group as to the dirt.
- the dirt detector may estimate a type of the dirt, based on a result of detection in each segment group as to the dirt, and the notifier may provide a notification about the type of the dirt estimated by the dirt detector.
- the dirt detector may determine urgency of dirt removal, based on a result of detection in each segment group as to the dirt, and the notifier may provide a notification about the urgency of dirt removal determined by the dirt detector.
- One or more embodiments of the disclosure may provide a target object detection apparatus capable of closely detecting a state of dirt on an optical window, thereby taking appropriate measures against the dirt on the optical window.
- FIG. 1 is an electrical block diagram of a target object detection apparatus according to one or more embodiments of the disclosure
- FIG. 2 illustrates an arrangement of LDs and PDs illustrated in FIG. 1 ;
- FIG. 3 is a rear view of an optical system in the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 4A illustrates a light projection path of the optical system in the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 4B illustrates a light reception path of the optical system in the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 5 illustrates a detection field-of-view of the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 6 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated in FIG. 1 and an exemplary light reception signal
- FIG. 7 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated in FIG. 1 and an exemplary light reception signal
- FIG. 8 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated in FIG. 1 and an exemplary light reception signal
- FIG. 9 is a flowchart of operations of the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 10 illustrates criteria for a density and an extent of dirt to be determined by the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 11A illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 11B illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 11C illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated in FIG. 1 ;
- FIG. 11D illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated in FIG. 1 .
- FIG. 1 is an electrical block diagram of a target object detection apparatus 100 .
- FIG. 2 illustrates an arrangement of laser diodes (LDs) and photodiodes (PDs) in the target object detection apparatus 100 .
- LDs laser diodes
- PDs photodiodes
- the target object detection apparatus 100 is, for example, an optical laser radar to be installed in a vehicle 30 such as a four-wheel automobile.
- the target object detection apparatus 100 detects a target object such as another vehicle, a human, a road (e.g., a road surface), or any object.
- the target object detection apparatus 100 includes a controller 1 , an LD module 2 , a charging circuit 3 , a motor 4 c , a motor drive circuit 5 , an encoder 6 , a PD module 7 , an analog-to-digital converter (ADC) 8 , a memory 9 , and an interface 10 .
- ADC analog-to-digital converter
- the controller 1 is constituted of, for example, a central processing unit (CPU), and is configured to control operations of the respective components.
- the controller 1 includes an object detector 1 a and a dirt detector 1 b .
- the functions of the object detector 1 a and dirt detector 1 b are respectively implemented by software programs to be executed by the CPU of the controller 1 .
- the LD module 2 includes, for example, an LD that serves as a light source, and a capacitor that causes the LD to emit light.
- the LD is a light emitting element that emits a high-power optical pulse.
- FIG. 1 illustrates one LD and one capacitor in the form of a block for convenience.
- the LD module 2 actually includes a plurality of LDs (e.g., LD 1 to LD 8 illustrated in FIG. 2 ) and a plurality of capacitors (not illustrated in FIG. 2 ) for the respective LDs (i.e., LD 1 to LD 8 ).
- the LDs i.e., LD 1 to LD 8
- the LDs are arranged in a vertical direction Z.
- the LDs i.e., LD 1 to LD 8
- the LD module 2 is an example of a “light emitter” according to one or more embodiments of the disclosure.
- the charging circuit 3 illustrated in FIG. 1 electrically charges the capacitor in the LD module 2 .
- FIG. 1 illustrates one charging circuit 3 in the form of a block.
- the target object detection apparatus 100 may include a plurality of charging circuits 3 in accordance with the number of LDs and the number of capacitors.
- the controller 1 controls the light emitting operation of the LD and the charging operation of the charging circuit 3 . Specifically, the controller 1 causes the LD to emit light, thereby projecting laser light (measurement light) onto a predetermined range. In addition, the controller 1 causes the LD to stop the light emission, and also causes the charging circuit 3 to electrically charge the capacitor.
- the motor 4 c serves as a drive source for a light scanner 4 to be described later with reference to, for example, FIG. 3 .
- the motor drive circuit 5 drives the motor 4 c .
- the encoder 6 detects rotational states, such as an angle and a rotational speed, of the motor 4 c .
- the controller 1 causes the motor drive circuit 5 to rotate the motor 4 c , and controls an operation of the light scanner 4 .
- the controller 1 detects operational states, such as an operation amount and an operating position, of the light scanner 4 , based on an output from the encoder 6 .
- the PD module 7 includes, for example, a PD that serves as a light receiving element, a transimpedance amplifier (TIA), a multiplexer (MUX), and a variable gain amplifier (VGA). The details of each circuit are not illustrated in the drawings.
- FIG. 1 illustrates one PD and one TIA in the form of a block for convenience.
- the PD module 7 actually includes a plurality of PDs (e.g., PD 1 to PD 32 illustrated in FIG. 2 ) and a plurality of TIAs (not illustrated in FIG. 2 ) for the respective PDs (i.e., PD 1 to PD 32 ).
- the PDs i.e., PD 1 to PD 32
- the PDs are arranged in the vertical direction Z.
- PDs i.e., PD 1 to PD 4 , PD 5 to PD 8 , PD 9 to PD 12 , PD 13 to PD 16 , PD 17 to PD 20 , PD 21 to PD 24 , PD 26 to PD 28 , PD 29 to PD 32
- LD i.e., LD 1 , LD 2 , LD 3 , LD 4 , LD 5 , LD 6 , LD 7 , LD 8
- the PDs i.e., PD 1 to PD 32
- the PD module 7 is an example of a “light receiver” according to one or more embodiments of the disclosure.
- the PD receives light, and outputs a current (light reception signal) according to the light reception state.
- the TIA converts into a voltage signal the current flowing through the PD, and outputs the voltage signal to the MUX.
- the MUX selects the output signal from the TIA, and outputs the selected signal to the VGA.
- the VGA amplifies the output signal from the MUX, and outputs the amplified signal to the ADC 8 .
- the ADC 8 receives the analog signal from the VGA, rapidly converts the analog signal into a digital signal, and outputs the digital signal to the controller 1 .
- the light reception signal according to the light reception state of the PD is thus subjected to signal processing by each of the TIA, the MUX, and the VGA, and then is output to the controller 1 via the ADC 8 .
- FIG. 1 illustrates one MUX, one VGA, and one ADC 8 in the form of a block.
- the target object detection apparatus 100 may include a plurality of MUXs, a plurality of VGAs, and a plurality of ADCs 8 in accordance with the number of PDs.
- the controller 1 controls the operations of the respective components in the PD module 7 . Specifically, for example, the controller 1 causes the LD in the LD module 2 to emit light, thereby projecting laser light onto the predetermined range, and then causes the PD in the PD module 7 to receive reflected light from a target object in the predetermined range. In these operations, the controller 1 causes the LDs (i.e., LD 1 to LD 8 in FIG. 2 ) to sequentially emit light, thereby projecting laser light, and causes the corresponding PDs (i.e., PD 1 to PD 32 in FIG. 2 ) to sequentially receive the reflected light.
- the controller 1 causes the LDs (i.e., LD 1 to LD 8 in FIG. 2 ) to sequentially emit light, thereby projecting laser light, and causes the corresponding PDs (i.e., PD 1 to PD 32 in FIG. 2 ) to sequentially receive the reflected light.
- the controller 1 then subjects a light reception signal output from each of the PDs (i.e., PD 1 to PD 32 ) in accordance with the light reception state to signal processing by each of the TIA and the VGA.
- the controller 1 also causes the ADC 8 to convert the analog light reception signals from the PD module 7 into digital light reception signals.
- the object detector 1 a of the controller 1 Based on the digital light reception signals thus converted by the ADC 8 , the object detector 1 a of the controller 1 detects presence or absence of the target object and a distance from the target object detection apparatus 100 to the target object, and the dirt detector 1 b of the controller 1 detects presence or absence of dirt on an optical window 12 to be described later with reference to, for example, FIG. 4A .
- the memory 9 is a volatile memory or a nonvolatile memory.
- the memory 9 stores therein, for example, information for the controller 1 in controlling the respective components of the target object detection apparatus 100 , and information for the controller 1 in detecting a target object.
- the memory 9 also stores therein a result of detection by the dirt detector 1 b of the controller 1 as to dirt on the optical window 12 .
- the interface 10 includes a communication circuit for establishing communications with a vehicle-side electronic control unit (ECU) 50 .
- the controller 1 transmits and receives various kinds of control information to and from the vehicle-side ECU 50 via the interface 10 .
- the controller 1 transmits a result of detection by the object detector 1 a and a result of detection by the dirt detector 1 b .
- Each of the controller 1 and the interface 10 is an example of a “notifier” according to one or more embodiments of the disclosure.
- the vehicle-side ECU 50 receives a result of detection as to a target object from the target object detection apparatus 100 , and controls an operation of, for example, an on-vehicle device (not illustrated) in a steering system installed in the vehicle 30 , based on the result of detection.
- the vehicle-side ECU 50 thus causes the vehicle 30 to travel and stop.
- the vehicle-side ECU 50 receives a result of detection as to dirt on the optical window 12 from the target object detection apparatus 100 , and transmits an operation command to the on-vehicle device, based on the result of detection.
- the vehicle-side ECU 50 transmits a dirt warning command to a display (not illustrated) mounted to a cabin of the vehicle 30 .
- the display thus displays thereon a warning that the optical window 12 is dirty, and a state of dirt on the optical window 12 to prompt a user to take appropriate measures, such as removal, against the dirt.
- the vehicle-side ECU 50 transmits a dirt cleaning command to a cleaning apparatus (not illustrated) installed in the vehicle 30 .
- the cleaning apparatus thus jets a cleaning fluid onto the optical window 12 to remove the dirt from the optical window 12 .
- FIG. 3 is a rear view of an optical system in the target object detection apparatus 100 .
- FIG. 4A illustrates a light projection path of the optical system in the target object detection apparatus 100 .
- FIG. 4B illustrates a light reception path of the optical system in the target object detection apparatus 100 .
- FIGS. 4A and 4B each illustrate the interior of the target object detection apparatus 100 seen from above.
- FIG. 3 illustrates the interior of the target object detection apparatus 100 seen from the rear (from below in FIG. 4A ).
- a casing 11 is formed in a box shape, and is made of synthetic resin that blocks transmission of light. As illustrated in FIGS. 4A and 4B , the casing 11 has in its front side the optical window 12 .
- the optical window 12 is made of a light transmissive material, such as synthetic resin or glass, that permits transmission of light.
- the optical window 12 serves as a light inlet through which light enters the casing 11 and a light outlet through which light goes out of the casing 11 .
- the target object detection apparatus 100 is mounted on the front, rear, left, or right side of the vehicle 30 such that the optical window 12 is directed forward, rearward, leftward, or rightward of the vehicle 30 , and the shorter edge of the casing 11 and the vertical direction (heightwise direction) Z become parallel.
- the casing 11 accommodates therein optical system components such as the LD module 2 , a light projecting lens 14 , the light scanner 4 , a reflecting mirror 15 , a light receiving lens 16 , a reflecting mirror 17 , and the PD module 7 .
- the LD module 2 , the motor 4 c of the light scanner 4 , and the PD module 7 are electronic components to be electrically driven.
- the casing 11 also accommodates therein other electronic components illustrated in FIG. 1 . It should be noted that FIG. 4B does not illustrate the LD module 2 , the light projecting lens 14 , a light projecting mirror 4 a (to be described later) of the light scanner 4 , and the motor 4 c of the light scanner 4 .
- the LD of the LD module 2 , the light projecting lens 14 , and the light scanner 4 constitute a light-projecting optical system.
- the light scanner 4 , the reflecting mirror 15 , the reflecting mirror 17 , the light receiving lens 16 , and the PD of the PD module 7 constitute a light-receiving optical system.
- a light shielding plate 18 is disposed between the light-projecting optical system and the light-receiving optical system in order to prevent interference of light.
- the light shielding plate 18 is not illustrated in FIGS. 4A and 4B .
- the LD module 2 , the light projecting lens 14 , the motor 4 c of the light scanner 4 , the reflecting mirror 15 , the light receiving lens 16 , the reflecting mirror 17 , the PD module 7 , and the light shielding plate 18 are fixedly disposed in the casing 11 .
- the LD module 2 is disposed on an upper side of the target object detection apparatus 100 at a center of the target object detection apparatus 100 .
- the light projecting lens 14 is disposed on the light emission side of the LD in the LD module 2 .
- the light projecting lens 14 is disposed on the left side of the LD module 2 .
- the light scanner 4 is disposed opposite the LD module 2 with respect to the light projecting lens 14 .
- the light scanner 4 which is also referred to as a light deflector, includes, for example, the light projecting mirror 4 a , a light receiving mirror 4 b , and the motor 4 c .
- the motor 4 c is a brushless motor. As illustrated in FIGS. 4A and 4B , the motor 4 c has a pivot 4 j .
- the light projecting mirror 4 a is coupled to an upper end of the pivot 4 j .
- the light receiving mirror 4 b is coupled to a lower end of the pivot 4 j .
- Each of the light projecting mirror 4 a and the light receiving mirror 4 b is a double-sided mirror formed in a plate shape.
- each of the light projecting mirror 4 a and the light receiving mirror 4 b has two plate planes each formed as a reflection plane.
- the light projecting mirror 4 a and the light receiving mirror 4 b rotate in conjunction with the pivot 4 j of the motor 4 c .
- the pivot 4 j of the motor 4 c is disposed in parallel with the vertical direction Z.
- the PD module 7 is disposed on a lower side of the target object detection apparatus 100 at the center of the target object detection apparatus 100 .
- the reflecting mirror 15 , the light receiving lens 16 , and the reflecting mirror 17 are disposed opposite the light scanner 4 with respect to the PD module 7 .
- the PD module 7 , the reflecting mirror 15 , the light receiving lens 16 , and the reflecting mirror 17 are disposed below the LD module 2 .
- the reflecting mirror 17 is disposed on the light reception side of the PD in the PD module 7 .
- the reflecting mirror 17 is disposed on the right side of the PD module 7 .
- the reflecting mirror 17 is inclined at a predetermined angle.
- the reflecting mirror 15 is disposed forward of the reflecting mirror 17 .
- the reflecting mirror 15 is disposed closer to the optical window 12 than the reflecting mirror 17 is.
- the reflecting mirror 15 is inclined at a predetermined angle.
- the light receiving lens 16 is disposed between the reflecting mirror 17 and the reflecting mirror 15 .
- an alternate long and short dash arrow indicates the light projection path of the light-projecting optical system.
- the LD in the LD module 2 emits light.
- the light is adjusted as to its expansion by the light projecting lens 14 , and then reaches the light projecting mirror 4 a of the light scanner 4 .
- the motor 4 c rotates to change an angle (orientation) of the light projecting mirror 4 a , so that one of the reflection planes of the light projecting mirror 4 a is directed toward the predetermined range E.
- the light from the LD transmits through the light projecting lens 14 , and then is reflected at the light projecting mirror 4 a .
- the light from the LD thus transmits through almost the upper half of the optical window 12 , and then is projected onto the external predetermined range E.
- a hatched portion indicates the predetermined range E corresponding to a range near the target object detection apparatus 100 in a range to be scanned by the target object detection apparatus 100 with light projected onto and received from the range. Since the pivot 4 j of the light projecting mirror 4 a and light receiving mirror 4 b is disposed in parallel with the vertical direction Z, the light scanner 4 scans the predetermined range E with laser light and the reflected light in a predetermined angular range ⁇ within a horizontal plane. In addition, since the plurality of LDs and the plurality of PDs are arranged in the vertical direction Z, the laser light and the reflected light are projected and received in a predetermined angular range within a vertical plane.
- FIG. 4A when a target object Q is in the predetermined range E, light projected from the target object detection apparatus 100 onto the predetermined range E is reflected from the target object Q.
- FIG. 4B an alternate long and two short dashes arrow indicates the light reception path of the light-receiving optical system in the target object detection apparatus 100 in receiving the reflected light from the target object Q.
- the light from the target object detection apparatus 100 is reflected from the target object Q.
- the reflected light from the target object Q transmits through the optical window 12 , and then reaches the light receiving mirror 4 b of the light scanner 4 .
- the motor 4 c rotates to change an angle (orientation) of the reflection planes of the light receiving mirror 4 b , so that one of the reflection planes of the light receiving mirror 4 b is directed toward the predetermined range E.
- the reflected light from the target object Q thus transmits through almost the lower half of the optical window 12 , is reflected by the light receiving mirror 4 b , and is guided to the reflecting mirror 15 .
- the light scanner 4 deflects toward the reflecting mirror 15 the reflected light from the target object Q in the predetermined range E.
- the reflected light which is guided to the reflecting mirror 15 by the light scanner 4 , is reflected at the reflecting mirror 15 to enter the light receiving lens 16 .
- the reflected light is condensed and adjusted by the light receiving lens 16 , and then is reflected at the reflecting mirror 17 . Thereafter, the reflected light is received by the PD in the PD module 7 .
- the PD outputs a light reception signal in accordance with the reflected light reception state.
- the light reception signal is subjected to signal processing by each of the PD module 7 and the ADC 8 .
- the object detector 1 a of the controller 1 Based on the light reception signal thus subjected to signal processing, the object detector 1 a of the controller 1 detects presence or absence of the target object Q and a distance from the target object detection apparatus 100 to the target object Q.
- FIG. 5 illustrates a detection field-of-view F of the target object detection apparatus 100 .
- the detection field-of-view F illustrated in FIG. 5 is a field of view of the target object detection apparatus 100 in the predetermined range E where the target object detection apparatus 100 detects the target object Q.
- the detection field-of-view F corresponds to a light transmission region of the optical window 12 where laser light and the reflected light are transmittable.
- the detection field-of-view F is divided into segments X 1 to X n arranged in a grid form.
- the target object detection apparatus 100 projects laser light in units of segments X 1 to X n , and receives the reflected light in units of segments X 1 to X n .
- the PD module 7 outputs light reception signals in units of segments X 1 to X n .
- the controller 1 Based on the light reception signals, the controller 1 detects presence or absence of the target object Q and a distance from the target object detection apparatus 100 to the target object Q. The controller 1 also detects presence or absence of dirt on the optical window 12 . In addition, the controller 1 makes a determination as to a state of dirt on the optical window 12 in units of segment groups Y 1 to Y m each of which is a subset of segments adjoining one another. In the example illustrated in FIG. 5 , each of the segment groups Y 1 to Y m consists of t (t ⁇ n) segments arranged in a matrix.
- FIGS. 6, 7, and 8 each illustrate an exemplary light projection and reception state of the target object detection apparatus 100 and an exemplary light reception signal.
- upper schematic diagrams (a) each illustrate the optical system in the target object detection apparatus 100 seen sideways; however, the reflecting mirror 15 , the reflecting mirror 17 , and the light shielding plate 18 are not illustrated in FIGS. 6 to 8 .
- lower graphs (b) each illustrate a change in light reception signal output from the PD module 7 .
- the horizontal axis represents a time
- the vertical axis represents a signal strength.
- light reception signals to be output from the PD module 7 include a pulsewise reflected-light signal based on the sparse dirt Db and a pulsewise reflected-light signal based on the target object Q.
- light reception signals include a reflected-light signal based on the dense dirt Da, a reflected-light signal based on the sparse dirt Db, and a reflected-light signal based on the target object Q.
- the controller 1 detects peaks of pulses in light reception signals output from the PD module 7 in units of segments X 1 to X n illustrated in FIG. 5 . At this time, the controller 1 detects a peak strength and a peak time as to each pulse, and stores the detected strength and time in the memory 9 as necessary. The controller 1 detects as a reflected-light signal a pulse having a peak strength that is equal to or more than a predetermined threshold value S (see (b) of FIG. 6 , (b) of FIG. 7 , (b) of FIG. 8 ). The controller 1 also detects as a reflected-light reception time a time at which the reflected-light signal reaches its peak value.
- the object detector 1 a calculates a period of time from a time, at which laser light as a source of the reflected-light signal detected by the controller 1 is projected, to the reflected-light reception time (i.e., a time of flight (TOF) of light), and also calculates a distance based on the time of flight, by the TOF method.
- TOF time of flight
- the object detector 1 a determines that the target object Q is in the predetermined range E.
- the object detector 1 a defines the distance as a distance from the target object detection apparatus 100 to the target object Q, and records the distance in the memory 9 with the distance correlated with the segments X 1 to X n .
- the dirt detector 1 b determines that the optical window 12 is dirty.
- the dirt detector 1 b reads from the memory 9 a peak strength of the reflected-light signal in calculating the distance, detects a dirt level based on the peak strength, and records the dirt level in the memory 9 with the dirt level correlated with the segments X 1 to X n .
- the dirt detector 1 b may calculate the dirt level, based on the peak strength and a predetermined operational expression. Alternatively, the dirt detector 1 b may define the peak strength as the dirt level.
- Light reception signals from which pulses whose peak strengths are equal to or more than the predetermined threshold value S are not detected, include none of the reflected-light signal based on the target object Q, the reflected-light signal based on the dense dirt Da, and the reflected-light signal based on the sparse dirt Db. Therefore, the object detector 1 a determines that no target object is in the predetermined range E, and the dirt detector 1 b determines that the optical window 12 is not dirty. In this case, the object detector 1 a does not detect the distance. In other words, the object detector 1 a does not detect the distance from the target object detection apparatus 100 to the target object Q.
- the dirt detector 1 b detects a dirt level, based on a signal strength of the light reception signal at a predetermined time Ta (see (b) of FIG. 6 , (b) of FIG. 7 , (b) of FIG. 8 ), and records the dirt level in the memory 9 with the dirt level correlated with the segments X 1 to X n .
- the predetermined time Ta is set at, for example, a time from emission of laser light from the LD to reception, by the PD, of the reflected light from the surface of the optical window 12 .
- the light reception signals include only a reflected-light signal based on the target object Q as illustrated in (b) of FIG. 6 .
- the object detector 1 a determines that the target object Q is in the predetermined range E
- the dirt detector 1 b determines that the optical window 12 is not dirty.
- the dirt detector 1 b detects a dirt level, based on the signal strength of the light reception signal at the predetermined time Ta, and records the detected dirt level in the memory 9 with the dirt level correlated with the segments X 1 to X n .
- the light reception signals include only a reflected-light signal based on dirt as illustrated in (b) of FIG. 7 .
- the dirt detector 1 b determines that the optical window 12 is dirty
- the object detector 1 a determines that no target object is in the predetermined range E. Therefore, the distance calculated by the object detector 1 a is not recorded as a distance from the target object detection apparatus 100 to the target object Q.
- the object detector 1 a determines that the target object Q is in the predetermined range E, and records the distance from the target object detection apparatus 100 to the target object Q in the memory 9 .
- the dirt detector 1 b determines that the optical window 12 is dirty, and records the dirt level in the memory 9 .
- FIG. 9 is a flowchart of the operations of the target object detection apparatus 100 .
- step S 1 illustrated in FIG. 9 first, the controller 1 controls, for example, the LD module 2 , the PD module 7 , and the light scanner 4 to perform the operation of projecting and receiving light onto and from the predetermined range E. Specifically, the controller 1 rotates the light projecting mirror 4 a and light receiving mirror 4 b of the light scanner 4 , and causes the LDs in the LD module 2 to sequentially emit light. The controller 1 then causes the light projecting mirror 4 a to reflect laser light from each LD, thereby projecting the laser light onto the predetermined range E.
- the controller 1 then causes the light receiving mirror 4 b to reflect the reflected light from the target object Q, the dense dirt Da, or the sparse dirt Db, and also causes the PDs in the PD module 7 to sequentially receive the reflected light.
- the controller 1 then subjects a light reception signal output from each PD to signal processing by each of the TIA, the MUX, the VGA, and the ADC 8 .
- step S 2 illustrated in FIG. 9 next, the controller 1 detects a reflected-light signal, based on light reception signals output from the PD module 7 in units of segments X 1 to X n in the detection field-of-view F (see FIG. 5 ), and the object detector 1 a calculates distances in units of segments X 1 to X n .
- step S 3 illustrated in FIG. 9 based on all the distances thus calculated in units of segments X 1 to X n , the object detector 1 a detects presence or absence of the target object Q and distances from the target object detection apparatus 100 to the target object Q in units of segments X 1 to X n , and records the results of detection in the memory 9 .
- step S 4 illustrated in FIG. 9 the controller 1 causes the interface 10 to notify the vehicle-side ECU 50 of the results of detection as to the target object Q.
- step S 5 illustrated in FIG. 9 based on the reflected-light signal detected by the controller 1 and the distances calculated by the object detector 1 a , the dirt detector 1 b detects presence or absence of dirt and dirt levels in units of segments X 1 to X n , and records the results of detection in the memory 9 .
- step S 6 illustrated in FIG. 9 next, the dirt detector 1 b calculates a sum and an average value of the dirt levels in each of the segment groups Y 1 to Y m illustrated in FIG. 5 . Specifically, the dirt detector 1 b calculates a sum, that is, a total value of the dirt levels in all the segments in each of the segment groups Y 1 to Y m , and calculates an average value of dirt levels in segments where the dirt extends.
- step S 7 illustrated in FIG. 9 next, the dirt detector 1 b detects a density and an extent of the dirt in each of the segment groups Y 1 to Y m , based on the sum of the dirt levels, the average value of the dirt levels, and a predetermined criterion, and records the results of detection in the memory 9 .
- FIG. 10 illustrates criteria for a density and an extent of dirt to be determined by the target object detection apparatus 100 .
- the memory 9 previously stores therein information on the criteria illustrated in FIG. 10 .
- step S 7 illustrated in FIG. 9 when the sum of the dirt levels in each of the segment groups Y 1 to Y m is smaller than a predetermined value U and the average value of the dirt levels in each of the segment groups Y 1 to Y m is smaller than a predetermined value V as illustrated in FIG. 10 , the dirt detector 1 b determines that sparse dirt Db is present in some of the segment groups Y 1 to Y m or determines that dense dirt Da and sparse dirt Db are absent in the segment groups Y 1 to Y m .
- the dirt detector 1 b determines that dense dirt Da is present in some of the segment groups Y 1 to Y m .
- the dirt detector 1 b determines that sparse dirt Db is present in all the segment groups Y 1 to Y m .
- the dirt detector 1 b determines that dense dirt Da is present in all the segment groups Y 1 to Y m .
- step S 8 illustrated in FIG. 9 next, the dirt detector 1 b detects a density and an extent of the dirt on the entire optical window 12 , based on the results of detection as to the dirt in each of the segment groups Y 1 to Y m .
- step S 9 illustrated in FIG. 9 next, the dirt detector 1 b estimates a type of the dirt on the optical window 12 , based on the results of detection.
- FIGS. 11A to 11D each illustrate an exemplary density and an exemplary extent of dirt in each of the segment groups Y 1 to Y m in the detection field-of-view F of the target object detection apparatus 100 .
- FIGS. 11A to 11D a segment group where dense dirt Da entirely extends is cross-hatched.
- a segment group where sparse dirt Db entirely extends is hatched with lines slanted upward to the right with wide pitches.
- a segment group where dense dirt Da partially extends is hatched with lines slanted upward to the left with narrow pitches.
- a segment group where sparse dirt Db partially extends or where dense dirt Da and sparse dirt Db are absent is not hatched. The same things may hold true for FIG. 10 .
- the dirt detector 1 b determines in step S 8 illustrated in FIG. 9 that sparse dirt Db adheres to a considerably small part of the optical window 12 or almost no dirt adheres to the optical window 12 , and then estimates in step S 9 illustrated in FIG. 9 that the dirt on the optical window 12 is “sparse mud” or “ignorable dirt”.
- the dirt detector 1 b determines in step S 8 illustrated in FIG. 9 that dense dirt Da adheres to a part of the optical window 12 , and estimates in step S 9 illustrated in FIG. 9 that the dirt on the optical window 12 is “bug”.
- the dirt detector 1 b estimates in step S 9 illustrated in FIG. 9 that the dirt on the optical window 12 is “problematic dirt”.
- the dirt detector 1 b determines in step S 8 illustrated in FIG. 9 that sparse dirt Db adheres to the entire optical window 12 , and estimates in step S 9 illustrated in FIG. 9 that the dirt on the optical window 12 is “sparse mud” or “problematic dirt”.
- the dirt detector 1 b determines in step S 8 illustrated in FIG. 9 that dense dirt Da adheres to the entire optical window 12 , and estimates in step S 9 illustrated in FIG. 9 that the dirt on the optical window 12 is “dense mud” and “very problematic dirt”.
- the memory 9 previously stores therein information (criteria) for estimating a type of dirt as described above.
- the dirt detector 1 b determines a density and an extent of dirt on the entire optical window 12 , and estimates a type of the dirt.
- step S 10 illustrated in FIG. 9 next, the dirt detector 1 b determines urgency of dirt removal as to the optical window 12 , based on the results of detection as to the dirt in each of the segment groups Y 1 to Y m .
- the dirt detector 1 b determines in step S 10 illustrated in FIG. 9 that the urgency of dirt removal is “low”.
- the dirt detector 1 b determines in step S 10 illustrated in FIG. 9 that the urgency of dirt removal is “high”.
- the segment groups in the detection field-of-view F include segment groups that are cross-hatched, that is, segment groups where dense dirt entirely extends, at an end of the detection field-of-view F, the dirt detector 1 b determines in step S 10 illustrated in FIG. 9 that the urgency of dirt removal is “low”.
- step S 10 illustrated in FIG. 9 when the dirt on the optical window 12 is “sparse mud” or “problematic dirt”, the dirt detector 1 b determines in step S 10 illustrated in FIG. 9 that the urgency of dirt removal is “middle”. As illustrated in FIG. 11D , when the dirt on the optical window 12 is “dense mud” or “very problematic dirt”, the dirt detector 1 b determines in step S 10 illustrated in FIG. 9 that the urgency of dirt removal is “high”.
- step S 11 illustrated in FIG. 9 the controller 1 causes the interface 10 to notify the vehicle-side ECU 50 of the results of detection by the dirt detector 1 b as to dirt. Specifically, the interface 10 notifies the vehicle-side ECU 50 of the density and extent of the dirt in each of the segment groups Y 1 to Y m , the density and extent of the dirt on the entire optical window 12 , the type of the dirt, and the urgency of dirt removal, which are detected by the dirt detector 1 b in steps S 7 to S 10 illustrated in FIG. 9 .
- the vehicle-side ECU 50 Upon reception of a notification that the urgency of dirt removal is “high”, from the target object detection apparatus 100 , for example, the vehicle-side ECU 50 causes the display in the vehicle 30 to display thereon a warning that the optical window 12 is dirty, with a high frequency or causes the cleaning apparatus in the vehicle 30 to automatically remove the dirt from the optical window 12 .
- the vehicle-side ECU 50 Upon reception of a notification that the urgency of dirt removal is “middle”, for example, the vehicle-side ECU 50 causes the display to display thereon a warning that the optical window 12 is dirty, with a low frequency.
- the vehicle-side ECU 50 Upon reception of a notification that the urgency of dirt removal is “low”, for example, the vehicle-side ECU 50 does not perform display of a warning that the optical window 12 is dirty and automatic dirt removal.
- the vehicle-side ECU 50 Based on the notification from the target object detection apparatus 100 , that is, based on the density and extent of the dirt in each of the segment groups Y 1 to Y m or on the entire optical window 12 , or the type of the dirt, the vehicle-side ECU 50 takes appropriate measures. For example, the vehicle-side ECU 50 changes the details of the warning displayed on the display. Alternatively, the vehicle-side ECU 50 changes a dirt removing method by the cleaning apparatus, such as an amount of cleaning fluid to be jetted from the cleaning apparatus.
- the dirt detector 1 b detects, based on light reception signals output from the PD module 7 , dirt levels in units of segments X 1 to X n in the detection field-of-view F of the target object detection apparatus 100 fronting on the predetermined range E, where the target object detection apparatus 100 detects the target object Q, through the optical window 12 .
- the dirt detector 1 b then detects a density and an extent of dirt, based on the dirt levels. Therefore, the dirt detector 1 b closely detects a state of dirt, such as a position of dense dirt and a position of sparse dirt, in the entire detection field-of-view F of the target object detection apparatus 100 , that is, in the entire light transmission region of the optical window 12 .
- the controller 1 notifies the vehicle-side ECU 50 of the state of dirt on the optical window 12 thus closely detected. Based on the notification, the vehicle-side ECU 50 appropriately gives a warning that the optical window 12 is dirty, thereby allowing a user to take appropriate measures against the dirt. For example, the user removes the dirt from the optical window 12 or leaves the dirt as it is. Based on the notification, alternatively, the vehicle-side ECU 50 causes the cleaning apparatus to appropriately clean the dirt off the optical window 12 or leaves the dirt as it is to save the cleaning fluid.
- the LDs sequentially emit laser light, and the light scanner 4 scans the predetermined range E with the laser light.
- the light scanner 4 then deflects the reflected light from the target object Q in the predetermined range E, and any of the PDs receives the reflected light. Therefore, the number of segments X 1 to X n is increased by finely dividing the detection field-of-view F of the target object detection apparatus 100 fronting on the predetermined range E through the optical window 12 .
- the dirt detector 1 b thus closely detects a density and an extent of dirt on the optical window 12 , based on dirt levels in the respective segments X 1 to X n .
- the dirt detector 1 b detects a density and an extent of dirt, based on a sum and an average value of dirt levels, in each of the segment groups Y 1 to Y m .
- Each of the segment groups Y 1 to Y m is a subset of segments adjoining one another.
- the dirt detector 1 b therefore detects whether dense dirt Da or sparse dirt Db adheres to portions of the optical window 12 , the portions corresponding to the segment groups Y 1 to Y m in the detection field-of-view F.
- the dirt detector 1 b closely determines how much dense or sparse dirt extends over the optical window 12 .
- the dirt detector 1 b estimates a type of dirt on the optical window 12 , based on a result of detection as to dirt in each of the segment groups Y 1 to Y m .
- the controller 1 then notifies the vehicle-side ECU 50 of the result of estimation.
- the vehicle-side ECU 50 therefore takes more appropriate measures.
- the vehicle-side ECU 50 changes the details of a warning to be displayed on the display in the vehicle 30 , in accordance with the notified type of the dirt on the optical window 12 .
- the vehicle-side ECU 50 changes a cleaning method by the cleaning apparatus, in accordance with the notified type of the dirt on the optical window 12 .
- the dirt detector 1 b determines urgency of dirt removal, based on a result of detection as to dirt in each of the segment groups Y 1 to Y m .
- the controller 1 then notifies the vehicle-side ECU 50 of the urgency of dirt removal.
- the vehicle-side ECU 50 therefore outputs an appropriate operating command to the display or cleaning apparatus in the vehicle 30 , in accordance with the notified urgency of dirt removal.
- the vehicle-side ECU 50 thus causes the user or cleaning apparatus to take appropriate measures against the dirt on the optical window 12 .
- the controller 1 detects a distance based on a peak of a pulse in light reception signals from the PD module 7 , and determines whether the pulse corresponds to a reflected-light signal based on dense dirt Da or sparse dirt Db, in accordance with the distance; however, the disclosure is not limited thereto.
- the controller 1 may determine whether the pulse corresponds to the reflected-light signal based on the dense dirt Da or sparse dirt Db, in accordance with a peak time of the pulse in the light reception signals, and may detect presence or absence of the dense dirt Da or sparse dirt Db in the corresponding segments X 1 to X n .
- the controller 1 may determine whether the pulse corresponds to the reflected-light signal based on the target object Q, in accordance with a peak time of the pulse in the light reception signals, and may detect presence or absence of the target object Q in the corresponding segments X 1 to X n .
- the controller 1 calculates a dirt level, based on a peak strength of a reflected-light signal based on dense dirt Da or sparse dirt Db; however, the disclosure is not limited thereto.
- the controller 1 may calculate a dirt level, based on a pulse width of the reflected-light signal based on the dense dirt Da or sparse dirt Db, or a combination of the pulse width with an amplitude.
- the controller 1 which is a notifier, causes the interface 10 , which is a notifier, to notify the vehicle-side ECU 50 of results of detection by the dirt detector 1 b , that is, a density of dirt on the optical window 12 , an extent of the dirt, a type of the dirt, and urgency of dirt removal; however, the disclosure is not limited thereto.
- the target object detection apparatus 100 may include a notifier, such as a display, a light emitting diode, or a loud speaker, configured to directly notify a user in a visible or audible manner of at least one of results of detection by the dirt detector 1 b , that is, at least one of a density of dirt on the optical window 12 , an extent of the dirt, a type of the dirt, or urgency of dirt removal.
- a notifier such as a display, a light emitting diode, or a loud speaker, configured to directly notify a user in a visible or audible manner of at least one of results of detection by the dirt detector 1 b , that is, at least one of a density of dirt on the optical window 12 , an extent of the dirt, a type of the dirt, or urgency of dirt removal.
- the dirt detector 1 b determines urgency of dirt removal at three levels of “high”, “middle”, and “low”; however, the disclosure is not limited thereto. In addition to this configuration, for example, the dirt detector 1 b may determine urgency of dirt removal at two levels or at four or more levels, using numerical values.
- the light scanner 4 scans the predetermined range E with the laser light from each LD, and then guides the reflected light from the target object Q in the predetermined range E to each PD; however, the disclosure is not limited thereto.
- the disclosure is applicable to a target object detection apparatus including a light scanner configured to scan a predetermined range with one of laser light emitted from an LD and the reflected light from a target object Q.
- the disclosure is also applicable to a target object detection apparatus including no light scanner.
- the LD module 2 includes eight LDs, and the PD module 7 includes 32 PDs; however, the disclosure is not limited thereto.
- the number of LDs and the number of PDs may be selected as appropriate.
- the LDs and PDs may be arranged in any one direction or any two or more directions rather than the vertical direction Z.
- the target object detection apparatus may include a light emitter including a light emitting element different from that described above, and a light receiver including a light receiving element different from that described above.
- the dirt detector 1 b detects a state of dirt on the optical window 12 serving as a light inlet and a light outlet; however, the disclosure is not limited thereto.
- the target object detection apparatus 100 may include a light-projecting optical window serving as a light outlet and a light-receiving optical window serving as a light inlet, and the dirt detector 1 b may detect a state of dirt on one of the optical windows.
- the disclosure is applied to the target object detection apparatus 100 configured to detect the presence or absence of the target object Q and the distance from the target object detection apparatus 100 to the target object Q.
- the disclosure is also applicable to a target object detection apparatus configured to detect one of presence or absence of a target object and a distance from the target object detection apparatus to the target object.
- the disclosure is applied to the target object detection apparatus 100 to be installed in a vehicle.
- the disclosure is also applicable to a target object detection apparatus for another use.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optics & Photonics (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
In a target object detection apparatus, an LD module projects laser light onto a predetermined range, and a PD module receives the reflected light from a target object, and outputs a light reception signal. Based on the light reception signal, an object detector detects presence or absence of the target object and a distance from the target object detection apparatus to the target object, and a dirt detector detects presence or absence of dirt on an optical window. The dirt detector detects, based on the light reception signal, dirt levels in units of segments in a detection field-of-view of the target object detection apparatus, and also detects a density and an extent of the dirt, based on the dirt levels. A controller causes an interface to notify a vehicle-side ECU of the result of detection as to the dirt.
Description
- This application is based on Japanese Patent Application No. 2018-208555 filed with the Japan Patent Office on Nov. 6, 2018, the entire contents of which are incorporated herein by reference.
- One or more embodiments of the disclosure relate to a target object detection apparatus for projecting and receiving light onto and from a target object to detect presence or absence of the target object and a distance from the target object detection apparatus to the target object. One or more embodiments of the disclosure particularly relate to a technique of detecting dirt on an optical window serving as a light outlet or light inlet of a target object detection apparatus.
- As disclosed in, for example, JP 2012-192775 A, JP 2005-010094 A, and JP 2018-072288 A, a target object detection apparatus such as an on-vehicle laser radar causes a light emitter to project measurement light onto a predetermined range. The target object detection apparatus then causes a light receiver to receive the reflected light from a target object in the predetermined range. The target object detection apparatus thus detects presence or absence of the target object and a distance from the target object detection apparatus to the target object, based on a light reception signal output from the light receiver. The light emitter includes a light emitting element such as a laser diode. The light receiver includes a light receiving element such as a photodiode.
- In the target object detection apparatus, components of an optical system and components of an electrical system are housed in a casing that shields light. The casing has an optical window. The optical window is made of a light transmissive material, such as glass or resin, that allows transmission of light. The optical window serves as a light outlet through which light goes out of the casing or a light inlet through which light enters the casing. The target object detection apparatus is mounted to, for example, a vehicle such that the optical window is directed to a predetermined range where a target object is detected. Measurement light emitted from the light emitter thus transmits through the optical window, and then is projected onto the predetermined range. In addition, the reflected light from the target object in the predetermined range transmits through the optical window, and then is received by the light receiver.
- If the optical window is dirty, the dirt hinders the measurement light from the light emitter from being projected out of the casing, and also hinders the reflected light from the external target object from entering the casing. Because of the dirt, the target object detection apparatus fails to detect the target object. In view of this, for example, JP 2012-192775 A, JP 2005-010094 A, and JP 2018-072288 A each propose a technique of detecting dirt on an optical window.
- A target object detection apparatus disclosed in JP 2012-192775 A changes a direction of laser light emitted from a light emitting element to a vertically downward direction, and detects presence or absence of dirt on an optical window, based on whether a light receiving element detects reflected light from a road surface. Upon detection of the presence of the dirt on the optical window, the target object detection apparatus displays a warning about the presence of the dirt.
- A target object detection apparatus disclosed in JP 2005-010094 A determines that an optical window (apparatus surface) is dirty on condition that, of a plurality of laser light beams emitted from light emitting elements, laser light beams, the number of which is equal to or more than a predetermined number, are high in strength to such an extent that a measurement time from the emission to reception of the corresponding reflected light is shorter than a predetermined time and a pulse of the corresponding reflected light exceeds an upper threshold value. Upon detection of the presence of the dirt on the optical window, the target object detection apparatus displays the presence of the dirt on an abnormality display.
- A target object detection apparatus disclosed in JP 2018-072288 A measures distances from the target object detection apparatus to a target object for each of pixels in a detection field-of-view of the target object detection apparatus fronting on a predetermined range through an optical window. The distances thus measured are stored in a memory. The target object detection apparatus then calculates an area of a pixel group corresponding to a distance from the target object to a surface of the optical window, of the distances stored in the memory. In other words, the target object detection apparatus calculates an area of dirt on the optical window. The target object detection apparatus transmits to a steering system a notification signal for decelerating a vehicle or a notification signal for stopping a vehicle, in accordance with the area thus calculated.
- Upon detection of presence of dirt on an optical window, a target object detection apparatus known in the related art has displayed the presence of the dirt to urge a user to remove the dirt from the optical window. However, even when a small amount of dirt adheres to a part of the optical window to such an extent that the dirt does not exert an adverse influence on detection performance of the target object detection apparatus or even when dirt to be removed naturally by, for example, wind or rain adheres to the optical window, the target object detection apparatus displays the presence of the dirt, which may make the user feel burdensome in some instances. If such minor dirt is manually removed in accordance with the display about the presence of the dirt on the optical window, a wasteful effort is required in some instances. In addition, if the dirt is removed with a cleaning fluid of a vehicle, the cleaning fluid is wasted in some instances. If the target object detection apparatus displays presence of dirt on the optical window each time dirt adheres to the optical window, the user is apt to leave the dirt since the user feels removal of the dirt burdensome. If the left dirt is, for example, dense dirt adhering to substantially the entire optical window, the dirt may continuously exert an adverse influence on the detection performance of the target object detection apparatus.
- One or more embodiments of the disclosure provide a target object detection apparatus capable of closely detecting a state of dirt on an optical window, thereby taking appropriate measures against the dirt on the optical window.
- According to one or more embodiments of the disclosure, a target object detection apparatus includes: a light emitter configured to emit measurement light; a light receiver configured to receive reflected light from a target object in a predetermined range onto which the light emitter projects the measurement light, the light receiver being configured to output a light reception signal according to a light reception state; an object detector configured to detect presence or absence of the target object or a distance from the target object detection apparatus to the target object, based on the light reception signal output from the light receiver; an optical window including a light transmissive material that allows transmission of light and serving as a light outlet for the measurement light or a light inlet for the reflected light; a dirt detector configured to detect presence or absence of dirt on the optical window, based on the light reception signal; and a notifier configured to provide a notification about the presence of the dirt on the optical window. The dirt detector detects, based on the light reception signal output from the light receiver, dirt levels in units of segments in a detection field-of-view of the target object detection apparatus fronting on the predetermined range through the optical window, and detects a density and an extent of the dirt, based on the dirt levels. The notifier provides a notification about a result of detection by the dirt detector as to the dirt.
- According to one or more embodiments of the disclosure, the dirt detector detects, based on a light reception signal output from the light receiver, dirt levels in units of segments in the detection field-of-view of the target object detection apparatus fronting on the predetermined range, where the target object detection apparatus detects the target object, through the optical window. The dirt detector then detects a density and an extent of the dirt, based on the dirt levels. Therefore, the dirt detector closely detects a state of dirt, such as a position of dense dirt and a position of sparse dirt, in the entire detection field-of-view of the target object detection apparatus, that is, in the entire light transmission region of the optical window. The notifier provides a notification about the state of the dirt on the optical window thus closely detected. A user or an external apparatus therefore takes appropriate measures against the dirt. For example, the user or external apparatus removes the dirt from the optical window or leaves the dirt as it is.
- According to one or more embodiments of the disclosure, in the target object detection apparatus, the light emitter may include a plurality of light emitting elements, and the light receiver may include a plurality of light receiving elements. The target object detection apparatus may further include a light scanner configured to scan the predetermined range with the measurement light emitted from each light emitting element or to guide the reflected light to the light receiver.
- According to one or more embodiments of the disclosure, in the target object detection apparatus, the dirt detector may calculate a sum of the dirt levels and an average value of dirt levels in segments where the dirt extends, in each segment group that is a subset of segments adjoining one another, and may detect the density and extent of the dirt, based on the sum and the average value.
- According to one or more embodiments of the disclosure, in the target object detection apparatus, the dirt detector may detect the density and extent of the dirt on the entire optical window, based on a result of detection in each segment group as to the dirt.
- According to one or more embodiments of the disclosure, in the target object detection apparatus, the dirt detector may estimate a type of the dirt, based on a result of detection in each segment group as to the dirt, and the notifier may provide a notification about the type of the dirt estimated by the dirt detector.
- According to one or more embodiments of the disclosure, in the target object detection apparatus, the dirt detector may determine urgency of dirt removal, based on a result of detection in each segment group as to the dirt, and the notifier may provide a notification about the urgency of dirt removal determined by the dirt detector.
- One or more embodiments of the disclosure may provide a target object detection apparatus capable of closely detecting a state of dirt on an optical window, thereby taking appropriate measures against the dirt on the optical window.
-
FIG. 1 is an electrical block diagram of a target object detection apparatus according to one or more embodiments of the disclosure; -
FIG. 2 illustrates an arrangement of LDs and PDs illustrated inFIG. 1 ; -
FIG. 3 is a rear view of an optical system in the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 4A illustrates a light projection path of the optical system in the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 4B illustrates a light reception path of the optical system in the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 5 illustrates a detection field-of-view of the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 6 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated inFIG. 1 and an exemplary light reception signal; -
FIG. 7 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated inFIG. 1 and an exemplary light reception signal; -
FIG. 8 illustrates an exemplary light projection and reception state of the target object detection apparatus illustrated inFIG. 1 and an exemplary light reception signal; -
FIG. 9 is a flowchart of operations of the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 10 illustrates criteria for a density and an extent of dirt to be determined by the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 11A illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 11B illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated inFIG. 1 ; -
FIG. 11C illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated inFIG. 1 ; and -
FIG. 11D illustrates an exemplary density and an exemplary extent of dirt in each segment group in the detection field-of-view of the target object detection apparatus illustrated inFIG. 1 . - Embodiments of the disclosure will be described with reference to the drawings. In the drawings, the identical or equivalent component is designated by the identical numeral. In embodiments of the disclosure, numerous specific details are set forth in order to provide a more through understanding of the invention. However, it will be apparent to one of ordinary skill in the art that the invention may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid obscuring the invention.
-
FIG. 1 is an electrical block diagram of a targetobject detection apparatus 100.FIG. 2 illustrates an arrangement of laser diodes (LDs) and photodiodes (PDs) in the targetobject detection apparatus 100. - The target
object detection apparatus 100 is, for example, an optical laser radar to be installed in avehicle 30 such as a four-wheel automobile. The targetobject detection apparatus 100 detects a target object such as another vehicle, a human, a road (e.g., a road surface), or any object. - The target
object detection apparatus 100 includes acontroller 1, anLD module 2, a chargingcircuit 3, amotor 4 c, amotor drive circuit 5, an encoder 6, aPD module 7, an analog-to-digital converter (ADC) 8, amemory 9, and aninterface 10. - The
controller 1 is constituted of, for example, a central processing unit (CPU), and is configured to control operations of the respective components. Thecontroller 1 includes an object detector 1 a and a dirt detector 1 b. The functions of the object detector 1 a and dirt detector 1 b are respectively implemented by software programs to be executed by the CPU of thecontroller 1. - The
LD module 2 includes, for example, an LD that serves as a light source, and a capacitor that causes the LD to emit light. The LD is a light emitting element that emits a high-power optical pulse.FIG. 1 illustrates one LD and one capacitor in the form of a block for convenience. TheLD module 2 actually includes a plurality of LDs (e.g., LD1 to LD8 illustrated inFIG. 2 ) and a plurality of capacitors (not illustrated inFIG. 2 ) for the respective LDs (i.e., LD1 to LD8). The LDs (i.e., LD1 to LD8) are arranged in a vertical direction Z. In the following, the LDs (i.e., LD1 to LD8) are collectively described as appropriate. TheLD module 2 is an example of a “light emitter” according to one or more embodiments of the disclosure. - The charging
circuit 3 illustrated inFIG. 1 electrically charges the capacitor in theLD module 2.FIG. 1 illustrates onecharging circuit 3 in the form of a block. The targetobject detection apparatus 100 may include a plurality of chargingcircuits 3 in accordance with the number of LDs and the number of capacitors. - The
controller 1 controls the light emitting operation of the LD and the charging operation of the chargingcircuit 3. Specifically, thecontroller 1 causes the LD to emit light, thereby projecting laser light (measurement light) onto a predetermined range. In addition, thecontroller 1 causes the LD to stop the light emission, and also causes the chargingcircuit 3 to electrically charge the capacitor. - The
motor 4 c serves as a drive source for alight scanner 4 to be described later with reference to, for example,FIG. 3 . Themotor drive circuit 5 drives themotor 4 c. The encoder 6 detects rotational states, such as an angle and a rotational speed, of themotor 4 c. Thecontroller 1 causes themotor drive circuit 5 to rotate themotor 4 c, and controls an operation of thelight scanner 4. In addition, thecontroller 1 detects operational states, such as an operation amount and an operating position, of thelight scanner 4, based on an output from the encoder 6. - The
PD module 7 includes, for example, a PD that serves as a light receiving element, a transimpedance amplifier (TIA), a multiplexer (MUX), and a variable gain amplifier (VGA). The details of each circuit are not illustrated in the drawings.FIG. 1 illustrates one PD and one TIA in the form of a block for convenience. ThePD module 7 actually includes a plurality of PDs (e.g., PD1 to PD32 illustrated inFIG. 2 ) and a plurality of TIAs (not illustrated inFIG. 2 ) for the respective PDs (i.e., PD1 to PD32). The PDs (i.e., PD1 to PD32) are arranged in the vertical direction Z. In the example illustrated inFIG. 2 , four PDs (i.e., PD1 to PD4, PD5 to PD8, PD9 to PD12, PD13 to PD16, PD17 to PD20, PD21 to PD24, PD26 to PD28, PD29 to PD32) are provided for each LD (i.e., LD1, LD2, LD3, LD4, LD5, LD6, LD7, LD8). In the following, the PDs (i.e., PD1 to PD32) are collectively described as appropriate. ThePD module 7 is an example of a “light receiver” according to one or more embodiments of the disclosure. - The PD receives light, and outputs a current (light reception signal) according to the light reception state. The TIA converts into a voltage signal the current flowing through the PD, and outputs the voltage signal to the MUX. The MUX selects the output signal from the TIA, and outputs the selected signal to the VGA. The VGA amplifies the output signal from the MUX, and outputs the amplified signal to the
ADC 8. - The
ADC 8 receives the analog signal from the VGA, rapidly converts the analog signal into a digital signal, and outputs the digital signal to thecontroller 1. In thePD module 7, the light reception signal according to the light reception state of the PD is thus subjected to signal processing by each of the TIA, the MUX, and the VGA, and then is output to thecontroller 1 via theADC 8.FIG. 1 illustrates one MUX, one VGA, and oneADC 8 in the form of a block. The targetobject detection apparatus 100 may include a plurality of MUXs, a plurality of VGAs, and a plurality ofADCs 8 in accordance with the number of PDs. - The
controller 1 controls the operations of the respective components in thePD module 7. Specifically, for example, thecontroller 1 causes the LD in theLD module 2 to emit light, thereby projecting laser light onto the predetermined range, and then causes the PD in thePD module 7 to receive reflected light from a target object in the predetermined range. In these operations, thecontroller 1 causes the LDs (i.e., LD1 to LD8 inFIG. 2 ) to sequentially emit light, thereby projecting laser light, and causes the corresponding PDs (i.e., PD1 to PD32 inFIG. 2 ) to sequentially receive the reflected light. Thecontroller 1 then subjects a light reception signal output from each of the PDs (i.e., PD1 to PD32) in accordance with the light reception state to signal processing by each of the TIA and the VGA. Thecontroller 1 also causes theADC 8 to convert the analog light reception signals from thePD module 7 into digital light reception signals. - Based on the digital light reception signals thus converted by the
ADC 8, the object detector 1 a of thecontroller 1 detects presence or absence of the target object and a distance from the targetobject detection apparatus 100 to the target object, and the dirt detector 1 b of thecontroller 1 detects presence or absence of dirt on anoptical window 12 to be described later with reference to, for example,FIG. 4A . - The
memory 9 is a volatile memory or a nonvolatile memory. Thememory 9 stores therein, for example, information for thecontroller 1 in controlling the respective components of the targetobject detection apparatus 100, and information for thecontroller 1 in detecting a target object. Thememory 9 also stores therein a result of detection by the dirt detector 1 b of thecontroller 1 as to dirt on theoptical window 12. - The
interface 10 includes a communication circuit for establishing communications with a vehicle-side electronic control unit (ECU) 50. Thecontroller 1 transmits and receives various kinds of control information to and from the vehicle-side ECU 50 via theinterface 10. In addition, thecontroller 1 transmits a result of detection by the object detector 1 a and a result of detection by the dirt detector 1 b. Each of thecontroller 1 and theinterface 10 is an example of a “notifier” according to one or more embodiments of the disclosure. - The vehicle-
side ECU 50 receives a result of detection as to a target object from the targetobject detection apparatus 100, and controls an operation of, for example, an on-vehicle device (not illustrated) in a steering system installed in thevehicle 30, based on the result of detection. The vehicle-side ECU 50 thus causes thevehicle 30 to travel and stop. In addition, the vehicle-side ECU 50 receives a result of detection as to dirt on theoptical window 12 from the targetobject detection apparatus 100, and transmits an operation command to the on-vehicle device, based on the result of detection. - Specifically, for example, the vehicle-
side ECU 50 transmits a dirt warning command to a display (not illustrated) mounted to a cabin of thevehicle 30. The display thus displays thereon a warning that theoptical window 12 is dirty, and a state of dirt on theoptical window 12 to prompt a user to take appropriate measures, such as removal, against the dirt. Alternatively, for example, the vehicle-side ECU 50 transmits a dirt cleaning command to a cleaning apparatus (not illustrated) installed in thevehicle 30. The cleaning apparatus thus jets a cleaning fluid onto theoptical window 12 to remove the dirt from theoptical window 12. -
FIG. 3 is a rear view of an optical system in the targetobject detection apparatus 100.FIG. 4A illustrates a light projection path of the optical system in the targetobject detection apparatus 100.FIG. 4B illustrates a light reception path of the optical system in the targetobject detection apparatus 100. -
FIGS. 4A and 4B each illustrate the interior of the targetobject detection apparatus 100 seen from above.FIG. 3 illustrates the interior of the targetobject detection apparatus 100 seen from the rear (from below inFIG. 4A ). - A
casing 11 is formed in a box shape, and is made of synthetic resin that blocks transmission of light. As illustrated inFIGS. 4A and 4B , thecasing 11 has in its front side theoptical window 12. Theoptical window 12 is made of a light transmissive material, such as synthetic resin or glass, that permits transmission of light. Theoptical window 12 serves as a light inlet through which light enters thecasing 11 and a light outlet through which light goes out of thecasing 11. - The target
object detection apparatus 100 is mounted on the front, rear, left, or right side of thevehicle 30 such that theoptical window 12 is directed forward, rearward, leftward, or rightward of thevehicle 30, and the shorter edge of thecasing 11 and the vertical direction (heightwise direction) Z become parallel. - As illustrated in
FIGS. 3, 4A, and 4B , thecasing 11 accommodates therein optical system components such as theLD module 2, alight projecting lens 14, thelight scanner 4, a reflectingmirror 15, alight receiving lens 16, a reflectingmirror 17, and thePD module 7. Of the optical system components, theLD module 2, themotor 4 c of thelight scanner 4, and thePD module 7 are electronic components to be electrically driven. Thecasing 11 also accommodates therein other electronic components illustrated inFIG. 1 . It should be noted thatFIG. 4B does not illustrate theLD module 2, thelight projecting lens 14, alight projecting mirror 4 a (to be described later) of thelight scanner 4, and themotor 4 c of thelight scanner 4. - The LD of the
LD module 2, thelight projecting lens 14, and thelight scanner 4 constitute a light-projecting optical system. Thelight scanner 4, the reflectingmirror 15, the reflectingmirror 17, thelight receiving lens 16, and the PD of thePD module 7 constitute a light-receiving optical system. As illustrated inFIG. 3 , alight shielding plate 18 is disposed between the light-projecting optical system and the light-receiving optical system in order to prevent interference of light. Thelight shielding plate 18 is not illustrated inFIGS. 4A and 4B . TheLD module 2, thelight projecting lens 14, themotor 4 c of thelight scanner 4, the reflectingmirror 15, thelight receiving lens 16, the reflectingmirror 17, thePD module 7, and thelight shielding plate 18 are fixedly disposed in thecasing 11. - As illustrated in
FIG. 3 , theLD module 2 is disposed on an upper side of the targetobject detection apparatus 100 at a center of the targetobject detection apparatus 100. Thelight projecting lens 14 is disposed on the light emission side of the LD in theLD module 2. InFIGS. 3, 4A, and 4B , thelight projecting lens 14 is disposed on the left side of theLD module 2. Thelight scanner 4 is disposed opposite theLD module 2 with respect to thelight projecting lens 14. - The
light scanner 4, which is also referred to as a light deflector, includes, for example, thelight projecting mirror 4 a, alight receiving mirror 4 b, and themotor 4 c. Themotor 4 c is a brushless motor. As illustrated inFIGS. 4A and 4B , themotor 4 c has a pivot 4 j. Thelight projecting mirror 4 a is coupled to an upper end of the pivot 4 j. In addition, thelight receiving mirror 4 b is coupled to a lower end of the pivot 4 j. Each of thelight projecting mirror 4 a and thelight receiving mirror 4 b is a double-sided mirror formed in a plate shape. In other words, each of thelight projecting mirror 4 a and thelight receiving mirror 4 b has two plate planes each formed as a reflection plane. Thelight projecting mirror 4 a and thelight receiving mirror 4 b rotate in conjunction with the pivot 4 j of themotor 4 c. The pivot 4 j of themotor 4 c is disposed in parallel with the vertical direction Z. - The
PD module 7 is disposed on a lower side of the targetobject detection apparatus 100 at the center of the targetobject detection apparatus 100. The reflectingmirror 15, thelight receiving lens 16, and the reflectingmirror 17 are disposed opposite thelight scanner 4 with respect to thePD module 7. ThePD module 7, the reflectingmirror 15, thelight receiving lens 16, and the reflectingmirror 17 are disposed below theLD module 2. - The reflecting
mirror 17 is disposed on the light reception side of the PD in thePD module 7. InFIGS. 3, 4A, and 4B , the reflectingmirror 17 is disposed on the right side of thePD module 7. In addition, the reflectingmirror 17 is inclined at a predetermined angle. The reflectingmirror 15 is disposed forward of the reflectingmirror 17. In other words, the reflectingmirror 15 is disposed closer to theoptical window 12 than the reflectingmirror 17 is. In addition, the reflectingmirror 15 is inclined at a predetermined angle. Thelight receiving lens 16 is disposed between the reflectingmirror 17 and the reflectingmirror 15. - In
FIG. 4A , an alternate long and short dash arrow indicates the light projection path of the light-projecting optical system. First, the LD in theLD module 2 emits light. The light is adjusted as to its expansion by thelight projecting lens 14, and then reaches thelight projecting mirror 4 a of thelight scanner 4. At this time, themotor 4 c rotates to change an angle (orientation) of thelight projecting mirror 4 a, so that one of the reflection planes of thelight projecting mirror 4 a is directed toward the predetermined range E. The light from the LD transmits through thelight projecting lens 14, and then is reflected at thelight projecting mirror 4 a. The light from the LD thus transmits through almost the upper half of theoptical window 12, and then is projected onto the external predetermined range E. - In
FIGS. 4A and 4B , a hatched portion indicates the predetermined range E corresponding to a range near the targetobject detection apparatus 100 in a range to be scanned by the targetobject detection apparatus 100 with light projected onto and received from the range. Since the pivot 4 j of thelight projecting mirror 4 a andlight receiving mirror 4 b is disposed in parallel with the vertical direction Z, thelight scanner 4 scans the predetermined range E with laser light and the reflected light in a predetermined angular range θ within a horizontal plane. In addition, since the plurality of LDs and the plurality of PDs are arranged in the vertical direction Z, the laser light and the reflected light are projected and received in a predetermined angular range within a vertical plane. - As illustrated in
FIG. 4A , when a target object Q is in the predetermined range E, light projected from the targetobject detection apparatus 100 onto the predetermined range E is reflected from the target object Q. InFIG. 4B , an alternate long and two short dashes arrow indicates the light reception path of the light-receiving optical system in the targetobject detection apparatus 100 in receiving the reflected light from the target object Q. - As illustrated in
FIG. 4B , the light from the targetobject detection apparatus 100 is reflected from the target object Q. The reflected light from the target object Q transmits through theoptical window 12, and then reaches thelight receiving mirror 4 b of thelight scanner 4. At this time, themotor 4 c rotates to change an angle (orientation) of the reflection planes of thelight receiving mirror 4 b, so that one of the reflection planes of thelight receiving mirror 4 b is directed toward the predetermined range E. The reflected light from the target object Q thus transmits through almost the lower half of theoptical window 12, is reflected by thelight receiving mirror 4 b, and is guided to the reflectingmirror 15. In other words, thelight scanner 4 deflects toward the reflectingmirror 15 the reflected light from the target object Q in the predetermined range E. The reflected light, which is guided to the reflectingmirror 15 by thelight scanner 4, is reflected at the reflectingmirror 15 to enter thelight receiving lens 16. The reflected light is condensed and adjusted by thelight receiving lens 16, and then is reflected at the reflectingmirror 17. Thereafter, the reflected light is received by the PD in thePD module 7. - The PD outputs a light reception signal in accordance with the reflected light reception state. The light reception signal is subjected to signal processing by each of the
PD module 7 and theADC 8. Based on the light reception signal thus subjected to signal processing, the object detector 1 a of thecontroller 1 detects presence or absence of the target object Q and a distance from the targetobject detection apparatus 100 to the target object Q. -
FIG. 5 illustrates a detection field-of-view F of the targetobject detection apparatus 100. - The detection field-of-view F illustrated in
FIG. 5 is a field of view of the targetobject detection apparatus 100 in the predetermined range E where the targetobject detection apparatus 100 detects the target object Q. The detection field-of-view F corresponds to a light transmission region of theoptical window 12 where laser light and the reflected light are transmittable. The detection field-of-view F is divided into segments X1 to Xn arranged in a grid form. The targetobject detection apparatus 100 projects laser light in units of segments X1 to Xn, and receives the reflected light in units of segments X1 to Xn. ThePD module 7 outputs light reception signals in units of segments X1 to Xn. Based on the light reception signals, thecontroller 1 detects presence or absence of the target object Q and a distance from the targetobject detection apparatus 100 to the target object Q. Thecontroller 1 also detects presence or absence of dirt on theoptical window 12. In addition, thecontroller 1 makes a determination as to a state of dirt on theoptical window 12 in units of segment groups Y1 to Ym each of which is a subset of segments adjoining one another. In the example illustrated inFIG. 5 , each of the segment groups Y1 to Ym consists of t (t<n) segments arranged in a matrix. -
FIGS. 6, 7, and 8 each illustrate an exemplary light projection and reception state of the targetobject detection apparatus 100 and an exemplary light reception signal. - In
FIGS. 6 to 8 , upper schematic diagrams (a) each illustrate the optical system in the targetobject detection apparatus 100 seen sideways; however, the reflectingmirror 15, the reflectingmirror 17, and thelight shielding plate 18 are not illustrated inFIGS. 6 to 8 . Also inFIGS. 6 to 8 , lower graphs (b) each illustrate a change in light reception signal output from thePD module 7. In each of the graphs, the horizontal axis represents a time, and the vertical axis represents a signal strength. - As illustrated in (a) of
FIG. 6 , when theoptical window 12 is not dirty, laser light emitted from the LD in theLD module 2 passes through thelight projecting lens 14 and thelight projecting mirror 4 a of thelight scanner 4, and then transmits through theoptical window 12. The laser light is thus projected onto the predetermined range E illustrated inFIG. 4A . Next, the reflected light from the target object Q in the predetermined range E transmits through theoptical window 12, and then passes through, for example, thelight receiving mirror 4 b of thelight scanner 4 and thelight receiving lens 16. The reflected light is thus received by the PD in thePD module 7. In this case, as illustrated in (b) ofFIG. 6 , light reception signals to be output from thePD module 7 include a pulsewise reflected-light signal based on the target object Q. - As illustrated in (a) of
FIG. 7 , when dense dirt Da adheres to theoptical window 12, laser light from the LD in theLD module 2 passes through thelight projecting lens 14 and thelight projecting mirror 4 a of thelight scanner 4, and then transmits through theoptical window 12; however, the laser light fails to transmit through the dense dirt Da. Consequently, the laser light is not projected onto the predetermined range E illustrated inFIG. 4A . Since the laser light is irregularly reflected at theoptical window 12 and the dense dirt Da, the reflected light passes through, for example, thelight receiving mirror 4 b of thelight scanner 4 and thelight receiving lens 16, and then is received by the PD in thePD module 7. In this case, as illustrated in (b) ofFIG. 7 , light reception signals to be output from thePD module 7 include a pulsewise reflected-light signal based on the dense dirt Da. - As illustrated in (a) of
FIG. 8 , when sparse dirt Db adheres to theoptical window 12, laser light from the LD in theLD module 2 passes through thelight projecting lens 14 and thelight projecting mirror 4 a of thelight scanner 4, and then part of the laser light is irregularly reflected at theoptical window 12 and the sparse dirt Db. The reflected light passes through, for example, thelight receiving mirror 4 b of thelight scanner 4 and thelight receiving lens 16, and is received by the PD in thePD module 7. Another part of the laser light transmits through theoptical window 12, and is projected onto the predetermined range E illustrated inFIG. 4A . When the part of the laser light reaches the target object Q, the reflected light from the target object Q transmits through theoptical window 12, and then passes through, for example, thelight receiving mirror 4 b of thelight scanner 4 and thelight receiving lens 16. The reflected light is then received by the PD in thePD module 7. In this case, as illustrated in (b) ofFIG. 8 , light reception signals to be output from thePD module 7 include a pulsewise reflected-light signal based on the sparse dirt Db and a pulsewise reflected-light signal based on the target object Q. - Even when sparse dirt Db and dense dirt Da adhere to a part of the
optical window 12, laser light and the reflected light are projected and received in a manner similar to that described above, and light reception signals include a reflected-light signal based on the dense dirt Da, a reflected-light signal based on the sparse dirt Db, and a reflected-light signal based on the target object Q. - The
controller 1 detects peaks of pulses in light reception signals output from thePD module 7 in units of segments X1 to Xn illustrated inFIG. 5 . At this time, thecontroller 1 detects a peak strength and a peak time as to each pulse, and stores the detected strength and time in thememory 9 as necessary. Thecontroller 1 detects as a reflected-light signal a pulse having a peak strength that is equal to or more than a predetermined threshold value S (see (b) ofFIG. 6 , (b) ofFIG. 7 , (b) ofFIG. 8 ). Thecontroller 1 also detects as a reflected-light reception time a time at which the reflected-light signal reaches its peak value. - The object detector 1 a calculates a period of time from a time, at which laser light as a source of the reflected-light signal detected by the
controller 1 is projected, to the reflected-light reception time (i.e., a time of flight (TOF) of light), and also calculates a distance based on the time of flight, by the TOF method. When the distance is longer than a predetermined distance corresponding to a surface of theoptical window 12, the object detector 1 a determines that the target object Q is in the predetermined range E. The object detector 1 a defines the distance as a distance from the targetobject detection apparatus 100 to the target object Q, and records the distance in thememory 9 with the distance correlated with the segments X1 to Xn. - When the distance detected by the object detector 1 a is equal to or less than the predetermined distance, the dirt detector 1 b determines that the
optical window 12 is dirty. The dirt detector 1 b reads from the memory 9 a peak strength of the reflected-light signal in calculating the distance, detects a dirt level based on the peak strength, and records the dirt level in thememory 9 with the dirt level correlated with the segments X1 to Xn. At this time, since the peak strength corresponds to an amount of received reflected light, the dirt detector 1 b may calculate the dirt level, based on the peak strength and a predetermined operational expression. Alternatively, the dirt detector 1 b may define the peak strength as the dirt level. - Light reception signals, from which pulses whose peak strengths are equal to or more than the predetermined threshold value S are not detected, include none of the reflected-light signal based on the target object Q, the reflected-light signal based on the dense dirt Da, and the reflected-light signal based on the sparse dirt Db. Therefore, the object detector 1 a determines that no target object is in the predetermined range E, and the dirt detector 1 b determines that the
optical window 12 is not dirty. In this case, the object detector 1 a does not detect the distance. In other words, the object detector 1 a does not detect the distance from the targetobject detection apparatus 100 to the target object Q. However, the dirt detector 1 b detects a dirt level, based on a signal strength of the light reception signal at a predetermined time Ta (see (b) ofFIG. 6 , (b) ofFIG. 7 , (b) ofFIG. 8 ), and records the dirt level in thememory 9 with the dirt level correlated with the segments X1 to Xn. The predetermined time Ta is set at, for example, a time from emission of laser light from the LD to reception, by the PD, of the reflected light from the surface of theoptical window 12. - If one or more pulses whose peak strengths are equal to or more than the predetermined threshold value S are detected from the light reception signals, but all the distances calculated by the object detector 1 a based on peak times of the respective pulses are longer than the predetermined distance, the light reception signals include only a reflected-light signal based on the target object Q as illustrated in (b) of
FIG. 6 . In this case, the object detector 1 a determines that the target object Q is in the predetermined range E, and the dirt detector 1 b determines that theoptical window 12 is not dirty. The dirt detector 1 b detects a dirt level, based on the signal strength of the light reception signal at the predetermined time Ta, and records the detected dirt level in thememory 9 with the dirt level correlated with the segments X1 to Xn. - If one or more pulses whose peak strengths are equal to or more than the predetermined threshold value S are detected from the light reception signals, but all the distances calculated by the object detector 1 a based on peak times of the respective pulses are equal to or less than the predetermined distance, the light reception signals include only a reflected-light signal based on dirt as illustrated in (b) of
FIG. 7 . In this case, the dirt detector 1 b determines that theoptical window 12 is dirty, and the object detector 1 a determines that no target object is in the predetermined range E. Therefore, the distance calculated by the object detector 1 a is not recorded as a distance from the targetobject detection apparatus 100 to the target object Q. - If the light reception signals include a reflected-light signal based on the target object Q and a reflected-light signal based on dirt as illustrated in (b) of
FIG. 8 , the object detector 1 a determines that the target object Q is in the predetermined range E, and records the distance from the targetobject detection apparatus 100 to the target object Q in thememory 9. In addition, the dirt detector 1 b determines that theoptical window 12 is dirty, and records the dirt level in thememory 9. -
FIG. 9 is a flowchart of the operations of the targetobject detection apparatus 100. - In step S1 illustrated in
FIG. 9 , first, thecontroller 1 controls, for example, theLD module 2, thePD module 7, and thelight scanner 4 to perform the operation of projecting and receiving light onto and from the predetermined range E. Specifically, thecontroller 1 rotates thelight projecting mirror 4 a andlight receiving mirror 4 b of thelight scanner 4, and causes the LDs in theLD module 2 to sequentially emit light. Thecontroller 1 then causes thelight projecting mirror 4 a to reflect laser light from each LD, thereby projecting the laser light onto the predetermined range E. Thecontroller 1 then causes thelight receiving mirror 4 b to reflect the reflected light from the target object Q, the dense dirt Da, or the sparse dirt Db, and also causes the PDs in thePD module 7 to sequentially receive the reflected light. Thecontroller 1 then subjects a light reception signal output from each PD to signal processing by each of the TIA, the MUX, the VGA, and theADC 8. - In step S2 illustrated in
FIG. 9 , next, thecontroller 1 detects a reflected-light signal, based on light reception signals output from thePD module 7 in units of segments X1 to Xn in the detection field-of-view F (see FIG. 5), and the object detector 1 a calculates distances in units of segments X1 to Xn. In step S3 illustrated inFIG. 9 , based on all the distances thus calculated in units of segments X1 to Xn, the object detector 1 a detects presence or absence of the target object Q and distances from the targetobject detection apparatus 100 to the target object Q in units of segments X1 to Xn, and records the results of detection in thememory 9. In step S4 illustrated inFIG. 9 , thecontroller 1 causes theinterface 10 to notify the vehicle-side ECU 50 of the results of detection as to the target object Q. - In step S5 illustrated in
FIG. 9 , based on the reflected-light signal detected by thecontroller 1 and the distances calculated by the object detector 1 a, the dirt detector 1 b detects presence or absence of dirt and dirt levels in units of segments X1 to Xn, and records the results of detection in thememory 9. In step S6 illustrated inFIG. 9 , next, the dirt detector 1 b calculates a sum and an average value of the dirt levels in each of the segment groups Y1 to Ym illustrated inFIG. 5 . Specifically, the dirt detector 1 b calculates a sum, that is, a total value of the dirt levels in all the segments in each of the segment groups Y1 to Ym, and calculates an average value of dirt levels in segments where the dirt extends. - In step S7 illustrated in
FIG. 9 , next, the dirt detector 1 b detects a density and an extent of the dirt in each of the segment groups Y1 to Ym, based on the sum of the dirt levels, the average value of the dirt levels, and a predetermined criterion, and records the results of detection in thememory 9. -
FIG. 10 illustrates criteria for a density and an extent of dirt to be determined by the targetobject detection apparatus 100. Thememory 9 previously stores therein information on the criteria illustrated inFIG. 10 . - In step S7 illustrated in
FIG. 9 , when the sum of the dirt levels in each of the segment groups Y1 to Ym is smaller than a predetermined value U and the average value of the dirt levels in each of the segment groups Y1 to Ym is smaller than a predetermined value V as illustrated inFIG. 10 , the dirt detector 1 b determines that sparse dirt Db is present in some of the segment groups Y1 to Ym or determines that dense dirt Da and sparse dirt Db are absent in the segment groups Y1 to Ym. When the sum of the dirt levels in each of the segment groups Y1 to Ym is smaller than the predetermined value U and the average value of the dirt levels in each of the segment groups Y1 to Ym is equal to or more than the predetermined value V, the dirt detector 1 b determines that dense dirt Da is present in some of the segment groups Y1 to Ym. When the sum of the dirt levels in each of the segment groups Y1 to Ym is equal to or more than the predetermined value U and the average value of the dirt levels in each of the segment groups Y1 to Ym is smaller than the predetermined value V, the dirt detector 1 b determines that sparse dirt Db is present in all the segment groups Y1 to Ym. When the sum of the dirt levels in each of the segment groups Y1 to Ym is equal to or more than the predetermined value U and the average value of the dirt levels in each of the segment groups Y1 to Ym is equal to or more than the predetermined value V, the dirt detector 1 b determines that dense dirt Da is present in all the segment groups Y1 to Ym. - In step S8 illustrated in
FIG. 9 , next, the dirt detector 1 b detects a density and an extent of the dirt on the entireoptical window 12, based on the results of detection as to the dirt in each of the segment groups Y1 to Ym. In step S9 illustrated inFIG. 9 , next, the dirt detector 1 b estimates a type of the dirt on theoptical window 12, based on the results of detection. -
FIGS. 11A to 11D each illustrate an exemplary density and an exemplary extent of dirt in each of the segment groups Y1 to Ym in the detection field-of-view F of the targetobject detection apparatus 100. - In
FIGS. 11A to 11D , a segment group where dense dirt Da entirely extends is cross-hatched. A segment group where sparse dirt Db entirely extends is hatched with lines slanted upward to the right with wide pitches. A segment group where dense dirt Da partially extends is hatched with lines slanted upward to the left with narrow pitches. A segment group where sparse dirt Db partially extends or where dense dirt Da and sparse dirt Db are absent is not hatched. The same things may hold true forFIG. 10 . - As illustrated in
FIG. 11A , when most (e.g., at least 80 to 90%) of the segment groups in the detection field-of-view F are segment groups that are not hatched, that is, segment groups where sparse dirt partially extends or dirt is absent, and the segment groups in the detection field-of-view F include no segment groups that are cross-hatched, that is, no segment groups where dense dirt entirely extends, the dirt detector 1 b determines in step S8 illustrated inFIG. 9 that sparse dirt Db adheres to a considerably small part of theoptical window 12 or almost no dirt adheres to theoptical window 12, and then estimates in step S9 illustrated inFIG. 9 that the dirt on theoptical window 12 is “sparse mud” or “ignorable dirt”. - As illustrated in
FIG. 11B , when some of the segment groups in the detection field-of-view F are segment groups that are cross-hatched, that is, segment groups where dense dirt entirely extends, the dirt detector 1 b determines in step S8 illustrated inFIG. 9 that dense dirt Da adheres to a part of theoptical window 12, and estimates in step S9 illustrated inFIG. 9 that the dirt on theoptical window 12 is “bug”. As illustrated inFIG. 11B , when the segment groups in the detection field-of-view F include segment groups that are cross-hatched, that is, segment groups where dense dirt entirely extends, at a center of the detection field-of-view F, the dirt detector 1 b estimates in step S9 illustrated inFIG. 9 that the dirt on theoptical window 12 is “problematic dirt”. - As illustrated in
FIG. 11C , when at least 50% of all the segment groups Y1 to Ym in the detection field-of-view F are segment groups that are hatched with lines slanted upward to the right, that is, segment groups where sparse dirt entirely extends, the dirt detector 1 b determines in step S8 illustrated inFIG. 9 that sparse dirt Db adheres to the entireoptical window 12, and estimates in step S9 illustrated inFIG. 9 that the dirt on theoptical window 12 is “sparse mud” or “problematic dirt”. - As illustrated in
FIG. 11D , when at least 50% of all the segment groups Y1 to Ym in the detection field-of-view F are segment groups that are cross-hatched, that is, segment groups where dense dirt entirely extends, the dirt detector 1 b determines in step S8 illustrated inFIG. 9 that dense dirt Da adheres to the entireoptical window 12, and estimates in step S9 illustrated inFIG. 9 that the dirt on theoptical window 12 is “dense mud” and “very problematic dirt”. - The
memory 9 previously stores therein information (criteria) for estimating a type of dirt as described above. With regard to a dirt pattern except for those illustrated inFIGS. 11A to 11D , the dirt detector 1 b determines a density and an extent of dirt on the entireoptical window 12, and estimates a type of the dirt. - In step S10 illustrated in
FIG. 9 , next, the dirt detector 1 b determines urgency of dirt removal as to theoptical window 12, based on the results of detection as to the dirt in each of the segment groups Y1 to Ym. - As illustrated in
FIG. 11A , when the dirt on theoptical window 12 is “sparse mud” or “ignorable dirt”, the dirt detector 1 b determines in step S10 illustrated inFIG. 9 that the urgency of dirt removal is “low”. - As illustrated in
FIG. 11B , when the dirt on theoptical window 12 is “bug” or “problematic dirt”, the dirt detector 1 b determines in step S10 illustrated inFIG. 9 that the urgency of dirt removal is “high”. Although not illustrated in the drawings, when the segment groups in the detection field-of-view F include segment groups that are cross-hatched, that is, segment groups where dense dirt entirely extends, at an end of the detection field-of-view F, the dirt detector 1 b determines in step S10 illustrated inFIG. 9 that the urgency of dirt removal is “low”. - As illustrated in
FIG. 11C , when the dirt on theoptical window 12 is “sparse mud” or “problematic dirt”, the dirt detector 1 b determines in step S10 illustrated inFIG. 9 that the urgency of dirt removal is “middle”. As illustrated inFIG. 11D , when the dirt on theoptical window 12 is “dense mud” or “very problematic dirt”, the dirt detector 1 b determines in step S10 illustrated inFIG. 9 that the urgency of dirt removal is “high”. - Upon completion of the processing for dirt (steps S5 to S10 in
FIG. 9 ) performed by the dirt detector 1 b, in step S11 illustrated inFIG. 9 , thecontroller 1 causes theinterface 10 to notify the vehicle-side ECU 50 of the results of detection by the dirt detector 1 b as to dirt. Specifically, theinterface 10 notifies the vehicle-side ECU 50 of the density and extent of the dirt in each of the segment groups Y1 to Ym, the density and extent of the dirt on the entireoptical window 12, the type of the dirt, and the urgency of dirt removal, which are detected by the dirt detector 1 b in steps S7 to S10 illustrated inFIG. 9 . - Upon reception of a notification that the urgency of dirt removal is “high”, from the target
object detection apparatus 100, for example, the vehicle-side ECU 50 causes the display in thevehicle 30 to display thereon a warning that theoptical window 12 is dirty, with a high frequency or causes the cleaning apparatus in thevehicle 30 to automatically remove the dirt from theoptical window 12. Upon reception of a notification that the urgency of dirt removal is “middle”, for example, the vehicle-side ECU 50 causes the display to display thereon a warning that theoptical window 12 is dirty, with a low frequency. - Upon reception of a notification that the urgency of dirt removal is “low”, for example, the vehicle-
side ECU 50 does not perform display of a warning that theoptical window 12 is dirty and automatic dirt removal. - Based on the notification from the target
object detection apparatus 100, that is, based on the density and extent of the dirt in each of the segment groups Y1 to Ym or on the entireoptical window 12, or the type of the dirt, the vehicle-side ECU 50 takes appropriate measures. For example, the vehicle-side ECU 50 changes the details of the warning displayed on the display. Alternatively, the vehicle-side ECU 50 changes a dirt removing method by the cleaning apparatus, such as an amount of cleaning fluid to be jetted from the cleaning apparatus. - According to one or more embodiments of the disclosure, the dirt detector 1 b detects, based on light reception signals output from the
PD module 7, dirt levels in units of segments X1 to Xn in the detection field-of-view F of the targetobject detection apparatus 100 fronting on the predetermined range E, where the targetobject detection apparatus 100 detects the target object Q, through theoptical window 12. The dirt detector 1 b then detects a density and an extent of dirt, based on the dirt levels. Therefore, the dirt detector 1 b closely detects a state of dirt, such as a position of dense dirt and a position of sparse dirt, in the entire detection field-of-view F of the targetobject detection apparatus 100, that is, in the entire light transmission region of theoptical window 12. Thecontroller 1 notifies the vehicle-side ECU 50 of the state of dirt on theoptical window 12 thus closely detected. Based on the notification, the vehicle-side ECU 50 appropriately gives a warning that theoptical window 12 is dirty, thereby allowing a user to take appropriate measures against the dirt. For example, the user removes the dirt from theoptical window 12 or leaves the dirt as it is. Based on the notification, alternatively, the vehicle-side ECU 50 causes the cleaning apparatus to appropriately clean the dirt off theoptical window 12 or leaves the dirt as it is to save the cleaning fluid. - According to one or more embodiments of the disclosure, the LDs sequentially emit laser light, and the
light scanner 4 scans the predetermined range E with the laser light. Thelight scanner 4 then deflects the reflected light from the target object Q in the predetermined range E, and any of the PDs receives the reflected light. Therefore, the number of segments X1 to Xn is increased by finely dividing the detection field-of-view F of the targetobject detection apparatus 100 fronting on the predetermined range E through theoptical window 12. The dirt detector 1 b thus closely detects a density and an extent of dirt on theoptical window 12, based on dirt levels in the respective segments X1 to Xn. - According to one or more embodiments of the disclosure, the dirt detector 1 b detects a density and an extent of dirt, based on a sum and an average value of dirt levels, in each of the segment groups Y1 to Ym. Each of the segment groups Y1 to Ym is a subset of segments adjoining one another. The dirt detector 1 b therefore detects whether dense dirt Da or sparse dirt Db adheres to portions of the
optical window 12, the portions corresponding to the segment groups Y1 to Ym in the detection field-of-view F. In addition, the dirt detector 1 b closely determines how much dense or sparse dirt extends over theoptical window 12. - According to one or more embodiments of the disclosure, the dirt detector 1 b estimates a type of dirt on the
optical window 12, based on a result of detection as to dirt in each of the segment groups Y1 to Ym. Thecontroller 1 then notifies the vehicle-side ECU 50 of the result of estimation. The vehicle-side ECU 50 therefore takes more appropriate measures. For example, the vehicle-side ECU 50 changes the details of a warning to be displayed on the display in thevehicle 30, in accordance with the notified type of the dirt on theoptical window 12. Alternatively, the vehicle-side ECU 50 changes a cleaning method by the cleaning apparatus, in accordance with the notified type of the dirt on theoptical window 12. - According to one or more embodiments of the disclosure, the dirt detector 1 b determines urgency of dirt removal, based on a result of detection as to dirt in each of the segment groups Y1 to Ym. The
controller 1 then notifies the vehicle-side ECU 50 of the urgency of dirt removal. The vehicle-side ECU 50 therefore outputs an appropriate operating command to the display or cleaning apparatus in thevehicle 30, in accordance with the notified urgency of dirt removal. The vehicle-side ECU 50 thus causes the user or cleaning apparatus to take appropriate measures against the dirt on theoptical window 12. - One or more embodiments of the disclosure may be modified as follows. According to one or more embodiments of the disclosure, the
controller 1 detects a distance based on a peak of a pulse in light reception signals from thePD module 7, and determines whether the pulse corresponds to a reflected-light signal based on dense dirt Da or sparse dirt Db, in accordance with the distance; however, the disclosure is not limited thereto. In addition to this configuration, for example, thecontroller 1 may determine whether the pulse corresponds to the reflected-light signal based on the dense dirt Da or sparse dirt Db, in accordance with a peak time of the pulse in the light reception signals, and may detect presence or absence of the dense dirt Da or sparse dirt Db in the corresponding segments X1 to Xn. Alternatively, thecontroller 1 may determine whether the pulse corresponds to the reflected-light signal based on the target object Q, in accordance with a peak time of the pulse in the light reception signals, and may detect presence or absence of the target object Q in the corresponding segments X1 to Xn. - According to one or more embodiments of the disclosure, the
controller 1 calculates a dirt level, based on a peak strength of a reflected-light signal based on dense dirt Da or sparse dirt Db; however, the disclosure is not limited thereto. In addition to this configuration, for example, thecontroller 1 may calculate a dirt level, based on a pulse width of the reflected-light signal based on the dense dirt Da or sparse dirt Db, or a combination of the pulse width with an amplitude. - According to one or more embodiments of the disclosure, the
controller 1, which is a notifier, causes theinterface 10, which is a notifier, to notify the vehicle-side ECU 50 of results of detection by the dirt detector 1 b, that is, a density of dirt on theoptical window 12, an extent of the dirt, a type of the dirt, and urgency of dirt removal; however, the disclosure is not limited thereto. In addition to this configuration, for example, the targetobject detection apparatus 100 may include a notifier, such as a display, a light emitting diode, or a loud speaker, configured to directly notify a user in a visible or audible manner of at least one of results of detection by the dirt detector 1 b, that is, at least one of a density of dirt on theoptical window 12, an extent of the dirt, a type of the dirt, or urgency of dirt removal. - According to one or more embodiments of the disclosure, the dirt detector 1 b determines urgency of dirt removal at three levels of “high”, “middle”, and “low”; however, the disclosure is not limited thereto. In addition to this configuration, for example, the dirt detector 1 b may determine urgency of dirt removal at two levels or at four or more levels, using numerical values.
- According to one or more embodiments of the disclosure, the
light scanner 4 scans the predetermined range E with the laser light from each LD, and then guides the reflected light from the target object Q in the predetermined range E to each PD; however, the disclosure is not limited thereto. In addition to this configuration, for example, the disclosure is applicable to a target object detection apparatus including a light scanner configured to scan a predetermined range with one of laser light emitted from an LD and the reflected light from a target object Q. The disclosure is also applicable to a target object detection apparatus including no light scanner. - According to one or more embodiments of the disclosure, in the target
object detection apparatus 100, theLD module 2 includes eight LDs, and thePD module 7 includes 32 PDs; however, the disclosure is not limited thereto. The number of LDs and the number of PDs may be selected as appropriate. The LDs and PDs may be arranged in any one direction or any two or more directions rather than the vertical direction Z. Alternatively, the target object detection apparatus may include a light emitter including a light emitting element different from that described above, and a light receiver including a light receiving element different from that described above. - According to one or more embodiments of the disclosure, the dirt detector 1 b detects a state of dirt on the
optical window 12 serving as a light inlet and a light outlet; however, the disclosure is not limited thereto. In addition to this configuration, for example, the targetobject detection apparatus 100 may include a light-projecting optical window serving as a light outlet and a light-receiving optical window serving as a light inlet, and the dirt detector 1 b may detect a state of dirt on one of the optical windows. - According to one or more embodiments of the disclosure, the disclosure is applied to the target
object detection apparatus 100 configured to detect the presence or absence of the target object Q and the distance from the targetobject detection apparatus 100 to the target object Q. Alternatively, the disclosure is also applicable to a target object detection apparatus configured to detect one of presence or absence of a target object and a distance from the target object detection apparatus to the target object. - According to one or more embodiments of the disclosure, the disclosure is applied to the target
object detection apparatus 100 to be installed in a vehicle. Alternatively, the disclosure is also applicable to a target object detection apparatus for another use. - While the invention has been described with reference to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Accordingly, the scope of the invention should be limited only by the attached claims.
Claims (6)
1. A target object detection apparatus comprising:
a light emitter configured to emit measurement light;
a light receiver configured to receive reflected light from a target object in a predetermined range onto which the light emitter projects the measurement light,
the light receiver being configured to output a light reception signal according to a light reception state;
an object detector configured to detect presence or absence of the target object or a distance from the target object detection apparatus to the target object, based on the light reception signal output from the light receiver;
an optical window comprising a light transmissive material that allows transmission of light and serving as a light outlet for the measurement light or a light inlet for the reflected light;
a dirt detector configured to detect presence or absence of dirt on the optical window, based on the light reception signal; and
a notifier configured to provide a notification about the presence of the dirt on the optical window,
wherein the dirt detector detects, based on the light reception signal output from the light receiver, dirt levels in units of segments in a detection field-of-view of the target object detection apparatus fronting on the predetermined range through the optical window, and detects a density and an extent of the dirt, based on the dirt levels, and
wherein the notifier provides a notification about a result of detection by the dirt detector as to the dirt.
2. The target object detection apparatus according to claim 1 ,
wherein the light emitter comprises a plurality of light emitting elements, and
wherein the light receiver comprises a plurality of light receiving elements,
the target object detection apparatus further comprising:
a light scanner configured to scan the predetermined range with the measurement light emitted from each light emitting element or to guide the reflected light to the light receiver.
3. The target object detection apparatus according to claim 1 ,
wherein the dirt detector calculates a sum of the dirt levels and an average value of dirt levels in segments where the dirt extends, in each segment group that is a subset of segments adjoining one another, and detects the density and extent of the dirt, based on the sum and the average value.
4. The target object detection apparatus according to claim 3 ,
wherein the dirt detector detects the density and extent of the dirt on the entire optical window, based on a result of detection in each segment group as to the dirt.
5. The target object detection apparatus according to claim 3 ,
wherein the dirt detector estimates a type of the dirt, based on a result of detection in each segment group as to the dirt, and
wherein the notifier provides a notification about the type of the dirt estimated by the dirt detector.
6. The target object detection apparatus claim 3 ,
wherein the dirt detector determines urgency of dirt removal, based on a result of detection in each segment group as to the dirt, and
wherein the notifier provides a notification about the urgency of dirt removal determined by the dirt detector.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018208555A JP2020076589A (en) | 2018-11-06 | 2018-11-06 | Object detection device |
JP2018-208555 | 2018-11-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200142042A1 true US20200142042A1 (en) | 2020-05-07 |
Family
ID=70457744
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/659,175 Abandoned US20200142042A1 (en) | 2018-11-06 | 2019-10-21 | Target object detection apparatus |
Country Status (4)
Country | Link |
---|---|
US (1) | US20200142042A1 (en) |
JP (1) | JP2020076589A (en) |
CN (1) | CN111158003A (en) |
DE (1) | DE102019128559A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210124028A1 (en) * | 2019-10-25 | 2021-04-29 | Sony Corporation | Predictive maintenance of exercise machines with time-of-flight sensors |
US11392146B2 (en) * | 2014-11-12 | 2022-07-19 | SZ DJI Technology Co., Ltd. | Method for detecting target object, detection apparatus and robot |
CN115792870A (en) * | 2023-02-09 | 2023-03-14 | 图达通智能科技(苏州)有限公司 | Window occlusion detection method and device for laser radar |
US11752558B2 (en) | 2021-04-16 | 2023-09-12 | General Electric Company | Detecting optical anomalies on optical elements used in an additive manufacturing machine |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102020115252B4 (en) * | 2020-06-09 | 2024-06-13 | Mercedes-Benz Group AG | Method and device for detecting contamination on a protective screen of a lidar sensor |
US10969491B1 (en) | 2020-08-14 | 2021-04-06 | Aeva, Inc. | LIDAR window blockage detection |
CN112099044B (en) * | 2020-08-24 | 2023-05-23 | 上海禾赛科技有限公司 | Photomask dirt detection system and method for laser radar and laser radar |
CN112099045B (en) * | 2020-08-24 | 2023-08-08 | 上海禾赛科技有限公司 | Photomask dirt detection system and method for laser radar and laser radar |
WO2022054532A1 (en) * | 2020-09-11 | 2022-03-17 | 株式会社デンソー | Vehicle control device, vehicle control method, and vehicle control program |
JP7452341B2 (en) | 2020-09-11 | 2024-03-19 | 株式会社デンソー | Cleaning control device, cleaning control method, cleaning control program |
JP7492453B2 (en) * | 2020-12-28 | 2024-05-29 | 本田技研工業株式会社 | Vehicle recognition system and method |
JP7410848B2 (en) * | 2020-12-28 | 2024-01-10 | 本田技研工業株式会社 | Vehicle recognition system and recognition method |
JP7187528B2 (en) * | 2020-12-28 | 2022-12-12 | 本田技研工業株式会社 | Vehicle recognition device, vehicle control system, vehicle recognition method, and program |
WO2022185885A1 (en) * | 2021-03-05 | 2022-09-09 | 株式会社小糸製作所 | Sensor system |
CN115728734B (en) * | 2021-08-31 | 2024-05-31 | 深圳市速腾聚创科技有限公司 | Laser radar shielding detection method and device, storage medium and laser radar |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3915742B2 (en) | 2003-06-20 | 2007-05-16 | 株式会社デンソー | Vehicle object recognition device |
JP2012192775A (en) | 2011-03-15 | 2012-10-11 | Denso Corp | Object detecting apparatus |
JP6824697B2 (en) | 2016-11-04 | 2021-02-03 | シャープ株式会社 | Object detection device and object detection method for traveling objects |
-
2018
- 2018-11-06 JP JP2018208555A patent/JP2020076589A/en active Pending
-
2019
- 2019-10-21 US US16/659,175 patent/US20200142042A1/en not_active Abandoned
- 2019-10-21 CN CN201910999660.8A patent/CN111158003A/en active Pending
- 2019-10-22 DE DE102019128559.3A patent/DE102019128559A1/en not_active Withdrawn
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11392146B2 (en) * | 2014-11-12 | 2022-07-19 | SZ DJI Technology Co., Ltd. | Method for detecting target object, detection apparatus and robot |
US20210124028A1 (en) * | 2019-10-25 | 2021-04-29 | Sony Corporation | Predictive maintenance of exercise machines with time-of-flight sensors |
US11747471B2 (en) * | 2019-10-25 | 2023-09-05 | Sony Group Corporation | Predictive maintenance of exercise machines with time-of-flight sensors |
US11752558B2 (en) | 2021-04-16 | 2023-09-12 | General Electric Company | Detecting optical anomalies on optical elements used in an additive manufacturing machine |
CN115792870A (en) * | 2023-02-09 | 2023-03-14 | 图达通智能科技(苏州)有限公司 | Window occlusion detection method and device for laser radar |
Also Published As
Publication number | Publication date |
---|---|
JP2020076589A (en) | 2020-05-21 |
DE102019128559A1 (en) | 2020-05-07 |
CN111158003A (en) | 2020-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200142042A1 (en) | Target object detection apparatus | |
US11156498B2 (en) | Object detector, sensing device, and mobile apparatus | |
US10398006B2 (en) | Object detection apparatus and moveable apparatus | |
US10114110B2 (en) | Object detecting device, sensing device, and mobile object device | |
US9864047B2 (en) | Scanning optoelectronic detection device having a detection threshold, motor vehicle and corresponding method | |
US20190242983A1 (en) | Target object detection device | |
US20190041517A1 (en) | Object detection apparatus | |
JP2018004426A (en) | Object detector, sensing device, and mobile body device | |
US9945951B2 (en) | Object detecting apparatus and vehicle collision avoidance control apparatus | |
US11150345B2 (en) | Object detector, sensing device, and mobile object apparatus | |
JPH04138390A (en) | Measuring apparatus of distance for vehicle | |
WO2021065998A1 (en) | Distance measurement device and method for detecting dirt on distance measurement device window | |
US20200064475A1 (en) | Target detecting device and target detecting system | |
US20190242981A1 (en) | Target detecting device | |
JP2019020149A (en) | Target detection apparatus | |
US11487008B2 (en) | Distance measuring device | |
JP2020112528A (en) | Optical ranging device and method for controlling the same | |
JP6265882B2 (en) | Object detection apparatus and object detection method | |
CN111033303A (en) | Distance measuring device and moving object | |
JP2021060397A (en) | Distance measuring device and method for detecting dirt on window of distance measuring device | |
JP2018151286A (en) | Object detector | |
JP2019039847A (en) | Object detection device | |
JP2019090679A (en) | Object detection apparatus | |
JP2903746B2 (en) | Inter-vehicle distance detection device | |
JP2003252182A (en) | Car shape detecting device and car washer with the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: OMRON AUTOMOTIVE ELECTRONICS CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HIBINO, MASATO;YOKOTA, MOTOMU;REEL/FRAME:051080/0801 Effective date: 20191008 |
|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |