EP1515161A1 - Optischer Entfernungsmesser und Verfahren zur Bestimmung der Entfernung zwischen einem Objekt und einem Referenzpunkt - Google Patents
Optischer Entfernungsmesser und Verfahren zur Bestimmung der Entfernung zwischen einem Objekt und einem Referenzpunkt Download PDFInfo
- Publication number
- EP1515161A1 EP1515161A1 EP04104355A EP04104355A EP1515161A1 EP 1515161 A1 EP1515161 A1 EP 1515161A1 EP 04104355 A EP04104355 A EP 04104355A EP 04104355 A EP04104355 A EP 04104355A EP 1515161 A1 EP1515161 A1 EP 1515161A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- interest
- rangefinder
- electromagnetic radiation
- optical
- scan
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
Definitions
- the invention relates to an optical rangefinder and a Method for determining the distance between an object and a reference point.
- a rangefinder is an instrument or device that is used to Determining the distance of an object from a reference point is used.
- a laser rangefinder a rotating mirror assembly to the Direction of a beam emitted by the laser rangefinder pretend. He can use a mechanically controlled mirror having a certain required range of motion strokes to a desired setting or angular position to reach. Because such mechanical scanners have a specific Range of motion to a desired To achieve movement of the laser or light beam is the actual response time of the mechanical scanner is greater than for certain applications would be desirable, for. B. for the Vehicle steering.
- the laser rangefinder in an agricultural Environment is exposed to dust or other solid particles, The range of motion of the laser rangefinder can be limited and thereby the performance can be reduced. Vibrations of the Laser rangefinder can cause mechanical failure or multiple connections in the rotating mirror assembly to lead. Moreover, the mechanical components of a rotating mirror assembly through manufacturing restrictions and Costs limited to a practical minimum size. The size of a rotating mirror assembly may be too large to fit in one desired housing size of the laser rangefinder recorded to become.
- the object underlying the invention is seen therein to provide a laser rangefinder, the one or has several properties: fast or Real-time response, suitable for dynamic vehicle control is, a compact housing, resistance to dust and other solid particles, and reliability despite acting vibrations.
- the optical rangefinder to determine the distance to an object comprises an optical source electromagnetic Radiation.
- a focusing optical element focuses or collimates the electromagnetic radiation to a Micro mirror array or array.
- a data processor controls the Micro-mirror assembly such that they focused electromagnetic radiation in a defined direction or in emits a defined radiation pattern.
- a beam adjustment sets the beam size (eg width) of the emitted beam a region of interest of interest to a desired Provide resolution level for this room area.
- One optical transmission element focuses or collimates the defined beam on an object.
- An optical receiving element receives from the object or within a field of interest reflected electromagnetic radiation.
- a detector has the Reception of reflected electromagnetic radiation after.
- One Timer measures the time between sending the electromagnetic radiation to the object and the reception of the electromagnetic radiation from any object within the field of view, the sufficiently reflective and of appropriate minimum size is to make a return generate electromagnetic radiation of sufficient strength has passed.
- a data processor calculates the elapsed time in a distance between the object and a reference point.
- a larger area with a smaller resolution sampled Based on these first sample data may be existing smaller areas of interest identified that then scanned at a higher resolution.
- FIG. 1 shows a block diagram of an optical rangefinder 99 for determining the distance between an object 108 and a reference point.
- the reference point may be with reference to the rangefinder 99 or a part thereof.
- the optical rangefinder 99 includes an outgoing one optical path 101 and an incoming optical path 103.
- the outgoing optical path 101 is connected to an electromagnetic Signal (eg a pulse or a pulse train) in relation, which is sent by the rangefinder 99 to an object 108, while the incoming optical path 103 with the reflected electromagnetic signal coming from the rangefinder 99 is received, is related.
- the outgoing optical path 101 includes a source 100 for electromagnetic energy focusing optical element 102, a micromirror arrangement 104 and an optical transmission element 106.
- the incoming Optical path 103 includes an optical receiving element 110 and a detector 112.
- the optical rangefinder 99 includes the source 100 for electromagnetic energy (eg a laser), the electromagnetic energy to the focusing optical element 102 (eg, a lens).
- the electromagnetic radiation can be an infrared ray, near infrared, ultraviolet, red light, a ray in the visible spectrum or another ray of light be.
- the focusing optical element 102 focuses or collimates the electromagnetic radiation on the micromirror arrangement 104.
- the focusing optical element 102 may be the beam expand or shape into a parallel beam.
- One Data processor 116 controls micromirror assembly 104 to control the focused electromagnetic radiation (eg a linear Beam) in a defined direction or a defined To direct radiation patterns.
- the optical transmission element 106 focuses the defined radiation pattern on the object 108.
- the optical receiving element 110 is arranged, electromagnetic Receive radiation that reflects from the object 108 has been.
- the detector 112 has the reception of reflected electromagnetic radiation.
- the reception of the reflected Radiation pattern is linked to a reception time.
- detector 112 generates a signal indicative of Intensity of the received beam reflection is proportional.
- One Timer 118 determines the time between a send time a transmission of the electromagnetic radiation (eg identifiable or traceable pulse) to the object 108 and a reception time of reception of the electromagnetic Radiation (eg an identifiable or traceable Pulse) from the object 108 has elapsed.
- the time between leaving the beam from the rangefinder 99 and its Return to the rangefinder 99 has passed is becoming Determination of the distance between the rangefinder 99 and the object 108 used.
- the data processor 116 converts the elapsed time in a distance between the object 108 and a reference point, z. B. the rangefinder 99th If the Beam generates multiple returns by holding multiple objects the past can be considered the arrival of the first Rewind, the last Rewind, the strongest Rewind, one Average or median of multiple returns, one mode multiple returns or consistent with a suitable, reliable propaganda model or other statistical Model are valued.
- the source 100 transmits electromagnetic Energy one or more pulses (eg a identifiable or traceable pulse) electromagnetic Radiation and the timer 118 registers the Transmission time.
- the Source 100 different frequencies or frequency ranges transmitted to the determination of the color of the visible light Object 108 based on the presence or absence reflected electromagnetic energy in relation to transmitted frequency of the rangefinder 99 easier.
- the source 100 has a Laser with an output power that is considered safe is used to charge people with her, accordingly applicable technical or legislative standards (eg US and international standards, federal communication commission rules or laws).
- the micromirror assembly 104 comprises a micromechanical device that releases a free selectable beam position or beam alignment and a variable beam size supported.
- a micromirror arrangement 104 For example, a micro-electro-mechanical system, a compliant micro-electro-mechanical system or another Device include.
- the micromirror assembly 104 includes rows of reflective ones Elements (eg, mirrors) associated with a substrate (eg, a Semiconductor substrate) are connected.
- Reflecting elements can be individually, together, consecutively or in combination be energized from it to a desired area to be sampled (eg a field of view). Every reflective element can have one or more capacitive plates or conductive Elements are applied to the reflective element deform and thereby move the reflective element, the to direct electromagnetic radiation (eg light beam). More as a reflective element, the electromagnetic Radiation (eg the light beam) simultaneously conduct what a larger beam results than if only a single one reflective element the electromagnetic radiation (eg. Light beam) reflected.
- the electromagnetic Radiation eg the light beam
- the electromagnetic Radiation simultaneously conduct what a larger beam results than if only a single one reflective element the electromagnetic radiation (eg. Light beam) reflected.
- a beam controller 117 controls the micromirror assembly 104, to get a controlled radiation pattern.
- the controlled Radiation pattern may be one of the following: a first pattern for scanning a field of view, a second pattern for covering a sample of the visual field, and a third pattern to the Cover a child (smaller) area of the Field of view.
- the beam control 117 sets a beam width or beam size of the defined radiation pattern.
- the Size of the output beam, its intensity or both can thus be dynamically tuned to a person of interest Area (eg a global area of interest or a local area of interest).
- the Rangefinder 99 fine tunes a scan path (e.g. a scan line) or a scan path with higher resolution provide some of the active reflective elements, which lead the beam, be changed.
- the jet control 117 can adjust the beam dynamically, without limitation by the Rotational speed of a multilateral mechanical mirror of known systems.
- elastomers are interposed between the reflective Element and the substrate of the micromirror assembly 104 inserted to the response time between a deformation and the Shut down rest position after the item is no longer with Energy is applied. That with the reflective element bonded elastomer can be used to the Range of movement of the reflective elements to increase what in turn increases the scanning angle range. That with the reflective element connected elastomer can be the energy or reduce voltage used to control the Micro-mirror assembly 104 is needed.
- Micromirror arrays 104 can be through semiconductor and integrated Circuit manufacturing process can be produced. details micromirror arrangements 104 may be one or more of the following: silicon, silicon oxide, Silicon nitride, aluminum, silver and nickel.
- the inclination or movement of the reflective elements is through controlled electrostatic charges applied to electrodes become.
- Semiconductor switches such as complementary Metal oxide silicon transistors (CMOS) can be used by the position of the reflective elements to control electrostatic deflection and the position of the to detect reflective elements by capacitive sensing.
- CMOS complementary Metal oxide silicon transistors
- the capacitive sensing of the position of the reflective elements allows feedback to fine-tune the preferred one Alignment of the reflective elements and that to reach Such an orientation required electrical energy.
- the beam control 117 may be inputs from a capacitive Accept sensing and semiconductor switches or a driver Activate the applied to the electrodes electrostatic To control charges.
- the micromirror assembly 104 supports activation of different reflective elements in virtually everyone Order (that is, a freely selectable order) by one to achieve the desired position of the reflective elements, instead of going through a certain sequence of motion to a desired position or angle inclination of a mirror Achieve as required with mechanical laser scanners can be.
- the micromirror arrangement 104 therefore supports a dynamic, free access to the positioning of the mirror to Generation of structured light.
- the micromirror arrangement 104 can provide data about a region or area of interest in terms of coordinates, intensity and distance provide.
- a driver may be connected between the beam control 117 and the Micro-mirror assembly 104 may be arranged to an electronic Interface between the beam control 117 and the Micro-mirror assembly 104 to provide.
- the beam control 117 may create a scan pattern or bias pattern, to select electrical energy at one or more selected to emit reflective elements of micromirror array 104.
- a micromirror assembly 104 may be such be driven, that it is a linear array of Picture elements or other patterns of structured light projected.
- the driver or beam controller 117 may be any activate subsequent elements of micromirror array 104, even before the item is actually needed to work with the Activation and movement of the element of Micromirror arrangement 104 to reduce associated delay. The time lag between the energy input and the Activation of the subsequent elements is thus minimized, which reduces the response time of the micromirror arrangement.
- the Micromirror arrangement 104 provides a freely accessible access ready for mirror positioning to provide tightly structured light to produce.
- the beam control 117 acts on the micromirror arrangement 104 to provide pulses of light or radiation, wherein the flying time of a reflective obstacle or another Object 108 is measured.
- the micromirror arrangement 104 supports great flexibility and efficiency in the Image data collection. For example, a first beam collects a smaller resolution a smaller amount of rasterized Image data points (i.e., first scan data) as a second ray with a larger resolution.
- the from the optical receiving element 110 received reflection of the first beam can be used to identify where objects of potential interest lie.
- the received from the optical receiving element 110 Reflection of the second beam with higher sampling resolution can then be used to collect data of higher density on local areas of interest are limited. There are Significant improvements in the efficiency of data collection (eg.
- a second scan higher Resolution with the second ray follows, instead of one Scanning the entire scene with high resolution and then do the voluminous data from the sample with high resolution (eg the global area of interest) to process information about the interested Extract surfaces.
- the entire scene represents a crop edge and the local area of interest provides a gap or break in the crop edge (eg by crippled plant growth or a previously harvested area).
- the local area of interest by one or more discontinuities in the reflectivity of the entire scene or crop edge or Discontinuities regarding certain frequencies radiated Light identified.
- FIG. 2 is a flow chart of a method for Determining a distance of an object 108 from a Reference point. The process in Figure 2 begins with the step S200.
- a source 100 for electromagnetic radiation is emitted Energy electromagnetic radiation (eg a light beam).
- a timer 118 may communicate with the sending of an identifiable Pulse of electromagnetic radiation from the rangefinder 99 Record connected time.
- a focusing optical element focuses 102 the electromagnetic radiation on a Micromirror arrangement 104.
- a lens may be used as a focusing optical element 102, the electromagnetic Focus radiation onto micromirror assembly 104.
- a diffraction grating as focusing optical element 102, the electromagnetic Energy to the micromirror assembly 104.
- step S204 the micromirror assembly 104 conducts focused electromagnetic radiation in a defined Direction or a defined radiation pattern on an object 108 (eg a plant, an obstacle, crop, Crop edge or stubble), corresponding to a scan with lower resolution over a larger area or one Scanning at a higher resolution over a smaller one area of interest, based on a previous one Scanning with lower resolution over the larger area.
- object 108 eg a plant, an obstacle, crop, Crop edge or stubble
- step S206 the optical transmission element 106 focuses the defined radiation pattern on an object 108.
- a Transfer lens focused, for example, as an optical Transmission element 106, the defined radiation pattern.
- an optical receiving element 110 equipped, electromagnetic radiation which reflects from the object 108 was when the object 108 of sufficient physical size and Reflectivity is.
- electromagnetic radiation eg Light beam
- a recipient lens receives as optical receiving element 110 electromagnetic radiation, which has been reflected by the object 108 and focuses the received electromagnetic radiation to a detector 112nd
- the electromagnetic radiation filtered or applied to a filter before being applied to the filter Detector 112 hits to receive certain frequencies of the received reject or transmit electromagnetic radiation. Filtering can be used to detect the presence of Prove objects with certain colors.
- the detector 112 detects the reception reflected, received electromagnetic radiation.
- the electromagnetic radiation may have been reflected off the object be.
- the detector 112 may be, for example, a charge-coupled Component (CCD), a cadmium sulfide sensor, a CMOS sensor or be another sensor that emits an electrical signal when electromagnetic energy, such as light, on the detector 112 falls.
- the emitted electrical signal can be used to determine an arrival or receipt time with a identifiable pulse is connected.
- the timer 118 may be a Arrival or reception time recorded with the reception an identifiable pulse or a modulated signal Electromagnetic radiation is connected.
- the transmission time and receive time of the identifiable pulse or modulated Signal can be related to each other (relative) or one Reference time frame (absolute) can be measured.
- step 212 the data processor 116 sets a elapsed time fixed between a sending time of the electromagnetic Radiation on the object 108 and a reception time of the reception the electromagnetic radiation from the object 108 has elapsed.
- the data processor 116 or a converter sets 114 the elapsed time in a distance between the object 108 and the reference point.
- the distance between the object 108 and the reference point can be used as input of a guidance system a work vehicle are used.
- Work vehicles can use agricultural machinery Combine harvesters, forage harvesters and tractors, construction machinery, Forestry machines, such as harvesters and forwarders, and lawn care equipment like mowers, and all-terrain utility vehicles.
- FIG. 3 shows another embodiment of a Rangefinder.
- the rangefinder 101 of Figure 3 is similar to the rangefinder of Figure 1, but has the Rangefinder 101 of Figure 3, a transmission filter 120 and a Receive filter 122 on. Similar reference numerals in the figures 1 and 3 indicate similar elements.
- the optical rangefinder 101 of Figure 3 comprises a outgoing optical path 105 and an incoming optical Path 107.
- the outgoing optical path 105 is connected to a electromagnetic signal (eg a pulse or a Pulse train) in relationship, the distance from the 101 on a Object 108 is sent while the incoming optical path 107 with the reflected electromagnetic signal coming from the Distance meter 101 is received, is related.
- a electromagnetic signal eg a pulse or a Pulse train
- the distance from the 101 on a Object 108 is sent while the incoming optical path 107 with the reflected electromagnetic signal coming from the Distance meter 101 is received, is related.
- the outgoing optical path 105 includes a source 100 for electromagnetic energy, a focusing optical element 102, a transmit filter 120, a micromirror array 104, and a optical transmission element 106.
- the incoming optical path 107 includes an optical receiving element 110, a receiving filter 122 and a detector 112.
- the transmit filter 120 includes a Intensity filter.
- the intensity filter can by a Liquid crystal display or a rotatable disc with realized different selectable permeability levels become.
- the transmission filter 120 may be the outgoing attenuate electromagnetic radiation to the eyes safe output levels of the outgoing optical path 105th to receive emitted electromagnetic radiation.
- the Intensity filter can be that of the source 100 electromagnetic Attenuate energy emitted radiation to the maximum distance from which a returning signal has been detected can be.
- the intensity filter can be used accordingly be to objects 108 outside of a particular filter out the area of interest.
- the transmission filter 120 can also be between the Micro-mirror assembly 104 and the optical transmission element 106 are arranged; in the position shown is the Micro-mirror assembly 104, however, before the additional heat of the full electromagnetic radiation protected by the Source 100 is generated.
- the transmit filter 120 is one Frequency-selective filter on which a certain frequency transmits or rejects electromagnetic radiation.
- the transmit filter 120 may be configured to be green, to lock red or blue light or other colors or pass.
- the amplitude of the reflected signals may be the data processor 116 estimate an approximate color of an object 108.
- FIG. 4 is a flowchart of a method for Determine if a scan is high or low Resolution should be used.
- the method of Figure 4 can for performing step S204 of FIG. 2.
- the method of FIG. 4 begins in step S400.
- step S400 a larger area of interest is included sampled at a lower resolution to obtain first sample data win.
- the first sample data can be background data, Include foreground data or both.
- the data processor 116 could not be sufficient on the basis of the first sampling data Information to complete in the first scan data distinguish between background data and foreground data.
- a foreground object is placed in front of a background object and closer to the rangefinder (eg 99 or 101).
- the first sample data is a local area of interest detected.
- the first sample data may be one or more Objects (eg 108) or potential objects in several Identify distances in a global scan area. Around to ensure the presence and position of the objects or check the size (eg width) of the dispatched Beam reduced to a smaller beam size.
- the local represents area of interest one or more areas in which possibly foreground objects were detected.
- the directed attention of this invention particularly well suited for the forest area, where trees as Background objects through the bushes in the foreground too can be detected.
- the shrubbery in the foreground can through one or more objects are represented in the foreground.
- the local region of interest may be part of the Background object or a discontinuity area between represent one or more background objects.
- a Discontinuity can be a larger change in the amplitude of the received electromagnetic radiation or reflection represent.
- the discontinuity may be a change in the Amplitude for a particular frequency (eg green light) or a frequency band of the received electromagnetic radiation represent.
- a global represents region of interest a crop edge and a discontinuity therein a local area of interest. The crop edge can reflect a first light frequency while the discontinuity the first light frequency is not reflected or a second one Reflected light frequency, which differs from the first light frequency different.
- a local area of interest with a sampled higher resolution level to provide second sample data received (eg foreground data).
- the data processor 116 or For example, the beam control 117 may attract attention of the beam over a higher resolution scan with a narrower beam size (eg over a local one of interest Area) based on the return signal from one another beam pulse or a modulated signal of the first Scanning.
- the second supports Sampling or the higher resolution sampling the distinction of background objects from Foreground objects of smaller physical size than the sample with smaller resolution.
- the higher one supports Resolution the distinction of objects due to the higher Resolution.
- Step S404 may be done in a variety of different ways be performed.
- the beam control 117 automatically by selective activation of the micromirror arrangement 104 reduce the beam size to the electromagnetic beam from the rangefinder 101 over a global interest Area or, at the higher resolution, a local one of interest Focus area.
- the micromirror arrangement 104 supports a freely accessible scan and a size setting of the from the rangefinder (eg 99 or 101) emitted beam during the flight or the trip.
- the resolution adjustment first, a whole global region with smaller ones Resolution and second, a local region of interest to sample larger resolution. No mechanical lens adjustment and no alignment of the rotating mirrors over one complete range of motion as in the prior art required.
- the first sample data becomes the second Scanned data integrated to a two- or three-dimensional map provide the larger area of interest and the Identification of at least one object, landmark or a guide feature.
- the two or Three-dimensional map can be used to build a trail plan for one Vehicle (eg an autonomous or unmanned vehicle) be used.
- the decision as to whether or not a narrower beam is used higher resolution or a larger beam with less Resolution should be used, depending on whether the larger one Resolution provides any additional information. If the narrower beam would always be used, the amount would be collected data. The with the data processor 116th Connected data processing and storage capacity would be to Support to configure the amount of collected data. The time to collect data from the global interested Range would also increase as the data collected probably also to other areas outside the local would belong to the area of interest.
- FIG. 5 shows a representation of data of a first one While Figure 6 is an illustration of data represents a second scan.
- the first sample data can Image data in a rectangular area (eg 22.86 cm by 22.86 cm in the real world), expressed in columns and Lines.
- the first sample data can be replaced by a larger one Beam size (eg 7.62 cm by 7.62 cm), while the second sample data is a smaller beam size (eg 2.54 by 2.54 cm).
- the first sample data includes a large one Background object and one or more small foreground objects within a global region of interest.
- the great Background object may be a tree stump while the Foreground objects include one or more leaves.
- the rectangular region of the first sample data from FIG. 5 can be found in FIG a grid or cell array with elements passing through Line and column coordinates are identified, split become. As shown, there are nine rows and nine columns, although in practice any numbers of rows and columns could be present. It is believed that there are leaves (L) with the following coordinates and distances: (Column two, line two) at about 6 meters from the rangefinder; (Column four, row four) at about 6.09 m from the rangefinder, that contains the stump, and (column seven, row seven) about 6.18 m from the rangefinder. There is also a Tree stump (T) in columns four to six at about 6.3 m from Rangefinder. Each of the sheets shown in FIG Tree stumps is of sufficient physical size and size Reflectivity to provide a sufficient return signal in the To create rangefinder and the presence of a To point to an object.
- the data processor becomes 116 or the beam control 117 of the rangefinder 99 or 101 initially to a large beam size (eg, a rectangular Beam with 22.86 cm edge length) or one operating mode smaller Resolution for a region of general interest in the distance from about 6 to 6.3 m from the rangefinder.
- a large beam size eg, a rectangular Beam with 22.86 cm edge length
- the rangefinder can first return of one sheet at line 2, column 2 at about 6 m notice and the last return from the tree stump at about 6.3m or both.
- the smaller foreground objects in front of the Tree stump could not be detected by the rangefinder become.
- the rangefinder might not be able to be between the small foreground object and the Differentiate background object.
- Figure 6 illustrates a case in which the background object or a portion thereof is identified within a local field of interest.
- the local field of interest of Figure 6 represents a box or a row-column combination in Figure 6.
- the range finder can be set to a smaller beamwidth (eg 2.54 by 2.54 cm 2 rectangular) with a higher resolution to obtain the second scan data in the local field of interest.
- the return signal is resolved on a time-of-flight basis so that within the smaller beamwidth or higher resolution objects are detected which are about 6m from the range finder, 6.09m from the rangefinder, 6.18m from the rangefinder and 6.3m from the rangefinder , Sheets are identified in column one, row one, column two, row two and column three, row three.
- the stump is detected in column 2, lines one through three inclusive.
- FIG. 7 shows another embodiment of a Rangefinder 199.
- the rangefinder 199 of Figure 7 is similar to the range finder 99 of Figure 1, but includes the rangefinder 199 of Figure 7 further an optical Camera 171.
- the optical camera 171 can be used to Identify regions of the same color, the surfaces at given distances.
- a color camera can output a color signal that is a red component, a Green component and a blue component
- the Color camera in an alternative embodiment a Near infrared component or a near infrared signal instead of the or in addition to the red, green and blue component provide.
- the color signal may have an intensity value of Picture elements or groups of picture elements for each associated one Red component, green component and blue component for the provide scanned area.
- the leaves are green, the stump is assumed brown and the sky blue in the background. If the optical Camera 171 and the laser beam would be calibrated and coordinated, would the processing of the camera image by the data processor 119 two blue regions on each side of the stump, three green regions where the leaves were and the brown region where the tree stump is located.
- the Regions identified in the camera image could be the first Estimates are used for where the multiple distances to analyze in the larger rectangular beam width.
Abstract
Description
- Fig. 1
- ein Blockdiagramm einer Ausführungsform eines optischen Entfernungsmessers zur Abschätzung oder Bestimmung einer Entfernung zwischen einem Objekt und einem Referenzpunkt,
- Fig. 2
- ein Flussdiagramm eines Verfahrens zur Bestimmung einer Entfernung oder eines Entfernungsbereichs eines Objekts von einem Referenzpunkt,
- Fig. 3
- ein Blockdiagramm einer anderen Ausführungsform eines optischen Entfernungsmessers zur Abschätzung oder Bestimmung einer Entfernung von einem Objekt zu einem Referenzpunkt,
- Fig. 4
- ein Flussdiagramm eines Verfahrens zur Einstellung der Strahlgröße eines definierten Strahlungsmusters zur Vergrößerung der Auflösung des optischen Entfernungsmessers,
- Fig. 5
- ein Beispiel eines ersten Bildmusters, das von einem Entfernungsmesser detektiert wird,
- Fig. 6
- ein Beispiel eines zweiten Bildmusters, das von einem Entfernungsmesser detektiert wird, und
- Fig. 7
- eine weitere Ausführungsform eines optischen Entfernungsmessers.
- 101
- Abgehender optischer Pfad
- 100
- Quelle elektromagnetischer Energie (z. B. Laser)
- 102
- fokussierendes optisches Element (z. B. Linse)
- 103
- einlaufender optischer Pfad
- 104
- Mikrospiegelanordnung
- 106
- optisches Übertragungselement (z. B. Linse)
- 108
- Objekt
- 110
- optisches Empfangselement (z. B. Linse)
- 112
- Detektor
- 114
- Konverter
- 116
- Datenprozessor
- 117
- Strahlsteuerung
- 118
- Timer
- 120
- Sendefilter (z. B. Intensitätsfilter)
- 122
- Empfangsfilter
- 171
- Kamera
Claims (24)
- Optischer Entfernungsmesser (99, 101, 199) zur Messung der Entfernung zwischen dem Entfernungsmesser (99, 101, 199) und einem Objekt (108), mit einer Quelle (100) zum Erzeugen eines Strahls elektromagnetischer Energie, einem fokussierenden optischen Element (102) zur Fokussierung oder Kollimation des Strahls, einer Mikrospiegelanordnung (104) zum Empfangen des Strahls vom fokussierenden optischen Element (102) und zur Abgabe eines steuerbaren Strahls, einem Datenprozessor (116) zur Auswahl eines Auflösungsniveaus des steuerbaren Strahls basierend auf einer vorhergehenden Abtastung mit geringerer Auflösung über eine größere Fläche, und einem optischen Übertragungselement (106) zur Fokussierung des steuerbaren Strahls auf ein Objekt (108) zur Abschätzung der Entfernung zwischen dem Objekt (108) und dem Entfernungsmesser (99, 101, 199).
- Optischer Entfernungsmesser (99, 101, 199) nach Anspruch 1, dadurch gekennzeichnet, dass die Mikrospiegelanordnung (104) ein mikroelektromechanisches System ist.
- Optischer Entfernungsmesser (99, 101, 199) nach Anspruch 1 oder 2, dadurch gekennzeichnet, dass die Mikrospiegelanordnung (104) eine Reihe deformierbarer reflektierender Elemente umfasst, die mit einer Strahlsteuerung (117) verbunden sind, welche die deformierbaren reflektierenden Elemente steuert, um die Richtung des steuerbaren Strahls vorzugeben.
- Optischer Entfernungsmesser (99, 101, 199) nach Anspruch 3, dadurch gekennzeichnet, dass die Strahlsteuerung (117) betreibbar ist, Elemente der Mikrospiegelanordnung (104) schon vor dem Zeitpunkt zu aktivieren, an dem eine Positionsänderung der Elemente wirklich erforderlich ist, um die Antwortzeit der Mikrospiegelanordnung (104) zu vermindern.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der Ansprüche 1 bis 4, dadurch gekennzeichnet, dass die Strahlgröße des gesteuerten Strahlungsmusters durch Reflexionsbeiträge mehrerer reflektierender Elemente der Mikrospiegelanordnung (104) bestimmbar ist.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der Ansprüche 1 bis 5, dadurch gekennzeichnet, dass der steuerbare Strahl einen ersten Strahl mit einer geringeren Auflösung und einen zweiten Strahl mit einer höheren Auflösung umfasst, wobei der erste Strahl erste Abtastdaten zur Identifikation einer lokalen interessierenden Fläche innerhalb einer globalen Fläche bereitstellt und die Daten der zweiten Abtastung mit der lokalen interessierenden Fläche in Beziehung stehen.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der Ansprüche 1 bis 6, dadurch gekennzeichnet, dass die Quelle (100) elektromagnetischer Energie einen Laser umfasst, dass das fokussierende optische Element (102) eine Linse umfasst, und dass das optische Übertragungselement (106) eine Linse umfasst.
- Optischer Entfernungsmesser (101) nach einem der Ansprüche 1 bis 7, dadurch gekennzeichnet, dass ein Intensitätsfilter (120) im Weg des steuerbaren Strahlungsmusters angeordnet ist, um die maximale Entfernung der globalen interessierenden Fläche und/oder der lokalen interessierenden Fläche zu begrenzen.
- Optischer Entfernungsmesser (101) nach einem der Ansprüche 1 bis 8, dadurch gekennzeichnet, dass ein Intensitätsfilter (122) im Weg des vom Objekt (108) reflektierten steuerbaren Strahls angeordnet ist, um den vom Objekt (108) reflektierten Strahl zwecks Abschätzung einer ungefähren Farbe des Objekts (108) zu filtern.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass eine erste Abtastung auf ein Hintergrundobjekt und ein potentielles Vordergrundobjekt gerichtet wird, und dass ein zweiter Abtastvorgang auf das potentielle Vordergrundobjekt gerichtet wird, um das Vorhandensein oder Nichtvorhandensein des potentiellen Vordergrundobjekts zu überprüfen.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass erste Abtastdaten sich auf eine globale interessierende Region beziehen und eine zweite Abtastung sich auf eine lokale interessierende Region bezieht, wobei die interessierende lokale Region sich auf eine mit einem Objekt (108) verbundene Diskontinuität bezieht, welche eine wesentliche Änderung der Amplitude des vom Objekt (108) reflektierten Strahlungsmusters oder eine Abwesenheit der Reflexion innerhalb einer vorbestimmten Nachbarschaft des Objekts (108) wiedergibt.
- Optischer Entfernungsmesser (99, 101, 199) nach Anspruch 11, dadurch gekennzeichnet, dass die Diskontinuität eine Unterbrechung oder Störung in einer Erntegutkante auf einem Feld wiedergibt.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der Ansprüche 1 bis 12, dadurch gekennzeichnet, dass eine Farbkamera (171) verwendet wird, um Regionen ähnlicher Farbe zu identifizieren, die Oberflächen des Objekts (108) bei gegebenen Entfernungen entsprechen könnten.
- Optischer Entfernungsmesser (99, 101, 199) nach einem der Ansprüche 1 bis 13, dadurch gekennzeichnet, dass ein optisches Empfangselement (110) zur Aufnahme einer Reflexion des steuerbaren Strahlungsmusters vom Objekt (108), ein Detektor (112) zum Empfang der Reflexion und Bereitstellung eines Ausgangssignals an den Datenprozessor (116) und ein mit dem Datenprozessor (116) verbundener Timer (118) zur Bestimmung einer zwischen dem Absenden eines identifizierbaren Impulses elektromagnetischer Strahlung von der Quelle (100) und dem Empfang der Reflexion des identifizierbaren Impulses am Detektor (112) verstrichenen Zeit, die auf die Entfernung zwischen dem Entfernungsmesser (99, 101, 199) und dem Objekt (108) hinweist, vorgesehen sind.
- Verfahren zur Bestimmung der Entfernung zwischen einem Objekt (108) und einem Referenzpunkt, mit folgenden Schritten:Abstrahlen elektromagnetischer Strahlung,Fokussieren der elektromagnetischen Strahlung auf eine Mikrospiegelanordnung (104),Richten der fokussierten elektromagnetischen Strahlung in einer definierten Richtung oder einem definierten Strahlungsmuster auf ein Objekt (108), entsprechend einer Abtastung mit geringerer Auflösung über eine größere Fläche oder einer Abtastung, die auf einer vorhergehenden Abtastung mit geringerer Auflösung basiert, mit höherer Auflösung über eine kleinere interessierende Fläche,Empfangen vom Objekt (108) reflektierter elektromagnetischer Strahlung,Detektion des Empfangs reflektierter elektromagnetischer Strahlung,Feststellung einer zwischen der Absendung der elektromagnetischen Strahlung auf das Objekt (108) und dem Empfang der elektromagnetischen Strahlung vom Objekt (108) verstrichenen Zeit, undUmrechnen der verstrichenen Zeit in eine Entfernung zwischen dem Objekt und dem Referenzpunkt.
- Verfahren nach Anspruch 15, dadurch gekennzeichnet, dass die abgestrahlte elektromagnetische Strahlung gefiltert wird, um die Intensität der auf die Mikrospiegelanordnung (104) einfallenden elektromagnetischen Strahlung zu steuern.
- Verfahren nach Anspruch 15 oder 16, dadurch gekennzeichnet, dass die reflektierte elektromagnetische Strahlung gefiltert wird, um die Intensität der auf einen Detektor (112) einfallenden elektromagnetischen Strahlung zu steuern.
- Verfahren nach einem der Ansprüche 15 bis 17, dadurch gekennzeichnet, dass die reflektierte elektromagnetische Strahlung in frequenzselektiver Weise gefiltert wird, um eine ungefähre Farbe des Objekts abzuschätzen.
- Verfahren nach einem der Ansprüche 15 bis 18, dadurch gekennzeichnet, dass die Abtastung mit geringerer Auflösung auf ein Hintergrundobjekt und ein potentielles Vordergrundobjekt gerichtet wird, und dass die Abtastung mit höherer Auflösung auf das potentielle Vordergrundobjekt gerichtet wird, um das Vorhandensein oder Fehlen des potentiellen Vordergrundobjekts an einer speziellen Raumposition zu überprüfen.
- Verfahren nach einem der Ansprüche 15 bis 19, dadurch gekennzeichnet, dass erste Abtastdaten sich auf eine globale interessierende Region beziehen und eine zweite Abtastung sich auf eine lokale interessierende Region bezieht.
- Verfahren nach Anspruch 20, dadurch gekennzeichnet, dass die interessierende lokale Region sich auf eine mit einem Objekt (108) verbundene Diskontinuität bezieht, welche eine wesentliche Änderung der Amplitude des vom Objekt (108) reflektierten Strahlungsmusters oder eine Abwesenheit der Reflexion innerhalb einer vorbestimmten Nachbarschaft des Objekts (108) wiedergibt.
- Verfahren nach einem der Ansprüche 15 bis 21, dadurch gekennzeichnet, dass die Diskontinuität eine Unterbrechung oder Störung in einer Erntegutkante auf einem Feld wiedergibt.
- Verfahren nach einem der Ansprüche 15 bis 22, dadurch gekennzeichnet, dass Regionen ähnlicher Farben identifiziert werden, die Oberflächen des Objekts (108) bei gegebener Entfernung entsprechen.
- Verfahren nach einem der Ansprüche 15 bis 23, dadurch gekennzeichnet, dass zur Bestimmung der Farbe des Objekts (108) eine Rotkomponente und/oder eine Grünkomponente und/oder eine Blaukomponente und/oder eine Infrarotkomponente der reflektierten Strahlung verarbeitet wird.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US662867 | 1991-03-01 | ||
US10/662,867 US7064810B2 (en) | 2003-09-15 | 2003-09-15 | Optical range finder with directed attention |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1515161A1 true EP1515161A1 (de) | 2005-03-16 |
EP1515161B1 EP1515161B1 (de) | 2012-04-18 |
Family
ID=34136817
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04104355A Expired - Fee Related EP1515161B1 (de) | 2003-09-15 | 2004-09-09 | Optischer Entfernungsmesser und Verfahren zur Bestimmung der Entfernung zwischen einem Objekt und einem Referenzpunkt |
Country Status (2)
Country | Link |
---|---|
US (2) | US7064810B2 (de) |
EP (1) | EP1515161B1 (de) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1736730A1 (de) | 2005-06-21 | 2006-12-27 | Diehl BGT Defence GmbH & Co.KG | Entfernungsmessvorrichtung und Verfahren zur Entfernungsmessung |
EP3070496A1 (de) * | 2015-03-18 | 2016-09-21 | Sick Ag | Polygonscanner und verfahren zum erfassen von objekten |
WO2017089063A1 (de) * | 2015-11-26 | 2017-06-01 | Valeo Schalter Und Sensoren Gmbh | Laserscanner und kraftfahrzeug mit einem laserscanner |
Families Citing this family (107)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7680342B2 (en) * | 2004-08-16 | 2010-03-16 | Fotonation Vision Limited | Indoor/outdoor classification in digital images |
US7606417B2 (en) | 2004-08-16 | 2009-10-20 | Fotonation Vision Limited | Foreground/background segmentation in digital images with differential exposure calculations |
US7916898B2 (en) * | 2003-09-15 | 2011-03-29 | Deere & Company | Method and system for identifying an edge of a crop |
WO2006083278A2 (en) * | 2004-05-26 | 2006-08-10 | Bae Systems Information And Electronic Systems Integration, Inc. | Method for transitioning from a missile warning system to a fine tracking system in a countermeasures system |
US7620209B2 (en) * | 2004-10-14 | 2009-11-17 | Stevick Glen R | Method and apparatus for dynamic space-time imaging system |
AU2005316100A1 (en) * | 2004-12-16 | 2006-06-22 | Vectronix Ag | Not temperature stabilized pulsed laser diode and all fibre power amplifier |
DE102005028570B4 (de) * | 2005-06-21 | 2012-12-13 | Diehl Bgt Defence Gmbh & Co. Kg | Entfernungsmessvorrichtung und Verfahren zur Entfernungsmessung |
US7692696B2 (en) * | 2005-12-27 | 2010-04-06 | Fotonation Vision Limited | Digital image acquisition system with portrait mode |
IES20060559A2 (en) * | 2006-02-14 | 2006-11-01 | Fotonation Vision Ltd | Automatic detection and correction of non-red flash eye defects |
EP1987436B1 (de) * | 2006-02-14 | 2015-12-09 | FotoNation Limited | Bildunschärfe |
US7583365B2 (en) * | 2006-03-29 | 2009-09-01 | Mensi, S.A. | Method of scanning a scene and corresponding scanning device |
IES20060564A2 (en) * | 2006-05-03 | 2006-11-01 | Fotonation Vision Ltd | Improved foreground / background separation |
DE102006029025A1 (de) * | 2006-06-14 | 2007-12-27 | Iris-Gmbh Infrared & Intelligent Sensors | Vorrichtung und Verfahren zur Abstandsbestimmung |
EP1884798B1 (de) * | 2006-08-03 | 2012-01-18 | Casio Computer Co., Ltd. | Verfahren zur Messung des Abstands zu einem Objekt |
US7554653B2 (en) * | 2006-12-01 | 2009-06-30 | Trimble Ab | Multitarget |
KR101503904B1 (ko) * | 2008-07-07 | 2015-03-19 | 삼성전자 주식회사 | 이동 로봇의 지도 구성 장치 및 방법 |
DE102008032216A1 (de) * | 2008-07-09 | 2010-01-14 | Sick Ag | Vorrichtung zur Erkennung der Anwesenheit eines Objekts im Raum |
US9188980B2 (en) * | 2008-09-11 | 2015-11-17 | Deere & Company | Vehicle with high integrity perception system |
US8818567B2 (en) * | 2008-09-11 | 2014-08-26 | Deere & Company | High integrity perception for machine localization and safeguarding |
US8229618B2 (en) * | 2008-09-11 | 2012-07-24 | Deere & Company | Leader-follower fully autonomous vehicle with operator on side |
US8392065B2 (en) | 2008-09-11 | 2013-03-05 | Deere & Company | Leader-follower semi-autonomous vehicle with operator on side |
US8224500B2 (en) * | 2008-09-11 | 2012-07-17 | Deere & Company | Distributed knowledge base program for vehicular localization and work-site management |
US8195358B2 (en) * | 2008-09-11 | 2012-06-05 | Deere & Company | Multi-vehicle high integrity perception |
US8478493B2 (en) * | 2008-09-11 | 2013-07-02 | Deere & Company | High integrity perception program |
US8195342B2 (en) * | 2008-09-11 | 2012-06-05 | Deere & Company | Distributed knowledge base for vehicular localization and work-site management |
US9026315B2 (en) | 2010-10-13 | 2015-05-05 | Deere & Company | Apparatus for machine coordination which maintains line-of-site contact |
US9235214B2 (en) * | 2008-09-11 | 2016-01-12 | Deere & Company | Distributed knowledge base method for vehicular localization and work-site management |
US20100063652A1 (en) * | 2008-09-11 | 2010-03-11 | Noel Wayne Anderson | Garment for Use Near Autonomous Machines |
US8989972B2 (en) | 2008-09-11 | 2015-03-24 | Deere & Company | Leader-follower fully-autonomous vehicle with operator on side |
US8730130B1 (en) * | 2008-12-04 | 2014-05-20 | RPA Electronic Solutions, Inc. | System and method for automatically aligning immersive displays |
US8219274B2 (en) * | 2009-07-02 | 2012-07-10 | Robert Bosch Gmbh | 3-dimensional perception system and method for mobile platform |
US8274507B2 (en) * | 2009-07-02 | 2012-09-25 | Robert Bosch Gmbh | Method and apparatus for obtaining 3-dimensional data with a portable device |
US8224516B2 (en) * | 2009-12-17 | 2012-07-17 | Deere & Company | System and method for area coverage using sector decomposition |
US20110153338A1 (en) * | 2009-12-17 | 2011-06-23 | Noel Wayne Anderson | System and method for deploying portable landmarks |
US8635015B2 (en) * | 2009-12-17 | 2014-01-21 | Deere & Company | Enhanced visual landmark for localization |
TW201212672A (en) * | 2010-06-10 | 2012-03-16 | Koninkl Philips Electronics Nv | Adjusting a building service system |
US9098931B2 (en) | 2010-08-11 | 2015-08-04 | Apple Inc. | Scanning projectors and image capture modules for 3D mapping |
US9870068B2 (en) | 2010-09-19 | 2018-01-16 | Facebook, Inc. | Depth mapping with a head mounted display using stereo cameras and structured light |
AT510579B1 (de) * | 2010-12-21 | 2012-05-15 | Riegl Laser Measurement Systems Gmbh | Laser-scanner und verfahren zur vermessung von zielräumen |
TW201243287A (en) * | 2011-04-28 | 2012-11-01 | Hon Hai Prec Ind Co Ltd | Laser range finder |
WO2013052781A1 (en) * | 2011-10-07 | 2013-04-11 | Massachusetts Institute Of Technology | Method and apparatus to determine depth information for a scene of interest |
KR101709844B1 (ko) | 2012-02-15 | 2017-02-23 | 애플 인크. | 맵핑 장치 및 맵핑하기 위한 방법 |
US9693503B2 (en) | 2013-02-20 | 2017-07-04 | Deere & Company | Crop sensing |
US9282693B2 (en) | 2013-02-20 | 2016-03-15 | Deere & Company | Data encoding with planting attributes |
US10178828B2 (en) | 2013-02-20 | 2019-01-15 | Deere & Company | Per plant crop sensing resolution |
US9668420B2 (en) | 2013-02-20 | 2017-06-06 | Deere & Company | Crop sensing display |
US11212962B2 (en) | 2013-02-20 | 2022-01-04 | Deere & Company | Field condition determination |
US9066465B2 (en) | 2013-02-20 | 2015-06-30 | Deere & Company | Soil compaction reduction system and method |
KR102124930B1 (ko) * | 2013-08-16 | 2020-06-19 | 엘지전자 주식회사 | 공간 해상도가 가변되는 거리 정보를 획득할 수 있는 거리검출장치 |
MX2016005338A (es) | 2013-10-23 | 2017-03-20 | Facebook Inc | Representacion de profundidad tri-dimensional con el uso de luz estructurada dinamica. |
CN105723239B (zh) * | 2013-11-20 | 2020-12-18 | 松下半导体解决方案株式会社 | 测距摄像系统以及固体摄像元件 |
CN112180397B (zh) | 2014-01-29 | 2023-07-25 | Lg伊诺特有限公司 | 用于提取深度信息的装置及方法 |
US10386464B2 (en) | 2014-08-15 | 2019-08-20 | Aeye, Inc. | Ladar point cloud compression |
JP2016071010A (ja) * | 2014-09-29 | 2016-05-09 | 株式会社ミツトヨ | オートフォーカス装置、オートフォーカス方法、及びプログラム |
US9854226B2 (en) * | 2014-12-22 | 2017-12-26 | Google Inc. | Illuminator for camera system having three dimensional time-of-flight capture with movable mirror element |
EP3259615B1 (de) * | 2015-02-20 | 2019-11-20 | Apple Inc. | Betätigtes optisches element für lichtstrahlabtastvorrichtung |
US9921299B2 (en) | 2015-02-20 | 2018-03-20 | Apple Inc. | Dynamic beam spot size for light beam scanning device |
US10107914B2 (en) | 2015-02-20 | 2018-10-23 | Apple Inc. | Actuated optical element for light beam scanning device |
EP3265885A4 (de) * | 2015-03-03 | 2018-08-29 | Prenav Inc. | Abtastung von umgebungen und verfolgung von unbemannten luftfahrzeugen |
WO2016154218A1 (en) * | 2015-03-22 | 2016-09-29 | Oculus Vr, Llc | Depth mapping with a head mounted display using stereo cameras and structured light |
US9880263B2 (en) * | 2015-04-06 | 2018-01-30 | Waymo Llc | Long range steerable LIDAR system |
DE102015106140A1 (de) * | 2015-04-22 | 2016-10-27 | Valeo Schalter Und Sensoren Gmbh | Verfahren zum Betreiben eines optoelektronischen Sensors für ein Kraftfahrzeug mit Anpassung des Aussendens der Sendesignale, optoelektronischer Sensor, Fahrerassistenzsystem sowie Kraftfahrzeug |
US9525863B2 (en) | 2015-04-29 | 2016-12-20 | Apple Inc. | Time-of-flight depth mapping with flexible scan pattern |
KR102368597B1 (ko) * | 2015-11-11 | 2022-03-02 | 삼성전자주식회사 | 영상 촬영 장치 및 이의 제어 방법 |
US10761196B2 (en) | 2016-02-18 | 2020-09-01 | Aeye, Inc. | Adaptive ladar receiving method |
US10042159B2 (en) | 2016-02-18 | 2018-08-07 | Aeye, Inc. | Ladar transmitter with optical field splitter/inverter |
US20170242104A1 (en) | 2016-02-18 | 2017-08-24 | Aeye, Inc. | Ladar Transmitter with Induced Phase Drift for Improved Gaze on Scan Area Portions |
US9933513B2 (en) | 2016-02-18 | 2018-04-03 | Aeye, Inc. | Method and apparatus for an adaptive ladar receiver |
US20170328990A1 (en) * | 2016-05-11 | 2017-11-16 | Texas Instruments Incorporated | Scalable field of view scanning in optical distance measurement systems |
US11237251B2 (en) * | 2016-05-11 | 2022-02-01 | Texas Instruments Incorporated | Lidar scanning with expanded scan angle |
US11106030B2 (en) | 2016-05-11 | 2021-08-31 | Texas Instruments Incorporated | Optical distance measurement system using solid state beam steering |
WO2017200896A2 (en) * | 2016-05-18 | 2017-11-23 | James O'keeffe | A dynamically steered lidar adapted to vehicle shape |
US11340338B2 (en) | 2016-08-10 | 2022-05-24 | James Thomas O'Keeffe | Distributed lidar with fiber optics and a field of view combiner |
US10578719B2 (en) | 2016-05-18 | 2020-03-03 | James Thomas O'Keeffe | Vehicle-integrated LIDAR system |
WO2018128655A2 (en) | 2016-09-25 | 2018-07-12 | Okeeffe James | Distributed laser range finder with fiber optics and micromirrors |
WO2018031830A1 (en) | 2016-08-10 | 2018-02-15 | Okeeffe James | Laser range finding with enhanced utilization of a remotely located mirror |
US9766060B1 (en) * | 2016-08-12 | 2017-09-19 | Microvision, Inc. | Devices and methods for adjustable resolution depth mapping |
WO2018126248A1 (en) * | 2017-01-02 | 2018-07-05 | Okeeffe James | Micromirror array for feedback-based image resolution enhancement |
WO2018044958A1 (en) | 2016-08-29 | 2018-03-08 | Okeeffe James | Laser range finder with smart safety-conscious laser intensity |
CN109997057B (zh) * | 2016-09-20 | 2020-07-14 | 创新科技有限公司 | 激光雷达系统和方法 |
US10408940B2 (en) | 2016-09-25 | 2019-09-10 | James Thomas O'Keeffe | Remote lidar with coherent fiber optic image bundle |
US10267900B2 (en) * | 2016-11-07 | 2019-04-23 | Bae Systems Information And Electronic Systems Integration Inc. | System and method for covert pointer/communications and laser range finder |
CA3051425A1 (en) | 2017-02-02 | 2018-08-09 | PreNav, Inc. | Tracking image collection for digital capture of environments, and associated systems and methods |
JP7206206B2 (ja) | 2017-02-17 | 2023-01-17 | エイアイ インコーポレイテッド | Ladarパルス干渉回避方法およびシステム |
US10969488B2 (en) * | 2017-03-29 | 2021-04-06 | Luminar Holdco, Llc | Dynamically scanning a field of regard using a limited number of output beams |
CN111344647A (zh) | 2017-09-15 | 2020-06-26 | 艾耶股份有限公司 | 具有低延时运动规划更新的智能激光雷达系统 |
US10677905B2 (en) * | 2017-09-26 | 2020-06-09 | Infineon Technologies Ag | System and method for occupancy detection using a millimeter-wave radar sensor |
US11353559B2 (en) * | 2017-10-09 | 2022-06-07 | Luminar, Llc | Adjustable scan patterns for lidar system |
US11415675B2 (en) | 2017-10-09 | 2022-08-16 | Luminar, Llc | Lidar system with adjustable pulse period |
US10942244B2 (en) * | 2017-12-12 | 2021-03-09 | Waymo Llc | Systems and methods for LIDARs with adjustable resolution and failsafe operation |
US10473788B2 (en) * | 2017-12-13 | 2019-11-12 | Luminar Technologies, Inc. | Adjusting area of focus of vehicle sensors by controlling spatial distributions of scan lines |
CN112074759A (zh) * | 2018-04-28 | 2020-12-11 | 深圳市大疆创新科技有限公司 | 具有多个发射器和多个接收器的光探测和测距传感器以及相关联的系统和方法 |
US11333748B2 (en) | 2018-09-17 | 2022-05-17 | Waymo Llc | Array of light detectors with corresponding array of optical elements |
US10656252B1 (en) | 2018-10-25 | 2020-05-19 | Aeye, Inc. | Adaptive control of Ladar systems using spatial index of prior Ladar return data |
US10656272B1 (en) | 2019-04-24 | 2020-05-19 | Aeye, Inc. | Ladar system and method with polarized receivers |
US11556000B1 (en) | 2019-08-22 | 2023-01-17 | Red Creamery Llc | Distally-actuated scanning mirror |
DE102019123207A1 (de) * | 2019-08-29 | 2021-03-04 | Claas Selbstfahrende Erntemaschinen Gmbh | Verfahren zur Signalauswertung von Signalen eines Entfernungsmessers |
US11598878B2 (en) * | 2020-04-07 | 2023-03-07 | Teledyne Scientific & Imaging, Llc | Vision-cued random-access lidar system and method for localization and navigation |
CN116034289A (zh) | 2020-05-13 | 2023-04-28 | 卢米诺有限责任公司 | 具有高分辨率扫描图案的激光雷达系统 |
US20220163635A1 (en) * | 2020-11-23 | 2022-05-26 | Harman International Industries, Incorporated | Systems and methods for reducing cognitive workload and energy consumption by a sensor utilized on a vehicle |
US11619740B2 (en) | 2021-03-26 | 2023-04-04 | Aeye, Inc. | Hyper temporal lidar with asynchronous shot intervals and detection intervals |
US11486977B2 (en) | 2021-03-26 | 2022-11-01 | Aeye, Inc. | Hyper temporal lidar with pulse burst scheduling |
US11474213B1 (en) | 2021-03-26 | 2022-10-18 | Aeye, Inc. | Hyper temporal lidar with dynamic laser control using marker shots |
US11635495B1 (en) | 2021-03-26 | 2023-04-25 | Aeye, Inc. | Hyper temporal lidar with controllable tilt amplitude for a variable amplitude scan mirror |
US20220308187A1 (en) | 2021-03-26 | 2022-09-29 | Aeye, Inc. | Hyper Temporal Lidar Using Multiple Matched Filters to Determine Target Retro-Reflectivity |
US20230044929A1 (en) | 2021-03-26 | 2023-02-09 | Aeye, Inc. | Multi-Lens Lidar Receiver with Multiple Readout Channels |
US11630188B1 (en) | 2021-03-26 | 2023-04-18 | Aeye, Inc. | Hyper temporal lidar with dynamic laser control using safety models |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4298280A (en) * | 1979-09-25 | 1981-11-03 | Massachusetts Institute Of Technology | Infrared radar system |
US5638164A (en) * | 1994-08-09 | 1997-06-10 | Development Authority, Rafael State of Israel--Ministry of Defense Armament | Apparatus and method for laser imaging |
DE19608632A1 (de) * | 1996-03-06 | 1997-09-11 | Eos Electro Optical Syst | Vorrichtung und Verfahren zur optischen Abtastung von Oberflächen |
EP1221582A2 (de) * | 2001-01-05 | 2002-07-10 | Leuze electronic GmbH + Co. | Optoelektronische Vorrichtung |
EP1310764A2 (de) * | 2001-11-09 | 2003-05-14 | Riegl Laser Measurement Systems Gmbh | Einrichtung zur Aufnahme eines Objektraumes |
EP1321777A2 (de) * | 2001-12-19 | 2003-06-25 | Riegl Laser Measurement Systems Gmbh | Verfahren zur Aufnahme eines Objektraumes |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3942890A (en) * | 1974-03-21 | 1976-03-09 | The United States Of America As Represented By The Secretary Of The Navy | Secure active sensor |
EP0127738B1 (de) | 1983-05-17 | 1987-09-09 | Contraves Ag | Visier in Periskopbauart |
EP0125429B1 (de) | 1983-05-17 | 1989-08-30 | Contraves Ag | Optisches System für ein Visier |
US5061049A (en) | 1984-08-31 | 1991-10-29 | Texas Instruments Incorporated | Spatial light modulator and method |
DE8518594U1 (de) | 1985-06-27 | 1985-11-28 | Fa. Carl Zeiss, 7920 Heidenheim | Wobbelseparator an Laser-Entfernungsmessern |
DE3823647A1 (de) | 1988-07-13 | 1990-01-18 | Leitz Wild Gmbh | Rundblick-periskop |
GB9003268D0 (en) | 1990-02-13 | 1990-04-11 | Stevens William H | Improvements in or relating to lasers |
US5966230A (en) | 1990-05-29 | 1999-10-12 | Symbol Technologies, Inc. | Integrated scanner on a common substrate |
US5220164A (en) * | 1992-02-05 | 1993-06-15 | General Atomics | Integrated imaging and ranging lidar receiver with ranging information pickoff circuit |
US6059188A (en) | 1993-10-25 | 2000-05-09 | Symbol Technologies | Packaged mirror including mirror travel stops |
US6407817B1 (en) * | 1993-12-20 | 2002-06-18 | Minolta Co., Ltd. | Measuring system with improved method of reading image data of an object |
NL9500590A (nl) | 1995-03-28 | 1996-11-01 | Hollandse Signaalapparaten Bv | Inrichting voor het detecteren van doelen. |
GB9515311D0 (en) * | 1995-07-26 | 1995-09-20 | 3D Scanners Ltd | Stripe scanners and methods of scanning |
US5933183A (en) | 1995-12-12 | 1999-08-03 | Fuji Photo Film Co., Ltd. | Color spatial light modulator and color printer using the same |
US5780839A (en) * | 1996-04-02 | 1998-07-14 | Trw Inc. | Laser crossbody and feature curvature tracker |
US5870176A (en) | 1996-06-19 | 1999-02-09 | Sandia Corporation | Maskless lithography |
KR100208000B1 (ko) | 1996-09-16 | 1999-07-15 | 윤종용 | 레이저 스캐닝 유니트 |
JP4136067B2 (ja) * | 1997-05-02 | 2008-08-20 | キヤノン株式会社 | 検出装置及びそれを用いた露光装置 |
US5939706A (en) * | 1997-12-03 | 1999-08-17 | Trw Inc. | Adaptive focal plane for high contrast imaging |
US6188500B1 (en) | 1998-04-03 | 2001-02-13 | Psc Scanning, Inc. | Method for generating multiple scan lines in a thin scanner |
DE19845666B4 (de) | 1998-10-05 | 2005-08-25 | Claas Selbstfahrende Erntemaschinen Gmbh | Lenkautomatik mit Ultraschall-Ortungsvorrichtung |
JP4032603B2 (ja) * | 2000-03-31 | 2008-01-16 | コニカミノルタセンシング株式会社 | 3次元計測装置 |
US20030035097A1 (en) * | 2000-10-02 | 2003-02-20 | Robert Lai | Method and apparatus for locating object by using laser range finder |
TW480346B (en) | 2001-02-01 | 2002-03-21 | Walsin Lihwa Corp | Actuating mechanism for rotating micro-mirror |
JP3703014B2 (ja) * | 2001-05-11 | 2005-10-05 | 三菱電機株式会社 | レーダ信号処理装置、及び距離・速度計測方法 |
-
2003
- 2003-09-15 US US10/662,867 patent/US7064810B2/en active Active
-
2004
- 2004-09-09 EP EP04104355A patent/EP1515161B1/de not_active Expired - Fee Related
-
2006
- 2006-03-28 US US11/391,616 patent/US7206063B2/en not_active Expired - Lifetime
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4298280A (en) * | 1979-09-25 | 1981-11-03 | Massachusetts Institute Of Technology | Infrared radar system |
US5638164A (en) * | 1994-08-09 | 1997-06-10 | Development Authority, Rafael State of Israel--Ministry of Defense Armament | Apparatus and method for laser imaging |
DE19608632A1 (de) * | 1996-03-06 | 1997-09-11 | Eos Electro Optical Syst | Vorrichtung und Verfahren zur optischen Abtastung von Oberflächen |
EP1221582A2 (de) * | 2001-01-05 | 2002-07-10 | Leuze electronic GmbH + Co. | Optoelektronische Vorrichtung |
EP1310764A2 (de) * | 2001-11-09 | 2003-05-14 | Riegl Laser Measurement Systems Gmbh | Einrichtung zur Aufnahme eines Objektraumes |
EP1321777A2 (de) * | 2001-12-19 | 2003-06-25 | Riegl Laser Measurement Systems Gmbh | Verfahren zur Aufnahme eines Objektraumes |
Non-Patent Citations (7)
Title |
---|
ANAGNOSTOPOULOS G P ET AL: "The electronics of a control system for micromirrors in a laser-scanning device", ICECS 2002. 9TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS, vol. 3, 15 September 2002 (2002-09-15), PISCATAWAY, NJ, USA, pages 1207 - 1210, XP010614572 * |
ARANA-AREJOLALEIBA N ET AL: "A 3D laser micro-sensor integrating control and data processing in an FPGA-based calculator", PROCEEDINGS THIRD INTERNATIONAL CONFERENCE ON 3-D DIGITAL IMAGING AND MODELING, 28 May 2001 (2001-05-28), IEEE, LOS ALAMITOS, CA, USA, pages 107 - 114, XP010542854 * |
ARANA-AREJOLALEIBA N ET AL: "A smart sensor based visual landmarks detection for indoor robot navigation", PATTERN RECOGNITION, 2002. PROCEEDINGS. 16TH INTERNATIONAL CONFERENCE ON QUEBEC CITY, QUE., CANADA 11-15 AUG. 2002, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 11 August 2002 (2002-08-11), pages 848 - 851, XP010614012, ISBN: 0-7695-1695-X * |
FAINMAN Y ET AL: "3D quantitative imaging of the microvasculature with the Texas Instruments digital micromirror device", PROCEEDINGS OF THE SPIE - THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING SPIE-INT. SOC. OPT. ENG USA, vol. 4457, August 2001 (2001-08-01), pages 137 - 144, XP002310630, ISSN: 0277-786X * |
JIMENEZ A R ET AL: "Automatic fruit recognition: a survey and new results using Range/Attenuation images", PATTERN RECOGNITION, ELSEVIER, KIDLINGTON, GB, vol. 32, no. 10, October 1999 (1999-10-01), pages 1719 - 1736, XP004171577, ISSN: 0031-3203 * |
OLLIS M ET AL: "First results in vision-based crop line tracking", ROBOTICS AND AUTOMATION, 1996. PROCEEDINGS., 1996 IEEE INTERNATIONAL CONFERENCE ON MINNEAPOLIS, MN, USA 22-28 APRIL 1996, NEW YORK, NY, USA,IEEE, US, 22 April 1996 (1996-04-22), pages 951 - 956, XP010162869, ISBN: 0-7803-2988-0 * |
RUFFIN P B: "Optical MEMS-based arrays", PROCEEDINGS OF THE SPIE - THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING SPIE-INT. SOC. OPT. ENG USA, vol. 5055, July 2003 (2003-07-01), pages 230 - 241, XP002310629, ISSN: 0277-786X * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1736730A1 (de) | 2005-06-21 | 2006-12-27 | Diehl BGT Defence GmbH & Co.KG | Entfernungsmessvorrichtung und Verfahren zur Entfernungsmessung |
EP3070496A1 (de) * | 2015-03-18 | 2016-09-21 | Sick Ag | Polygonscanner und verfahren zum erfassen von objekten |
WO2017089063A1 (de) * | 2015-11-26 | 2017-06-01 | Valeo Schalter Und Sensoren Gmbh | Laserscanner und kraftfahrzeug mit einem laserscanner |
Also Published As
Publication number | Publication date |
---|---|
US7064810B2 (en) | 2006-06-20 |
US20050057741A1 (en) | 2005-03-17 |
US20060176468A1 (en) | 2006-08-10 |
EP1515161B1 (de) | 2012-04-18 |
US7206063B2 (en) | 2007-04-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1515161B1 (de) | Optischer Entfernungsmesser und Verfahren zur Bestimmung der Entfernung zwischen einem Objekt und einem Referenzpunkt | |
EP1632790B1 (de) | Optischer Entfernungsmesser und Verfahren zur Bestimmung der Entfernung zwischen einem Objekt und einem Referenzpunkt | |
EP0396867B1 (de) | Navigationsverfahren | |
King | Airborne multispectral digital camera and video sensors: a critical review of system designs and applications | |
DE69635891T2 (de) | Verbesserte optische kamera zur entfernungsmessung | |
EP0396865B1 (de) | Optisches Radar | |
DE202018006696U1 (de) | Optischer Bildübertrager mit Helligkeitsverbesserung | |
DE112017004806T5 (de) | Optisches system zur sammlung von entfernungsinformationen in einem feld | |
DE102008064652B4 (de) | Optischer Laufzeitsensor zur Raumabtastung | |
DE69633524T2 (de) | Verfahren und Gerät zur Objekterfassung | |
DE112017000127T5 (de) | 2D Lidar-Scannen mit hoher Präzision mit einem drehbaren konkaven Spiegel und einer Strahllenkvorrichtung | |
DE112011101667T5 (de) | Abtastender 3D-Bildgeber | |
DE102004014041A1 (de) | Sensorsystem zur Hinderniserkennung | |
DE102014108310B4 (de) | Optisches Laufzeitsystem | |
EP0464263A2 (de) | Anordnung zum Erkennen von Hindernissen für Piloten tieffliegender Luftfahrzeuge | |
DE19628049C2 (de) | Vorrichtung zur Erfassung der Position eines menschlichen Körpers unter Verwendung eines Infrarotstrahlsensors | |
DE102010013663A1 (de) | Strahlungssensor | |
DE212017000248U1 (de) | LiDAR-Vorrichtung | |
DE3007893C2 (de) | Wärmebildgerät | |
DE102019105478A1 (de) | LIDAR-Sensoren und Verfahren für dieselben | |
WO2020114740A1 (de) | Lidar-system sowie kraftfahrzeug | |
WO2007036553A1 (de) | Vorrichtung und verfahren zur aufnahme von entfernungsbildern | |
DE102010020537A1 (de) | Wasserdetektor | |
DE19851010B4 (de) | Einrichtung zur Erkennung und Lokalisierung von Laserstrahlungsquellen | |
DE112020000407B4 (de) | Lidar-systeme und -verfahren mit strahllenkung und weitwinkelsignaldetektion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
17P | Request for examination filed |
Effective date: 20050916 |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502004013454 Country of ref document: DE Effective date: 20120614 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20130121 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502004013454 Country of ref document: DE Effective date: 20130121 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20160927 Year of fee payment: 13 Ref country code: DE Payment date: 20160819 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20160926 Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502004013454 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20170909 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20180531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180404 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170909 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171002 |