EP4418003A1 - Ranging apparatus and ranging system - Google Patents
Ranging apparatus and ranging system Download PDFInfo
- Publication number
- EP4418003A1 EP4418003A1 EP23193401.9A EP23193401A EP4418003A1 EP 4418003 A1 EP4418003 A1 EP 4418003A1 EP 23193401 A EP23193401 A EP 23193401A EP 4418003 A1 EP4418003 A1 EP 4418003A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- ranging
- information
- laser light
- ranging system
- arrangement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/484—Transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
Definitions
- Arrangements described herein relate generally to a ranging apparatus and a ranging system.
- a ranging apparatus called LiDAR (Light Detection and Ranging) is known.
- a LiDAR emits laser light to a ranging target. The emitted laser light is reflected by the ranging target, and detected by an optical sensor of the LiDAR. In this manner, the LiDAR is capable of measuring a distance between the LiDAR and the ranging target on the basis of the time at which the laser light was emitted and the time at which the laser light reflected by the ranging target was detected.
- the angle of view and the resolution of distance information that can be acquired has a trade-off relation.
- a ranging apparatus includes a light source (23), a movable mirror (251), a light sensor (26), a measurement circuit (27), and a first control circuit (21).
- the movable mirror is configured to reflect each of first laser light (LE) and second laser light (LR).
- the first laser light is emitted from the light source.
- the second laser light corresponds to the first laser light reflected by an external subject.
- the light sensor is configured to detect the second laser light reflected by the movable mirror.
- the measurement circuit is configured to measure a distance to the subject based on a timing of emission of the first laser light by the light source and a timing of detection of the second laser light by the light sensor.
- the first control circuit is configured to change an emission direction of the first laser light based on a first signal from outside.
- the following is an explanation of a ranging system 1 according to the first arrangement.
- FIG. 1 is a schematic diagram illustrating an example of a configuration of a ranging system according to a first arrangement.
- FIG. 1 illustrates a state in which a transportation equipment VE including the ranging system 1 is moving through a predetermined route.
- the ranging system 1 includes an information processing apparatus 10 and a ranging apparatus 20.
- the transportation equipment VE is, for example, a vehicle, a train, an airplane, or a ship.
- the information processing apparatus 10 includes, for example, a device collecting information, such as its state, a current location of the transportation equipment VE, and a surrounding environment thereof.
- the information processing apparatus 10 is configured to be capable of controlling the ranging apparatus 20.
- the information processing apparatus 10 can designate a ranging direction for the ranging apparatus 20.
- the information processing apparatus 10 may be configured to be capable of controlling acceleration/deceleration and/or the traveling direction of the transportation equipment VE.
- the information processing apparatus 10 may have a function of supporting autonomous traveling of the transportation equipment VE.
- the ranging apparatus 20 is a type of a LiDAR.
- the ranging apparatus 20 emits laser light and detects the laser light reflected by a subject (ranging target).
- the ranging apparatus 20 measures a distance between the ranging apparatus 20 and the subject on the basis of the time of emission of the laser light and the time of detection of the reflected laser light.
- the ranging apparatus 20 is mounted (installed) in, for example, a front part of the transportation equipment VE, and acquires distance information of a predetermined angle of view in the traveling direction of the transportation equipment VE.
- the ranging apparatus 20 can change the ranging direction without changing the angle of view on the basis of an instruction of the information processing apparatus 20.
- the angle of view of the ranging apparatus 20, that is, the range in which a distance is measured by the ranging apparatus 20 is also referred to as "FOV (Field Of View)".
- FIG. 2 is a block diagram illustrating an example of a configuration of the information processing apparatus 10 according to the first arrangement.
- the information processing apparatus 10 includes, for example, a CPU (Central Processing Apparatus) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage device 14, a user interface 15, a communication interface 16, and an information collecting device 17.
- a CPU Central Processing Apparatus
- ROM Read Only Memory
- RAM Random Access Memory
- the CPU 11 is an integrated circuit capable of executing various programs.
- the CPU 11 controls operations of the whole information processing apparatus 10.
- the ROM 12 is a nonvolatile semiconductor memory.
- the ROM 12 stores a control program and/or a control data and the like of the information processing apparatus 10.
- the RAM 13 is, for example, a volatile semiconductor memory.
- the RAM 13 is used as a work area of the CPU 11.
- the control program and/or the control data and the like stored in the ROM 12 are loaded on the RAM 13.
- the storage device 14 is a storage medium used for storing data and/or programs.
- the storage device 14 stores, for example, map information including information of the route through which the transportation equipment VE can move.
- the user interface 15 is an input interface used by the user.
- the user can operate the information processing apparatus 10 using the user interface 15.
- the communication interface 16 is an interface circuit connectable to a network.
- the communication interface 16 is configured to be capable of communicating with the ranging apparatus 20.
- the information processing apparatus 10 can control the ranging apparatus 20 via the communication interface 16.
- the information collecting device 17 collects information relating the current location, information relating to the state of the transportation equipment VE, and/or information relating to the surroundings of the transportation equipment VE.
- the information collecting device 17 includes, for example, a camera and/or a sensor.
- the information stored in the storage device 14 may be downloaded via a server on the network.
- the storage device 14 and/or the information collecting device 17 may be externally connected to the information processing apparatus 10.
- the information processing apparatus 10 may operate on the basis of control of a terminal on the network, or operate on the basis of information stored in the server on the network.
- the information processing apparatus 10 may be a system constructed with a plurality of devices connected via the network.
- the network used by the information processing apparatus 10 may be wired or wireless, or both of wired and wireless networks may be used.
- FIG. 3 is a block diagram illustrating an example of a configuration of the ranging apparatus 20 according to the first arrangement.
- the ranging apparatus 20 includes, for example, a ranging controller 21, a laser driver 22, a laser diode 23, a mirror controller 24, an optical system 25, a light sensor 26, and a measurement device 27.
- the optical system 25 includes, for example, a rotary mirror 251.
- the ranging controller 21 controls operations of the whole ranging apparatus 20.
- the ranging controller 21 includes, for example, a CPU, a ROM, a RAM, and an oscillator (not illustrated).
- the ROM of the ranging controller 21 stores a control program and the like of the ranging apparatus 20.
- the CPU of the ranging controller 21 controls the laser driver 22, the mirror controller 24, the light sensor 26, and the measurement device 27 in accordance with the control program.
- the RAM of the ranging controller 21 is used as a work area of the CPU.
- the oscillator is used for generation of intermittent pulse signals.
- the ranging controller 21 may be configured to be capable of executing various data processing and arithmetic processing.
- the laser driver 22 drives the laser diode 23.
- the laser driver 22 functions as a power supply source of the laser diode 23.
- the laser diode 23 emits laser light on the basis of a drive current supplied from the laser driver 22.
- the laser light emitted from the laser diode 23 is made incident on the optical system 25.
- the ranging controller 21 controls the laser driver 22 such that the laser diode 23 intermittently emits laser light.
- the laser light generated on the basis of the pulse signal is also referred to as "pulse laser".
- the pulse laser is emitted with predetermined pulse width and period.
- the mirror controller 24 drives the rotary mirror 251 included in the optical system 25.
- the mirror controller 24 functions as a power circuit of a motor to rotate the rotary mirror 251.
- the rotary mirror 251 is driven (rotated) on the basis of a drive current supplied from the mirror controller 24, and reflects the incident laser light.
- the rotary mirror 251 is configured to be rotatable around, for example, an axis.
- the rotary mirror 251 may be a double-sided mirror or a polygon mirror including three or more reflection surfaces (mirror surfaces).
- the optical system 25 further includes an optical element according to arrangement of the laser diode 23 and/or the light sensor 26. The detailed configuration of the optical system 25 will be described later.
- the number of rotations can be changed on the basis of the instruction of the ranging controller 21.
- the rotary mirror 251 may be a biaxial MEMS (Micro Electro Mechanical Systems) mirror.
- the rotary mirror 251 may be a combination of a rotary mirror and a monoaxial MEMS mirror assigned to scan of part of region.
- the rotary mirror may be referred to as "movable mirror”.
- the light sensor 26 is a light receiving element sensing light made incident on the ranging apparatus 20.
- the light sensor 26 is disposed such that laser light emitted from the laser diode 23 and reflected by the object outside the ranging apparatus 20 is made incident thereon via the optical system 25.
- the light sensor 26 converts the laser light made incident on the ranging apparatus 20 into an electrical signal. Thereafter, the light sensor 26 adjusts an output level of the converted electrical signal, and outputs the electrical signal to the measurement device 27.
- the light sensor 26 includes, for example, a photomultiplier element, as an element converting light into an electrical signal.
- a single-photon avalanche diode (SPAD) serving as a type of avalanche photodiodes is used as the photomultiplier element.
- SPAD single-photon avalanche diode
- the measurement device 27 measures the time of detection of the laser light by the light sensor 26 on the basis of the light receiving result transmitted from the light sensor 26. For example, the measurement device 27 integrates the light receiving results for each unit time in accordance with the number of ranging points, and determines the peak part of the integrated signal as the time of detection of the laser light. In addition, the measurement device 27 calculates time of flight (ToF) of the laser light on the basis of the time of emission of the laser light by the laser diode 23 and the time of detection of the laser light reflected by the subject. Thereafter, the measurement device 27 measures (ranges) the distance between the ranging apparatus 20 and the subject on the basis of the time of flight of the laser light and the speed of the laser light. Such a ranging method is also referred to as "ToF method". The measurement device 27 outputs a ranging result to the information processing apparatus 10 for each laser light emitted by the ranging apparatus 20.
- the measurement device 27 acquires the time of emission of the laser light by the laser diode 23 by, for example, notification from the ranging controller 21.
- the time of emission of the laser light may be measured by detection of the laser light emitted from the laser diode 23 by the light sensor in the ranging apparatus 20.
- the measurement device 27 may change an integration setting of light receiving results on the basis of an instruction from the ranging controller 21.
- the ranging controller 21 can also change the period and timing at which the laser diode 23 emits the pulse laser, the rotational speed of the rotary mirror 251, and/or the integration setting of light receiving results by the measurement device 27, on the basis of the instruction from the information processing apparatus 10. In this manner, the ranging controller 21 can change the angle of view and the number of ranging points of the ranging apparatus 20. In other words, the ranging controller 21 can change the setting of each of the laser driver 22, the mirror controller 24, and the measurement device 27 in association on the basis of the setting of the angle of view and the number of ranging points transmitted from the information processing apparatus 10.
- FIG. 4 is a schematic diagram illustrating an example of a configuration of an optical system included in the ranging apparatus according to the first arrangement.
- FIG. 4 also illustrates the laser diode 23, the light sensor 26, and an object OB together.
- the optical system 25 further includes, for example, optical elements 252, 253, and 254.
- Each of the optical elements 252 and 254 is, for example, a lens or a mirror.
- Each of the optical elements 252 and 254 may be formed of a combination of a plurality of lenses and/or a plurality of mirrors.
- the optical element 253 is, for example, a half mirror or a holed mirror.
- the pulse laser emitted by the laser diode 23 is also referred to as "outgoing light LE".
- the pulse laser (outgoing light LE) reflected by the object OB is also referred to as "reflected light LR".
- the optical element 252 guides the outgoing light LE emitted from the laser diode 23 to the optical element 253.
- the outgoing light LE guided by the optical element 252 is transmitted or passes through the optical element 253, and is applied to the rotary mirror 251.
- the rotary mirror 251 reflects the applied outgoing light LE in a direction corresponding to the incident angle of the outgoing light LE with respect to the applied surface.
- the reflected outgoing light LE is reflected by the object OB positioned in the traveling direction of the outgoing light LE outside the ranging apparatus 20.
- the reflected light LR from the object OB is reflected by the rotary mirror 251 and applied to the optical element 253.
- the optical element 253 reflects the reflected light LR reflected by the rotary mirror 251 toward the optical element 254.
- the optical element 254 guides the reflected light LR reflected by the optical element 253 to the light sensor 26.
- the light sensor 26 converts the reflected light LR guided by the optical element 254 into an electrical signal, and outputs the electrical signal to the measurement device 27.
- the present specification illustrates the case where the rotary mirror 251 is a polygon mirror including six reflection surfaces S1 to S6. Tilt angles of the reflection surfaces are mutually different.
- the ranging controller 21 controls the rotary mirror 251 such that the rotary mirror 251 rotates at fixed rotational speed based on fixed angle of view and ranging rate.
- the ranging apparatus 20 can scan the place to be ranged in a two-dimensional manner with the intermittently emitted outgoing light LE and the rotary mirror 251.
- the region that can be scanned by the ranging apparatus 20 is referred to as "scan area SA".
- a set of ranging results of a plurality of points corresponding to one scan is referred to as "frame”.
- An image of a frame is generated, for example, in correspondence with one rotation of the rotary mirror 251.
- the ranging apparatus 20 can successively acquire distance information of a distance to the object OB positioned in front of the ranging apparatus 20 by successively executing a scan.
- the optical system 25 may have any other configuration as long as it can execute a scan using laser light.
- FIG. 5 is a schematic diagram illustrating an example of a configuration of a scan area SA scanned by the ranging apparatus 20 according to the first arrangement.
- FIG. 5 illustrates an example of an emission direction of the outgoing light LE for one frame in the scan area SA.
- the outgoing light LE is applied to a PQR space.
- a R axis is an axis extending from the ranging apparatus 20 to the subject, and extends along, for example, the center of the emission direction of the outgoing light LE.
- a PQ plane is a curved surface orthogonal to the R axis and extending from the emission surface of the outgoing light LE in a concentric circle manner.
- a P axis and a Q axis are axes orthogonal to each other in the PQ plane.
- the distance data measured on the basis of each outgoing light LE is generated as, for example, a map on the PQ plane.
- the ranging system 1 is capable of mapping the distance data to the object existing in the space PQR in association with the FOV in the scan area SA, and recognize the distance to the object existing in the FOV.
- the ranging controller 21 achieves a scan in the P direction (lateral direction) by controlling the laser driver 22 and the mirror controller 24 and the like to intermittently emit the outgoing light LE at timings based on the set FOV.
- the scan area SA includes first line SS1 to sixth line SS6.
- the scan positions of the first line SS1 to the sixth line SS6 are based on the tilt angles of the reflection surfaces S1 to S6, respectively.
- the ranging apparatus 20 achieves a plurality of lines of scan shifted in the Q direction (vertical direction) by application of the outgoing light LE to different reflection surfaces by rotation of the rotary mirror 251.
- the ranging apparatus 20 can change the ranging direction (the position of the FOV) by adjusting the emission timing of the outgoing light LE.
- FIG. 5 illustrates three types of FOV1 to FOV3.
- the FOV1, FOV2, and FOV3 are associated with a left part, a middle part, and a right part of the scan area SA, respectively.
- the present example illustrates the outgoing light LE corresponding to the FOV2.
- the ranging controller 21 controls the laser driver 22 and the mirror controller 24 and the like such that the outgoing light LE is intermittently emitted in the FOV2.
- the ranging apparatus 20 can acquire distance information in the FOV2.
- the ranging apparatus 20 can selectively emit the outgoing light LE to each of the FOV1 and the FOV3 in the same manner as the FOV2, and acquire distance information of the associated FOV.
- the present example illustrates three types of FOVs that do not mutually overlap, but the positions of the FOVs are not limited thereto.
- the ranging apparatus 20 can change the positions of the FOVs to desired positions within the scan area SA.
- the ranging apparatus 20 can generate a plurality of pixels (distance data) arranged in a one-dimensional manner for one outgoing light LE.
- the pixels arranged in a one-dimensional manner are arranged along, for example, the Q axis.
- the ranging apparatus 20 repeatedly executes processing of the measurement period relating to measurement associated with one outgoing light LE while shifting in a one-dimensional manner along the P axis in each of the first line SS1 to the sixth line SS6. In this manner, the ranging apparatus 20 can generate distance data in the set FOV.
- Such a scanning method is also referred to as "multi-channel raster scan”.
- the outgoing light LE having an application surface having a vertically elongated shape is used as means for achieving multi-channel raster scan.
- the number of lines and/or the scan direction in one scan of the ranging apparatus 20 may have other settings.
- the following is an explanation of an example of the setting of the ranging direction of the ranging apparatus 20.
- the rotational speed of the rotary mirror 251 is fixed. For this reason, the reflection direction of the outgoing light LE by the rotary mirror 251 can be determined on the basis of a lapse of time from the initial position of the rotary mirror 251. Accordingly, the ranging apparatus 20 can control the emission direction of the outgoing light LE on the basis of the lapse of time from the initial position of the rotary mirror 251. Specifically, the ranging apparatus 20 can control the ranging direction without minutely controlling the number of rotations of the rotary mirror 251, by controlling the emission timing of the outgoing light LE.
- FIG. 6 is a timing chart illustrating an example of setting the ranging direction in the ranging apparatus 20 according to the first arrangement.
- FIG. 6 illustrates an example of a method of setting respective ranging directions corresponding to the FOV1 to FOV3 illustrated in FIG. 5 , with the configuration of the optical system 25 illustrated in FIG. 4 .
- the term "active (state)” in FIG. 6 indicates a state in which the ranging controller 21 supplies a pulse signal to the laser driver 22 and the laser diode 23 intermittently emits the outgoing light LE.
- non-active (state) indicates a state in which the ranging controller 21 supplies no pulse signal to the laser driver 22 and the laser diode 23 does not emit the outgoing light LE.
- one frame is divided into six periods P1 to P6.
- the periods P1 to P6 correspond to periods in which the outgoing light LE is reflected by the respective reflection surfaces S1 to S6 of the rotary mirror 251, respectively.
- the period P1 includes time t1-1, time t1-2, and t1-3.
- the period P2 includes time t2-1, time t2-2, and t2-3.
- the period P3 includes time t3-1, time t3-2, and t3-3.
- the period P4 includes time t4-1, time t4-2, and t4-3.
- the period P5 includes time t5-1, time t5-2, and t5-3.
- the period P6 includes time t6-1, time t6-2, and t6-3.
- the time t1-1, the time t2-1, the time t3-1, the time t4-1, the time t5-1, and the time t6-1 correspond to the respective start times of the periods P1 to P6, respectively.
- the time t1-2, the time t2-2, the time t3-2, the time t4-2, the time t5-2, and the time t6-2 correspond to the respective times after first time has passed from the start times of the periods P1 to P6, respectively.
- the time t1-3, the time t2-3, the time t3-3, the time t4-3, the time t5-3, and the time t6-3 correspond to the respective times after second time longer than the first time has passed from the start times of the periods P1 to P6, respectively.
- the ranging apparatus 20 changes to the active state in subsidiary periods SP1 with the times t1-1, t2-1, t3-1, t4-1, t5-1, and t6-1 serving as the respective starting points, and changes to the non-active state in the other periods.
- the ranging apparatus 20 can intermittently emit the outgoing light LE in the left part of the scan area SA, and range the ranging direction (FOV1) associated with the subsidiary periods SP1.
- the ranging apparatus 20 changes to the active state in subsidiary periods SP2 with the times t1-2, t2-2, t3-2, t4-2, t5-2, and t6-2 serving as the respective starting points, and changes to the non-active state in the other periods.
- the ranging apparatus 20 can intermittently emit the outgoing light LE in the middle part of the scan area SA, and range the ranging direction (FOV2) associated with the subsidiary periods SP2.
- the ranging apparatus 20 changes to the active state in subsidiary periods SP3 with the times t1-3, t2-3, t3-3, t4-3, t5-3, and t6-3 serving as the respective starting points, and changes to the non-active state in the other periods.
- the ranging apparatus 20 can intermittently emit the outgoing light LE in the right part of the scan area SA, and range the ranging direction (FOV3) associated with the subsidiary periods SP3.
- the ranging apparatus 20 can adjust the ranging direction by controlling the timings at which the pulse signal is supplied to the laser driver 22.
- the respective lengths of the subsidiary periods SP1, SP2, and SP3 are set substantially equal to each other. This is also applicable to a case where the ranging direction is set to a FOV different from the FOV1 to FOV3.
- the start timings and the end timings of the subsidiary periods SP may be different between the periods P1 to P6.
- FIG. 7 is a block diagram illustrating an example of a functional configuration of the ranging system 1 according to the first arrangement.
- the information processing apparatus 10 functions as an information processing part 101 and an image processing part 102
- the ranging apparatus 20 functions as an emission controller 201, a light projecting part 202, a light receiving part 203, and a measurement part 204.
- the information processing part 101 is, for example, a functional block corresponding to the CPU 11, the RAM 13, and the information collecting device 17.
- the image processing part 102 is, for example, a functional block corresponding to the CPU 11 and the RAM 13.
- the emission controller 201 is, for example, a functional block corresponding to the ranging controller 21 and the laser driver 22.
- the light projecting part 202 is a functional block corresponding to the laser diode 23 and the optical system 25.
- the light receiving part 203 is a functional block corresponding to the optical system 25 and the light sensor 26.
- the measurement part 204 is a functional block corresponding to the measurement device 27.
- the information processing part 101 determines the ranging direction (FOV) of the ranging apparatus 20 on the basis of information acquired from the sensor and the like of the information collecting device 17.
- the information processing part 101 transmits control parameters corresponding to the determined FOV to each of the emission controller 201 and the image processing part 102.
- the emission controller 201 supplies a pulse signal to the light projecting part 202 on the basis of the control parameters received from the information processing part 101.
- the light projecting part 202 emits the outgoing light LE in accordance with the pulse signal received from the emission controller 201.
- the light projecting part 202 also scans the ranging direction (FOV) determined by the information processing part 101, on the basis of control of the emission timings of the outgoing light LE by the emission controller 201.
- the light receiving part 203 receives the reflected light LR reflected by the object OB in the FOV, and converts the reflected light LR into an electrical signal.
- the light receiving part 203 transmits the converted electrical signal (light receiving result) to the measurement part 204.
- the measurement part 204 generates distance data in each ranging point on the basis of the light receiving result of each outgoing light LE received from the light receiving part 203.
- the measurement part 204 transmits the generated distance data to the image processing part 102.
- the image processing part 102 generates an image for each frame using the distance data received from the measurement part 204 and information of the ranging direction received from the information processing part 101.
- the image generated by the image processing part 102 includes distance information between the ranging apparatus 20 and the object OB in the FOV.
- the image generated by the image processing part 102 is referred to by, for example, the control program of the vehicle in which the ranging system 1 is installed.
- FIG. 8 is a flowchart illustrating an example of a ranging operation of the ranging system 1 according to the first arrangement. The following is an explanation of the ranging operation of the ranging system 1 according to the first arrangement with reference to FIG. 8 .
- the ranging system 1 starts a ranging operation (Start), for example, when the transportation equipment VE starts operation.
- the ranging system 1 loads the ranging settings (S11).
- the ranging settings include settings, such as the angle of view, the resolution, and the ranging direction.
- the ranging system 1 starts ranging on the basis of the loaded ranging settings (S12). Specifically, the information processing apparatus 10 transmits the control parameters based on the ranging settings to the ranging apparatus 20. Thereafter, the ranging apparatus 20 starts ranging with the angle of view, the resolution, and the ranging direction based on the received control parameters.
- the information analysis processing is processing in which the information processing apparatus 10 analyzes information collected by the camera and/or the sensor of the information collecting device 17. Specific examples of the information analyzed by the information processing apparatus 10 will be explained in third to fifth arrangements.
- the ranging system 1 adjusts the ranging direction of the ranging apparatus 20 on the basis of the analyzed information (S14). Specifically, the information processing apparatus 10 transmits control parameters corresponding to the FOV based on the analysis results in the processing at S13 to the ranging apparatus 20. Thereafter, the ranging apparatus 20 adjusts the ranging direction on the basis of the received control parameters.
- the ranging apparatus 20 uses, for example, the method explained with reference to FIG. 6 to adjust the ranging direction.
- the information processing apparatus 10 may designate the emission timing of the outgoing light LE for the ranging apparatus 20, or designate the FOV setting based on the analysis results from preset FOV settings.
- a set of the processing of S13 and the processing of S14 is also referred to as "ranging direction adjusting operation".
- the ranging system 1 checks whether a ranging operation end instruction has been received (S15).
- the ranging operation end instruction may be received via the user interface 15, or generated in accordance with predetermined conditions.
- the ranging system 1 according to the first arrangement explained above enables ranging of a noted range while the resolution is maintained.
- the following is an explanation of details of the advantageous effect of the first arrangement.
- LiDARs using the ToF method are known as ranging apparatuses capable of executing long-distance ranging.
- a LiDAR executes ranging for each pair of emission and reception of laser light.
- the number of ranging points per unit area of a LiDAR that is, the number of ranging points of a LiDAR is smaller than that of cameras capable of acquiring an image only by light reception.
- a two-dimensional image acquired by a camera has, for example, 2 to 20 megapixels.
- the number of pixels that can be ranged by one frame of a LiDAR is, for example, 0.1 to 0.2 megapixels or around.
- a LiDAR has limitations in the number of points that can be ranged by one frame.
- the resolution of a LiDAR decreases as a wider angle of view is set, and increases as a narrower angle of view is set.
- a possible method for satisfying the resolution required in a LiDAR includes narrowing the angle of view, that is, emitting the outgoing light LE in a concentrated manner in a part of ranging direction (FOV) in the scan area SA. In this manner, the LiDAR can acquire ranging results of high resolution, and improve the detection accuracy for a long-distance subject.
- FOV part of ranging direction
- no attention may be paid to ranging in a direction that the transportation equipment VE should note.
- the ranging system 1 controls the ranging direction of the ranging apparatus 20 (LiDAR) on the basis of the information collected by the information processing apparatus 10 with the sensor or the like. Specifically, the information processing apparatus 10 determines the ranging direction (FOV) of the ranging apparatus 20 to include the subject to be noted, on the basis of the collected information. The information processing apparatus 10 notifies the ranging apparatus 20 of the setting of the determined ranging direction. The ranging apparatus 20 changes the emission timings of the outgoing light LE on the basis of the notification from the information processing apparatus 10. In this manner, the ranging apparatus 20 can change the ranging direction to a direction to be noted in movement of the transportation equipment VE, while fixing the angle of view at which the outgoing light LE is to be applied in the scan area SA.
- the ranging system 1 can enhance the detection accuracy for the long-distance subject by properly setting the ranging direction and/or the resolution and the like.
- the ranging system 1 can secure the required ranging resolution in the ranging region required from the use case in front of the transportation equipment VE, that is, ranging of the noted range.
- the ranging system 1 can acquire information of the subject in a region for which a field of view cannot be secured with a camera or the like, by direction control of the ranging apparatus 20. Accordingly, the transportation equipment VE using the ranging system 1 is enabled to improve safety in moving.
- a ranging system 1A according to the second arrangement changes the ranging direction of a LiDAR by using a movable mount on which the housing of the LiDAR is installed.
- the following is an explanation of the ranging system 1A according to the second arrangement, with respect to points thereof different from the first arrangement.
- FIG. 9 is a schematic diagram illustrating an example of a configuration of the ranging system 1A according to the second arrangement.
- the ranging system 1A includes, for example, an information processing apparatus 10A (not illustrated), a ranging apparatus 20, and a movable mount 30.
- the information processing apparatus 10A has a configuration similar to that of the information processing apparatus 10 according to the first arrangement, and further controls the movable mount 30.
- the information processing apparatus 10A supplies a control signal based on information collected by the information collecting device 17 to the movable mount 30.
- the ranging apparatus 20 is installed on the movable mount 30.
- the movable mount 30 is a mount to be driven based on control of the information processing apparatus 10A.
- the movable mount 30 is, for example, configured to be rotatable around an axis. When the movable mount 30 is rotated, the ranging apparatus 20 on the movable mount 30 is also rotated.
- the movable mount 30 may be configured to operate in a multiaxial manner.
- the movable mount 30 may be configured to change the direction of the ranging apparatus 20 both in the horizontal direction and in the vertical direction.
- the ranging apparatus 20 may have a function as the movable mount 30.
- FIG. 10 is a block diagram illustrating an example of a functional configuration of the ranging system 1A according to the second arrangement.
- the information processing apparatus 10A functions as an information processing part 101A and an image processing part 102
- the ranging apparatus 20 functions as an emission controller 201, a light projecting part 202, a light receiving part 203, and a measurement part 204, in the same manner as the first arrangement
- the movable mount 30 functions as a motor controller 301.
- the information processing part 101A is, for example, a functional block corresponding to the CPU 11, the RAM 13, and the information collecting device 17.
- the motor controller 301 is a functional block corresponding to the movable mount 30.
- the information processing part 101A determines the ranging direction (FOV) of the ranging apparatus 20 on the basis of information acquired from the sensor and the like of the information collecting device 17, in the same manner as the information processing part 101 of the first arrangement.
- the information processing part 101A transmits control parameters of the ranging direction corresponding to the determined FOV to each of the motor controller 301 the emission controller 201.
- the motor controller 301 drives (rotates) the movable mount 30 on the basis of the control parameters received from the information processing part 101 to adjust the direction of the emission port of the ranging apparatus 20.
- the emission controller 201 supplies a pulse signal to the light projecting part 202 on the basis of the control parameters received from the information processing part 101A, in the same manner as the first arrangement.
- the other configurations and operations of the ranging system 1A according to the second arrangement are similar to those of the ranging system 1 according to the first arrangement.
- the control parameters transmitted to the motor controller 301 may be different from the control parameters transmitted to the emission controller 201. It suffices that the control parameters transmitted by the information processing part 101A are optimized for each of the motor controller 301 and the emission controller 201 to enable ranging corresponding to the determined FOV.
- the ranging direction of the ranging apparatus 20 may be changed using only drive of the movable mount 30 without changing the ranging timings of the ranging apparatus 20.
- the ranging system 1A according to the second arrangement includes the movable mount 30 driven on the basis of control of the information processing apparatus 10.
- the movable mount 30 is configured to be capable of controlling the ranging direction of the ranging apparatus 20 on the basis of the setting of the FOV determined by the information processing apparatus 10.
- the ranging system 1A according to the second arrangement is capable of enlarging a scannable region, and adjusting the ranging direction in a wider range than that of the ranging system 1 according to the first arrangement.
- a ranging system 1B according to the third arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the ranging apparatus 20 on the basis of location information of the railroad vehicle RV.
- the following is an explanation of the ranging system 1B according to the third arrangement, with respect to points different from the first and the second arrangements.
- FIG. 11 is a block diagram illustrating an example of a configuration of the ranging system 1B according to the third arrangement.
- the ranging system 1B includes an information processing apparatus 10B and a ranging apparatus 20.
- the information processing apparatus 10 has configuration acquired by adapting the information processing apparatus 10 according to the first arrangement for use as an autonomous traveling system for railroad vehicles RV.
- the information processing apparatus 10B includes a train controller 40, a vehicle speed controller 41, an image processor 42, a vehicle speed sensor 43, a GNSS (Global Navigation Satellite System) device 44, a camera 45, and a line information database 46.
- GNSS Global Navigation Satellite System
- the train controller 40 generates a control signal relating to acceleration and deceleration of the railroad vehicle RV, on the basis of vehicle speed information acquired from the vehicle speed sensor 43, an instruction from the image processor 42, and operation information acquired from the line information database 46, and the like.
- the information acquired from the image processor 42 includes, for example, location information of the railroad vehicle RV.
- the train controller 40 transmits the generated control signal to the vehicle speed controller 41. In this manner, the train controller 40 adjusts the speed between stations and controls traveling of the railroad vehicle RV.
- the vehicle speed controller 41 includes an acceleration unit and an deceleration unit to adjust the speed of the railroad vehicle RV.
- the vehicle speed controller 41 controls the motor connected to wheels of the railroad vehicle RV and/or brakes.
- the image processor 42 generates an image, for example, on the basis of distance information from the ranging apparatus 20.
- the image processor 42 determines the distance from the starting point of the railroad vehicle RV by putting image information from the camera 45, ranging information from the ranging apparatus 20, location information from the GNSS device 44, and/or the line information database 46 together.
- the image processor 42 can specify the starting point of the railroad vehicle RV, for example, on the basis of the line information database 46.
- the image processor 42 instructs the train controller 40 to stop the railroad vehicle RV in a case where it is required to stop the train in accordance with the result of detection of the distance from the starting point and/or the ranging results.
- the image processor 42 changes the ranging direction of the ranging apparatus 20 on the basis of the collected information.
- the vehicle speed sensor 43, the GNSS device 44, and the camera 45 are devices to collect information of the railroad vehicle RV itself or the surroundings.
- the vehicle speed sensor 43 is a sensor detecting the current speed of the railroad vehicle RV.
- the vehicle speed sensor 43 transmits the detected speed information to the train controller 40.
- the GNSS device 44 is a positioning device receiving radio waves emitted from a plurality of artificial satellites, and specifying the current location of the railroad vehicle RV on the basis of the received radio waves.
- the GNSS device 44 includes, for example, a receiver converting a satellite signal into digital data, a receiving antenna to receive a satellite signal, an autonomous measurement device, such as an acceleration sensor and a gyrosensor, an arithmetic processing unit calculating the current location from the satellite signal, and a storage device.
- the GNSS device 44 transmits the location information calculated on the basis of the satellite signal to the image processor 42.
- the camera 45 is an optical device capable of imaging an image around the railroad vehicle RV.
- the camera 45 is provided in a front part of the railroad vehicle RV.
- the camera 45 transmits the acquired image information to the image processor 42.
- the line information database 46 retains information of the line on which the railroad vehicle RV travels and/or information relating to the operation of the railroad vehicle RV, and the like.
- the line information database 46 includes distance information of a distance from the starting point on the line on which the railroad vehicle RV travels.
- Examples of the information necessary for operation of the train include information of a speed limit of the railroad vehicle RV, information of stations at which the train stops, and information of stopping positions of the stations. The information necessary for operation of the train is set in accordance with the distance information from the starting point or the location information.
- the ranging apparatus 20 can change the ranging direction on the basis of an instruction from the image processor 42.
- the instruction as to the ranging direction from the image processor 42 to the ranging apparatus 20 include information relating to the position for the target to be noted or the ranging direction.
- the ranging apparatus 20 acquires ranging information of the subject, such as an obstacle existing in front of the railroad vehicle RV, in a two-dimensional manner on the basis of the FOV designated by the image processor 42, and transmits the acquired ranging information to the image processor 42.
- the instruction from the image processor 42 is based on, for example, distance information of the distance to the station to stop at and/or information of a sign position serving as a criterion of the stopping position, and the like.
- the distance information of the distance to the station to stop at is acquired from, for example, the operation information acquired from the line information database 46 and by the GNSS device 44.
- each of the train controller 40 and the image processor 42 corresponds to, for example, the CPU 11, the ROM 12, and the RAM 13 of the information processing apparatus 10 according to the first arrangement.
- the train controller 40 and the image processor 42 are, for example, computers configured to be capable of communicating with each other.
- the line information database 46 is stored in the storage device 14 or the like.
- the vehicle speed sensor 43, the GNSS device 44, and the camera 45 correspond to the information collecting device 17.
- the devices in the information processing apparatus 10B may be connected via a network cable, such as Ethernet (registered trademark).
- Ethernet registered trademark
- the term "obstacle" means, for example, an object obstructing train operations.
- FIG. 12 is a block diagram illustrating an example of a functional configuration of the ranging system 1B according to the third arrangement.
- the information processing apparatus 10B functions as a location information collecting part 103, a routing information acquisition part 104, the line information database 46, and an image processing part 102
- the ranging apparatus 20 functions as an emission controller 201, a light projecting part 202, a light receiving part 203, and a measurement part 204, in the same manner as the first arrangement.
- the location information collecting part 103 is a functional block corresponding to the GNSS device 44 and the image processor 42.
- the routing information acquisition part 104 is a functional block corresponding to the image processor 42.
- the location information collecting part 103 collects location information of the railroad vehicle RV on the basis of the measurement results of the GNSS device 44. To collect the location information, the location information collecting part 103 uses, for example, a position measuring arithmetic processing algorithm including satellite positioning signal processing, autonomous measurement data arithmetic processing, and time arithmetic processing. The location information collecting part 103 transmits the collected location information to the routing information acquisition part 104.
- a position measuring arithmetic processing algorithm including satellite positioning signal processing, autonomous measurement data arithmetic processing, and time arithmetic processing.
- the routing information acquisition part 104 acquires operation information in the vicinity of the current location of the railroad vehicle RV from the line information database 46 on the basis of the location information received from the location information collecting part 103.
- the routing information acquisition part 104 determines the ranging direction (FOV) of the ranging apparatus 20 on the basis of the acquired operation information. Thereafter, the routing information acquisition part 104 transmits control parameters corresponding to the determined FOV to each of the emission controller 201 and the image processing part 102.
- the routing information acquisition part 104 may acquire the ranging direction at the current location with reference to the line information database 46 using the location information.
- the emission controller 201 supplies a pulse signal to the light projecting part 202 on the basis of the control parameters received from the routing information acquisition part 104.
- the light projecting part 202 emits pulse laser (outgoing light LE) in accordance with the pulse signal received from the emission controller 201, in the same manner as the first arrangement.
- the light receiving part 203 receives the reflected light LR reflected from the object OB in the FOV and converts the reflected light LR into an electrical signal.
- the measurement part 204 transmits the electrical signal (light receiving results) received from the light receiving part 203 to the image processing part 102.
- the image processing part 102 generates an image for each frame using the distance data received from the measurement part 204 and the information of the ranging direction received from the routing information acquisition part 104.
- the other configurations of the ranging system 1B according to the third arrangement are the same as those of the ranging system 1 according to the first arrangement.
- FIG. 13 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system 1B according to the third arrangement. The following is an explanation of the ranging direction adjusting operation of the ranging system 1B according to the third arrangement.
- the information processing apparatus 10B collects location information from the GNSS device 44 (S31) .
- the information processing apparatus 10B acquires operation information at the current location on the basis of the acquired location information and the line information database 46 (S32).
- the information processing apparatus 10B changes the ranging direction of the ranging apparatus 20 on the basis of the acquired operation information (S33).
- the ranging system 1B ends a series of processes in FIG. 13 , that is, one ranging direction adjusting operation (End).
- the other operations of the ranging system 1B according to the third arrangement are the same as those of the ranging system 1 according to the first arrangement.
- FIG. 14 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system 1B according to the third arrangement.
- a railroad vehicle RV1 is located on a line RL0.
- the line RL0 is divided into two lines RL1 and RL2 via a branch part BR.
- a platform HM for railroad vehicles RV is located between the lines RL1 and RL2.
- parts of the lines RL1 and RL2 adjacent to the platform HM correspond to a first track FL and a second track SL, respectively.
- a railroad vehicle RV2 is stopped at the first track FL.
- the railroad vehicle RV1 is scheduled to stop at the first track FL.
- the railroad vehicle RV1 detects that it has moved to the position of the line RL0, the railroad vehicle RV1 acquires operation information based on the position of the line RL0, and determines the ranging direction (direction of FOV).
- the railroad vehicle RV1 sets the ranging direction to a ranging direction toward the first track FL from a position on the line RL0.
- the railroad vehicle RV1 can check presence/absence of any railroad vehicle RV stopped in the traveling direction thereof and/or presence/absence of an obstacle.
- the ranging system 1B determines the ranging direction at the current location at least on the basis of the location information of the railroad vehicle RV and the line information database 46.
- a method using a monocular camera and/or a stereo camera is known as a method for detecting an obstacle existing ahead of the railroad vehicle.
- these cameras have problems in the detection accuracy for subjects at a long distance, as described in the first arrangement.
- the detection accuracy for subjects by cameras tends to deteriorate in a case of insufficient quantity of light. Imaging with a camera can be assisted by illumination ahead of the railroad vehicle RV, but a region that cannot be followed by illumination may occur.
- the railroad vehicle RV includes the ranging apparatus 20.
- the ranging apparatus 20 can detect an obstacle at a long distance with higher accuracy than that of cameras, with the narrower angle of view.
- the ranging system 1B according to the third arrangement controls the ranging direction of the ranging apparatus 20 with reference to the line information database 46 in accordance with the current location of the traveling railroad vehicle RV.
- the GNSS device 44 can execute measurement regardless of the quantity of light of the surroundings.
- the ranging system 1B can set a ranging direction based on the operation information in the ranging apparatus 20, regardless of the quantity of light of the surroundings.
- the ranging system 1B can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the ranging apparatus 20 with the required resolution, in the same manner as the first arrangement.
- the ranging system 1B can secure the required ranging resolution in ranging of the ranging region required from the use case in front of the railroad vehicle RV, that is, ranging of the noted range.
- the ranging system 1B can acquire information of the subject in a region for which a field of view cannot be secured with a camera or illumination, by direction control of the ranging apparatus 20. Accordingly, the railroad vehicle RV using the ranging system 1B is enabled to improve safety in traveling.
- a ranging system 1C according to the fourth arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the ranging apparatus 20 on the basis of the shape of the line in the traveling direction of the railroad vehicle RV.
- the following is an explanation of the ranging system 1C according to the fourth arrangement with respect to points different from the first to the third arrangements.
- the ranging system 1C according to the fourth arrangement includes an information processing apparatus 10C and a ranging apparatus 20.
- the hardware configuration of the information processing apparatus 10C is the same as, for example, that of the information processing apparatus 10B according to the third arrangement.
- FIG. 15 is a block diagram illustrating an example of a functional configuration of the ranging system 1C according to the fourth arrangement.
- the information processing apparatus 10C functions as an image collecting part 105, a line detecting part 106, and an image processing part 102
- the ranging apparatus 20 of the ranging system 1C functions as an emission controller 201, a light projecting part 202, a light receiving part 203, and a measurement part 204, in the same manner as the first arrangement.
- the image collecting part 105 is a functional block corresponding to a camera 45 and an image processor 42.
- the line detecting part 106 is a functional block corresponding to the image processor 42.
- the image collecting part 105 collects an image taken by the camera 45. Thereafter, the image collecting part 105 transmits the collected image to the line detecting part 106.
- the line detecting part 106 detects a line from the image received from the image collecting part 105. Specifically, the line detecting part 106 detects the line ahead of the railroad vehicle RV, and determines a region on which the railroad vehicle RV travels on the line. Thereafter, the line detecting part 106 determines the ranging direction (FOV) of the ranging apparatus 20 on the basis of the acquired line information. For example, the line detecting part 106 calculates the distance in the traveling direction on the basis of the track of the detected line, and determines the ranging direction to include a point corresponding to a train forward distance designated separately.
- FOV ranging direction
- the train forward distance is a distance ahead of the railroad vehicle RV along the line.
- the train forward distance may be preset or acquired from the line information database 46.
- the line detecting part 106 transmits control parameters corresponding to the determined FOV to each of the emission controller 201 and the image processing part 102.
- the emission controller 201 supplies a pulse signal to the light projecting part 202 on the basis of the control parameters received from the line detecting part 106.
- the light projecting part 202 emits pulse laser (outgoing light LE) in accordance with the pulse signal received from the emission controller 201.
- the light receiving part 203 receives reflected light LR reflected from the object OB in the FOV and converts the reflected light LR into an electrical signal.
- the measurement part 204 transmits the electrical signal (light receiving results) received from the light receiving part 203 to the image processing part 102.
- the image processing part 102 generates an image for each frame using the distance data received from the measurement part 204 and the information of the ranging direction received from the line detecting part 106.
- the other configurations of the ranging system 1C according to the fourth arrangement are the same as those of the ranging system 1B according to the third arrangement.
- the line detecting part 106 detects a line on the basis of a feature quantity serving as a yardstick indicating line likelihood based on the predetermined criterion.
- the line detecting part 106 may use information, such as detected line information, line width information, and branch information, to detect a line.
- information such as detected line information, line width information, and branch information.
- FIG. 16 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system 1C according to the fourth arrangement. The following is an explanation of the ranging direction adjusting operation of the ranging system 1C according to the fourth arrangement with reference to FIG. 16 .
- the information processing apparatus 10C collects an image from the camera 45 (S41).
- the information processing apparatus 10C detects a line by analyzing the acquired image (S42).
- the information processing apparatus 10C determines a ranging point of the railroad vehicle RV on the basis of line detection results (S43).
- the ranging point determined by the processing at S43 is based on a predetermined train forward distance.
- the information processing apparatus 10C changes the ranging direction of the ranging apparatus 20 on the basis of information of the determined ranging point (S44).
- the ranging system 1C ends a series of processes in FIG. 16 , that is, the ranging direction adjusting operation in the fourth arrangement (End).
- the other operations of the ranging system 1C according to the fourth arrangement are the same as those of the ranging system 1 according to the first arrangement.
- FIG. 17 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system 1C according to the fourth arrangement.
- a railroad vehicle RV is located on a meandering line RL.
- the angle of view of the camera 45 provided in the front part of the railroad vehicle RV is indicated as "FOVc".
- the FOVc of the camera 45 is set broader than the FOV of the ranging apparatus 20.
- the railroad vehicle RV is traveling on a rightward curved part of the line RL.
- the railroad vehicle RV detects the rightward curved line RL on the basis of an image from the camera 45, and calculates the train forward distance along the line RL. Thereafter, the railroad vehicle RV sets the ranging direction to a direction including the predetermined train forward distance. In this manner, the railroad vehicle RV is enabled to check presence/absence of an obstacle on the line in the traveling direction and the like.
- the ranging system 1C according to the fourth arrangement can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the ranging apparatus 20 with the required resolution, in the same manner as the first arrangement.
- the ranging system 1C according to the fourth arrangement can early find an obstacle existing in the traveling direction, because the FOV is set with the predetermined train forward distance. Accordingly, the railroad vehicle RV using the ranging system 1C is enabled to improve safety in traveling.
- a ranging system 1D according to the fifth arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the ranging apparatus 20 in accordance with the object detected around the railroad vehicle RV.
- the following is an explanation of the ranging system 1D according to the fifth arrangement with respect to points different from the first to the fourth arrangements.
- the ranging system 1D according to the fifth arrangement includes an information processing apparatus 10D and a ranging apparatus 20.
- the hardware configuration of the information processing apparatus 10D is the same as that of the information processing apparatus 10B according to the third arrangement.
- FIG. 18 is a block diagram an example of a functional configuration of the ranging system 1D according to the fifth arrangement.
- the information processing apparatus 10D of the ranging system 1D functions as an image collecting part 105, an object recognition part 107, a sample database (sample DB) 47, and an image processing part 102.
- the ranging apparatus 20 of the ranging system 1C functions as an emission controller 201, a light projecting part 202, a light receiving part 203, and a measurement part 204, in the same manner as the first arrangement.
- the object recognition part 107 is a functional block corresponding to the image processor 42.
- the sample database 47 is stored in, for example, the storage device 14.
- the image collecting part 105 collects an image taken by the camera 45, in the same manner as the fourth arrangement.
- the image collecting part 105 transmits the collected image to the line detecting part 106.
- the object recognition part 107 detects an object from the image received from the image collecting part 105.
- the object recognition part 107 refers to, for example, the same database 47 to detect an object.
- the sample database 47 includes a library relating obstructions in traveling of the railroad vehicles RV. Examples of information of obstructions recorded on the sample database 47 include shapes of obstacles that may exist in the line, such as people, animals, fallen trees, and vehicles.
- the library of the sample database 47 include information relating to shapes and the like of these obstacles.
- the object recognition part 107 checks the image received from the image collecting part 105 against the library of obstacles of the sample database 47, and calculates an image position of a region having high similarity. The object recognition part 107 determines a region having high similarity as a region in which an obstacle exists. Thereafter, the object recognition part 107 determines the ranging direction (FOV) of the ranging apparatus 20 to a direction of a point determined as a point at which an obstacle exists in a three-dimensional manner. Thereafter, the object recognition part 107 transmits control parameters corresponding to the determined FOV to each of the emission controller 201 and the image processing part 102.
- FOV ranging direction
- the object recognition part 107 may detect a line ahead of the railroad vehicle RV on the basis of the algorithm as explained in the fourth arrangement.
- the object recognition part 107 may set the FOV in accordance with position relation between the detected line and the object.
- the other configurations of the ranging system 1D according to the fifth arrangement are the same as those of the ranging system 1B according to the third arrangement.
- FIG. 19 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system 1D according to the fifth arrangement. The following is an explanation of the ranging direction adjusting operation of the ranging system 1D according to the fifth arrangement.
- the information processing apparatus 10D collects an image from the camera 45 (S51).
- the information processing apparatus 10D analyzes the acquired image and detects an object OB (S52). In the processing at S52, the information processing apparatus 10D may further detect a line.
- the information processing apparatus 10D checks whether the object OB has been detected in a predetermined region (S53).
- the predetermined region is, for example, a region on the line RL.
- the configuration is not limited thereto, but the predetermined region may include a region in the vicinity of the line RL.
- the ranging system 1D ends a series of processes in FIG. 19 , that is, the ranging direction adjusting operation in the fifth arrangement (End).
- the ranging system 1D changes the ranging direction of the ranging apparatus 20 on the basis of information of the detected position of the object OB (S54).
- the ranging system 1C ends a series of processes in FIG. 19 , that is, the ranging direction adjusting operation in the fifth arrangement (End).
- the other operations of the ranging system 1C according to the fifth arrangement are the same as those of the ranging system 1 according to the first arrangement.
- FIG. 20 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system 1D according to the fifth arrangement.
- a railroad vehicle RV is located on a meandering line RL.
- the angle of view of the camera 45 provided in the front part of the railroad vehicle RV is indicated as "FOVc".
- the FOVc of the camera 45 is set broader than the FOV of the ranging apparatus 20.
- the railroad vehicle RV is traveling on a rightward curved part of the line RL.
- the railroad vehicle RV detects an object OB on the rightward curved line RL on the basis of an image from the camera 45.
- the railroad vehicle RV sets the ranging direction to a direction including the object OB. In this manner, the railroad vehicle RV is enabled to accurately acquire a distance to the obstacle on the line.
- the ranging system 1D according to the fifth arrangement can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the ranging apparatus 20 with the required resolution, in the same manner as the first arrangement.
- the ranging system 1D according to the fifth arrangement can accurately calculate a distance to an obstacle (object OB) in the predetermined region. This configuration enables the ranging system 1D according to the fifth arrangement to more accurately determine a risk in traveling and controls vehicle speed based on the risk in traveling. Accordingly, the railroad vehicle RV using the ranging system 1D is enabled to improve safety in traveling.
- a ranging system 1E according to the sixth arrangement is mounted on a railroad vehicle RV, and uses the methods for changing the ranging direction explained in the third to the fifth arrangements properly.
- the following is an explanation of the ranging system 1E according to the sixth arrangement with respect to points different from the first to the fifth arrangements.
- the ranging system 1E includes an information processing apparatus 10E including respective functions of the information processing apparatuses 10B, 10C, and 10D and a ranging apparatus 20.
- the hardware configuration of the information processing apparatus 10E is the same as that of the information processing apparatus 10B according to the third arrangement.
- the RAM 13 stores setting information.
- the setting information includes information relating to the setting of the ranging direction adjusting operation.
- the setting information may be stored in the storage device 14, or stored in an external device connected to the ranging system 1 in a wired or wireless manner.
- FIG. 21 is a table illustrating an example of the setting information stored in the information processing apparatus 10E according to a sixth arrangement.
- the setting information includes information indicating whether each of a first setting, a second setting, and a third setting is valid.
- the first setting is associated with the method for adjusting the ranging direction based on the location information of the railroad vehicle RV described in the third arrangement.
- the second setting is associated with the method for adjusting the ranging direction based on the shape of the line described in the fourth arrangement.
- the third setting is associated with the method for adjusting the ranging direction based on the detection results of a specific object described in the fifth arrangement.
- one of the first setting, the second setting, and the third setting can be set to valid ("0").
- each of the first setting, the second setting, and the third setting is set to invalid ("-").
- the other structures of the ranging system 1E according to the sixth arrangement are the same as those in the ranging system 1B according to the third arrangement.
- FIG. 22 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system 1E according to the sixth arrangement. The following is an explanation of the ranging direction adjusting operation of the ranging system 1E.
- the ranging system 1E regularly executes a series of processes in FIG. 22 (Start).
- the ranging system 1E checks whether the first setting is valid, with reference to the setting information stored in the RAM 13 (S61).
- the ranging system 1E executes ranging direction setting based on the location, that is, the ranging direction adjusting operation described in the third arrangement (S62).
- the processing at S62 is finished, the ranging system 1E ends a series of processes in FIG. 22 (End).
- the ranging system 1E checks whether the second setting is valid, with reference to the setting information stored in the RAM 13 (S63).
- the ranging system 1E executes ranging direction setting based on the line, that is, the ranging direction adjusting operation described in the fourth arrangement (S64).
- the processing at S64 is finished, the ranging system 1E ends a series of processes in FIG. 22 (End).
- the ranging system 1E checks whether the third setting is valid, with reference to the setting information stored in the RAM 13 (S65) .
- the ranging system 1E executes ranging direction setting based on the object, that is, the ranging direction adjusting operation described in the fifth arrangement (S66).
- the processing at S66 is finished, the ranging system 1E ends a series of processes in FIG. 22 (End).
- the ranging system 1E maintains the current ranging direction setting, and ends a series of processes in FIG. 22 (End).
- the ranging system 1E according to the sixth arrangement is configured to use the ranging direction adjusting operations described in the third to the fifth arrangements properly according to the user's request.
- This structure enables the ranging system 1E to adjust the ranging direction using the method more suitable to the use environment of the railroad vehicle RV.
- the arrangements described above may be used in combination in a possible range.
- the second arrangement may be combined with any of the third to the sixth arrangements.
- the third to the sixth arrangements illustrate a case where the transportation equipment VE is a railroad vehicle RV, but the structure is not limited thereto.
- the third to the sixth arrangements are applicable to transportation equipment VE using elements indicating routes in the same manner as the line.
- the third to the sixth arrangements are also applicable to fixed-route buses.
- part of functions of the information processing apparatus 10 may be installed in the ranging apparatus 20.
- the ranging apparatus 20 may achieve each of the functions of the information processing parts 101 and 101A, the routing information acquisition part 104, the line detecting part 106, and the object recognition part 107.
- the processing of determining the ranging direction (FOV) may be executed by the ranging controller 21 of the ranging apparatus 20.
- information acquired by each of sensors of the information collecting device 17 is transmitted to the ranging controller 21.
- Part of functions of the ranging controller 21 may be provided in the light sensor 26 and/or the measurement device 27. In this manner, the ranging apparatus 20 can timely execute minute operations.
- the ranging direction adjusting operation may be achieved by an embedded computer including a CPU, a memory, a bus, and an input/output circuit (I/O).
- an embedded computer including a CPU, a memory, a bus, and an input/output circuit (I/O).
- the CPU included in the ranging system 1 may be another circuit.
- a MPU Micro Processing Unit
- Each of processes described in the arrangements may be achieved by dedicated hardware.
- the processing executed by software and the processing executed by hardware may exist in a mixed manner, or only one of them may exist.
- the ranging controller 21 and/or the CPU may also be referred to as "control circuit” and/or “processor”.
- the measurement device 27 may also be referred to as "measurement circuit”.
- the image processor 42 may also be referred to as "image processing circuit”.
- the laser diode 23 may also be referred to as "light source”.
- the term "train forward distance” may be rephrased according to the type of the transportation equipment VE.
- the element "line” may also be referred to as "traveling route”.
- the ranging apparatus 20 executes multi-channel raster scan, but other scanning methods may be used.
- the ranging apparatus 20 may use "raster scan”, “multi-channel scan”, and/or "OPA method (Optical Phased Array)", as other scanning methods.
- OPA method Optical Phased Array
- the ranging apparatus 20 can adjust the ranging direction (position of FOV) by, for example, adjusting the emission timings of the pulse laser, in a case of using either a mechanical method or the OPA method is used as the scanning method.
- a ranging apparatus comprising:
- Clause 2 The ranging apparatus of clause 1, wherein the first control circuit changes the emission direction of the first laser light by changing timings at which the light source intermittently emits the first laser light while the movable mirror rotating at constant speed makes one rotation.
- Clause 7 The ranging system of clause 6, wherein the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal based on the detected traveling route.
- Clause 8 The ranging system of clause 7, wherein the second control circuit generates the first signal including control parameters to emit the first laser light by the light source in a direction including a part having a distance from the transportation equipment being a first distance.
- Clause 10 The ranging system of clause 6, wherein the second control circuit detects an obstacle from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light to a position of the obstacle.
- Clause 12 The ranging system of clause 10, wherein the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light in a direction including the position of the obstacle, in a case where the obstacle is positioned on the traveling route.
- Clause 14 The ranging system of any one of clauses 3 to 13, wherein the transportation equipment is a railroad vehicle.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
According to one arrangement, a ranging apparatus includes a light source (23), a movable mirror (251), a light sensor (26), a measurement circuit (27), and a first control circuit (21). The movable mirror reflects each of first and second laser lights. The second laser light corresponds to the first laser light reflected by an external subject. The light sensor detects the second laser light reflected by the movable mirror. The measurement circuit measures a distance to the subject based on a timing of emission of the first laser light by the light source and a timing of detection of the second laser light by the light sensor. The first control circuit changes an emission direction of the first laser light based on a first signal from outside.
Description
- Arrangements described herein relate generally to a ranging apparatus and a ranging system.
- A ranging apparatus called LiDAR (Light Detection and Ranging) is known. A LiDAR emits laser light to a ranging target. The emitted laser light is reflected by the ranging target, and detected by an optical sensor of the LiDAR. In this manner, the LiDAR is capable of measuring a distance between the LiDAR and the ranging target on the basis of the time at which the laser light was emitted and the time at which the laser light reflected by the ranging target was detected. In a LiDAR, the angle of view and the resolution of distance information that can be acquired has a trade-off relation.
-
-
FIG. 1 is a schematic diagram illustrating an example of a configuration of a ranging system according to a first arrangement. -
FIG. 2 is a block diagram illustrating an example of a configuration of an information processing apparatus according to the first arrangement. -
FIG. 3 is a block diagram illustrating an example of a configuration of a ranging apparatus according to the first arrangement. -
FIG. 4 is a schematic diagram illustrating an example of a configuration of an optical system included in the ranging apparatus according to the first arrangement. -
FIG. 5 is a schematic diagram illustrating an example of a configuration of a scan area scanned by the ranging apparatus according to the first arrangement. -
FIG. 6 is a timing chart illustrating an example of setting a ranging direction in the ranging apparatus according to the first arrangement. -
FIG. 7 is a block diagram illustrating an example of a functional configuration of the ranging system according to the first arrangement. -
FIG. 8 is a flowchart illustrating an example of a ranging operation of the ranging system according to the first arrangement. -
FIG. 9 is a schematic diagram illustrating an example of a configuration of a ranging system according to a second arrangement. -
FIG. 10 is a block diagram illustrating an example of a functional configuration of a ranging system according to the second arrangement. -
FIG. 11 is a block diagram illustrating an example of a configuration of a ranging system according to a third arrangement. -
FIG. 12 is a block diagram illustrating an example of a functional configuration of a ranging system according to the third arrangement. -
FIG. 13 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system according to the third arrangement. -
FIG. 14 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system according to the third arrangement. -
FIG. 15 is a block diagram illustrating an example of a functional configuration of a ranging system according to a fourth arrangement. -
FIG. 16 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system according to the fourth arrangement. -
FIG. 17 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system according to the fourth arrangement. -
FIG. 18 is a block diagram an example of a functional configuration of a ranging system according to a fifth arrangement. -
FIG. 19 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system according to the fifth arrangement. -
FIG. 20 is a schematic diagram illustrating an example of adjustment of the ranging direction with the ranging system according to the fifth arrangement. -
FIG. 21 is a table illustrating an example of setting information stored in an information processing apparatus according to a sixth arrangement. -
FIG. 22 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system according to the sixth arrangement. - In general, according to one arrangement, a ranging apparatus includes a light source (23), a movable mirror (251), a light sensor (26), a measurement circuit (27), and a first control circuit (21). The movable mirror is configured to reflect each of first laser light (LE) and second laser light (LR). The first laser light is emitted from the light source. The second laser light corresponds to the first laser light reflected by an external subject. The light sensor is configured to detect the second laser light reflected by the movable mirror. The measurement circuit is configured to measure a distance to the subject based on a timing of emission of the first laser light by the light source and a timing of detection of the second laser light by the light sensor. The first control circuit is configured to change an emission direction of the first laser light based on a first signal from outside.
- Arrangements will now be described hereinafter with reference to drawings. The arrangements illustrate devices and/or methods to realize the technical idea of the invention. The drawings are schematic or conceptual ones. The dimensions and the ratios and the like of the drawings are not necessarily the same as the actual ones. In the following explanations, constituent elements having substantially the same functions and structures are denoted by the same reference numerals.
- The following is an explanation of a ranging
system 1 according to the first arrangement. -
FIG. 1 is a schematic diagram illustrating an example of a configuration of a ranging system according to a first arrangement.FIG. 1 illustrates a state in which a transportation equipment VE including the rangingsystem 1 is moving through a predetermined route. As illustrated inFIG. 1 , the rangingsystem 1 includes aninformation processing apparatus 10 and a rangingapparatus 20. The transportation equipment VE is, for example, a vehicle, a train, an airplane, or a ship. - The
information processing apparatus 10 includes, for example, a device collecting information, such as its state, a current location of the transportation equipment VE, and a surrounding environment thereof. Theinformation processing apparatus 10 is configured to be capable of controlling the rangingapparatus 20. Theinformation processing apparatus 10 can designate a ranging direction for the rangingapparatus 20. Theinformation processing apparatus 10 may be configured to be capable of controlling acceleration/deceleration and/or the traveling direction of the transportation equipment VE. Specifically, theinformation processing apparatus 10 may have a function of supporting autonomous traveling of the transportation equipment VE. - The ranging
apparatus 20 is a type of a LiDAR. The rangingapparatus 20 emits laser light and detects the laser light reflected by a subject (ranging target). The rangingapparatus 20 measures a distance between the rangingapparatus 20 and the subject on the basis of the time of emission of the laser light and the time of detection of the reflected laser light. The rangingapparatus 20 is mounted (installed) in, for example, a front part of the transportation equipment VE, and acquires distance information of a predetermined angle of view in the traveling direction of the transportation equipment VE. In addition, the rangingapparatus 20 can change the ranging direction without changing the angle of view on the basis of an instruction of theinformation processing apparatus 20. In the present specification, the angle of view of the rangingapparatus 20, that is, the range in which a distance is measured by the rangingapparatus 20 is also referred to as "FOV (Field Of View)". -
FIG. 2 is a block diagram illustrating an example of a configuration of theinformation processing apparatus 10 according to the first arrangement. As illustrated inFIG. 2 , theinformation processing apparatus 10 includes, for example, a CPU (Central Processing Apparatus) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, astorage device 14, auser interface 15, acommunication interface 16, and aninformation collecting device 17. - The
CPU 11 is an integrated circuit capable of executing various programs. TheCPU 11 controls operations of the wholeinformation processing apparatus 10. TheROM 12 is a nonvolatile semiconductor memory. TheROM 12 stores a control program and/or a control data and the like of theinformation processing apparatus 10. TheRAM 13 is, for example, a volatile semiconductor memory. TheRAM 13 is used as a work area of theCPU 11. For example, the control program and/or the control data and the like stored in theROM 12 are loaded on theRAM 13. Thestorage device 14 is a storage medium used for storing data and/or programs. Thestorage device 14 stores, for example, map information including information of the route through which the transportation equipment VE can move. - The
user interface 15 is an input interface used by the user. The user can operate theinformation processing apparatus 10 using theuser interface 15. Thecommunication interface 16 is an interface circuit connectable to a network. Thecommunication interface 16 is configured to be capable of communicating with the rangingapparatus 20. Specifically, theinformation processing apparatus 10 can control the rangingapparatus 20 via thecommunication interface 16. Theinformation collecting device 17 collects information relating the current location, information relating to the state of the transportation equipment VE, and/or information relating to the surroundings of the transportation equipment VE. Theinformation collecting device 17 includes, for example, a camera and/or a sensor. - The information stored in the
storage device 14 may be downloaded via a server on the network. Thestorage device 14 and/or theinformation collecting device 17 may be externally connected to theinformation processing apparatus 10. Theinformation processing apparatus 10 may operate on the basis of control of a terminal on the network, or operate on the basis of information stored in the server on the network. Theinformation processing apparatus 10 may be a system constructed with a plurality of devices connected via the network. The network used by theinformation processing apparatus 10 may be wired or wireless, or both of wired and wireless networks may be used. -
FIG. 3 is a block diagram illustrating an example of a configuration of the rangingapparatus 20 according to the first arrangement. As illustrated inFIG. 3 , the rangingapparatus 20 includes, for example, a rangingcontroller 21, alaser driver 22, alaser diode 23, amirror controller 24, anoptical system 25, alight sensor 26, and ameasurement device 27. Theoptical system 25 includes, for example, arotary mirror 251. - The ranging
controller 21 controls operations of the whole rangingapparatus 20. The rangingcontroller 21 includes, for example, a CPU, a ROM, a RAM, and an oscillator (not illustrated). The ROM of the rangingcontroller 21 stores a control program and the like of the rangingapparatus 20. The CPU of the rangingcontroller 21 controls thelaser driver 22, themirror controller 24, thelight sensor 26, and themeasurement device 27 in accordance with the control program. The RAM of the rangingcontroller 21 is used as a work area of the CPU. The oscillator is used for generation of intermittent pulse signals. The rangingcontroller 21 may be configured to be capable of executing various data processing and arithmetic processing. - The
laser driver 22 drives thelaser diode 23. Specifically, thelaser driver 22 functions as a power supply source of thelaser diode 23. Thelaser diode 23 emits laser light on the basis of a drive current supplied from thelaser driver 22. The laser light emitted from thelaser diode 23 is made incident on theoptical system 25. The rangingcontroller 21 controls thelaser driver 22 such that thelaser diode 23 intermittently emits laser light. In the following explanation, the laser light generated on the basis of the pulse signal is also referred to as "pulse laser". In the rangingapparatus 20, the pulse laser is emitted with predetermined pulse width and period. - The
mirror controller 24 drives therotary mirror 251 included in theoptical system 25. Specifically, themirror controller 24 functions as a power circuit of a motor to rotate therotary mirror 251. Therotary mirror 251 is driven (rotated) on the basis of a drive current supplied from themirror controller 24, and reflects the incident laser light. Therotary mirror 251 is configured to be rotatable around, for example, an axis. Therotary mirror 251 may be a double-sided mirror or a polygon mirror including three or more reflection surfaces (mirror surfaces). Theoptical system 25 further includes an optical element according to arrangement of thelaser diode 23 and/or thelight sensor 26. The detailed configuration of theoptical system 25 will be described later. The number of rotations can be changed on the basis of the instruction of the rangingcontroller 21. Therotary mirror 251 may be a biaxial MEMS (Micro Electro Mechanical Systems) mirror. Therotary mirror 251 may be a combination of a rotary mirror and a monoaxial MEMS mirror assigned to scan of part of region. The rotary mirror may be referred to as "movable mirror". - The
light sensor 26 is a light receiving element sensing light made incident on the rangingapparatus 20. Thelight sensor 26 is disposed such that laser light emitted from thelaser diode 23 and reflected by the object outside the rangingapparatus 20 is made incident thereon via theoptical system 25. Thelight sensor 26 converts the laser light made incident on the rangingapparatus 20 into an electrical signal. Thereafter, thelight sensor 26 adjusts an output level of the converted electrical signal, and outputs the electrical signal to themeasurement device 27. Thelight sensor 26 includes, for example, a photomultiplier element, as an element converting light into an electrical signal. For example, a single-photon avalanche diode (SPAD) serving as a type of avalanche photodiodes is used as the photomultiplier element. - The
measurement device 27 measures the time of detection of the laser light by thelight sensor 26 on the basis of the light receiving result transmitted from thelight sensor 26. For example, themeasurement device 27 integrates the light receiving results for each unit time in accordance with the number of ranging points, and determines the peak part of the integrated signal as the time of detection of the laser light. In addition, themeasurement device 27 calculates time of flight (ToF) of the laser light on the basis of the time of emission of the laser light by thelaser diode 23 and the time of detection of the laser light reflected by the subject. Thereafter, themeasurement device 27 measures (ranges) the distance between the rangingapparatus 20 and the subject on the basis of the time of flight of the laser light and the speed of the laser light. Such a ranging method is also referred to as "ToF method". Themeasurement device 27 outputs a ranging result to theinformation processing apparatus 10 for each laser light emitted by the rangingapparatus 20. - The
measurement device 27 acquires the time of emission of the laser light by thelaser diode 23 by, for example, notification from the rangingcontroller 21. The time of emission of the laser light may be measured by detection of the laser light emitted from thelaser diode 23 by the light sensor in the rangingapparatus 20. Themeasurement device 27 may change an integration setting of light receiving results on the basis of an instruction from the rangingcontroller 21. - The ranging
controller 21 can also change the period and timing at which thelaser diode 23 emits the pulse laser, the rotational speed of therotary mirror 251, and/or the integration setting of light receiving results by themeasurement device 27, on the basis of the instruction from theinformation processing apparatus 10. In this manner, the rangingcontroller 21 can change the angle of view and the number of ranging points of the rangingapparatus 20. In other words, the rangingcontroller 21 can change the setting of each of thelaser driver 22, themirror controller 24, and themeasurement device 27 in association on the basis of the setting of the angle of view and the number of ranging points transmitted from theinformation processing apparatus 10. -
FIG. 4 is a schematic diagram illustrating an example of a configuration of an optical system included in the ranging apparatus according to the first arrangement.FIG. 4 also illustrates thelaser diode 23, thelight sensor 26, and an object OB together. As illustrated inFIG. 4 , theoptical system 25 further includes, for example, 252, 253, and 254. Each of theoptical elements 252 and 254 is, for example, a lens or a mirror. Each of theoptical elements 252 and 254 may be formed of a combination of a plurality of lenses and/or a plurality of mirrors. Theoptical elements optical element 253 is, for example, a half mirror or a holed mirror. In the following explanation, the pulse laser emitted by thelaser diode 23 is also referred to as "outgoing light LE". The pulse laser (outgoing light LE) reflected by the object OB is also referred to as "reflected light LR". - The
optical element 252 guides the outgoing light LE emitted from thelaser diode 23 to theoptical element 253. The outgoing light LE guided by theoptical element 252 is transmitted or passes through theoptical element 253, and is applied to therotary mirror 251. Therotary mirror 251 reflects the applied outgoing light LE in a direction corresponding to the incident angle of the outgoing light LE with respect to the applied surface. The reflected outgoing light LE is reflected by the object OB positioned in the traveling direction of the outgoing light LE outside the rangingapparatus 20. - The reflected light LR from the object OB is reflected by the
rotary mirror 251 and applied to theoptical element 253. Theoptical element 253 reflects the reflected light LR reflected by therotary mirror 251 toward theoptical element 254. Theoptical element 254 guides the reflected light LR reflected by theoptical element 253 to thelight sensor 26. Thelight sensor 26 converts the reflected light LR guided by theoptical element 254 into an electrical signal, and outputs the electrical signal to themeasurement device 27. - The present specification illustrates the case where the
rotary mirror 251 is a polygon mirror including six reflection surfaces S1 to S6. Tilt angles of the reflection surfaces are mutually different. The rangingcontroller 21 controls therotary mirror 251 such that therotary mirror 251 rotates at fixed rotational speed based on fixed angle of view and ranging rate. The rangingapparatus 20 can scan the place to be ranged in a two-dimensional manner with the intermittently emitted outgoing light LE and therotary mirror 251. - In the following explanation, the region that can be scanned by the ranging
apparatus 20 is referred to as "scan area SA". A set of ranging results of a plurality of points corresponding to one scan is referred to as "frame". An image of a frame is generated, for example, in correspondence with one rotation of therotary mirror 251. The rangingapparatus 20 can successively acquire distance information of a distance to the object OB positioned in front of the rangingapparatus 20 by successively executing a scan. Theoptical system 25 may have any other configuration as long as it can execute a scan using laser light. -
FIG. 5 is a schematic diagram illustrating an example of a configuration of a scan area SA scanned by the rangingapparatus 20 according to the first arrangement.FIG. 5 illustrates an example of an emission direction of the outgoing light LE for one frame in the scan area SA. As illustrated inFIG. 5 , the outgoing light LE is applied to a PQR space. A R axis is an axis extending from the rangingapparatus 20 to the subject, and extends along, for example, the center of the emission direction of the outgoing light LE. A PQ plane is a curved surface orthogonal to the R axis and extending from the emission surface of the outgoing light LE in a concentric circle manner. A P axis and a Q axis are axes orthogonal to each other in the PQ plane. The distance data measured on the basis of each outgoing light LE is generated as, for example, a map on the PQ plane. The rangingsystem 1 is capable of mapping the distance data to the object existing in the space PQR in association with the FOV in the scan area SA, and recognize the distance to the object existing in the FOV. - Specifically, the ranging
controller 21 achieves a scan in the P direction (lateral direction) by controlling thelaser driver 22 and themirror controller 24 and the like to intermittently emit the outgoing light LE at timings based on the set FOV. In a case of using the rotary mirror 241 including six reflection surfaces S1 to S6, the scan area SA includes first line SS1 to sixth line SS6. The scan positions of the first line SS1 to the sixth line SS6 are based on the tilt angles of the reflection surfaces S1 to S6, respectively. Specifically, the rangingapparatus 20 achieves a plurality of lines of scan shifted in the Q direction (vertical direction) by application of the outgoing light LE to different reflection surfaces by rotation of therotary mirror 251. In addition, the rangingapparatus 20 can change the ranging direction (the position of the FOV) by adjusting the emission timing of the outgoing light LE. -
FIG. 5 illustrates three types of FOV1 to FOV3. The FOV1, FOV2, and FOV3 are associated with a left part, a middle part, and a right part of the scan area SA, respectively. The present example illustrates the outgoing light LE corresponding to the FOV2. In a case of executing ranging for the FOV2, the rangingcontroller 21 controls thelaser driver 22 and themirror controller 24 and the like such that the outgoing light LE is intermittently emitted in the FOV2. In this manner, the rangingapparatus 20 can acquire distance information in the FOV2. In addition, the rangingapparatus 20 can selectively emit the outgoing light LE to each of the FOV1 and the FOV3 in the same manner as the FOV2, and acquire distance information of the associated FOV. The present example illustrates three types of FOVs that do not mutually overlap, but the positions of the FOVs are not limited thereto. The rangingapparatus 20 can change the positions of the FOVs to desired positions within the scan area SA. - The ranging
apparatus 20 can generate a plurality of pixels (distance data) arranged in a one-dimensional manner for one outgoing light LE. The pixels arranged in a one-dimensional manner are arranged along, for example, the Q axis. The rangingapparatus 20 repeatedly executes processing of the measurement period relating to measurement associated with one outgoing light LE while shifting in a one-dimensional manner along the P axis in each of the first line SS1 to the sixth line SS6. In this manner, the rangingapparatus 20 can generate distance data in the set FOV. Such a scanning method is also referred to as "multi-channel raster scan". The outgoing light LE having an application surface having a vertically elongated shape is used as means for achieving multi-channel raster scan. The number of lines and/or the scan direction in one scan of the rangingapparatus 20 may have other settings. - The following is an explanation of an example of the setting of the ranging direction of the ranging
apparatus 20. - In the ranging
apparatus 20, for example, the rotational speed of therotary mirror 251 is fixed. For this reason, the reflection direction of the outgoing light LE by therotary mirror 251 can be determined on the basis of a lapse of time from the initial position of therotary mirror 251. Accordingly, the rangingapparatus 20 can control the emission direction of the outgoing light LE on the basis of the lapse of time from the initial position of therotary mirror 251. Specifically, the rangingapparatus 20 can control the ranging direction without minutely controlling the number of rotations of therotary mirror 251, by controlling the emission timing of the outgoing light LE. -
FIG. 6 is a timing chart illustrating an example of setting the ranging direction in the rangingapparatus 20 according to the first arrangement.FIG. 6 illustrates an example of a method of setting respective ranging directions corresponding to the FOV1 to FOV3 illustrated inFIG. 5 , with the configuration of theoptical system 25 illustrated inFIG. 4 . The term "active (state)" inFIG. 6 indicates a state in which the rangingcontroller 21 supplies a pulse signal to thelaser driver 22 and thelaser diode 23 intermittently emits the outgoing light LE. The term "non-active (state)" inFIG. 6 indicates a state in which the rangingcontroller 21 supplies no pulse signal to thelaser driver 22 and thelaser diode 23 does not emit the outgoing light LE. - As illustrated in
FIG. 6 , in the present example, one frame is divided into six periods P1 to P6. The periods P1 to P6 correspond to periods in which the outgoing light LE is reflected by the respective reflection surfaces S1 to S6 of therotary mirror 251, respectively. The period P1 includes time t1-1, time t1-2, and t1-3. The period P2 includes time t2-1, time t2-2, and t2-3. The period P3 includes time t3-1, time t3-2, and t3-3. The period P4 includes time t4-1, time t4-2, and t4-3. The period P5 includes time t5-1, time t5-2, and t5-3. The period P6 includes time t6-1, time t6-2, and t6-3. The time t1-1, the time t2-1, the time t3-1, the time t4-1, the time t5-1, and the time t6-1 correspond to the respective start times of the periods P1 to P6, respectively. The time t1-2, the time t2-2, the time t3-2, the time t4-2, the time t5-2, and the time t6-2 correspond to the respective times after first time has passed from the start times of the periods P1 to P6, respectively. The time t1-3, the time t2-3, the time t3-3, the time t4-3, the time t5-3, and the time t6-3 correspond to the respective times after second time longer than the first time has passed from the start times of the periods P1 to P6, respectively. - In the setting of ranging the FOV1, the ranging
apparatus 20 changes to the active state in subsidiary periods SP1 with the times t1-1, t2-1, t3-1, t4-1, t5-1, and t6-1 serving as the respective starting points, and changes to the non-active state in the other periods. In this case, the rangingapparatus 20 can intermittently emit the outgoing light LE in the left part of the scan area SA, and range the ranging direction (FOV1) associated with the subsidiary periods SP1. - In the setting of ranging the FOV2, the ranging
apparatus 20 changes to the active state in subsidiary periods SP2 with the times t1-2, t2-2, t3-2, t4-2, t5-2, and t6-2 serving as the respective starting points, and changes to the non-active state in the other periods. In this case, the rangingapparatus 20 can intermittently emit the outgoing light LE in the middle part of the scan area SA, and range the ranging direction (FOV2) associated with the subsidiary periods SP2. - In the setting of ranging the FOV3, the ranging
apparatus 20 changes to the active state in subsidiary periods SP3 with the times t1-3, t2-3, t3-3, t4-3, t5-3, and t6-3 serving as the respective starting points, and changes to the non-active state in the other periods. In this case, the rangingapparatus 20 can intermittently emit the outgoing light LE in the right part of the scan area SA, and range the ranging direction (FOV3) associated with the subsidiary periods SP3. - As described above, the ranging
apparatus 20 can adjust the ranging direction by controlling the timings at which the pulse signal is supplied to thelaser driver 22. In a case where only the ranging direction is changed in a state in which the angle of view is fixed, the respective lengths of the subsidiary periods SP1, SP2, and SP3 are set substantially equal to each other. This is also applicable to a case where the ranging direction is set to a FOV different from the FOV1 to FOV3. In addition, if it is possible to include a noted range in the FOV, the start timings and the end timings of the subsidiary periods SP may be different between the periods P1 to P6. -
FIG. 7 is a block diagram illustrating an example of a functional configuration of the rangingsystem 1 according to the first arrangement. As illustrated inFIG. 7 , in the rangingsystem 1, theinformation processing apparatus 10 functions as aninformation processing part 101 and animage processing part 102, and the rangingapparatus 20 functions as anemission controller 201, alight projecting part 202, alight receiving part 203, and ameasurement part 204. Theinformation processing part 101 is, for example, a functional block corresponding to theCPU 11, theRAM 13, and theinformation collecting device 17. Theimage processing part 102 is, for example, a functional block corresponding to theCPU 11 and theRAM 13. Theemission controller 201 is, for example, a functional block corresponding to the rangingcontroller 21 and thelaser driver 22. Thelight projecting part 202 is a functional block corresponding to thelaser diode 23 and theoptical system 25. Thelight receiving part 203 is a functional block corresponding to theoptical system 25 and thelight sensor 26. Themeasurement part 204 is a functional block corresponding to themeasurement device 27. - The
information processing part 101 determines the ranging direction (FOV) of the rangingapparatus 20 on the basis of information acquired from the sensor and the like of theinformation collecting device 17. Theinformation processing part 101 transmits control parameters corresponding to the determined FOV to each of theemission controller 201 and theimage processing part 102. Theemission controller 201 supplies a pulse signal to thelight projecting part 202 on the basis of the control parameters received from theinformation processing part 101. Thelight projecting part 202 emits the outgoing light LE in accordance with the pulse signal received from theemission controller 201. Thelight projecting part 202 also scans the ranging direction (FOV) determined by theinformation processing part 101, on the basis of control of the emission timings of the outgoing light LE by theemission controller 201. - The
light receiving part 203 receives the reflected light LR reflected by the object OB in the FOV, and converts the reflected light LR into an electrical signal. Thelight receiving part 203 transmits the converted electrical signal (light receiving result) to themeasurement part 204. Themeasurement part 204 generates distance data in each ranging point on the basis of the light receiving result of each outgoing light LE received from thelight receiving part 203. Themeasurement part 204 transmits the generated distance data to theimage processing part 102. Theimage processing part 102 generates an image for each frame using the distance data received from themeasurement part 204 and information of the ranging direction received from theinformation processing part 101. The image generated by theimage processing part 102 includes distance information between the rangingapparatus 20 and the object OB in the FOV. The image generated by theimage processing part 102 is referred to by, for example, the control program of the vehicle in which the rangingsystem 1 is installed. -
FIG. 8 is a flowchart illustrating an example of a ranging operation of the rangingsystem 1 according to the first arrangement. The following is an explanation of the ranging operation of the rangingsystem 1 according to the first arrangement with reference toFIG. 8 . - The ranging
system 1 starts a ranging operation (Start), for example, when the transportation equipment VE starts operation. - First, the ranging
system 1 loads the ranging settings (S11). The ranging settings include settings, such as the angle of view, the resolution, and the ranging direction. - Next, the ranging
system 1 starts ranging on the basis of the loaded ranging settings (S12). Specifically, theinformation processing apparatus 10 transmits the control parameters based on the ranging settings to the rangingapparatus 20. Thereafter, the rangingapparatus 20 starts ranging with the angle of view, the resolution, and the ranging direction based on the received control parameters. - Next, the ranging
system 1 executes information analysis processing (S13). The information analysis processing is processing in which theinformation processing apparatus 10 analyzes information collected by the camera and/or the sensor of theinformation collecting device 17. Specific examples of the information analyzed by theinformation processing apparatus 10 will be explained in third to fifth arrangements. - Next, the ranging
system 1 adjusts the ranging direction of the rangingapparatus 20 on the basis of the analyzed information (S14). Specifically, theinformation processing apparatus 10 transmits control parameters corresponding to the FOV based on the analysis results in the processing at S13 to the rangingapparatus 20. Thereafter, the rangingapparatus 20 adjusts the ranging direction on the basis of the received control parameters. The rangingapparatus 20 uses, for example, the method explained with reference toFIG. 6 to adjust the ranging direction. In the processing at S14, theinformation processing apparatus 10 may designate the emission timing of the outgoing light LE for the rangingapparatus 20, or designate the FOV setting based on the analysis results from preset FOV settings. In the following explanation, a set of the processing of S13 and the processing of S14 is also referred to as "ranging direction adjusting operation". - Next, the ranging
system 1 checks whether a ranging operation end instruction has been received (S15). The ranging operation end instruction may be received via theuser interface 15, or generated in accordance with predetermined conditions. - If no ranging operation end instruction has been received in the processing at S15 (S15: NO), the system proceeds to the processing at S13. In this manner, the processing at S13 and the processing at S14 are regularly executed, and the ranging direction is properly changed when the transportation equipment VE operates.
- If a ranging operation end instruction has been received in the processing at S15 (S15: YES), the ranging
system 1 ends a series of processes inFIG. 8 (End). - The ranging
system 1 according to the first arrangement explained above enables ranging of a noted range while the resolution is maintained. The following is an explanation of details of the advantageous effect of the first arrangement. - As a method for detecting the subject positioned in front of the transportation equipment VE, a method using a monocular camera and/or a stereo camera is known. On the other hand, these cameras have problems in the detection accuracy for subjects at a long distance. By contrast, LiDARs using the ToF method are known as ranging apparatuses capable of executing long-distance ranging. A LiDAR executes ranging for each pair of emission and reception of laser light. For this reason, the number of ranging points per unit area of a LiDAR, that is, the number of ranging points of a LiDAR is smaller than that of cameras capable of acquiring an image only by light reception. A two-dimensional image acquired by a camera has, for example, 2 to 20 megapixels. By contrast, the number of pixels that can be ranged by one frame of a LiDAR is, for example, 0.1 to 0.2 megapixels or around.
- As described above, a LiDAR has limitations in the number of points that can be ranged by one frame. In a case where the number of ranging points is fixed, the resolution of a LiDAR decreases as a wider angle of view is set, and increases as a narrower angle of view is set. Accordingly, a possible method for satisfying the resolution required in a LiDAR includes narrowing the angle of view, that is, emitting the outgoing light LE in a concentrated manner in a part of ranging direction (FOV) in the scan area SA. In this manner, the LiDAR can acquire ranging results of high resolution, and improve the detection accuracy for a long-distance subject. However, in a LiDAR set to a narrow angle of view, no attention may be paid to ranging in a direction that the transportation equipment VE should note.
- For this reason, the ranging
system 1 according to the first arrangement controls the ranging direction of the ranging apparatus 20 (LiDAR) on the basis of the information collected by theinformation processing apparatus 10 with the sensor or the like. Specifically, theinformation processing apparatus 10 determines the ranging direction (FOV) of the rangingapparatus 20 to include the subject to be noted, on the basis of the collected information. Theinformation processing apparatus 10 notifies the rangingapparatus 20 of the setting of the determined ranging direction. The rangingapparatus 20 changes the emission timings of the outgoing light LE on the basis of the notification from theinformation processing apparatus 10. In this manner, the rangingapparatus 20 can change the ranging direction to a direction to be noted in movement of the transportation equipment VE, while fixing the angle of view at which the outgoing light LE is to be applied in the scan area SA. - As described above, the ranging
system 1 according to the first arrangement can enhance the detection accuracy for the long-distance subject by properly setting the ranging direction and/or the resolution and the like. In addition, the rangingsystem 1 can secure the required ranging resolution in the ranging region required from the use case in front of the transportation equipment VE, that is, ranging of the noted range. In addition, the rangingsystem 1 can acquire information of the subject in a region for which a field of view cannot be secured with a camera or the like, by direction control of the rangingapparatus 20. Accordingly, the transportation equipment VE using the rangingsystem 1 is enabled to improve safety in moving. - A ranging
system 1A according to the second arrangement changes the ranging direction of a LiDAR by using a movable mount on which the housing of the LiDAR is installed. The following is an explanation of the rangingsystem 1A according to the second arrangement, with respect to points thereof different from the first arrangement. -
FIG. 9 is a schematic diagram illustrating an example of a configuration of the rangingsystem 1A according to the second arrangement. As illustrated inFIG. 9 , the rangingsystem 1A includes, for example, aninformation processing apparatus 10A (not illustrated), a rangingapparatus 20, and amovable mount 30. - The
information processing apparatus 10A has a configuration similar to that of theinformation processing apparatus 10 according to the first arrangement, and further controls themovable mount 30. Theinformation processing apparatus 10A supplies a control signal based on information collected by theinformation collecting device 17 to themovable mount 30. In the rangingsystem 1A, the rangingapparatus 20 is installed on themovable mount 30. Themovable mount 30 is a mount to be driven based on control of theinformation processing apparatus 10A. Themovable mount 30 is, for example, configured to be rotatable around an axis. When themovable mount 30 is rotated, the rangingapparatus 20 on themovable mount 30 is also rotated. Themovable mount 30 may be configured to operate in a multiaxial manner. For example, themovable mount 30 may be configured to change the direction of the rangingapparatus 20 both in the horizontal direction and in the vertical direction. The rangingapparatus 20 may have a function as themovable mount 30. -
FIG. 10 is a block diagram illustrating an example of a functional configuration of the rangingsystem 1A according to the second arrangement. As illustrated inFIG. 10 , theinformation processing apparatus 10A functions as aninformation processing part 101A and animage processing part 102, the rangingapparatus 20 functions as anemission controller 201, alight projecting part 202, alight receiving part 203, and ameasurement part 204, in the same manner as the first arrangement, and themovable mount 30 functions as a motor controller 301. Theinformation processing part 101A is, for example, a functional block corresponding to theCPU 11, theRAM 13, and theinformation collecting device 17. The motor controller 301 is a functional block corresponding to themovable mount 30. - The
information processing part 101A determines the ranging direction (FOV) of the rangingapparatus 20 on the basis of information acquired from the sensor and the like of theinformation collecting device 17, in the same manner as theinformation processing part 101 of the first arrangement. Theinformation processing part 101A transmits control parameters of the ranging direction corresponding to the determined FOV to each of the motor controller 301 theemission controller 201. The motor controller 301 drives (rotates) themovable mount 30 on the basis of the control parameters received from theinformation processing part 101 to adjust the direction of the emission port of the rangingapparatus 20. Theemission controller 201 supplies a pulse signal to thelight projecting part 202 on the basis of the control parameters received from theinformation processing part 101A, in the same manner as the first arrangement. - The other configurations and operations of the ranging
system 1A according to the second arrangement are similar to those of the rangingsystem 1 according to the first arrangement. The control parameters transmitted to the motor controller 301 may be different from the control parameters transmitted to theemission controller 201. It suffices that the control parameters transmitted by theinformation processing part 101A are optimized for each of the motor controller 301 and theemission controller 201 to enable ranging corresponding to the determined FOV. In the second arrangement, the ranging direction of the rangingapparatus 20 may be changed using only drive of themovable mount 30 without changing the ranging timings of the rangingapparatus 20. - The ranging
system 1A according to the second arrangement includes themovable mount 30 driven on the basis of control of theinformation processing apparatus 10. Themovable mount 30 is configured to be capable of controlling the ranging direction of the rangingapparatus 20 on the basis of the setting of the FOV determined by theinformation processing apparatus 10. With this configuration, the rangingsystem 1A according to the second arrangement is capable of enlarging a scannable region, and adjusting the ranging direction in a wider range than that of the rangingsystem 1 according to the first arrangement. - A ranging
system 1B according to the third arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the rangingapparatus 20 on the basis of location information of the railroad vehicle RV. The following is an explanation of the rangingsystem 1B according to the third arrangement, with respect to points different from the first and the second arrangements. -
FIG. 11 is a block diagram illustrating an example of a configuration of the rangingsystem 1B according to the third arrangement. As illustrated inFIG. 11 , the rangingsystem 1B includes aninformation processing apparatus 10B and a rangingapparatus 20. Theinformation processing apparatus 10 has configuration acquired by adapting theinformation processing apparatus 10 according to the first arrangement for use as an autonomous traveling system for railroad vehicles RV. Specifically, theinformation processing apparatus 10B includes atrain controller 40, avehicle speed controller 41, animage processor 42, avehicle speed sensor 43, a GNSS (Global Navigation Satellite System)device 44, acamera 45, and aline information database 46. - The
train controller 40 generates a control signal relating to acceleration and deceleration of the railroad vehicle RV, on the basis of vehicle speed information acquired from thevehicle speed sensor 43, an instruction from theimage processor 42, and operation information acquired from theline information database 46, and the like. The information acquired from theimage processor 42 includes, for example, location information of the railroad vehicle RV. Thetrain controller 40 transmits the generated control signal to thevehicle speed controller 41. In this manner, thetrain controller 40 adjusts the speed between stations and controls traveling of the railroad vehicle RV. - The
vehicle speed controller 41 includes an acceleration unit and an deceleration unit to adjust the speed of the railroad vehicle RV. Thevehicle speed controller 41 controls the motor connected to wheels of the railroad vehicle RV and/or brakes. - The
image processor 42 generates an image, for example, on the basis of distance information from the rangingapparatus 20. In addition, theimage processor 42 determines the distance from the starting point of the railroad vehicle RV by putting image information from thecamera 45, ranging information from the rangingapparatus 20, location information from theGNSS device 44, and/or theline information database 46 together. Theimage processor 42 can specify the starting point of the railroad vehicle RV, for example, on the basis of theline information database 46. Theimage processor 42 instructs thetrain controller 40 to stop the railroad vehicle RV in a case where it is required to stop the train in accordance with the result of detection of the distance from the starting point and/or the ranging results. In addition, theimage processor 42 changes the ranging direction of the rangingapparatus 20 on the basis of the collected information. - The
vehicle speed sensor 43, theGNSS device 44, and thecamera 45 are devices to collect information of the railroad vehicle RV itself or the surroundings. Thevehicle speed sensor 43 is a sensor detecting the current speed of the railroad vehicle RV. Thevehicle speed sensor 43 transmits the detected speed information to thetrain controller 40. TheGNSS device 44 is a positioning device receiving radio waves emitted from a plurality of artificial satellites, and specifying the current location of the railroad vehicle RV on the basis of the received radio waves. TheGNSS device 44 includes, for example, a receiver converting a satellite signal into digital data, a receiving antenna to receive a satellite signal, an autonomous measurement device, such as an acceleration sensor and a gyrosensor, an arithmetic processing unit calculating the current location from the satellite signal, and a storage device. TheGNSS device 44 transmits the location information calculated on the basis of the satellite signal to theimage processor 42. Thecamera 45 is an optical device capable of imaging an image around the railroad vehicle RV. Thecamera 45 is provided in a front part of the railroad vehicle RV. Thecamera 45 transmits the acquired image information to theimage processor 42. - The
line information database 46 retains information of the line on which the railroad vehicle RV travels and/or information relating to the operation of the railroad vehicle RV, and the like. For example, theline information database 46 includes distance information of a distance from the starting point on the line on which the railroad vehicle RV travels. Examples of the information necessary for operation of the train include information of a speed limit of the railroad vehicle RV, information of stations at which the train stops, and information of stopping positions of the stations. The information necessary for operation of the train is set in accordance with the distance information from the starting point or the location information. - The ranging
apparatus 20 according to the third arrangement can change the ranging direction on the basis of an instruction from theimage processor 42. The instruction as to the ranging direction from theimage processor 42 to the rangingapparatus 20 include information relating to the position for the target to be noted or the ranging direction. The rangingapparatus 20 acquires ranging information of the subject, such as an obstacle existing in front of the railroad vehicle RV, in a two-dimensional manner on the basis of the FOV designated by theimage processor 42, and transmits the acquired ranging information to theimage processor 42. The instruction from theimage processor 42 is based on, for example, distance information of the distance to the station to stop at and/or information of a sign position serving as a criterion of the stopping position, and the like. The distance information of the distance to the station to stop at is acquired from, for example, the operation information acquired from theline information database 46 and by theGNSS device 44. - In the
information processing apparatus 10B, each of thetrain controller 40 and theimage processor 42 corresponds to, for example, theCPU 11, theROM 12, and theRAM 13 of theinformation processing apparatus 10 according to the first arrangement. Specifically, thetrain controller 40 and theimage processor 42 are, for example, computers configured to be capable of communicating with each other. Theline information database 46 is stored in thestorage device 14 or the like. Thevehicle speed sensor 43, theGNSS device 44, and thecamera 45 correspond to theinformation collecting device 17. The devices in theinformation processing apparatus 10B may be connected via a network cable, such as Ethernet (registered trademark). In the present specification, the term "obstacle" means, for example, an object obstructing train operations. -
FIG. 12 is a block diagram illustrating an example of a functional configuration of the rangingsystem 1B according to the third arrangement. As illustrated inFIG. 12 , in the rangingsystem 1B, theinformation processing apparatus 10B functions as a locationinformation collecting part 103, a routinginformation acquisition part 104, theline information database 46, and animage processing part 102, and the rangingapparatus 20 functions as anemission controller 201, alight projecting part 202, alight receiving part 203, and ameasurement part 204, in the same manner as the first arrangement. The locationinformation collecting part 103 is a functional block corresponding to theGNSS device 44 and theimage processor 42. The routinginformation acquisition part 104 is a functional block corresponding to theimage processor 42. - The location
information collecting part 103 collects location information of the railroad vehicle RV on the basis of the measurement results of theGNSS device 44. To collect the location information, the locationinformation collecting part 103 uses, for example, a position measuring arithmetic processing algorithm including satellite positioning signal processing, autonomous measurement data arithmetic processing, and time arithmetic processing. The locationinformation collecting part 103 transmits the collected location information to the routinginformation acquisition part 104. - The routing
information acquisition part 104 acquires operation information in the vicinity of the current location of the railroad vehicle RV from theline information database 46 on the basis of the location information received from the locationinformation collecting part 103. The routinginformation acquisition part 104 determines the ranging direction (FOV) of the rangingapparatus 20 on the basis of the acquired operation information. Thereafter, the routinginformation acquisition part 104 transmits control parameters corresponding to the determined FOV to each of theemission controller 201 and theimage processing part 102. In a case where theline information database 46 includes information associating the location information with the ranging direction, the routinginformation acquisition part 104 may acquire the ranging direction at the current location with reference to theline information database 46 using the location information. - The
emission controller 201 according to the third arrangement supplies a pulse signal to thelight projecting part 202 on the basis of the control parameters received from the routinginformation acquisition part 104. Hereinafter, thelight projecting part 202 emits pulse laser (outgoing light LE) in accordance with the pulse signal received from theemission controller 201, in the same manner as the first arrangement. Thelight receiving part 203 receives the reflected light LR reflected from the object OB in the FOV and converts the reflected light LR into an electrical signal. Themeasurement part 204 transmits the electrical signal (light receiving results) received from thelight receiving part 203 to theimage processing part 102. Theimage processing part 102 generates an image for each frame using the distance data received from themeasurement part 204 and the information of the ranging direction received from the routinginformation acquisition part 104. The other configurations of the rangingsystem 1B according to the third arrangement are the same as those of the rangingsystem 1 according to the first arrangement. -
FIG. 13 is a flowchart illustrating an example of a ranging direction adjusting operation of the rangingsystem 1B according to the third arrangement. The following is an explanation of the ranging direction adjusting operation of the rangingsystem 1B according to the third arrangement. - When a ranging direction adjusting operation is started (Start), the
information processing apparatus 10B collects location information from the GNSS device 44 (S31) . - Next, the
information processing apparatus 10B acquires operation information at the current location on the basis of the acquired location information and the line information database 46 (S32). - Next, the
information processing apparatus 10B changes the ranging direction of the rangingapparatus 20 on the basis of the acquired operation information (S33). - When the processing at S33 is finished, the ranging
system 1B ends a series of processes inFIG. 13 , that is, one ranging direction adjusting operation (End). The other operations of the rangingsystem 1B according to the third arrangement are the same as those of the rangingsystem 1 according to the first arrangement. -
FIG. 14 is a schematic diagram illustrating an example of adjustment of the ranging direction with the rangingsystem 1B according to the third arrangement. As illustrated inFIG. 14 , in the present example, a railroad vehicle RV1 is located on a line RL0. The line RL0 is divided into two lines RL1 and RL2 via a branch part BR. A platform HM for railroad vehicles RV is located between the lines RL1 and RL2. For example, parts of the lines RL1 and RL2 adjacent to the platform HM correspond to a first track FL and a second track SL, respectively. In the present example, a railroad vehicle RV2 is stopped at the first track FL. - In the present example, the railroad vehicle RV1 is scheduled to stop at the first track FL. When the railroad vehicle RV1 detects that it has moved to the position of the line RL0, the railroad vehicle RV1 acquires operation information based on the position of the line RL0, and determines the ranging direction (direction of FOV). In this case, the railroad vehicle RV1 sets the ranging direction to a ranging direction toward the first track FL from a position on the line RL0. In this manner, the railroad vehicle RV1 can check presence/absence of any railroad vehicle RV stopped in the traveling direction thereof and/or presence/absence of an obstacle. It suffices that the ranging
system 1B according to the third arrangement determines the ranging direction at the current location at least on the basis of the location information of the railroad vehicle RV and theline information database 46. - A method using a monocular camera and/or a stereo camera is known as a method for detecting an obstacle existing ahead of the railroad vehicle. However, these cameras have problems in the detection accuracy for subjects at a long distance, as described in the first arrangement. In addition, the detection accuracy for subjects by cameras tends to deteriorate in a case of insufficient quantity of light. Imaging with a camera can be assisted by illumination ahead of the railroad vehicle RV, but a region that cannot be followed by illumination may occur.
- By contrast, in the ranging
system 1B according to the third arrangement, the railroad vehicle RV includes the rangingapparatus 20. As described in the first arrangement, the rangingapparatus 20 can detect an obstacle at a long distance with higher accuracy than that of cameras, with the narrower angle of view. In addition, The rangingsystem 1B according to the third arrangement controls the ranging direction of the rangingapparatus 20 with reference to theline information database 46 in accordance with the current location of the traveling railroad vehicle RV. TheGNSS device 44 can execute measurement regardless of the quantity of light of the surroundings. Specifically, the rangingsystem 1B can set a ranging direction based on the operation information in the rangingapparatus 20, regardless of the quantity of light of the surroundings. - Consequently, the ranging
system 1B according to the third arrangement can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the rangingapparatus 20 with the required resolution, in the same manner as the first arrangement. In other words, the rangingsystem 1B can secure the required ranging resolution in ranging of the ranging region required from the use case in front of the railroad vehicle RV, that is, ranging of the noted range. In addition, the rangingsystem 1B can acquire information of the subject in a region for which a field of view cannot be secured with a camera or illumination, by direction control of the rangingapparatus 20. Accordingly, the railroad vehicle RV using the rangingsystem 1B is enabled to improve safety in traveling. - A ranging
system 1C according to the fourth arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the rangingapparatus 20 on the basis of the shape of the line in the traveling direction of the railroad vehicle RV. The following is an explanation of the rangingsystem 1C according to the fourth arrangement with respect to points different from the first to the third arrangements. - The ranging
system 1C according to the fourth arrangement includes aninformation processing apparatus 10C and a rangingapparatus 20. The hardware configuration of theinformation processing apparatus 10C is the same as, for example, that of theinformation processing apparatus 10B according to the third arrangement. -
FIG. 15 is a block diagram illustrating an example of a functional configuration of the rangingsystem 1C according to the fourth arrangement. As illustrated inFIG. 15 , in the rangingsystem 1C, theinformation processing apparatus 10C functions as animage collecting part 105, aline detecting part 106, and animage processing part 102, and the rangingapparatus 20 of the rangingsystem 1C functions as anemission controller 201, alight projecting part 202, alight receiving part 203, and ameasurement part 204, in the same manner as the first arrangement. Theimage collecting part 105 is a functional block corresponding to acamera 45 and animage processor 42. Theline detecting part 106 is a functional block corresponding to theimage processor 42. - The
image collecting part 105 collects an image taken by thecamera 45. Thereafter, theimage collecting part 105 transmits the collected image to theline detecting part 106. Theline detecting part 106 detects a line from the image received from theimage collecting part 105. Specifically, theline detecting part 106 detects the line ahead of the railroad vehicle RV, and determines a region on which the railroad vehicle RV travels on the line. Thereafter, theline detecting part 106 determines the ranging direction (FOV) of the rangingapparatus 20 on the basis of the acquired line information. For example, theline detecting part 106 calculates the distance in the traveling direction on the basis of the track of the detected line, and determines the ranging direction to include a point corresponding to a train forward distance designated separately. The train forward distance is a distance ahead of the railroad vehicle RV along the line. The train forward distance may be preset or acquired from theline information database 46. Thereafter, theline detecting part 106 transmits control parameters corresponding to the determined FOV to each of theemission controller 201 and theimage processing part 102. - The
emission controller 201 according to the fourth arrangement supplies a pulse signal to thelight projecting part 202 on the basis of the control parameters received from theline detecting part 106. Hereinafter, in the same manner as the third arrangement, thelight projecting part 202 emits pulse laser (outgoing light LE) in accordance with the pulse signal received from theemission controller 201. Thelight receiving part 203 receives reflected light LR reflected from the object OB in the FOV and converts the reflected light LR into an electrical signal. Themeasurement part 204 transmits the electrical signal (light receiving results) received from thelight receiving part 203 to theimage processing part 102. Theimage processing part 102 generates an image for each frame using the distance data received from themeasurement part 204 and the information of the ranging direction received from theline detecting part 106. The other configurations of the rangingsystem 1C according to the fourth arrangement are the same as those of the rangingsystem 1B according to the third arrangement. - The
line detecting part 106 detects a line on the basis of a feature quantity serving as a yardstick indicating line likelihood based on the predetermined criterion. Theline detecting part 106 may use information, such as detected line information, line width information, and branch information, to detect a line. A specific method for detecting a line is disclosed in, for example, the specification of . The whole patent application is cited by reference in the specification of the present application.Japanese Patent Application Publication No. 2018-119125 "Rail Track Detection Device" filed on June 22, 2018 -
FIG. 16 is a flowchart illustrating an example of a ranging direction adjusting operation of the rangingsystem 1C according to the fourth arrangement. The following is an explanation of the ranging direction adjusting operation of the rangingsystem 1C according to the fourth arrangement with reference toFIG. 16 . - When a ranging direction adjusting operation is started (Start), the
information processing apparatus 10C collects an image from the camera 45 (S41). - Next, the
information processing apparatus 10C detects a line by analyzing the acquired image (S42). - Next, the
information processing apparatus 10C determines a ranging point of the railroad vehicle RV on the basis of line detection results (S43). The ranging point determined by the processing at S43 is based on a predetermined train forward distance. - Next, the
information processing apparatus 10C changes the ranging direction of the rangingapparatus 20 on the basis of information of the determined ranging point (S44). - When the processing at S44 is finished, the ranging
system 1C ends a series of processes inFIG. 16 , that is, the ranging direction adjusting operation in the fourth arrangement (End). The other operations of the rangingsystem 1C according to the fourth arrangement are the same as those of the rangingsystem 1 according to the first arrangement. -
FIG. 17 is a schematic diagram illustrating an example of adjustment of the ranging direction with the rangingsystem 1C according to the fourth arrangement. As illustrated inFIG. 17 , in the present example, a railroad vehicle RV is located on a meandering line RL. In addition, the angle of view of thecamera 45 provided in the front part of the railroad vehicle RV is indicated as "FOVc". The FOVc of thecamera 45 is set broader than the FOV of the rangingapparatus 20. - In the present example, the railroad vehicle RV is traveling on a rightward curved part of the line RL. The railroad vehicle RV detects the rightward curved line RL on the basis of an image from the
camera 45, and calculates the train forward distance along the line RL. Thereafter, the railroad vehicle RV sets the ranging direction to a direction including the predetermined train forward distance. In this manner, the railroad vehicle RV is enabled to check presence/absence of an obstacle on the line in the traveling direction and the like. - The ranging
system 1C according to the fourth arrangement can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the rangingapparatus 20 with the required resolution, in the same manner as the first arrangement. In addition, the rangingsystem 1C according to the fourth arrangement can early find an obstacle existing in the traveling direction, because the FOV is set with the predetermined train forward distance. Accordingly, the railroad vehicle RV using the rangingsystem 1C is enabled to improve safety in traveling. - A ranging
system 1D according to the fifth arrangement is mounted on a railroad vehicle RV, and changes the ranging direction of the rangingapparatus 20 in accordance with the object detected around the railroad vehicle RV. The following is an explanation of the rangingsystem 1D according to the fifth arrangement with respect to points different from the first to the fourth arrangements. - The ranging
system 1D according to the fifth arrangement includes aninformation processing apparatus 10D and a rangingapparatus 20. The hardware configuration of theinformation processing apparatus 10D is the same as that of theinformation processing apparatus 10B according to the third arrangement. -
FIG. 18 is a block diagram an example of a functional configuration of the rangingsystem 1D according to the fifth arrangement. As illustrated inFIG. 18 , theinformation processing apparatus 10D of the rangingsystem 1D functions as animage collecting part 105, anobject recognition part 107, a sample database (sample DB) 47, and animage processing part 102. The rangingapparatus 20 of the rangingsystem 1C functions as anemission controller 201, alight projecting part 202, alight receiving part 203, and ameasurement part 204, in the same manner as the first arrangement. Theobject recognition part 107 is a functional block corresponding to theimage processor 42. Thesample database 47 is stored in, for example, thestorage device 14. - The
image collecting part 105 collects an image taken by thecamera 45, in the same manner as the fourth arrangement. Theimage collecting part 105 transmits the collected image to theline detecting part 106. Theobject recognition part 107 detects an object from the image received from theimage collecting part 105. Theobject recognition part 107 refers to, for example, thesame database 47 to detect an object. Thesample database 47 includes a library relating obstructions in traveling of the railroad vehicles RV. Examples of information of obstructions recorded on thesample database 47 include shapes of obstacles that may exist in the line, such as people, animals, fallen trees, and vehicles. The library of thesample database 47 include information relating to shapes and the like of these obstacles. Theobject recognition part 107 checks the image received from theimage collecting part 105 against the library of obstacles of thesample database 47, and calculates an image position of a region having high similarity. Theobject recognition part 107 determines a region having high similarity as a region in which an obstacle exists. Thereafter, theobject recognition part 107 determines the ranging direction (FOV) of the rangingapparatus 20 to a direction of a point determined as a point at which an obstacle exists in a three-dimensional manner. Thereafter, theobject recognition part 107 transmits control parameters corresponding to the determined FOV to each of theemission controller 201 and theimage processing part 102. - The
object recognition part 107 may detect a line ahead of the railroad vehicle RV on the basis of the algorithm as explained in the fourth arrangement. Theobject recognition part 107 may set the FOV in accordance with position relation between the detected line and the object. The other configurations of the rangingsystem 1D according to the fifth arrangement are the same as those of the rangingsystem 1B according to the third arrangement. -
FIG. 19 is a flowchart illustrating an example of a ranging direction adjusting operation of the rangingsystem 1D according to the fifth arrangement. The following is an explanation of the ranging direction adjusting operation of the rangingsystem 1D according to the fifth arrangement. - When a ranging direction adjusting operation is started (Start), the
information processing apparatus 10D collects an image from the camera 45 (S51). - Next, the
information processing apparatus 10D analyzes the acquired image and detects an object OB (S52). In the processing at S52, theinformation processing apparatus 10D may further detect a line. - Next, the
information processing apparatus 10D checks whether the object OB has been detected in a predetermined region (S53). The predetermined region is, for example, a region on the line RL. The configuration is not limited thereto, but the predetermined region may include a region in the vicinity of the line RL. - If the object OB is not detected in the predetermined region (S53: NO), the ranging
system 1D ends a series of processes inFIG. 19 , that is, the ranging direction adjusting operation in the fifth arrangement (End). - If the object OB is detected in the predetermined region (S53: YES), the ranging
system 1D changes the ranging direction of the rangingapparatus 20 on the basis of information of the detected position of the object OB (S54). - When the processing at S54 is finished, the ranging
system 1C ends a series of processes inFIG. 19 , that is, the ranging direction adjusting operation in the fifth arrangement (End). The other operations of the rangingsystem 1C according to the fifth arrangement are the same as those of the rangingsystem 1 according to the first arrangement. -
FIG. 20 is a schematic diagram illustrating an example of adjustment of the ranging direction with the rangingsystem 1D according to the fifth arrangement. As illustrated inFIG. 20 , in the present example, a railroad vehicle RV is located on a meandering line RL. In addition, the angle of view of thecamera 45 provided in the front part of the railroad vehicle RV is indicated as "FOVc". The FOVc of thecamera 45 is set broader than the FOV of the rangingapparatus 20. - In the present example, the railroad vehicle RV is traveling on a rightward curved part of the line RL. The railroad vehicle RV detects an object OB on the rightward curved line RL on the basis of an image from the
camera 45. In this case, the railroad vehicle RV sets the ranging direction to a direction including the object OB. In this manner, the railroad vehicle RV is enabled to accurately acquire a distance to the obstacle on the line. - The ranging
system 1D according to the fifth arrangement can change the ranging direction to a direction to be noted, while achieving setting of the angle of view (FOV) of the rangingapparatus 20 with the required resolution, in the same manner as the first arrangement. In addition, the rangingsystem 1D according to the fifth arrangement can accurately calculate a distance to an obstacle (object OB) in the predetermined region. This configuration enables the rangingsystem 1D according to the fifth arrangement to more accurately determine a risk in traveling and controls vehicle speed based on the risk in traveling. Accordingly, the railroad vehicle RV using the rangingsystem 1D is enabled to improve safety in traveling. - A ranging system 1E according to the sixth arrangement is mounted on a railroad vehicle RV, and uses the methods for changing the ranging direction explained in the third to the fifth arrangements properly. The following is an explanation of the ranging system 1E according to the sixth arrangement with respect to points different from the first to the fifth arrangements.
- The ranging system 1E according to the sixth arrangement includes an information processing apparatus 10E including respective functions of the
10B, 10C, and 10D and a ranginginformation processing apparatuses apparatus 20. The hardware configuration of the information processing apparatus 10E is the same as that of theinformation processing apparatus 10B according to the third arrangement. In the information processing apparatus 10E, theRAM 13 stores setting information. The setting information includes information relating to the setting of the ranging direction adjusting operation. The setting information may be stored in thestorage device 14, or stored in an external device connected to the rangingsystem 1 in a wired or wireless manner. -
FIG. 21 is a table illustrating an example of the setting information stored in the information processing apparatus 10E according to a sixth arrangement. As illustrated inFIG. 21 , the setting information includes information indicating whether each of a first setting, a second setting, and a third setting is valid. The first setting is associated with the method for adjusting the ranging direction based on the location information of the railroad vehicle RV described in the third arrangement. The second setting is associated with the method for adjusting the ranging direction based on the shape of the line described in the fourth arrangement. The third setting is associated with the method for adjusting the ranging direction based on the detection results of a specific object described in the fifth arrangement. - In the information processing apparatus 10E according to the sixth arrangement, one of the first setting, the second setting, and the third setting can be set to valid ("0"). In the information processing apparatus 10E, in a case where the methods for adjusting the ranging direction described in the third to the fifth arrangements are not used, each of the first setting, the second setting, and the third setting is set to invalid ("-"). The other structures of the ranging system 1E according to the sixth arrangement are the same as those in the ranging
system 1B according to the third arrangement. -
FIG. 22 is a flowchart illustrating an example of a ranging direction adjusting operation of the ranging system 1E according to the sixth arrangement. The following is an explanation of the ranging direction adjusting operation of the ranging system 1E. - When a ranging operation is started, the ranging system 1E regularly executes a series of processes in
FIG. 22 (Start). - First, the ranging system 1E checks whether the first setting is valid, with reference to the setting information stored in the RAM 13 (S61).
- If it is checked in the processing at S61 that the first setting is valid (S61: YES), the ranging system 1E executes ranging direction setting based on the location, that is, the ranging direction adjusting operation described in the third arrangement (S62). When the processing at S62 is finished, the ranging system 1E ends a series of processes in
FIG. 22 (End). - If it is checked in the processing at S61 that the first setting is not valid (S61: NO), the ranging system 1E checks whether the second setting is valid, with reference to the setting information stored in the RAM 13 (S63).
- If it is checked in the processing at S63 that the second setting is valid (S63: YES), the ranging system 1E executes ranging direction setting based on the line, that is, the ranging direction adjusting operation described in the fourth arrangement (S64). When the processing at S64 is finished, the ranging system 1E ends a series of processes in
FIG. 22 (End). - If it is checked in the processing at S63 that the second setting is not valid (S63: NO), the ranging system 1E checks whether the third setting is valid, with reference to the setting information stored in the RAM 13 (S65) .
- If it is checked in the processing at S65 that the third setting is valid (S65: YES), the ranging system 1E executes ranging direction setting based on the object, that is, the ranging direction adjusting operation described in the fifth arrangement (S66). When the processing at S66 is finished, the ranging system 1E ends a series of processes in
FIG. 22 (End). - If it is checked in the processing at S65 that the third setting is not valid (S65: NO), the ranging system 1E maintains the current ranging direction setting, and ends a series of processes in
FIG. 22 (End). - As described above, the ranging system 1E according to the sixth arrangement is configured to use the ranging direction adjusting operations described in the third to the fifth arrangements properly according to the user's request. This structure enables the ranging system 1E to adjust the ranging direction using the method more suitable to the use environment of the railroad vehicle RV.
- The arrangements described above may be used in combination in a possible range. For example, the second arrangement may be combined with any of the third to the sixth arrangements. The third to the sixth arrangements illustrate a case where the transportation equipment VE is a railroad vehicle RV, but the structure is not limited thereto. The third to the sixth arrangements are applicable to transportation equipment VE using elements indicating routes in the same manner as the line. For example, the third to the sixth arrangements are also applicable to fixed-route buses.
- As long as the operations described in the above arrangements can be achieved, part of functions of the
information processing apparatus 10 may be installed in the rangingapparatus 20. For example, the rangingapparatus 20 may achieve each of the functions of the 101 and 101A, the routinginformation processing parts information acquisition part 104, theline detecting part 106, and theobject recognition part 107. In the ranging direction adjusting operation, the processing of determining the ranging direction (FOV) may be executed by the rangingcontroller 21 of the rangingapparatus 20. In this case, information acquired by each of sensors of theinformation collecting device 17 is transmitted to the rangingcontroller 21. Part of functions of the rangingcontroller 21 may be provided in thelight sensor 26 and/or themeasurement device 27. In this manner, the rangingapparatus 20 can timely execute minute operations. Classification of the structures explained in the arrangements may be other classifications as long as the operations described in the arrangements can be achieved. The ranging direction adjusting operation may be achieved by an embedded computer including a CPU, a memory, a bus, and an input/output circuit (I/O). - The CPU included in the ranging
system 1 may be another circuit. For example, a MPU (Micro Processing Unit) or the like may be used instead of the CPU. Each of processes described in the arrangements may be achieved by dedicated hardware. In each of the arrangements, the processing executed by software and the processing executed by hardware may exist in a mixed manner, or only one of them may exist. The rangingcontroller 21 and/or the CPU may also be referred to as "control circuit" and/or "processor". Themeasurement device 27 may also be referred to as "measurement circuit". Theimage processor 42 may also be referred to as "image processing circuit". Thelaser diode 23 may also be referred to as "light source". The term "train forward distance" may be rephrased according to the type of the transportation equipment VE. The element "line" may also be referred to as "traveling route". - The arrangements described above illustrate the case where the ranging
apparatus 20 executes multi-channel raster scan, but other scanning methods may be used. For example, the rangingapparatus 20 may use "raster scan", "multi-channel scan", and/or "OPA method (Optical Phased Array)", as other scanning methods. Specifically, it suffices that the rangingapparatus 20 can adjust the ranging direction (position of FOV) by, for example, adjusting the emission timings of the pulse laser, in a case of using either a mechanical method or the OPA method is used as the scanning method. -
Clause 1. A ranging apparatus comprising: - a light source (23);
- a movable mirror (251) configured to reflect each of first laser light (LE) and second laser light (LR), the first laser light emitted from the light source, the second laser light corresponding to the first laser light reflected by an external subject;
- a light sensor (26) configured to detect the second laser light reflected by the movable mirror;
- a measurement circuit (27) configured to measure a distance to the subject based on a timing of emission of the first laser light by the light source and a timing of detection of the second laser light by the light sensor; and
- a first control circuit (21) configured to change an emission direction of the first laser light based on a first signal from outside.
- Clause 2. The ranging apparatus of
clause 1, wherein the first control circuit changes the emission direction of the first laser light by changing timings at which the light source intermittently emits the first laser light while the movable mirror rotating at constant speed makes one rotation. -
Clause 3. A ranging system mounted on transportation equipment, the ranging system comprising: - the ranging apparatus of
clause 1; - an information collecting device configured to collect information; and
- a second control circuit configured to generate the first signal based on the information.
-
Clause 4. The ranging system ofclause 3, wherein - the information collecting device includes a GNSS (Global Navigation Satellite System) device, and
- the GNSS device configured to calculate a current location of the transportation equipment based on a satellite signal, and output the current location as part of the information.
-
Clause 5. The ranging system ofclause 4, further comprising: - a storage device configured to store a first database including information of ranging directions associated with location information of a traveling route of the transportation equipment, wherein
- the second control circuit refers to the first database using information of the current location of the transportation equipment received from the GNSS device, and generates the first signal including control parameters to emit the first laser light by the light source in a ranging direction associated with the current location.
- Clause 6. The ranging system of
clause 3, wherein - the information collecting device includes a camera, and
- the camera outputs a taken image as part of the information.
- Clause 7. The ranging system of clause 6, wherein
the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal based on the detected traveling route. - Clause 8. The ranging system of clause 7, wherein the second control circuit generates the first signal including control parameters to emit the first laser light by the light source in a direction including a part having a distance from the transportation equipment being a first distance.
- Clause 9. The ranging system of clause 8, wherein the first distance is a distance along the traveling route.
-
Clause 10. The ranging system of clause 6, wherein the second control circuit detects an obstacle from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light to a position of the obstacle. -
Clause 11. The ranging system ofclause 10, further comprising: - a storage device configured to store a second database including information of respective shapes of a plurality of obstructions corresponding to the obstacles, wherein
- the second control circuit determines a part having high similarity to information of the respective shapes of the obstructions in the image, as a part in which the obstacle exists.
-
Clause 12. The ranging system ofclause 10, wherein
the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light in a direction including the position of the obstacle, in a case where the obstacle is positioned on the traveling route. -
Clause 13. The ranging system ofclause 3, further comprising: - a movable mount on which the ranging system is installed, wherein
- the second control circuit changes an emission direction of the first laser light by controlling the movable mount based on the information.
-
Clause 14. The ranging system of any one ofclauses 3 to 13, wherein the transportation equipment is a railroad vehicle. - While certain arrangements have been described, these arrangements have been presented by way of example only, and are not intended to limit the scope of the claims. Indeed, the apparatuses described herein may be embodied in a variety of other forms; furthermore various omissions, substitutions and changes in the form of the apparatuses described herein may be made.
Claims (14)
- A ranging apparatus comprising:a light source (23);a movable mirror (251) configured to reflect each of first laser light (LE) and second laser light (LR), the first laser light emitted from the light source, the second laser light corresponding to the first laser light reflected by an external subject;a light sensor (26) configured to detect the second laser light reflected by the movable mirror;a measurement circuit (27) configured to measure a distance to the subject based on a timing of emission of the first laser light by the light source and a timing of detection of the second laser light by the light sensor; anda first control circuit (21) configured to change an emission direction of the first laser light based on a first signal from outside.
- The ranging apparatus of claim 1, wherein the first control circuit changes the emission direction of the first laser light by changing timings at which the light source intermittently emits the first laser light while the movable mirror rotating at constant speed makes one rotation.
- A ranging system mounted on transportation equipment, the ranging system comprising:the ranging apparatus of claim 1;an information collecting device configured to collect information; anda second control circuit configured to generate the first signal based on the information.
- The ranging system of claim 3, whereinthe information collecting device includes a GNSS (Global Navigation Satellite System) device, andthe GNSS device configured to calculate a current location of the transportation equipment based on a satellite signal, and output the current location as part of the information.
- The ranging system of claim 4, further comprising:a storage device configured to store a first database including information of ranging directions associated with location information of a traveling route of the transportation equipment, whereinthe second control circuit refers to the first database using information of the current location of the transportation equipment received from the GNSS device, and generates the first signal including control parameters to emit the first laser light by the light source in a ranging direction associated with the current location.
- The ranging system of claim 3, whereinthe information collecting device includes a camera, andthe camera outputs a taken image as part of the information.
- The ranging system of claim 6, wherein
the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal based on the detected traveling route. - The ranging system of claim 7, wherein the second control circuit generates the first signal including control parameters to emit the first laser light by the light source in a direction including a part having a distance from the transportation equipment being a first distance.
- The ranging system of claim 8, wherein the first distance is a distance along the traveling route.
- The ranging system of claim 6, wherein the second control circuit detects an obstacle from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light to a position of the obstacle.
- The ranging system of claim 10, further comprising:a storage device configured to store a second database including information of respective shapes of a plurality of obstructions corresponding to the obstacles, whereinthe second control circuit determines a part having high similarity to information of the respective shapes of the obstructions in the image, as a part in which the obstacle exists.
- The ranging system of claim 10, wherein
the second control circuit detects a traveling route of the transportation equipment from the image, and generates the first signal including control parameters enabling the light source to emit the first laser light in a direction including the position of the obstacle, in a case where the obstacle is positioned on the traveling route. - The ranging system of claim 3, further comprising:a movable mount on which the ranging system is installed, whereinthe second control circuit changes an emission direction of the first laser light by controlling the movable mount based on the information.
- The ranging system of any one of claims 3 to 13, wherein the transportation equipment is a railroad vehicle.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023022701A JP2024116871A (en) | 2023-02-16 | 2023-02-16 | Distance measuring device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4418003A1 true EP4418003A1 (en) | 2024-08-21 |
Family
ID=87845794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23193401.9A Pending EP4418003A1 (en) | 2023-02-16 | 2023-08-25 | Ranging apparatus and ranging system |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4418003A1 (en) |
| JP (1) | JP2024116871A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018119125A (en) | 2017-01-27 | 2018-08-02 | 川口化学工業株式会社 | Halogen- and zinc-free butyl rubber composition enabling color discrimination. |
| US20200300982A1 (en) * | 2017-04-14 | 2020-09-24 | Luminar Technologies, Inc. | Combining lidar and camera data |
| US20210096262A1 (en) * | 2019-09-27 | 2021-04-01 | Gm Cruise Holdings Llc | Dynamic power throttling of spinning lidar |
| US20220317249A1 (en) * | 2021-03-26 | 2022-10-06 | Aeye, Inc. | Hyper Temporal Lidar with Switching Between a Baseline Scan Mode and a Pulse Burst Mode |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3061675B2 (en) * | 1992-01-29 | 2000-07-10 | マツダ株式会社 | Vehicle obstacle detection device |
| JPH10222792A (en) * | 1997-02-05 | 1998-08-21 | Kotaro Kishi | Obstacle monitoring device for vehicle |
| JPH11153664A (en) * | 1997-09-30 | 1999-06-08 | Sumitomo Electric Ind Ltd | Object detection device using repetitive pulsed light |
| JPH11326499A (en) * | 1998-05-20 | 1999-11-26 | Mitsubishi Electric Corp | Distance measuring device and vehicle control device using the same |
| JP2001050723A (en) * | 1999-08-11 | 2001-02-23 | Minolta Co Ltd | Distance measuring equipment |
| JP2006258604A (en) * | 2005-03-17 | 2006-09-28 | Sanyo Electric Co Ltd | Detection device |
| JP2016057141A (en) * | 2014-09-09 | 2016-04-21 | 株式会社リコー | Distance measuring device, moving body device, and distance measuring method |
| JP6314774B2 (en) * | 2014-09-26 | 2018-04-25 | 株式会社デンソー | Laser irradiation control device |
| KR102554215B1 (en) * | 2016-09-20 | 2023-07-11 | 이노비즈 테크놀로지스 엘티디 | Lidar systems and methods |
| JP2020034386A (en) * | 2018-08-29 | 2020-03-05 | パイオニア株式会社 | Scanner and distance measuring device |
| JP7227879B2 (en) * | 2019-09-02 | 2023-02-22 | 株式会社日立製作所 | Surrounding Observation System, Surrounding Observation Program and Surrounding Observation Method |
| JP7443006B2 (en) * | 2019-09-19 | 2024-03-05 | 株式会社東芝 | Photodetector and distance measuring device |
| JP7350598B2 (en) * | 2019-10-03 | 2023-09-26 | 日本信号株式会社 | monitoring device |
-
2023
- 2023-02-16 JP JP2023022701A patent/JP2024116871A/en active Pending
- 2023-08-25 EP EP23193401.9A patent/EP4418003A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018119125A (en) | 2017-01-27 | 2018-08-02 | 川口化学工業株式会社 | Halogen- and zinc-free butyl rubber composition enabling color discrimination. |
| US20200300982A1 (en) * | 2017-04-14 | 2020-09-24 | Luminar Technologies, Inc. | Combining lidar and camera data |
| US20210096262A1 (en) * | 2019-09-27 | 2021-04-01 | Gm Cruise Holdings Llc | Dynamic power throttling of spinning lidar |
| US20220317249A1 (en) * | 2021-03-26 | 2022-10-06 | Aeye, Inc. | Hyper Temporal Lidar with Switching Between a Baseline Scan Mode and a Pulse Burst Mode |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2024116871A (en) | 2024-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11604475B2 (en) | Planar-beam, light detection and ranging system | |
| CN111352091B (en) | Real-time gating and signal routing in laser and detector arrays for LIDAR applications | |
| CN108427123B (en) | LIDAR device and method for operating a LIDAR device | |
| US10739441B2 (en) | System and method for adjusting a LiDAR system | |
| US7969558B2 (en) | High definition lidar system | |
| US9766122B2 (en) | Method and system for positioning an apparatus for monitoring a parabolic reflector aerially | |
| CN111273259B (en) | LIDAR device for automatic driving vehicle and LIDAR peak value detection method | |
| US10928488B2 (en) | LIDAR 3D design using a polygon mirror | |
| US11561287B2 (en) | LIDAR sensors and methods for the same | |
| US12158520B2 (en) | Signal processing device, signal processing method, and information processing device | |
| CN111157977B (en) | LIDAR peak detection for autonomous vehicles using time-to-digital converters and multi-pixel photon counters | |
| WO2019082700A1 (en) | Control device, control method, program, and storage medium | |
| US11237255B2 (en) | LiDAR system | |
| US20200158829A1 (en) | Lidar device with polygon-shape mirror and prism for autonomous driving vehicles | |
| KR20180058068A (en) | Mirror rotational optical structure for 360˚ multichannel scanning and 3d lidar system comprising the same | |
| CN116249913A (en) | Dynamic compensation of polygon and motor tolerances using galvanometer control curves | |
| CN111366910B (en) | Light detection and ranging device for an autonomous vehicle | |
| JP6186863B2 (en) | Ranging device and program | |
| US20240085558A1 (en) | Lidar sensor with adjustable optic | |
| EP4418003A1 (en) | Ranging apparatus and ranging system | |
| EP3709052A1 (en) | Object detector | |
| CN111308446B (en) | Light detection and ranging device with single rotating mirror for autonomous vehicles | |
| JP6967846B2 (en) | Object detection method and object detection device | |
| WO2023048691A1 (en) | Fast and high-resolution lidar with multiaxis and multi- surface polygon scanner | |
| US12013261B2 (en) | Magnetic sensing for a galvanometer scanner using a hall sensor for LiDAR system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20230825 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KABUSHIKI KAISHA TOSHIBA |