US8311286B2 - Ranging apparatus and ranging method - Google Patents

Ranging apparatus and ranging method Download PDF

Info

Publication number
US8311286B2
US8311286B2 US12/037,727 US3772708A US8311286B2 US 8311286 B2 US8311286 B2 US 8311286B2 US 3772708 A US3772708 A US 3772708A US 8311286 B2 US8311286 B2 US 8311286B2
Authority
US
United States
Prior art keywords
light
modulated
phase
lights
exposure periods
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/037,727
Other versions
US20080205709A1 (en
Inventor
Tomonori Masuda
Youichi Sawachi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sdip Holdings Pty Ltd
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Assigned to FUJIFILM CORPORATION reassignment FUJIFILM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MASUDA, TOMONORI, SAWACHI, YOUICHI
Publication of US20080205709A1 publication Critical patent/US20080205709A1/en
Application granted granted Critical
Publication of US8311286B2 publication Critical patent/US8311286B2/en
Assigned to OPTALERT LIMITED reassignment OPTALERT LIMITED CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: OPTALERT PTY LTD
Assigned to OPTALERT HOLDINGS PTY LIMITED reassignment OPTALERT HOLDINGS PTY LIMITED CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: OPTALERT LIMITED
Assigned to SDIP HOLDINGS PTY LTD reassignment SDIP HOLDINGS PTY LTD ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OPTALERT HOLDINGS PTY LIMITED
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • G01S17/32Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
    • G01S17/36Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated with phase comparison between the received signal and the contemporaneously transmitted signal
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/8943D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491Details of non-pulse systems

Definitions

  • the present invention relates to a ranging apparatus and a ranging method, and more particularly to a ranging apparatus and a ranging method for detecting the phase delay of reflected light from an object that is irradiated with modulated light at each of the pixels of an image capturing device, for thereby detecting a three-dimensional structure of the object.
  • a ranging apparatus based on the optical TOF ranging process comprises a light source 200 in the form of an LED array, for example, for emitting intensity-modulated light (modulated light), an image capturing device 204 for detecting reflected light from an object 202 irradiated with the modulated light from the light source 200 , and an optical system 206 for focusing the reflected light onto the image capturing device 204 .
  • a light source 200 in the form of an LED array, for example, for emitting intensity-modulated light (modulated light)
  • an image capturing device 204 for detecting reflected light from an object 202 irradiated with the modulated light from the light source 200
  • an optical system 206 for focusing the reflected light onto the image capturing device 204 .
  • the reflected light from the object 202 is focused onto the light-detecting surface of the image capturing device 204 by the optical system 206 .
  • the light-detecting surface of the image capturing device 204 comprises a two-dimensional matrix of pixels (photodiodes). When the phase delay of ⁇ is determined at each of the pixels according to the above equation, a three-dimensional structure of the object 202 can be detected.
  • a ranging apparatus based on the above principle is disclosed in Japanese Patent No. 3758618, for example.
  • the disclosed ranging apparatus measures the distance from the apparatus to an object when reflected light from the object is detected in exposure periods established in a plurality of patterns by opening and closing the overflow drain gates (OFDG) or readout gates of an image capturing device out of phase with each other.
  • OFDG overflow drain gates
  • the light source 200 In a first frame, in response to a negative-going edge of a synchronizing signal Sa (see FIG. 21A ) in step S 1 shown in FIG. 20 , the light source 200 emits a modulated light W in step S 2 .
  • the object 202 When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204 . As shown in FIG.
  • the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T 1 later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 0°.
  • the image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ .
  • the amount of reflected light R at the time the phase of the modulated light W is 0° is photoelectrically converted into an electric charge, which is stored in the image capturing device 204 in step S 3 .
  • the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S 4 .
  • the digital signal is saved in a buffer memory as a sampled amplitude A 0 of the reflected light R at the time the phase of the modulated light W is 0° in step S 5 . Then, the light source 200 stops emitting the modulated light W in step S 6 .
  • the light source 200 emits the modulated light W again in step S 8 .
  • the object 202 is irradiated with the modulated light W
  • the object 202 reflects it as a reflected light R to the image capturing device 204 .
  • the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T 2 (>T 1 ) later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 90°.
  • the image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ .
  • the amount of reflected light R at the time the phase of the modulated light W is 90° is photoelectrically converted into an electric charge, which is stored into the image capturing device 204 in step S 9 .
  • the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S 10 .
  • the digital signal is saved in a buffer memory as a sampled amplitude A 1 of the reflected light R at the time the phase of the modulated light W is 90° in step S 11 . Then, the light source 200 stops emitting the modulated light W in step S 12 .
  • the light source 200 emits the modulated light W again in step S 14 .
  • the object 202 When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204 .
  • the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T 3 (>T 2 ) later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 180°.
  • the image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ .
  • the amount of reflected light R at the time the phase of the modulated light W is 270° is photoelectrically converted into an electric charge, which is stored into the image capturing device 204 in step S 21 .
  • the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S 22 .
  • the digital signal is saved in a buffer memory as a sampled amplitude A 3 of the reflected light R at the time the phase of the modulated light W is 270° in step S 23 . Then, the light source 200 stops emitting the modulated light W in step S 24 .
  • the ranging apparatus is incorporated in a digital camera, a surveillance camera, or the like, then the ranging apparatus is exposed to noise such as clock noise, etc. from a display circuit, other IC circuits, etc.
  • a ranging apparatus comprising a light-emitting unit for emitting a series of modulated lights which are intensity-modulated and have respective different start phases at which the modulated lights start being emitted, a light-detecting unit for detecting reflected lights from an object that is irradiated with the modulated lights, and a calculating unit for calculating the distance up to the object based on the phase difference between the modulated lights and the reflected lights.
  • the light-emitting unit may comprise a light emitter and a light emission controller for intensity-modulating a light emitted from the light emitter and emitting the intensity-modulated light as the modulated lights, the light emission controller including a start phase controller for controlling the start phases of the modulated lights.
  • the light-detecting unit may sample the amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted.
  • the ranging apparatus disclosed in Japanese Patent No. 3758618 has needed to provide a plurality of patterns for arranging exposure periods, and hence required a complex circuit for energizing an image capturing device. According to the first aspect of the present invention, however, as the exposure periods are established in a single pattern, the circuit for energizing the image capturing device is relatively simple, and the ranging apparatus is less burdensome for the CPU incorporated therein.
  • the durations of the exposure periods may be changed by a user's command input, an automatic iris mechanism, or an electronic shutter combined with the image capturing device.
  • the durations of the exposure periods may be changed based on an external control signal.
  • the durations of the exposure periods are usually changed while the central points of the exposure periods remain unchanged in position. Therefore, the start times of the exposure periods are changed, and hence the timings at which the drive signal is applied to the image capturing device need to be changed, resulting in the need for a calibration.
  • the ranging apparatus may further comprise a start phase calculator for calculating the start phases of the modulated lights based on the changed exposure periods.
  • the ranging apparatus does not need a memory or a memory area for storing the table.
  • the light-detecting unit may comprise an exposure timing changer for changing the cycle length of the exposure periods based on an external control signal
  • the light-emitting unit may comprise a wavelength changer for changing respective wavelengths of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changer, and a start phase changer for changing the start phases of the modulated lights based on the changed cycle length of the exposure periods.
  • the wavelengths of the modulated lights may be changed by a CPU control signal or a user's command input. In other words, the wavelengths of the modulated lights may be changed based on an external control signal. In this case, the central time points of the exposure periods are usually determined depending on the changed wavelengths of the modulated lights. If the wavelengths of the exposure periods are changed to a value which is related to the preset cycle length of the exposure periods by an integral number, e.g., if the wavelengths of the exposure periods are divided by an integer or multiplied by an integer, then the process is simple. However, if the wavelengths of the exposure periods are changed to a value which is related to the preset cycle time of the exposure periods by a real number, then the ranging apparatus needs a dedicated calibration.
  • the wavelength changer changes the respective wavelengths of the modulated lights based on the above-mentioned external control signal
  • the exposure timing changer changes the cycle length of the exposure periods based on the external control signal
  • the start phase changer changes the start phases of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changer. Consequently, the wavelengths of the modulated lights can be set depending on the cycle length of the exposure periods.
  • the exposure timings can therefore be changed to a value which is related to the preset cycle length of the exposure periods by an integral number, e.g., the exposure timings can be divided by an integer or multiplied by an integer. Accordingly, the circuit arrangement of the ranging apparatus is relatively simple.
  • the ranging apparatus may further comprise a memory storing a table which registers therein information on the wavelengths and start phases of the modulated lights corresponding to the changed cycle length of the exposure periods, the wavelength changer may change the wavelengths of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table stored in the memory, and the start phase changer may change the start phases of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table. Therefore, the wavelength changer changes the wavelengths of the modulated lights based on the changed cycle length of the exposure periods by referring to the table, and the start phase changer changes the start phases by referring to the table. The processing time required by the ranging apparatus can be thus shortened.
  • the ranging apparatus may further comprise a wavelength calculator for calculating the wavelengths of the modulated lights based on the changed cycle length of the exposure periods, and a start phase calculator for calculating the start phases of the modulated lights based on the changed cycle length of the exposure periods.
  • the ranging apparatus does not need a memory or a memory area for storing the table.
  • the light-emitting unit may emit a first modulated light at a phase over a predetermined period from a first emission start time and emits a second modulated light at a difference phase over the predetermined period from a second emission start time
  • the light-detecting unit may detect a first reflected light from the object irradiated with the first modulated light over the predetermined period from the first emission start time and detects a second reflected light from the object irradiated with the second modulated light over the predetermined period from the second emission start time
  • the calculating unit may calculate the distance up to the object based on at least the phase difference between the first modulated light and the first reflected light and the phase difference between the second modulated light and the second reflected light.
  • a ranging method comprising the steps of (a) emitting a series of modulated lights which are intensity-modulated and have respective different start phases at which the modulated lights start being emitted, (b) detecting reflected lights from an object that is irradiated with the modulated lights, and (c) calculating the distance up to the object based on the phase difference between the modulated lights and the reflected lights.
  • the ranging method is less susceptible to noise. Since a circuit for energizing an image capturing device used in the ranging method is relatively simple, the ranging method is less burdensome for a CPU used to carry out the ranging method.
  • the step (b) may comprise an exposure timing changing step of changing a cycle length of the exposure periods based on an external control signal
  • the step (a) may comprise a wavelength changing step of changing respective wavelengths of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changing step, and a start phase changing step of changing the start phases of the modulated lights based on the changed cycle length of the exposure periods which has been changed by the exposure timing changing step.
  • the ranging method may use a table which registers therein information on the wavelengths and start phases of the modulated lights corresponding to the changed cycle length of the exposure periods, and the wavelength changing step may change the wavelengths of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table, and the start phase changing step may change the start phases of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table.
  • the ranging method may further comprise a wavelength calculating step of calculating the wavelengths of the modulated lights based on the changed cycle length of the exposure periods, and a start phase calculating step of calculating the start phases of the modulated lights based on the changed cycle length of the exposure periods.
  • the step (a) may comprise emitting a first modulated light at a phase over a predetermined period from a first emission start time and emitting a second modulated light at a different phase over the predetermined period from a second emission start time
  • the step (b) may comprise detecting a first reflected light from the object irradiated with the first modulated light over the predetermined period from the first emission start time, and detecting a second reflected light from the object irradiated with the second modulated light over the predetermined period from the second emission start time
  • the step (c) may comprise calculating the distance up to the object based on at least the phase difference between the first modulated light and the first reflected light and the phase difference between the second modulated light and the second reflected light.
  • the step (b) may comprise sampling the amount of the first reflected light in exposure periods established at a constant cycle length from the first emission start time and sampling the amount of the second reflected light in exposure periods established at the constant cycle length from the second emission start time, and the step (c) may comprise calculating a value representing the sampled amount of the first reflected light which is integrated over the predetermined period, as the phase difference between the first modulated light and the first reflected light, and calculating a value representing the sampled amount of the second reflected light which is integrated over the predetermined period, as the phase difference between the second modulated light and the second reflected light.
  • the ranging method may further comprise the step of correcting the start phases of the modulated lights based on the difference between the distance up to the object which is calculated in the step (c) and a distance measured up to the object.
  • the ranging apparatus and the ranging method according to the present invention are less susceptible to noise. Since the circuit for energizing the image capturing device used in the ranging apparatus and the ranging method is relatively simple, the ranging apparatus and the ranging method is less burdensome for the CPU used therein.
  • FIG. 1 is a block diagram of a first ranging apparatus according to the present invention
  • FIG. 2 is a schematic view of a general structure of an image capturing device
  • FIGS. 3A and 3B are views showing how an electric charge is stored in the image capturing device
  • FIGS. 4A and 4B are views showing how an electric charge is transferred in the image capturing device
  • FIG. 5 is a diagram illustrative of the principle of a process for determining a phase delay of a reflected light from sampled amplitudes thereof based on a captured image signal from the image capturing device;
  • FIG. 6 is a waveform diagram showing the relationship between first through fourth modulated lights emitted from a light-emitting means, a synchronizing signal, and exposure periods;
  • FIG. 7A is a waveform diagram showing the relationship between the first modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a first frame;
  • FIG. 7C is a waveform diagram showing the relationship between the third modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a fifth frame;
  • FIG. 7D is a waveform diagram showing the relationship between the fourth modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a seventh frame;
  • FIG. 8 is a flowchart of a processing sequence of the first ranging apparatus
  • FIG. 9 is a block diagram of a second ranging apparatus according to the present invention.
  • FIG. 11 is a diagram showing details of a first information table
  • FIG. 12 is a block diagram of a third ranging apparatus according to the present invention.
  • FIG. 13 is a block diagram of a fourth ranging apparatus according to the present invention.
  • FIG. 14A is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods in a usual fashion;
  • FIG. 14B is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods whose duration has been changed;
  • FIG. 15 is a diagram showing details of a second information table
  • FIG. 18 is a view illustrative of an optical TOF ranging process
  • FIG. 20 is a flowchart of a processing sequence of a ranging apparatus according to the related art.
  • FIG. 21B is a waveform diagram showing the relationship between the modulated light, the reflected light, the synchronizing signal, and exposure periods in a third frame in the ranging apparatus according to the related art;
  • FIG. 21D is a waveform diagram showing the relationship between the modulated light, the reflected light, the synchronizing signal, and exposure periods in a seventh frame in the ranging apparatus according to the related art.
  • FIG. 22 is a waveform diagram illustrative of drawbacks of the ranging apparatus according to the related art.
  • a ranging apparatus 10 A As shown in FIG. 1 , a ranging apparatus 10 A according to a first embodiment of the present invention (hereinafter referred to as “first ranging apparatus 10 A”) comprises a light-emitting means 14 for emitting a series of modulated lights 12 which have been intensity-modulated and which start being emitted at different start phases, a light-detecting means 20 for detecting reflected lights 18 from an object 16 which has been irradiated with the modulated lights 12 , a calculating means 22 for calculating the distance from the first ranging apparatus 10 A to the object 16 based on the phase differences between the modulated lights 12 and the reflected lights 18 , and a synchronizing signal generator 24 for generating a synchronizing signal Sa which represents the start of a light emission process.
  • first ranging apparatus 10 A comprises a light-emitting means 14 for emitting a series of modulated lights 12 which have been intensity-modulated and which start being emitted at different start phases, a light-detecting means 20 for detecting
  • the light-emitting means 14 comprises a light emitter 26 and a light emission controller 28 for controlling the light emitter 26 to intensity-modulate lights emitted from the light emitter 26 and emit them as the modulated lights 12 .
  • the light emitter 26 starts emitting the modulated lights 12 based on a negative-going edge, for example, of the synchronizing signal.
  • a time point which is aligned with the negative-going edge of the synchronizing signal Sa refers to an emission starting time point.
  • a next second frame the electric charge is transferred.
  • a predetermined voltage is applied to a vertical transfer electrode 54 corresponding to one packet of the vertical transfer path 48 , thereby lowering the potential of the packet to a level lower than the potential of the pixel 46 .
  • the electric charge stored in the pixel 46 now flows into the vertical transfer path 48 .
  • the potential is restored, and during a horizontal blanking period, a transfer voltage is applied to the vertical transfer electrode 54 to transfer the electric charge to the horizontal transfer path 44 , as shown in FIG. 2 .
  • the horizontal blanking period and the horizontal scanning period in the second frame are repeated to transfer a series of electric charges stored in the respective pixels 46 along the vertical transfer path 48 and the horizontal transfer path 44 to the output circuit 56 , which outputs the captured image signal Sb.
  • the captured image signal Sb from the image capturing device 30 is processed into the analog image signal Sc by the analog signal processor 36 .
  • the analog image signal Sc is converted into the digital image data Dc by the A/D converter 38 .
  • the digital image data Dc have a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at required timings (exposure periods) and associated with the respective pixels 46 .
  • the buffer memory 40 stores four types of image data Dc (first through fourth image data Dc 1 through Dc 4 ) according to the optical TOF ranging process referred to above.
  • the first image data Dc 1 has a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at timings when the phase of the modulated light 12 is 0°, for example, and associated with the respective pixels 46 .
  • the second, third, and fourth image data Dc 2 , Dc 3 , Dc 4 have a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at timings when the phase of the modulated light 12 is 90°, 180°, 270°, for example, and associated with the respective pixels 46 .
  • the calculating means 22 comprises a distance calculator 58 for calculating the distances from the respective pixels 46 to the object 16 based on the first through fourth image data Dc 1 through Dc 4 .
  • a calculating algorithm of the distance calculator 58 particularly, a calculating algorithm for calculating the distance from one pixel 46 to the object 16 will be described below with reference to FIG. 5 . If it is assumed that the modulated light 12 has its varying amplitude represented by a circle 60 with its center at the origin of a coordinate system, then the reflected light 18 has its amplitude at points P 1 , P 2 , P 3 , P 4 when the modulated light 12 is at respective phases of 0° (360°), 90°, 180°, 270°. If the point P 1 has coordinates (A, ⁇ B), then the point P 2 has coordinates (B, A), the point P 3 has coordinates ( ⁇ A, B), and the point P 4 has coordinates ( ⁇ B, ⁇ A).
  • the light emission controller 28 of the first ranging apparatus 10 A has a start phase controller 64 for controlling the phases (start phases) at which the respective modulated lights 12 start being emitted.
  • the light-detecting means 20 samples the amounts of reflected lights 18 in exposure periods that are established with a constant cycle length based on the negative-going edge, for example, of the synchronizing signal Sa.
  • the start phase controller 64 controls the light emitter 26 to emit a series of modulated lights, i.e., as shown in FIG. 6 , a first modulated light 12 A which starts being emitted at a first phase ⁇ 1 , a second modulated light 12 B which starts being emitted at a second phase ⁇ 2 , a third modulated light 12 C which starts being emitted at a third phase ⁇ 3 , and a fourth modulated light 12 D which starts being emitted at a fourth phase ⁇ 4 .
  • the first phase 61 is delayed or advanced by a given phase from the reference phase 66 (0°), and can be determined depending on an initially-set exposure period of the image capturing device 30 .
  • the second phase ⁇ 2 is delayed by 90° from the first phase ⁇ 1 , the third phase ⁇ 3 by 90° from the second phase ⁇ 2 , and the fourth phase ⁇ 4 by 90° from the third phase ⁇ 3 .
  • FIGS. 7A through 7D show an example of the chronological relationship between the first through fourth modulated lights 12 A through 12 D and the exposure periods Tr.
  • the centers of the exposure periods Tr are held in alignment with the phase of 180° of the first modulated light 12 A.
  • the centers of the exposure periods Tr are held in alignment with the phase of 90° of the second modulated light 12 B.
  • the centers of the exposure periods Tr are held in alignment with the phase of 0° of the third modulated light 12 C.
  • the centers of the exposure periods Tr are held in alignment with the phase of 270° of the fourth modulated light 12 D.
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a first frame in step S 101 shown in FIG. 8 (see FIG. 7A ).
  • the start phase controller 64 sets a start phase for a first modulated light 12 A to the first phase ⁇ 1 in step S 102 . Therefore, the light emission controller 28 controls the light emitter 26 to emit a first modulated light 12 A based on the negative-going edge of the synchronizing signal Sa in step S 103 .
  • the first modulated light 12 A emitted from the light emitter 26 is applied to the object 16 , and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32 .
  • the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with a time point that is a time period Ta later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the first modulated light 12 A has a phase of 180°.
  • the image capturing device 30 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ (see FIG. 7A ).
  • the amount of reflected light 18 at the time the phase of the first modulated light 12 A is 180° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S 104 .
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a second frame in step S 105 .
  • the electric charge stored in the image capturing device 30 is transferred as an analog signal (image signal) in step S 106 , and the analog signal is converted into a digital signal in step S 107 .
  • the digital signal is saved in the buffer memory 40 as third image data Dc 3 representing a pixel-dependent array of sampled amplitudes S 3 of the reflected light 18 at the time the phase of the first modulated light 12 A is 180° in step S 108 . Then, the light emitter 26 stops emitting the first modulated light 12 A in step S 109 .
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a third frame in step S 110 (see FIG. 7B ).
  • the start phase controller 64 sets a start phase for a second modulated light 12 B to the second phase ⁇ 2 in step S 111 .
  • the light emission controller 28 controls the light emitter 26 to emit a second modulated light 12 B based on the negative-going edge of the synchronizing signal Sa in step S 112 .
  • the second modulated light 12 B emitted from the light emitter 26 is applied to the object 16 , and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32 .
  • the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ .
  • the amount of reflected light 18 at the time the phase of the second modulated light 12 B is 90° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S 113 (see FIG. 7B ).
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a fourth frame in step S 114 .
  • the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S 115 , and the analog signal is converted into a digital signal in step S 116 .
  • the digital signal is saved in the buffer memory 40 as second image data Dc 2 representing a pixel-dependent array of sampled amplitudes S 2 of the reflected light 18 at the time the phase of the second modulated light 12 B is 90° in step S 117 .
  • the light emitter 26 stops emitting the second modulated light 12 B in step S 118 .
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a fifth frame in step S 119 (see FIG. 7C ).
  • the start phase controller 64 sets a start phase for a third modulated light 12 C to the third phase ⁇ 3 in step S 120 .
  • the light emission controller 28 controls the light emitter 26 to emit a third modulated light 12 C based on the negative-going edge of the synchronizing signal Sa in step S 121 .
  • the third modulated light 12 C emitted from the light emitter 26 is applied to the object 16 , and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32 .
  • the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ . In the fifth frame, therefore, the amount of reflected light 18 at the time the phase of the third modulated light 12 C is 0° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S 122 (see FIG. 7C ).
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a sixth frame in step S 123 .
  • the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S 124 , and the analog signal is converted into a digital signal in step S 125 .
  • the digital signal is saved in the buffer memory 40 as first image data Dc 1 representing a pixel-dependent array of sampled amplitudes S 1 of the reflected light 18 at the time the phase of the third modulated light 12 C is 0° in step S 126 .
  • the light emitter 26 stops emitting the third modulated light 12 C in step S 127 .
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing a seventh frame in step S 128 (see FIG. 7D ).
  • the start phase controller 64 sets a start phase for a fourth modulated light 12 D to the fourth phase ⁇ 4 in step S 129 .
  • the light emission controller 28 controls the light emitter 26 to emit a fourth modulated light 12 D based on the negative-going edge of the synchronizing signal Sa in step S 130 .
  • the fourth modulated light 12 D emitted from the light emitter 26 is applied to the object 16 , and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32 .
  • the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2 ⁇ .
  • the amount of reflected light 18 at the time the phase of the fourth modulated light 12 D is 270° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S 131 (see FIG. 7D ).
  • the synchronizing signal generator 24 generates a synchronizing signal Sa representing an eighth frame in step S 132 .
  • the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S 133 , and the analog signal is converted into a digital signal in step S 134 .
  • the digital signal is saved in the buffer memory 40 as fourth image data Dc 4 representing a pixel-dependent array of sampled amplitudes S 4 of the reflected light 18 at the time the phase of the fourth modulated light 12 D is 270° in step S 135 .
  • the light emitter 26 stops emitting the fourth modulated light 12 D in step S 136 .
  • the distance calculator 58 calculates the distance up to the object 16 based on the first through fourth image data Dc 1 through Dc 4 saved in the buffer memory 40 in step S 137 .
  • the first ranging apparatus 10 A emits a series of modulated lights 12 which have been intensity-modulated and which start being emitted at different start phase, detects reflected lights 18 from the object 16 which has been irradiated with the modulated lights 12 , and calculates the distance up to the object 16 based on the phase differences between the modulated lights 12 and the reflected lights 18 . If the first ranging apparatus 10 A is incorporated in a digital camera, a surveillance camera, or the like, then the first ranging apparatus 10 A is exposed to noise such as clock noise, etc. from a display circuit, other IC circuits, etc. However, as simply illustrated in FIG. 6 , since the exposure timings do not change depending on the frames, the exposure periods Tr can easily be set out of alignment with the timings of noise spikes 68 , making the first ranging apparatus 10 A less susceptible to noise.
  • the circuit (image capturing device controller 34 ) for energizing the image capturing device 30 is relatively simple, and a burden on the CPU incorporated therein can be reduced.
  • the light-detecting means 20 additionally includes an exposure period changer 70 for changing the terminal ends of the exposure periods Tr based on an external control signal.
  • the first start phase changer 72 changes the start phases of the modulated lights 12 based on the changed exposure periods Tr and the information registered in the first information table 74 stored in the memory 76 . Specifically, the first start phase changer 72 reads phase information corresponding to the changed exposure periods Tr, from among the phase information registered in the first information table 74 stored in the memory 76 , and supplies the read information to the start phase controller 64 . Based on the supplied phase information, the start phase controller 64 changes the start phases (first phase ⁇ 1 through fourth phase ⁇ 4 ) of the first modulated light 12 A through fourth modulated light 12 D.
  • the light-detecting means 20 obtains a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12 A is 180°, for example, and also obtains a sampled amplitude of the reflected light 18 when the phase of the second modulated light 12 B is 90°. Similarly, the light-detecting means 20 obtains a sampled amplitude of the reflected light 18 when the phase of the third modulated light 12 C is 0°, and also obtains a sampled amplitude of the reflected light 18 when the phase of the fourth modulated light 12 D is 270°.
  • the durations of the exposure periods Tr may be changed by a user's command input, an automatic iris mechanism, or an electronic shutter combined with the image capturing device 30 .
  • the durations of the exposure periods Tr may be changed based on an external control signal.
  • the durations of the exposure periods Tr are usually changed while the central points of the exposure periods Tr remain unchanged in position. Therefore, the start times of the exposure periods Tr are changed, and hence the timings at which the drive signal is applied to the image capturing device 30 need to be changed, resulting in the need for a calibration.
  • the exposure period changer 70 changes the exposure periods Tr based on a command signal from a user control console 78 , i.e., a command signal from the user indicating whether the exposure periods Tr are to be shorter or longer, or a command signal from an exposure period calculator 80 , i.e., a command signal indicating whether the exposure periods Tr are to be shorter or longer, based on the sampled amplitudes stored in the buffer memory 40 .
  • the exposure period changer 70 can easily change the exposure periods Tr.
  • the light detecting means 20 can now obtain, at the central time points of the changed exposure periods Tr, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12 A is 180°.
  • the absolute phase directly represents a start phase of the first modulated light 12 A.
  • the relative phase represents a phase by which the current start phase of the first modulated light 12 A is delayed or advanced.
  • the first start phase changer 72 reads the phase information (start phase) corresponding to the supplied identification code, from the first information table 74 , and supplies the read phase information to the start phase controller 64 .
  • the start phase controller 64 sets a start phase which is supplied from the first start phase changer 72 , as a start phase (first phase ⁇ 1 ) of the first modulated light 12 A. Based on the set first phase ⁇ 1 , the second phase ⁇ 2 through fourth phase ⁇ 4 are to be set.
  • the exposure period changer 70 changes the terminal ends of the exposure periods Tr to change the durations of the exposure periods Tr
  • the first start phase changer 72 changes the start phases of the modulated lights 12 based on the changed exposure periods Tr.
  • the first information table 74 registers therein the information on the start phases of the first modulated light 12 A through fourth modulated light 12 D corresponding to the identification codes of the exposure periods Tr, and the start phases of the first modulated light 12 A through fourth modulated light 12 D are changed based on the information registered in the first information table 74 . Consequently, the start phases of the first modulated light 12 A through fourth modulated light 12 D based on the changed exposure periods Tr can be determined simply by accessing the first information table 74 , rather than by carrying out complex calculations. The processing time required by the second ranging apparatus 10 B can thus be shortened.
  • the third ranging apparatus 10 C is similar to the second ranging apparatus 10 B described above, except as follows:
  • the exposure period changer 70 has initial exposure periods Tr preset therein. When a command signal for shortening the exposure periods Tr is supplied to the exposure period changer 70 , the exposure period changer 70 shortens the present exposure periods Tr by 1/n (n: real number). When a command signal for lengthening the exposure periods Tr is supplied to the exposure period changer 70 , the exposure period changer 70 lengthens the present exposure periods Tr by 1/n (n: real number).
  • the third ranging apparatus 10 C includes a first start phase calculator 82 for calculating the start phase of the first modulated light 12 A through fourth modulated light 12 D based on the changed exposure periods Tr.
  • the first start phase calculator 82 calculates a start phase (first phase ⁇ 1 ) of the first modulated light 12 A based on the durations of the changed exposure periods Tr.
  • the thus-calculated first phase ⁇ 1 is as follows:
  • the light detecting means 20 can now obtain, at the central time points of the changed exposure periods Tr, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12 A is 180°.
  • the calculated start phase (first phase ⁇ 1 ) is supplied to the start phase controller 64 .
  • the start phase controller 64 sets a start phase that is supplied from the first start phase calculator 82 , as a start phase (first phase ⁇ 1 ) of the first modulated light 12 A. Based on the set first phase ⁇ 1 , the second phase ⁇ 2 through fourth phase ⁇ 4 are set.
  • the light-detecting means 20 can sample the reflected light 18 at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12 A through 12 D, at the central time points of the changed exposure periods Tr.
  • the distance calculator 58 is now capable of calculating the distance up to the object 16 highly accurately, as with the distance calculator 58 of the second ranging apparatus 10 B.
  • the third ranging apparatus 10 C does not need to have the memory 76 or a memory area for storing the first information table 74 .
  • a ranging apparatus 10 D according to a fourth embodiment of the present invention (hereinafter referred to as “fourth ranging apparatus 10 D”) will be described below with reference to FIGS. 13 through 14B .
  • the fourth ranging apparatus 10 D is similar to the first ranging apparatus 10 A described above, but differs therefrom as follows:
  • the light-detecting means 20 includes an exposure timing changer 84 for changing the cycle length Tt (see FIGS. 14A and 14B ) of the exposure periods Tr based on an external control signal.
  • the light-emitting means 14 includes a wavelength changer 86 for changing the wavelengths Td (see FIGS.
  • the wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12 A through 12 D based on the changed cycle length Tt of the exposure periods Tr and the information (wavelength-information) registered in the second information table 90 stored in the memory 76 .
  • the second start phase changer 88 changes the start phases of the first modulated light 12 A through fourth modulated light 12 D based on the changed cycle length Tt of the exposure periods Tr and the information (phase information) registered in the second information table 90 stored in the memory 76 .
  • the wavelength changer 86 reads the information on the wavelength corresponding to the changed cycle length Tt of the exposure periods Tr, from among the information on the wavelengths registered in the second information table 90 stored in the memory 76 , and supplies the read information to the light emission controller 28 . Based on the supplied information on the wavelength, the light emission controller 28 changes the wavelengths Td of the first through fourth modulated lights 12 A through 12 D.
  • the second start phase changer 88 reads the information on the phase corresponding to the changed cycle length Tt of the exposure periods Tr, from among the information on the phases registered in the second information table 90 , and supplies the read information to the start phase controller 64 . Based on the supplied information on the phase, the start phase controller 64 changes the start phases of the first modulated light 12 A through fourth modulated light 12 D.
  • the second start phase changer 88 controls the light emitter 26 to emit a series of modulated lights, i.e., as shown in FIG. 14A , a first modulated light 12 A which starts being emitted at a first phase ⁇ 1 , a second modulated light 12 B which starts being emitted at a second phase ⁇ 2 , a third modulated light 12 C which starts being emitted at a third phase ⁇ 3 , and a fourth modulated light 12 D which starts being emitted at a fourth phase ⁇ 4 .
  • the light-detecting means 20 obtains a sampled amplitude S 3 of the reflected light 18 when the phase of the first modulated light 12 A is 180°, for example, and also obtains a sampled amplitude S 2 of the reflected light 18 when the phase of the second modulated light 12 B is 90°. Similarly, the light-detecting means 20 obtains a sampled amplitude S 1 of the reflected light 18 when the phase of the third modulated light 12 C is 0°, and also obtains a sampled amplitude S 4 of the reflected light 18 when the phase of the fourth modulated light 12 D is 270°.
  • the time length of one frame may be changed by a CPU control signal or a user's command input, thereby changing the wavelength Td of the modulated light 12 .
  • the time length of one frame may be changed based on an external control signal.
  • the central time points of the exposure periods Tr are usually determined depending on the changed time length of one frame. If the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., if the cycle length Tt of the exposure periods Tr is divided by an integer or multiplied by an integer, then the process is simple. However, if the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle time Tt of the exposure periods Tr by a real number, then the fourth ranging apparatus 10 D needs a dedicated calibration.
  • the wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12 A through 12 D based on a command signal from a user control console 78 , i.e., a command signal from the user indicating whether the time length of one frame is to be shorter or longer, or a command signal from an exposure timing calculator 92 for calculating whether the time length of one frame is to be shorter or longer, i.e., a command signal indicating whether the time length of one frame is to be shorter or longer, based on the sampled amplitudes stored in the buffer memory 40 .
  • the exposure timing changer 84 may change the cycle length Tt of the exposure periods Tr as follows:
  • the exposure timing changer 84 establishes several types of cycle lengths Tt having different time lengths, e.g., at least two types of cycle lengths Tt, in advance.
  • the exposure timing changer 84 selects a cycle length Tt that is one level shorter than the cycle length Tt of the present exposure periods Tr.
  • the exposure timing changer 84 selects a cycle length Tt that is one level longer than the cycle length Tt of the present exposure periods Tr.
  • the wavelengths Td of the first through fourth modulated lights 12 A through 12 D can be set depending on the changed cycle length Tt of the exposure periods Tr according to the above process.
  • the cycle length Tt of the exposure periods Tr can be changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the cycle length Tt of the exposure periods Tr can be divided by an integer or multiplied by an integer. Accordingly, the circuit arrangement of the fourth ranging apparatus 10 D is relatively simple.
  • the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the cycle length Tt of the exposure periods Tr is divided by an integer or multiplied by an integer, then the reflected light 18 can be sampled at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12 A through 12 D providing the wavelength Td of the first through fourth modulated lights 12 A through 12 D remains unchanged.
  • the reflected light 18 cannot be sampled at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12 A through 12 D.
  • the exposure timing changer 84 assigns identification codes respectively to the cycle lengths Tt of a plurality of types of exposure periods Tr that are established in advance.
  • the exposure timing changer 84 sends an identification code corresponding to the cycle length Tt of exposure periods Tr selected thereby to the wavelength changer 86 , and the second start phase changer 88 , which recognize the changed cycle length Tt of the exposure periods Tr based on the identification code.
  • the information registered in the second information table 90 may include, as shown in FIG. 15 , the identification codes of the cycle lengths Tt of the exposure periods Tr, wavelength information and phase information (start phase), corresponding to the identification codes of the cycle lengths Tt of the exposure periods Tr.
  • start phase corresponding to the identification codes of exposure periods Tr will be explained below.
  • the wavelength Td of the first modulated light 12 A is changed to the wavelength indicated by the wavelength information corresponding to the identification code, the start phase of the first modulated light 12 A is changed to a start phase represented by the phase information corresponding to the identification code, and then the first modulated light 12 A is emitted.
  • the light-detecting means 20 can now obtain, at the central time points of the exposure periods Tr whose cycle length Tt has been changed, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12 A is 180°.
  • the second information table 90 may register therein only information on the wavelengths and the start phases (first phases ⁇ 1 ) of the first modulated light 12 A. This is because the wavelength Td of the second modulated light 12 B through fourth modulated light 12 D are the same as the wavelength Td of the first modulated light 12 A, and, as described above, the second phase ⁇ 2 of the second modulated light 12 B is delayed by 90° from the first phase ⁇ 1 , the third phase ⁇ 3 by 90° from the second phase ⁇ 2 , and the fourth phase ⁇ 4 by 90° from the third phase ⁇ 3 , and thus, the second through fourth phases can be easily set based on the above phase relation.
  • the wavelength changer 86 reads the information on the wavelength corresponding to the supplied identification code from the second information table 90 , and supplies the read information to the light emission controller 28 .
  • the light emission controller 28 sets the wavelengths Td of the first through fourth modulated lights 12 A through 12 D, as wavelengths represented by the wavelength information supplied from the wavelength changer 86 .
  • the second start phase changer 88 reads the phase information (start phase) corresponding to the supplied identification code from the second information table 90 , and supplies the read information to the start phase controller 64 .
  • the start phase controller 64 sets the start phase (first phase ⁇ 1 ) of the first modulated light 12 A as a start phase supplied from the second start phase changer 88 . Based on the set first phase ⁇ 1 , the second phase ⁇ 2 through fourth phase ⁇ 4 are set.
  • the exposure timing changer 84 changes the cycle length Tt of the exposure periods Tr
  • the wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12 A through 12 D based on the changed cycle length Tt of the exposure periods Tr
  • the second start phase changer 88 changes the start phases of the first modulated light 12 A through fourth modulated light 12 D based on the changed cycle length Tt of the exposure periods Tr. Therefore, the wavelengths Td of the modulated lights 12 can be set depending on the cycle length Tt of the exposure periods Tr.
  • the exposure timings can be changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the exposure timings can be divided by an integer or multiplied by an integer. Therefore, the circuit arrangement of the fourth ranging apparatus 10 D is relatively simple.
  • the second information table 90 registers therein the information on the wavelengths Td and the start phases of the first modulated light 12 A, corresponding to the identification codes of the cycle lengths Tt of the exposure periods Tr, and the wavelengths Td and the start phases of the first through fourth modulated lights 12 A through 12 D, are changed based on the information registered in the second information table 90 . Consequently, the wavelengths Td and the start phases of the first through fourth modulated lights 12 A through 12 D based on the changed cycle length Tt of the exposure periods Tr can be determined simply by accessing the second information table 90 , rather than by carrying out complex calculations. The processing time required by the fourth ranging apparatus 10 D can thus be shortened.
  • a ranging apparatus 10 E according to a fifth embodiment of the present invention (hereinafter referred to as “fifth ranging apparatus 10 E”) will be described below with reference to FIG. 16 .
  • the fifth ranging apparatus 10 E is similar to the fourth ranging apparatus 10 D described above, but differs therefrom as follows:
  • the exposure timing changer 84 has the cycle length Tt of initial exposure periods Tr preset therein.
  • the exposure timing changer 84 shortens the cycle length Tt of the present exposure periods Tr by 1/m (m: integral number).
  • the exposure timing changer 84 lengthens the cycle length Tt of the present exposure periods Tr by 1/m (m: integral number).
  • the fifth ranging apparatus 10 E includes a wavelength calculator 94 for calculating the wavelengths Td of the first through fourth modulated lights 12 A through 12 D based on the changed cycle length Tt of the exposure periods Tr, and a second start phase calculator 96 for calculating the start phases at which the first through fourth modulated lights 12 A through 12 D start being emitted.
  • the sixth ranging apparatus 10 F is similar to the first ranging apparatus 10 A described above, but differs therefrom in that it includes a difference calculator 98 and a start phase corrector 100 .
  • the difference calculator 98 calculates the difference ⁇ L between the distance up to the object 16 which has been calculated by the distance calculator 58 (calculated distance Lc) and the measured distance Lr up to the object 16 which has been input from the control console 78 .
  • the start phase corrector 100 calculates a start phase (first phase ⁇ 1 ) of the first modulated light 12 A based on the difference ⁇ L calculated by the difference calculator 98 . If the distance up to the object 16 which has been calculated by the distance calculator 58 (calculated distance Lc) is shorter than the measured distance Lr up to the object 16 which has been input from the control console 78 , then the start phase corrector 100 sets the start phase of the first modulated light 12 A to a value advanced (or delayed) from the present set start phase. Conversely, if the calculated distance Lc is longer than the measured distance Lr, then the start phase corrector 100 sets the start phase of the first modulated light 12 A to a value delayed (or advanced) from the present set start phase.
  • the start phase corrector 100 supplies the calculated start phase (first phase ⁇ 1 ) to the start phase controller 64 .
  • the start phase controller 64 sets a start phase supplied from the start phase corrector 100 , to be the start phase (first phase ⁇ 1 ) of the first modulated light 12 A. Based on the set first phase ⁇ 1 , the second phase ⁇ 2 through fourth phase ⁇ 4 are set.
  • the distance calculator 58 calculates the distance Lc up to the object 16 based on the corrected start phases and compares the calculated distance Lc with the measured distance Lr again.
  • the operation of the difference calculator 98 and the start phase corrector 100 is put to an end.
  • the sixth ranging apparatus 10 F can correct an error of the distance measured up to the object 16 , the sixth ranging apparatus 10 F can measure the distance accurately and stably.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)

Abstract

A first ranging apparatus includes a light-emitting unit for emitting a series of first through fourth modulated lights which have respective different start phases at which the first through fourth modulated lights start being emitted, a light-detecting unit for detecting reflected lights from an object that is irradiated with the first through fourth modulated lights, and a calculating unit for calculating the distance up to the object based on the phase difference between the first through fourth modulated lights and the reflected lights. The light-emitting unit comprises a start phase controller for controlling the start phases. The light-detecting units samples the amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a ranging apparatus and a ranging method, and more particularly to a ranging apparatus and a ranging method for detecting the phase delay of reflected light from an object that is irradiated with modulated light at each of the pixels of an image capturing device, for thereby detecting a three-dimensional structure of the object.
2. Description of the Related Art
One known process for measuring the distance up to an object is an optical TOF (Time Of Flight) ranging process.
As shown in FIG. 18 of the accompanying drawings, a ranging apparatus based on the optical TOF ranging process comprises a light source 200 in the form of an LED array, for example, for emitting intensity-modulated light (modulated light), an image capturing device 204 for detecting reflected light from an object 202 irradiated with the modulated light from the light source 200, and an optical system 206 for focusing the reflected light onto the image capturing device 204.
If the modulated light emitted from the light source 200 and applied to the object 202 is intensity-modulated, for example, at a high frequency of 20 MHz, then the modulated light has a wavelength of 15 m. When the modulated light travels back and forth over a distance of 7.5 m, the modulated light as it is detected by the image capturing device 204 has undergone a phase delay of one cycle length.
The phase delay that the reflected light undergoes with respect to the modulated light will be described below with reference to FIG. 19 of the accompanying drawings.
As shown in FIG. 19, a reflected light R has a phase delay of φ with respect to a modulated light W. In order to detect the phase delay of φ, the reflected light R is sampled at four equal intervals, for example, in one cyclic period of the modulated light W. If the sampled amplitudes of the reflected light R at respective phases of 0°, 90°, 180°, 270°, for example, of the modulated light W are represented by A0, A1, A2, A3, respectively, then the phase delay of φ is expressed by the following equation:
φ=arctan {(A3−A1)/(A0−A2)}
The reflected light from the object 202 is focused onto the light-detecting surface of the image capturing device 204 by the optical system 206. The light-detecting surface of the image capturing device 204 comprises a two-dimensional matrix of pixels (photodiodes). When the phase delay of φ is determined at each of the pixels according to the above equation, a three-dimensional structure of the object 202 can be detected.
A ranging apparatus based on the above principle is disclosed in Japanese Patent No. 3758618, for example.
The disclosed ranging apparatus measures the distance from the apparatus to an object when reflected light from the object is detected in exposure periods established in a plurality of patterns by opening and closing the overflow drain gates (OFDG) or readout gates of an image capturing device out of phase with each other.
Specific details of the ranging process performed by the disclosed ranging apparatus will be described below with reference to FIGS. 20 and 21A through 21D of the accompanying drawings. In a first frame, in response to a negative-going edge of a synchronizing signal Sa (see FIG. 21A) in step S1 shown in FIG. 20, the light source 200 emits a modulated light W in step S2. When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204. As shown in FIG. 21A, the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T1 later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 0°. The image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π.
In the first frame, the amount of reflected light R at the time the phase of the modulated light W is 0° is photoelectrically converted into an electric charge, which is stored in the image capturing device 204 in step S3. In a next second frame, the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S4. The digital signal is saved in a buffer memory as a sampled amplitude A0 of the reflected light R at the time the phase of the modulated light W is 0° in step S5. Then, the light source 200 stops emitting the modulated light W in step S6.
Thereafter, in a next third frame, in response to a negative-going edge of the synchronizing signal Sa (see FIG. 21B) in step S7, the light source 200 emits the modulated light W again in step S8. When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204. As shown in FIG. 21B, the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T2 (>T1) later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 90°. The image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π.
In the third frame, the amount of reflected light R at the time the phase of the modulated light W is 90° is photoelectrically converted into an electric charge, which is stored into the image capturing device 204 in step S9. In a next fourth frame, the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S10. The digital signal is saved in a buffer memory as a sampled amplitude A1 of the reflected light R at the time the phase of the modulated light W is 90° in step S11. Then, the light source 200 stops emitting the modulated light W in step S12.
Thereafter, in a next fifth frame, in response to a negative-going edge of the synchronizing signal Sa (see FIG. 21C) in step S13, the light source 200 emits the modulated light W again in step S14. When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204. As shown in FIG. 21C, the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T3 (>T2) later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 180°. The image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π.
In the fifth frame, the amount of reflected light R at the time the phase of the modulated light W is 180° is photoelectrically converted into an electric charge, which is stored into the image capturing device 204 in step S15. In a next fourth frame, the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S16. The digital signal is saved in a buffer memory as a sampled amplitude A2 of the reflected light R at the time the phase of the modulated light W is 180° in step S17. Then, the light source 200 stops emitting the modulated light W in step S18.
Thereafter, in a next seventh frame, in response to a negative-going edge of the synchronizing signal Sa (see FIG. 21D) in step S19, the light source 200 emits the modulated light W again in step S20. When the object 202 is irradiated with the modulated light W, the object 202 reflects it as a reflected light R to the image capturing device 204. As shown in FIG. 21D, the image capturing device 204 is adjusted to have the center of a first exposure period Tr synchronized with a time point that is a time period T4 (>T3) later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the modulated light W has a phase of 270°. The image capturing device 204 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π.
In the seventh frame, the amount of reflected light R at the time the phase of the modulated light W is 270° is photoelectrically converted into an electric charge, which is stored into the image capturing device 204 in step S21. In a next eighth frame, the electric charge stored in the image capturing device 204 is transferred as an analog signal, and the analog signal is converted into a digital signal in step S22. The digital signal is saved in a buffer memory as a sampled amplitude A3 of the reflected light R at the time the phase of the modulated light W is 270° in step S23. Then, the light source 200 stops emitting the modulated light W in step S24.
The phase delay φ of the reflected light R is determined based on the sampled amplitudes A0, A1, A2, A3 stored in the buffer memory, and the distance from the ranging apparatus to the object 202 is determined based on the phase delay φ in step S25.
If the above ranging apparatus is incorporated in a digital camera, a surveillance camera, or the like, then the ranging apparatus is exposed to noise such as clock noise, etc. from a display circuit, other IC circuits, etc.
Since the frames have different exposure timings as shown in FIG. 22 of the accompanying drawings, noise spikes 210 may be added to the exposure periods Tr of a certain frame and noise spikes 210 may not be added to the exposure periods Tr of another frame. Consequently, it is difficult to remove those noise spikes 210. In the example shown in FIG. 22, the noise spikes 210 are added to the exposure periods Tr of the third and fifth frames.
In addition, inasmuch as it is necessary for the different frames to have the different time periods T1 through T4 from the negative-going edge of the synchronizing signal Sa to the center of the first exposure period Tr, a complex drive circuit is required to operate the image capturing device 204, and the ranging process is burdensome for the CPU used therein.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a ranging apparatus and a ranging method which are less susceptible to noise, require a simple drive circuit for operating an image capturing device, and are less burdensome for the CPU incorporated in the ranging apparatus.
According to a first aspect of the present invention, there is provided a ranging apparatus comprising a light-emitting unit for emitting a series of modulated lights which are intensity-modulated and have respective different start phases at which the modulated lights start being emitted, a light-detecting unit for detecting reflected lights from an object that is irradiated with the modulated lights, and a calculating unit for calculating the distance up to the object based on the phase difference between the modulated lights and the reflected lights.
The ranging apparatus thus constructed is less susceptible to noise. Since a circuit for energizing an image capturing device used in the ranging apparatus is relatively simple, the ranging apparatus is less burdensome for a CPU incorporated therein.
According to the first aspect of the present invention, the light-emitting unit may comprise a light emitter and a light emission controller for intensity-modulating a light emitted from the light emitter and emitting the intensity-modulated light as the modulated lights, the light emission controller including a start phase controller for controlling the start phases of the modulated lights.
The light-detecting unit may sample the amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted. The ranging apparatus disclosed in Japanese Patent No. 3758618 has needed to provide a plurality of patterns for arranging exposure periods, and hence required a complex circuit for energizing an image capturing device. According to the first aspect of the present invention, however, as the exposure periods are established in a single pattern, the circuit for energizing the image capturing device is relatively simple, and the ranging apparatus is less burdensome for the CPU incorporated therein.
According to the first aspect of the present invention, the light-detecting unit may comprise an exposure period changer for changing terminal ends of the exposure periods based on an external control signal, and the light-emitting unit may comprise a start phase changer for changing the start phases of the modulated lights based on the exposure periods which have been changed by the exposure period changer.
If the object and its background are so bright that the signal generated by the light-detecting unit is saturated, then the durations of the exposure periods may be changed by a user's command input, an automatic iris mechanism, or an electronic shutter combined with the image capturing device. In other words, the durations of the exposure periods may be changed based on an external control signal. The durations of the exposure periods are usually changed while the central points of the exposure periods remain unchanged in position. Therefore, the start times of the exposure periods are changed, and hence the timings at which the drive signal is applied to the image capturing device need to be changed, resulting in the need for a calibration.
According to the first aspect of the present invention, the exposure period changer changes the terminal ends of the exposure periods to change the durations of the exposure periods, and the start phase changer changes the start phases of the modulated lights based on the changed exposure periods. It is not necessary to change the start times of the exposure periods. No calibration of the ranging apparatus is required since the start times of the exposure periods are not changed.
The ranging apparatus may further comprise a memory storing a table which registers therein information on the start phases of the modulated lights which correspond to the changed exposure periods, and the start phase changer may change the start phases of the modulated lights based on the changed exposure periods and the information registered in the table stored in the memory. The start phase changer can change the start phases of the modulated lights based on the changed exposure periods by referring to the table. The processing time required by the ranging apparatus can be thus shortened.
The ranging apparatus may further comprise a start phase calculator for calculating the start phases of the modulated lights based on the changed exposure periods. In this case, the ranging apparatus does not need a memory or a memory area for storing the table.
According to the first aspect of the present invention, the light-detecting unit may comprise an exposure timing changer for changing the cycle length of the exposure periods based on an external control signal, and the light-emitting unit may comprise a wavelength changer for changing respective wavelengths of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changer, and a start phase changer for changing the start phases of the modulated lights based on the changed cycle length of the exposure periods.
If the distance up to the object is so large that the calculated distance is of an invalid value, then the wavelengths of the modulated lights may be changed by a CPU control signal or a user's command input. In other words, the wavelengths of the modulated lights may be changed based on an external control signal. In this case, the central time points of the exposure periods are usually determined depending on the changed wavelengths of the modulated lights. If the wavelengths of the exposure periods are changed to a value which is related to the preset cycle length of the exposure periods by an integral number, e.g., if the wavelengths of the exposure periods are divided by an integer or multiplied by an integer, then the process is simple. However, if the wavelengths of the exposure periods are changed to a value which is related to the preset cycle time of the exposure periods by a real number, then the ranging apparatus needs a dedicated calibration.
According to the first aspect of the present invention, however, the wavelength changer changes the respective wavelengths of the modulated lights based on the above-mentioned external control signal, the exposure timing changer changes the cycle length of the exposure periods based on the external control signal, and the start phase changer changes the start phases of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changer. Consequently, the wavelengths of the modulated lights can be set depending on the cycle length of the exposure periods. The exposure timings can therefore be changed to a value which is related to the preset cycle length of the exposure periods by an integral number, e.g., the exposure timings can be divided by an integer or multiplied by an integer. Accordingly, the circuit arrangement of the ranging apparatus is relatively simple.
The ranging apparatus may further comprise a memory storing a table which registers therein information on the wavelengths and start phases of the modulated lights corresponding to the changed cycle length of the exposure periods, the wavelength changer may change the wavelengths of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table stored in the memory, and the start phase changer may change the start phases of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table. Therefore, the wavelength changer changes the wavelengths of the modulated lights based on the changed cycle length of the exposure periods by referring to the table, and the start phase changer changes the start phases by referring to the table. The processing time required by the ranging apparatus can be thus shortened.
The ranging apparatus may further comprise a wavelength calculator for calculating the wavelengths of the modulated lights based on the changed cycle length of the exposure periods, and a start phase calculator for calculating the start phases of the modulated lights based on the changed cycle length of the exposure periods. In this case, the ranging apparatus does not need a memory or a memory area for storing the table.
According to the first aspect of the present invention, the light-emitting unit may emit a first modulated light at a phase over a predetermined period from a first emission start time and emits a second modulated light at a difference phase over the predetermined period from a second emission start time, the light-detecting unit may detect a first reflected light from the object irradiated with the first modulated light over the predetermined period from the first emission start time and detects a second reflected light from the object irradiated with the second modulated light over the predetermined period from the second emission start time, and the calculating unit may calculate the distance up to the object based on at least the phase difference between the first modulated light and the first reflected light and the phase difference between the second modulated light and the second reflected light.
The light-detecting unit may sample the amount of the first reflected light in exposure periods established at a constant cycle length from the first emission start time and sample the amount of the second reflected light in exposure periods established at the constant cycle length from the second emission start time, and the calculating unit may calculate a value representing the sampled amount of the first reflected light which is integrated over the predetermined period, as the phase difference between the first modulated light and the first reflected light, and calculate a value representing the sampled amount of the second reflected light which is integrated over the predetermined period, as the phase difference between the second modulated light and the second reflected light.
According to the first aspect of the present invention, the ranging apparatus may further comprise a start phase corrector for correcting the start phases of the modulated lights based on the difference between the distance up to the object which is calculated by the calculating unit and a distance measured up to the object.
Since the ranging apparatus can correct an error of the distance measured up to the object, the ranging apparatus can measure the distance accurately and stably.
According to a second aspect of the present invention, there is provided a ranging method comprising the steps of (a) emitting a series of modulated lights which are intensity-modulated and have respective different start phases at which the modulated lights start being emitted, (b) detecting reflected lights from an object that is irradiated with the modulated lights, and (c) calculating the distance up to the object based on the phase difference between the modulated lights and the reflected lights.
The ranging method is less susceptible to noise. Since a circuit for energizing an image capturing device used in the ranging method is relatively simple, the ranging method is less burdensome for a CPU used to carry out the ranging method.
According to the second aspect of the present invention, the step (b) may comprise sampling the amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted.
According to the second aspect of the present invention, the step (b) may comprise an exposure period changing step of changing terminal ends of the exposure periods based on an external control signal, and the step (a) may comprise a start phase changing step of changing start phases of the modulated lights based on the exposure periods which have been changed by the exposure period changing step. The ranging method may use a table which registers therein information on the start phases of the modulated lights which correspond to the changed exposure periods, and the start phase changing step may change the start phases of the modulated lights based on the changed exposure periods and the information registered in the table. Alternatively, the ranging method may further comprise a start phase calculating step of calculating the start phases of the modulated lights based on the changed exposure periods, and the start phase changing step may change the start phases of the modulated lights based on the information on the start phases from the start phase calculating step.
According to the second aspect of the present invention, the step (b) may comprise an exposure timing changing step of changing a cycle length of the exposure periods based on an external control signal, and the step (a) may comprise a wavelength changing step of changing respective wavelengths of the modulated lights based on the cycle length of the exposure periods which has been changed by the exposure timing changing step, and a start phase changing step of changing the start phases of the modulated lights based on the changed cycle length of the exposure periods which has been changed by the exposure timing changing step. The ranging method may use a table which registers therein information on the wavelengths and start phases of the modulated lights corresponding to the changed cycle length of the exposure periods, and the wavelength changing step may change the wavelengths of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table, and the start phase changing step may change the start phases of the modulated lights based on the changed cycle length of the exposure periods and the information registered in the table. Alternatively, the ranging method may further comprise a wavelength calculating step of calculating the wavelengths of the modulated lights based on the changed cycle length of the exposure periods, and a start phase calculating step of calculating the start phases of the modulated lights based on the changed cycle length of the exposure periods.
According to the second aspect of the present invention, the step (a) may comprise emitting a first modulated light at a phase over a predetermined period from a first emission start time and emitting a second modulated light at a different phase over the predetermined period from a second emission start time, the step (b) may comprise detecting a first reflected light from the object irradiated with the first modulated light over the predetermined period from the first emission start time, and detecting a second reflected light from the object irradiated with the second modulated light over the predetermined period from the second emission start time, and the step (c) may comprise calculating the distance up to the object based on at least the phase difference between the first modulated light and the first reflected light and the phase difference between the second modulated light and the second reflected light.
The step (b) may comprise sampling the amount of the first reflected light in exposure periods established at a constant cycle length from the first emission start time and sampling the amount of the second reflected light in exposure periods established at the constant cycle length from the second emission start time, and the step (c) may comprise calculating a value representing the sampled amount of the first reflected light which is integrated over the predetermined period, as the phase difference between the first modulated light and the first reflected light, and calculating a value representing the sampled amount of the second reflected light which is integrated over the predetermined period, as the phase difference between the second modulated light and the second reflected light.
According to the second aspect of the present invention, the ranging method may further comprise the step of correcting the start phases of the modulated lights based on the difference between the distance up to the object which is calculated in the step (c) and a distance measured up to the object.
As described above, the ranging apparatus and the ranging method according to the present invention are less susceptible to noise. Since the circuit for energizing the image capturing device used in the ranging apparatus and the ranging method is relatively simple, the ranging apparatus and the ranging method is less burdensome for the CPU used therein.
The above and other objects, features, and advantages of the present invention will become more apparent from the following description when taken in conjunction with the accompanying drawings in which preferred embodiments of the present invention are shown by way of illustrative example.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of a first ranging apparatus according to the present invention;
FIG. 2 is a schematic view of a general structure of an image capturing device;
FIGS. 3A and 3B are views showing how an electric charge is stored in the image capturing device;
FIGS. 4A and 4B are views showing how an electric charge is transferred in the image capturing device;
FIG. 5 is a diagram illustrative of the principle of a process for determining a phase delay of a reflected light from sampled amplitudes thereof based on a captured image signal from the image capturing device;
FIG. 6 is a waveform diagram showing the relationship between first through fourth modulated lights emitted from a light-emitting means, a synchronizing signal, and exposure periods;
FIG. 7A is a waveform diagram showing the relationship between the first modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a first frame;
FIG. 7B is a waveform diagram showing the relationship between the second modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a third frame;
FIG. 7C is a waveform diagram showing the relationship between the third modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a fifth frame;
FIG. 7D is a waveform diagram showing the relationship between the fourth modulated light, a reflected light thereof, the synchronizing signal, and the exposure periods in a seventh frame;
FIG. 8 is a flowchart of a processing sequence of the first ranging apparatus;
FIG. 9 is a block diagram of a second ranging apparatus according to the present invention;
FIG. 10A is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods in a usual fashion;
FIG. 10B is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods whose duration has been changed;
FIG. 11 is a diagram showing details of a first information table;
FIG. 12 is a block diagram of a third ranging apparatus according to the present invention;
FIG. 13 is a block diagram of a fourth ranging apparatus according to the present invention;
FIG. 14A is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods in a usual fashion;
FIG. 14B is a waveform diagram showing the relationship between first through fourth modulated lights, a synchronizing signal, and exposure periods whose duration has been changed;
FIG. 15 is a diagram showing details of a second information table;
FIG. 16 is a block diagram of a fifth ranging apparatus according to the present invention;
FIG. 17 is a block diagram of a sixth ranging apparatus according to the present invention;
FIG. 18 is a view illustrative of an optical TOF ranging process;
FIG. 19 is a waveform diagram showing a phase delay that a reflected light undergoes with respect to a modulated light;
FIG. 20 is a flowchart of a processing sequence of a ranging apparatus according to the related art;
FIG. 21A is a waveform diagram showing the relationship between a modulated light, a reflected light thereof, a synchronizing signal, and exposure periods in a first frame in the ranging apparatus according to the related art;
FIG. 21B is a waveform diagram showing the relationship between the modulated light, the reflected light, the synchronizing signal, and exposure periods in a third frame in the ranging apparatus according to the related art;
FIG. 21C is a waveform diagram showing the relationship between the modulated light, the reflected light, the synchronizing signal, and exposure periods in a fifth frame in the ranging apparatus according to the related art;
FIG. 21D is a waveform diagram showing the relationship between the modulated light, the reflected light, the synchronizing signal, and exposure periods in a seventh frame in the ranging apparatus according to the related art; and
FIG. 22 is a waveform diagram illustrative of drawbacks of the ranging apparatus according to the related art.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Like or corresponding parts are denoted by like or corresponding reference characters.
Ranging apparatus and ranging methods according to preferred embodiments of the present invention will be described below with reference to FIGS. 1 through 17.
As shown in FIG. 1, a ranging apparatus 10A according to a first embodiment of the present invention (hereinafter referred to as “first ranging apparatus 10A”) comprises a light-emitting means 14 for emitting a series of modulated lights 12 which have been intensity-modulated and which start being emitted at different start phases, a light-detecting means 20 for detecting reflected lights 18 from an object 16 which has been irradiated with the modulated lights 12, a calculating means 22 for calculating the distance from the first ranging apparatus 10A to the object 16 based on the phase differences between the modulated lights 12 and the reflected lights 18, and a synchronizing signal generator 24 for generating a synchronizing signal Sa which represents the start of a light emission process.
The light-emitting means 14 comprises a light emitter 26 and a light emission controller 28 for controlling the light emitter 26 to intensity-modulate lights emitted from the light emitter 26 and emit them as the modulated lights 12. The light emitter 26 starts emitting the modulated lights 12 based on a negative-going edge, for example, of the synchronizing signal. Specifically, in this case, a time point which is aligned with the negative-going edge of the synchronizing signal Sa, refers to an emission starting time point.
The light emitter 26 comprises an array of LEDs. The light emission controller 28 controls the light emitter 26 to emit lights that are intensity-modulated sinusoidally, for example, as the modulated lights 12.
The light-detecting means 20 comprises an image capturing device 30, an optical system 32 for focusing the reflected lights 18 onto the light-detecting surface of the image capturing device 30, an image capturing device controller 34 for energizing the image capturing device 30, an analog signal processor 36 for processing a captured image signal Sb from the image capturing device 30 into an analog image signal Sc, an A/D converter 38 for converting the analog image signal Sc into digital image data Dc, and a buffer memory 40 for storing the digital image data Dc therein.
As shown in FIG. 2, the image capturing device 30 comprises a light detector 42 and a horizontal transfer path 44 disposed adjacent to the light detector 42. The light detector 42 comprises a matrix of pixels 46 (photodiodes) for photoelectrically converting an amount of light applied thereto into an amount of electric charge corresponding to the applied amount of light. The image capturing device 30 also includes a plurality of vertical transfer paths 48 that are shared by respective columns of pixels 46 and spaced apart along rows of pixels 46. The horizontal transfer path 44 is shared by the vertical transfer paths 48.
A process of reading electric charges from the pixels 46 based on the concept of frames used in the outputting of video data will be described below. As shown in FIGS. 3A and 3B, each of the pixels 46 generates an electric charge in response to a reflected light 18 applied thereto and stores the generated electric charge (exposure) in a first frame. At this time, the pixel 46 is not exposed to the reflected light 18 throughout the first frame, but is exposed to the reflected light 18 in each of exposure periods that are established at required timings. Specifically, the exposure periods are established by energizing an electrooptical shutter or a CCD electronic shutter combined with the image capturing device 30 based on a control signal from the image capturing device controller 34. An overflow drain region 50 is disposed adjacent to each of the pixels 46. When a predetermined voltage is applied to a drain electrode 52 connected to the overflow drain region 50, the potential of the overflow drain region 50 is lowered to drain the electric charge stored in the pixel 46.
In a next second frame, the electric charge is transferred. Specifically, during a vertical blanking period, for example, of the second frame, as shown in FIGS. 4A and 4B, a predetermined voltage is applied to a vertical transfer electrode 54 corresponding to one packet of the vertical transfer path 48, thereby lowering the potential of the packet to a level lower than the potential of the pixel 46. The electric charge stored in the pixel 46 now flows into the vertical transfer path 48. Thereafter, the potential is restored, and during a horizontal blanking period, a transfer voltage is applied to the vertical transfer electrode 54 to transfer the electric charge to the horizontal transfer path 44, as shown in FIG. 2. When the electric charge is transferred to the horizontal transfer path 44, a transfer voltage is applied to a horizontal transfer electrode connected to the horizontal transfer path 44 during a horizontal scanning period, thereby transferring the electric charge along the horizontal transfer path 44 to an output circuit 56. The output circuit 56 converts the electric charge into a voltage signal depending on the amount of electric charge, and outputs the voltage signal as the captured image signal Sb.
The horizontal blanking period and the horizontal scanning period in the second frame are repeated to transfer a series of electric charges stored in the respective pixels 46 along the vertical transfer path 48 and the horizontal transfer path 44 to the output circuit 56, which outputs the captured image signal Sb.
In the second frame, the pixels 46 may be or may not be exposed to the reflected light 18.
The captured image signal Sb from the image capturing device 30 is processed into the analog image signal Sc by the analog signal processor 36. The analog image signal Sc is converted into the digital image data Dc by the A/D converter 38. The digital image data Dc have a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at required timings (exposure periods) and associated with the respective pixels 46.
The buffer memory 40 stores four types of image data Dc (first through fourth image data Dc1 through Dc4) according to the optical TOF ranging process referred to above. The first image data Dc1 has a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at timings when the phase of the modulated light 12 is 0°, for example, and associated with the respective pixels 46. Similarly, the second, third, and fourth image data Dc2, Dc3, Dc4 have a data structure comprising an array of amplitudes of the reflected light 18 that are sampled at timings when the phase of the modulated light 12 is 90°, 180°, 270°, for example, and associated with the respective pixels 46.
The calculating means 22 comprises a distance calculator 58 for calculating the distances from the respective pixels 46 to the object 16 based on the first through fourth image data Dc1 through Dc4.
A calculating algorithm of the distance calculator 58, particularly, a calculating algorithm for calculating the distance from one pixel 46 to the object 16 will be described below with reference to FIG. 5. If it is assumed that the modulated light 12 has its varying amplitude represented by a circle 60 with its center at the origin of a coordinate system, then the reflected light 18 has its amplitude at points P1, P2, P3, P4 when the modulated light 12 is at respective phases of 0° (360°), 90°, 180°, 270°. If the point P1 has coordinates (A, −B), then the point P2 has coordinates (B, A), the point P3 has coordinates (−A, B), and the point P4 has coordinates (−B, −A).
Since these coordinates can be converted into a rectangular triangle 62 shown in FIG. 5, the phase delay of φ of the reflected light 18 with respect to the modulated light 12 is determined by the following equation (1):
φ=arctan {(B−(−B))/(A−(−A))}  (1)
Since A corresponds to the sampled amplitude S2 of the second image data Dc2, −A the sampled amplitude S4 of the fourth image data Dc4, B the sampled amplitude S3 of the third image data Dc3, and −B the sampled amplitude S1 of the first image data Dc1, the equation (1) can be rewritten into the following equation (2):
φ=arctan {(S3−S1)/(S2−S4)}  (2)
If one cycle length of the modulated light 12 is indicated by T, then a delay time τ that is consumed after the modulated light 12 is emitted from the light emitter 26 until the reflected light 18 is detected by the image capturing device 30, is determined by the following equation:
τ=T×(φ/2π)
The delay time τ is commensurate with twice the distance L from the first ranging apparatus 10A to the object 16 and the light travels between the ranging apparatus 10A and the object 16. Therefore, the distance L is determined by the equation:
L=(τ×c)/2
The distance calculator 58 has the above algorithm installed as software, and applies the algorithm to each of the pixels 46 to calculate the distance depending on each of the pixels 46 for thereby detecting the three-dimensional structure of the object 16.
The light emission controller 28 of the first ranging apparatus 10A has a start phase controller 64 for controlling the phases (start phases) at which the respective modulated lights 12 start being emitted. The light-detecting means 20 samples the amounts of reflected lights 18 in exposure periods that are established with a constant cycle length based on the negative-going edge, for example, of the synchronizing signal Sa.
In the first ranging apparatus 10A, the start phase controller 64 controls the light emitter 26 to emit a series of modulated lights, i.e., as shown in FIG. 6, a first modulated light 12A which starts being emitted at a first phase θ1, a second modulated light 12B which starts being emitted at a second phase θ2, a third modulated light 12C which starts being emitted at a third phase θ3, and a fourth modulated light 12D which starts being emitted at a fourth phase θ4. The synchronizing signal Sa generated by the synchronizing signal generator 24 is supplied to the light emission controller 28 and the image capturing device controller 34 for enabling the light emission controller 28 (and the start phase controller 64) and the image capturing device controller 34 to operate in synchronism with each other.
The first phase 61 is delayed or advanced by a given phase from the reference phase 66 (0°), and can be determined depending on an initially-set exposure period of the image capturing device 30.
The second phase θ2 is delayed by 90° from the first phase θ1, the third phase θ3 by 90° from the second phase θ2, and the fourth phase θ4 by 90° from the third phase θ3.
A first exposure period Tr starts at a time point which is a given period Ta later than the emission starting time point (time point which is aligned with the negative-going edge of the synchronizing signal Sa), and the cycle length of each of exposure periods Tr is equalized to one wavelength of the modulated light 12. With the exposure periods being thus established, it is possible to obtain a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12A is either one of 0°, 90°, 180°, 270°, and also to obtain a sampled amplitude of the reflected light 18 when the phase of the second modulated light 12B is either one of 0°, 90°, 180°, 270° and different from the phase of the first modulated light 12A. Similarly, it is possible to obtain a sampled amplitude of the reflected light 18 when the phase of the third modulated light 12C is either one of 0°, 90°, 180°, 270° and different from the phases of the first and second modulated lights 12A, 12B, and also to obtain a sampled amplitude of the reflected light 18 when the phase of the fourth modulated light 12D is either one of 0°, 90°, 180°, 270° and different from the phases of the first, second, and third modulated lights 12A, 12B, 12C.
FIGS. 7A through 7D show an example of the chronological relationship between the first through fourth modulated lights 12A through 12D and the exposure periods Tr. As shown in FIG. 7A, the centers of the exposure periods Tr are held in alignment with the phase of 180° of the first modulated light 12A. As shown in FIG. 7B, the centers of the exposure periods Tr are held in alignment with the phase of 90° of the second modulated light 12B. As shown in FIG. 7C, the centers of the exposure periods Tr are held in alignment with the phase of 0° of the third modulated light 12C. As shown in FIG. 7D, the centers of the exposure periods Tr are held in alignment with the phase of 270° of the fourth modulated light 12D.
Accordingly, it is possible to obtain a sampled amplitude S3 of the reflected light 18 when the phase of the first modulated light 12A is 180°, and also to obtain a sampled amplitude S2 of the reflected light 18 when the phase of the second modulated light 12B is 90°. Similarly, it is possible to obtain a sampled amplitude S1 of the reflected light 18 when the phase of the third modulated light 12C is 0°, and also to obtain a sampled amplitude S4 of the reflected light 18 when the phase of the fourth modulated light 12D is 270°.
A processing sequence of the first ranging apparatus 10A will be described below with reference to the waveform diagrams shown in FIGS. 7A through 7D and a flowchart shown in FIG. 8.
First, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a first frame in step S101 shown in FIG. 8 (see FIG. 7A). In response to a rising edge of the synchronizing signal Sa, the start phase controller 64 sets a start phase for a first modulated light 12A to the first phase θ1 in step S102. Therefore, the light emission controller 28 controls the light emitter 26 to emit a first modulated light 12A based on the negative-going edge of the synchronizing signal Sa in step S103.
The first modulated light 12A emitted from the light emitter 26 is applied to the object 16, and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32. The image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with a time point that is a time period Ta later than the negative-going edge of the synchronizing signal Sa, i.e., a time point at which the first modulated light 12A has a phase of 180°. The image capturing device 30 is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π (see FIG. 7A).
In the first frame, the amount of reflected light 18 at the time the phase of the first modulated light 12A is 180° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S104. Thereafter, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a second frame in step S105. In the second frame, the electric charge stored in the image capturing device 30 is transferred as an analog signal (image signal) in step S106, and the analog signal is converted into a digital signal in step S107. The digital signal is saved in the buffer memory 40 as third image data Dc3 representing a pixel-dependent array of sampled amplitudes S3 of the reflected light 18 at the time the phase of the first modulated light 12A is 180° in step S108. Then, the light emitter 26 stops emitting the first modulated light 12A in step S109.
Then, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a third frame in step S110 (see FIG. 7B). In response to a rising edge of the synchronizing signal Sa, the start phase controller 64 sets a start phase for a second modulated light 12B to the second phase θ2 in step S111. The light emission controller 28 controls the light emitter 26 to emit a second modulated light 12B based on the negative-going edge of the synchronizing signal Sa in step S112.
The second modulated light 12B emitted from the light emitter 26 is applied to the object 16, and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32. As described above, the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π. In the third frame, therefore, the amount of reflected light 18 at the time the phase of the second modulated light 12B is 90° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S113 (see FIG. 7B). Thereafter, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a fourth frame in step S114. In the fourth frame, the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S115, and the analog signal is converted into a digital signal in step S116. The digital signal is saved in the buffer memory 40 as second image data Dc2 representing a pixel-dependent array of sampled amplitudes S2 of the reflected light 18 at the time the phase of the second modulated light 12B is 90° in step S117. Then, the light emitter 26 stops emitting the second modulated light 12B in step S118.
Then, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a fifth frame in step S119 (see FIG. 7C). In response to a rising edge of the synchronizing signal Sa, the start phase controller 64 sets a start phase for a third modulated light 12C to the third phase θ3 in step S120. The light emission controller 28 controls the light emitter 26 to emit a third modulated light 12C based on the negative-going edge of the synchronizing signal Sa in step S121.
The third modulated light 12C emitted from the light emitter 26 is applied to the object 16, and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32. As described above, the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π. In the fifth frame, therefore, the amount of reflected light 18 at the time the phase of the third modulated light 12C is 0° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S122 (see FIG. 7C). Thereafter, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a sixth frame in step S123. In the sixth frame, the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S124, and the analog signal is converted into a digital signal in step S125. The digital signal is saved in the buffer memory 40 as first image data Dc1 representing a pixel-dependent array of sampled amplitudes S1 of the reflected light 18 at the time the phase of the third modulated light 12C is 0° in step S126. Then, the light emitter 26 stops emitting the third modulated light 12C in step S127.
Then, the synchronizing signal generator 24 generates a synchronizing signal Sa representing a seventh frame in step S128 (see FIG. 7D). In response to a rising edge of the synchronizing signal Sa, the start phase controller 64 sets a start phase for a fourth modulated light 12D to the fourth phase θ4 in step S129. The light emission controller 28 controls the light emitter 26 to emit a fourth modulated light 12D based on the negative-going edge of the synchronizing signal Sa in step S130.
The fourth modulated light 12D emitted from the light emitter 26 is applied to the object 16, and the object 16 reflects it as a reflected light 18 to the image capturing device 30 through the optical system 32. As described above, the image capturing device 30 is adjusted to have the center of the first exposure period Tr synchronized with the time point that is the time period Ta later than the negative-going edge of the synchronizing signal Sa, and is also adjusted such that each of successive exposure periods Tr thereof has a cycle length of 2π. In the seventh frame, therefore, the amount of reflected light 18 at the time the phase of the fourth modulated light 12D is 270° is photoelectrically converted into an electric charge, which is stored in the image capturing device 30 in step S131 (see FIG. 7D). Thereafter, the synchronizing signal generator 24 generates a synchronizing signal Sa representing an eighth frame in step S132. In the eighth frame, the electric charge stored in the image capturing device 30 is transferred as an analog signal in step S133, and the analog signal is converted into a digital signal in step S134. The digital signal is saved in the buffer memory 40 as fourth image data Dc4 representing a pixel-dependent array of sampled amplitudes S4 of the reflected light 18 at the time the phase of the fourth modulated light 12D is 270° in step S135. Then, the light emitter 26 stops emitting the fourth modulated light 12D in step S136.
Then, the distance calculator 58 calculates the distance up to the object 16 based on the first through fourth image data Dc1 through Dc4 saved in the buffer memory 40 in step S137.
As described above, the first ranging apparatus 10A emits a series of modulated lights 12 which have been intensity-modulated and which start being emitted at different start phase, detects reflected lights 18 from the object 16 which has been irradiated with the modulated lights 12, and calculates the distance up to the object 16 based on the phase differences between the modulated lights 12 and the reflected lights 18. If the first ranging apparatus 10A is incorporated in a digital camera, a surveillance camera, or the like, then the first ranging apparatus 10A is exposed to noise such as clock noise, etc. from a display circuit, other IC circuits, etc. However, as simply illustrated in FIG. 6, since the exposure timings do not change depending on the frames, the exposure periods Tr can easily be set out of alignment with the timings of noise spikes 68, making the first ranging apparatus 10A less susceptible to noise.
In the first ranging apparatus 10A, as the exposure periods Tr are established in a single pattern, the circuit (image capturing device controller 34) for energizing the image capturing device 30 is relatively simple, and a burden on the CPU incorporated therein can be reduced.
In the above embodiment, the image capturing device 30 is exposed to the reflected lights 18 based on the first through fourth modulated lights 12A through 12D in the respective first, third, fifth, and seventh frames, and the electric charges generated from the respective reflected lights are transferred in the second, fourth, sixth, and eighth frames. However, the image capturing device 30 may be exposed to the reflected light 18 based on the first modulated light 12A in the first frame, and in the second frame, the electric charge generated from the reflected light may be transferred while the image capturing device 30 may be exposed to the reflected light 18 based on the second modulated light 12B. In the third frame, the electric charge generated from the reflected light may be transferred while the image capturing device 30 may be exposed to the reflected light 18 based on the third modulated light 12C. In the fourth frame, the electric charge generated from the reflected light may be transferred while the image capturing device 30 may be exposed to the reflected light 18 based on the fourth modulated light 12D, and the electric charge generated from the reflected light may be transferred in the fifth frame.
A ranging apparatus 10B according to a second embodiment of the present invention (hereinafter referred to as “second ranging apparatus 10B”) will be described below with reference to FIGS. 9 through 11.
As shown in FIG. 9, the second ranging apparatus 10B is similar to the first ranging apparatus 10A described above, but differs therefrom as follows:
The light-detecting means 20 additionally includes an exposure period changer 70 for changing the terminal ends of the exposure periods Tr based on an external control signal.
The light-emitting means 14 additionally includes a first start phase changer 72 for changing the start phases of the modulated lights 12 based on the exposure periods Tr changed by the exposure period changer 70, and a memory 76 storing a first information table 74 which registers therein information (phase information) on start phases of the modulated lights 12 which correspond to the changed exposure periods Tr.
The first start phase changer 72 changes the start phases of the modulated lights 12 based on the changed exposure periods Tr and the information registered in the first information table 74 stored in the memory 76. Specifically, the first start phase changer 72 reads phase information corresponding to the changed exposure periods Tr, from among the phase information registered in the first information table 74 stored in the memory 76, and supplies the read information to the start phase controller 64. Based on the supplied phase information, the start phase controller 64 changes the start phases (first phase θ1 through fourth phase θ4) of the first modulated light 12A through fourth modulated light 12D.
The operating principles of the second ranging apparatus 10B will be described below with reference to FIGS. 10A and 10B.
Initially, as with the first ranging apparatus 10A, the start phase controller 64 controls the light emitter 26 to emit a series of modulated lights, i.e., as shown in FIG. 10A, a first modulated light 12A which starts being emitted at the first phase θ1, a second modulated light 12B which starts being emitted at the second phase θ2, a third modulated light 12C which starts being emitted at the third phase θ3, and a fourth modulated light 12D which starts being emitted at the fourth phase θ4.
The light-detecting means 20 obtains a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12A is 180°, for example, and also obtains a sampled amplitude of the reflected light 18 when the phase of the second modulated light 12B is 90°. Similarly, the light-detecting means 20 obtains a sampled amplitude of the reflected light 18 when the phase of the third modulated light 12C is 0°, and also obtains a sampled amplitude of the reflected light 18 when the phase of the fourth modulated light 12D is 270°.
If the object 16 and its background are so bright that the signal generated by the light-detecting means 20 is saturated, then the durations of the exposure periods Tr may be changed by a user's command input, an automatic iris mechanism, or an electronic shutter combined with the image capturing device 30. In other words, the durations of the exposure periods Tr may be changed based on an external control signal. The durations of the exposure periods Tr are usually changed while the central points of the exposure periods Tr remain unchanged in position. Therefore, the start times of the exposure periods Tr are changed, and hence the timings at which the drive signal is applied to the image capturing device 30 need to be changed, resulting in the need for a calibration.
In the second ranging apparatus 10B, the exposure period changer 70 changes the exposure periods Tr based on a command signal from a user control console 78, i.e., a command signal from the user indicating whether the exposure periods Tr are to be shorter or longer, or a command signal from an exposure period calculator 80, i.e., a command signal indicating whether the exposure periods Tr are to be shorter or longer, based on the sampled amplitudes stored in the buffer memory 40.
The exposure period changer 70 may change the exposure periods Tr as follows: The exposure period changer 70 establishes several types of exposure periods Tr having different time lengths, e.g., at least two types of exposure periods Tr, in advance. When a command signal for shortening the exposure periods Tr is applied to the exposure period changer 70, the exposure period changer 70 selects exposure periods Tr that are one level shorter than the present exposure periods Tr. When a command signal for lengthening the exposure periods Tr is applied to the exposure period changer 70, the exposure period changer 70 selects exposure periods Tr that are one level longer than the present exposure periods Tr.
In this manner, the exposure period changer 70 can easily change the exposure periods Tr.
As shown in FIG. 10B, the exposure period changer 70 changes the durations of the exposure periods Tr by changing the terminal ends thereof. Therefore, the start timings of the exposure periods Tr which are not changed and the start timings of the exposure periods Tr which have been changed remain the same as each other. Instead, the central time points of the exposure periods Tr which have been changed are shifted out of alignment with the central time points of the exposure periods Tr which are not changed. Therefore, the reflected light 18 cannot be sampled at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D.
The above problem is solved as follows: The exposure period changer 70 assigns identification codes respectively to a plurality of types of exposure periods Tr that are established in advance. The exposure period changer 70 sends an identification code corresponding to the exposure periods Tr selected thereby to the first start phase changer 72, which recognizes the changed exposure periods Tr based on the identification code.
The first start phase changer 72 changes the start phases of the first modulated light 12A through fourth modulated light 12D based on the changed exposure periods Tr (selected exposure periods) and the information registered in the first information table 74 stored in the memory 76. Specifically, since the first start phase changer 72 can recognize the changed exposure periods Tr based on the identification code sent from the exposure period changer 70, the information registered in the first information table 74 may include, as shown in FIG. 11, the identification codes of the exposure periods Tr and the phase information which corresponds to the identification codes of the exposure periods Tr, i.e., the start phases (absolute phases or relative phases). A start phase which corresponds to an identification code of exposure periods Tr is explained below. When the light emitter 26 emits the first modulated light 12A at the start phase, the light detecting means 20 can now obtain, at the central time points of the changed exposure periods Tr, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12A is 180°.
The absolute phase directly represents a start phase of the first modulated light 12A. The relative phase represents a phase by which the current start phase of the first modulated light 12A is delayed or advanced. When the initial start phases (first phases θ1) of the first modulated light 12A are set in advance, the start phases corresponding to the identification codes of the exposure periods Tr to be registered in the first information table 74 are preferably expressed as an absolute phase, since no calculation of the start phase of the first modulated light 12A is required, thereby providing a simpler configuration of the circuit and simpler program.
The first information table 74 may register therein only information on the start phases (first phases θ1) of the first modulated light 12A. This is because, as described above, the second phase θ2 of the second modulated light 12B is delayed by 90° from the first phase θ1, the third phase θ3 by 90° from the second phase θ2, and the fourth phase θ4 by 90° from the third phase θ3, and thus, the second through fourth phase can be easily set based on the above phase relation.
The first start phase changer 72 reads the phase information (start phase) corresponding to the supplied identification code, from the first information table 74, and supplies the read phase information to the start phase controller 64. The start phase controller 64 sets a start phase which is supplied from the first start phase changer 72, as a start phase (first phase θ1) of the first modulated light 12A. Based on the set first phase θ1, the second phase θ2 through fourth phase θ4 are to be set.
Therefore, the light-detecting means 20 can sample the reflected light 18 at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D, at the central time points of the changed exposure periods Tr. The distance calculator 58 is now capable of calculating the distance up to the object 16 highly accurately, as with the distance calculator 58 of the first ranging apparatus 10A.
In the second ranging apparatus 10B, as described above, the exposure period changer 70 changes the terminal ends of the exposure periods Tr to change the durations of the exposure periods Tr, and the first start phase changer 72 changes the start phases of the modulated lights 12 based on the changed exposure periods Tr. Thus, it is not necessary to change the start times of the exposure periods Tr. Specifically, no calibration of the second ranging apparatus 10B is required because the start times of the exposure periods Tr are not changed.
In this case, the first information table 74 registers therein the information on the start phases of the first modulated light 12A through fourth modulated light 12D corresponding to the identification codes of the exposure periods Tr, and the start phases of the first modulated light 12A through fourth modulated light 12D are changed based on the information registered in the first information table 74. Consequently, the start phases of the first modulated light 12A through fourth modulated light 12D based on the changed exposure periods Tr can be determined simply by accessing the first information table 74, rather than by carrying out complex calculations. The processing time required by the second ranging apparatus 10B can thus be shortened.
A ranging apparatus 10C according to a third embodiment of the present invention (hereinafter referred to as “third ranging apparatus 10C”) will be described below with reference to FIG. 12.
As shown in FIG. 12, the third ranging apparatus 10C is similar to the second ranging apparatus 10B described above, except as follows:
The exposure period changer 70 has initial exposure periods Tr preset therein. When a command signal for shortening the exposure periods Tr is supplied to the exposure period changer 70, the exposure period changer 70 shortens the present exposure periods Tr by 1/n (n: real number). When a command signal for lengthening the exposure periods Tr is supplied to the exposure period changer 70, the exposure period changer 70 lengthens the present exposure periods Tr by 1/n (n: real number).
The third ranging apparatus 10C includes a first start phase calculator 82 for calculating the start phase of the first modulated light 12A through fourth modulated light 12D based on the changed exposure periods Tr.
The first start phase calculator 82 calculates a start phase (first phase θ1) of the first modulated light 12A based on the durations of the changed exposure periods Tr. The thus-calculated first phase θ1 is as follows: When the light emitter 26 emits the first modulated light 12A at the calculated first phase θ1, the light detecting means 20 can now obtain, at the central time points of the changed exposure periods Tr, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12A is 180°.
The calculated start phase (first phase θ1) is supplied to the start phase controller 64. The start phase controller 64 sets a start phase that is supplied from the first start phase calculator 82, as a start phase (first phase θ1) of the first modulated light 12A. Based on the set first phase θ1, the second phase θ2 through fourth phase θ4 are set.
Therefore, the light-detecting means 20 can sample the reflected light 18 at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D, at the central time points of the changed exposure periods Tr. The distance calculator 58 is now capable of calculating the distance up to the object 16 highly accurately, as with the distance calculator 58 of the second ranging apparatus 10B. The third ranging apparatus 10C does not need to have the memory 76 or a memory area for storing the first information table 74.
A ranging apparatus 10D according to a fourth embodiment of the present invention (hereinafter referred to as “fourth ranging apparatus 10D”) will be described below with reference to FIGS. 13 through 14B.
As shown in FIG. 13, the fourth ranging apparatus 10D is similar to the first ranging apparatus 10A described above, but differs therefrom as follows:
The light-detecting means 20 includes an exposure timing changer 84 for changing the cycle length Tt (see FIGS. 14A and 14B) of the exposure periods Tr based on an external control signal. The light-emitting means 14 includes a wavelength changer 86 for changing the wavelengths Td (see FIGS. 14A and 14B) of a plurality of modulated lights 12 based on the cycle length Tt of the exposure periods Tr changed by the exposure timing changer 84, a second start phase changer 88 for changing the start phases of the modulated lights 12 based on the cycle length Tt of the exposure periods Tr changed by the exposure timing changer 84, and a memory 76 storing a second information table 90 which registers therein the information on the wavelength Td and start phases of the modulated lights 12 which correspond to the changed cycle length Tt of the exposure periods Tr.
The wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr and the information (wavelength-information) registered in the second information table 90 stored in the memory 76. The second start phase changer 88 changes the start phases of the first modulated light 12A through fourth modulated light 12D based on the changed cycle length Tt of the exposure periods Tr and the information (phase information) registered in the second information table 90 stored in the memory 76.
The wavelength changer 86 reads the information on the wavelength corresponding to the changed cycle length Tt of the exposure periods Tr, from among the information on the wavelengths registered in the second information table 90 stored in the memory 76, and supplies the read information to the light emission controller 28. Based on the supplied information on the wavelength, the light emission controller 28 changes the wavelengths Td of the first through fourth modulated lights 12A through 12D. On the other hand, the second start phase changer 88 reads the information on the phase corresponding to the changed cycle length Tt of the exposure periods Tr, from among the information on the phases registered in the second information table 90, and supplies the read information to the start phase controller 64. Based on the supplied information on the phase, the start phase controller 64 changes the start phases of the first modulated light 12A through fourth modulated light 12D.
The operating principles of the fourth ranging apparatus 10D will be described below with reference to FIGS. 14A and 14B.
Initially, as with the first ranging apparatus 10A, the second start phase changer 88 controls the light emitter 26 to emit a series of modulated lights, i.e., as shown in FIG. 14A, a first modulated light 12A which starts being emitted at a first phase θ1, a second modulated light 12B which starts being emitted at a second phase θ2, a third modulated light 12C which starts being emitted at a third phase θ3, and a fourth modulated light 12D which starts being emitted at a fourth phase θ4.
The light-detecting means 20 obtains a sampled amplitude S3 of the reflected light 18 when the phase of the first modulated light 12A is 180°, for example, and also obtains a sampled amplitude S2 of the reflected light 18 when the phase of the second modulated light 12B is 90°. Similarly, the light-detecting means 20 obtains a sampled amplitude S1 of the reflected light 18 when the phase of the third modulated light 12C is 0°, and also obtains a sampled amplitude S4 of the reflected light 18 when the phase of the fourth modulated light 12D is 270°.
If the distance up to the object 16 is so large that the calculated distance is of an invalid value, then the time length of one frame may be changed by a CPU control signal or a user's command input, thereby changing the wavelength Td of the modulated light 12. In other words, the time length of one frame may be changed based on an external control signal. In this case, the central time points of the exposure periods Tr are usually determined depending on the changed time length of one frame. If the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., if the cycle length Tt of the exposure periods Tr is divided by an integer or multiplied by an integer, then the process is simple. However, if the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle time Tt of the exposure periods Tr by a real number, then the fourth ranging apparatus 10D needs a dedicated calibration.
In the fourth ranging apparatus 10D, the wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12A through 12D based on a command signal from a user control console 78, i.e., a command signal from the user indicating whether the time length of one frame is to be shorter or longer, or a command signal from an exposure timing calculator 92 for calculating whether the time length of one frame is to be shorter or longer, i.e., a command signal indicating whether the time length of one frame is to be shorter or longer, based on the sampled amplitudes stored in the buffer memory 40.
Likewise, the exposure timing changer 84 changes the cycle length Tt of the exposure periods Tr based on a command signal from the user control console 78 or a command signal from the exposure timing calculator 92.
The exposure timing changer 84 may change the cycle length Tt of the exposure periods Tr as follows: The exposure timing changer 84 establishes several types of cycle lengths Tt having different time lengths, e.g., at least two types of cycle lengths Tt, in advance. When a command signal for shortening one frame is applied to the exposure timing changer 84, the exposure timing changer 84 selects a cycle length Tt that is one level shorter than the cycle length Tt of the present exposure periods Tr. When a command signal for lengthening one frame is applied to the exposure timing changer 84, the exposure timing changer 84 selects a cycle length Tt that is one level longer than the cycle length Tt of the present exposure periods Tr.
The wavelengths Td of the first through fourth modulated lights 12A through 12D can be set depending on the changed cycle length Tt of the exposure periods Tr according to the above process. Thus, the cycle length Tt of the exposure periods Tr can be changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the cycle length Tt of the exposure periods Tr can be divided by an integer or multiplied by an integer. Accordingly, the circuit arrangement of the fourth ranging apparatus 10D is relatively simple.
If the cycle length Tt of the exposure periods Tr is changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the cycle length Tt of the exposure periods Tr is divided by an integer or multiplied by an integer, then the reflected light 18 can be sampled at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D providing the wavelength Td of the first through fourth modulated lights 12A through 12D remains unchanged. However, when the wavelength Td of the first through fourth modulated lights 12A through 12D is changed, the reflected light 18 cannot be sampled at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D.
The above problem is solved as follows: The exposure timing changer 84 assigns identification codes respectively to the cycle lengths Tt of a plurality of types of exposure periods Tr that are established in advance. The exposure timing changer 84 sends an identification code corresponding to the cycle length Tt of exposure periods Tr selected thereby to the wavelength changer 86, and the second start phase changer 88, which recognize the changed cycle length Tt of the exposure periods Tr based on the identification code.
The wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr (selected cycle, length Tt of the exposure periods Tr) and the information registered in the second information table 90 stored in the memory 76. The second start phase changer 88 changes the start phases of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr and the information registered in the second information table 90.
Specifically, inasmuch as the changed cycle length Tt of the exposure periods Tr can be recognized from the identification code sent from the exposure timing changer 84, the information registered in the second information table 90 may include, as shown in FIG. 15, the identification codes of the cycle lengths Tt of the exposure periods Tr, wavelength information and phase information (start phase), corresponding to the identification codes of the cycle lengths Tt of the exposure periods Tr. A start phase corresponding to the identification codes of exposure periods Tr will be explained below. The wavelength Td of the first modulated light 12A, for example, is changed to the wavelength indicated by the wavelength information corresponding to the identification code, the start phase of the first modulated light 12A is changed to a start phase represented by the phase information corresponding to the identification code, and then the first modulated light 12A is emitted. In this case, as shown in FIG. 14B, the light-detecting means 20 can now obtain, at the central time points of the exposure periods Tr whose cycle length Tt has been changed, a sampled amplitude of the reflected light 18 when the phase of the first modulated light 12A is 180°.
The second information table 90 may register therein only information on the wavelengths and the start phases (first phases θ1) of the first modulated light 12A. This is because the wavelength Td of the second modulated light 12B through fourth modulated light 12D are the same as the wavelength Td of the first modulated light 12A, and, as described above, the second phase θ2 of the second modulated light 12B is delayed by 90° from the first phase θ1, the third phase θ3 by 90° from the second phase θ2, and the fourth phase θ4 by 90° from the third phase θ3, and thus, the second through fourth phases can be easily set based on the above phase relation.
The wavelength changer 86 reads the information on the wavelength corresponding to the supplied identification code from the second information table 90, and supplies the read information to the light emission controller 28. The light emission controller 28 sets the wavelengths Td of the first through fourth modulated lights 12A through 12D, as wavelengths represented by the wavelength information supplied from the wavelength changer 86. Further, the second start phase changer 88 reads the phase information (start phase) corresponding to the supplied identification code from the second information table 90, and supplies the read information to the start phase controller 64. The start phase controller 64 sets the start phase (first phase θ1) of the first modulated light 12A as a start phase supplied from the second start phase changer 88. Based on the set first phase θ1, the second phase θ2 through fourth phase θ4 are set.
Therefore, the light-detecting means 20 can sample the reflected light 18 at the given four phases (180°, 90°, 0°, 270°) of the first through fourth modulated lights 12A through 12D, at the central time points of the exposure periods Tr whose cycle length has been changed. The distance calculator 58 is now capable of calculating the distance up to the object 16 highly accurately, as with the distance calculator 58 of the first ranging apparatus 10A, even though the distance up to the object 16 is large.
In the fourth ranging apparatus 10D, the exposure timing changer 84 changes the cycle length Tt of the exposure periods Tr, the wavelength changer 86 changes the wavelengths Td of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr, and the second start phase changer 88 changes the start phases of the first modulated light 12A through fourth modulated light 12D based on the changed cycle length Tt of the exposure periods Tr. Therefore, the wavelengths Td of the modulated lights 12 can be set depending on the cycle length Tt of the exposure periods Tr. As a result, the exposure timings can be changed to a value which is related to the preset cycle length Tt of the exposure periods Tr by an integral number, e.g., the exposure timings can be divided by an integer or multiplied by an integer. Therefore, the circuit arrangement of the fourth ranging apparatus 10D is relatively simple.
In this case, the second information table 90 registers therein the information on the wavelengths Td and the start phases of the first modulated light 12A, corresponding to the identification codes of the cycle lengths Tt of the exposure periods Tr, and the wavelengths Td and the start phases of the first through fourth modulated lights 12A through 12D, are changed based on the information registered in the second information table 90. Consequently, the wavelengths Td and the start phases of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr can be determined simply by accessing the second information table 90, rather than by carrying out complex calculations. The processing time required by the fourth ranging apparatus 10D can thus be shortened.
A ranging apparatus 10E according to a fifth embodiment of the present invention (hereinafter referred to as “fifth ranging apparatus 10E”) will be described below with reference to FIG. 16.
As shown in FIG. 16, the fifth ranging apparatus 10E is similar to the fourth ranging apparatus 10D described above, but differs therefrom as follows:
The exposure timing changer 84 has the cycle length Tt of initial exposure periods Tr preset therein. When a command signal for shortening the cycle length Tt of the exposure periods Tr is supplied to the exposure timing changer 84, the exposure timing changer 84 shortens the cycle length Tt of the present exposure periods Tr by 1/m (m: integral number). When a command signal for lengthening the cycle length Tt of the exposure periods Tr is supplied to the exposure timing changer 84, the exposure timing changer 84 lengthens the cycle length Tt of the present exposure periods Tr by 1/m (m: integral number).
The fifth ranging apparatus 10E includes a wavelength calculator 94 for calculating the wavelengths Td of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr, and a second start phase calculator 96 for calculating the start phases at which the first through fourth modulated lights 12A through 12D start being emitted.
The wavelength calculator 94 calculates the wavelengths Td of the first through fourth modulated lights 12A through 12D based on the changed cycle length Tt of the exposure periods Tr. The second start phase calculator 96 calculates a start phase (first phase θ1) of the first modulated light 12A based on the changed cycle length Tt of the exposure periods Tr. The calculated first phase 61 will be explained below. The wavelength Td of the first modulated light 12A is changed to the calculated wavelength Td, the start phase of the first modulated light 12A is changed to the calculated first phase θ1, and the first modulated light 12A is emitted. Therefore, the reflected light 18 when the phase of the first modulated light 12A is 180°, can be sampled at the central time points of the changed exposure periods Tr whose cycle length Tt has been changed.
Accordingly, by setting the second phase θ2 through fourth phase θ4 based on the first phase θ1, when the reflected light is sampled at the central time points of the exposure periods Tr whose cycle length Tt has been changed, the reflected light 18 can be sampled at the given four phases (180°, 90°, 0°, 270°). Thus, the distance calculator 58 is now capable of calculating the distance up to the object 16 highly accurately, as with the distance calculator 58 of the fourth ranging apparatus 10D. The fifth ranging apparatus 10E does not need to have the memory 76 or a memory area for storing the second information table 90.
A ranging apparatus 10F according to a sixth embodiment of the present invention (hereinafter referred to as “sixth ranging apparatus 10F”) will be described below with reference to FIG. 17.
As shown in FIG. 17, the sixth ranging apparatus 10F is similar to the first ranging apparatus 10A described above, but differs therefrom in that it includes a difference calculator 98 and a start phase corrector 100.
The difference calculator 98 calculates the difference ΔL between the distance up to the object 16 which has been calculated by the distance calculator 58 (calculated distance Lc) and the measured distance Lr up to the object 16 which has been input from the control console 78.
The start phase corrector 100 corrects start phases of the first through fourth modulated lights 12A through 12D, based on the difference ΔL calculated by the difference calculator 98.
Specifically, the start phase corrector 100 calculates a start phase (first phase θ1) of the first modulated light 12A based on the difference ΔL calculated by the difference calculator 98. If the distance up to the object 16 which has been calculated by the distance calculator 58 (calculated distance Lc) is shorter than the measured distance Lr up to the object 16 which has been input from the control console 78, then the start phase corrector 100 sets the start phase of the first modulated light 12A to a value advanced (or delayed) from the present set start phase. Conversely, if the calculated distance Lc is longer than the measured distance Lr, then the start phase corrector 100 sets the start phase of the first modulated light 12A to a value delayed (or advanced) from the present set start phase.
The start phase corrector 100 supplies the calculated start phase (first phase θ1) to the start phase controller 64. The start phase controller 64 sets a start phase supplied from the start phase corrector 100, to be the start phase (first phase θ1) of the first modulated light 12A. Based on the set first phase θ1, the second phase θ2 through fourth phase θ4 are set.
The distance calculator 58 calculates the distance Lc up to the object 16 based on the corrected start phases and compares the calculated distance Lc with the measured distance Lr again.
If the calculated distance Lc and the measured distance Lr agree or substantially agree with each other, the operation of the difference calculator 98 and the start phase corrector 100 is put to an end.
Since the sixth ranging apparatus 10F can correct an error of the distance measured up to the object 16, the sixth ranging apparatus 10F can measure the distance accurately and stably.
In each of the above embodiments, the ranging apparatus is arranged to generate and apply four modulated lights, i.e., the first through fourth modulated lights 12A through 12D. However, the ranging apparatus may be arranged to generate and apply three modulated lights or more than five modulated lights.
Although certain preferred embodiments of the present invention have been shown and described in detail, it should be understood that various changes and modifications may be made therein without departing from the scope of the appended claims.

Claims (14)

1. A ranging apparatus comprising:
a light-emitting unit having a light emitter, and a light emission controller for intensity-modulating a light emitted from said light emitter and emitting the intensity-modulated light as said modulated lights;
a light-detecting unit for detecting reflected lights from an object that is irradiated with said modulated lights; and
a calculating unit for calculating a distance up to said object based on a phase difference between said modulated lights and said reflected lights,
wherein the light emission controller comprises a start phase controller for controlling phases of modulated lights which start being emitted at times different from each other,
wherein said light-detecting unit samples amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted,
wherein said light-detecting unit comprises:
an exposure period changer for changing terminal ends of said exposure periods based on an external control signal; and
wherein said light-emitting unit comprises:
a start phase changer for changing said start phases of said modulated lights based on said exposure periods which have been changed by said exposure period changer.
2. A ranging apparatus according to claim 1, further comprising:
a memory storing a table which registers therein information on the start phases of said modulated lights which correspond to the changed exposure periods,
wherein said start phase changer changes the start phases of said modulated lights based on the changed exposure periods and the information registered in said table stored in said memory.
3. A ranging apparatus according to claim 1, further comprising:
a start phase calculator for calculating the start phases of said modulated lights based on the changed exposure periods,
wherein said start phase changer changes the start phases of said modulated lights based on the information on the start phases from said start phase calculator.
4. A ranging apparatus according to claim 1, wherein said light-emitting unit emits a first modulated light at a phase over a predetermined period from a first emission start time and emits a second modulated light at a different phase over said predetermined period from a second emission start time;
said light-detecting unit detects a first reflected light from said object irradiated with said first modulated light over said predetermined period from said first emission start time and detects a second reflected light from said object irradiated with said second modulated light over said predetermined period from said second emission start time; and
said calculating unit calculates the distance up to said object based on at least the phase difference between said first modulated light and said first reflected light and the phase difference between said second modulated light and said second reflected light.
5. A ranging apparatus according to claim 4, wherein said light-detecting unit samples an amount of the first reflected light in exposure periods established at a constant cycle length from said first emission start time and samples an amount of the second reflected light in exposure periods established at the constant cycle length from said second emission start time; and
said calculating unit calculates a value representing the sampled amount of the first reflected light which is integrated over said predetermined period, as said phase difference between said first modulated light and said first reflected light, and calculates a value representing the sampled amount of the second reflected light which is integrated over said predetermined period, as said phase difference between said second modulated light and said second reflected light.
6. A ranging apparatus comprising:
a light-emitting unit having a light emitter, and a light emission controller for intensity-modulating a light emitted from said light emitter and emitting the intensity-modulated light as said modulated lights;
a light-detecting unit for detecting reflected lights from an object that is irradiated with said modulated lights; and
a calculating unit for calculating a distance up to said object based on a phase difference between said modulated lights and said reflected lights,
wherein the light emission controller comprises a start phase controller for controlling phases of modulated lights which start being emitted at times different from each other,
wherein said light-detecting unit samples amounts of the reflected lights in exposure periods established at a constant cycle length from the time when the modulated lights start being emitted,
wherein said light-detecting unit comprises:
an exposure timing changer for changing said cycle length of said exposure periods based on an external control signal, and
wherein said light-emitting unit comprises:
a wavelength changer for changing respective wavelengths of said modulated lights based on the cycle length of said exposure periods which has been changed by said exposure timing changer; and
a start phase changer for changing said start phases of said modulated lights based on the changed cycle length of said exposure periods.
7. A ranging apparatus according to claim 6, further comprising:
a memory storing a table which registers therein information on the wavelengths and start phases of said modulated lights corresponding to the changed cycle length of said exposure periods;
wherein said wavelength changer changes the wavelengths of said modulated lights based on the changed cycle length of said exposure periods and the information registered in said table stored in said memory; and
said start phase changer changes said start phases of said modulated lights based on the changed cycle length of said exposure periods and the information registered in said table.
8. A ranging apparatus according to claim 6, further comprising:
a wavelength calculator for calculating the wavelengths of said modulated lights based on the changed cycle length of said exposure periods; and
a start phase calculator for calculating said start phases of said modulated lights based on the changed cycle length of said exposure periods.
9. A ranging apparatus according to claim 6, wherein said light-emitting unit emits a first modulated light at a phase over a predetermined period from a first emission start time and emits a second modulated light at a different phase over said predetermined period from a second emission start time;
said light-detecting unit detects a first reflected light from said object irradiated with said first modulated light over said predetermined period from said first emission start time and detects a second reflected light from said object irradiated with said second modulated light over said predetermined period from said second emission start time; and
said calculating unit calculates the distance up to said object based on at least the phase difference between said first modulated light and said first reflected light and the phase difference between said second modulated light and said second reflected light.
10. A ranging apparatus according to claim 9, wherein said light-detecting unit samples an amount of the first reflected light in exposure periods established at a constant cycle length from said first emission start time and samples an amount of the second reflected light in exposure periods established at the constant cycle length from said second emission start time; and
said calculating unit calculates a value representing the sampled amount of the first reflected light which is integrated over said predetermined period, as said phase difference between said first modulated light and said first reflected light, and calculates a value representing the sampled amount of the second reflected light which is integrated over said predetermined period, as said phase difference between said second modulated light and said second reflected light.
11. A ranging apparatus comprising:
a light-emitting unit having a light emitter, and a light emission controller for intensity-modulating a light emitted from said light emitter and emitting the intensity-modulated light as said modulated lights;
a light-detecting unit for detecting reflected lights from an object that is irradiated with said modulated lights; and
a calculating unit for calculating a distance up to said object based on a phase difference between said modulated lights and said reflected lights,
wherein the light emission controller comprises a start phase controller for controlling phases of modulated lights which start being emitted at times different from each other, further comprising:
a start phase corrector for correcting said start phases of said modulated lights based on a difference between the distance up to said object which is calculated by said calculating unit and a distance measured up to said object.
12. A ranging method comprising the steps of:
(a) emitting modulated lights by intensity-modulating lights emitted from a light-emitting unit and which have respective different start phases at which the modulated lights start being emitted;
(b) detecting reflected lights from an object that is irradiated with said modulated lights; and
(c) calculating a distance up to said object based on a phase difference between said modulated lights and said reflected lights,
wherein the emitting step (a) comprises a step of controlling phases of the modulated lights being emitted at times different from each other,
further comprising the step of:
correcting said start phases of said modulated lights based on a difference between the distance up to said object which is calculated in said step (c) and a distance measured up to said object.
13. A ranging method according to claim 12, wherein said step (a) comprises:
emitting a first modulated light at a phase over a predetermined period from a first emission start time and emitting a second modulated light at a different phase over said predetermined period from a second emission start time;
wherein said step (b) comprises:
detecting a first reflected light from said object irradiated with said first modulated light over said predetermined period from said first emission start time, and detecting a second reflected light from said object irradiated with said second modulated light over said predetermined period from said second emission start time; and
wherein said step (c) comprises:
calculating the distance up to said object based on at least the phase difference between said first modulated light and said first reflected light, and the phase difference between said second modulated light and said second reflected light.
14. A ranging method according to claim 13, wherein said step (b) comprises:
sampling an amount of said first reflected light in exposure periods established at a constant cycle length from said first emission start time and sampling an amount of said second reflected light in exposure periods established at the constant cycle length from said second emission start time; and
said step (c) comprises calculating a value representing the sampled amount of said first reflected light which is integrated over said predetermined period, as said phase difference between said first modulated light and said first reflected light and calculating a value representing the sampled amount of said second reflected light which is integrated over said predetermined period, as said phase difference between said second modulated light and said second reflected light.
US12/037,727 2007-02-27 2008-02-26 Ranging apparatus and ranging method Active 2031-09-04 US8311286B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2007-047372 2007-02-27
JP2007047372 2007-02-27

Publications (2)

Publication Number Publication Date
US20080205709A1 US20080205709A1 (en) 2008-08-28
US8311286B2 true US8311286B2 (en) 2012-11-13

Family

ID=39715957

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/037,727 Active 2031-09-04 US8311286B2 (en) 2007-02-27 2008-02-26 Ranging apparatus and ranging method

Country Status (2)

Country Link
US (1) US8311286B2 (en)
JP (1) JP2008241695A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016165449A1 (en) * 2015-08-07 2016-10-20 中兴通讯股份有限公司 Distance measurement method and device
US10281565B2 (en) * 2014-06-09 2019-05-07 Panasonic Intellectual Property Management Co., Ltd. Distance measuring device and solid-state image sensor used therein
US10791282B2 (en) 2018-12-13 2020-09-29 Fenwick & West LLP High dynamic range camera assembly with augmented pixels
US10791286B2 (en) 2018-12-13 2020-09-29 Facebook Technologies, Llc Differentiated imaging using camera assembly with augmented pixels
US10855896B1 (en) * 2018-12-13 2020-12-01 Facebook Technologies, Llc Depth determination using time-of-flight and camera assembly with augmented pixels
US10902623B1 (en) 2019-11-19 2021-01-26 Facebook Technologies, Llc Three-dimensional imaging with spatial and temporal coding for depth camera assembly
US11194160B1 (en) 2020-01-21 2021-12-07 Facebook Technologies, Llc High frame rate reconstruction with N-tap camera sensor

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5190663B2 (en) * 2007-03-27 2013-04-24 スタンレー電気株式会社 Distance image generator
JP4629136B2 (en) * 2008-10-15 2011-02-09 富士フイルム株式会社 Ranging device, ranging method and program
KR101675112B1 (en) * 2010-01-21 2016-11-22 삼성전자주식회사 Method of extractig depth information and optical apparatus employing the method
US8681255B2 (en) * 2010-09-28 2014-03-25 Microsoft Corporation Integrated low power depth camera and projection device
WO2014208018A1 (en) 2013-06-26 2014-12-31 パナソニックIpマネジメント株式会社 Distance measuring system
JP6246911B2 (en) * 2014-05-02 2017-12-20 富士フイルム株式会社 Ranging device, ranging method, and ranging program
US10158509B2 (en) 2015-09-23 2018-12-18 Innophase Inc. Method and apparatus for polar receiver with phase-amplitude alignment
US9673829B1 (en) 2015-12-02 2017-06-06 Innophase, Inc. Wideband polar receiver architecture and signal processing methods
JP2017150893A (en) * 2016-02-23 2017-08-31 ソニー株式会社 Ranging module, ranging system, and control method of ranging module
US10122397B2 (en) 2017-03-28 2018-11-06 Innophase, Inc. Polar receiver system and method for Bluetooth communications
US10503122B2 (en) 2017-04-14 2019-12-10 Innophase, Inc. Time to digital converter with increased range and sensitivity
US10108148B1 (en) * 2017-04-14 2018-10-23 Innophase Inc. Time to digital converter with increased range and sensitivity
US10840921B2 (en) 2018-09-07 2020-11-17 Innophase Inc. Frequency control word linearization for an oscillator
US11095296B2 (en) 2018-09-07 2021-08-17 Innophase, Inc. Phase modulator having fractional sample interval timing skew for frequency control input
US10622959B2 (en) 2018-09-07 2020-04-14 Innophase Inc. Multi-stage LNA with reduced mutual coupling
US10728851B1 (en) 2019-01-07 2020-07-28 Innophase Inc. System and method for low-power wireless beacon monitor
US11070196B2 (en) 2019-01-07 2021-07-20 Innophase Inc. Using a multi-tone signal to tune a multi-stage low-noise amplifier
CN110186387A (en) * 2019-06-04 2019-08-30 浙江舜宇光学有限公司 Detection method, the device and system of depth
JP7417859B2 (en) * 2020-03-19 2024-01-19 株式会社リコー Distance correction information calculation method, distance measuring device, moving object and stereo camera device

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6243589A (en) 1985-08-20 1987-02-25 Meisei Electric Co Ltd Time measuring system
US4756617A (en) 1985-10-18 1988-07-12 Spectra-Physics, Inc. Laser alignment system with modulated field
US4855760A (en) * 1987-03-12 1989-08-08 Fuji Photo Film Co., Ltd. LED array with graduated quantity control
JPH02254397A (en) 1989-03-29 1990-10-15 Hioki Ee Corp Method and apparatus for measuring time
US5194906A (en) * 1990-09-10 1993-03-16 Kabushiki Kaisha Topcon Distance measuring device
US5260682A (en) * 1991-03-12 1993-11-09 Stanley Electric Co., Ltd. Light-wave distance measuring apparatus for vehicle
US5602638A (en) * 1994-04-01 1997-02-11 Boulware; Jim L. Apparatus for accurately determining a moving ball's position and speed
US5694204A (en) * 1994-10-03 1997-12-02 Hamamatsu Photonics K.K. Device for optically measuring distance
US5870178A (en) * 1996-02-20 1999-02-09 Canon Kabushiki Kaisha Distance measuring apparatus
US5877851A (en) 1997-09-24 1999-03-02 The United States Of America As Represented By The Secretary Of The Army Scannerless ladar architecture employing focal plane detector arrays and FM-CW ranging theory
JP2002090454A (en) 2000-09-14 2002-03-27 Hokuyo Automatic Co Obstacle detection sensor for automated guided vehicle
JP2003279329A (en) 2002-02-28 2003-10-02 Ckd Corp Three-dimensional measuring apparatus
JP2004032682A (en) 2002-04-08 2004-01-29 Matsushita Electric Works Ltd Free space information detector using intensity modulated light
US20040263673A1 (en) * 2003-06-26 2004-12-30 Matsushita Electric Industrial Co., Ltd. Camera apparatus, image server and image server system
JP2005069927A (en) 2003-08-26 2005-03-17 Nec Viewtechnology Ltd Distance measuring device and method therefor
US20050083396A1 (en) * 2002-10-10 2005-04-21 Akira Shiota Exposure system and production method for exposure system
US20050088509A1 (en) * 2003-10-23 2005-04-28 Fuji Photo Film Co., Ltd. Light quantity adjustment device and method and exposure apparatus
JP2005181180A (en) 2003-12-22 2005-07-07 Tdk Corp Radar system
US20050173617A1 (en) * 2004-02-10 2005-08-11 Konica Minolta Photo Imaging, Inc. Image forming apparatus
US20050178946A1 (en) * 2002-07-15 2005-08-18 Matsushita Electric Works, Ltd. Light receiving device with controllable sensitivity and spatial information detecting apparatus using the same
US20050195383A1 (en) * 1994-05-23 2005-09-08 Breed David S. Method for obtaining information about objects in a vehicular blind spot
JP3758618B2 (en) 2002-07-15 2006-03-22 松下電工株式会社 Ranging device and distance measuring method using image sensor
US7045783B2 (en) * 2001-06-05 2006-05-16 University Of Florida Research Foundation, Inc. Device and method for object illumination and imaging using light pulses
JP2006300616A (en) 2005-04-18 2006-11-02 Matsushita Electric Works Ltd Space information detection system
US20070057209A1 (en) * 2004-09-17 2007-03-15 Matsushita Electric Works, Ltd. Range image sensor

Patent Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6243589A (en) 1985-08-20 1987-02-25 Meisei Electric Co Ltd Time measuring system
US4756617A (en) 1985-10-18 1988-07-12 Spectra-Physics, Inc. Laser alignment system with modulated field
US4855760A (en) * 1987-03-12 1989-08-08 Fuji Photo Film Co., Ltd. LED array with graduated quantity control
JPH02254397A (en) 1989-03-29 1990-10-15 Hioki Ee Corp Method and apparatus for measuring time
US5194906A (en) * 1990-09-10 1993-03-16 Kabushiki Kaisha Topcon Distance measuring device
US5260682A (en) * 1991-03-12 1993-11-09 Stanley Electric Co., Ltd. Light-wave distance measuring apparatus for vehicle
US5602638A (en) * 1994-04-01 1997-02-11 Boulware; Jim L. Apparatus for accurately determining a moving ball's position and speed
US20050195383A1 (en) * 1994-05-23 2005-09-08 Breed David S. Method for obtaining information about objects in a vehicular blind spot
US5694204A (en) * 1994-10-03 1997-12-02 Hamamatsu Photonics K.K. Device for optically measuring distance
US5870178A (en) * 1996-02-20 1999-02-09 Canon Kabushiki Kaisha Distance measuring apparatus
US5877851A (en) 1997-09-24 1999-03-02 The United States Of America As Represented By The Secretary Of The Army Scannerless ladar architecture employing focal plane detector arrays and FM-CW ranging theory
JP2002090454A (en) 2000-09-14 2002-03-27 Hokuyo Automatic Co Obstacle detection sensor for automated guided vehicle
US7045783B2 (en) * 2001-06-05 2006-05-16 University Of Florida Research Foundation, Inc. Device and method for object illumination and imaging using light pulses
JP2003279329A (en) 2002-02-28 2003-10-02 Ckd Corp Three-dimensional measuring apparatus
JP2004032682A (en) 2002-04-08 2004-01-29 Matsushita Electric Works Ltd Free space information detector using intensity modulated light
US20050178946A1 (en) * 2002-07-15 2005-08-18 Matsushita Electric Works, Ltd. Light receiving device with controllable sensitivity and spatial information detecting apparatus using the same
JP3758618B2 (en) 2002-07-15 2006-03-22 松下電工株式会社 Ranging device and distance measuring method using image sensor
US20050083396A1 (en) * 2002-10-10 2005-04-21 Akira Shiota Exposure system and production method for exposure system
US20040263673A1 (en) * 2003-06-26 2004-12-30 Matsushita Electric Industrial Co., Ltd. Camera apparatus, image server and image server system
JP2005069927A (en) 2003-08-26 2005-03-17 Nec Viewtechnology Ltd Distance measuring device and method therefor
US20050088509A1 (en) * 2003-10-23 2005-04-28 Fuji Photo Film Co., Ltd. Light quantity adjustment device and method and exposure apparatus
JP2005181180A (en) 2003-12-22 2005-07-07 Tdk Corp Radar system
US20050173617A1 (en) * 2004-02-10 2005-08-11 Konica Minolta Photo Imaging, Inc. Image forming apparatus
US20070057209A1 (en) * 2004-09-17 2007-03-15 Matsushita Electric Works, Ltd. Range image sensor
JP2006300616A (en) 2005-04-18 2006-11-02 Matsushita Electric Works Ltd Space information detection system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Rejection of the Application, dated Nov. 22, 2011, issued in related JP Application No. 2007-047371, 4 pages in English and Japanese.
Rejection of the Application, dated Nov. 22, 2011, issued in related JP Application No. 2007-077861, 3 pages in English and Japanese.
Rejection of the Application, dated Nov. 22, 2011, issued in related JP Application No. 2008-040992, 4 pages in English and Japanese.

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10281565B2 (en) * 2014-06-09 2019-05-07 Panasonic Intellectual Property Management Co., Ltd. Distance measuring device and solid-state image sensor used therein
WO2016165449A1 (en) * 2015-08-07 2016-10-20 中兴通讯股份有限公司 Distance measurement method and device
US10791282B2 (en) 2018-12-13 2020-09-29 Fenwick & West LLP High dynamic range camera assembly with augmented pixels
US10791286B2 (en) 2018-12-13 2020-09-29 Facebook Technologies, Llc Differentiated imaging using camera assembly with augmented pixels
US10855896B1 (en) * 2018-12-13 2020-12-01 Facebook Technologies, Llc Depth determination using time-of-flight and camera assembly with augmented pixels
US11399139B2 (en) 2018-12-13 2022-07-26 Meta Platforms Technologies, Llc High dynamic range camera assembly with augmented pixels
US11509803B1 (en) * 2018-12-13 2022-11-22 Meta Platforms Technologies, Llc Depth determination using time-of-flight and camera assembly with augmented pixels
US10902623B1 (en) 2019-11-19 2021-01-26 Facebook Technologies, Llc Three-dimensional imaging with spatial and temporal coding for depth camera assembly
US11348262B1 (en) 2019-11-19 2022-05-31 Facebook Technologies, Llc Three-dimensional imaging with spatial and temporal coding for depth camera assembly
US11194160B1 (en) 2020-01-21 2021-12-07 Facebook Technologies, Llc High frame rate reconstruction with N-tap camera sensor

Also Published As

Publication number Publication date
US20080205709A1 (en) 2008-08-28
JP2008241695A (en) 2008-10-09

Similar Documents

Publication Publication Date Title
US8311286B2 (en) Ranging apparatus and ranging method
US7869007B2 (en) Ranging apparatus and ranging method
US7796239B2 (en) Ranging apparatus and ranging method
US8254638B2 (en) Ranging apparatus and ranging method
US7847825B2 (en) Image capturing apparatus
KR20180119476A (en) Method and system for time alignment calibration, event annotation and/or database generation
US6295085B1 (en) Method and apparatus for eliminating flicker effects from discharge lamps during digital video capture
US8948342B2 (en) X-ray imaging apparatus and measurement method
JP2013050310A (en) Distance image generation device
US8866803B2 (en) Image display device displaying image by applying laser light
JP2020008531A (en) Distance measuring device with distance correction function
JP2009156704A (en) Brightness measuring device and method of display panel, and display device
US6519002B1 (en) Method and apparatus to minimize flicker effects from a discharge light source during digital video capture
JP2001313958A (en) Three-dimensional image reader
JP2007281556A (en) Imaging element, imaging apparatus, and imaging system
JP7310606B2 (en) Two-dimensional flicker measuring device and two-dimensional flicker measuring method
JP2011169842A (en) Flicker measuring method and device thereof
JP2008241258A (en) Range finder and range finding method
JP5520562B2 (en) Three-dimensional shape measuring system and three-dimensional shape measuring method
WO2021049151A1 (en) Distance measurement device and distance measurement mechanism deviation adjustment method for same
TW201236451A (en) Image sensor
JP2009159572A (en) Light receiving unit and optical communication equipment
JP6094089B2 (en) Lighting device and lighting system
US20240192370A1 (en) Distance measuring device and distance measuring system
JP2014021100A (en) Three-dimensional information detection device, and three-dimensional information detection method

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJIFILM CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MASUDA, TOMONORI;SAWACHI, YOUICHI;REEL/FRAME:020563/0721

Effective date: 20080111

Owner name: FUJIFILM CORPORATION,JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MASUDA, TOMONORI;SAWACHI, YOUICHI;REEL/FRAME:020563/0721

Effective date: 20080111

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: SDIP HOLDINGS PTY LTD, AUSTRALIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OPTALERT HOLDINGS PTY LIMITED;REEL/FRAME:049573/0047

Effective date: 20190319

Owner name: OPTALERT HOLDINGS PTY LIMITED, AUSTRALIA

Free format text: CHANGE OF NAME;ASSIGNOR:OPTALERT LIMITED;REEL/FRAME:049572/0963

Effective date: 20150124

Owner name: OPTALERT LIMITED, AUSTRALIA

Free format text: CHANGE OF NAME;ASSIGNOR:OPTALERT PTY LTD;REEL/FRAME:049572/0885

Effective date: 20110923

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12