US20170180690A1 - System and Method for Feedback Control in Scanning Projectors - Google Patents
System and Method for Feedback Control in Scanning Projectors Download PDFInfo
- Publication number
- US20170180690A1 US20170180690A1 US14/978,766 US201514978766A US2017180690A1 US 20170180690 A1 US20170180690 A1 US 20170180690A1 US 201514978766 A US201514978766 A US 201514978766A US 2017180690 A1 US2017180690 A1 US 2017180690A1
- Authority
- US
- United States
- Prior art keywords
- photodetector
- laser light
- scanning
- feedback signal
- perimeter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000003116 impacting effect Effects 0.000 claims abstract description 27
- 230000033001 locomotion Effects 0.000 claims description 40
- 230000003287 optical effect Effects 0.000 claims description 26
- 230000005284 excitation Effects 0.000 claims description 19
- 230000004044 response Effects 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000010408 sweeping Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000003491 array Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000003990 capacitor Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- WYTGDNHDOZPMIW-RCBQFDQVSA-N alstonine Natural products C1=CC2=C3C=CC=CC3=NC2=C2N1C[C@H]1[C@H](C)OC=C(C(=O)OC)[C@H]1C2 WYTGDNHDOZPMIW-RCBQFDQVSA-N 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/02—Details
- G01J1/04—Optical or mechanical part supplementary adjustable parts
- G01J1/0407—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
- G01J1/0425—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings using optical fibers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/02—Details
- G01J1/04—Optical or mechanical part supplementary adjustable parts
- G01J1/0407—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
- G01J1/0466—Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings with a sighting port
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/101—Scanning systems with both horizontal and vertical deflecting means, e.g. raster or XY scanners
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/105—Scanning systems with one or more pivoting mirrors or galvano-mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
- H04N3/02—Scanning details of television systems; Combination thereof with generation of supply voltages by optical-mechanical means only
- H04N3/08—Scanning details of television systems; Combination thereof with generation of supply voltages by optical-mechanical means only having a moving reflector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/14—Picture reproducers using optical-mechanical scanning means only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3129—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] scanning a light beam on the display screen
- H04N9/3135—Driving therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3161—Modulator illumination systems using laser light sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N2021/9513—Liquid crystal panels
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
Definitions
- the present disclosure generally relates to projectors, and more particularly relates to scanning projectors.
- pixels are typically generated by modulating light from laser light sources as a scanning mirror scans the modulated light in a raster pattern.
- This use of a scanning mirror to scan the modulated light requires relatively precise control of the scanning mirror.
- the physical motion of the scanning must be precisely controlled to facilitate an accurate scan of the modulated light in the raster pattern.
- previous techniques for monitoring and controlling the physical motion of the scanning mirror can be insufficiently precise for some scanning projector applications.
- FIG. 1 shows a schematic diagram of a scanning laser projector in accordance with various embodiments of the present invention
- FIG. 2 shows a schematic diagram of portion of an exemplary image region and over scanned region in accordance with various embodiments of the present invention
- FIG. 3 shows a schematic diagram of portion of an exemplary image region and over scanned region in accordance with various embodiments of the present invention
- FIG. 4 shows a schematic diagram of an exemplary image region and over scanned region in accordance with various embodiments of the present invention
- FIG. 5 shows an exemplary device that includes a microlens array in accordance with various embodiments of the present invention
- FIG. 6 shows an exemplary device that includes a projector in accordance with various embodiments of the present invention
- FIG. 7 shows a schematic view of a scanning laser projector in accordance with various embodiments of the present invention.
- FIG. 8 shows a plan view of a microelectromechanical system (MEMS) device with a scanning mirror in accordance with various embodiments of the present invention
- FIG. 9 shows a block diagram of a mobile device in accordance with various embodiments of the present invention.
- FIG. 10 shows a perspective view of a mobile device in accordance with various embodiments of the present invention.
- FIG. 11 shows a perspective view of a head-up display system in accordance with various embodiments of the present invention.
- FIG. 12 shows a perspective view of eyewear in accordance with various embodiments of the present invention.
- FIG. 13 shows a perspective view of a gaming apparatus in accordance with various embodiments of the present invention.
- FIG. 14 shows a perspective view of a gaming apparatus in accordance with various embodiments of the present invention.
- the embodiments described herein provide a scanning projector that uses at least one photodetector to generate a feedback signal, and uses the feedback signal to control a scanning mirror in the projector.
- the scanning mirror is configured to reflect light into an image region and an over scanned region.
- the at least one photodetector is configured to receive a portion of the reflected light impacting the over scanned region, and provides the feedback signal responsive to the received portion of light.
- This feedback signal can then be used to provide precise control of the scanning mirror, and thus can provide improved performance in the scanning projector.
- this feedback signal can be used to compensate for variations in the operational environment, such as temperature changes, source voltage changes, etc. If such operational environment changes are not compensated for they could otherwise cause inaccuracies in the control of the scanning mirror, and result in unacceptable degradations in the image quality produced by the scanning projector.
- the scanning laser projector 100 includes a laser light source 102 , scanning mirror(s) 104 , and a drive circuit 106 .
- the laser light source 102 provides laser light that is encoded with pixel data to generate image pixels that are to be projected by the scanning laser projector 100 .
- the drive circuit 106 controls the movement of the scanning mirror(s) 104 .
- the drive circuit 106 provides excitation signal(s) to excite motion of the scanning mirror(s) 104 .
- the scanning mirror(s) 104 reflect the laser light into an image region 112 and an over scanned region 114 , where the image region 112 is defined by a perimeter 116 .
- the scanning mirror(s) 104 are controlled by the drive circuit 104 to reflect the laser light into a raster pattern 118 , with the raster pattern 118 covering the image region 112 and extending into the over scanned region 114 .
- At least one photodetector 110 is configured to receive a portion of the reflected laser light impacting the over scanned region 114 .
- This photodetector 110 is configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector 110 .
- This feedback signal is provided to the drive circuit 106 , and is used by the drive circuit 106 to accurately control the motion of the scanning mirror(s) 104 .
- the drive circuit 106 modifies the excitation signal in response to the feedback signal, thus facilitating precise control of the motion of the scanning mirror(s) 104 .
- Such precise control of the scanning mirror(s) 104 can facilitate improved image quality, and can further facilitate new usages and applications for the scanning laser projector 100 .
- the feedback signal indicates the timing of various scans in the raster pattern 118 impacting the photodetectors 110 .
- the feedback signal can indicate a photodetector entry time corresponding to when the reflected laser light first impacts the photodetector 110 during a particular horizontal scan, and likewise indicates a photodetector exit time corresponding to when the reflected laser light last impacts the photodetector 110 during that same horizontal scan.
- the feedback signal can be used to determine and control various operational parameters of the scanning mirrors 104 .
- the feedback signal can be used to determine and control the horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude of the scanning mirrors 104 and resulting raster pattern 118 .
- the horizontal scan amplitude is a measure of the horizontal sweep of the raster pattern 118 .
- the horizontal scan amplitude can be calculated using the timing of the laser light hitting the photodetectors 110 , the position of the photodetectors 110 , and the frequency of the horizontal scanning.
- the horizontal phase alignment is likewise a measure of horizontal position of the raster pattern 118 .
- Such a horizontal phase alignment can be calculated using the feedback signal by determining a timing difference between left and right sweeping scans in the raster pattern 118 .
- the vertical scan amplitude is likewise a measure of the vertical sweep of the raster pattern 118 .
- the vertical scan amplitude can be calculated using the feedback signal by determining the number of scans crossing the photodetector 110 . Detailed examples of such embodiments will be described in greater detail below.
- the image region 112 and perimeter 116 can be implemented and defined in various ways.
- the image region 112 can be defined by an opening surrounded by a border fixture or by a microlens array (MLA). Examples of such embodiments will be described in greater detail below with reference to FIGS. 5 and 6 .
- MLA microlens array
- an optical waveguide can be used to direct light to the photodetector 110 .
- the waveguide can be coupled between the photodetector 110 and an aperture that is positioned proximate to the perimeter 116 such that the aperture receives the portion of the reflected laser light impacting the over scanned region 114 and the optical waveguide transmits the portion of the reflected light to the photodetector 110 .
- the aperture and/or waveguide can be implemented together with the border fixture or MLA defining the perimeter 116 .
- the photodetector 110 can be positioned off axis relative to the horizontal scan direction of the reflected laser light.
- the horizontal scan of the reflected laser light will cross the photodetector at a non-orthogonal angle.
- such an embodiment can be used to determine a precise vertical position of a particular horizontal scan.
- multiple photodetectors 110 can be implemented.
- a second photodetector 110 can be configured to receive a second portion of the reflected laser light impacting the over scanned region 114 .
- Such a second photodetector 110 can be configured to provide a second feedback signal responsive to the second portion of the reflected laser light impacting the second photodetector 110 .
- the first photodetector 110 can be positioned proximate to a horizontal edge of the perimeter 116
- the second photodetector 110 is positioned proximate to a vertical edge of the perimeter 116 .
- the photodetector 110 can be dimensionally small relative to the horizontal scan amplitude.
- the photodetector 110 can have a sensor width of about 6% the horizontal scan amplitude. However, this is just one example, and devices of other sizes can be used.
- FIG. 2 a schematic diagram of portion of an exemplary image region 212 and over scanned region 214 is illustrated.
- pixel-modulated laser light is reflected by one or more scanning mirrors into a raster pattern 218 .
- the raster pattern 218 is projected into image region 212 and extends into the over scanned region 214 .
- the scanning of pixel-modulated laser light into the raster pattern 218 generates an image in the area corresponding to the image region 212 .
- raster pattern 218 is not illustrated to scale.
- a typical raster pattern 218 would include a significantly greater number of horizontal scan lines, with the number of horizontal scan lines corresponding to a vertical scan rate in the raster pattern 218 .
- the line illustrating the raster pattern 218 does not represent the actual size of the laser beam creating the raster pattern 218 .
- FIG. 2 shows an expanded view of a photodetector 216 positioned in the over scanned region 214 to more clearly indicate how the reflected laser light can be detected by the photodetector 216 and used to generate a feedback signal.
- the reflected laser light impacts the sensing region of photodetector 216 at T 1 , as indicated in FIG. 2 .
- T 1 and T 2 thus correspond to a photodetector entry time and photodetector exit time. This process continues in the next horizontal scan.
- the reflected laser light again impacts sensing region of the photodetector 216 at T 3 and then again exits the photodetector at T 4 .
- T 3 and T 4 thus correspond to a second photodetector entry time and second photodetector exit time.
- the reflected light again impacts the sensing region at T 5 and exits at T 6 .
- the output of the photodetector 216 during these times can be used to generate a corresponding feedback signal.
- the photodetector 216 can be used to provide for enhanced feedback control.
- the feedback signal can be used to determine horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude, and provide feedback control of the mirrors based on one or more of those parameters.
- the drive circuit e.g., drive circuit 106
- the horizontal scan amplitude for feedback control of the scanning mirrors (e.g., scanning mirrors 104 ).
- T 1 and T 2 are sufficient to calculate the horizontal scan amplitude.
- multiple crossings of the photodetector can be used to improve accuracy.
- the data from additional entry and exit times e.g., the times of T 1 , T 2 , T 3 and T 4
- a feedback signal generated from the photodetector 216 can also be used to determine the horizontal phase alignment, where the horizontal phase alignment defines the horizontal position in time of the raster pattern 218 .
- the timing difference between the left and right sweeping scans can be calculated and used to determine horizontal phase alignment.
- the time between T 2 and T 3 corresponds to the time of a left sweeping scan between those points.
- the time between T 4 and T 5 corresponds to the time of a right sweeping scan between those points.
- the time difference between the left sweeping scan and the right sweeping scan can be calculated. This time difference, along with the known position of the photodetector can be used to determine the horizontal phase alignment of the raster pattern 218 .
- the horizontal phase alignment can be used to correct the timing of the laser light source (e.g., laser light source 102 ) to provide precise alignment between the pixels generated by the laser light source and the scanning mirrors (e.g., scanning mirrors 104 ).
- the laser light source e.g., laser light source 102
- the scanning mirrors e.g., scanning mirrors 104
- a feedback signal generated from the photodetector 216 can be used to control the pixel alignment relative to the horizontal scan position.
- the feedback signal or data derived from the feedback signal can be provided to a pixel drive generator or other such element coupled to the laser light source.
- the feedback signal can then be used to control the laser light and provide pixel alignment of the laser light with the scanning mirror.
- the position of the pixel being generated by the laser light source can be precisely controlled and thus precisely aligned.
- such an embodiment can be used to ensure that pixels are aligned with lensets in the microlens array. A description of such an embodiment will be described in greater detail below.
- a feedback signal generated from the photodetector 216 can also be used to determine the vertical scan amplitude of the raster pattern 218 .
- the vertical scan amplitude can be determined by counting the number of sweeps that occur across the photodetector 216 during an image frame.
- the vertical scan amplitude can be adjusted by the drive circuit such that a specified number of sweeps cross the photodetector 216 .
- FIG. 3 a schematic diagram of portion of an exemplary image region 312 and over scanned region 214 is illustrated.
- pixel-modulated laser light is reflected by one or more scanning mirrors into a raster pattern 318 .
- This raster pattern 218 is projected into the image region 312 and extends into the over scanned region 314 .
- FIG. 3 again shows an expanded view of a photodetector 316 positioned in the over scanned region 314 .
- the photodetector 316 is positioned off-axis relative to the horizontal scan direction of the reflected laser light. This off-axis position causes the horizontal scan of the reflected laser light to cross the photodetector 316 at a non-orthogonal angle relative to the photodetector 316 .
- the reflected laser light impacts the sensing region of photodetector 316 at T 1 .
- the reflected laser light exits the photodetector 316 at T 2 .
- T 1 and T 2 thus correspond to a photodetector entry time and photodetector exit time.
- the reflected laser light again impacts sensing region of the photodetector 316 at T 3 and then again exits the photodetector at T 4 .
- T 3 and T 4 thus correspond to a second photodetector entry time and second photodetector exit time.
- the photodetector 316 and the entry and exit times can be used to determine and control the horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude. For example, these parameters can be calculated and used for feedback control using the various techniques described above with reference to FIG. 2 .
- the off-axis arrangement of the photodetector 316 further facilitates precise determination of the vertical position of a scan impacting the end of the photodetector 316 .
- the precise determination of the vertical position of scan can be calculated using by determining the entry time and exit time of scan that crosses a bottom corner of the photodetector 316 .
- the time between T 3 and T 1 can be used to determine where along the bottom of the photodetector 316 the scan crossed.
- the portion of the photodetector 316 crossed by the scan becomes wider.
- the portion of the photodetector 316 crossed by the scan becomes narrower.
- This difference in the portion of the photodetector 316 crossed by the scan at different vertical positions can be used to accurately determine the vertical position of a particular scan. Specifically, by calculating the time between T 3 and T 4 , and knowing the frequency of the horizontal scan and the position of the photodetector 316 , the precise vertical position of the scan impacting the off-axis bottom edge of the photodetector 316 can be determined. A feedback signal generated from the photodetector 316 can thus be used by the drive circuit adjust the scanning mirrors and resulting vertical position of the raster scan 318 .
- the amplitude of the output of the photodetector 316 generated during a scan crossing can be measured and used to determine vertical position of the scan. In such an embodiment, the larger the portion of the photodetector 316 that is crossed by the scan, the higher the amplitude of the photodetector 316 output and vice versa.
- FIG. 4 a schematic diagram of an exemplary image region 412 and over scanned region 414 is illustrated, with the image region 412 defined by a perimeter 416 .
- pixel-modulated laser light is reflected by one or more scanning mirrors into a raster pattern 418 .
- photodetectors 420 , 422 , 424 and 426 are each configured to receive a portion of the reflected laser light impacting the over scanned region 414 .
- Each of the photodetectors 420 , 422 , 424 and 426 are configured to provide a feedback signal responsive to their respective received portion of the reflected laser light. Such feedback signals can then be provided to a drive circuit and used by the drive circuit to accurately control the motion of the scanning mirror used to generate the raster pattern 418 .
- photodetectors 422 and 424 are positioned proximate a horizontal edge of the perimeter 416 .
- photodetectors 420 and 426 are positioned proximate to a vertical edge of the perimeter 416 .
- the photodetectors are positioned at locations that correspond to different horizontal scan amplitudes.
- the line 434 represents the center of the horizontal scan path, and thus the line 434 represents a location where a horizontal scan is at zero amplitude.
- line 436 represents a midpoint to the maximum horizontal scan amplitude, and thus represents a location where the horizontal scan amplitude is at 50% of maximum.
- lines 438 and 440 respectively represent locations where the horizontal scan amplitude is 90% and 95% percent of maximum.
- these locations of different scan amplitude also have corresponding different rates of motion. Specifically, the rate of motion in the scanning mirror (and in the resulting raster pattern 418 is higher near the center of the horizontal scan path and decreases as the amplitude increases. Furthermore, it should be noted that positioning photodetectors at areas of higher horizontal scan amplitude facilitates improved horizontal scan amplitude, while positioning photodetectors at areas of lower horizontal scan amplitude facilitates improved horizontal phase determination.
- photodetector 424 is arranged to detect the reflected light at approximately zero horizontal scan amplitude
- photodetector 422 is arranged to detect the reflected light at approximately 50% of the horizontal scan amplitude
- photodetector 420 is arranged to detect the reflected light at approximately 90% of the horizontal scan amplitude
- photodetector 426 is arranged to detect the reflected light at approximately 95% of the horizontal scan amplitude.
- photodetectors 420 and 426 could be configured and used to accurately determine horizontal scan amplitude based on their positions corresponding to relatively high percentages (90% and 95%) of the horizontal scan amplitude.
- photodetector 424 could be configured and used to determine horizontal phase alignment based on its position at the center of the horizontal scan. The photodetector 422 at midpoint of the horizontal scan amplitude provides a compromise position that could be effectively used for both horizontal scan amplitude determination and horizontal phase alignment determination.
- the image region and over scanned region can be defined and implemented in a variety of ways.
- the image region can be implemented to include a microlens array.
- microlens arrays are optical devices that include an arrangement of micro-lenses, commonly referred to as lenslets.
- Such microlens arrays can be fabricated from a variety of materials and with a variety of techniques.
- Microlens arrays can include one or two dimensional arrangements of lenslets formed on or with a supporting substrate. The individual lenslets can have apertures of different shapes, including circular and hexagonal.
- Microlens arrays can be used in a variety of applications, including eyewear and head-up displays (HUD). Examples of such applications will be discussed below.
- HUD head-up displays
- an exemplary device 500 includes a microlens array (MLA) 502 , where the MLA 502 defines an image region 512 , an over scanned region 514 , and a perimeter 516 .
- the MLA 502 includes a plurality of lenslets 522 .
- the plurality of lenslets 522 receives the reflected laser light in the image region 512 and optically delivers the light in a form that can be used to generate an image.
- a photodetector 510 is configured to receive a portion of the reflected laser light impacting the over scanned region 514 .
- this arrangement is provided by using optical waveguides 518 .
- each optical waveguides 518 is coupled between the photodetector 510 and a corresponding aperture 520 .
- the apertures 520 are positioned proximate to the perimeter 516 such that the each aperture 520 receives a portion of the reflected laser light impacting the over scanned region 514 and the corresponding optical waveguide 518 transmits the portion of the reflected light to the photodetector 510 .
- Such an arrangement allows one photodetector 510 to detect reflected light impacting the over scanned region 514 at multiple locations. Such an arrangement is possible because the scanning of the reflected laser light is such that the light hits only one location at a time. Thus, one photodetector 510 can be used to provide a feedback signal responsive to the light impacting at multiple locations in the over scanned region 514 .
- FIG. 5 illustrates the photodetector 510 inside the over scanned region 514 that in other embodiments the use of the optical waveguides 520 can facilitate the placement of the photodetector outside the overs scanned region. In some applications the placement of the photodetector 510 is limited only by the effective transmission ability of the optical waveguides 518 .
- the optical waveguides 518 can be implemented with a variety of structures and devices.
- the optical waveguides 518 can implemented with optical fibers, where the optical fibers are arranged to extend from the apertures 520 to the photodetector 510 .
- the optical waveguides 518 can be implemented with strip waveguides, rectangular waveguides, rib waveguides, and segmented waveguides, to list a few non-limiting examples.
- the optical waveguides 518 can be implemented as part of the MLA 512 .
- the optical waveguides 518 could be formed with or otherwise integrated with the MLA 512 .
- the optical waveguides 518 could be fabricated with the MLA 512 as part of the fabrication process used to form the MLA 512 .
- an MLA 512 can require precise pixel alignment relative to the MLA 512 .
- it can be required to ensure that each pixel is generated by the laser light source at a time in the horizontal scan that accurately corresponds to the position of a particular lenslet 522 in the array. This helps ensure that each pixels hits the appropriate lenslet 522 in the MLA 512 .
- a feedback signal generated from the photodetector can be used to control the pixel alignment relative to the horizontal scan position and ensure such a proper pixel alignment.
- the feedback signal or data derived from the feedback signal can be provided to a pixel drive generator and used to control the at least one source of laser light to provide pixel alignment of the laser light with the scanning mirror.
- the border fixture defines an opening, where the opening resides in a virtual plane through which the reflected light in the image region passes.
- Such an arrangement can be used in a variety of applications, including scanning projectors. Examples of such applications will be discussed below.
- an exemplary device 600 includes a projector 602 , a border fixture 604 , and system optics 606 . Note that in FIG. 6 both a side view of a front view of the border fixture 604 are illustrated.
- the border fixture 604 defines an image region 612 , an over scanned region 614 , and a perimeter 616 .
- the border fixture 604 defines an opening 622 . As configured, the opening 622 resides in a virtual plane represented by line 624 . During operation light outputted by the projector 602 passes through the opening 622 at the virtual plane and impacts the system optics 606 .
- a photodetector 610 is configured to receive a portion of the reflected laser light impacting the over scanned region 614 .
- this arrangement is provided by using optical waveguides 618 .
- each optical waveguide 618 is coupled between the photodetector 610 and a corresponding aperture 620 .
- the apertures 620 are positioned proximate to the perimeter 616 such that the each aperture 620 receives a portion of the reflected laser light impacting the over scanned region 614 and the corresponding optical waveguide 618 transmits the portion of the reflected light to the photodetector 610 .
- FIG. 7 a schematic view of a scanning laser projector 700 is illustrated.
- the scanning laser projector 700 is an example of the type of system that can be used in accordance with various embodiments of the present invention.
- Scanning laser projector 700 includes an image processing component 702 , a pixel drive generator 704 , a red laser module 706 , a green laser module 708 , and a blue laser module 710 .
- Light from the laser modules is combined with dichroics 712 , 714 , and 716 .
- Scanning laser projector 700 also includes fold mirror 718 , drive circuit 720 , and MEMS device 722 with scanning mirror 724 .
- image processing component 702 processes video content at using two dimensional interpolation algorithms to determine the appropriate spatial image content for each scan position at which an output pixel is to be displayed by the pixel drive generator.
- the video content may represent a grid of pixels at any resolution (e.g., 640 ⁇ 480, 848 ⁇ 480, 1280 ⁇ 720, 1920 ⁇ 1080).
- the input light intensity encoding typically represents the light intensity in 8, 10, 12 bit or higher resolutions.
- This content is then mapped to a commanded current for each of the red, green, and blue laser sources such that the output intensity from the lasers is consistent with the input image content.
- this process occurs at output pixel rates in excess of 150 MHz.
- the laser beams are then directed onto an ultra-high speed gimbal mounted 2 dimensional bi-axial laser scanning mirror 724 .
- this bi-axial scanning mirror is fabricated from silicon using MEMS processes.
- the vertical axis of rotation is operated quasi-statically and creates a vertical sawtooth raster trajectory.
- the vertical axis is also referred to as the slow-scan axis.
- the horizontal axis is operated on a resonant vibrational mode of the scanning mirror.
- the MEMS device uses electromagnetic actuation, achieved using a miniature assembly containing the MEMS die and small subassemblies of permanent magnets and an electrical interface, although the various embodiments are not limited in this respect.
- some embodiments employ electrostatic or piezoelectric actuation. Any type of mirror actuation may be employed without departing from the scope of the present invention.
- the horizontal resonant axis is also referred to as the fast-scan axis.
- raster pattern 726 is formed by combining a sinusoidal component on the horizontal axis and a sawtooth component on the vertical axis.
- output beam 728 sweeps back and forth left-to-right in a sinusoidal pattern, and sweeps vertically (top-to-bottom) in a sawtooth pattern with the display blanked during flyback (bottom-to-top).
- FIG. 7 illustrates the sinusoidal pattern as the beam sweeps vertically top-to-bottom, but does not show the flyback from bottom-to-top.
- the vertical sweep is controlled with a triangular wave such that there is no flyback.
- the vertical sweep is sinusoidal.
- the various embodiments of the invention are not limited by the waveforms used to control the vertical and horizontal sweep or the resulting raster pattern 726 .
- the drive circuit 720 provides a drive signal to MEMS device 722 .
- the drive signal includes an excitation signal to control the resonant angular motion of scanning mirror 724 on the fast-scan axis, and also includes slow scan drive signal to cause deflection on the slow-scan axis.
- the resulting mirror deflection on both the fast and slow-scan axes causes output beam 728 to generate a raster scan 726 in both an image region 730 and an over scanned region 732 .
- the laser light sources produce light pulses for each output pixel and scanning mirror 724 reflects the light pulses as beam 728 traverses the raster pattern 726 .
- Drive circuit 720 also receives a feedback signal from MEMS device 722 .
- the feedback signal from the MEMS device 722 can describe the maximum deflection angle of the mirror, also referred to herein as the amplitude of the feedback signal.
- At least one photodetector 734 is configured to receive a portion of the reflected laser light impacting the over scanned region 732 .
- This photodetector 734 is configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector 110 .
- This feedback signal is provided to the drive circuit 720 , and is used by the drive circuit 720 to accurately control the motion of the scanning mirror 724 .
- drive circuit 720 excites resonant motion of scanning mirror 724 such that the amplitude of the feedback signal is constant. This provides for a constant maximum angular deflection on the fast-scan axis as shown in raster pattern 726 .
- the excitation signal used to excite resonant motion of scanning mirror 724 can include an amplitude and a phase.
- Drive circuit 720 includes feedback circuit(s) that modifies the excitation signal amplitude to keep the feedback signal amplitude substantially constant. Additionally, the drive circuit 720 can modify the excitation signal to control the horizontal phase alignment and vertical position of the raster pattern 726 .
- drive circuit 720 may be implemented in hardware, a programmable processor, or in any combination.
- drive circuit 720 is implemented in an application specific integrated circuit (ASIC).
- ASIC application specific integrated circuit
- some of the faster data path control is performed in an ASIC and overall control is provided by a software programmable microprocessor.
- red, green, and blue laser light sources are shown in FIG. 7 , the various embodiments are not limited by the wavelength of light emitted by the laser light sources.
- non-visible light e.g., infrared light
- visible light is emitted instead of, or in addition to, visible light.
- FIG. 7 illustrates an embodiment with a single MEMS device 722 and a single scanning mirror 724 , that this is just one example implementation.
- a scanning laser projector could instead be implemented with scanning mirror assembly that includes two scanning mirrors, with one mirror configured to deflect along one axis and another mirror configured to deflect along a second axis that is largely perpendicular to the first axis.
- Such an embodiment could include a second MEMS device, a second scanning mirror, and a second drive circuit.
- the first scanning mirror could be configured to generate horizontal scanning motion
- the second scanning mirror configured to generate vertical motion.
- the motion of one scanning mirror determines the horizontal scan amplitude and the motion of the other scanning mirror determines the vertical scan amplitude.
- each of the photodetectors can be configured to generate a feedback signal that is provided to one or more drive circuits (e.g., drive circuit 720 ).
- the feedback signals can then be used by the first drive circuit to control the first scanning mirror and the resulting horizontal scan amplitude, and can be used by the second drive circuit to control the second scanning mirror and the resulting vertical scan amplitude.
- the photodetector(s) can be used to generate feedback signal(s) to facilitate accurate control of the motion of multiple scanning mirrors.
- drive circuit 720 excites resonant motion of scanning mirror 724 such that the amplitude of the feedback signal is constant. This provides for a constant maximum angular deflection on the fast-scan axis as shown in raster pattern 726 .
- the excitation signal used to excite resonant motion of scanning mirror 724 can include an amplitude and a phase.
- Drive circuit 720 includes feedback circuit(s) that modifies the excitation signal amplitude to keep the feedback signal amplitude substantially constant. Additionally, the drive circuit 720 can modify the excitation signal to control the horizontal phase alignment and vertical position of the raster pattern 726 .
- MEMS device 800 includes fixed platform 802 , scanning platform 840 , and scanning mirror 816 .
- Scanning platform 840 is coupled to fixed platform 802 by flexures 810 and 812
- scanning mirror 16 is coupled to scanning platform 840 by flexures 820 and 822 .
- Scanning platform 840 has a drive coil connected to drive lines 850 , which are driven by a drive signal provided from a drive circuit (e.g., drive circuit 720 ).
- a drive circuit e.g., drive circuit 720
- the drive signal includes an excitation signal to excite resonant motion of scanning mirror 816 on the fast-scan axis, and also includes a slow-scan drive signal to cause non-resonant motion of scanning platform 840 on the slow-scan axis.
- Current drive into drive lines 850 produces a current in the drive coil.
- an external magnetic field source (not shown) imposes a magnetic field on the drive coil.
- the magnetic field imposed on the drive coil by the external magnetic field source has a component in the plane of the coil, and is oriented non-orthogonally with respect to the two drive axes.
- the in-plane current in the coil windings interacts with the in-plane magnetic field to produce out-of plane Lorentz forces on the conductors.
- flexures 810 and 812 form a pivot axis.
- Flexures 810 and 812 are flexible members that undergo a torsional flexure, thereby allowing scanning platform 840 to rotate on the pivot axis and have an angular displacement relative to fixed platform 802 .
- Flexures 810 and 812 are not limited to torsional embodiments as shown in FIG. 8 .
- flexures 810 and 812 take on other shapes such as arcs, “S” shapes, or other serpentine shapes.
- the term “flexure” as used herein refers to any flexible member coupling a scanning platform to another platform (scanning or fixed), and capable of movement that allows the scanning platform to have an angular displacement with respect to the other platform.
- Scanning mirror 816 pivots on a first axis formed by flexures 820 and 822 , and pivots on a second axis formed by flexures 810 and 812 .
- the first axis is referred to herein as the horizontal axis or fast-scan axis
- the second axis is referred to herein as the vertical axis or slow-scan axis.
- scanning mirror 816 scans at a mechanically resonant frequency on the horizontal axis resulting in a sinusoidal horizontal sweep. Further, in some embodiments, scanning mirror 816 scans vertically at a nonresonant frequency, so the vertical scan frequency can be controlled independently.
- the MEMS device 800 will also incorporates one or more integrated piezoresistive position sensors.
- piezoresistive sensor 880 can be configured to produces a voltage that represents the displacement of mirror 816 with respect to scanning platform 840 , and this voltage can be provided back to the drive circuit.
- positions sensors are provided on one scan axis while in other embodiments position sensors are provided for both axes.
- the MEMS device 800 is provided as an example, and the various embodiments of the invention are not limited to this specific implementation.
- any scanning mirror capable of sweeping in two dimensions to reflect a light beam in a raster pattern may be incorporated without departing from the scope of the present invention.
- any combination of scanning mirrors e.g., two mirrors: one for each axis
- any type of mirror drive mechanism may be utilized without departing from the scope of the present invention.
- MEMS device 800 uses a drive coil on a moving platform with a static magnetic field, other embodiments may include a magnet on a moving platform with drive coil on a fixed platform.
- the mirror drive mechanism may include an electrostatic drive mechanism.
- scanning laser projectors described above can be implemented in a wide variety of devices and for a wide variety of applications. Several specific examples of these types of devices will not be discussed with reference to FIGS. 9-14 . In each case, the various embodiments described above can be implemented with or as part of such a device.
- mobile device 900 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanning laser projector 100 , scanning laser projector 700 ).
- mobile device 900 includes wireless interface 910 , processor 920 , memory 930 , and scanning laser projector 902 .
- Scanning laser projector 902 includes photodetector(s) configured in an over scanned region signal to provide feedback signal(s) as described above. Scanning laser projector 902 may receive image data from any image source.
- scanning laser projector 902 includes memory that holds still images. In other embodiments, scanning laser projector 902 includes memory that includes video images. In still further embodiments, scanning laser projector 902 displays imagery received from external sources such as connectors, wireless interface 910 , a wired interface, or the like.
- Wireless interface 910 may include any wireless transmission and/or reception capabilities.
- wireless interface 910 includes a network interface card (NIC) capable of communicating over a wireless network.
- NIC network interface card
- wireless interface 910 may include cellular telephone capabilities.
- wireless interface 910 may include a global positioning system (GPS) receiver.
- GPS global positioning system
- Processor 920 may be any type of processor capable of communicating with the various components in mobile device 900 .
- processor 920 may be an embedded processor available from application specific integrated circuit (ASIC) vendors, or may be a commercially available microprocessor.
- ASIC application specific integrated circuit
- processor 920 provides image or video data to scanning laser projector 100 .
- the image or video data may be retrieved from wireless interface 910 or may be derived from data retrieved from wireless interface 910 .
- scanning laser projector 902 may display images or video received directly from wireless interface 910 .
- processor 920 may provide overlays to add to images and/or video received from wireless interface 910 , or may alter stored imagery based on data received from wireless interface 910 (e.g., modifying a map display in GPS embodiments in which wireless interface 910 provides location coordinates).
- mobile device 1000 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanning laser projector 100 , scanning laser projector 700 ).
- Mobile device 1000 may be a hand held scanning laser projector with or without communications ability.
- mobile device 1000 may be a scanning laser projector with little or no other capabilities.
- mobile device 1000 may be a device usable for communications, including for example, a cellular phone, a smart phone, a tablet computing device, a global positioning system (GPS) receiver, or the like.
- GPS global positioning system
- mobile device 1000 may be connected to a larger network via a wireless (e.g., cellular), or this device can accept and/or transmit data messages or video content via an unregulated spectrum (e.g., WiFi) connection.
- a wireless e.g., cellular
- WiFi unregulated spectrum
- Mobile device 1000 includes scanning laser projector 1020 , touch sensitive display 1010 , audio port 1002 , control buttons 1004 , card slot 1006 , and audio/video (A/V) port 1008 . None of these elements are essential. For example, mobile device may only include scanning laser projector 1020 without any of touch sensitive display 1010 , audio port 1002 , control buttons 1004 , card slot 1006 , or A/V port 1008 . Some embodiments include a subset of these elements. For example, an accessory projector may include scanning laser projector 1020 , control buttons 1004 and A/V port 1008 . A smartphone embodiment may combine touch sensitive display device 1010 and projector 1020 .
- Touch sensitive display 1010 may be any type of display.
- touch sensitive display 1010 includes a liquid crystal display (LCD) screen.
- display 1010 is not touch sensitive.
- Display 1010 may or may not always display the image projected by scanning laser projector 1020 .
- an accessory product may always display the projected image on display 1010
- a mobile phone embodiment may project a video while displaying different content on display 1010 .
- Some embodiments may include a keypad in addition to touch sensitive display 1010 .
- A/V port 1008 accepts and/or transmits video and/or audio signals.
- A/V port 1008 may be a digital port, such as a high definition multimedia interface (HDMI) interface that accepts a cable suitable to carry digital audio and video data. Further, A/V port 1008 may include RCA jacks to accept or transmit composite inputs. Still further, A/V port 1008 may include a VGA connector to accept or transmit analog video signals.
- HDMI high definition multimedia interface
- VGA VGA connector
- mobile device 1000 may be tethered to an external signal source through A/V port 1008 , and mobile device 1000 may project content accepted through A/V port 1008 .
- mobile device 1000 may be an originator of content, and A/V port 1008 is used to transmit content to a different device.
- Audio port 1002 provides audio signals.
- mobile device 1000 is a media recorder that can record and play audio and video.
- the video may be projected by scanning laser projector 1020 and the audio may be output at audio port 1002 .
- Mobile device 1000 also includes card slot 1006 .
- a memory card inserted in card slot 1006 may provide a source for audio to be output at audio port 1002 and/or video data to be projected by scanning laser projector 1020 .
- Card slot 1006 may receive any type of solid state memory device, including for example secure digital (SD) memory cards.
- SD secure digital
- head-up display system 1100 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanning laser projector 100 , scanning laser projector 700 ).
- the head-up display system 1100 includes a scanning laser projector 1102 .
- the scanning laser projector 1102 is shown mounted in a vehicle dash to project the head-up display.
- an automotive head-up display is shown in FIG. 11 , this is not a limitation and other applications are possible.
- various embodiments include head-up displays in avionics application, air traffic control applications, and other applications.
- eyewear 1200 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanning laser projector 100 , scanning laser projector 700 ).
- Eyewear 1200 includes scanning laser projector 1202 to project a display in the eyewear's field of view.
- eyewear 1200 is see-through and in other embodiments, eyewear 1200 is opaque.
- eyewear 1200 may be used in an augmented reality application in which a wearer can see the display from projector 1202 overlaid on the physical world.
- eyewear 1200 may be used in a virtual reality application, in which a wearer's entire view is generated by projector 1202 .
- eyewear 1200 includes two projectors 1202 , with one for each eye
- Gaming apparatus 1300 allows a user or users to observe and interact with a gaming environment.
- the game is navigated based on the motion, position, or orientation of gaming apparatus 1300 , an apparatus that includes scanning laser projector 1302 .
- Other control interfaces such as manually-operated buttons, foot pedals, or verbal commands, may also contribute to navigation around, or interaction with the gaming environment.
- trigger 1342 contributes to the illusion that the user or users are in a first person perspective video game environment, commonly known as a “first person shooter game.” Because the size and brightness of the projected display can be controlled by the gaming application in combination with the user's movement, gaming apparatus 1300 creates a highly believable or “immersive” environment for these users.
- Tactile interface 1344 may provide a variety of output signals, such as recoil, vibration, shake, rumble, etc.
- Tactile interface 1344 may also include a touch-sensitive input feature, such as a touch sensitive display screen or a display screen that requires a stylus. Additional tactile interfaces, for example, input and/or output features for a motion sensitive probe are also included in various embodiments of the present invention.
- Gaming apparatus 1300 may also include audio output devices, such as integrated audio speakers, remote speakers, or headphones. These sorts of audio output devices may be connected to gaming apparatus 1300 with wires or through a wireless technology.
- wireless headphones 1346 provide the user with sound effects via a BLUETOOTHTM connection, although any sort of similar wireless technology could be substituted freely.
- wireless headphones 1346 may include microphone 1345 or binaural microphone 1347 , to allow multiple users, instructors, or observers to communicate.
- Binaural microphone 1347 typically includes microphones on each ear piece, to capture sounds modified by the user's head shadow. This feature may be used for binaural hearing and sound localization by other simulation participants.
- Gaming apparatus 1300 may include any number of sensors 1310 that measure ambient brightness, motion, position, orientation, and the like. For example, gaming apparatus 1300 may detect absolute heading with a digital compass, and detect relative motion with an x-y-z gyroscope or accelerometer. In some embodiments, gaming apparatus 1300 also includes a second accelerometer or gyroscope to detect the relative orientation of the device, or its rapid acceleration or deceleration. In other embodiments, gaming apparatus 1300 may include a Global Positioning Satellite (GPS) sensor, to detect absolute position as the user travels in terrestrial space.
- GPS Global Positioning Satellite
- Gaming apparatus 1300 may include battery 1341 and/or diagnostic lights 1343 .
- battery 1341 may be a rechargeable battery, and diagnostic lights 1343 could indicate the current charge of the battery.
- battery 1341 may be a removable battery clip, and gaming apparatus 1300 may have an additional battery, electrical capacitor or super-capacitor to allow for continued operation of the apparatus while the discharged battery is replaced with a charged battery.
- diagnostic lights 1343 can inform the user or a service technician about the status of the electronic components included within or connected to this device.
- diagnostic lights 1343 may indicate the strength of a received wireless signal, or the presence or absence of a memory card.
- Diagnostic lights 1343 could also be replaced by any small screen, such as an organic light emitting diode or liquid crystal display screen. Such lights or screens could be on the exterior surface of gaming apparatus 1300 , or below the surface, if the shell for this apparatus is translucent or transparent.
- Other components of gaming apparatus 1300 may be removable, detachable or separable from this device.
- scanning laser projector 1302 may be detachable or separable from gaming housing 1389 .
- the subcomponents of scanning laser projector 100 may be detachable or separable from gaming housing 1389 , and still function.
- Gaming apparatus 1400 includes buttons 1404 , display 1410 , and projector 1402 .
- gaming apparatus 1400 is a standalone apparatus that does not need a larger console for a user to play a game. For example, a user may play a game while watching display 1410 and/or the projected content.
- gaming apparatus 1400 operates as a controller for a larger gaming console. In these embodiments, a user may watch a larger screen tethered to the console in combination with watching display 1410 and/or projected content.
- a scanning laser projector comprising: at least one source of laser light; a scanning mirror configured to reflect the laser light; a perimeter defining an image region inside the perimeter and an over scanned region outside the perimeter, the image region and over scanned region configured to receive the reflected laser light; a photodetector configured to receive a portion of the reflected laser light impacting the over scanned region outside the perimeter, the photodetector further configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector; and a drive circuit configured to provide an excitation signal to excite motion of the scanning mirror, the drive circuit configured to modify the excitation signal in response to the feedback signal.
- a method comprising: A method comprising: controlling motion of a scanning mirror to reflect laser light in a pattern across an image region inside a perimeter and across an over scanned region outside the perimeter; detecting a portion of the reflected laser light in the over scanned region; providing a feedback signal responsive to the detected portion of the reflected laser light; and modify the motion of the scanning mirror in response to the feedback signal.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Immunology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Pathology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Mechanical Optical Scanning Systems (AREA)
- Mechanical Light Control Or Optical Switches (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
A scanning projector and method is provided that generates a feedback signal from at least one photodetector. In the scanning projector, a scanning mirror is configured to reflect laser light into an image region and an over scanned region. The at least one photodetector is configured to receive a portion of the reflected laser light impacting the over scanned region, and provides the feedback signal responsive to the received portion of light. This feedback signal can then be used to provide precise control of the scanning mirror.
Description
- The present disclosure generally relates to projectors, and more particularly relates to scanning projectors.
- In scanning projectors, pixels are typically generated by modulating light from laser light sources as a scanning mirror scans the modulated light in a raster pattern. This use of a scanning mirror to scan the modulated light requires relatively precise control of the scanning mirror. Specifically, the physical motion of the scanning must be precisely controlled to facilitate an accurate scan of the modulated light in the raster pattern. Unfortunately, previous techniques for monitoring and controlling the physical motion of the scanning mirror can be insufficiently precise for some scanning projector applications.
-
FIG. 1 shows a schematic diagram of a scanning laser projector in accordance with various embodiments of the present invention; -
FIG. 2 shows a schematic diagram of portion of an exemplary image region and over scanned region in accordance with various embodiments of the present invention; -
FIG. 3 shows a schematic diagram of portion of an exemplary image region and over scanned region in accordance with various embodiments of the present invention; -
FIG. 4 shows a schematic diagram of an exemplary image region and over scanned region in accordance with various embodiments of the present invention; -
FIG. 5 shows an exemplary device that includes a microlens array in accordance with various embodiments of the present invention; -
FIG. 6 shows an exemplary device that includes a projector in accordance with various embodiments of the present invention; -
FIG. 7 shows a schematic view of a scanning laser projector in accordance with various embodiments of the present invention; -
FIG. 8 shows a plan view of a microelectromechanical system (MEMS) device with a scanning mirror in accordance with various embodiments of the present invention; -
FIG. 9 shows a block diagram of a mobile device in accordance with various embodiments of the present invention; -
FIG. 10 shows a perspective view of a mobile device in accordance with various embodiments of the present invention; -
FIG. 11 shows a perspective view of a head-up display system in accordance with various embodiments of the present invention; -
FIG. 12 shows a perspective view of eyewear in accordance with various embodiments of the present invention; -
FIG. 13 shows a perspective view of a gaming apparatus in accordance with various embodiments of the present invention; and -
FIG. 14 shows a perspective view of a gaming apparatus in accordance with various embodiments of the present invention. - In the following detailed description, reference is made to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It is to be understood that the various embodiments of the invention, although different, are not necessarily mutually exclusive. For example, a particular feature, structure, or characteristic described herein in connection with one embodiment may be implemented within other embodiments without departing from the scope of the invention. In addition, it is to be understood that the location or arrangement of individual elements within each disclosed embodiment may be modified without departing from the scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, appropriately interpreted, along with the full range of equivalents to which the claims are entitled. In the drawings, like numerals refer to the same or similar functionality throughout the several views.
- In general, the embodiments described herein provide a scanning projector that uses at least one photodetector to generate a feedback signal, and uses the feedback signal to control a scanning mirror in the projector. In the scanning projector the scanning mirror is configured to reflect light into an image region and an over scanned region. The at least one photodetector is configured to receive a portion of the reflected light impacting the over scanned region, and provides the feedback signal responsive to the received portion of light. This feedback signal can then be used to provide precise control of the scanning mirror, and thus can provide improved performance in the scanning projector. As one example, this feedback signal can be used to compensate for variations in the operational environment, such as temperature changes, source voltage changes, etc. If such operational environment changes are not compensated for they could otherwise cause inaccuracies in the control of the scanning mirror, and result in unacceptable degradations in the image quality produced by the scanning projector.
- Turning now to
FIG. 1 , a schematic diagram of ascanning laser projector 100 is illustrated. Thescanning laser projector 100 includes alaser light source 102, scanning mirror(s) 104, and adrive circuit 106. During operation, thelaser light source 102 provides laser light that is encoded with pixel data to generate image pixels that are to be projected by thescanning laser projector 100. To facilitate this, thedrive circuit 106 controls the movement of the scanning mirror(s) 104. Specifically, thedrive circuit 106 provides excitation signal(s) to excite motion of the scanning mirror(s) 104. - The scanning mirror(s) 104 reflect the laser light into an
image region 112 and an over scannedregion 114, where theimage region 112 is defined by aperimeter 116. Specifically, during operation of thescanning light projector 100, the scanning mirror(s) 104 are controlled by thedrive circuit 104 to reflect the laser light into araster pattern 118, with theraster pattern 118 covering theimage region 112 and extending into the over scannedregion 114. - In accordance with the embodiments described herein, at least one
photodetector 110 is configured to receive a portion of the reflected laser light impacting the over scannedregion 114. Thisphotodetector 110 is configured to provide a feedback signal responsive to the portion of the reflected laser light received by thephotodetector 110. This feedback signal is provided to thedrive circuit 106, and is used by thedrive circuit 106 to accurately control the motion of the scanning mirror(s) 104. Specifically, in one embodiment thedrive circuit 106 modifies the excitation signal in response to the feedback signal, thus facilitating precise control of the motion of the scanning mirror(s) 104. Such precise control of the scanning mirror(s) 104 can facilitate improved image quality, and can further facilitate new usages and applications for thescanning laser projector 100. - In some embodiments, the feedback signal indicates the timing of various scans in the
raster pattern 118 impacting thephotodetectors 110. For example, the feedback signal can indicate a photodetector entry time corresponding to when the reflected laser light first impacts thephotodetector 110 during a particular horizontal scan, and likewise indicates a photodetector exit time corresponding to when the reflected laser light last impacts thephotodetector 110 during that same horizontal scan. - To facilitate precise control the
scanning mirrors 104 by thedrive circuit 106, the feedback signal can be used to determine and control various operational parameters of thescanning mirrors 104. For example, the feedback signal can be used to determine and control the horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude of thescanning mirrors 104 and resultingraster pattern 118. - In general, the horizontal scan amplitude is a measure of the horizontal sweep of the
raster pattern 118. In the embodiments described herein, the horizontal scan amplitude can be calculated using the timing of the laser light hitting thephotodetectors 110, the position of thephotodetectors 110, and the frequency of the horizontal scanning. The horizontal phase alignment is likewise a measure of horizontal position of theraster pattern 118. Such a horizontal phase alignment can be calculated using the feedback signal by determining a timing difference between left and right sweeping scans in theraster pattern 118. The vertical scan amplitude is likewise a measure of the vertical sweep of theraster pattern 118. The vertical scan amplitude can be calculated using the feedback signal by determining the number of scans crossing thephotodetector 110. Detailed examples of such embodiments will be described in greater detail below. - The
image region 112 andperimeter 116 can be implemented and defined in various ways. For example, in some embodiments, theimage region 112 can be defined by an opening surrounded by a border fixture or by a microlens array (MLA). Examples of such embodiments will be described in greater detail below with reference toFIGS. 5 and 6 . - In some embodiments, an optical waveguide can used to direct light to the
photodetector 110. In such an embodiment, the waveguide can be coupled between thephotodetector 110 and an aperture that is positioned proximate to theperimeter 116 such that the aperture receives the portion of the reflected laser light impacting the over scannedregion 114 and the optical waveguide transmits the portion of the reflected light to thephotodetector 110. Furthermore, in such embodiments the aperture and/or waveguide can be implemented together with the border fixture or MLA defining theperimeter 116. - In some embodiments, the
photodetector 110 can be positioned off axis relative to the horizontal scan direction of the reflected laser light. In such an embodiment, the horizontal scan of the reflected laser light will cross the photodetector at a non-orthogonal angle. As will be described in greater detail below, such an embodiment can be used to determine a precise vertical position of a particular horizontal scan. - In some embodiments,
multiple photodetectors 110 can be implemented. For example, asecond photodetector 110 can be configured to receive a second portion of the reflected laser light impacting the over scannedregion 114. Such asecond photodetector 110 can be configured to provide a second feedback signal responsive to the second portion of the reflected laser light impacting thesecond photodetector 110. As will be described below, such embodiments can be used to provide additional accuracy and precision to thedrive circuit 106. In one such embodiment, thefirst photodetector 110 can be positioned proximate to a horizontal edge of theperimeter 116, while thesecond photodetector 110 is positioned proximate to a vertical edge of theperimeter 116. - A variety of devices can be used as the
photodetector 110. Examples of such devices include silicon photodiodes, phototransistors, or other photosensitive devices, including other photosensitive semiconductor devices. In a typical embodiment, thephotodetector 110 can be dimensionally small relative to the horizontal scan amplitude. For example, thephotodetector 110 can have a sensor width of about 6% the horizontal scan amplitude. However, this is just one example, and devices of other sizes can be used. - It should be noted that in the description of the various embodiments herein, the distinction between vertical and horizontal is somewhat arbitrary, since a rotation of the
scanning laser projector 100 will cause a rotation of the two axes. Accordingly, the various embodiments of the present invention are not to be limited by the terms “horizontal” and “vertical”. - Turning now to
FIG. 2 , a schematic diagram of portion of anexemplary image region 212 and over scannedregion 214 is illustrated. Like the embodiment ofFIG. 1 , pixel-modulated laser light is reflected by one or more scanning mirrors into araster pattern 218. Also like the embodiment ofFIG. 1 , theraster pattern 218 is projected intoimage region 212 and extends into the over scannedregion 214. The scanning of pixel-modulated laser light into theraster pattern 218 generates an image in the area corresponding to theimage region 212. - It should again be noted that the
raster pattern 218 is not illustrated to scale. For example, atypical raster pattern 218 would include a significantly greater number of horizontal scan lines, with the number of horizontal scan lines corresponding to a vertical scan rate in theraster pattern 218. Additionally, the line illustrating theraster pattern 218 does not represent the actual size of the laser beam creating theraster pattern 218. -
FIG. 2 shows an expanded view of aphotodetector 216 positioned in the over scannedregion 214 to more clearly indicate how the reflected laser light can be detected by thephotodetector 216 and used to generate a feedback signal. Specifically, in this illustrated embodiment the reflected laser light impacts the sensing region ofphotodetector 216 at T1, as indicated inFIG. 2 . As the scan continues, the reflected laser light exits thephotodetector 216 at T2. T1 and T2 thus correspond to a photodetector entry time and photodetector exit time. This process continues in the next horizontal scan. Specifically, the reflected laser light again impacts sensing region of thephotodetector 216 at T3 and then again exits the photodetector at T4. T3 and T4 thus correspond to a second photodetector entry time and second photodetector exit time. Finally, the reflected light again impacts the sensing region at T5 and exits at T6. - The output of the
photodetector 216 during these times can be used to generate a corresponding feedback signal. By detecting these entry and exit times and providing such information in a feedback signal, thephotodetector 216 can be used to provide for enhanced feedback control. For example, the feedback signal can be used to determine horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude, and provide feedback control of the mirrors based on one or more of those parameters. - Specifically, knowing the frequency of the horizontal scan, the position and sensing width of the
photodetector 216, and the entry and exit times of a horizontal scan a precise determination of the horizontal scan amplitude can be calculated and controlled. For example, in a device that uses a MEMS mirror the motion of the mirror is sinusoidal to very high fidelity. In such an embodiment, the trigonometric relationship can be used to very precisely calculate the horizontal amplitude of the sinusoidal motion. With such a calculation performed, the drive circuit (e.g., drive circuit 106) can use the horizontal scan amplitude for feedback control of the scanning mirrors (e.g., scanning mirrors 104). - It should be noted that such a calculation can be performed with feedback data from only one scan hitting the
photodetector 216. Thus, T1 and T2 are sufficient to calculate the horizontal scan amplitude. However, multiple crossings of the photodetector can be used to improve accuracy. In such a case, the data from additional entry and exit times (e.g., the times of T1, T2, T3 and T4) can be averaged or otherwise combined together to provide greater accuracy in the horizontal scan amplitude measurement. - A feedback signal generated from the
photodetector 216 can also be used to determine the horizontal phase alignment, where the horizontal phase alignment defines the horizontal position in time of theraster pattern 218. In such an embodiment the timing difference between the left and right sweeping scans can be calculated and used to determine horizontal phase alignment. For example, the time between T2 and T3 corresponds to the time of a left sweeping scan between those points. Likewise, the time between T4 and T5 corresponds to the time of a right sweeping scan between those points. The time difference between the left sweeping scan and the right sweeping scan can be calculated. This time difference, along with the known position of the photodetector can be used to determine the horizontal phase alignment of theraster pattern 218. With such a calculation performed, the horizontal phase alignment can be used to correct the timing of the laser light source (e.g., laser light source 102) to provide precise alignment between the pixels generated by the laser light source and the scanning mirrors (e.g., scanning mirrors 104). - Specifically, a feedback signal generated from the
photodetector 216 can be used to control the pixel alignment relative to the horizontal scan position. In such an embodiment, the feedback signal or data derived from the feedback signal can be provided to a pixel drive generator or other such element coupled to the laser light source. The feedback signal can then be used to control the laser light and provide pixel alignment of the laser light with the scanning mirror. In this embodiment the position of the pixel being generated by the laser light source can be precisely controlled and thus precisely aligned. In one application, such an embodiment can be used to ensure that pixels are aligned with lensets in the microlens array. A description of such an embodiment will be described in greater detail below. - A feedback signal generated from the
photodetector 216 can also be used to determine the vertical scan amplitude of theraster pattern 218. For example, the vertical scan amplitude can be determined by counting the number of sweeps that occur across thephotodetector 216 during an image frame. In one example, the vertical scan amplitude can be adjusted by the drive circuit such that a specified number of sweeps cross thephotodetector 216. - Turning now to
FIG. 3 , a schematic diagram of portion of anexemplary image region 312 and over scannedregion 214 is illustrated. Like the embodiment ofFIGS. 1 and 2 , pixel-modulated laser light is reflected by one or more scanning mirrors into araster pattern 318. Thisraster pattern 218 is projected into theimage region 312 and extends into the over scannedregion 314. -
FIG. 3 again shows an expanded view of aphotodetector 316 positioned in the over scannedregion 314. In this embodiment, thephotodetector 316 is positioned off-axis relative to the horizontal scan direction of the reflected laser light. This off-axis position causes the horizontal scan of the reflected laser light to cross thephotodetector 316 at a non-orthogonal angle relative to thephotodetector 316. - In this illustrated embodiment, the reflected laser light impacts the sensing region of
photodetector 316 at T1. As the scan continues, the reflected laser light exits thephotodetector 316 at T2. T1 and T2 thus correspond to a photodetector entry time and photodetector exit time. This process continues in the next horizontal scan. Specifically, the reflected laser light again impacts sensing region of thephotodetector 316 at T3 and then again exits the photodetector at T4. T3 and T4 thus correspond to a second photodetector entry time and second photodetector exit time. - Like the embodiment illustrated in
FIG. 2 , thephotodetector 316 and the entry and exit times can be used to determine and control the horizontal scan amplitude, horizontal phase alignment, and/or vertical scan amplitude. For example, these parameters can be calculated and used for feedback control using the various techniques described above with reference toFIG. 2 . - Furthermore, the off-axis arrangement of the
photodetector 316 further facilitates precise determination of the vertical position of a scan impacting the end of thephotodetector 316. The precise determination of the vertical position of scan can be calculated using by determining the entry time and exit time of scan that crosses a bottom corner of thephotodetector 316. For example, the time between T3 and T1 can be used to determine where along the bottom of thephotodetector 316 the scan crossed. Notably, as a scan moves up in this bottom corner of thephotodetector 316, the portion of thephotodetector 316 crossed by the scan becomes wider. Conversely, as the scan moves down, the portion of thephotodetector 316 crossed by the scan becomes narrower. - This difference in the portion of the
photodetector 316 crossed by the scan at different vertical positions can be used to accurately determine the vertical position of a particular scan. Specifically, by calculating the time between T3 and T4, and knowing the frequency of the horizontal scan and the position of thephotodetector 316, the precise vertical position of the scan impacting the off-axis bottom edge of thephotodetector 316 can be determined. A feedback signal generated from thephotodetector 316 can thus be used by the drive circuit adjust the scanning mirrors and resulting vertical position of theraster scan 318. - In another embodiment, the amplitude of the output of the
photodetector 316 generated during a scan crossing can be measured and used to determine vertical position of the scan. In such an embodiment, the larger the portion of thephotodetector 316 that is crossed by the scan, the higher the amplitude of thephotodetector 316 output and vice versa. - Turning now to
FIG. 4 , a schematic diagram of anexemplary image region 412 and over scannedregion 414 is illustrated, with theimage region 412 defined by aperimeter 416. Like the embodiment ofFIG. 1 , pixel-modulated laser light is reflected by one or more scanning mirrors into araster pattern 418. - In accordance with the embodiments described herein,
photodetectors region 414. Each of thephotodetectors raster pattern 418. - In the embodiment of
FIG. 4 the various photodetectors are arranged in locations that together provide effective information for feedback control of the scanning mirrors. It should be first noted thatphotodetectors perimeter 416. Conversely,photodetectors perimeter 416. - Furthermore, the photodetectors are positioned at locations that correspond to different horizontal scan amplitudes. In
FIG. 4 , theline 434 represents the center of the horizontal scan path, and thus theline 434 represents a location where a horizontal scan is at zero amplitude. Likewise,line 436 represents a midpoint to the maximum horizontal scan amplitude, and thus represents a location where the horizontal scan amplitude is at 50% of maximum. Likewise,lines - It should be noted that these locations of different scan amplitude also have corresponding different rates of motion. Specifically, the rate of motion in the scanning mirror (and in the resulting
raster pattern 418 is higher near the center of the horizontal scan path and decreases as the amplitude increases. Furthermore, it should be noted that positioning photodetectors at areas of higher horizontal scan amplitude facilitates improved horizontal scan amplitude, while positioning photodetectors at areas of lower horizontal scan amplitude facilitates improved horizontal phase determination. - In this illustrated embodiment,
photodetector 424 is arranged to detect the reflected light at approximately zero horizontal scan amplitude,photodetector 422 is arranged to detect the reflected light at approximately 50% of the horizontal scan amplitude,photodetector 420 is arranged to detect the reflected light at approximately 90% of the horizontal scan amplitude, andphotodetector 426 is arranged to detect the reflected light at approximately 95% of the horizontal scan amplitude. - Thus, in the example of
FIG. 4 ,photodetectors photodetector 424 could be configured and used to determine horizontal phase alignment based on its position at the center of the horizontal scan. Thephotodetector 422 at midpoint of the horizontal scan amplitude provides a compromise position that could be effectively used for both horizontal scan amplitude determination and horizontal phase alignment determination. - As was describe above, the image region and over scanned region can be defined and implemented in a variety of ways. For example, the image region can be implemented to include a microlens array. In general, microlens arrays are optical devices that include an arrangement of micro-lenses, commonly referred to as lenslets. Such microlens arrays can be fabricated from a variety of materials and with a variety of techniques. Microlens arrays can include one or two dimensional arrangements of lenslets formed on or with a supporting substrate. The individual lenslets can have apertures of different shapes, including circular and hexagonal. Microlens arrays can be used in a variety of applications, including eyewear and head-up displays (HUD). Examples of such applications will be discussed below.
- Turning now to
FIG. 5 , anexemplary device 500 includes a microlens array (MLA) 502, where theMLA 502 defines animage region 512, an over scannedregion 514, and aperimeter 516. TheMLA 502 includes a plurality oflenslets 522. During operation, the plurality oflenslets 522 receives the reflected laser light in theimage region 512 and optically delivers the light in a form that can be used to generate an image. - In accordance with the embodiments described herein, a
photodetector 510 is configured to receive a portion of the reflected laser light impacting the over scannedregion 514. In this embodiment, this arrangement is provided by usingoptical waveguides 518. Specifically, eachoptical waveguides 518 is coupled between thephotodetector 510 and acorresponding aperture 520. Theapertures 520 are positioned proximate to theperimeter 516 such that the eachaperture 520 receives a portion of the reflected laser light impacting the over scannedregion 514 and the correspondingoptical waveguide 518 transmits the portion of the reflected light to thephotodetector 510. - Such an arrangement allows one
photodetector 510 to detect reflected light impacting the over scannedregion 514 at multiple locations. Such an arrangement is possible because the scanning of the reflected laser light is such that the light hits only one location at a time. Thus, onephotodetector 510 can be used to provide a feedback signal responsive to the light impacting at multiple locations in the over scannedregion 514. - It should be noted that while
FIG. 5 illustrates thephotodetector 510 inside the over scannedregion 514 that in other embodiments the use of theoptical waveguides 520 can facilitate the placement of the photodetector outside the overs scanned region. In some applications the placement of thephotodetector 510 is limited only by the effective transmission ability of theoptical waveguides 518. - The
optical waveguides 518 can be implemented with a variety of structures and devices. As one example, theoptical waveguides 518 can implemented with optical fibers, where the optical fibers are arranged to extend from theapertures 520 to thephotodetector 510. In other embodiments theoptical waveguides 518 can be implemented with strip waveguides, rectangular waveguides, rib waveguides, and segmented waveguides, to list a few non-limiting examples. - In one embodiment, the
optical waveguides 518 can be implemented as part of theMLA 512. Specifically, theoptical waveguides 518 could be formed with or otherwise integrated with theMLA 512. For example, theoptical waveguides 518 could be fabricated with theMLA 512 as part of the fabrication process used to form theMLA 512. - It should be noted that in some applications the use of an
MLA 512 can require precise pixel alignment relative to theMLA 512. Specifically, depending on the size and arrangement of the lenslets in theMLA 512, it can be required to ensure that each pixel is generated by the laser light source at a time in the horizontal scan that accurately corresponds to the position of aparticular lenslet 522 in the array. This helps ensure that each pixels hits theappropriate lenslet 522 in theMLA 512. A feedback signal generated from the photodetector can be used to control the pixel alignment relative to the horizontal scan position and ensure such a proper pixel alignment. In such an embodiment the feedback signal or data derived from the feedback signal can be provided to a pixel drive generator and used to control the at least one source of laser light to provide pixel alignment of the laser light with the scanning mirror. - Another way in which the image region and overs canned region can be defined is with a border fixture. In such an embodiment, the border fixture defines an opening, where the opening resides in a virtual plane through which the reflected light in the image region passes. Such an arrangement can be used in a variety of applications, including scanning projectors. Examples of such applications will be discussed below.
- Turning now to
FIG. 6 , anexemplary device 600 includes aprojector 602, aborder fixture 604, andsystem optics 606. Note that inFIG. 6 both a side view of a front view of theborder fixture 604 are illustrated. Theborder fixture 604 defines animage region 612, an over scannedregion 614, and aperimeter 616. Theborder fixture 604 defines anopening 622. As configured, theopening 622 resides in a virtual plane represented byline 624. During operation light outputted by theprojector 602 passes through theopening 622 at the virtual plane and impacts thesystem optics 606. - In accordance with the embodiments described herein, a
photodetector 610 is configured to receive a portion of the reflected laser light impacting the over scannedregion 614. In this embodiment, this arrangement is provided by usingoptical waveguides 618. Specifically, eachoptical waveguide 618 is coupled between thephotodetector 610 and acorresponding aperture 620. Theapertures 620 are positioned proximate to theperimeter 616 such that the eachaperture 620 receives a portion of the reflected laser light impacting the over scannedregion 614 and the correspondingoptical waveguide 618 transmits the portion of the reflected light to thephotodetector 610. - Turning now to
FIG. 7 , a schematic view of ascanning laser projector 700 is illustrated. Thescanning laser projector 700 is an example of the type of system that can be used in accordance with various embodiments of the present invention.Scanning laser projector 700 includes animage processing component 702, apixel drive generator 704, ared laser module 706, agreen laser module 708, and ablue laser module 710. Light from the laser modules is combined withdichroics 712, 714, and 716.Scanning laser projector 700 also includesfold mirror 718,drive circuit 720, andMEMS device 722 withscanning mirror 724. - In operation,
image processing component 702 processes video content at using two dimensional interpolation algorithms to determine the appropriate spatial image content for each scan position at which an output pixel is to be displayed by the pixel drive generator. For example, the video content may represent a grid of pixels at any resolution (e.g., 640×480, 848×480, 1280×720, 1920×1080). The input light intensity encoding typically represents the light intensity in 8, 10, 12 bit or higher resolutions. - This content is then mapped to a commanded current for each of the red, green, and blue laser sources such that the output intensity from the lasers is consistent with the input image content. In some embodiments, this process occurs at output pixel rates in excess of 150 MHz. The laser beams are then directed onto an ultra-high speed gimbal mounted 2 dimensional bi-axial
laser scanning mirror 724. In some embodiments, this bi-axial scanning mirror is fabricated from silicon using MEMS processes. The vertical axis of rotation is operated quasi-statically and creates a vertical sawtooth raster trajectory. The vertical axis is also referred to as the slow-scan axis. The horizontal axis is operated on a resonant vibrational mode of the scanning mirror. In some embodiments, the MEMS device uses electromagnetic actuation, achieved using a miniature assembly containing the MEMS die and small subassemblies of permanent magnets and an electrical interface, although the various embodiments are not limited in this respect. For example, some embodiments employ electrostatic or piezoelectric actuation. Any type of mirror actuation may be employed without departing from the scope of the present invention. - The horizontal resonant axis is also referred to as the fast-scan axis. In some embodiments,
raster pattern 726 is formed by combining a sinusoidal component on the horizontal axis and a sawtooth component on the vertical axis. In these embodiments,output beam 728 sweeps back and forth left-to-right in a sinusoidal pattern, and sweeps vertically (top-to-bottom) in a sawtooth pattern with the display blanked during flyback (bottom-to-top). - It should be noted that
FIG. 7 illustrates the sinusoidal pattern as the beam sweeps vertically top-to-bottom, but does not show the flyback from bottom-to-top. In other embodiments, the vertical sweep is controlled with a triangular wave such that there is no flyback. In still further embodiments, the vertical sweep is sinusoidal. The various embodiments of the invention are not limited by the waveforms used to control the vertical and horizontal sweep or the resultingraster pattern 726. - The
drive circuit 720 provides a drive signal toMEMS device 722. The drive signal includes an excitation signal to control the resonant angular motion ofscanning mirror 724 on the fast-scan axis, and also includes slow scan drive signal to cause deflection on the slow-scan axis. The resulting mirror deflection on both the fast and slow-scan axes causesoutput beam 728 to generate araster scan 726 in both animage region 730 and an over scannedregion 732. In operation, the laser light sources produce light pulses for each output pixel andscanning mirror 724 reflects the light pulses asbeam 728 traverses theraster pattern 726.Drive circuit 720 also receives a feedback signal fromMEMS device 722. The feedback signal from theMEMS device 722 can describe the maximum deflection angle of the mirror, also referred to herein as the amplitude of the feedback signal. - In accordance with the embodiments described herein, at least one
photodetector 734 is configured to receive a portion of the reflected laser light impacting the over scannedregion 732. Thisphotodetector 734 is configured to provide a feedback signal responsive to the portion of the reflected laser light received by thephotodetector 110. This feedback signal is provided to thedrive circuit 720, and is used by thedrive circuit 720 to accurately control the motion of thescanning mirror 724. - In operation,
drive circuit 720 excites resonant motion ofscanning mirror 724 such that the amplitude of the feedback signal is constant. This provides for a constant maximum angular deflection on the fast-scan axis as shown inraster pattern 726. The excitation signal used to excite resonant motion ofscanning mirror 724 can include an amplitude and a phase.Drive circuit 720 includes feedback circuit(s) that modifies the excitation signal amplitude to keep the feedback signal amplitude substantially constant. Additionally, thedrive circuit 720 can modify the excitation signal to control the horizontal phase alignment and vertical position of theraster pattern 726. - To facilitate this, drive
circuit 720 may be implemented in hardware, a programmable processor, or in any combination. For example, in some embodiments,drive circuit 720 is implemented in an application specific integrated circuit (ASIC). Further, in some embodiments, some of the faster data path control is performed in an ASIC and overall control is provided by a software programmable microprocessor. - Although red, green, and blue laser light sources are shown in
FIG. 7 , the various embodiments are not limited by the wavelength of light emitted by the laser light sources. For example, in some embodiments, non-visible light (e.g., infrared light) is emitted instead of, or in addition to, visible light. - It should be noted that while
FIG. 7 illustrates an embodiment with asingle MEMS device 722 and asingle scanning mirror 724, that this is just one example implementation. As another example, a scanning laser projector could instead be implemented with scanning mirror assembly that includes two scanning mirrors, with one mirror configured to deflect along one axis and another mirror configured to deflect along a second axis that is largely perpendicular to the first axis. - Such an embodiment could include a second MEMS device, a second scanning mirror, and a second drive circuit. The first scanning mirror could be configured to generate horizontal scanning motion, and the second scanning mirror configured to generate vertical motion. Thus, the motion of one scanning mirror determines the horizontal scan amplitude and the motion of the other scanning mirror determines the vertical scan amplitude.
- In such an embodiment, each of the photodetectors (e.g.,
photodetector 734 ofFIG. 7 ) can be configured to generate a feedback signal that is provided to one or more drive circuits (e.g., drive circuit 720). The feedback signals can then be used by the first drive circuit to control the first scanning mirror and the resulting horizontal scan amplitude, and can be used by the second drive circuit to control the second scanning mirror and the resulting vertical scan amplitude. Thus, the photodetector(s) can be used to generate feedback signal(s) to facilitate accurate control of the motion of multiple scanning mirrors. - In operation,
drive circuit 720 excites resonant motion ofscanning mirror 724 such that the amplitude of the feedback signal is constant. This provides for a constant maximum angular deflection on the fast-scan axis as shown inraster pattern 726. The excitation signal used to excite resonant motion ofscanning mirror 724 can include an amplitude and a phase.Drive circuit 720 includes feedback circuit(s) that modifies the excitation signal amplitude to keep the feedback signal amplitude substantially constant. Additionally, thedrive circuit 720 can modify the excitation signal to control the horizontal phase alignment and vertical position of theraster pattern 726. - Turning now to
FIG. 8 , a plan view of a microelectromechanical system (MEMS) device with a scanning mirror is illustrated.MEMS device 800 includes fixedplatform 802,scanning platform 840, andscanning mirror 816.Scanning platform 840 is coupled to fixedplatform 802 byflexures 810 and 812, and scanning mirror 16 is coupled toscanning platform 840 byflexures Scanning platform 840 has a drive coil connected to drivelines 850, which are driven by a drive signal provided from a drive circuit (e.g., drive circuit 720). The drive signal includes an excitation signal to excite resonant motion ofscanning mirror 816 on the fast-scan axis, and also includes a slow-scan drive signal to cause non-resonant motion ofscanning platform 840 on the slow-scan axis. Current drive intodrive lines 850 produces a current in the drive coil. In operation, an external magnetic field source (not shown) imposes a magnetic field on the drive coil. The magnetic field imposed on the drive coil by the external magnetic field source has a component in the plane of the coil, and is oriented non-orthogonally with respect to the two drive axes. The in-plane current in the coil windings interacts with the in-plane magnetic field to produce out-of plane Lorentz forces on the conductors. Since the drive current forms a loop onscanning platform 840, the current reverses sign across the scan axes. This means the Lorentz forces also reverse sign across the scan axes, resulting in a torque in the plane of and normal to the magnetic field. This combined torque produces responses in the two scan directions depending on the frequency content of the torque. - The long axis of
flexures 810 and 812 form a pivot axis.Flexures 810 and 812 are flexible members that undergo a torsional flexure, thereby allowingscanning platform 840 to rotate on the pivot axis and have an angular displacement relative to fixedplatform 802.Flexures 810 and 812 are not limited to torsional embodiments as shown inFIG. 8 . For example, in some embodiments,flexures 810 and 812 take on other shapes such as arcs, “S” shapes, or other serpentine shapes. The term “flexure” as used herein refers to any flexible member coupling a scanning platform to another platform (scanning or fixed), and capable of movement that allows the scanning platform to have an angular displacement with respect to the other platform. -
Scanning mirror 816 pivots on a first axis formed byflexures flexures 810 and 812. The first axis is referred to herein as the horizontal axis or fast-scan axis, and the second axis is referred to herein as the vertical axis or slow-scan axis. In some embodiments, scanningmirror 816 scans at a mechanically resonant frequency on the horizontal axis resulting in a sinusoidal horizontal sweep. Further, in some embodiments, scanningmirror 816 scans vertically at a nonresonant frequency, so the vertical scan frequency can be controlled independently. - In a typical embodiment the
MEMS device 800 will also incorporates one or more integrated piezoresistive position sensors. For example,piezoresistive sensor 880 can be configured to produces a voltage that represents the displacement ofmirror 816 with respect toscanning platform 840, and this voltage can be provided back to the drive circuit. Furthermore, in some embodiments, positions sensors are provided on one scan axis while in other embodiments position sensors are provided for both axes. - It should be noted that the
MEMS device 800 is provided as an example, and the various embodiments of the invention are not limited to this specific implementation. For example, any scanning mirror capable of sweeping in two dimensions to reflect a light beam in a raster pattern may be incorporated without departing from the scope of the present invention. Also for example, any combination of scanning mirrors (e.g., two mirrors: one for each axis) may be utilized to reflect a light beam in a raster pattern. Further, any type of mirror drive mechanism may be utilized without departing from the scope of the present invention. For example, althoughMEMS device 800 uses a drive coil on a moving platform with a static magnetic field, other embodiments may include a magnet on a moving platform with drive coil on a fixed platform. Further, the mirror drive mechanism may include an electrostatic drive mechanism. - The scanning laser projectors described above (e.g., scanning
laser projector 100 ofFIG. 1 ) can be implemented in a wide variety of devices and for a wide variety of applications. Several specific examples of these types of devices will not be discussed with reference toFIGS. 9-14 . In each case, the various embodiments described above can be implemented with or as part of such a device. - Turning to
FIG. 9 , a block diagram of amobile device 900 in accordance with various embodiments is illustrated. Specifically,mobile device 900 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanninglaser projector 100, scanning laser projector 700). As shown inFIG. 9 ,mobile device 900 includeswireless interface 910,processor 920,memory 930, andscanning laser projector 902.Scanning laser projector 902 includes photodetector(s) configured in an over scanned region signal to provide feedback signal(s) as described above.Scanning laser projector 902 may receive image data from any image source. - For example, in some embodiments,
scanning laser projector 902 includes memory that holds still images. In other embodiments,scanning laser projector 902 includes memory that includes video images. In still further embodiments,scanning laser projector 902 displays imagery received from external sources such as connectors,wireless interface 910, a wired interface, or the like. -
Wireless interface 910 may include any wireless transmission and/or reception capabilities. For example, in some embodiments,wireless interface 910 includes a network interface card (NIC) capable of communicating over a wireless network. Also for example, in some embodiments,wireless interface 910 may include cellular telephone capabilities. In still further embodiments,wireless interface 910 may include a global positioning system (GPS) receiver. One skilled in the art will understand thatwireless interface 910 may include any type of wireless communications capability without departing from the scope of the present invention. -
Processor 920 may be any type of processor capable of communicating with the various components inmobile device 900. For example,processor 920 may be an embedded processor available from application specific integrated circuit (ASIC) vendors, or may be a commercially available microprocessor. In some embodiments,processor 920 provides image or video data toscanning laser projector 100. The image or video data may be retrieved fromwireless interface 910 or may be derived from data retrieved fromwireless interface 910. For example, throughprocessor 920,scanning laser projector 902 may display images or video received directly fromwireless interface 910. Also for example,processor 920 may provide overlays to add to images and/or video received fromwireless interface 910, or may alter stored imagery based on data received from wireless interface 910 (e.g., modifying a map display in GPS embodiments in whichwireless interface 910 provides location coordinates). - Turning to
FIG. 10 , a perspective view of amobile device 1000 in accordance with various embodiments is illustrated. Specifically,mobile device 1000 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanninglaser projector 100, scanning laser projector 700).Mobile device 1000 may be a hand held scanning laser projector with or without communications ability. For example, in some embodiments,mobile device 1000 may be a scanning laser projector with little or no other capabilities. Also for example, in some embodiments,mobile device 1000 may be a device usable for communications, including for example, a cellular phone, a smart phone, a tablet computing device, a global positioning system (GPS) receiver, or the like. Further,mobile device 1000 may be connected to a larger network via a wireless (e.g., cellular), or this device can accept and/or transmit data messages or video content via an unregulated spectrum (e.g., WiFi) connection. -
Mobile device 1000 includesscanning laser projector 1020, touchsensitive display 1010,audio port 1002,control buttons 1004,card slot 1006, and audio/video (A/V)port 1008. None of these elements are essential. For example, mobile device may only includescanning laser projector 1020 without any of touchsensitive display 1010,audio port 1002,control buttons 1004,card slot 1006, or A/V port 1008. Some embodiments include a subset of these elements. For example, an accessory projector may includescanning laser projector 1020,control buttons 1004 and A/V port 1008. A smartphone embodiment may combine touchsensitive display device 1010 andprojector 1020. - Touch
sensitive display 1010 may be any type of display. For example, in some embodiments, touchsensitive display 1010 includes a liquid crystal display (LCD) screen. In some embodiments,display 1010 is not touch sensitive.Display 1010 may or may not always display the image projected by scanninglaser projector 1020. For example, an accessory product may always display the projected image ondisplay 1010, whereas a mobile phone embodiment may project a video while displaying different content ondisplay 1010. Some embodiments may include a keypad in addition to touchsensitive display 1010. A/V port 1008 accepts and/or transmits video and/or audio signals. For example, A/V port 1008 may be a digital port, such as a high definition multimedia interface (HDMI) interface that accepts a cable suitable to carry digital audio and video data. Further, A/V port 1008 may include RCA jacks to accept or transmit composite inputs. Still further, A/V port 1008 may include a VGA connector to accept or transmit analog video signals. - In some embodiments,
mobile device 1000 may be tethered to an external signal source through A/V port 1008, andmobile device 1000 may project content accepted through A/V port 1008. In other embodiments,mobile device 1000 may be an originator of content, and A/V port 1008 is used to transmit content to a different device. -
Audio port 1002 provides audio signals. For example, in some embodiments,mobile device 1000 is a media recorder that can record and play audio and video. In these embodiments, the video may be projected by scanninglaser projector 1020 and the audio may be output ataudio port 1002. -
Mobile device 1000 also includescard slot 1006. In some embodiments, a memory card inserted incard slot 1006 may provide a source for audio to be output ataudio port 1002 and/or video data to be projected by scanninglaser projector 1020.Card slot 1006 may receive any type of solid state memory device, including for example secure digital (SD) memory cards. - Turning to
FIG. 11 , a perspective view of a head-updisplay system 1100 in accordance with various embodiments is illustrated. Specifically, head-updisplay system 1100 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanninglaser projector 100, scanning laser projector 700). The head-updisplay system 1100 includes ascanning laser projector 1102. Specifically, thescanning laser projector 1102 is shown mounted in a vehicle dash to project the head-up display. Although an automotive head-up display is shown inFIG. 11 , this is not a limitation and other applications are possible. For example, various embodiments include head-up displays in avionics application, air traffic control applications, and other applications. - Turning to
FIG. 12 , a perspective view ofeyewear 1200 in accordance with various embodiments is illustrated. Specifically,eyewear 1200 is an example of the type of device in which a scanning laser projector as described above can be implemented (e.g., scanninglaser projector 100, scanning laser projector 700).Eyewear 1200 includesscanning laser projector 1202 to project a display in the eyewear's field of view. In some embodiments,eyewear 1200 is see-through and in other embodiments,eyewear 1200 is opaque. For example,eyewear 1200 may be used in an augmented reality application in which a wearer can see the display fromprojector 1202 overlaid on the physical world. Also for example,eyewear 1200 may be used in a virtual reality application, in which a wearer's entire view is generated byprojector 1202. - Although only one
projector 1202 is shown inFIG. 12 , this is not a limitation and other implementations are possible. For example, in some embodiments,eyewear 1200 includes twoprojectors 1202, with one for each eye - Turning to
FIG. 13 , a perspective view of agaming apparatus 1300 in accordance with various embodiments is illustrated.Gaming apparatus 1300 allows a user or users to observe and interact with a gaming environment. In some embodiments, the game is navigated based on the motion, position, or orientation ofgaming apparatus 1300, an apparatus that includesscanning laser projector 1302. Other control interfaces, such as manually-operated buttons, foot pedals, or verbal commands, may also contribute to navigation around, or interaction with the gaming environment. For example, in some embodiments,trigger 1342 contributes to the illusion that the user or users are in a first person perspective video game environment, commonly known as a “first person shooter game.” Because the size and brightness of the projected display can be controlled by the gaming application in combination with the user's movement,gaming apparatus 1300 creates a highly believable or “immersive” environment for these users. - Many other first person perspective simulations can also be created by
gaming apparatus 1300, for such activities as 3D seismic geo-prospecting, spacewalk planning, jungle canopy exploration, automobile safety instruction, medical education, etc.Tactile interface 1344 may provide a variety of output signals, such as recoil, vibration, shake, rumble, etc.Tactile interface 1344 may also include a touch-sensitive input feature, such as a touch sensitive display screen or a display screen that requires a stylus. Additional tactile interfaces, for example, input and/or output features for a motion sensitive probe are also included in various embodiments of the present invention. -
Gaming apparatus 1300 may also include audio output devices, such as integrated audio speakers, remote speakers, or headphones. These sorts of audio output devices may be connected togaming apparatus 1300 with wires or through a wireless technology. For example,wireless headphones 1346 provide the user with sound effects via a BLUETOOTH™ connection, although any sort of similar wireless technology could be substituted freely. In some embodiments,wireless headphones 1346 may includemicrophone 1345 orbinaural microphone 1347, to allow multiple users, instructors, or observers to communicate.Binaural microphone 1347 typically includes microphones on each ear piece, to capture sounds modified by the user's head shadow. This feature may be used for binaural hearing and sound localization by other simulation participants. -
Gaming apparatus 1300 may include any number ofsensors 1310 that measure ambient brightness, motion, position, orientation, and the like. For example,gaming apparatus 1300 may detect absolute heading with a digital compass, and detect relative motion with an x-y-z gyroscope or accelerometer. In some embodiments,gaming apparatus 1300 also includes a second accelerometer or gyroscope to detect the relative orientation of the device, or its rapid acceleration or deceleration. In other embodiments,gaming apparatus 1300 may include a Global Positioning Satellite (GPS) sensor, to detect absolute position as the user travels in terrestrial space. -
Gaming apparatus 1300 may includebattery 1341 and/or diagnostic lights 1343. For example,battery 1341 may be a rechargeable battery, and diagnostic lights 1343 could indicate the current charge of the battery. In another example,battery 1341 may be a removable battery clip, andgaming apparatus 1300 may have an additional battery, electrical capacitor or super-capacitor to allow for continued operation of the apparatus while the discharged battery is replaced with a charged battery. In other embodiments, diagnostic lights 1343 can inform the user or a service technician about the status of the electronic components included within or connected to this device. For example, diagnostic lights 1343 may indicate the strength of a received wireless signal, or the presence or absence of a memory card. - Diagnostic lights 1343 could also be replaced by any small screen, such as an organic light emitting diode or liquid crystal display screen. Such lights or screens could be on the exterior surface of
gaming apparatus 1300, or below the surface, if the shell for this apparatus is translucent or transparent. Other components ofgaming apparatus 1300 may be removable, detachable or separable from this device. For example,scanning laser projector 1302 may be detachable or separable fromgaming housing 1389. In some embodiments, the subcomponents ofscanning laser projector 100 may be detachable or separable fromgaming housing 1389, and still function. - Turning to
FIG. 14 , a perspective view of agaming apparatus 1400 in accordance with various embodiments is illustrated.Gaming apparatus 1400 includesbuttons 1404,display 1410, andprojector 1402. In some embodiments,gaming apparatus 1400 is a standalone apparatus that does not need a larger console for a user to play a game. For example, a user may play a game while watchingdisplay 1410 and/or the projected content. In other embodiments,gaming apparatus 1400 operates as a controller for a larger gaming console. In these embodiments, a user may watch a larger screen tethered to the console in combination with watchingdisplay 1410 and/or projected content. - In one embodiment, a scanning laser projector is provided. The scanning laser projector, comprising: at least one source of laser light; a scanning mirror configured to reflect the laser light; a perimeter defining an image region inside the perimeter and an over scanned region outside the perimeter, the image region and over scanned region configured to receive the reflected laser light; a photodetector configured to receive a portion of the reflected laser light impacting the over scanned region outside the perimeter, the photodetector further configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector; and a drive circuit configured to provide an excitation signal to excite motion of the scanning mirror, the drive circuit configured to modify the excitation signal in response to the feedback signal.
- In another embodiment, a method is provided. The method comprising: A method comprising: controlling motion of a scanning mirror to reflect laser light in a pattern across an image region inside a perimeter and across an over scanned region outside the perimeter; detecting a portion of the reflected laser light in the over scanned region; providing a feedback signal responsive to the detected portion of the reflected laser light; and modify the motion of the scanning mirror in response to the feedback signal.
- Although the present invention has been described in conjunction with certain embodiments, it is to be understood that modifications and variations may be resorted to without departing from the scope of the invention as those skilled in the art readily understand. Such modifications and variations are considered to be within the scope of the invention and the appended claims.
Claims (20)
1. A scanning laser projector, comprising:
at least one source of laser light;
a scanning mirror configured to reflect the laser light;
a perimeter defining an image region inside the perimeter and an over scanned region outside the perimeter, the image region and over scanned region configured to receive the reflected laser light, wherein the perimeter is defined by an opening surrounded by a border fixture, where the opening resides in a virtual plane through which the reflected laser light in the image region passes;
a photodetector configured to receive a portion of the reflected laser light impacting the over scanned region outside the perimeter, the photodetector further configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector; and
a drive circuit configured to provide an excitation signal to excite motion of the scanning mirror, the drive circuit configured to modify the excitation signal in response to the feedback signal.
2. The scanning laser projector of claim 1 , wherein the photodetector is positioned off axis relative to a horizontal scan of the reflected laser light such that the horizontal scan of the reflected laser light crosses the photodetector at a non-orthogonal angle.
3. The scanning laser projector of claim 1 , further comprising an optical waveguide, the optical waveguide coupled between the photodetector and an aperture positioned proximate to the perimeter such that the aperture receives the portion of the reflected laser light impacting the over scanned region and the optical waveguide transmits the portion of the reflected laser light to the photodetector.
4. The scanning laser projector of claim 1 , further comprising a second photodetector configured to receive a second portion of the reflected laser light impacting the over scanned region outside the perimeter, the second photodetector further configured to provide a second feedback signal responsive to the second portion of the reflected laser light impacting the photodetector.
5. The scanning laser projector of claim 4 , wherein the photodetector is adjacent a horizontal edge of the perimeter, and wherein the second photodetector is adjacent a vertical edge of the perimeter.
6. (canceled)
7. The scanning laser projector of claim 1 , further comprising an optical waveguide integrated with the border fixture, the optical waveguide coupled between the photodetector and an aperture positioned proximate to the perimeter such that the aperture receives the portion of the reflected laser light impacting the over scanned region and the optical waveguide transmits the portion of the reflected laser light to the photodetector.
8. The scanning laser projector of claim 1 , further comprising a microlens array comprising two or more lensets, the microlens array positioned within the perimeter and configured to receive the reflected laser light in the image region.
9. The scanning laser projector of claim 8 , further comprising an optical waveguide integrated with the microlens array, the optical waveguide coupled between the photodetector and an aperture positioned proximate to the perimeter such that the aperture receives the portion of the reflected laser light impacting the over scanned region and the optical waveguide transmits the portion of the reflected laser light to the photodetector.
10. The scanning laser projector of claim 1 , wherein the feedback signal indicates a photodetector entry time and a photodetector exit time, and wherein the drive circuit is configured to determine a horizontal scan amplitude based at least in part on the photodetector entry time and the photodetector exit time.
11. The scanning laser projector of claim 1 , wherein the feedback signal indicates a photodetector entry time and a photodetector exit time, and wherein the scanning laser projector is configured to determine a horizontal phase alignment based at least in part on the photodetector entry time and the photodetector exit time.
12. The scanning laser projector of claim 1 , wherein the feedback signal indicates a number of sweeps crossing the photodetector during a frame, and wherein the drive circuit is configured to determine a vertical scan amplitude of the scan based at least in part on the determined number of scan crossings.
13. The scanning laser projector of claim 1 , wherein the photodetector is positioned off axis relative to a horizontal scan of the reflected laser light such that the horizontal scan of the reflected laser light crosses the photodetector at a non-orthogonal angle, and wherein the feedback signal indicates a photodetector entry time and a photodetector exit time for a scan crossing a corner of the photodetector, and wherein the drive circuit is configured to determine a vertical scan amplitude of the scan based at least in part on the photodetector entry time and the photodetector exit time when crossing the corner of the photodetector.
14. The scanning laser projector of claim 1 , wherein the feedback signal is provided to a pixel drive generator, and wherein the pixel drive generator is configured to use the feedback signal to control the at least one source of laser light to provide pixel alignment of the laser light with the scanning mirror.
15. The scanning laser projector of claim 1 , wherein the drive circuit is configured to use an average of multiple feedback signals taken over time to modify the excitation signal in response to the feedback signal.
16. The scanning laser projector of claim 1 , wherein the photodetector is configured to receive reflected laser light corresponding to 50% of a horizontal scan amplitude, and further comprising a second photodetector configured to receive a second portion of the reflected laser light impacting the over scanned region outside the perimeter, the second photodetector further configured to provide a feedback signal responsive to the second portion of the reflected laser light impacting the photodetector, and wherein the second photodetector is configured to receive reflected laser light corresponding to 95% of the horizontal scan amplitude.
17. A method comprising:
controlling motion of a scanning mirror to reflect laser light in a pattern across an image region inside a perimeter and across an over scanned region outside the perimeter, wherein the perimeter is defined by an opening surrounded by a border fixture, where the opening resides in a virtual plane through which the reflected laser light in the image region passes;
detecting a portion of the reflected laser light in the over scanned region;
providing a feedback signal responsive to the detected portion of the reflected laser light; and
modifying the motion of the scanning mirror in response to the feedback signal.
18. The method of claim 17 , wherein the step of modifying the motion of the scanning mirror in response to the feedback signal comprises determining a horizontal scan amplitude based at least in part on feedback signal and determining a horizontal phase alignment based at least in part on feedback signal.
19. The method of claim 17 , wherein the step of modifying the motion of the scanning mirror in response to the feedback signal comprises determining a vertical scan amplitude based at least in part on feedback signal.
20. A scanning laser projector, comprising:
at least one source of laser light;
a first scanning mirror configured to reflect the laser light along a first axis;
a second scanning mirror configured to reflect the laser light along a second axis;
a perimeter defining an image region inside the perimeter and an over scanned region outside the perimeter, the image region and over scanned region configured to receive the reflected laser light, wherein the perimeter is defined by an opening surrounded by a border fixture, where the opening resides in a virtual plane through which the reflected laser light in the image region passes;
a photodetector configured to receive a portion of the reflected laser light impacting the over scanned region outside the perimeter, the photodetector further configured to provide a feedback signal responsive to the portion of the reflected laser light received by the photodetector; and
a drive circuit configured to provide a first excitation signal to excite motion of the first scanning mirror and a second excitation signal to excite motion of the second scanning mirror, the drive circuit configured to modify the first excitation signal in response to the feedback signal to control a horizontal scan amplitude, the drive circuit further configured to modify the second excitation signal in response to the feedback signal to control a vertical scan amplitude.
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/978,766 US9693029B1 (en) | 2015-12-22 | 2015-12-22 | System and method for feedback control in scanning projectors |
PCT/US2016/066551 WO2017112481A1 (en) | 2015-12-22 | 2016-12-14 | System and method for feedback control in scanning projectors |
JP2018530887A JP6884417B2 (en) | 2015-12-22 | 2016-12-14 | Feedback control systems and methods in scanning projectors |
EP16879888.2A EP3394600B1 (en) | 2015-12-22 | 2016-12-14 | System for feedback control in scanning projectors |
CN201680075090.8A CN108431583B (en) | 2015-12-22 | 2016-12-14 | System and method for feedback control in a scanning projector |
KR1020187018524A KR20180087398A (en) | 2015-12-22 | 2016-12-14 | System and method for feedback control in an injector projector |
US15/478,951 US10104353B2 (en) | 2015-12-22 | 2017-04-04 | Scanning projector with feedback from border fixture |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/978,766 US9693029B1 (en) | 2015-12-22 | 2015-12-22 | System and method for feedback control in scanning projectors |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/478,951 Continuation US10104353B2 (en) | 2015-12-22 | 2017-04-04 | Scanning projector with feedback from border fixture |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170180690A1 true US20170180690A1 (en) | 2017-06-22 |
US9693029B1 US9693029B1 (en) | 2017-06-27 |
Family
ID=59066614
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/978,766 Active US9693029B1 (en) | 2015-12-22 | 2015-12-22 | System and method for feedback control in scanning projectors |
US15/478,951 Active 2036-01-15 US10104353B2 (en) | 2015-12-22 | 2017-04-04 | Scanning projector with feedback from border fixture |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/478,951 Active 2036-01-15 US10104353B2 (en) | 2015-12-22 | 2017-04-04 | Scanning projector with feedback from border fixture |
Country Status (6)
Country | Link |
---|---|
US (2) | US9693029B1 (en) |
EP (1) | EP3394600B1 (en) |
JP (1) | JP6884417B2 (en) |
KR (1) | KR20180087398A (en) |
CN (1) | CN108431583B (en) |
WO (1) | WO2017112481A1 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180172984A1 (en) * | 2016-12-21 | 2018-06-21 | Mitsumi Electric Co., Ltd. | Image projection apparatus and compensation method |
US10073268B2 (en) * | 2015-05-28 | 2018-09-11 | Thalmic Labs Inc. | Display with integrated visible light eye tracking |
CN108549188A (en) * | 2018-04-24 | 2018-09-18 | 歌尔股份有限公司 | The position phase method of adjustment of laser scanning projection's instrument |
US10133075B2 (en) | 2015-05-04 | 2018-11-20 | Thalmic Labs Inc. | Systems, devices, and methods for angle- and wavelength-multiplexed holographic optical elements |
US10151926B2 (en) | 2016-01-29 | 2018-12-11 | North Inc. | Systems, devices, and methods for preventing eyebox degradation in a wearable heads-up display |
EP3481061A1 (en) * | 2017-11-01 | 2019-05-08 | Mitsumi Electric Co., Ltd. | Image projection apparatus and image projection method |
JP2019128386A (en) * | 2018-01-22 | 2019-08-01 | スタンレー電気株式会社 | Optical scanner |
US10474296B1 (en) * | 2018-07-12 | 2019-11-12 | Microvision, Inc. | Laser scanning devices and methods with touch detection |
US20210176441A1 (en) * | 2019-12-06 | 2021-06-10 | Mitsumi Electric Co., Ltd. | Display apparatus |
CN113031249A (en) * | 2019-12-09 | 2021-06-25 | 觉芯电子(无锡)有限公司 | Micro-mirror control device based on photoelectric feedback |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6604816B2 (en) * | 2015-10-28 | 2019-11-13 | スタンレー電気株式会社 | Image projection apparatus and MEMS mirror control method |
US9693029B1 (en) * | 2015-12-22 | 2017-06-27 | Microvision, Inc. | System and method for feedback control in scanning projectors |
WO2019126951A1 (en) * | 2017-12-25 | 2019-07-04 | 歌尔科技有限公司 | Laser beam scanning display device, and augmented reality glasses |
JP7015475B2 (en) * | 2018-03-16 | 2022-02-15 | 株式会社リコー | Optical scanning device, image projection device and moving object |
CN117850037A (en) * | 2018-09-28 | 2024-04-09 | 奇跃公司 | Projection system with collimating scanning mirror |
CN109584761A (en) * | 2018-10-31 | 2019-04-05 | 歌尔股份有限公司 | A kind of signal adjusting method and laser scanning projection device |
US11487105B2 (en) | 2018-12-18 | 2022-11-01 | Microsoft Technology Licensing, Llc | Modified slow-scan drive signal |
US10930275B2 (en) | 2018-12-18 | 2021-02-23 | Microsoft Technology Licensing, Llc | Natural language input disambiguation for spatialized regions |
US11709231B2 (en) * | 2018-12-21 | 2023-07-25 | Infineon Technologies Ag | Real time gating and signal routing in laser and detector arrays for LIDAR application |
JP2020129087A (en) * | 2019-02-12 | 2020-08-27 | 株式会社リコー | Display device, display system, moving object, display control method, and display control program |
JP2020154111A (en) * | 2019-03-20 | 2020-09-24 | 株式会社リコー | Optical scanner, display system, and mobile object |
CN111751084B (en) * | 2019-03-29 | 2021-10-29 | 安世亚太科技股份有限公司 | Phase calibration system and method of oscillating reflector |
CN112130321B (en) * | 2019-06-24 | 2023-06-27 | 成都理想境界科技有限公司 | Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment |
CN110596895B (en) * | 2019-08-09 | 2021-10-29 | 成都理想境界科技有限公司 | Near-to-eye display device and projection feedback method |
US11774834B2 (en) * | 2021-09-20 | 2023-10-03 | Stmicroelectronics Ltd | Scanning laser projector system utilizing photodiodes inside scan area but outside of projection area for feedback |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040119811A1 (en) * | 2002-12-23 | 2004-06-24 | Bush Craig P. | Scanning with multiple oscillating scanners |
US8159513B2 (en) * | 2007-03-19 | 2012-04-17 | Canon Kabushiki Kaisha | Image forming apparatus and control method for same |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS62219790A (en) | 1986-03-19 | 1987-09-28 | Matsushita Electric Ind Co Ltd | Screen for projection type television receiver |
US4684996A (en) | 1986-08-25 | 1987-08-04 | Eastman Kodak Company | Video projector with optical feedback |
US5786594A (en) * | 1996-01-18 | 1998-07-28 | Ricoh Company, Ltd. | Multi-beam pitch adjustment system and method |
EP1065888A1 (en) | 1999-06-30 | 2001-01-03 | Thomson Licensing S.A. | Projection video display for multiple signal sources |
US6480221B1 (en) * | 2000-05-10 | 2002-11-12 | Lexmark International, Inc | Method and apparatus for determining a process position of a scan line in an electrophotographic machine |
JP4174252B2 (en) * | 2001-07-11 | 2008-10-29 | キヤノン株式会社 | Optical deflection apparatus, image forming apparatus using the same, and driving method thereof |
NO330155B1 (en) | 2006-02-28 | 2011-02-28 | 3D Perception As | Method and apparatus for use in calibrating a projector's image display to a display screen, and display screen for such use. |
US8159913B2 (en) | 2006-10-17 | 2012-04-17 | Hitachi, Ltd. | Optical disc recording apparatus and recording power control method |
JP5095311B2 (en) * | 2007-08-30 | 2012-12-12 | 株式会社日立製作所 | Image display apparatus and method for adjusting vibration state of reflecting mirror in image display apparatus |
US7972014B2 (en) * | 2008-08-05 | 2011-07-05 | Opus Microsystems Corporation | Scanning projection apparatus with phase detection and compensation |
JP2012003051A (en) * | 2010-06-17 | 2012-01-05 | Brother Ind Ltd | Scanning type image display device |
JP6387589B2 (en) * | 2013-08-30 | 2018-09-12 | 株式会社リコー | Image forming apparatus, vehicle, and control method of image forming apparatus |
JP2015225216A (en) * | 2014-05-28 | 2015-12-14 | パイオニア株式会社 | Image display device |
US9693029B1 (en) * | 2015-12-22 | 2017-06-27 | Microvision, Inc. | System and method for feedback control in scanning projectors |
-
2015
- 2015-12-22 US US14/978,766 patent/US9693029B1/en active Active
-
2016
- 2016-12-14 WO PCT/US2016/066551 patent/WO2017112481A1/en active Application Filing
- 2016-12-14 JP JP2018530887A patent/JP6884417B2/en active Active
- 2016-12-14 CN CN201680075090.8A patent/CN108431583B/en active Active
- 2016-12-14 KR KR1020187018524A patent/KR20180087398A/en not_active Application Discontinuation
- 2016-12-14 EP EP16879888.2A patent/EP3394600B1/en active Active
-
2017
- 2017-04-04 US US15/478,951 patent/US10104353B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040119811A1 (en) * | 2002-12-23 | 2004-06-24 | Bush Craig P. | Scanning with multiple oscillating scanners |
US8159513B2 (en) * | 2007-03-19 | 2012-04-17 | Canon Kabushiki Kaisha | Image forming apparatus and control method for same |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10133075B2 (en) | 2015-05-04 | 2018-11-20 | Thalmic Labs Inc. | Systems, devices, and methods for angle- and wavelength-multiplexed holographic optical elements |
US10197805B2 (en) | 2015-05-04 | 2019-02-05 | North Inc. | Systems, devices, and methods for eyeboxes with heterogeneous exit pupils |
US10534182B2 (en) * | 2015-05-28 | 2020-01-14 | North Inc. | Optical splitter for integrated eye tracking and scanning laser projection in wearable heads-up displays |
US10114222B2 (en) | 2015-05-28 | 2018-10-30 | Thalmic Labs Inc. | Integrated eye tracking and laser projection methods with holographic elements of varying optical powers |
US10078220B2 (en) * | 2015-05-28 | 2018-09-18 | Thalmic Labs Inc. | Wearable heads-up display with integrated eye tracker |
US10488661B2 (en) | 2015-05-28 | 2019-11-26 | North Inc. | Systems, devices, and methods that integrate eye tracking and scanning laser projection in wearable heads-up displays |
US10429655B2 (en) * | 2015-05-28 | 2019-10-01 | North Inc. | Systems, devices, and methods that integrate eye tracking and scanning laser projection in wearable heads-up displays |
US10139633B2 (en) * | 2015-05-28 | 2018-11-27 | Thalmic Labs Inc. | Eyebox expansion and exit pupil replication in wearable heads-up display having integrated eye tracking and laser projection |
US10180578B2 (en) | 2015-05-28 | 2019-01-15 | North Inc. | Methods that integrate visible light eye tracking in scanning laser projection displays |
US10073268B2 (en) * | 2015-05-28 | 2018-09-11 | Thalmic Labs Inc. | Display with integrated visible light eye tracking |
US10151926B2 (en) | 2016-01-29 | 2018-12-11 | North Inc. | Systems, devices, and methods for preventing eyebox degradation in a wearable heads-up display |
US20180172984A1 (en) * | 2016-12-21 | 2018-06-21 | Mitsumi Electric Co., Ltd. | Image projection apparatus and compensation method |
US10120185B2 (en) * | 2016-12-21 | 2018-11-06 | Mitsumi Electric Co., Ltd. | Image projection apparatus and compensation method |
CN109756714B (en) * | 2017-11-01 | 2021-12-21 | 三美电机株式会社 | Image projection apparatus and image projection method |
EP3481061A1 (en) * | 2017-11-01 | 2019-05-08 | Mitsumi Electric Co., Ltd. | Image projection apparatus and image projection method |
CN109756714A (en) * | 2017-11-01 | 2019-05-14 | 三美电机株式会社 | Image projection device and image projecting method |
US11243459B2 (en) * | 2017-11-01 | 2022-02-08 | Mitsumi Electric Co., Ltd. | Image projection apparatus and image projection method |
JP7025634B2 (en) | 2017-11-01 | 2022-02-25 | ミツミ電機株式会社 | Image projection device and image projection method |
JP2019086528A (en) * | 2017-11-01 | 2019-06-06 | ミツミ電機株式会社 | Image projection device and image projection method |
JP2019128386A (en) * | 2018-01-22 | 2019-08-01 | スタンレー電気株式会社 | Optical scanner |
CN108549188A (en) * | 2018-04-24 | 2018-09-18 | 歌尔股份有限公司 | The position phase method of adjustment of laser scanning projection's instrument |
US10474296B1 (en) * | 2018-07-12 | 2019-11-12 | Microvision, Inc. | Laser scanning devices and methods with touch detection |
US11997432B2 (en) * | 2019-12-06 | 2024-05-28 | Mitsumi Electric Co., Ltd. | Display apparatus |
US20210176441A1 (en) * | 2019-12-06 | 2021-06-10 | Mitsumi Electric Co., Ltd. | Display apparatus |
CN113031249A (en) * | 2019-12-09 | 2021-06-25 | 觉芯电子(无锡)有限公司 | Micro-mirror control device based on photoelectric feedback |
Also Published As
Publication number | Publication date |
---|---|
JP2019509507A (en) | 2019-04-04 |
EP3394600B1 (en) | 2022-04-06 |
US20170214898A1 (en) | 2017-07-27 |
KR20180087398A (en) | 2018-08-01 |
CN108431583A (en) | 2018-08-21 |
WO2017112481A1 (en) | 2017-06-29 |
JP6884417B2 (en) | 2021-06-09 |
EP3394600A1 (en) | 2018-10-31 |
US9693029B1 (en) | 2017-06-27 |
US10104353B2 (en) | 2018-10-16 |
EP3394600A4 (en) | 2019-05-08 |
CN108431583B (en) | 2020-10-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10104353B2 (en) | Scanning projector with feedback from border fixture | |
US8511838B2 (en) | Scanning laser projector with safety system | |
US9921056B2 (en) | Devices and methods for adjustable resolution depth mapping | |
US8746898B2 (en) | Projector with shutter | |
US10200683B2 (en) | Devices and methods for providing foveated scanning laser image projection with depth mapping | |
US8576468B2 (en) | Scanning projector with dynamic scan angle | |
EP3497926B1 (en) | Devices and methods for providing depth mapping with scanning laser image projection | |
KR102598428B1 (en) | Multistripe laser for laser-based projector displays | |
US20170293155A1 (en) | Devices and Methods for Speckle Reduction in Scanning Projectors Using Birefringence | |
US9798149B1 (en) | Devices and methods for optical power sensing scanning laser projectors | |
US10598943B2 (en) | Method and apparatus for collimating light from a laser diode |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROVISION, INC., WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JACKSON, ROBERT JAMES;REEL/FRAME:037352/0317 Effective date: 20151222 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |