KR20190125409A - MEMS scanning display device - Google Patents

Abstract

An embodiment of a scanning image display system is disclosed. In one embodiment, the scanning display system is a laser light source comprising two or more offset lasers, configured to scan light from the laser light source in a first direction at high frequency and in a second direction at low frequency to form an image. Scanning laser system with a scanning mirror system and an interlaced pattern to form an image, and adjusting one or more of a phase offset between the first and second frames of the interlaced image and a scan rate in the second direction And a controller configured to control the scanning mirror system.

Description

MEMS scanning display device

Some display devices use laser scanning to produce a viewable image. In one embodiment, the laser light is reflected by the scanning mirror system at different angles to scan the laser over the pixels of the projected image. Control of the light color and / or intensity at each pixel allows the image to be projected.

An embodiment of a scanning image display system is disclosed. In one embodiment, the scanning display system is a laser light source comprising two or more offset lasers, configured to scan light from the laser light source in a first direction at high frequency and in a second direction at low frequency to form an image. Scanning laser system with a scanning mirror system and an interlaced pattern to form an image, and adjusting one or more of a phase offset between the first and second frames of the interlaced image and a scan rate in the second direction And a controller configured to control the scanning mirror system.

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify essential features or key features of the subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. In addition, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this specification.

1 shows a block diagram of an exemplary laser based MEMS scanning display device.
2 shows an example laser trace diagram.
3 shows another exemplary laser trace diagram.
4 shows an example laser die in a first rotational orientation.
5 shows an example laser die in a second rotational orientation.
6 shows another exemplary laser trace diagram.
7 shows another exemplary laser trace diagram.
8 shows a block diagram of an example computing device.

As noted above, some display devices use laser scanning to produce a viewable image. In one embodiment, the laser light is reflected by the mirror system at different angles to project the reflected laser light across the field-of-view (FOV). To achieve a range of reflection angles, suitable actuators, such as microelectromechanical system (MEMS) actuators, can rotate the mirror system.

MEMS actuators can rotate the mirror system in the horizontal and vertical directions to produce an image that can be viewed with a two-dimensional field of view. For this purpose, the mirror system may comprise a single mirror driven in both the horizontal and vertical directions, or two mirrors driven separately in the horizontal and vertical directions. Different scan rates may be used in the horizontal and vertical directions. In two mirror systems, for example, horizontally scanned mirrors can be driven at a relatively fast rate (eg -10 kHz) and vertically scanned mirrors are driven at a relatively slow rate (eg -60 Hz). Can be. The horizontal and vertical scan rates, along with other factors such as the mirror aperture (eg diameter) and scan angle, may at least partially determine the resolution of the image produced at this rate.

However, current MEMS technology places an upper limit on the mirror scan rate to limit the display resolution. As an embodiment, the 27 kHz horizontal scan rate combined with the 60 Hz vertical scan rate may yield a vertical resolution of 720p. Considerably higher vertical resolutions (eg, 1440p, 2160p) may be desirable, especially for close-eye display implementations where 720p and similar vertical resolutions may appear blurred and low resolution. Increasing the horizontal and / or vertical scan rate increases the display resolution, while the former may be technically impossible, while the latter increases power consumption. In addition, high scan rates may at least partially limit the mirror scan angle and aperture, and larger values are also required. In addition, supporting higher resolutions may also require larger mirror sizes due to diffraction limits associated with smaller “pixel” sizes. Since the larger the mirror, the lower the scanning frequency, the use of such a large mirror can further increase the difficulty of achieving higher resolutions with the scanning display.

Accordingly, embodiments are disclosed for a laser based MEMS scanning display device configured for high resolution output. As described below, the interlace mode of operating multiple lasers is combined with the variable scan rate and / or phase offset between interlace frames to achieve the desired spacing between laser outputs to yield the desired image pixel spacing and resolution. Can be. The use of multiple lasers allows multiple lines to be scanned every mirror period, thus allowing high resolution to be achieved without increasing the mirror scan frequency, and allowing larger mirrors to be used, resulting in pixel size problems due to diffraction limitations. Can help you avoid it. Also disclosed are embodiments in which the output from an eye-tracking sensor is used to dynamically change the laser output interval as a function of the user's line of sight direction.

1 shows a block diagram of an example display device 100 shown as an example laser based MEMS scanning display device. Display device 100 includes two or more lasers 102, as described below in more detail with reference to FIGS. 4 and 5, and can assume any suitable form (eg, a solid state laser). And output light of one or more wavelengths (eg, light in the red, green, and / or blue wavelength range). The laser 102 outputs light for reception by the first mirror 104 reflecting light received from the laser toward the second mirror 106. The first mirror 104 can be configured to scan in the horizontal (eg, x-axis) direction so that the light ultimately forms an image that can be projected and viewed through the two-dimensional FOV, and the second mirror 106 Can be configured to scan in a vertical (eg y-axis) direction. In another embodiment, the first mirror can scan vertically and the second mirror can scan horizontally.

1 shows the reflection of light from the second mirror 106 toward the output 108 where a viewable image is formed. The output 108 may assume any suitable form, such as display surface, projection optics, waveguide optics, and the like. As an embodiment, the display device 100 is a virtual reality head-mounted display (HMD) device having an output 108 configured as an opaque surface, or an image corresponding to the surrounding physical environment is directed to the laser light. It can be configured as a mixed reality HMD device with an output configured as a partially transparent surface that can be delivered and combined. Display device 100 may assume other suitable forms, such as a head-up display, mobile device screen, monitor, television, or the like.

In order to enable the generation of the desired image, the actuator 110 drives the first and second mirrors 104 and 106 separately. In one embodiment, the actuator 110 moves the first mirror 104 in the horizontal direction at a relatively fast first rate (eg, 27 kHz, 35 kHz), and at a relatively slow second rate (eg, 60 Hz). 120 Hz) to rotate the second mirror 106 in the vertical direction. The second rate may be fixed such that the second mirror 106 is vertically scanned in a continuous manner, while in other embodiments the vertical scan may be performed in stages so that the second mirror is substantially before the horizontal scan line is completed. Transition to the next non-zero scan line when the horizontal scan line completes with a vertical velocity equal to zero. The mirrors 104 and 106 can assume any suitable form, such as a MEMS actuated mirror (eg, resonant piezoelectric operation).

In some implementations, the display device 100 can further include an eye tracking sensor 112 operable to detect the gaze direction of the user of the display device. The gaze direction may be mapped to an area within the display space to determine the location at the output 108 where the user's gaze is directed. As described in detail below with reference to FIG. 3, one or more operating parameters (eg, vertical scan rate, phase offset) of the display device 100 may be changed in response to the determined position of the gaze. Sensor 112 may assume any suitable form. In an embodiment, the sensor 112 captures an image of the user's eye, including one or more light sources (eg, an infrared light source) configured to reflect glare of light from the cornea of each eye of the user, and the glare. It may include one or more image sensors.

Display device 100 further includes a controller 114 for performing the approaches disclosed herein. The controller 114 may control the operation of the laser 102 (eg, frequency, intensity, duty cycle) and / or the first and / or second mirrors 104 and 106, and the eye tracking sensor ( 112 may receive the output and adjust the operation of the laser, the first mirror, and / or the second mirror based on the eye tracking sensor output.

Display device 100 may include replacement or additional elements that are not shown in FIG. 1. For example, one or more optical elements (eg, collimators, diffusers, couplers, converging lenses, diverging lenses, hologram elements) may be placed in the optical path through which the laser light travels to achieve the desired display characteristics. The display device 100 may further include a power source (eg, battery, power source) suitable for providing power to the active element of the display device. It is also contemplated to include a single mirror in place of various modifications to the display device 100, for example first and second mirrors 104 and 106, where the single mirror is scanned in both horizontal and vertical directions. .

2 shows an example laser trace diagram 200. For example, diagram 200 shows an optical output that may be generated by display device 100 of FIG. 1. Four laser traces are shown that correspond to the outputs of two lasers in two different frames that can be successively interlaced. Each trace corresponds to light generated in the display space at the FOV 201, for example at the output 108 of FIG. 1. Thus, the portion of the laser trace between successive turning points, such as turning points 202A and 202B, may correspond to a horizontal row of recognized image pixels drawn by the laser trace. In some embodiments, the turning point may be outside of the image frame.

As shown in legend 204, diagram 200 shows a trace of a first laser in a first frame, a trace of a second laser in a first frame, a trace of a first laser in a second frame, and a second. The trace of the second laser in the frame is shown. In the first frame, the traces of the first and second lasers can be separated vertically in the display space by one line. Thus, the traces of the first and second lasers can produce light vertically adjacent to vertically aligned image pixels. As an embodiment, FIG. 2 illustrates vertically adjacent, vertically aligned image pixels 206A and 206B that may be generated by the first and second lasers of the first frame.

The embodiment shown in FIG. 2 may correspond to an approach in which horizontal mirror scanning is achieved with actuators that vibrate in harmony with substantially sinusoidal motion. Thus, the laser trace can exhibit at least partial sinusoidal motion; As shown in FIG. 2, each laser trace scans a horizontal row of image pixels at a half period (e.g. pi rad) of a sine wave, such that two horizontal traces represent the full period (e.g. 2 * pi rad). Controlling the vertical mirror causes these two traces to produce two traces of horizontal image pixels.

In this formula, interlacing the first and second frames, and other successive alternate frames may include applying a phase offset between the alternating frames. As an example, FIG. 2 shows the phase offset of pi radians applied to the corresponding sinusoids between the first and second frames. By applying the phase offset between the alternating frames in this manner, a more uniform distribution of light throughout the FOV 201, thus higher resolution image and brightness uniformity can be achieved. Considering the high frequency scanning rate adopted by the horizontal mirror in this embodiment, the scanning operation of the high frequency horizontal mirror controls the scanning operation of the high frequency horizontal mirror because adjusting the scanning rate may interfere with harmonic oscillation. It can cause difficulties. As such, phase offset is achieved by controlling the slow scanning vertical mirror to begin vertical scanning early or later in the horizontal scan period, depending on the desired adjustment. In addition, by selecting a sufficiently high alternating frequency between interlaced frames, a stable image without unacceptable flickering is produced, so that light from both frames appears simultaneously to the viewer. By way of example, each frame may be displayed at a vertical scan frequency of 120 Hz, and the progressive image formed by the first and second alternating frames is displayed at a vertical scan frequency of 60 Hz.

Single line (eg, pixel) spacing may be achieved in certain areas within FOV 201, but less desirable spacing may result in other areas in the FOV. In the embodiment shown in FIG. 2, a high overlap is output from each laser of the first frame and the same corresponding laser of the second frame within a horizontal angle near zero degrees in the FOV 201. In contrast, a more preferred single line spacing is achieved towards the edge of the FOV 201, for example between horizontal angles of +/- 15 degrees and +/- 30 degrees. This deviation in line spacing in the FOV 201 can cause undesirable deviations in resolution and brightness. To resolve this deviation, the phase offset between the alternating frames can be adjusted by adjusting the vertical scanning mirror.

3 shows an example laser trace diagram 300 generated with a phase offset of pi / 2 radians between alternating frames. In contrast to the laser trace diagram 200 of FIG. 2 generated with a phase offset of pi radians, FIG. 3 shows that the use of pi / 2 radians offsets is a horizontal angle in other areas within the FOV 201, for example near zero degrees. It shows how to get a single line spacing within. Less desirable spacing and laser output overlap result in a horizontal angle towards the edge of the FOV 201, for example an angle between +/- 15 degrees and +/- 30 degrees.

The laser trace diagrams shown in FIGS. 2 and 3 show how the phase offset adjustment between alternating frames in the interlaced laser scan output produces the desired line and image pixel spacing in different regions of the FOV in display space. This approach can be extended to the use of any suitable set of phase offsets to achieve the desired line spacing in any region of the FOV. In addition, phase offset adjustment may be used dynamically during operation of the display device in areas where the user's gaze is directed, for example to achieve a desired line spacing between the end of the frame and the subsequent start of the vertical blank spacing. In the embodiment with reference to FIG. 1, to determine the area within the FOV of the output 108 where the user's gaze is directed, the controller 114 may use the output from the eye tracking sensor 112 indicating the user's gaze direction. Can be. The controller 114 optimizes the display output perceived by the user through the operation of the display device 100 by selecting a phase offset in response to this determination to achieve a desired line spacing in the area where the user's gaze is directed. Can be. Any suitable level of granularity may be used in the course of dynamically adjusting the phase offset. As an embodiment, the FOV can be divided into quadrants, with each phase offset associated with each quadrant and used to achieve the desired line spacing in that quadrant. However, the FOV may or may not be the same and may be divided into any suitable number of regions having any suitable geometry that may be regular or irregular. As another embodiment, a substantially continuous function may be used to map the gaze point of the FOV to the phase offset. For example, a Monte Carlo test may be performed to determine the set of mappings between the gaze point and phase offset.

It is to be understood that FIGS. 2 and 3 are provided as examples and are not intended to be limiting in any way. For example, laser trace diagrams 200 and 300 may represent a laser output prior to processing by one or more optical elements that may be included in display device 100 of FIG. 1. In addition, any suitable integer n laser can be used, and the vertical resolution of the image is proportional to n-for example, increasing the number of lasers of n from 2 to 4 doubles the vertical resolution. In addition, any suitable vertical refresh rate may be used in which an increase in the vertical refresh rate reduces the vertical resolution-for example, doubling the vertical refresh rate reduces the vertical resolution in half. As such, the number n of lasers and the vertical refresh rate may be balanced to achieve the desired display output. In addition, the subset of diagrams 200 and 300 may be selected as the FOV in which the image is presented to the viewer. As an embodiment with reference to FIG. 3, exemplary FOV 302 represents omitting a portion of the laser trace of diagram 300. Omitted portions may correspond to areas where the laser power is asymmetrical, vertically misaligned (as at the horizontal end of diagram 300), or otherwise undesirable. The omitted portion may be referred to as the overscan area where the laser output is deactivated (eg, by stopping power supply to the laser).

Multiple laser configurations can be used to create a single and other desired line spacing. As an example, FIG. 4 shows an exemplary laser die 400 that includes two solid state lasers 402A and 402B. Lasers 402A and 402B may be arranged on laser die 400, for example, via a suitable lithographic process. In the orientation shown in FIG. 4, the laser die 400 is centered with respect to the x-axis 404 and the y-axis 406, which is one or more mirrors (eg, made in FIG. 1). The first and second mirrors 104 and 106 may correspond to the horizontal and vertical axes on which they are scanned, respectively. The lasers 402A and 402B are also aligned with the vertical axis 406 and spaced along the vertical axis 406 by a vertical separation distance 408 measured along the vertical axis from the laser center to the laser center. The separation distance 408 can be selected to achieve the desired laser operation and to avoid unwanted problems associated with very narrow gaps between the lasers 402A and 402B, such as thermal crosstalk. The separation distance 408 may further accommodate the arrangement of structural and electrical elements needed to form the laser die 400 and to operate the lasers 402A and 402B with mechanical tolerances. In one embodiment, the separation distance 408 may be substantially equal to 15 microns.

However, this vertical separation distance and other vertical separation distances may appear at line intervals larger than one line in the display space. As described in detail below, a particular vertical refresh rate and / or phase offset may be selected to compensate and achieve a single line spacing.

By rotating the laser die for the orientation shown in FIG. 4 and providing laser light to the mirror system in the rotated orientation, a single line spacing can be achieved with the laser die 400. To this end, FIG. 5 shows the laser die 400 in a direction rotated with respect to the orientation shown in FIG. 4. The rotated orientation is selected to achieve a reduced vertical separation distance relative to the vertical separation distance 408 of the non-rotational orientation. For example, the vertical separation distance 410 may be substantially equal to 1 micron. In this way, a single line spacing can be achieved in display space with a laser die 400 that can have a 15 micron or similar vertical separation distance in the non-rotating direction. Due to mechanical tolerances, rotational errors may occur in the rotating laser die 400, which may appear as line spacing errors in the display space. To compensate, the vertical refresh rate can be adjusted by characterizing the known mechanical spacing between the lasers 402A and 402B and the thermal variance of the laser die 400. As an embodiment, line spacing in display spaces larger than one line may be compensated for by increasing the vertical refresh rate at the expense of some vertical resolution to achieve a single line spacing. The laser trace diagrams 200 and 300 of FIGS. 2 and 3 may be generated by the laser die 400 arranged in a rotational orientation, for example.

6 shows an example laser trace diagram 600 including laser traces from two lasers in two alternating frames, as indicated by legend 602. Diagram 600 is more than space resulting in a single line in display space, such as laser die 400 in the orientation shown in FIG. 4 with a vertical separation distance 408 between lasers 402A and 402B. It can represent a laser output generated by a laser die oriented with vertical separation between large lasers. In this embodiment, the sinusoidal profile otherwise assumed by the laser trace is distorted due to the vertical laser separation distance, resulting in a 'bow' shape for the laser trace resulting from the scanning mirror effect. The properties of the distorted sinusoidal also differ from laser to laser-the first laser exhibits a greater downward curvature during the horizontal line scan, while the second laser exhibits a greater upward curvature during the horizontal line scan. However, by adjusting the vertical refresh rate as described above, desired single and other line spacing in display space can be achieved. For the vertical separation distance 408, the vertical refresh rate may vary, for example to adjust the line spacing and / or resolution while still maintaining the integer of the horizontal line in the image. For example, this can be done in a non-foveal region (e.g., in a non-foveal region) rather than in a foveal region (e.g., user's line of sight) to achieve a foveated display using eye tracking data. For example, in a user's peripheral view).

The phase offset between interlaced frames generated by the laser die 400 with the vertical separation distance 408 can be adjusted to produce the desired line spacing in a particular portion of the FOV 604, as described above. have. 7 shows an example laser trace diagram 700 resulting from variation in the phase offset of pi radians used to generate the diagram 600, with a phase offset of pi / 2 radians. In contrast to diagram 600 where unwanted line spacing and laser output overlap occurs at a horizontal angle close to zero degrees, the pi / 2 radian phase offset represented by diagram 700 is a desired line at a horizontal angle close to zero degrees. Get the interval. As noted above, the output from the eye tracking sensor 112 of FIG. 1 can be used to dynamically adjust the phase offset to achieve the desired line spacing in response to the user's line of sight.

In some embodiments, the methods and processes disclosed herein may be associated with a computing system of one or more computing devices. In particular, these methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and / or other computer-program product.

8 schematically depicts a non-limiting embodiment of a computing system 800 that can perform one or more of the above methods and processes. Computing system 800 is shown in simplified form. Computing system 800 may include one or more of a personal computer, server computer, tablet computer, home-entertainment computer, network computing device, gaming device, mobile computing device, mobile communication device (eg, smart phone), and / or other computing device. Can take the form.

Computing system 800 includes a logic machine 802 and a storage machine 804. Computing device 800 may optionally include display subsystem 806, input subsystem 808, communication subsystem 810, and / or other components not shown in FIG. 8.

Logic machine 802 includes one or more physical devices configured to execute instructions. For example, a logic machine executes one or more instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. It can be configured to. These instructions can be implemented to perform tasks, implement data types, transform the state of one or more components, achieve technical effects or otherwise achieve desired results.

The logic machine may include one or more processors configured to execute software instructions. Additionally or alternatively, the logic machine may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. The processor of the logic machine may be single-core or multi-core, wherein the instructions executed may be configured for sequential processing, parallel processing, and / or distributed processing. Individual components of the logic machine may be distributed among two or more separate devices, which may optionally be remotely deployed and / or configured for integrated processing. Aspects of the logic machine may be virtualized and executed by a networked computing device configured in a remotely accessible, cloud-computing architecture.

To implement the methods and processes disclosed herein, storage machine 804 includes one or more physical devices configured to hold instructions executable by a logic machine. When these methods and processes are implemented, the state of the storage machine 804 may be translated (eg, to retain different data).

The storage machine 804 can include a removable and / or built-in device. Storage machine 804 may include optical memory (eg, CD, DVD, HD-DVD, Blu-ray Disc, etc.), semiconductor memory (eg, RAM, EPROM, EEPROM, etc.), and / or magnetic memory (eg, hard disk), among others. Disk drive, floppy disk drive, tape drive, MRAM, etc.). Storage machine 804 is volatile, nonvolatile, dynamic, static, read / write, read-only, random-access, sequential-access, location-addressable, file-addressable ), And / or a content-addressable device.

It will be appreciated that the storage machine 804 includes one or more physical devices. However, aspects of the instructions alternatively disclosed herein may be propagated by a communication medium (eg, electromagnetic signal, optical signal, etc.) that is not maintained by the physical device for a limited period of time.

Aspects of logic machine 802 and storage machine 804 may be integrated together in one or more hardware-logic components. Such hardware-logic components include, for example, field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PSAs / ASICs), program- and application-specific standard products (PSSPs) and system- on-a-chip, and a complex programmable logic device (CPLD).

The terms “module”, “program”, and “engine” may be used to disclose aspects of the computing system 800 that are implemented to perform a particular function. In some cases, modules, programs, or engines may be instantiated through logic machine 802 executing instructions maintained by storage machine 804. It will be appreciated that different modules, programs, and / or engines may be illustrated from the same application, service, code block, object, library, routine, API, function, or the like. Likewise, the same module, program, and / or engine may be illustrated by different applications, services, code blocks, objects, routines, APIs, functions, and the like. The terms “module”, “program”, and “engine” may include each or a group of executable files, data files, libraries, drivers, scripts, database records, and the like.

It will be appreciated that the "service" used herein is an application program that can be executed across multiple user sessions. Services may be made available to one or more system components, programs, and / or other services. In some implementations, the service can run on one or more server-computing devices.

If display subsystem 806 is included, display subsystem 706 can be used to represent a visual depiction of data held by storage machine 804. This visual depiction may take the form of a graphical user interface (GUI). Since the methods and processes disclosed herein change the data maintained by the storage machine and thus change the state of the storage machine, the state of the display subsystem 806 is used to visually indicate a change in the underlying data. It can be converted as well. Display subsystem 806 may include one or more display devices that virtually use any type of technology. Such display devices may be combined with logic machine 802 and / or storage machine 804 in a shared enclosure, or such display devices may be peripheral display devices.

When included, the input subsystem 808 may include or interface with one or more user-input devices, such as a keyboard, mouse, touch screen, or game controller. In some embodiments, the input subsystem can include or interface with the selected natural user input (NUI) componentry. Such components may be integrated or peripherals, and the transfer and / or processing of input operations may be handled on-board or off-board. Exemplary NUI components include a microphone for speech and / or speech recognition; Infrared, color, stereoscopic, and / or depth cameras for machine vision and / or gesture recognition; A head tracker, eye tracker, accelerometer, and / or gyroscope for motion detection and / or intent recognition; It can also include electric field sensing components to evaluate brain activity.

When included, the communication subsystem 810 may be configured to communicatively connect with one or more other computing devices. The communication subsystem 810 can include wired and / or wireless communication devices compatible with one or more different communication protocols. As a non-limiting embodiment, the communication subsystem can be configured for communication over a wireless telephone network, a wireless or wired local area network, a wireless or wired wide area network. In some embodiments, the communication subsystem may enable computing system 800 to send and / or receive messages to and / or from other devices via a network such as the Internet.

Another embodiment provides a scanning display system, the scanning display system comprising: a laser light source comprising two or more offset lasers, from the laser light source in a first direction at high frequency and in a second direction at low frequency to form an image; A scanning mirror system configured to scan light, and scanning laser light with an interlaced pattern to form an image, and scanning in a second direction and a phase offset between a first frame and a second frame of the interlaced image And a controller configured to control the scanning mirror system to adjust one or more of the rates. In such embodiments, the scanning mirror system may alternatively or additionally include a first mirror configured to scan laser light in a first direction, and a second mirror configured to scan laser light in a second direction. have. In such an embodiment, the controller may alternatively or additionally adjust the time at which the scanning mirror system initiates scanning of the laser light in the second direction with respect to the scanning of the laser light in the first direction. It can be configured to adjust the phase offset between. In such embodiments, the controller may alternatively or additionally be configured to adjust the phase offset between the first frame and the second frame based on the desired line spacing in the area in the image. In such an embodiment, the region may alternatively or additionally be one of a plurality of regions within the region in the image, and the controller may alternatively or additionally associate each phase offset with each of the plurality of regions. It can be configured to. In such embodiments, the scanning display system may alternatively or additionally include an eye tracking sensor configured to detect the eye direction of the user, and the controller may alternatively or additionally map the eye direction to an area within the image. And adjust one or more of a scan rate and a phase offset in the second direction based on the area in the image. In this embodiment, the controller alternatively or additionally adjusts the phase offset in a first manner based on the mapping of the gaze direction to the first area in the image, and based on the mapping of the gaze direction to the second area in the image. Can be configured to adjust the phase offset in a second manner. In such embodiments, the area may alternatively or additionally be a pavilion area of the image, the image may alternatively or additionally comprise a nonpobil area, and the controller may alternatively or additionally comprise a nonpoville area It may be configured to increase the scan rate in the second direction at and reduce the scan rate in the second direction at the pavil area. In such embodiments, two or more offset lasers may alternatively or additionally be offset vertically in a central alignment orientation with respect to the second scan direction. In such embodiments, the laser light source may alternatively or additionally be configured to output light of multiple colors. In such an embodiment, the controller may alternatively or additionally be configured to compensate for line spacing errors in rotational orientation by adjusting the scan rate in the second direction. In such an embodiment, the scanning mirror system may alternatively or additionally be configured to scan horizontal lines of the image in the half period of the microelectromechanical actuator driving the scanning mirror system. In this embodiment, the scanning display system may alternatively or additionally be configured to scan in the first direction at a frequency of 27 kHz to 35 kHz. In such embodiments, the controller may alternatively or additionally be configured to control the mirror system to form an image at a resolution between 1440p and 2160p.

Another embodiment provides a method of displaying an image, the method comprising: detecting light from two or more offset lasers towards a scanning mirror system; And scanning the light from the two or more offset lasers in the first direction at high frequency and in the second direction at low frequency to scan the laser light in the interlaced pattern and form an image. In such an embodiment, the method may alternatively or additionally map a gaze direction determined via the eye tracking sensor to an area in the image, and one of a scan rate and a phase offset in a second direction based on the area in the image. It may include the step of adjusting the above. In such an embodiment, scanning the light from two or more offset lasers in the first direction may alternatively or additionally include scanning the light in the first direction at a frequency of 27 kHz to 35 kHz. Can be. In such embodiments, scanning the light from the two or more offset lasers may alternatively or additionally include scanning the light to form an image at a resolution between 1440p and 2160p.

Another embodiment provides a scanning display system, the scanning display system comprising: a laser light source comprising two or more offset lasers, from the laser light source in a first direction at high frequency and in a second direction at low frequency to form an image; Determine the gaze direction through data from the scanning mirror system, the eye tracking sensor, and the eye tracking sensor configured to scan the light, and control the scanning mirror to scan the laser light in an interlaced pattern to form an image, at least the gaze And a controller configured to adjust one or more of a phase offset between the first frame and the second frame of the interlaced image and a scan rate in the second direction based on the orientation. In such embodiments, the display system may alternatively or additionally include a head mounted display system.

It is to be understood that the configurations and / or methods disclosed herein are exemplary in nature and that this particular embodiment or example is not to be considered as limiting, since a number of variations are possible. The particular routines or methods disclosed herein may represent one or more of any number of processing strategies. Accordingly, the various operations illustrated and / or disclosed may be performed in parallel, in the order illustrated and / or disclosed, and in other orders, or omitted. Likewise, the order of the processes can be changed.

The subject matter herein includes all new and non-obvious combinations and sub-combinations of the various processes, systems, and configurations and other features, functions, operations, and / or attributes disclosed herein in addition to any and all equivalents. Include.

Claims (15)

A scanning display system,
A laser light source comprising at least two offset lasers;
A scanning mirror system configured to scan light from the laser light source in a first direction at high frequency and in a second direction at low frequency to form an image; And
Scan the laser light with an interlaced pattern for forming the image and at least one of a scan rate in the second direction and a phase offset between the first frame and the second frame of the interlaced pattern A controller configured to control the scanning mirror system to adjust the
Including, a scanning display system. The method of claim 1,
And the scanning mirror system comprises a first mirror configured to scan the laser light in the first direction and a second mirror configured to scan the laser light in the second direction. The method of claim 1,
The controller is configured to adjust the time between the first frame and the second frame by adjusting a time at which the scanning mirror system starts scanning of the laser light in the second direction compared to scanning of the laser light in the first direction. And configured to adjust the phase offset. The method of claim 1,
And the controller is configured to adjust the phase offset between the first frame and the second frame based on a desired line spacing in an area within the image. The method of claim 4, wherein
And the region is one of a plurality of regions in the image, wherein the controller is configured to associate an individual phase offset with each of the plurality of regions. The method of claim 1,
And an eye tracking sensor configured to detect a gaze direction of a user, wherein the controller is further configured to map the gaze direction to an area in the image and to scan the scan rate in the second direction based on an area in the image and And adjust one or more of the phase offsets. The method of claim 6,
The controller also adjusts the phase offset in a first manner based on the mapping of the gaze direction to the first area in the image, and based on the mapping of the gaze direction to the second area in the image. And adjust the phase offset in a manner. The method of claim 6,
The region is a foveal region of the image, the image comprising a non-foveal region, and the controller is further configured to determine a scan rate in the non-oviville region in the second direction. And increase and decrease the scan rate in the second direction in the pavil area. The method of claim 1,
And the two or more offset lasers are vertically offset in a central alignment orientation with respect to the second scan direction. The method of claim 9,
And the controller is further configured to compensate for line spacing error in rotational orientation by adjusting the scan rate in the second direction. The method of claim 1,
And the scanning mirror system is configured to scan a horizontal line of the image in a half period of a microelectromechanical actuator driving the scanning mirror system. The method of claim 1,
And the scanning display system is configured to scan in the first direction at a frequency of 27 kHz to 35 kHz. The method of claim 1,
And the controller is configured to control the mirror system to form the image at a resolution between 1440p and 2160p. The method of claim 1,
And the laser light source is configured to output a plurality of colors of light. As an image display method,
Directing light from the two or more offset lasers towards the scanning mirror system; And
Scanning the laser light in an interlaced pattern and forming the image by scanning light from the two or more offset lasers in a first direction at a high frequency and in a second direction at a low frequency
Comprising an image display method.

Images