WO2020042907A1 - 一种光纤扫描显示装置及设备、扫描方法 - Google Patents

一种光纤扫描显示装置及设备、扫描方法 Download PDF

Info

Publication number
WO2020042907A1
WO2020042907A1 PCT/CN2019/100523 CN2019100523W WO2020042907A1 WO 2020042907 A1 WO2020042907 A1 WO 2020042907A1 CN 2019100523 W CN2019100523 W CN 2019100523W WO 2020042907 A1 WO2020042907 A1 WO 2020042907A1
Authority
WO
WIPO (PCT)
Prior art keywords
scanner
scanning
image
focus area
display device
Prior art date
Application number
PCT/CN2019/100523
Other languages
English (en)
French (fr)
Inventor
姚长呈
Original Assignee
成都理想境界科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 成都理想境界科技有限公司 filed Critical 成都理想境界科技有限公司
Publication of WO2020042907A1 publication Critical patent/WO2020042907A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10—Scanning systems
    • G02B26/103—Scanning systems having movable or deformable optical fibres, light guides or waveguides as scanning elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10—Scanning systems
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/02—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes by tracing or scanning a light beam on a screen

Definitions

  • the invention relates to the technical field of optical fiber scanning, in particular to an optical fiber scanning display device and device, and a scanning method.
  • Laser scanning imaging refers to the use of laser light as a light source, and the laser scanning imaging device scans the image surface in a preset manner and changes the color of the emitted laser light accordingly, so that laser scanning imaging can be realized on the image surface.
  • raster scanning Lisa such as scanning are mainly used to scan the emitted scanning light, and then image rendering is used.
  • the size and resolution of the obtained image are relatively fixed, the number of pixels included is small, and the pixel density (Pixels, Per Inch, PPI) is constant.
  • the electron beam is scanned according to a fixed scanning line and a prescribed scanning order, that is, a rule from left to right and top to bottom. After scanning one line, it moves to the starting position of the next line to continue. Scan until the last line is scanned to complete the entire screen scan.
  • the object of the present invention is to provide an optical fiber scanning display device, device and scanning method, which are used to solve the technical problems of low pixel density and poor local rendering effect of scanned images of the optical fiber scanning display device in the prior art.
  • an embodiment of the present invention provides a fiber scanning display device, which includes a first scanner, at least one second scanner, a processor, a light source corresponding to the first scanner, and A light source corresponding to a second scanner, the first scanner and the second scanner have the same and synchronized frame rate, and the scanning amplitude of the second scanner is smaller than that of the first scanner;
  • the first scanner is configured to perform global scanning on an image to be displayed, and the processor is configured to determine a corresponding focus area of a human eye in the image to be displayed, and perform image interpolation processing on the focus area.
  • the two scanners are used to scan and display the focus area that has been subjected to image interpolation processing.
  • the first scanner scans the focus area
  • the light source corresponding to the first scanner is turned off and only passes through the second scanner. Scan the scanning light that emits pixels in the focus area.
  • the optical fiber scanning display device further includes:
  • a first scanning driver for driving a scanning fiber in the first scanner
  • the processor is further configured to obtain position change information corresponding to a change in the position of the focus area, and control the scan driver to provide the second scanner with a driving signal corresponding to the position change information; wherein,
  • the position change information includes direction information and displacement information.
  • the optical fiber scanning display device further includes an optical magnifying glass group, and the optical magnifying glass group includes at least one optical lens, and the optical magnifying glass group is disposed at an exit end of the optical fiber scanning display device and is used for The scanning light emitted from the scanner or the second scanner is projected onto the projection carrier.
  • the scanning range of the second scanner is smaller than the scanning range of the first scanner.
  • the slow axis frequency of the first scanner and the second scanner are the same.
  • an embodiment of the present invention provides a scanning method, which is applied to an optical fiber scanning display device.
  • the optical fiber scanning display device includes a first scanner, at least one second scanner, a light source corresponding to the first scanner, and The light source corresponding to the second scanner, the first scanner and the second scanner have the same and synchronized frame rate, and the scanning amplitude of the second scanner is smaller than that of the first scanner, so
  • the methods include:
  • the second scanner is used to scan and display a focus area that has been subjected to image interpolation processing, and controls the first scanner to keep the light source corresponding to the first scanner in an off state in the focus area.
  • the method further includes:
  • a driving signal corresponding to the position change information is provided to the second scanner.
  • the method further includes:
  • the modulation information includes a pixel gray value and a display modulation timing
  • Scanning and displaying a focused area after image interpolation processing by using the second scanner includes:
  • the scanning light that is emitted from the pixels in the focus area is scanned according to the modulation information.
  • an embodiment of the present invention provides an optical fiber scanning display device, including a processor and an optical fiber scanning display device.
  • the optical fiber scanning display device includes a first scanner, at least one second scanner, and corresponds to the first scanner.
  • Light source corresponding to the second scanner, the first scanner and the second scanner have the same and synchronized frame rate, and the scanning range of the second scanner is smaller than that of the first scanner
  • the processor is configured to determine a focus area when a human eye is focused in a scanning field of view of the optical fiber scanning display device, and perform image interpolation processing on the focus area
  • the first scanner is used for an image to be displayed
  • the second scanner is used to scan and display a focus area subjected to image interpolation processing, and when the first scanner scans the focus area, a light source corresponding to the first scanner is turned off .
  • the fiber-optic scanning display device scans the image to be displayed globally by scanning the first scanner, and the processor can determine the corresponding focus area of the human eye in the image to be displayed, and perform image interpolation processing on the focus area to increase
  • the pixel density in the focus area allows more pixels to be included in the focused field of view, and a second scanner with a smaller scan amplitude is used to scan and display the focus area that has undergone image interpolation processing, and controls the first scanner
  • the focus area is scanned, the light source is turned off to display the picture of the focus area only through the second scanner.
  • the local focus area with a higher pixel density in the display image has higher sharpness and less graininess. It helps to increase the pixel density of the rendering area in the partial rendering of the image, and improves the projection display effect of the optical fiber scanning display device.
  • FIG. 1 is a schematic structural diagram of an optical fiber scanning display device according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a projected display image of an optical fiber scanning display device according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a scanning method according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a fiber scanning structure in an embodiment of the present invention.
  • the optical fiber scanning display device includes a processor 10, a first scanner 20, at least one second scanner 30, and a corresponding one of the first scanner 20.
  • the first scanner 20 and the second scanner 30 have the same and synchronized frame rate.
  • the scanning amplitude of the second scanner 30 is much smaller than that of the first scanner 20.
  • the processor 10 may be configured to determine a corresponding focus area of the human eye in the image to be displayed, perform image interpolation processing on the focus area, and perform image interpolation processing through the second scanner 30 To scan and display the focused area of the camera, and control the first scanner 20 to keep the light source corresponding to the first scanner 20 in the focused area in the off state, that is, the first scanner can scan normally in the focused area, but does not project the display
  • the second scanner 30 is scanned.
  • the fiber-optic scanning display device may further include components such as an image source and a fiber-optic magnifier group, which are not shown in FIG. 1 one by one.
  • the image source can be used to provide an image to be displayed for a fiber-optic scanning display device.
  • the optical magnifying glass set is arranged on the exit light path of the scanner and can be used to process the exit light of the scanner and then project it onto a projection carrier, such as the human eye or a curtain Wait.
  • the above-mentioned optical fiber scanning display device is provided with a first scanner 20 and a second scanner 30 with different scanning amplitudes.
  • the amplitude of the second scanner 30 may be set in advance or adjusted according to the actual needs of the user.
  • the scanning range of the second scanner 30 is much smaller than the scanning range of the first scanner 20, so as to achieve the purpose of local encryption.
  • the processor 10 may detect a focus area corresponding to the human eye in the image to be displayed, and perform an interpolation process on the focus area into the image to make the focus
  • the area contains more pixels, which increases the pixel density of the focused area, with higher definition and smaller graininess, which effectively improves the display capability of the device scan.
  • optical fiber scanning display device provided by the embodiments of the present invention will be described in detail below by way of examples.
  • the frame rates of the first scanner 20 and the second scanner 30 included in the optical fiber scanning display device are the same and synchronized, and the scanning amplitude of the first scanner 20 is much larger than that of the second scanner 30.
  • the image projected by the first scanner 20 and the image projected by the second scanner 30 can be calculated and output in real time through rendering technology, and the pixel density corresponding to the image to be displayed and locally (corresponding to the focus area) is displayed. Enlarged image.
  • the first scanner 20 and the second scanner 30 may have the same structure.
  • the first scanner 20 is a scanner used for conventional scanning
  • the second scanner 30 is a scanner with a smaller driving voltage, which can be used with a small swing. More pixels are displayed in amplitude modulation, that is, the second scanner 30 can scan an image area with a larger pixel density. Therefore, if the first scanner 20 and the second scanner 30 are used to scan different regions in the same frame to be displayed, the pixel density of the displayed image scanned by the second scanner 30 will be greater than that of the first scanner 20 The pixel density of the scanned display image.
  • the fast axis frequency and the slow axis frequency of the scanner together determine the scanning resolution of the scanner.
  • the first scanner 20 and the second scanner 30 may have the same slow axis frequency, and the fast axis frequency may be Different, the fast axis frequency and slow axis frequency together determine the scanning resolution of the scanner.
  • Each scanner in the optical fiber scanning display device corresponds to a light source
  • the light source may be a laser light source.
  • the light source may include at least one laser.
  • the light source includes a red laser, a green laser, a blue laser, and a light combining unit, three of which correspond to the three color channels of each pixel in the image to be displayed.
  • the image to be displayed uses the RGB color mode, that is, Each pixel in the image to be displayed has a red channel, a green channel, and a blue channel.
  • the red laser, the green laser, and the blue laser in the light source correspond to the three color channels of each pixel in the image to be displayed.
  • the output energy of each of the red laser light source, the green laser light source, and the blue laser light source can be adjusted.
  • the light combining unit includes a red light combining unit provided at the output end of the red laser, a green light combining unit provided at the output end of the green laser, and a blue light combining unit provided at the output end of the blue laser; Or the light emitted by the blue laser is combined together.
  • the reflected light or projected light of each light combining unit in the light combining unit according to the design of the optical path between the red laser, the green laser and the blue laser, the reflected light or projected light of each light combining unit in the light combining unit. The characteristics will be correspondingly different, and there is no limitation here.
  • the scanning fiber in the fiber-optic scanning display device has no physical pixel size limitation, it is determined whether the local area is projected and displayed by controlling the on and off of the light source (such as controlling the on and off of the laser). By controlling the lighting duration of the laser, the size of the pixel grid can be determined. In an ideal state, the laser starts to light after the light spot enters a certain pixel area, and before the pixel is out, the laser is turned off to avoid overlapping of pixels and affecting contrast.
  • the first scanner 20 is used to perform global scanning on the image to be displayed, and the pixel density corresponding to the projected and displayed image is relatively small, and it can be considered that the image corresponding to the displayed image is a display image of a normal resolution.
  • the fiber-optic scanning display device may detect the corresponding focus area of the human eye in the image to be displayed by the processor 10.
  • the focus area may be the field of view area when the human eye focuses in the scanning field of view of the fiber-optic scan display device.
  • the display image corresponds to the determined pixel area.
  • the processor 10 may determine the focus area by detecting the fixation point of the human eye. For example, after the processor 10 detects the corresponding pixel position of the fixation point of the human eye in the image to be displayed, the processor 10 corresponds to the fixation point of the human eye.
  • the pixel position is the center, and a pixel area of a preset size in the image to be displayed is determined as a focus area. For example, a pixel area corresponding to a pixel size of 4096 * 2160 is used as a focus area.
  • the fiber-optic scanning display device may include a detection device connected to the processor 10, such as a sensor.
  • the sensor can detect relevant data of the pupil of the human eye during the scanning process, so that the processor 10 can determine the focus of the human eye through the data detected by the sensor. Location area.
  • the sensor may be an eye-tracking camera.
  • the eye-tracking camera collects human eye images during the scanning process of the fiber-optic scanning display device, and the processor 10 determines the focus area by using eye tracking technology.
  • eye movement tracking refers to a technique for tracking eye movements by measuring the position of the gaze point of the eyes or the movement of the eyeballs relative to the head.
  • the optical fiber scanning display device includes an eye movement tracker.
  • the eye movement tracker can locate the pupil position and obtain the coordinates of the pupil center through image processing technology, so as to track the eye movement by calculating a person's gaze point.
  • image processing technology so as to track the eye movement by calculating a person's gaze point.
  • the processor 10 may determine the focus area when the human eye is focused in the scanning field of view of the fiber-optic scanning display device through the eye tracker.
  • the processor 10 may perform image interpolation processing on the focus area.
  • Image interpolation is to use the gray values of known neighboring pixels (or tri-color values in RGB images) to generate the gray values of unknown pixels in order to achieve a higher resolution image from the original image, thereby increasing The number of pixels in the focus area increases the pixel density.
  • the fiber-optic scanning display device uses at least one second scanner 30 to scan and display the focus area after the image interpolation process, corresponding to a display image with a larger display pixel density.
  • the plurality of second scanners 30 may scan and project different areas of the focused area, respectively.
  • a second scanner 30 is mainly used as an example for description.
  • the second scanner 30 may store a look-up table (LUT), and the LUT table may be applied to a mapping table of pixel gray values, which will actually sample the pixel gray. After a certain transformation such as threshold, inversion, binarization, contrast adjustment, linear transformation, etc., it becomes another corresponding gray value to play out the useful information of the image and enhance the light contrast of the image To improve image quality.
  • LUT look-up table
  • the processor 10 may perform the interpolation according to the LUT table when performing image interpolation processing on the focus area. That is, the display specification (resolution) of the second scanner 30 can be considered as determined according to the degree of encryption of the pixels, and is reflected in the LUT table of the second scanner 30.
  • the processor 10 determines that the first scanner 20 has scanned the focused area, for example, when the currently scanned pixel is a pixel in the focused area, it can turn off the light source of the first scanner 20 and stop projecting the first A scanner 20 scans the light and keeps the first scanner 20 in a focused area to keep the light source in an off state.
  • the first scanner 20 and the second scanner 30 may be activated at the same time when the optical fiber scanning display device operates, and the light sources are both on.
  • the processor 10 determines the focus area when the human eye is focused in the scanning field of view of the fiber-optic scanning display device and performs interpolation processing on the focus area
  • the first scanner 20 may be started to perform a global scan on the image to be displayed.
  • the second scanner 30 is also activated to scan and display the corresponding processed focus area in the image to be displayed. Then, when it is determined that the focus area is scanned by the first scanner 20, the light source of the first scanner 20 may be controlled to be turned off, so that the focus area is scanned and displayed only by the second scanner 30.
  • the first scanner 20 and the second scanner 30 may not be started synchronously.
  • the first scanner 20 is activated to scan the image to be displayed globally, and then the second scanner 30 is activated to scan the focus area.
  • the processor 10 detects the corresponding focus area of the human eye in the image to be displayed, and performs image interpolation processing, and then the image can be directly processed by the second scanner 30 after interpolation
  • the display image corresponding to the image to be displayed can be displayed at the frame rate, and then the partial image with a higher density is displayed in the display image. That is, the display image corresponding to the user's focus area.
  • FIG. 2 is a schematic diagram of a display image corresponding to scanning and projecting a frame of image by using a fiber-optic scanning display device.
  • a raster scanning method is used as an example in the figure.
  • Area A in the figure represents the pixel area scanned by the first scanner 20. It can be a global screen scanned according to a fixed resolution, and area B represents a focus area that has undergone image interpolation processing, that is, a pixel area scanned and projected by the second scanner 30, which is displayed by the second scanner 30 that is specifically used for pixel encryption In the picture, the pixel density of area B is greater than the pixel density of area A.
  • the optical fiber scanning display device uses a first scanner 20 to perform a global scan on an image to be displayed (corresponding to area A).
  • the processor 10 detects that the determined eye-gaze area is area B, and performs image interpolation processing on area B.
  • the second scan The device 30 is dedicated to scan and display the area B. And when it is determined that the first scanner 20 has scanned the focus area, the light source corresponding to the first scanner 20 is controlled to be turned off.
  • the processor 10 of the optical fiber scanning display device can detect the focused area of the human eye in real time, and keep the light source of the first scanner 20 in the focused area in the off state, so that only the first The two scanners 30 scan and project the image portion of the focus area after interpolation processing in the display image, so as to increase the pixel density of the focus area corresponding to the human eye in the projection display image.
  • the human eye is most sensitive to the image quality in the central part of the field of view, it is not sensitive to the image quality at the edges, and this sensitivity level decays sharply with the field of view.
  • the characteristics of optical fiber scanning imaging by utilizing the characteristics of optical fiber scanning imaging, more pixels are included in the central range of the focused field of view through control, and the local picture density of the real picture is greater, the definition is higher, and the graininess is smaller.
  • a scanning driver is provided in the scanning imaging device, and the scanning drivers are located in each scanner and are used to drive the scanning optical fiber in the corresponding scanner.
  • the fiber-optic scanning display device can drive the piezoelectric driver by supplying an alternating current signal to the scanning driver in the scanner, thereby driving the scanning fiber to swing and scan through the piezoelectric driver.
  • the pixel encryption area focus area
  • the scanning range of the second scanner is smaller, that is, the pixel encryption function can be implemented with a smaller drive (AC component).
  • the processor 10 may determine position change information when the position of the focus area changes.
  • the position change information includes at least direction information and displacement information, where the direction
  • the information can represent the change of the focus direction of the human eye
  • the displacement information can represent the moving distance of the focus area.
  • the center point of the focus area can be used as a reference point to detect the movement direction and distance of the center point during the position change process to determine the position change information.
  • the processor 10 may acquire the position change information of the focus area in real time, and obtain the moving direction and distance of the focus area in time.
  • the processor 10 can control the driving signal of the second scanner 30 according to the moving direction and moving distance of the focus area, so as to realize the translation of the projection display area of the second scanner 30, thereby achieving The effect that the focus position of the human eye moves and the display area of the second scanner 30 moves synchronously.
  • the processor 10 may add a corresponding direction (including a horizontal direction and a vertical direction) to the driving signal according to the moving direction in the position change information.
  • the DC driving component and the translation distance of the projection display area corresponding to the second scanner 30 are controlled according to the moving distance in the position change information.
  • the scanner itself can be used as a filter, it will have different harmonic responses to the excitation signals of various spectral components. Therefore, under the action of a DC signal, the corresponding response of the scanner is an offset signal, which is reflected in the image
  • the image can be translated by adding a corresponding DC drive in a corresponding direction in the drive signal.
  • the fiber-optic scanning display device may further include an optical magnifying glass group.
  • the optical magnifying glass group includes at least one optical lens. The specific number of lenses and lens parameter settings meet the requirements of the actual situation. No specific restrictions.
  • the optical magnifying glass group can be set at the exit end of the fiber-optic scanning display device, and is used to project the scanning light emitted by the scanner to a projection carrier, such as a human eye or a curtain, for the convenience of the user to view.
  • the entrance of the scanning optical fiber in the scanner can also be provided with a lens structure, that is, the scanning optical fiber is specifically a lens optical fiber with a lens structure set at the incident end.
  • the scanning optical fiber can be sintered or ground in the optical fiber.
  • a spherical, wedge-shaped, or tapered lens is formed at one end to increase the numerical aperture of the scanning fiber, thereby improving the light receiving efficiency of the scanning fiber.
  • an embodiment of the present invention further provides a scanning method, which can be applied to an optical fiber scanning display device having a structure as shown in FIG. 1.
  • the steps of the method mainly include steps S11 to Step S13 can be described as follows:
  • step S11 the first scanner 20 in the fiber-optic scanning display device is used to globally scan the image to be displayed, and the scanning light is emitted; wherein the fiber-optic scanning display device includes the first scanner 20, at least one second scanner 30, and The first light source corresponding to the scanner 20 and the light source corresponding to the second scanner 30, the frame rates of the first scanner 20 and the second scanner 30 are the same and synchronized, and the scanning amplitude of the second scanner 30 is smaller than the first Scanning amplitude of the scanner 20.
  • step S12 determining a corresponding focus area of the human eye in the image to be displayed, and performing image interpolation processing on the focus area.
  • step S13 the second scanner 30 is used to scan and display the focus area after the image interpolation processing is performed, and the first scanner 20 is controlled to keep the light source corresponding to the first scanner 20 in the focus area in the off state.
  • the optical fiber scanning display device includes a first scanner 20 and a second scanner 30 with different scanning amplitudes, and the first scanner 20 and the second scanner 30 have the same and synchronized frame rates.
  • the optical fiber scanning display device uses the first scanner 20 to perform global scanning, and then determines the focus area corresponding to the human eye in the image to be displayed, and performs image interpolation processing on the focus area.
  • the second scanner 30 with a smaller scanning amplitude is used to scan the output focus.
  • the scanning light in the area displays a focused area with a higher pixel density, which increases the pixel density of the local image portion corresponding to the focus of the human eye in the displayed image, and has higher definition.
  • the first scanner 20 may be used to scan and project the image to be displayed by default, that is, the light source of the first scanner 20 is on, and the first scan may be considered.
  • the projection display image corresponding to the controller 20 is a display screen with a normal resolution.
  • the fiber-optic scanning display device can determine the corresponding focusing area when the human eye focuses in the scanning field of view of the fiber-optic scanning display device through a sensor or the like, and perform image interpolation processing on the focusing area to increase the number of pixels included in the focusing area.
  • the focus area may be an area determined according to a fixation point of a human eye. For a determination process, refer to the foregoing related description, and details are not described herein again.
  • the optical fiber scanning display device can detect and obtain the focus area in real time, and perform interpolation processing on the focus area. When the position of the focus area does not change, it is only necessary to provide the scanner with an AC drive signal for driving the fiber to swing. can.
  • the LUT table in the second scanner 30 may be used to perform the LUT table, and the LUT table contains more information showing the modulation. Then, the modulation information of the pixels in the processed focus area corresponds to the LUT table in the second scanner 30.
  • the modulation information includes the pixel gray value and the display modulation timing.
  • the second scanner 30 can be used to scan and display the focused area after the image interpolation processing to display a display image with a larger pixel density.
  • the optical fiber scanning display device determines that the first scanner 20 has scanned the focus area
  • the light source of the first scanner 20 can be controlled to be turned off, and the scanning light of the first scanner 20 is stopped from being projected and displayed, that is, the first scan
  • the scanner 20 keeps the light source turned off in the focus area, and keeps it on in other areas, so that only the second scanner 30 can project and display the scanning light corresponding to the pixels in the focus area, so as to obtain a local image with a higher density.
  • the second scanner 30 may be in an unactivated state, or the second scanner 30 may be started in synchronization with the first scanner 20, and each presses Scan at your own sweep. If the second scanner 30 is started in synchronization with the first scanner 20 and the second scanner 30 scans and displays the focus area after the image interpolation process is performed, the light source of the second scanner 30 is turned on so that It displays a focused image corresponding to the focus area, and the second scanner 30 or the light source of the second scanner 30 can be turned off after the focus area is scanned.
  • the fiber scanning display device when determining the position change of the focus area, may obtain position change information corresponding to the focus area, and the position change information includes direction information and displacement information; further, the fiber scan display device may change according to the position.
  • the information controls the driving signal of the second scanner 30 to change the position of the projection display area of the second scanner 30 so that as the focus position of the human eye changes, the position of the projection display area of the second scanning area changes synchronously and is partially displayed to The high-definition display image of the user effectively improves the user's visual experience during scanning transmission.
  • the first scanner 20 can project a corresponding projection image corresponding to the second scanner 30
  • the projected image is processed by splicing, rendering, and the like, so that an image corresponding to the image to be displayed and in focus (corresponding to the focused area) with a larger pixel density can be projected and displayed.
  • the optical fiber scanning display device detects the focus area of the human eye, performs image interpolation processing on the focus area, and uses a first
  • the two scanners 30 scan and keep the light source of the first scanner 20 turned off in the focus area, so that only the second scanner 30 can scan and display the focus area with a higher pixel density, and increase the focus in the projection display image. Partial pixel density improves display effect.
  • an embodiment of the present invention further provides a fiber scanning display device.
  • the fiber scanning display device includes a processor 200 and a fiber scanning display device 100.
  • the fiber scanning display device 100 may include a first scanning device. Scanner 20, at least one second scanner 30, a light source corresponding to the first scanner 20, and a light source corresponding to the second scanner 30.
  • the optical fiber scanning display device 100 may further include components such as an image source and an optical fiber magnifying glass group.
  • the image source can be used to provide the scanner with an image to be displayed.
  • the optical magnifying glass set is arranged on the exit light path of the scanner and can be used to process the outgoing light of the scanner.
  • FIG. 4 only shows a fiber magnifying glass set.
  • the display frame rates of the first scanner 20 and the second scanner 30 are the same and synchronized.
  • the scanning range of the second scanner 30 is smaller than the scanning range of the first scanner 20, and the processor 200 is configured to determine that the human eye scans the display device with the optical fiber.
  • 100 scans the focus area in the field of view when focusing, and performs image interpolation processing on the focus area.
  • the first scanner 20 is used for global scanning of the image to be displayed, and the second scanner 30 is used for focusing that has been subjected to image interpolation processing. The area is scanned and displayed.
  • the first scanner 20 is in the focus area, and the light source of the first scanner 20 is turned off, thereby increasing the pixel density of the focused portion of the human eye in the image projected and displayed by the optical fiber scanning display device, and improving the projection display. effect.
  • the foregoing embodiments corresponding to FIG. 1 to FIG. 3 are also applicable to the optical fiber scanning display device of this embodiment. Through the foregoing detailed description of the optical fiber scanning display device 200, those skilled in the art can clearly know the optical fiber scanning in this embodiment. The implementation of the display device is omitted here for brevity of the description.
  • any reference signs placed between parentheses shall not be construed as limiting the claim.
  • the word “comprising” or “including” does not exclude the presence of elements or steps not listed in a claim.
  • the word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements.
  • the invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claim listing several devices, several of these devices may be embodied by the same hardware item.
  • the use of the words first, second, and third does not indicate any order, and these words can be interpreted as names.
  • the fiber-optic scanning display device scans the image to be displayed globally by scanning the first scanner, and the processor can determine the corresponding focus area of the human eye in the image to be displayed, and perform image interpolation processing on the focus area to increase
  • the pixel density in the focus area allows more pixels to be included in the focused field of view, and a second scanner with a smaller scan amplitude is used to scan and display the focus area that has undergone image interpolation processing, and controls the first scanner
  • the light source is turned off to display the picture of the focus area only through the second scanner.
  • the local focus area with larger pixel density in the displayed image has higher definition and smaller graininess, which helps to increase the pixel density of the rendering area in the local rendering of the image, and improves the projection display effect of the fiber scanning display device.
  • the invention is not limited to the foregoing specific embodiments.
  • the invention extends to any new feature or any new combination disclosed in this specification, and to any new method or process step or any new combination disclosed.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Mechanical Optical Scanning Systems (AREA)

Abstract

一种光纤扫描显示装置及设备、扫描方法，用于在图像局部渲染中增大渲染区域像素密度，提升扫描显示装置的显示效果，光纤扫描显示装置包括：第一扫描器(20)、至少一个第二扫描器(30)、处理器(10)以及与扫描器(20,30)对应的光源，第一扫描器(20)和第二扫描器(30)具有相同且同步的帧率，第二扫描器(30)的扫描幅度小于第一扫描器(20)的扫描幅度；其中，第一扫描器(20)用于对待显示图像进行全局扫描，处理器(10)用于确定人眼在待显示图像中对应的聚焦区域(B)，并对聚焦区域(B)进行图像插值处理，第二扫描器(30)用于对图像插值处理后的聚焦区域(B)进行扫描显示，第一扫描器(20)在扫描聚焦区域(B)时，与第一扫描器(20)对应的光源处于关闭状态。

Description

一种光纤扫描显示装置及设备、扫描方法
本申请要求享有2018年8月31日提交的名称为“一种光纤扫描显示装置及设备、扫描方法”的中国专利申请CN201811009527.5的优先权，其全部内容通过引用并入本文中。
技术领域
本发明涉及光纤扫描技术领域，尤其涉及一种光纤扫描显示装置及设备、扫描方法。
背景技术
激光扫描成像是指利用激光作为光源，通过激光扫描成像装置在像面上按照预设的方式进行扫描，同时相应改变出射激光的色彩，这样即能够在像面上实现激光扫描成像。
目前，在实现激光扫描成像的过程中，主要采用光栅扫描、利萨如扫描等方式扫描出射扫描光线，后再采用图像渲染等手段。但这些扫描方式中，获得的画面的尺寸和分辨率较为固定，包含的像素点数较少，像素密度(Pixels Per Inch，PPI)恒定。例如，在光栅扫描方式中，电子束按照固定的扫描线和规定的扫描顺序进行扫描，即从左往右、由上往下的规则，先扫描完一行，再移至下一行起始位置继续扫描，直至扫描到最后一行，以完成整个屏幕的扫描。因此，在扫描成像系统中，对于固定的视场范围，如人眼的注视区域，人眼仅能看到有限且较少的像素个数。而在实际应用中，通常还会结合图像渲染等手段，来使图像中特定区域内的显示内容色彩更为丰富、细节更突出，但对于扫描图像来说，由于其整体画面分辨率固定，特定区域包含的像素个数较少，即便渲染也无法达到较好的效果。
发明内容
本发明的目的是提供一种光纤扫描显示装置及设备、扫描方法，用于解决现有技术中光纤扫描显示装置的扫描图像的像素密度较低，局部渲染效果较差的技术问题。
为了实现上述发明目的，第一方面，本发明实施例提供了一种光纤扫描显示装置，其包括第一扫描器、至少一个第二扫描器、处理器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫 描器的扫描幅度小于所述第一扫描器的扫描幅度；
其中，所述第一扫描器用于对待显示图像进行全局扫描，所述处理器用于确定人眼在所述待显示图像中对应的聚焦区域，并对所述聚焦区域进行图像插值处理，所述第二扫描器用于对进行了图像插值处理的聚焦区域进行扫描显示，所述第一扫描器在扫描所述聚焦区域时，与该第一扫描器对应的光源处于关闭状态，仅通过第二扫描器扫描出射所述聚焦区域内的像素的扫描光线。
可选的，所述光纤扫描显示装置还包括：
第一扫描驱动器，用于驱动第一扫描器中的扫描光纤；以及
第二扫描驱动器，用于驱动第二扫描器中的扫描光纤；
所述处理器还用于获取所述聚焦区域的位置变化时所对应的位置变化信息，并控制所述扫描驱动器对所述第二扫描器提供与所述位置变化信息相应的驱动信号；其中，所述位置变化信息包括方向信息和位移信息。
可选的，所述光纤扫描显示装置还包括光学放大镜组，所述光学放大镜组包括至少一个光学透镜，所述光学放大镜组设置于所述光纤扫描显示装置的出射端，用于将第一扫描器或者第二扫描器出射的扫描光线投射到投射载体。
可选的，所述第二扫描器的扫描范围小于所述第一扫描器的扫描范围。
可选的，所述第一扫描器与所述第二扫描器的慢轴频率相同。
第二方面，本发明实施例提供一种扫描方法，应用于光纤扫描显示装置，所述光纤扫描显示装置包括第一扫描器、至少一个第二扫描器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫描器的扫描幅度小于所述第一扫描器的扫描幅度，所述方法包括：
采用所述光纤扫描显示装置中的所述第一扫描器对待显示图像进行全局扫描；
确定人眼在所述待显示图像中对应的聚焦区域，并对所述聚焦区域进行图像插值处理；
采用所述第二扫描器对进行了图像插值处理后的聚焦区域进行扫描显示，并控制所述第一扫描器在所述聚焦区域内保持与该第一扫描器对应的光源处于关闭状态。
可选的，所述方法还包括：
在确定所述聚焦区域的位置变化时，获取所述聚焦区域对应的位置变化信息，所述位置变化信息包括方向信息和位移信息；
对所述第二扫描器提供与所述位置变化信息相应的驱动信号。
可选的，在对所述聚焦区域进行图像插值处理之后，所述方法还包括：
存储处理后的所述聚焦区域中像素的调制信息，所述调制信息包括像素灰度值和显示调制时序；
采用所述第二扫描器对进行了图像插值处理后的聚焦区域进行扫描显示，包括：
采用所述第二扫描器扫描图像插值处理后的聚焦区域；
根据所述调制信息扫描出射所述聚焦区域中像素的扫描光线。
第三方面，本发明实施例提供一种光纤扫描显示设备，包括处理器和光纤扫描显示装置，所述光纤扫描显示装置包括第一扫描器、至少一个第二扫描器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫描器的扫描幅度小于所述第一扫描器的扫描幅度，所述处理器用于确定人眼在所述光纤扫描显示装置的扫描视场中聚焦时的聚焦区域，并对所述聚焦区域进行图像插值处理，所述第一扫描器用于对待显示图像进行全局扫描，所述第二扫描器用于对进行了图像插值处理的聚焦区域进行扫描显示，所述第一扫描器在扫描所述聚焦区域时，与该第一扫描器对应的光源处于关闭状态。
本发明实施例中的一个或者多个技术方案，至少具有如下技术效果或者优点：
光纤扫描显示装置通过扫描幅度较大第一扫描器对待显示图像进行全局扫描，以及，通过处理器可确定人眼在待显示图像中对应的聚焦区域，并对聚焦区域进行图像插值处理，增大聚焦区域内的像素密度，使得聚焦的视场范围内包含更多的像素，进而采用扫描幅度较小的第二扫描器对进行了图像插值处理的聚焦区域进行扫描显示，并控制第一扫描器在扫描聚焦区域时，光源处于关闭状态，以仅通过第二扫描器显示聚焦区域的画面。由于第一扫描器和第二扫描器具有相同且同步的帧率，故在显示待显示图像时，显示图像中的像素密度较大的局部聚焦区域的清晰度更高，颗粒感更小，有助于在图像局部渲染中增大渲染区域像素密度，提高光纤扫描显示装置的投射显示效果。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以 根据这些附图获得其他的附图：
图1为本发明实施例中光纤扫描显示装置的结构示意图；
图2为本发明实施例中光纤扫描显示装置的投射显示图像的示意图；
图3为本发明实施例中扫描方法的流程图；
图4为本发明实施例中光纤扫描结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明实施例提供一种光纤扫描显示装置，如图1所示，该光纤扫描显示装置包括处理器10、第一扫描器20、至少一个第二扫描器30、与第一扫描器20对应的光源以及与第二扫描器30对应的光源。
其中，光纤扫描显示装置中第一扫描器20和第二扫描器30具有相同且同步的帧率，第二扫描器30的扫描幅度远小于第一扫描器20的扫描幅度，光纤扫描显示装置用于扫描待显示图像并出射扫描光线，处理器10可以用于确定人眼在待显示图像中对应的聚焦区域，并对聚焦区域进行图像插值处理，并通过第二扫描器30对图像插值处理后的聚焦区域进行扫描显示，且控制第一扫描器20在该聚焦区域内保持与该第一扫描器20对应的光源处于关闭状态，即第一扫描器在聚焦区域可以正常扫描，但不投射显示图像，仅通过第二扫描器30扫描出射图像插值处理后的聚焦区域内的像素对应的扫描光线。
在实际应用中，光纤扫描显示装置还可以包括图像源、光纤放大镜组等部件，图1中未一一示出。其中，图像源可用于为光纤扫描显示装置提供待显示图像，光学放大镜组设置在扫描器的出射光路上，可用于对扫描器的出射光进行处理，进而投射到投射载体，如人眼或幕布等。
上述的光纤扫描显示装置中，设置有扫描幅度不同的第一扫描器20和第二扫描器30，第二扫描器30的幅度可以是预先设定的，也可以根据用户的实际需求进行调整，且第二扫描器30的扫描幅度远小于第一扫描器20的扫描幅度，以便于实现局部加密的目的。在采用扫描幅度较大的第一扫描器20对待显示图像的像素进行扫描时，处理器10可以检测待显示图像中与人眼对应的聚焦区域，并对聚焦区域进场图像插值处理，使得聚焦区域内 包含更多的像素，增大了聚焦区域的像素密度，清晰度更高，颗粒感更小，有效提高装置扫描的显示能力。
为了使本领域的技术人员更加理解本发明实施例提供的技术方案，下面对本发明实施例提供的光纤扫描显示装置进行详细举例说明。
本发明实施例中，光纤扫描显示装置包括的第一扫描器20和第二扫描器30的帧率相同且同步，第一扫描器20的扫描幅度远大于第二扫描器30的扫描幅度。在扫描过程中，通过渲染技术可将第一扫描器20投射的图像与第二扫描器30投射的图像进行实时计算和输出，显示与待显示图像相对应且局部(对应于聚焦区域)像素密度增大的图像。
第一扫描器20和第二扫描器30可以具有相同的结构，第一扫描器20是常规扫描使用的扫描器，第二扫描器30是驱动电压较小的扫描器，可在很小的摆动幅度下调制显示较多的像素，即第二扫描器30可以扫描出射像素密度较大的图像区域。因此，若采用第一扫描器20和第二扫描器30分别对同一帧待显示图像中的不同区域进行扫描，则第二扫描器30扫描出射的显示图像的像素密度将大于第一扫描器20扫描出射的显示画面的像素密度。扫描器的快轴频率和慢轴频率共同决定了扫描器的扫描分辨率，本发明实施例中，第一扫描器20和第二扫描器30可以具有相同的慢轴频率，其快轴频率可以不同，快轴频率和慢轴频率共同决定了扫描器的扫描分辨率。
光纤扫描显示装置中每个扫描器对应有一个光源，光源可以是激光光源。在实际应用中，光源可以包括至少一个激光器。例如，如果光源包括红色激光器、绿色激光器、蓝色激光器和合光单元，其中三个激光器与待显示图像中每个像素的三个色彩通道一一对应，例如待显示图像采用RGB色彩模式，也即待显示图像中每个像素都具有红色通道、绿色通道和蓝色通道，则光源中的红色激光器、绿色激光器和蓝色激光器与待显示图像中每个像素的三个色彩通道一一对应。红色激光光源、绿色激光光源和蓝色激光光源中每个激光光源的输出能量都可以调节。
合光单元包括设置于红色激光器的出射端的红光合光单元、设置于绿色激光器的出射端的绿光合光单元和设置于蓝色激光器的出射端的蓝光合光单元；用于将红色激光器、绿色激光器或蓝色激光器各自出射的光线组合在一起，在其他实施例中，根据红色激光器、绿色激光器和蓝色激光器之间的光路设计的不同，合光单元中各个合光单元的反射光或投射光的特性也会相应不同，在此不做限制。
由于光纤扫描显示装置中的扫描光纤没有物理像素尺寸的限制，因此通过控制光源的开启和关闭(如控制激光器的亮灭)来决定局部区域是否投射显示。通过控制激光器的点 亮时长，可以决定像素网格的尺寸。理想状态下，激光器在光斑进入某像素区域后开始点亮，在出该像素之前，即关断激光器，以避免造成像素的重叠，影响对比度。
本发明实施例中，采用第一扫描器20对待显示图像进行全局扫描，对应投射显示的图像的像素密度较小，可以认为其对应显示的图像为常规分辨率的显示图像。以及，光纤扫描显示装置可以通过处理器10检测人眼在待显示图像中对应的聚焦区域，聚焦区域可以是根据人眼在光纤扫描显示装置的扫描视场中聚焦时的视场区域，在待显示图像对应所确定的像素区域。
在实际应用中，处理器10可以通过检测人眼的注视点来确定聚焦区域，例如处理器10检测到人眼注视点在待显示图像中对应的像素位置后，以人眼的注视点对应的像素位置为中心，将待显示图像中预设大小的像素区域确定为聚焦区域，如将对应像素尺寸为4096*2160的像素区域作为聚焦区域。
光纤扫描显示装置中可以包括与处理器10连接的检测装置，如传感器等，传感器可以在扫描过程中实时检测人眼瞳孔的相关数据，从而处理器10通过传感器检测的数据可以确定人眼聚焦的位置区域。例如，传感器可以是眼动追踪摄像头，眼动追踪摄像头在光纤扫描显示装置扫描过程中采集人眼图像，进而处理器10利用眼动追踪(Eye Tracking)技术确定聚焦区域。其中，眼动追踪是指通过测量眼睛的注视点的位置或者眼球相对头部的运动而实现对眼球运动的追踪的技术。
或者，光纤扫描显示装置中包括眼动追踪器，眼动追踪器可以通过图像处理技术，定位瞳孔位置，获取瞳孔中心坐标，从而通过计算人的注视点，实现对眼睛运动的追踪。在进行眼球定位时可采用的方法较多，比如霍夫圆检测、阈值分割、灰度投射、模板匹配、神经网络训练等等。那么，处理器10可以通过眼动追踪器确定人眼在光纤扫描显示装置的扫描视场中聚焦时的聚焦区域。
进一步，处理器10在确定聚焦区域后，即可对聚焦区域进行图像插值处理。图像插值就是利用已知邻近像素点的灰度值(或RGB图像中的三色值)来产生未知像素点的灰度值，以实现由原始图像再生出具有更高分辨率的图像，从而增加聚焦区域内包含的像素数量，增大像素密度。
进而，光纤扫描显示装置采用至少一个第二扫描器30对图像插值处理后的聚焦区域进行扫描显示，对应显示像素密度较大的显示图像。例如，如果是多个第二扫描器30，则多个第二扫描器30可以分别对聚焦区域的不同区域进行扫描投射。本发明实施例中主要以一个第二扫描器30为例进行说明。
在实际应用中，第二扫描器30中可以存储有显示查找表(Look-Up Table，LUT)，LUT表可以应用到一张像素灰度值的映射表，它将实际采样到的像素灰度值经过一定的变换如阈值、反转、二值化、对比度调整、线性变换等，变成另一个与之对应的灰度值，以起到突出图像的有用信息，增强图像的光对比度的作用，提高图像质量。
本发明实施例中，处理器10在对聚焦区域进行图像插值处理时即可根据LUT表来进行。也就是说，第二扫描器30的显示规格(分辨率)可以按照像素的加密度来认为确定，并体现在第二扫描器30的LUT表中。
在实际应用中，处理器10在确定第一扫描器20扫描到聚焦区域时，例如当前扫描的像素为聚焦区域内的像素时，即可关闭第一扫描器20的的光源，停止投射显示第一扫描器20的扫描光线，并保持第一扫描器20在聚焦区域内保持光源处于关闭状态。
具体来说，在光纤扫描显示装置工作初期第一扫描器20和第二扫描器30可以是同时启动的，且光源均处于开启状态。例如，若处理器10在确定人眼在光纤扫描显示装置的扫描视场中聚焦时的聚焦区域，并对聚焦区域进行插值处理后，即可启动第一扫描器20对待显示图像进行全局扫描，同时也启动第二扫描器30对待显示图像中对应的处理后的聚焦区域进行扫描显示。那么，在确定第一扫描器20扫描到聚焦区域时，即可控制第一扫描器20的光源处于关闭状态，实现仅通过第二扫描器30扫描显示聚焦区域。
或者，第一扫描器20和第二扫描器30也可以不是同步启动的。例如，在光纤扫描显示装置工作初期，先启动了第一扫描器20对待显示图像进行全局扫描，后再启动第二扫描器30对聚焦区域进行扫描。例如，在第一扫描器20的扫描过程中，通过处理器10检测人眼在待显示图像中对应的聚焦区域，并进行图像插值处理，然后可直接通过第二扫描器30对图像插值处理后的聚焦区域进行扫描显示，并在第一扫描器20和第二扫描器30完成扫描后，便可按照帧率显示待显示图像对应的显示图像，则显示图像中具有较高密度的局部图像，即为用户聚焦区域对应的显示图像。
例如，图2为采用光纤扫描显示装置扫描投射一帧图像对应的显示图像示意图，图中以扫描器均采用光栅扫描方式为例，图中区域A代表第一扫描器20扫描投射的像素区域，其可以是按照固定分辨率扫描的全局画面，区域B代表经过图像插值处理的聚焦区域，即为第二扫描器30扫描投射的像素区域，专门用于像素加密的第二扫描器30所显示的画面，区域B的像素密度大于区域A的像素密度。光纤扫描显示装置采用第一扫描器20对待显示图像(对应于区域A)进行全局扫描，处理器10检测确定的人眼注视区域为区域B，并对区域B进行了图像插值处理，第二扫描器30专用于对区域B进行扫描显示。且 在确定第一扫描器20扫描到聚焦区域时，控制第一扫描器20对应的光源关闭。
因此，在扫描投射过程中，光纤扫描显示装置的处理器10可以实时检测人眼聚焦区域，并在聚焦区域内保持第一扫描器20的光源处于关闭状态，实现仅通过振动幅度较小的第二扫描器30对待显示图像中经插值处理后的聚焦区域的图像部分进行扫描投射，提高投影显示图像中人眼对应的聚焦区域的像素密度。
由于人眼对聚焦的视场中央部分的画质最敏感，而对边缘的画质不敏感，且这种敏感程度随视场衰减剧烈。本发明实施例中，利用光纤扫描成像的特点，通过控制使聚焦的视场中央范围内包含更多的像素，现实画面局部像素密度更大，清晰度更高，颗粒感更小。
在本发明另一实施例中，扫描成像装中设置有扫描驱动器，扫描驱动器位于各扫描器中，用于驱动相应扫描器中的扫描光纤。在实际应用中，光纤扫描显示装置可以通过给扫描器中扫描驱动器提供交流电信号驱动压电驱动器，从而通过压电驱动器带动扫描光纤摆动扫描。同时，由于通常情况下，像素加密区域(聚焦区域)相比画面尺寸较小，因此第二扫描器的扫描范围较小，即可以较小的驱动(交流成分)实现此像素加密功能。
光纤扫描显示装置在扫描过程中，如果人眼的聚焦区域的位置发生改变，处理器10可以确定聚焦区域位置变化时的位置变化信息，该位置变化信息中至少包括方向信息和位移信息，其中方向信息可以表征人眼聚焦方向的变化，位移信息可以表征聚焦区域的移动距离。例如，可以以聚焦区域的中心点为参考点，检测中心点在位置变化过程中的移动方向和距离确定位置变化信息。当然，在实际应用中，处理器10可实时获取聚焦区域的位置变化信息，以及时获取聚焦区域的移动方向和移动距离。
在获得位置变化信息后，处理器10可根据聚焦区域的移动方向和移动距离，控制第二扫描器30的驱动信号，以实现第二扫描器30的投射显示区域的平动，从而实现随着人眼聚焦位置的移动，第二扫描器30的显示区域同步移动的效果。
具体来说，在实现改变第二扫描器30的投射显示区域的平动时，处理器10可以根据位置变化信息中的移动方向，在驱动信号中增加相应方向(包括水平方向和垂直方向)的直流驱动的成分，以及根据位置变化信息中的移动距离，控制第二扫描器30对应的投射显示区域的平动距离。
在实际应用中，由于扫描器本身可作为滤波器，会对各个频谱成分的激励信号具有不同的谐响应，因此，在直流信号作用下，扫描器对应的响应为一个偏置信号，反映在图像上就是整体图像的平移。因此，处理器10在确定了第二扫描器30的投射显示区域所需的平移量，即可通过在驱动信号中对应方向上加入相应的直流驱动，实现图像的平动。
在本发明另一实施例中，光纤扫描显示装置还可以包括光学放大镜组，该光学放大镜组包括至少一个光学透镜，具体的透镜数量和透镜的参数设置以满足实际情况的需要为准，在此不做具体限制。光学放大镜组可设置在光纤扫描显示装置的出射端，用于将扫描器出射的扫描光线投射到投射载体，例如人眼或幕布等，以便于用户查看。
在实际应用中，扫描器中扫描光纤的入射还可以设置有透镜结构，也即该扫描光纤具体为透镜结构设置在入射端的透镜光纤(lensed fiber)，扫描光纤可以通过烧结或者研磨等方式在光纤一端形成球形、楔形或锥形等透镜，提高扫描光纤的数值孔径，从而提高扫描光纤的收光率。
基于同一发明构思，本发明实施例还提供一种扫描方法，该方法可以应用于具有如图1所示结构的光纤扫描显示装置中，如图3所示，该方法的步骤主要包括步骤S11至步骤S13，可以描述如下：
在步骤S11中：采用光纤扫描显示装置中的第一扫描器20对待显示图像进行全局扫描，出射扫描光线；其中，光纤扫描显示装置包括第一扫描器20、至少一个第二扫描器30、与第一与扫描器20对应的光源以及与第二扫描器30对应的光源，第一扫描器20和第二扫描器30的帧率相同且同步，且第二扫描器30的扫描幅度小于第一扫描器20的扫描幅度。
在步骤S12中：确定人眼在待显示图像中对应的聚焦区域，并对聚焦区域进行图像插值处理。
在步骤S13中：采用第二扫描器30对进行了图像插值处理后的聚焦区域进行扫描显示，并控制第一扫描器20在聚焦区域内保持与该第一扫描器20对应的光源处于关闭状态。
具体来说，光纤扫描显示装置包括扫描幅度不同的第一扫描器20和第二扫描器30，且第一扫描器20和第二扫描器30具有相同及同步的帧率。光纤扫描显示装置采用第一扫描器20进行全局扫描，进而确定待显示图像中人眼对应的聚焦区域，并对聚焦区域进行图像插值处理，采用扫描幅度较小的第二扫描器30扫描出射聚焦区域的扫描光线，显示像素密度较大的聚焦区域，提高了显示图像中人眼聚焦对应的局部图像部分的像素密度，清晰度较高。其中，光纤扫描显示装置的结构及各部分的功能请参见图1至图2及相关内容，此处不再赘述。
在S11中，在启动光纤扫描显示装置对待显示图像进行扫描时，可默认先采用第一扫描器20扫描投射待显示图像，即第一扫描器20的光源处于点亮状态，可认为第一扫描 器20对应的投射显示图像为常规分辨率的显示画面。
在S12中，光纤扫描显示装置可以通过传感器等确定人眼在光纤扫描显示装置的扫描视场中聚焦时对应的聚焦区域，并对聚焦区域进行图像插值处理，增大聚焦区域包含的像素点数量。该聚焦区域可以是根据人眼的注视点所确定的区域，其确定过程请参照前述相关描述，此处不再赘述。在实际应用中，光纤扫描显示装置可以是实时检测获取聚焦区域，并对聚焦区域进行插值处理，在聚焦区域的位置无变化时，仅需向扫描器提供用于驱动光纤摆动的交流驱动信号即可。
实际应用中，在对聚焦区域进行图像插值处理过程中，可根据第二扫描器30中的LUT表来进行，LUT表包含了较多的显示调制的信息。则处理后的聚焦区域中像素的调制信息，对应于第二扫描器30中的LUT表，调制信息包括像素灰度值和显示调制时序等。
光纤扫描显示装置在确定并对聚焦区域进行图像插值处理后，即可采用第二扫描器30对图像插值处理后的聚焦区域进行扫描显示，以显示像素密度较大的显示图像。
在S13中，若光纤扫描显示装置确定第一扫描器20扫描到聚焦区域，即可控制第一扫描器20的光源处于关闭状态，停止投射显示第一扫描器20的扫描光线，即第一扫描器20在聚焦区域内保持光源关闭，而在其它区域保持点亮状态，实现仅通过第二扫描器30投射显示聚焦区域内像素对应的扫描光线，以获得具有较高密度的局部图像。
当然，在启动光纤扫描显示装置采用第一扫描器20扫描投射时，第二扫描器30可以处于未启动状态，或者，第二扫描器30也可以与第一扫描器20同步启动，并各按自己的扫描幅度进行扫描。如果第二扫描器30与第一扫描器20同步启动，且第二扫描器30对进行了图像插值处理后的聚焦区域进行扫描显示，则第二扫描器30的光源处于点亮状态，以使其显示聚焦区域对应的聚焦图像，在扫描完聚焦区域后可关闭第二扫描器30或第二扫描器30的光源。
本发明实施例中，光纤扫描显示装置在确定聚焦区域的位置变化时，可获取聚焦区域对应的位置变化信息，该位置变化信息包括方向信息和位移信息；进而，光纤扫描显示装置可以根据位置变化信息控制第二扫描器30的驱动信号，改变第二扫描器30的投射显示区域的位置，实现随着人眼聚焦位置的改变，第二扫描区域的投射显示区域的位置同步改变，局部呈现给用户高清的显示图像，有效提高了扫描透射过程中用户的视觉体验度。
光纤扫描显示装置在通过第一扫描器20和第二扫描器30完成当前帧(即待显示图像)的扫描后，即可将第一扫描器20投射对应的投射图像与第二扫描器30对应的投射图像进行拼接、渲染等处理，从而可投射显示与待显示图像对应且聚焦的局部(对应于聚焦 区域)像素密度较大的图像。
本发明实施例中，光纤扫描显示装置在采用第一扫描器20扫描待显示图像的过程中，通过检测人眼的聚焦区域，并对聚焦区域进行图像插值处理，并采用扫描幅度较小的第二扫描器30进行扫描，并在聚焦区域内保持第一扫描器20的光源关闭，实现仅通过第二扫描器30对像素密度较大的聚焦区域进行扫描显示，实现增大投影显示图像中聚焦部分的像素密度，提高显示效果。
基于同一发明构思，本发明实施例还提供一种光纤扫描显示设备，如图4所示，该光纤扫描显示设备包括处理器200和光纤扫描显示装置100，光纤扫描显示装置100可以包括第一扫描器20、至少一个第二扫描器30、与第一扫描器20对应的光源以及与第二扫描器30对应的光源。
在实际应用中，光纤扫描显示装置100还可以包括图像源、光纤放大镜组等部件。其中，图像源可用于为扫描器提供待显示图像，光学放大镜组设置在扫描器的出射光路上，可用于对扫描器的出射光进行处理，图4中仅示出了光纤放大镜组。
第一扫描器20和第二扫描器30的显示帧率相同且同步，第二扫描器30的扫描幅度小于第一扫描器20的扫描幅度，处理器200用于确定人眼在光纤扫描显示装置100的扫描视场中聚焦时的聚焦区域，并对聚焦区域进行图像插值处理，第一扫描器20用于对待显示图像进行全局扫描，第二扫描器30用于对进行了图像插值处理的聚焦区域进行扫描显示，第一扫描器20在聚焦区域内，该第一扫描器20的光源处于关闭状态，从而增大光纤扫描显示设备投射显示的图像中人眼聚焦部分的像素密度，提高投射显示效果。其中，前述图1至图3对应的实施例同样适用于本实施例的光纤扫描显示设备，通过前述对光纤扫描显示装置200的详细描述，本领域技术人员可以清楚的知道本实施例中光纤扫描显示设备的实施方式，为了说明书的简洁，在此不再赘述。
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”或“包括”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序，可将这些单词解释为名称。
本发明实施例中的一个或者多个技术方案，至少具有如下技术效果或者优点：
光纤扫描显示装置通过扫描幅度较大第一扫描器对待显示图像进行全局扫描，以及，通过处理器可确定人眼在待显示图像中对应的聚焦区域，并对聚焦区域进行图像插值处理，增大聚焦区域内的像素密度，使得聚焦的视场范围内包含更多的像素，进而采用扫描幅度较小的第二扫描器对进行了图像插值处理的聚焦区域进行扫描显示，并控制第一扫描器在扫描聚焦区域时，光源处于关闭状态，以仅通过第二扫描器显示聚焦区域的画面，由于第一扫描器和第二扫描器具有相同且同步的帧率，故在显示待显示图像时，显示图像中的像素密度较大的局部聚焦区域的清晰度更高，颗粒感更小，有助于在图像局部渲染中增大渲染区域像素密度，提高光纤扫描显示装置的投射显示效果。
本说明书中公开的所有特征，或公开的所有方法或过程中的步骤，除了互相排斥的特征和/或步骤以外，均可以以任何方式组合。
本说明书(包括任何附加权利要求、摘要和附图)中公开的任一特征，除非特别叙述，均可被其他等效或具有类似目的的替代特征加以替换。即，除非特别叙述，每个特征只是一系列等效或类似特征中的一个例子而已。
本发明并不局限于前述的具体实施方式。本发明扩展到任何在本说明书中披露的新特征或任何新的组合，以及披露的任一新的方法或过程的步骤或任何新的组合。

Claims (9)

  1. 一种光纤扫描显示装置，其特征在于，包括第一扫描器、至少一个第二扫描器、处理器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫描器的扫描幅度小于所述第一扫描器的扫描幅度；
    其中，所述第一扫描器用于对待显示图像进行全局扫描，所述处理器用于确定人眼在所述待显示图像中对应的聚焦区域，并对所述聚焦区域进行图像插值处理，所述第二扫描器用于对图像插值处理后的聚焦区域进行扫描显示，所述第一扫描器在扫描所述聚焦区域时，与所述第一扫描器对应的光源处于关闭状态。
  2. 如权利要求1所述的装置，其特征在于，所述光纤扫描显示装置还包括：
    第一扫描驱动器，用于驱动所述第一扫描器中的扫描光纤；以及
    第二扫描驱动器，用于驱动所述第二扫描器中的扫描光纤；
    所述处理器还用于获取所述聚焦区域的位置变化时所对应的位置变化信息，并控制所述第二扫描驱动器对所述第二扫描器提供与所述位置变化信息相应的驱动信号；其中，所述位置变化信息包括方向信息和位移信息。
  3. 如权利要求2所述的装置，其特征在于，所述光纤扫描显示装置还包括光学放大镜组，所述光学放大镜组包括至少一个光学透镜，所述光学放大镜组设置于所述光纤扫描显示装置的出射端，用于将所述第一扫描器或者所述第二扫描器出射的扫描光线投射到投射载体。
  4. 如权利要求3所述的装置，其特征在于，所述第二扫描器的扫描范围小于所述第一扫描器的扫描范围。
  5. 如权利要求3所述的装置，其特征在于，所述第一扫描器与所述第二扫描器的慢轴频率相同。
  6. 一种扫描方法，应用于光纤扫描显示装置，其特征在于，所述光纤扫描显示装置包括第一扫描器、至少一个第二扫描器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫描器的扫描幅度小于所述第一扫描器的扫描幅度，所述方法包括：
    采用所述光纤扫描显示装置中的所述第一扫描器对待显示图像进行全局扫描；
    确定人眼在所述待显示图像中对应的聚焦区域，并对所述聚焦区域进行图像插值处 理；
    采用所述第二扫描器对图像插值处理后的聚焦区域进行扫描显示，并控制所述第一扫描器在所述聚焦区域内保持与该第一扫描器对应的光源处于关闭状态。
  7. 如权利要求6所述的方法，其特征在于，所述方法还包括：
    在确定所述聚焦区域的位置变化时，获取所述聚焦区域对应的位置变化信息，所述位置变化信息包括方向信息和位移信息；
    对所述第二扫描器提供与所述位置变化信息相应的驱动信号。
  8. 如权利要求7所述的方法，其特征在于，在对所述聚焦区域进行图像插值处理之后，所述方法还包括：存储图像插值处理后的所述聚焦区域中像素的调制信息，所述调制信息包括像素灰度值和显示调制时序；
    采用所述第二扫描器对图像插值处理后的聚焦区域进行扫描显示，包括：
    采用所述第二扫描器扫描图像插值处理后的聚焦区域；
    根据所述调制信息扫描出射所述聚焦区域中像素的扫描光线。
  9. 一种光纤扫描显示设备，其特征在于，包括处理器和光纤扫描显示装置，所述光纤扫描显示装置包括第一扫描器、至少一个第二扫描器、与第一扫描器对应的光源以及与第二扫描器对应的光源，所述第一扫描器和所述第二扫描器具有相同且同步的帧率，所述第二扫描器的扫描幅度小于所述第一扫描器的扫描幅度，所述处理器用于确定人眼在所述光纤扫描显示装置的扫描视场中聚焦时的聚焦区域，并对所述聚焦区域进行图像插值处理，所述第一扫描器用于对待显示图像进行全局扫描，所述第二扫描器用于对图像插值处理后的聚焦区域进行扫描显示，所述第一扫描器在扫描所述聚焦区域时，与所述第一扫描器对应的光源处于关闭状态。
PCT/CN2019/100523 2018-08-31 2019-08-14 一种光纤扫描显示装置及设备、扫描方法 WO2020042907A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811009527.5 2018-08-31
CN201811009527.5A CN110873961B (zh) 2018-08-31 2018-08-31 一种光纤扫描显示装置及设备、扫描方法

Publications (1)

Publication Number Publication Date
WO2020042907A1 true WO2020042907A1 (zh) 2020-03-05

Family

ID=69644984

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/100523 WO2020042907A1 (zh) 2018-08-31 2019-08-14 一种光纤扫描显示装置及设备、扫描方法

Country Status (2)

Country Link
CN (1) CN110873961B (zh)
WO (1) WO2020042907A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112305756A (zh) * 2020-10-30 2021-02-02 维沃移动通信有限公司 电子设备、其控制方法及控制装置和可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020020810A1 (en) * 1999-08-05 2002-02-21 Microvision, Inc. Active tuning of a torsional resonant structure
CN1902946A (zh) * 2003-12-31 2007-01-24 讯宝科技公司 激光投影显示器
CN101893934A (zh) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 一种智能调整屏幕显示的方法和装置
KR20130099622A (ko) * 2012-02-29 2013-09-06 건양대학교산학협력단 시역 다중화에 의한 홀로그래픽 디스플레이 장치
CN103852962A (zh) * 2012-12-04 2014-06-11 建兴电子科技股份有限公司 扫描投影装置及其扫描控制方法
CN106125479A (zh) * 2016-08-08 2016-11-16 常州创微电子机械科技有限公司 多激光扫描投影系统
CN107894660A (zh) * 2016-10-04 2018-04-10 矢崎总业株式会社 车辆用显示装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4868966B2 (ja) * 2006-07-21 2012-02-01 三菱電機株式会社 画像表示装置
US8757812B2 (en) * 2008-05-19 2014-06-24 University of Washington UW TechTransfer—Invention Licensing Scanning laser projection display devices and methods for projecting one or more images onto a surface with a light-scanning optical fiber
US20140126032A1 (en) * 2011-06-10 2014-05-08 Masahiko Yatsu Image display device
CN102525384B (zh) * 2011-12-23 2014-06-18 华中科技大学 光纤悬臂共振型扫描器的二维栅格式扫描方法
JP6202806B2 (ja) * 2012-11-16 2017-09-27 オリンパス株式会社 虚像表示装置
JP5956949B2 (ja) * 2013-03-22 2016-07-27 株式会社日立エルジーデータストレージ 画像表示装置
US9104038B2 (en) * 2013-04-25 2015-08-11 Microvision, Inc. Multiple laser drive method, apparatus and system
JP5925389B2 (ja) * 2013-08-28 2016-05-25 三菱電機株式会社 画像投影装置
US9140971B2 (en) * 2013-10-31 2015-09-22 Microvision, Inc. Scanning laser proximity detection
JP6340807B2 (ja) * 2014-02-05 2018-06-13 株式会社リコー 画像表示装置及び移動体
WO2016079769A1 (ja) * 2014-11-18 2016-05-26 オリンパス株式会社 光走査用アクチュエータ及び光走査装置
US9998717B2 (en) * 2014-12-24 2018-06-12 Prysm, Inc. Scanning beam display system
JP7062873B2 (ja) * 2016-11-25 2022-05-09 船井電機株式会社 光投射装置
CN110023818B (zh) * 2016-12-26 2022-05-13 麦克赛尔株式会社 影像显示装置和影像显示方法
CN107505704B (zh) * 2017-09-15 2019-05-14 华中科技大学 一种光纤螺旋扫描器的驱动调节方法及装置
CN207689756U (zh) * 2017-12-28 2018-08-03 成都理想境界科技有限公司 一种光纤扫描投影设备及光纤扫描装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020020810A1 (en) * 1999-08-05 2002-02-21 Microvision, Inc. Active tuning of a torsional resonant structure
CN1902946A (zh) * 2003-12-31 2007-01-24 讯宝科技公司 激光投影显示器
CN101893934A (zh) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 一种智能调整屏幕显示的方法和装置
KR20130099622A (ko) * 2012-02-29 2013-09-06 건양대학교산학협력단 시역 다중화에 의한 홀로그래픽 디스플레이 장치
CN103852962A (zh) * 2012-12-04 2014-06-11 建兴电子科技股份有限公司 扫描投影装置及其扫描控制方法
CN106125479A (zh) * 2016-08-08 2016-11-16 常州创微电子机械科技有限公司 多激光扫描投影系统
CN107894660A (zh) * 2016-10-04 2018-04-10 矢崎总业株式会社 车辆用显示装置

Also Published As

Publication number Publication date
CN110873961B (zh) 2022-03-04
CN110873961A (zh) 2020-03-10

Similar Documents

Publication Publication Date Title
JP4885865B2 (ja) 画像投射装置
US9971153B2 (en) Method and apparatus for displaying video data
US9355314B2 (en) Head-mounted display apparatus and login method thereof
US5982555A (en) Virtual retinal display with eye tracking
US6154321A (en) Virtual retinal display with eye tracking
US7742085B2 (en) Zoom method of a digital camera based on extracted values
US10761329B2 (en) Image projection device
WO2022126956A1 (zh) 激光投影设备及其提示方法
US11435577B2 (en) Foveated projection system to produce ocular resolution near-eye displays
KR20010015901A (ko) 콘트래스트 개선을 위해 실루엣을 이용하는 확장 이미징
JP2010139575A (ja) シースルー型ヘッドマウント表示装置
JP2000122617A (ja) 台形歪み補正装置
JP2004527798A (ja) 消去（オフ）及び像化（オン）用光源を用いて画面に像を生じるための装置及び方法
WO2020042907A1 (zh) 一种光纤扫描显示装置及设备、扫描方法
US20230350205A1 (en) Projection device and projection method for head mounted display based on rotary mems fast scanner
JP2010243809A (ja) 画像表示装置
CN114071094A (zh) 投影设备以及投影方法
CN114025143B (zh) 投影机及其拼接投影方法
US20080123956A1 (en) Active environment scanning method and device
JP2005346012A (ja) 表示装置、表示方法、及びプログラム
KR20150072528A (ko) 디스플레이 장치 및 이를 이용한 디스플레이 방법
JP2005249946A (ja) 表示装置の欠陥検査装置
JP2002287254A (ja) 画像指示手段の位置検出方法、該方法に用いられる画像投影装置及び画像制御装置
TWI511571B (zh) 投影系統及其影像調整方法
JP2010211149A (ja) 画像表示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19853693

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19853693

Country of ref document: EP

Kind code of ref document: A1