CN110873961A - Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method - Google Patents
Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method Download PDFInfo
- Publication number
- CN110873961A CN110873961A CN201811009527.5A CN201811009527A CN110873961A CN 110873961 A CN110873961 A CN 110873961A CN 201811009527 A CN201811009527 A CN 201811009527A CN 110873961 A CN110873961 A CN 110873961A
- Authority
- CN
- China
- Prior art keywords
- scanner
- scanning
- image
- optical fiber
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/103—Scanning systems having movable or deformable optical fibres, light guides or waveguides as scanning elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/02—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes by tracing or scanning a light beam on a screen
Abstract
The invention discloses an optical fiber scanning display device, optical fiber scanning display equipment and an optical fiber scanning method, which are used for increasing the pixel density of a rendering area in local rendering of an image and improving the display effect of the scanning display device. The device includes: the system comprises a first scanner, at least one second scanner, a processor and a light source corresponding to the scanners, wherein the first scanner and the second scanner have the same and synchronous frame rate, and the scanning amplitude of the second scanner is smaller than that of the first scanner; the first scanner is used for carrying out global scanning on an image to be displayed, the processor is used for determining a focus area corresponding to human eyes in the image to be displayed and carrying out image interpolation processing on the focus area, the second scanner is used for carrying out scanning display on the focus area subjected to the image interpolation processing, and when the first scanner is used for scanning the focus area, the light source is in a closed state.
Description
Technical Field
The invention relates to the technical field of optical fiber scanning, in particular to an optical fiber scanning display device, optical fiber scanning display equipment and an optical fiber scanning method.
Background
The laser scanning imaging is to use laser as a light source, scan on an image plane through a laser scanning imaging device according to a preset mode, and correspondingly change the color of the emergent laser, so that the laser scanning imaging can be realized on the image plane.
At present, in the process of realizing laser scanning imaging, scanning light rays are emitted by scanning mainly in modes of raster scanning, lissajou scanning and the like, and then means such as image rendering and the like are adopted. However, in these scanning methods, the size and resolution of the obtained picture are relatively fixed, the number of Pixels included is relatively small, and the pixel density (Pixels Per inc, PPI) is constant. For example, in the raster scanning mode, the electron beam scans according to a fixed scan line and a predetermined scan sequence, i.e. the electron beam scans a line from left to right and from top to bottom, and then moves to the start position of the next line to continue scanning until the last line is scanned, so as to complete the scanning of the whole screen. Thus, in a scanning imaging system, the human eye sees only a limited and small number of pixels for a fixed field of view, such as the eye's gaze area. In practical applications, display contents in a specific area of an image are often richer in color and more prominent in details by means of image rendering and the like, but for a scanned image, the resolution of the whole image is fixed, so that the number of pixels included in the specific area is small, and a good effect cannot be achieved even if rendering is performed.
Disclosure of Invention
The invention aims to provide an optical fiber scanning display device, optical fiber scanning display equipment and an optical fiber scanning method, which are used for solving the technical problems that the pixel density of a scanned image of the optical fiber scanning display device is low and the local rendering effect is poor in the prior art.
In order to achieve the above object, in a first aspect, an embodiment of the present invention provides an optical fiber scanning display device, which includes a first scanner, at least one second scanner, a processor, and a light source corresponding to the scanners, where the first scanner and the second scanner have the same and synchronous frame rate, and a scanning amplitude of the second scanner is smaller than a scanning amplitude of the first scanner;
the first scanner is used for carrying out global scanning on an image to be displayed, the processor is used for determining a focusing area corresponding to human eyes in the image to be displayed and carrying out image interpolation processing on the focusing area, the second scanner is used for carrying out scanning display on the focusing area subjected to the image interpolation processing, and when the first scanner is used for scanning the focusing area, the light source is in a closed state, and scanning light rays of pixels in the focusing area are emitted only through the second scanner in a scanning mode.
Optionally, the optical fiber scanning display device further includes:
a scan driver for driving a scanning fiber in the scanner;
the processor is further configured to obtain position change information corresponding to a change in the position of the focus area, and control the scan driver to provide a driving signal corresponding to the position change information to the second scanner; wherein the position change information includes direction information and displacement information.
Optionally, the optical fiber scanning display device further includes an optical magnifying lens group, where the optical magnifying lens group includes at least one optical lens, and the optical magnifying lens group is disposed at an exit end of the optical fiber scanning display device and is configured to project scanning light emitted by the scanner to the projection carrier.
Optionally, the scanning range of the second scanner is smaller than the scanning range of the first scanner.
Optionally, the slow axis frequencies of the first scanner and the second scanner are the same.
In a second aspect, an embodiment of the present invention provides a scanning method applied to an optical fiber scanning display device, where the optical fiber scanning display device includes a first scanner, at least one second scanner, and a light source corresponding to the scanners, where the first scanner and the second scanner have the same and synchronous frame rate, and a scanning amplitude of the second scanner is smaller than a scanning amplitude of the first scanner, and the method includes:
adopting the first scanner in the optical fiber scanning display device to carry out global scanning on an image to be displayed;
determining a corresponding focus area of human eyes in the image to be displayed, and performing image interpolation processing on the focus area;
and scanning and displaying the focus area subjected to the image interpolation processing by adopting the second scanner, and controlling the first scanner to keep the light source in a closed state in the focus area.
Optionally, the method further includes:
when the position change of the focusing area is determined, acquiring position change information corresponding to the focusing area, wherein the position change information comprises direction information and displacement information;
and providing a driving signal corresponding to the position change information to the second scanner.
Optionally, after the image interpolation processing is performed on the focus area, the method further includes:
storing the processed modulation information of the pixels in the focus area, wherein the modulation information comprises pixel gray values and display modulation time sequences;
the scanning and displaying of the focus area after the image interpolation processing is performed by adopting the second scanner comprises the following steps:
scanning the focused area subjected to image interpolation processing by using the second scanner;
and scanning and emitting scanning light rays of pixels in the focusing area according to the modulation information.
In a third aspect, an embodiment of the present invention provides an optical fiber scanning display device, including a processor and an optical fiber scanning display device, the optical fiber scanning display device comprises a first scanner, at least one second scanner and a light source corresponding to the scanner, the first scanner and the second scanner have the same and synchronous frame rate, the scanning amplitude of the second scanner is smaller than that of the first scanner, the processor is configured to determine a region of focus of a human eye when focused in a scan field of view of the fiber optic scanning display device, and the focus area is processed by image interpolation, the first scanner is used for global scanning of the image to be displayed, the second scanner is used for scanning and displaying the focus area subjected to the image interpolation processing, and the light source is in a closed state when the first scanner scans the focus area.
One or more technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:
the optical fiber scanning display device carries out global scanning on an image to be displayed through a first scanner with larger scanning amplitude, a processor can determine a corresponding focusing area of human eyes in the image to be displayed, carries out image interpolation processing on the focusing area, increases the pixel density in the focusing area, enables more pixels to be contained in a focusing field range, further adopts a second scanner with smaller scanning amplitude to carry out scanning display on the focusing area subjected to the image interpolation processing, controls a light source to be in an off state when the first scanner scans the focusing area, displays a picture of the focusing area only through the second scanner, and has the same and synchronous frame rate due to the fact that the first scanner and the second scanner have the same and synchronous frame rate, when the image to be displayed is displayed, the local focusing area with larger pixel density in the displayed image has higher definition and smaller granular sensation, the method is beneficial to increasing the pixel density of a rendering area in the local rendering of the image and improving the projection display effect of the optical fiber scanning display device.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without inventive exercise:
FIG. 1 is a schematic structural diagram of an optical fiber scanning display device according to an embodiment of the present invention;
FIG. 2 is a schematic view of a projected display image of an optical fiber scanning display device according to an embodiment of the present invention;
FIG. 3 is a flow chart of a scanning method in an embodiment of the invention;
FIG. 4 is a schematic diagram of a fiber scanning structure according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
An embodiment of the present invention provides an optical fiber scanning display device, as shown in fig. 1, the optical fiber scanning display device includes a processor 10, a first scanner 20, at least one second scanner 30, and a light source corresponding to the scanner.
The optical fiber scanning display device includes a first scanner 20 and a second scanner 30, which have the same and synchronous frame rate, the scanning amplitude of the second scanner 30 is much smaller than the scanning amplitude of the first scanner 20, the optical fiber scanning display device is configured to scan an image to be displayed and emit scanning light, the processor 10 is configured to determine a corresponding focusing area of a human eye in the image to be displayed, perform image interpolation on the focusing area, perform scanning display on the focusing area after the image interpolation by using the second scanner 30, and control the first scanner 20 to keep the light source in an off state in the focusing area, that is, the first scanner may normally scan in the focusing area, but does not project a display image, and only scans the scanning light corresponding to pixels in the focusing area after the image interpolation by using the second scanner 30.
In practical applications, the optical fiber scanning display device may further include an image source, an optical fiber magnifying lens set, and other components, which are not shown in fig. 1. The image source can be used for providing an image to be displayed for the optical fiber scanning display device, and the optical amplifying lens group is arranged on an emergent light path of the scanner and can be used for processing emergent light of the scanner and further projecting the emergent light to a projection carrier, such as human eyes or a curtain.
In the above optical fiber scanning display device, the first scanner 20 and the second scanner 30 with different scanning amplitudes are provided, the amplitude of the second scanner 30 may be preset or may be adjusted according to the actual requirement of the user, and the scanning amplitude of the second scanner 30 is much smaller than the scanning amplitude of the first scanner 20, so as to achieve the purpose of local encryption. When the first scanner 20 with a large scanning amplitude is used for scanning the pixels of the image to be displayed, the processor 10 may detect a focusing area corresponding to human eyes in the image to be displayed, and perform interpolation processing on the focusing area, so that more pixels are included in the focusing area, the pixel density of the focusing area is increased, the definition is higher, the granular sensation is smaller, and the display capability of the device for scanning is effectively improved.
In order to make those skilled in the art understand the technical solutions provided by the embodiments of the present invention, the following describes an optical fiber scanning display device provided by the embodiments of the present invention in detail.
In the embodiment of the present invention, the frame rates of the first scanner 20 and the second scanner 30 included in the fiber scanning display device are the same and synchronous, and the scanning amplitude of the first scanner 20 is much larger than that of the second scanner 30. During the scanning process, the image projected by the first scanner 20 and the image projected by the second scanner 30 can be calculated and output in real time through a rendering technology, and an image which corresponds to the image to be displayed and has locally increased pixel density (corresponding to a focus area) is displayed.
The first scanner 20 and the second scanner 30 may have the same structure, the first scanner 20 is a scanner used in conventional scanning, the second scanner 30 is a scanner with a smaller driving voltage, and more pixels can be modulated and displayed at a smaller swing amplitude, that is, the second scanner 30 can scan an image area with a higher pixel density. Therefore, if the first scanner 20 and the second scanner 30 are used to scan different areas in the same frame of image to be displayed, the pixel density of the display image scanned and emitted by the second scanner 30 will be greater than the pixel density of the display image scanned and emitted by the first scanner 20. The fast axis frequency and the slow axis frequency of the scanner jointly determine the scanning resolution of the scanner, and in the embodiment of the present invention, the first scanner 20 and the second scanner 30 may have the same slow axis frequency, and the fast axis frequency may be different, and the fast axis frequency and the slow axis frequency jointly determine the scanning resolution of the scanner.
Each scanner in the optical fiber scanning display device corresponds to a light source, and the light source can be a laser light source. In practice, the light source may comprise at least one laser. For example, if the light source includes a red laser, a green laser, a blue laser, and a light combining unit, where the three lasers correspond to three color channels of each pixel in the image to be displayed one by one, for example, the image to be displayed adopts an RGB color mode, that is, each pixel in the image to be displayed has a red channel, a green channel, and a blue channel, the red laser, the green laser, and the blue laser in the light source correspond to three color channels of each pixel in the image to be displayed one by one. The output energy of each of the red, green and blue laser light sources can be adjusted.
The light combination unit comprises a red light combination unit arranged at the emergent end of the red laser, a green light combination unit arranged at the emergent end of the green laser and a blue light combination unit arranged at the emergent end of the blue laser; the light combining unit is configured to combine light beams emitted by the red laser, the green laser, or the blue laser, and in other embodiments, characteristics of reflected light or projected light of each light combining unit in the light combining unit may also be different according to different optical path designs between the red laser, the green laser, and the blue laser, which is not limited herein.
Since the scanning optical fiber in the optical fiber scanning display device has no limitation on the size of a physical pixel, whether the local area projects the display or not is determined by controlling the on and off of the light source (such as controlling the on and off of the laser). By controlling the on-time of the laser, the size of the pixel grid can be determined. In an ideal state, the laser starts to light up after a light spot enters a certain pixel region, and the laser is turned off before the light spot exits the pixel region, so that the overlapping of the pixels is avoided, and the contrast is not affected.
In the embodiment of the present invention, the first scanner 20 is adopted to perform global scanning on the image to be displayed, the pixel density of the image corresponding to projection display is relatively low, and the image corresponding to projection display can be considered as a display image with a conventional resolution. And the optical fiber scanning display device may detect, by the processor 10, a corresponding focus region of a human eye in the image to be displayed, where the focus region may be a field region when the human eye focuses in a scanning field of the optical fiber scanning display device, and the image to be displayed corresponds to the determined pixel region.
In practical applications, the processor 10 may determine the focus area by detecting a gaze point of human eyes, for example, after the processor 10 detects a pixel position corresponding to the gaze point of human eyes in an image to be displayed, the processor determines a pixel area with a preset size in the image to be displayed as the focus area by taking the pixel position corresponding to the gaze point of human eyes as a center, for example, the processor determines a pixel area with a corresponding pixel size of 4096 × 2160 as the focus area.
The optical fiber scanning display device may include a detection device connected to the processor 10, such as a sensor, which can detect data related to the pupil of the human eye in real time during the scanning process, so that the processor 10 can determine the position area focused by the human eye according to the data detected by the sensor. For example, the sensor may be an Eye Tracking camera that captures images of a human Eye during scanning of the fiber optic scanning display device, and the processor 10 determines the focus area using Eye Tracking (Eye Tracking) technology. Here, eye tracking refers to a technique of tracking eye movement by measuring the position of a fixation point of an eye or the movement of an eyeball with respect to the head.
Or, the optical fiber scanning display device comprises an eye movement tracker, and the eye movement tracker can locate the position of the pupil and acquire the central coordinate of the pupil through an image processing technology, so that the tracking of the eye movement is realized by calculating the fixation point of the person. The method for locating the eyeball is more, such as Hough circle detection, threshold segmentation, gray projection, template matching, neural network training and the like. The processor 10 may then determine, via the eye tracker, the area of focus of the human eye when focused in the scan field of view of the fiber optic scanning display device.
Further, after determining the focus area, the processor 10 may perform image interpolation processing on the focus area, where the image interpolation processing uses the gray values (or the tristimulus values in the RGB image) of the known neighboring pixel points to generate the gray values of the unknown pixel points, so as to reproduce an image with higher resolution from the original image, thereby increasing the number of pixels included in the focus area and increasing the pixel density.
Furthermore, the optical fiber scanning display device uses at least one second scanner 30 to scan and display the focus area after the image interpolation processing, and correspondingly displays the display image with higher pixel density. For example, if there are a plurality of second scanners 30, the plurality of second scanners 30 may scan and project different areas of the focal area, respectively. In the embodiment of the present invention, a second scanner 30 is mainly used as an example for description.
In practical applications, a Look-Up Table (LUT) may be stored in the second scanner 30, and the LUT may be applied to a mapping Table of a pixel gray scale value, which transforms the actually sampled pixel gray scale value into another gray scale value corresponding to the pixel gray scale value through a certain transformation, such as threshold, inversion, binarization, contrast adjustment, linear transformation, etc., so as to highlight useful information of an image, enhance the optical contrast of the image, and improve the image quality.
In the embodiment of the present invention, the processor 10 may perform the image interpolation processing on the focus area according to the LUT table. That is, the display specification (resolution) of the scanner 2 can be regarded as determined in terms of the encryption degree of the pixel, and is embodied in the LUT table of the scanner 2.
In practical applications, the processor 10 may turn off the light source of the first scanner 20, stop projecting the scanning light for displaying the first scanner 20, and keep the first scanner 20 in the off state when it is determined that the first scanner 20 scans the focus area, for example, when the currently scanned pixel is a pixel in the focus area.
Specifically, the first scanner 20 and the second scanner 30 may be activated simultaneously during the initial period of operation of the fiber scanning display device, and the light sources are both turned on. For example, if the processor 10 determines a focus area when human eyes focus in a scanning field of the optical fiber scanning display device, and performs interpolation processing on the focus area, the first scanner 20 may be started to perform global scanning on an image to be displayed, and the second scanner 30 may also be started to perform scanning display on the corresponding processed focus area in the image to be displayed. Then, when it is determined that the first scanner 20 scans the focus area, the light source of the first scanner 20 may be controlled to be turned off, so that only the second scanner 30 scans and displays the focus area.
Alternatively, the first scanner 20 and the second scanner may not be started simultaneously. For example, in the initial stage of the operation of the optical fiber scanning display device, the first scanner 20 is started to perform global scanning on the image to be displayed, and then the second scanner 30 is started to scan the focus area. For example, in the scanning process of the first scanner 20, the processor 10 detects a corresponding focus area of the human eye in the image to be displayed, performs image interpolation processing, and then directly scans and displays the processed focus area through the second scanner 30, and after the first scanner 20 and the second scanner 30 complete scanning, the display image corresponding to the image to be displayed can be displayed according to the frame rate, and then a local image with higher density in the display image is a display image corresponding to the focus area of the user.
For example, fig. 2 is a schematic diagram of a display image corresponding to a frame of image scanned and projected by using an optical fiber scanning display device, where the scanners all use a raster scanning manner as an example, in the diagram, a region a represents a pixel region scanned and projected by the first scanner 20, which may be a global image scanned according to a fixed resolution, a region B represents a focus region subjected to image interpolation processing, that is, a pixel region scanned and projected by the second scanner 30, and a frame displayed by the second scanner 30 dedicated to pixel encryption is used, and the pixel density of the region B is greater than the pixel density of the region a. The optical fiber scanning display device adopts a first scanner 20 to carry out global scanning on an image to be displayed (corresponding to an area A), a processor 10 detects a determined human eye watching area as an area B and carries out image interpolation processing on the area B, and a second scanner 30 is specially used for carrying out scanning display on the area B. And controls the light source of the first scanner 20 to be turned off when it is determined that the first scanner 20 scans the focus area.
Therefore, in the scanning and projecting process, the processor 10 of the optical fiber scanning display device can detect the focusing area of the human eye in real time, and keep the light source processing off state of the first scanner 20 in the focusing area, so that the image part of the focusing area subjected to interpolation processing in the image to be displayed is scanned and projected only by the second scanner 30 with smaller vibration amplitude, and the pixel density of the focusing area corresponding to the human eye in the projected and displayed image is improved.
Since the human eye is most sensitive to the image quality of the central part of the focused field of view and is not sensitive to the image quality of the edges, the degree of sensitivity is strongly attenuated with the field of view. In the embodiment of the invention, the characteristic of optical fiber scanning imaging is utilized, more pixels are contained in the central range of the focused field of view through control, the local pixel density of the real picture is higher, the definition is higher, and the granular sensation is smaller.
In another embodiment of the present invention, a scan driver is disposed in the scan imaging device, and the scan driver is disposed in each scanner and is used for driving the scan fiber in the corresponding scanner. In practical application, the optical fiber scanning display device can drive the piezoelectric driver by supplying an alternating current signal to the scanning driver in the scanner, so that the scanning optical fiber is driven by the piezoelectric driver to swing and scan. Meanwhile, since the pixel encryption area (focus area) is smaller than the screen size in a normal case, the scanning range of the second scanner is smaller, that is, the pixel encryption function can be realized with a smaller drive (ac component).
In the scanning process of the optical fiber scanning display device, if the position of the focus area of the human eye changes, the processor 10 may determine position change information when the position of the focus area changes, where the position change information at least includes direction information and displacement information, where the direction information may represent the change of the focus direction of the human eye, and the displacement information may represent the moving distance of the focus area. For example, the position change information may be determined by detecting a moving direction and a distance of the center point during the position change using the center point of the focus area as a reference point. Of course, in practical applications, the processor 10 may acquire the position change information of the focus area in real time, and also acquire the moving direction and the moving distance of the focus area in real time.
After obtaining the position change information, the processor 10 may control the driving signal of the second scanner 30 according to the moving direction and the moving distance of the focus area, so as to implement the translation of the projection display area of the second scanner 30, thereby implementing the effect of synchronously moving the display area of the second scanner 30 along with the movement of the focus position of the human eye.
Specifically, when the translation of the projection display area of the second scanner 30 is changed, the processor 10 may add a dc driving component in a corresponding direction (including a horizontal direction and a vertical direction) to the driving signal according to the moving direction in the position change information, and control the translation distance of the projection display area corresponding to the second scanner 30 according to the moving distance in the position change information.
In practical applications, since the scanner itself can be used as a filter and has different harmonic responses to the excitation signals of the respective spectral components, under the action of the dc signal, the corresponding response of the scanner is a bias signal, which is reflected on the image, i.e. the translation of the whole image. Therefore, when determining the translation amount required for the projection display area of the second scanner 30, the processor 10 may add corresponding dc drive to the driving signal in the corresponding direction to implement the image translation.
In another embodiment of the present invention, the optical fiber scanning display device may further include an optical magnifying lens group, where the optical magnifying lens group includes at least one optical lens, and the specific number of the lenses and the parameter setting of the lenses are based on the requirements of the actual situation, and are not limited herein. The optical magnifying lens group can be arranged at the emergent end of the optical fiber scanning display device and is used for projecting scanning light rays emitted by the scanner to a projection carrier, such as human eyes or a curtain, so as to be convenient for a user to view.
In practical application, the incidence of the scanning fiber in the scanner may also be provided with a lens structure, that is, the scanning fiber is specifically a lens fiber (lens fiber) with the lens structure arranged at the incidence end, and the scanning fiber may form a spherical, wedge or conical lens at one end of the fiber by sintering or grinding, etc., so as to improve the numerical aperture of the scanning fiber, thereby improving the light acceptance rate of the scanning fiber.
Based on the same inventive concept, the embodiment of the present invention further provides a scanning method, which may be applied to an optical fiber scanning display device having the structure shown in fig. 1, as shown in fig. 3, and the steps of the method may be described as follows:
s11: a first scanner 20 in the optical fiber scanning display device is adopted to carry out global scanning on an image to be displayed and emit scanning light; the optical fiber scanning display device comprises a first scanner 20, at least one second scanner 30 and a light source corresponding to the scanners, wherein the frame rates of the first scanner 20 and the second scanner 30 are the same and synchronous, and the scanning amplitude of the second scanner 30 is smaller than that of the first scanner 20;
s12: determining a corresponding focusing area of human eyes in an image to be displayed, and performing image interpolation processing on the focusing area;
s13: the second scanner 30 is used to scan and display the focus area after the image interpolation processing, and the first scanner 20 is controlled to keep the light source in the off state in the focus area.
Specifically, the fiber scanning display device includes a first scanner 20 and a second scanner 30 having different scanning amplitudes, and the first scanner 20 and the second scanner 30 have the same and synchronized frame rates. The optical fiber scanning display device adopts the first scanner 20 to carry out global scanning, further determines a focusing area corresponding to human eyes in an image to be displayed, carries out image interpolation processing on the focusing area, adopts the second scanner 30 with smaller scanning amplitude to scan scanning light rays exiting the focusing area, displays the focusing area with higher pixel density, improves the pixel density of a local image part corresponding to the human eye focusing in the displayed image, and has higher definition. Please refer to fig. 1 to 2 and related contents for the structure and functions of each part of the optical fiber scanning display device, which are not described herein again.
In S11, when the optical fiber scanning display device is started to scan an image to be displayed, the first scanner 20 may be used to scan and project the image to be displayed first by default, that is, the light source of the first scanner 20 is in an on state, and the projected display image corresponding to the first scanner 20 may be considered as a display image with a normal resolution.
In S12, the fiber scanning display device may determine, through a sensor or the like, a corresponding focus region where the human eye focuses in the scanning field of view of the fiber scanning display device, and perform image interpolation processing on the focus region to increase the number of pixels included in the focus region. The focus area may be an area determined according to a fixation point of a human eye, and the determination process refers to the foregoing related description, which is not described herein again. In practical application, the optical fiber scanning display device may detect and acquire a focus area in real time, perform interpolation processing on the focus area, and only need to provide an ac driving signal for driving the optical fiber to swing to the scanner when the position of the focus area is unchanged.
In practical applications, the image interpolation process for the focus area may be performed according to the LUT table in the second scanner 30, which contains much information about the display modulation. The modulation information of the pixels in the processed focus area, which includes the pixel gray scale value and the display modulation timing, corresponds to the LUT table in the second scanner 30.
After the fiber scanning display device determines and performs image interpolation processing on the focus area, the second scanner 30 may be used to scan and display the focus area, so as to display a display image with a higher pixel density.
In S13, if the fiber scanning display device determines that the first scanner 20 scans the focus area, the light source of the first scanner 20 is controlled to be in an off state, and the scanning light for displaying the first scanner 20 is stopped, i.e. the first scanner 20 keeps the light source off in the focus area and keeps the other areas in an on state, so as to realize the projection of the scanning light corresponding to the pixels in the focus area only by the second scanner 30, and obtain the local image with higher density.
Of course, when the fiber scanning display device is started to scan the projection by using the first scanner 20, the second scanner 30 may be in an inactive state, or the second scanner 30 may also be started synchronously with the first scanner 20 and perform scanning according to its own scanning amplitude. If the second scanner 30 and the first scanner 20 are started synchronously and the second scanner 30 performs scanning display on the focus area after the image interpolation processing, the light source of the second scanner 30 is in a lighting state to display the focus image corresponding to the focus area, and the light source of the second scanner 30 or the second scanner 30 can be turned off after the focus area is scanned.
In the embodiment of the invention, when the optical fiber scanning display device determines the position change of the focusing area, the optical fiber scanning display device can acquire the position change information corresponding to the focusing area, wherein the position change information comprises direction information and displacement information; furthermore, the optical fiber scanning display device can control the driving signal of the second scanner 30 according to the position change information, change the position of the projection display area of the second scanner 30, realize that the position of the projection display area of the second scanning area changes synchronously along with the change of the focusing position of human eyes, locally present a high-definition display image for a user, and effectively improve the visual experience of the user in the scanning and transmission process.
After the optical fiber scanning display device finishes scanning a current frame (i.e., an image to be displayed) by the first scanner 20 and the second scanner 30, the projected image projected by the first scanner 20 and the projected image projected by the second scanner 30 can be spliced, rendered, and the like, so that an image corresponding to the image to be displayed and focused and having a high local (corresponding to a focusing area) pixel density can be projected and displayed.
In the embodiment of the invention, in the process of scanning an image to be displayed by using the first scanner 20, the optical fiber scanning display device detects the focusing area of human eyes, performs image interpolation processing on the focusing area, scans by using the second scanner 30 with a smaller scanning amplitude, and keeps the light source of the first scanner 20 off in the focusing area, so that the focusing area with a higher pixel density is scanned and displayed only by using the second scanner 30, the pixel density of a focusing part in a projection display image is increased, and the display effect is improved.
Based on the same inventive concept, an embodiment of the present invention further provides an optical fiber scanning display apparatus, as shown in fig. 4, the optical fiber scanning display apparatus includes a processor 200 and an optical fiber scanning display device 100, and the optical fiber scanning display device 100 may include a first scanner 20, at least one second scanner 30, and a light source corresponding to the scanner.
In practical applications, the optical fiber scanning display device 100 may further include an image source, an optical fiber magnifying lens assembly, and the like. The image source can be used for providing an image to be displayed for the scanner, the optical amplifying mirror group is arranged on an emergent light path of the scanner and can be used for processing emergent light of the scanner, and only the optical fiber amplifying mirror group is shown in fig. 4.
The display frame rates of the first scanner 20 and the second scanner 30 are the same and synchronous, the scanning amplitude of the second scanner 30 is smaller than the scanning amplitude of the first scanner 20, the processor 200 is configured to determine a focusing area when human eyes are focused in a scanning field of view of the optical fiber scanning display device 100, and perform image interpolation processing on the focusing area, the first scanner 20 is configured to perform global scanning on an image to be displayed, the second scanner 30 is configured to perform scanning display on the focusing area subjected to the image interpolation processing, and a light source of the first scanner 20 is in an off state in the focusing area, so that the pixel density of a focusing part of the human eyes in the image projected and displayed by the optical fiber scanning display device is increased, and the projection display effect is improved. The embodiments corresponding to fig. 1 to fig. 3 are also applicable to the optical fiber scanning display device of this embodiment, and through the foregoing detailed description of the optical fiber scanning display apparatus 200, those skilled in the art can clearly know the implementation manner of the optical fiber scanning display device in this embodiment, and for the sake of brevity of the description, details are not repeated herein.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" or "comprises" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order, but rather the words are to be construed as names.
One or more technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:
the optical fiber scanning display device carries out global scanning on an image to be displayed through a first scanner with larger scanning amplitude, a processor can determine a corresponding focusing area of human eyes in the image to be displayed, carries out image interpolation processing on the focusing area, increases the pixel density in the focusing area, enables more pixels to be contained in a focusing field range, further adopts a second scanner with smaller scanning amplitude to carry out scanning display on the focusing area subjected to the image interpolation processing, controls a light source to be in an off state when the first scanner scans the focusing area, displays a picture of the focusing area only through the second scanner, and has the same and synchronous frame rate due to the fact that the first scanner and the second scanner have the same and synchronous frame rate, when the image to be displayed is displayed, the local focusing area with larger pixel density in the displayed image has higher definition and smaller granular sensation, the method is beneficial to increasing the pixel density of a rendering area in the local rendering of the image and improving the projection display effect of the optical fiber scanning display device.
All of the features disclosed in this specification, or all of the steps in any method or process so disclosed, may be combined in any combination, except combinations of features and/or steps that are mutually exclusive.
Any feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving equivalent or similar purposes, unless expressly stated otherwise. That is, unless expressly stated otherwise, each feature is only an example of a generic series of equivalent or similar features.
The invention is not limited to the foregoing embodiments. The invention extends to any novel feature or any novel combination of features disclosed in this specification and any novel method or process steps or any novel combination of features disclosed.
Claims (9)
1. An optical fiber scanning display device is characterized by comprising a first scanner, at least one second scanner, a processor and a light source corresponding to the scanner, wherein the first scanner and the second scanner have the same and synchronous frame rate, and the scanning amplitude of the second scanner is smaller than that of the first scanner;
the first scanner is used for carrying out global scanning on an image to be displayed, the processor is used for determining a focus area corresponding to human eyes in the image to be displayed and carrying out image interpolation processing on the focus area, the second scanner is used for carrying out scanning display on the focus area subjected to the image interpolation processing, and when the first scanner is used for scanning the focus area, the light source is in a closed state.
2. The apparatus of claim 1, wherein the fiber scanning display device further comprises:
a scan driver for driving a scanning fiber in the scanner;
the processor is further configured to obtain position change information corresponding to a change in the position of the focus area, and control the scan driver to provide a driving signal corresponding to the position change information to the second scanner; wherein the position change information includes direction information and displacement information.
3. The device as claimed in claim 2, wherein the optical fiber scanning display device further comprises an optical magnifying lens set, the optical magnifying lens set comprises at least one optical lens, and the optical magnifying lens set is disposed at the exit end of the optical fiber scanning display device and is used for projecting the scanning light emitted by the scanner to the projection carrier.
4. The apparatus of claim 3, wherein a scan range of the second scanner is smaller than a scan range of the first scanner.
5. The apparatus of claim 3, wherein the slow axis frequencies of the first scanner and the second scanner are the same.
6. A scanning method is applied to an optical fiber scanning display device, and is characterized in that the optical fiber scanning display device comprises a first scanner, at least one second scanner and a light source corresponding to the scanners, the first scanner and the second scanner have the same and synchronous frame rate, the scanning amplitude of the second scanner is smaller than that of the first scanner, and the method comprises the following steps:
adopting the first scanner in the optical fiber scanning display device to carry out global scanning on an image to be displayed;
determining a corresponding focus area of human eyes in the image to be displayed, and performing image interpolation processing on the focus area;
and scanning and displaying the focus area subjected to the image interpolation processing by adopting the second scanner, and controlling the first scanner to keep the light source in a closed state in the focus area.
7. The method of claim 6, wherein the method further comprises:
when the position change of the focusing area is determined, acquiring position change information corresponding to the focusing area, wherein the position change information comprises direction information and displacement information;
and providing a driving signal corresponding to the position change information to the second scanner.
8. The method of claim 7, wherein after image interpolation processing of the focus region, the method further comprises:
storing the processed modulation information of the pixels in the focus area, wherein the modulation information comprises pixel gray values and display modulation time sequences;
the scanning and displaying of the focus area after the image interpolation processing is performed by adopting the second scanner comprises the following steps:
scanning the focused area subjected to image interpolation processing by using the second scanner;
and scanning and emitting scanning light rays of pixels in the focusing area according to the modulation information.
9. The optical fiber scanning display equipment is characterized by comprising a processor and an optical fiber scanning display device, the optical fiber scanning display device comprises a first scanner, at least one second scanner and a light source corresponding to the scanner, the first scanner and the second scanner have the same and synchronous frame rate, the scanning amplitude of the second scanner is smaller than that of the first scanner, the processor is configured to determine a region of focus of a human eye when focused in a scan field of view of the fiber optic scanning display device, and the focus area is processed by image interpolation, the first scanner is used for global scanning of the image to be displayed, the second scanner is used for scanning and displaying the focus area subjected to the image interpolation processing, and the light source is in a closed state when the first scanner scans the focus area.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811009527.5A CN110873961B (en) | 2018-08-31 | 2018-08-31 | Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method |
| PCT/CN2019/100523 WO2020042907A1 (en) | 2018-08-31 | 2019-08-14 | Optical fiber scanning display apparatus and device, and scanning method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811009527.5A CN110873961B (en) | 2018-08-31 | 2018-08-31 | Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110873961A true CN110873961A (en) | 2020-03-10 |
| CN110873961B CN110873961B (en) | 2022-03-04 |
Family
ID=69644984
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811009527.5A Active CN110873961B (en) | 2018-08-31 | 2018-08-31 | Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110873961B (en) |
| WO (1) | WO2020042907A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112305756A (en) * | 2020-10-30 | 2021-02-02 | 维沃移动通信有限公司 | Electronic device, control method and control device thereof, and readable storage medium |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008026591A (en) * | 2006-07-21 | 2008-02-07 | Mitsubishi Electric Corp | Image display apparatus |
| CN102525384A (en) * | 2011-12-23 | 2012-07-04 | 华中科技大学 | Two-dimensional grid-type scanning method adopting optical fiber cantilever resonance-type scanner |
| CN103597398A (en) * | 2011-06-10 | 2014-02-19 | 日立麦克赛尔株式会社 | Image display device |
| WO2014077032A1 (en) * | 2012-11-16 | 2014-05-22 | オリンパス株式会社 | Display device |
| JP2014186078A (en) * | 2013-03-22 | 2014-10-02 | Hitachi Media Electoronics Co Ltd | Image display device |
| CN105518510A (en) * | 2013-08-28 | 2016-04-20 | 三菱电机株式会社 | Image projection device |
| CN105739225A (en) * | 2014-12-24 | 2016-07-06 | Prysm公司 | Scanning Beam Display System |
| CN105940336A (en) * | 2014-02-05 | 2016-09-14 | 株式会社理光 | Image display device and mobile object |
| JP2016528517A (en) * | 2013-04-25 | 2016-09-15 | マイクロビジョン，インク． | Multi-laser drive system |
| JP2017504047A (en) * | 2013-10-31 | 2017-02-02 | マイクロビジョン，インク． | Scanning laser proximity detection |
| CN107003511A (en) * | 2014-11-18 | 2017-08-01 | 奥林巴斯株式会社 | Optical scanning actuator and light scanning apparatus |
| CN107505704A (en) * | 2017-09-15 | 2017-12-22 | 华中科技大学 | The driving adjusting method and device of a kind of fiber spiral scanner |
| CN107894660A (en) * | 2016-10-04 | 2018-04-10 | 矢崎总业株式会社 | Display apparatus |
| JP2018084730A (en) * | 2016-11-25 | 2018-05-31 | 船井電機株式会社 | Light projector |
| WO2018122902A1 (en) * | 2016-12-26 | 2018-07-05 | マクセル株式会社 | Image display device and image display method |
| US20180199015A1 (en) * | 2008-05-19 | 2018-07-12 | University Of Washington | Scanning laser projection display for small handheld devices |
| CN207689756U (en) * | 2017-12-28 | 2018-08-03 | 成都理想境界科技有限公司 | A kind of optical fiber scanning projection device and fibre-optic scanner |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6384406B1 (en) * | 1999-08-05 | 2002-05-07 | Microvision, Inc. | Active tuning of a torsional resonant structure |
| US7369584B2 (en) * | 2003-12-31 | 2008-05-06 | Symbol Technologies, Inc. | Laser projection display |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
| KR101392021B1 (en) * | 2012-02-29 | 2014-05-07 | 건양대학교산학협력단 | Holographic display device by multiplexing viewing field |
| CN103852962B (en) * | 2012-12-04 | 2016-08-10 | 光宝科技股份有限公司 | Scanning projection device and scan control method thereof |
| CN106125479A (en) * | 2016-08-08 | 2016-11-16 | 常州创微电子机械科技有限公司 | Many laser scanning projections system |
-
2018
- 2018-08-31 CN CN201811009527.5A patent/CN110873961B/en active Active
-
2019
- 2019-08-14 WO PCT/CN2019/100523 patent/WO2020042907A1/en active Application Filing
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008026591A (en) * | 2006-07-21 | 2008-02-07 | Mitsubishi Electric Corp | Image display apparatus |
| US20180199015A1 (en) * | 2008-05-19 | 2018-07-12 | University Of Washington | Scanning laser projection display for small handheld devices |
| CN103597398A (en) * | 2011-06-10 | 2014-02-19 | 日立麦克赛尔株式会社 | Image display device |
| CN102525384A (en) * | 2011-12-23 | 2012-07-04 | 华中科技大学 | Two-dimensional grid-type scanning method adopting optical fiber cantilever resonance-type scanner |
| WO2014077032A1 (en) * | 2012-11-16 | 2014-05-22 | オリンパス株式会社 | Display device |
| JP2014186078A (en) * | 2013-03-22 | 2014-10-02 | Hitachi Media Electoronics Co Ltd | Image display device |
| JP2016528517A (en) * | 2013-04-25 | 2016-09-15 | マイクロビジョン，インク． | Multi-laser drive system |
| CN105518510A (en) * | 2013-08-28 | 2016-04-20 | 三菱电机株式会社 | Image projection device |
| JP2017504047A (en) * | 2013-10-31 | 2017-02-02 | マイクロビジョン，インク． | Scanning laser proximity detection |
| CN105940336A (en) * | 2014-02-05 | 2016-09-14 | 株式会社理光 | Image display device and mobile object |
| CN107003511A (en) * | 2014-11-18 | 2017-08-01 | 奥林巴斯株式会社 | Optical scanning actuator and light scanning apparatus |
| CN105739225A (en) * | 2014-12-24 | 2016-07-06 | Prysm公司 | Scanning Beam Display System |
| CN107894660A (en) * | 2016-10-04 | 2018-04-10 | 矢崎总业株式会社 | Display apparatus |
| JP2018084730A (en) * | 2016-11-25 | 2018-05-31 | 船井電機株式会社 | Light projector |
| WO2018122902A1 (en) * | 2016-12-26 | 2018-07-05 | マクセル株式会社 | Image display device and image display method |
| CN107505704A (en) * | 2017-09-15 | 2017-12-22 | 华中科技大学 | The driving adjusting method and device of a kind of fiber spiral scanner |
| CN207689756U (en) * | 2017-12-28 | 2018-08-03 | 成都理想境界科技有限公司 | A kind of optical fiber scanning projection device and fibre-optic scanner |
Non-Patent Citations (1)
| Title |
|---|
| 王一丁: "《数字图像处理》", 31 August 2015, 西安电子科技大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112305756A (en) * | 2020-10-30 | 2021-02-02 | 维沃移动通信有限公司 | Electronic device, control method and control device thereof, and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110873961B (en) | 2022-03-04 |
| WO2020042907A1 (en) | 2020-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9971153B2 (en) | Method and apparatus for displaying video data | |
| US9195115B2 (en) | Image projection device, image protection method, distance measuring device and distance measuring method | |
| US5982555A (en) | Virtual retinal display with eye tracking | |
| US6154321A (en) | Virtual retinal display with eye tracking | |
| US7428997B2 (en) | Method and apparatus for illuminating a field-of-view and capturing an image | |
| US7742085B2 (en) | Zoom method of a digital camera based on extracted values | |
| CN109581654B (en) | Grid type optical fiber scanning imaging system and control method and application thereof | |
| JP6613984B2 (en) | Drawing apparatus and drawing method | |
| CN105247601B (en) | Display device | |
| US9800844B2 (en) | Image projection apparatus | |
| US6454411B1 (en) | Method and apparatus for direct projection of an image onto a human retina | |
| JP2015194694A (en) | Image display device and image display adjustment method | |
| US7909471B2 (en) | Rear projection type display apparatus | |
| CN110873961B (en) | Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method | |
| CN110446019A (en) | A kind of optical fiber scanning optical projection system and its modulator approach | |
| KR102103663B1 (en) | Shooting device and method and shooting device control program | |
| JP2010243809A (en) | Image display device | |
| US10365476B2 (en) | Method for operating a laser projector to have a uniform scan pattern | |
| US10884235B2 (en) | Drawing apparatus and drawing method | |
| KR101575313B1 (en) | Curved display device and display method using the same | |
| JP2016133746A (en) | Drawing device and drawing method | |
| JP2004145153A (en) | Confocal microscope with light quantity saturation display function | |
| JPH0695141B2 (en) | Laser radar image forming device | |
| CN116416885A (en) | Time delay adjusting method and projection display device | |
| JPS63307374A (en) | Laser visual sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |