CN101589328A - Image display device and display packing thereof, program, integrated circuit, glasses type head mounted display, automobile, binoculars and console display - Google Patents

Abstract

A kind of image display device comprises: left eye is used to export the left eye image that has constituted a part or whole original image with light source (101); Left eye deflector (104), the described left eye that left eye is exported with light source (101) carries out deflection with image towards user's left eye direction; Right eye is used to export the right eye image that has constituted a part or whole original image with light source (110); Right eye deflector (107), the right eye that right eye is exported with light source (11) carries out deflection with image towards user's right eye direction; Control part (105,111), left eye is controlled with the image efferent with image efferent and right eye, at least one left eye inequality image and right eye image among output pixel position, picture shape, image size, image resolution ratio and the display frame rate, melt the picture effect thereby utilize, make the user go out original image with image and right eye with image recognition according to left eye.

Description

Image display device and display packing thereof, program, integrated circuit, glasses type head mounted display, automobile, binoculars and console display

Technical field

Head mounted display) the present invention relates to HMD (head mount display: display device such as.

Background technology

At present, HMD display device such as (head mounted displays) is used a kind of imaging mode (following note is made " laser scanning methods ") (for example, with reference to patent documentation 1) that directly eye retina is carried out two-dimensional scan with laser.Adopt the display device of laser scanning methods to be also referred to as retina scanning display (Retinal Scanning Display:RSD), retina irradiation display, retina light and paint display, laser scanning display, direct viewing type display device, virtual retinal display (Virtual RetinalDisplay:VRD) etc.

The structure example of having represented spectacle HMD among Figure 1A and Figure 1B.In Figure 1A and Figure 1B, assembled the light source 101,110 that is used to launch laser on the spectacle-frame, be used to the scanner section 103,108 controlling the wave front shape changing unit 102,109 of laser wave front and be used on two-dimensional directional, carrying out laser scanning.Laser projects to by scanner section 103,108 on the eyeglass 11,12 of glasses, by the deflector that the surface possessed 104,107 reflections of eyeglass 11,12.Then, this laser is injected eyes of user, forms image on retina.Here, deflector 104,107 has been used semi-transparent semi-reflecting lens or hologram optical element (HOE:Hologram Optical Element) etc., the user can see simultaneously outside scenery and by the laser image represented the two.In addition, used mirror device etc. in the scanner section 103,108, this mirror device is vibrated a monolithic catoptron on single shaft or biaxially oriented, thereby carries out laser scanning on two-dimensional directional.

In addition, about the HMD type of show image in eyes, the example of an existing patent is arranged, it improves the resolution (for example, with reference to patent documentation 2) of the image of being watched by change shown image pixel in right and left eyes.In the example of this existing patent, right eye shows that odd column pixel, left eye show the even column pixel, shows by this complementary pixel, can present the image that is synthesized the back gained by the display pixel of right and left eyes to the user.

[patent documentation 1] Japanese kokai publication hei 10-301055 communique

[patent documentation 2] Japanese kokai publication hei 9-061776 communique

But the problem that exists in the display device of laser scanning methods is, it is difficult to improve the image quality such as resolution, field-of-view angle, frame per second of shown image.At first, if the mirror device that makes the monolithic mirrors vibrate as scanner section 103,108, then when attempting to improve the image quality of display image, the size of catoptron will become problem.

In mirror device, shown in Figure 74, make monolithic catoptron 301 along the first turning axle X and with the second turning axle Y of first turning axle X quadrature vibration, change the reflection direction that incides the laser 304 on the catoptron thus and carry out two-dimensional scan.

In HMD shown in Figure 1, carry out track example that the laser of two-dimensional scan depicted on deflector 104 shown in Figure 75 by scanner section 103.As shown in the drawing, the mode of carrying out two-dimensional scan by scanner section 103 is that laser demonstrates display image 501 by depicting track while scan 502 in user's eye.In this example, the HM of Fig. 1 is designed to make the turning axle directions X of scanner section 103 corresponding with the horizontal direction of display image 501, the vertical direction of turning axle Y direction and display image 501 is corresponding.In addition, the vibration frequency of catoptron on turning axle directions X (through Y-axis) is expressed as the driving frequency Hx of horizontal direction, the vibration frequency of catoptron on turning axle Y direction (through X-axis) is expressed as the driving frequency Hy of vertical direction.In the track while scan shown in Figure 75 502, laser carry out in vertical direction single pass during in, can repeatedly scan in the horizontal direction.Usually, the side that speed is lower among the driving frequency Hx of two-axis mirror, the Hy has determined the frame per second of display image 501.In the example of Figure 75, light beam carry out in vertical direction single pass during in, demonstrate 1 two field picture.In addition, in light beam is during enterprising line scanning in the other direction, also demonstrate under the situation of 1 two field picture, laser vertically round trip during in can demonstrate 2 frame images, therefore, satisfy the relation of formula (1) between the frame per second fps of driving frequency Hy and image.

[formula 1]

fps＝2×Hy (1)

In addition, shown in Figure 76, the laser 304 that incides on the scanner section 103 scans corresponding to the vibration of catoptron, and this scanning is forming scanning angle α, forms scanning angle β on the direction of turning axle Y on the direction of turning axle X.Here said scanning angle α, β are the angles of the scope of the laser that scans of expression scanner section 103.Shown in Figure 76, the light path angulation of the laser of the light path of the laser of laser scanning during to the leftmost side when scanning the rightmost side is expressed as horizontal scanning angle α.In addition, similarly, the light path angulation of the laser of the light path of the laser of laser scanning during to the top when scanning below is expressed as vertical scanning angle β.

Here, the diameter of supposing the monolithic catoptron 301 that comprises in the scanner section 103 is that the horizontal resolution of display image 501 shown among the HMD of D, Fig. 1 is that Nx, vertical resolution are Ny, and then in general the relation of formula (2) and formula (3) is set up.

[formula 2]

Nx∝D×α (2)

[formula 3]

Ny∝D×β (3)

Therefore, in the laser scanning type display device,, must add the diameter D of the monolithic catoptron 301 of high scan angles α, β or scanner section 103 in order to improve display resolution.

But if strengthened the diameter D of the monolithic catoptron 301 of scanner section 103, the weight of monolithic catoptron 301 will increase.Consequently, the driving frequency Hx, the Hy that are difficult to add high scan angles α, β or improve monolithic catoptron 301, thus cause the frame per second fps of display image 501 to descend.In addition, if strengthened scanning angle α, β, just must make monolithic catoptron 301 movement ranges big, therefore, it is difficult that the raising of driving frequency Hx, Hy becomes.In addition, the maximization of the actuation element (actuator) that also can cause being used to making monolithic catoptron 301 that action take place or the increase of power consumption or drive sound increase etc., thus be difficult to scanner section 103 is assembled on the spectacle HMD.In addition, the relation of the driving frequency of scanner section 103 and resolution also becomes a difficult problem that realizes high image quality in the beam flying display device.

In HMD shown in Figure 1, carry out track example that the laser 303 of two-dimensional scan depicted on deflector 104 shown in Figure 77 by scanner section 103.As shown in the drawing, laser 303 carries out two-dimensional scan by scanner section 103, depicts the track while scan 602c shown in Figure 77 thus.Consequently, in user's eye, demonstrate display image 601c.At this moment, set overscan regions Or, Ol, made the display line of track while scan 602c and display image 601c overlapping exactly.For display image 601c, usually, display image 601c is shown overscanning rate A with respect to the shared schedule of proportion of scanning area of the track while scan 602c that contains overscan regions.

Here, the horizontal resolution of supposing the display image 601b that shows in the HMD of Fig. 1 is that Nx, vertical resolution are Ny, then generally can satisfy the relation of formula (4) between the driving frequency Hx of the horizontal direction of the vertical resolution Ny of display image and frame per second fps and scanner section 103.Shown in this formula (4), in the driving frequency Hx existence of the horizontal direction of scanner section 103 in limited time, be difficult to improve simultaneously the vertical resolution Ny of display image and frame per second fps the two.

[formula 4]

Hx＝Ny×fps/(2×A) (4)

In addition, under the situation of the scanning angle α, the β that have strengthened scanner section 103,108 in order to show the image of having a wide sphere of vision, the operating distance of monolithic catoptron 301 in during one-period will increase, and this causes driving frequency to descend.Therefore, in having used the beam flying type HMD of mirror device, be difficult to improve simultaneously the frame per second and the resolution of the display image of having a wide sphere of vision.

In addition, as spectacle HMD image inclination under the situation that projects to deflector 104,107, image can produce keystone distortion, in order to proofread and correct this distortion, can cause the field-of-view angle of image to narrow down.

As shown in Figure 1, the light from scanner section 103,108 projects to respectively on the deflector 104,107 at a slant.Usually, with the rectangle image when obliquity projects on the screen, keystone distortion can take place or be called as the distortion of trapezoidal distortion (keystone) in the image that projection produces on the screen, therefore, use spectacle HMD also can be in user's eye projection produce the image of keystone distortion.

The keystone distortion that is produced when using Figure 78 and Figure 79 to come illustration to incide on the screen S sideling from the rectangle image of pointolite O.Figure 78 is the figure that the top observation post from screen S gets, and Figure 79 is the figure from the top view gained of screen S.In this example, shown in Figure 78 and Figure 79, the light that light source O sends tiltedly incides on the screen in the place ahead from the left side of screen S.Therefore, shown in Figure 78, the left side L1 of the projected image on light source O and the screen S is different with the distance between the L2 of the right.

In addition, shown in Figure 79, with regard to the formed projection image of light source O, because vertically projectional angle is θ, so range points light source O is far away more, and the limit of the projected image on the screen is just long more.Therefore, the projected image 401a on the screen S will form keystone distortion.

But,, do not take some countermeasures at this oblique projection in the example (patent documentation 1) of the existing patent of the spectacle HMD of the oblique projection image of eyeglass.In addition, even be not to constitute by laser and scanner section but under the situation about being made of liquid crystal cell or organic EL (organic electroluminescent) display, this problem also can take place at light source O.

The pre-projecting type projector of being sold in the market etc. is proofreaied and correct keystone distortion by Flame Image Process.Figure 80 has represented the example keystone distortion proofreaied and correct by image processing part.Corresponding to base length short among the last base of image 501a before the correction of trapezoidal shape or the bottom, determine the viewing area of a rectangle.Then, at the part that exceeds rectangular area display image not, just can demonstrate image 502a after the correction of rectangle thus for the user.But, utilize this method, the size of display image is according to the length decision of the minor face of image 501a before proofreading and correct, so the problem of its existence is that the result can only show the image that has tunnel vision.

So, with regard to beam flying type display device, because the influence of the position relation of size, driving frequency, scanner section 103,108 and the deflector 104,107 of scanner section 103,108 etc. is difficult to improve image quality such as resolution, field-of-view angle, frame per second.In the example (patent documentation 1) of the existing patent of the spectacle HMD of the oblique projection image of eyeglass, do not realize the countermeasure of the raising of the expansion of field-of-view angle and image quality simultaneously.

Patent documentation 2 discloses a kind of method, though the resolution of the left and right sides descends to some extent, can guarantee the resolution of the show image that the user sees.But it does not touch and the peculiar frame per second of the beam flying type display device problem relevant with resolution.In addition, about paying the utmost attention to which suitable this problem just among frame per second and the resolution, its answer is different because of the difference of picture material.Sports casts etc. change rapidly that image should preferentially guarantee frame per second, and must preferentially guarantee resolution in that the situation of rest image is next.In patent documentation 2, do not consider that this content according to information changes the way of frame per second or resolution etc. yet.

Summary of the invention

The present invention makes for addressing the above problem, and its purpose is, suitably changes the demonstration of the image of the left and right sides in image display device, utilizes melting as effect of eyes, improves user's image quality of watching when the identification image.

In order to solve described existing issue, image display device of the present invention be a kind of on user's retina the image display device of display image, possess: left eye image efferent, the left eye that is used to export having constituted part or all whole original image is exported with image; The left eye deflector, the described left eye that is used for to described left eye to be exported with the image efferent carries out deflection with image towards user's left eye direction; Right eye image efferent, the right eye that is used to export having constituted part or all whole original image is exported with image; The right eye deflector, the described right eye that is used for to described right eye to be exported with the image efferent carries out deflection with image towards user's right eye direction; And control part, described left eye is controlled with the image efferent with image efferent and described right eye, among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one mutually different described left eye image and described right eye image, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

According to this structure, in eyes, show the wide visual field angle image of low image quality, and in the another eyes, show the narrow field angle image of high image quality, just can improve the image quality of being watched and enlarge the visual field of display image.

In addition, also can be, described left eye comprises with the image efferent: the left eye light source, export with the light beam of each pixel of image describing to constitute left eye; And the left eye scanner section, make from the beam flying described left eye deflector of described left eye with light source; Described right eye comprises with the image efferent: the right eye light source, export with the light beam of each pixel of image describing to constitute right eye; And the right eye scanner section, make from described right eye with the described right eye deflector of the beam flying of light source.According to this structure, both realized being assemblied in miniaturization, the economize on electricityization of the image display device on the glasses, can prevent the keystone distortion of image again.

In addition, described control part also can comprise: the sweep limit configuration part, make described left eye carry out beam flying with a scanner section among the scanner section with the 1st scanning angle of the part that only scans described original image with scanner section and described right eye, make another scanner section carry out beam flying with the 2nd scanning angle, described the 2nd scanning angle is bigger and smaller or equal to the scanning angle that can scan whole described original image than described the 1st scanning angle; The different described left eye of image quality by controlling described left eye with image efferent and described right eye image efferent, thereby corresponding to the scanning angle that described sweep limit configuration part sets, is exported with image and described right eye image in the image quality configuration part.

An embodiment is, described image quality configuration part comprises the frame per second configuration part, this frame per second configuration part makes described left eye export the image of the 1st frame per second with image efferent and described right eye with the corresponding image efferent of the side with being set at described the 1st scanning angle among the image efferent, makes the image with the corresponding image efferent output of a side that is set at described the 2nd scanning angle 2nd frame per second littler than described the 1st frame per second.According to this structure, just can show the image of narrow field angle with high frame per second, thereby improve the frame per second that the user is watched when recognition image.

Another embodiment is, described image quality configuration part comprises resolution setting portion, this resolution setting portion makes described left eye export the image of the 1st resolution with image efferent and described right eye with the corresponding image efferent of the side with being set at described the 1st scanning angle among the image efferent, makes the image with the corresponding image efferent output of a side that is set at described the 2nd scanning angle 2nd resolution lower than described the 1st resolution.According to this structure, just can show the image of narrow field angle with high pixel, thereby improve the resolution that the user is watched when recognition image.

In addition, described left eye is used the big or small different of scanner section with scanner section and described right eye, described sweep limit configuration part make described left eye with scanner section and described right eye with scanner section among both a larger-size side carry out beam flying with described the 1st scanning angle, make above-mentioned among both the less side of size carry out beam flying with described the 2nd scanning angle.According to this structure, just can show the image of narrow field angle with high pixel, thereby improve the resolution that the user is watched when recognition image.

Image display device of the present invention also comprises the line-of-sight detection portion that is used to detect user's sight line, and the sweep limit configuration part makes described left eye carry out beam flying to the sight line position that comprises the user in interior zone in the testing result of described line-of-sight detection portion with a side group that is set to described the 1st scanning angle among the scanner section with scanner section and described right eye.According to this structure, even taken place also can in user's central field of vision, show images with high image quality under the situation of change in user's sight line.

In addition, described sweep limit configuration part also can make described left eye carry out beam flying with the corresponding side of the clearsighted eyes user with described the 1st scanning angle with among the scanner section with scanner section and described right eye, makes opposite side carry out beam flying with described the 2nd scanning angle.According to this structure, can show images with high image quality in eyes one side that the user is convenient to watch, thereby improve the image quality that the user is watched when recognition image.

In addition, described sweep limit configuration part also can make described left eye carry out beam flying with the corresponding side of the clear-eyed eyes user with described the 1st scanning angle with among the scanner section with scanner section and described right eye, makes opposite side carry out beam flying with described the 2nd scanning angle.According to this structure, can show images with high image quality in eyes one side that the user is convenient to watch, thereby improve the image quality that the user is watched when recognition image.

In addition, described control part also can comprise described scan pattern determination section, this scan pattern determination section makes described left eye carry out beam flying with scanner section and described right eye respectively in such a way with scanner section, promptly, described original image is divided into a plurality of scanning areas, at left eye described in each frame with scanner section and described right eye scanning area difference with scanner section, and at left eye described in the adjacent frame with scanner section and described right eye with scanner section scanning area difference separately.According to this structure, can prevent from right eye and left eye, to continue to show the image of different piece, thereby reduce the sense of discomfort of user when watching image.

An embodiment also can be, Yi Bian described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye with scanner section, Yi Bian with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus; Described scan pattern determination section is divided into a plurality of scanning areas with described original image, so that scan on described 2nd direction adjacent pixels with scanner section and described right eye with scanner section at left eye described in each frame.According to this structure, can utilize the continuous pixels of melting the image of watching as effect raising user of eyes, thereby can improve the fluency of display image.

Another embodiment also can be, Yi Bian described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye with scanner section, Yi Bian with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus; Described scan pattern determination section is divided into a plurality of scanning areas with described original image, so that scan continuous scanning area on described the 2nd direction at left eye described in each frame respectively with scanner section with scanner section and described right eye.According to this structure, can utilize the continuous pixels of melting the image of watching as effect raising user of eyes, thereby can improve the fluency of display image.

Also can be in addition, Yi Bian described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye with scanner section, Yi Bian with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus; Described scan pattern determination section makes described left eye carry out beam flying with scanner section and described right eye in such a way respectively with scanner section, that is, described left eye is opposite with the direction of scanning of scanner section on described the 2nd direction with scanner section and described right eye.According to this structure, the pixel that can avoid showing in right eye and left eye overlaps, thereby improves the effect that eyes melt picture.

Also can be, described control part comprises demonstration image quality determination section, this show image quality determination section based on described left eye with scanner section and described right eye maximum drive frequency with scanner section, generate the correcting image after the frame per second of described original image and at least any one party among the display pixel number proofreaied and correct; Described scan pattern determination section will be divided into a plurality of scanning areas by the described correcting image that described demonstration image quality determination section generates, and make described left eye carry out beam flying with scanner section and described right eye respectively with scanner section.According to this structure,, also can suppress the decline of the image resolution ratio that the user sees as effect by means of melting of right and left eyes even because of the upper limit of the driving frequency of scanner section reduces the resolution of right and left eyes under for the situation that keeps frame per second.In addition, utilizing doubly speed to drive to wait when being higher than the high speed frame per second display image of the original frame per second of image, also can suppress the decline of resolution.

Also can be in addition, Yi Bian described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye with scanner section, Yi Bian with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus; Described demonstration image quality determination section is proofreaied and correct for a less side among following two driving frequencies 2 times with the frame per second of described original image, and described two driving frequencies are described left eyes essential in order to show described original image with scanner section and described right eye with scanner section at the driving frequency on described the 2nd direction and described left eye with scanner section and described right eye with the maximum drive frequency of scanner section on described the 2nd direction.According to this structure, can either utilize the resolution of being watched of melting of eyes as the effect maintenance, can set higher display image frame per second again.

Further, described demonstration image quality determination section also can be proofreaied and correct once more to the described frame per second after proofreading and correct, so that according to the described frame per second after proofreading and correct and described left eye with scanner section and described right eye with the display pixel number of scanner section on described the 2nd direction that the driving frequency on the 1st direction is calculated more than or equal to predetermined, as to make described original image frame per second more than or equal to 1 numerical value, and smaller or equal to the display pixel number of described original image on described the 2nd direction.According to this structure, can set the frame per second and the resolution of display image in the mode of the performance of bringing into play scanner section to greatest extent.

Also can be in addition, described scan pattern determination section is divided into the scanning area of the quantity suitable with following numerical value with described original image, the merchant of this numerical value for counting gained with any one total pixel number of image divided by the display pixel of each frame after described demonstration image quality determination section correction with image or described right eye with described left eye.According to this structure, can demonstrate whole pixels of display image with minimal frame number.

Also can be that described demonstration image quality determination section is also proofreaied and correct the frame per second of described original image and at least one side among the display pixel number based on the content information of the content of representing described original image in addition.According to this structure, can select the suitable image quality that adapts with picture material, for example, for sports etc. dynamically abundant image improve frame per second, the images many for Word messages such as news then improve resolution.

Control part also can also comprise user's configuration management portion, the image quality corrected value that this user's configuration management portion keeps the user that each content information is set, described demonstration image quality determination section based on the corresponding described image quality corrected value of the content information of described original image, the frame per second of described original image and at least one side among the display pixel number are proofreaied and correct.According to this structure, can set the image quality of user preferences at the variety classes of information such as sports or news, make the change of corresponding frame per second and resolution.

In addition, described user's configuration management portion also can be described user's configuration management portion also can also keep the information relevant with user's eyesight, described demonstration image quality determination section is proofreaied and correct the frame per second of described original image and at least one side among the display pixel number based on the information relevant with user's eyesight that keeps in described user's configuration management portion.According to this structure, can carry out following processing, that is, the mode that has precedence over resolution with frame per second is that the weak-eyed user changes image quality.

Image display device of the present invention also can also comprise: battery is used to drive this image display device; Power management portion is used to detect the surplus of described battery; And the driving frequency determination section, according to the testing result of described power management portion, change described left eye with scanner section and described right eye with the two the maximal value of driving frequency of scanner section.According to this structure, when battery dump energy more after a little while, can suppress the battery consumption of scanner section, guarantee long display device driving time.

Owing to described left eye is injected described left eye and caused described left eye to become the left eye distorted image that is deformed into trapezoidal shape at described left eye with deflector with image with deflector with the light beam that scanner section scanned is oblique, and owing to described right eye is injected described right eye and caused described right eye to become at described right eye is deformed into trapezoidal shape with deflector right eye with under the situation of distorted image with image with deflector with the light beam that scanner section scanned is oblique, described control part also can comprise: the rectangular area determination section, be used to determine left eye to use the rectangular area with rectangular area and right eye, described left eye is to be the 1st limit with described left eye with the part on the long limit of distorted image with the rectangular area, with with described the 1st limit quadrature and link the end points on described the 1st limit and described left eye is the rectangular shape on the 2nd limit with the line segment of the hypotenuse of distorted image, described right eye with the rectangular area be with described right eye with the part on the long limit of image as the 3rd limit that equates with described the 1st edge lengths, with with described the 3rd limit quadrature and link the end points on described the 3rd limit and described right eye is the rectangular shape on the 4th limit with the line segment of the hypotenuse of distorted image; The depth-width ratio adjustment part is used to adjust the height of described original image and at least one side among the width, is height, is the correcting image of width with described the 2nd length of side and described the 4th length of side sum so that described original image becomes with described the 1st length of side; Distortion correction portion, generation make described correcting image to described left eye left eye correcting image with the distortion of distorted image reverse direction, so that demonstrate described left eye image on deflector at described left eye, and generate make described correcting image to the right eye correcting image of described right eye with the distortion of distorted image reverse direction so that demonstrate described right eye image on deflector at described right eye; And output image control part, with described left eye with outputing to described left eye image efferent with described left eye with the corresponding part in rectangular area among the correcting image, and with described right eye with outputing to described right eye image efferent with described right eye with the corresponding part in rectangular area among the correcting image.

According to this structure, carry out timing in the image keystone distortion that is produced when realizing the HMD of shape of glasses, that can utilize eyes melts the picture effect, thereby realizes carrying out keeping than existing keystone the keystone correction of bigger vertical angle of view.

An embodiment can be, described rectangular area determination section determines described left eye to use the rectangular area with rectangular area and described right eye in such a way, promptly, with described left eye with image and described right eye with distorted image so that described left eye is included in described right eye with among the long limit of image with the minor face of distorted image, and after described right eye was included in described left eye and overlaps with the mode among the long limit of distorted image with the minor face of image, the described the 2nd and the 4th limit becomes passed described left eye with distorted image and the described right eye straight line with the intersection point of each hypotenuse of distorted image.

Also can be in addition, described control part comprises the remaining area determination section, this remaining area determination section is used to determine left eye remaining area and right eye remaining area, this left eye remaining area is that the opposite side with described the 1st limit is long limit, is the trapezoidal shape of hypotenuse with described left eye with the part of the hypotenuse of distorted image, described the 4th limit of its aspect ratio is shorter, this right eye remaining area is to be long limit, to be the trapezoidal shape of hypotenuse with described right eye with the part of the hypotenuse of distorted image that with described the 3rd limit described the 2nd limit of its aspect ratio is shorter; Described output image control part also with described left eye with outputing to described left eye image efferent with described left eye with the corresponding part of remaining area among the correcting image, and with described right eye with outputing to described right eye image efferent with described right eye with the corresponding part of remaining area among the correcting image.According to this structure, it has and utilizes melting as effect of eyes to make the right of the image that the user sees and the effect that the left side becomes level and smooth straight line.

An embodiment also can be, described output image control part is by the described left eye of control image efferent and described right eye image efferent, reduce described left eye with remaining area and at described right eye with at least one the regional brightness among in the rectangular area and the zone that described left eye overlaps with remaining area, and reduce described right eye with remaining area and at described left eye with at least one the regional brightness among in the rectangular area and the zone that described right eye overlaps with remaining area.

Another embodiment can be, described output image control part is by the described left eye of control image efferent and described right eye image efferent, increase the brightness of described right eye, and increase the brightness in the zone that does not overlap with remaining area with described right eye among the described left eye usefulness rectangular area with the zone that does not overlap with remaining area with described left eye among the rectangular area.

According to this structure, it has the effect that prevents to produce in the image that the user sees the brightness spot as effect of melting that can utilize eyes.

Also can be that described rectangular area determination section determines the shape of described left eye rectangular area and described right eye rectangular area so that the ratio of width to height of described correcting image is the mode of the ratio of 16: 9 or 4: 3 in addition.According to this structure, utilize melting of eyes as effect, the shape of the image that the user sees just becomes 16: 9 or 4: 3 the depth-width ratio that is suitable for video image evaluation.

Also can be in addition, described rectangular area determination section in the eyesight difference of user's right and left eyes under the situation more than the certain numerical value, so that the pairing rectangular area of clear-eyed eyes becomes maximum, and make the pairing rectangular area of weak-eyed eyes become the shape that 0 mode determines described left eye rectangular area and described right eye rectangular area; Described remaining area determination section is so that the pairing remaining area of clear-eyed eyes becomes 0, and the mode that makes the pairing remaining area of weak-eyed eyes become maximum determines the shape of described left eye remaining area and described right eye remaining area.According to this structure, can eliminate the influence of weak-eyed one branch hole eyeball, keystone distortion is made correction.

Display packing of the present invention comprises: the left eye image step, the left eye that has constituted a part or whole original image is exported with image; Left eye deflection step makes the described left eye of exporting with image output step by described left eye carry out deflection with image towards user's left eye direction; Right eye is exported step with image, and the right eye that has constituted a part or whole original image is exported with image; Right eye deflection step makes the described right eye of exporting with image output step by described right eye carry out deflection with image towards user's right eye direction; And controlled step, described left eye is controlled with the image efferent with image efferent and described right eye, described left eye image and described right eye image that among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one is inequality, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

Program of the present invention makes computing machine carry out following steps: the left eye image step, the left eye that has constituted a part or whole original image is exported with image; Left eye deflection step makes the described left eye of exporting with image output step by described left eye carry out deflection with image towards user's left eye direction; Right eye is exported step with image, and the right eye that has constituted a part or whole original image is exported with image; Right eye deflection step makes the described right eye of exporting with image output step by described right eye carry out deflection with image towards user's right eye direction; And controlled step, described left eye is controlled with the image efferent with image efferent and described right eye, described left eye image and described right eye image that among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one is inequality, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

Integrated circuit of the present invention comprises: left eye image efferent, the left eye that constitutes a part or whole original image is exported with image; The left eye deflector, the described left eye that described left eye is exported with the image efferent carries out deflection with image towards user's left eye direction; Right eye image efferent is exported with image the right eye that constitutes a part or whole original image; The right eye deflector, the described left eye that described right eye is exported with the image efferent carries out deflection with image towards user's right eye direction; And control part, described left eye is controlled with the image efferent with image efferent and described right eye, described left eye image and described right eye image that among output pixel position, picture shape, image size and the display frame rate at least one is inequality, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

In addition, the present invention not only can implement as this beam flying type display device, and can be used as the integrated circuit of the function that is used to realize beam flying type display device and implement, perhaps as making computing machine carry out this functional programs and implement.In addition, self-evident, this program can be by the circulation of transmission mediums such as recording medium such as CD-ROM and the Internet.In addition, the present invention's integrated circuit of also can be used as the function that is used to realize this display device is implemented.

Glasses type head mounted display of the present invention comprises: above-mentioned image display device; The left eye eyeglass, it is configured in user's left eye position, and has described left eye deflector in the position on user's left eye opposite; The right eye eyeglass, it is configured in user's right eye position, and has described right eye deflector in the position on user's right eye opposite; Left side mirror leg, the one end is connected to described left eye eyeglass, and the other end is fixed on user's left side of head; Right side mirror leg, one end are connected to described right eye eyeglass, and the other end is fixed on user's right side of head.

Automobile of the present invention comprises: above-mentioned image display device; Windshield, it comprises that described left eye is with deflector and described right eye deflector.

Binoculars of the present invention comprise: left eye eye lens sheet, and it has described left eye deflector; Right eye eye lens sheet, it has described right eye deflector.

Console display of the present invention comprises: above-mentioned image display device; Be used to deposit the framework of described display device; The display surface that on described framework surface, constitutes with deflector with deflector and described right eye by described left eye.

The effect of invention

According to the present invention, can be with the melting as the effect flexible Application in improving the image quality that spectacle HMD is watched of eyes, and can be in the performance of gated sweep portion, improve frame per second that the user watched or the resolution of being watched when the identification image.

Description of drawings

Figure 1A is the vertical view of the beam flying type display device in the 1st embodiment of the present invention.

Figure 1B is the side view of the beam flying type display device in the 1st embodiment of the present invention.

Fig. 2 is the detailed structure view of the beam flying type display device in the 1st embodiment of the present invention.

Fig. 3 is the functional block diagram of the beam flying type display device in the 1st embodiment of the present invention.

Fig. 4 A is the example that is projected in the left eye usefulness image on user's left eye.

Fig. 4 B is the example that is projected in the right eye usefulness image on user's right eye.

Fig. 4 C shows to utilize when Fig. 4 A and Fig. 4 B are carried out projection and melts the general image that the user is seen as effect.

Fig. 5 shows the table of the relation of people's the visual field and eyesight.

Fig. 6 is the process flow diagram of processing that is used for improving the viewed frame that arrives of display image of the 1st embodiment of the present invention.

Fig. 7 A shows the size that is used for the original image that shows in the HMD of the 1st embodiment of the present invention.

Fig. 7 B shows the horizontal field of view angle of the original image shown in Fig. 7 A.

Fig. 7 C shows the vertical field of view angle of the original image shown in Fig. 7 A.

Fig. 8 A shows the size that is used for the center image that shows in the HMD of the 1st embodiment of the present invention.

Fig. 8 B shows the horizontal field of view angle of the center image shown in Fig. 8 A.

Fig. 8 C shows the vertical field of view angle of the center image shown in Fig. 8 A.

It is the example of center when having set center image that Fig. 9 A shows sight line position with the user.

Fig. 9 B shows the relation between the original image of Fig. 9 A and user's the sight line.

Figure 10 shows the horizontal scanning angle of scanner section in the 1st embodiment of the present invention and shows relation between user's the horizontal field of view angle of image.

Figure 11 shows the frame that is used for the original image that shows in the MD of the 1st embodiment of the present invention.

Figure 12 shows the display frame that is used for the wide open image that shows in the HMD of the 1st embodiment of the present invention.

Figure 13 shows the display frame that is used for the narrow field-of-view image that shows in the HMD of the 1st embodiment of the present invention.

Figure 14 shows the frame that makes the image that the user sees as effect that melts that utilizes eyes in the 1st embodiment of the present invention.

Figure 15 is the arrangement plan that the wide open in the 2nd embodiment of the present invention is used scanner section and deflector.

Figure 16 is the arrangement plan that scanner section and deflector are used in the narrow visual field in the 2nd embodiment of the present invention.

Figure 17 A shows the size that is used for the original image that shows in the HMD of the 2nd embodiment of the present invention.

Figure 17 B shows the horizontal field of view angle of the original image shown in Figure 17 A.

Figure 17 C shows the vertical field of view angle of the original image shown in Figure 17 A.

Figure 18 A shows the size that is used for the center image that shows in the HMD of the 2nd embodiment of the present invention.

Figure 18 B shows the horizontal field of view angle of the center image shown in Figure 18 A.

Figure 18 C shows the vertical field of view angle of the center image shown in Figure 18 A.

Figure 19 is the process flow diagram of processing that is used for improving the viewed resolution that arrives of display image of the 2nd embodiment of the present invention.

Figure 20 shows the frame that is used for the original image that shows in the HMD of the 2nd embodiment of the present invention.

Figure 21 shows the display frame that is used for the wide open image that shows in the HMD of the 2nd embodiment of the present invention.

Figure 22 shows the display frame that is used for the narrow field-of-view image that shows in the HMD of the 2nd embodiment of the present invention.

Figure 23 shows the frame that makes the image that the user sees as effect that melts that utilizes eyes in the 2nd embodiment of the present invention.

Figure 24 is the functional block diagram of the beam flying type display device in the 3rd embodiment of the present invention.

Figure 25 shows the distortion of the projected image that produces on deflector.

Figure 26 shows the process flow diagram of the aligning step of keystone distortion.

Figure 27 shows the position relation of scanner section and deflector.

Figure 28 shows the keystone distortion that produces on deflector.

Figure 29 shows the shape of left eye with the projected image on the deflector.

Figure 30 shows the shape of right eye with the projected image on the deflector.

Figure 31 shows the shape of the image that the user sees.

Figure 32 shows according to left eye and has extracted rectangular area and remaining area state afterwards with the projected image on the deflector.

Figure 33 shows according to right eye and has extracted rectangular area and remaining area state afterwards with the projected image on the deflector.

Figure 34 shows the shape of the show image after the keystone correction.

Figure 35 shows the process flow diagram of the deforming step of image shown in the right and left eyes in the 3rd embodiment of the present invention.

Figure 36 A shows the longitudinal size and the lateral dimension of original image.

Figure 36 B shows the depth-width ratio of the original image of Figure 36 A is adjusted the correcting image that the back generates.

Figure 37 shows the image-region that is presented among the correcting image in the left eye.

Figure 38 shows the image-region that is presented among the correcting image in the right eye.

Figure 39 shows the image of Figure 37 has been implemented the state after the distortion correction.

Figure 40 shows the image of Figure 38 has been implemented the state after the distortion correction.

Figure 41 shows among the image of Figure 39 and extracts as the state after the part of object output.

Figure 42 shows among the image of Figure 40 and extracts as the state after the part of object output.

Figure 43 shows according to left eye and extracts rectangular area state afterwards with the projected image on the deflector.

Figure 44 shows according to right eye and extracts remaining area state afterwards with the projected image on the deflector.

Figure 45 shows the shape of the show image after the keystone correction.

Figure 46 shows the image-region that is presented among the correcting image in the left eye.

Figure 47 shows the image-region that is presented among the correcting image in the right eye.

Figure 48 is used for illustrating the representative instance of this 3rd embodiment.

Figure 49 is the functional block diagram of the beam flying type display device in the 4th embodiment of the present invention.

Figure 50 is the process flow diagram that is used to change the processing of the frame per second of display image and resolution.

Figure 51 shows the size of the original image that is used to show.

Figure 52 shows the example of the metadata (meta data) that is attached on the original image.

Figure 53 shows the relation between battery dump energy and the frequency correction value.

Figure 54 shows the content information of original image and the relation between the frame per second coefficient.

Figure 55 shows the relation between content information and the frame per second coefficient correction value.

Figure 56 A shows an example of the vertical scanning scope of scanner section.

Figure 56 B shows another example of the vertical scanning scope of scanner section.

Figure 56 C shows another example of the vertical scanning scope of scanner section.

Figure 57 shows an example of the scan pattern in the scanner section of left and right sides.

Figure 58 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 59 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 60 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 61 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 62 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 63 shows another example of the scan pattern in the scanner section of left and right sides.

Figure 64 is the side view of the HUD in the 5th embodiment of the present invention.

Figure 65 shows an example of the general view of the HUD shown in Figure 64.

Figure 66 shows another example of the general view of the HUD shown in Figure 64.

Figure 67 shows another example of the general view of the HUD shown in Figure 64.

Figure 68 is the detailed structure view of the HUD shown in Figure 64.

Figure 69 shows an example of the general view of the binoculars in the 6th embodiment of the present invention.

Figure 70 shows the left eye side display part of the binoculars shown in Figure 69.

Figure 71 shows the right eye side display part of the binoculars shown in Figure 69.

Figure 72 shows another example of the general view of the binoculars in the 6th embodiment of the present invention.

Figure 73 shows the console display in the 7th embodiment of the present invention.

Figure 74 shows the example of turning axle of the catoptron of two-dimensional scan light beam.

Figure 75 shows the track of being described by the laser of scanner section scanning generation on deflector.

Figure 76 shows the example of the arrangement plan of scanner section and deflector.

Figure 77 shows the example of scan pattern under the situation of having considered overscan regions.

Figure 78 shows the general view when projecting to the image from pointolite on the screen at a slant.

Figure 79 shows the front view (FV) when projecting to the image from pointolite on the screen at a slant.

Figure 80 shows the keystone correction that utilizes prior art to carry out.

Description of reference numerals:

11 left eye eyeglasses

12 right eye eyeglasses

13 left side mirror legs

14 right side mirror legs

100 left eyes image efferent

101 left eye light sources

102 left eyes wave front shape changing unit

103 left eye scanner sections

104 left eye deflector

105 left eye control parts

106,112 earphone portions

107 right eye deflector

108 right eye scanner sections

109 right eyes wave front shape changing unit

110 right eye light sources

111 right eye control parts

201,3001 focal length horizontal component changing units

202,3002 focal length vertical component changing units

211 red laser light sources

212 blue laser light source

213 green laser light sources

214 optical detection parts

301 monolithic catoptrons

303,304 laser

The 401a projected image

501,601 display images

Image before 501a proofreaies and correct

502a proofreaies and correct the back image

502,602c track while scan

601 left eye images

601a left eye distorted image

The 601b left eye is used the viewing area

602 right eye images

602a right eye distorted image

The 602b right eye is used the viewing area

603 general images

801b graphical analysis portion

802b driving frequency determination section

803b power management portion

804b shows the image quality determination section

805b user's configuration management portion

806b scan pattern determination section

807b image control part

901,1901,1901a original image

1001,2001 center image

1051 sweep limit configuration parts

1052 image quality configuration parts

1053 resolution setting portions

1054 frame per second configuration parts

1401a, 1401b left eye are used the rectangular area

1401,1402,1403 scan patterns

1402a left eye remaining area

The 1501a right eye is used the rectangular area

1502a, 1502b right eye remaining area

1601a melts picture back figure

1801 keystone distortion detection units

1802 rectangular area determination sections

1803 remaining area determination sections

1804 image control parts

1805 depth-width ratio adjustment parts

1806 distortion correction portions

1807 output image control parts

The 1902a correcting image

2001a, 2601a left eye parts of images

2101a, 2701a right eye parts of images

2201a left eye ladder diagram picture

2301a right eye ladder diagram picture

2401a left eye projection image

2501a right eye projection image

2202a, 2203a, 2302a, 2303a trapezoid area

2402a, 2502a rectangular area

2601 cars

2602,2610 laser scan units

2603 windshield

2604 semi-transparent semi-reflecting lens

2605 drivers

2606,2609 eyeballs

2607 ceilings

2608 support rod

3101 binoculars

3101a left eye side display part

3101b right eye side display part

3102,3501 catoptrons

3103,3502 cameras

3104 right eyes

3105 users

3106 left eyes

3401 console displays

Embodiment

Below, with reference to the description of drawings embodiments of the present invention.

(the 1st embodiment)

The beam flying type display device (head mounted display: HMD) of the shape of glasses of the 1st embodiment of the present invention is described with reference to Figure 1A～Fig. 3.Wherein, Figure 1A is the front view (FV) of beam flying type display device, and Figure 1B is the side view of beam flying type display device, and Fig. 2 is the details drawing of the part of Figure 1A, and Fig. 3 is the functional block diagram of the beam flying type display device in the 1st embodiment.The spectacle beam flying type display device of the 1st embodiment of the present invention comprises: display device; Be configured in user's the locational left eye of left eye eyeglass 11; Be configured in user's the locational right eye of right eye eyeglass 12; Left side mirror leg (temple) 13, one end are connected to left eye eyeglass 11, and the other end is fixed on user's left side of head; Right side mirror leg 14, one end are connected to right eye eyeglass 12, and the other end is fixed on user's right side of head.

Display device such as Figure 1A, Figure 1B and shown in Figure 2 comprise: light source 101,110, and its output beam is used to describe to constitute each pixel of display image; Wave front shape changing unit 102,109, its wave front shape to the light beam of light source 101,110 outputs changes; Scanner section 103,108, it makes the light beam of wave front shape changing unit 102,109 outputs carry out two-dimensional scan towards deflector 104,107; Deflector 104,107, its scan light that makes scanner section 103,108 is towards the deflection of eyes of user direction; Control part 105,111, it is controlled described each several part; Earphone portion 106,112.

Wherein, left eye has constituted left eye image efferent 100 with wave front shape changing unit 102 and left eye with scanner section 103 with light source 101, left eye.Similarly, right eye has constituted right eye image efferent (omit diagram) with wave front shape changing unit 109, right eye with scanner section 108 with light source 110, right eye.

In addition, in this embodiment, light source 101,110, wave front shape changing unit 102,109, scanner section 103,108, control part 105,111 and earphone portion 106,112 are housed in the mirror leg 13,14, and deflector 104,107 is configured in the side facing to eyes of user on the eyeglass 11,12.

In addition, in this manual, sometimes will " left eye with eyeglass 11 " and " right eye with eyeglass 12 " be referred to as " eyeglass 11,12 ".Similarly,, use and the right eye time spent, sometimes can omit the word of " left eye is used " and " right eye is used " at the general designation left eye for other textural element (comprising image etc.).

Light source 101,110 output beams.As shown in Figure 2, the light beam of being exported is the laser that the laser composite wave of all kinds by red laser light source 211, blue laser light source 212,213 outputs of green laser light source is formed, by the output of LASER Light Source 211,212,213 of all kinds is suitably modulated, just can export the laser of random color.And then, by modulating, just can on user's eye retina, demonstrate image with wave front shape changing unit 102,109 or scanner section 103,108 interlocks.

In addition, green laser light source 213 in this embodiment will be used to export ultrared semiconductor laser light resource and be used for infrared ray is transformed to green SHG (Second-Harmonic Generation: second harmonic produces) elements combination, output green laser.But, the present invention is not limited to said structure, also can adopt green semiconductor laser light resource 213.In addition, each LASER Light Source 211,212,213 also can be Solid State Laser, liquid laser, gas laser, light emitting diode etc.

In addition, as shown in Figure 2, light source 101,110 also can comprise optical detection part 214.Optical detection part 214 can detect user's direction of visual lines by detecting the light intensity that comes out from the corneal reflection of eyes of user.By the effect of deflector 104,107 towards most of light beam of eyes direction deflection with respect to the anterior corneal surface oblique incidence, but be vertical incidence with respect to anterior corneal surface, so the reflectivity of light beam is higher from the light beam in eyeball front.Utilize this character, just can go out direction of visual lines according to catoptrical intensity detection.

Wave front shape changing unit 102,109 changes the wave front shape of the light beam that light source 101,110 sends respectively, and the luminous point size of the light beam after deflector 104,107 deflections is dropped in the specialized range.

" luminous point size (the spot size) " of light beam refers to the luminous point size on the retina of eyes of user, and the back will be illustrated; But also can be in the luminous point size on the pupil, in the luminous point size on the cornea, luminous point size on deflector 104,107.Luminous point size on retina is identical with shown pixel size.In addition, " wave front shape " refers to the 3D shape of light beam wave front, comprises plane, sphere, aspheric shape.

Use in the wave front shape changing unit 102 at left eye shown in Figure 2, focal length horizontal component changing unit 201 and focal length vertical component changing unit 202 are arranged in series on the light path.Thus, just can change the curvature of beam level direction and the curvature of vertical direction independently.Focal length horizontal component changing unit 201 changes the curvature of horizontal direction by changing the distance of cylindrical lens and catoptron.Focal length vertical component changing unit 202 changes the curvature of vertical direction by using the cylindrical lens with respect to the cylindrical lens arranged perpendicular of focal length horizontal component changing unit 201.In addition, focal length horizontal component changing unit 201 and focal length vertical component changing unit 202 all change the diameter of light beam simultaneously along with the change of curvature.

In addition, if the curved transition of horizontal direction is greater than the curved transition of vertical direction, the horizontal direction that then can handle by a relatively large margin changes, therefore, under the situation of the horizontal view angle of wishing picture greater than the vertical angle of view, perhaps as the HMD that the sidepiece at head is assembling scanner section 103,108, at scanner section 103,108 under the situation of glancing incidence angle greater than the vertical incidence angle of the light beam that deflector 104,107 penetrates, so especially effective.

In addition, in Fig. 2, only these a part of wave front shapes relevant with each diameter of the curvature of the curvature of horizontal direction and vertical direction change among the parameter of his-and-hers watches oscillography front shape, but also can change other parameters, for example the shape of the curvature distribution in the wave front, wave front front end or size etc.

In addition, wave front shape changing unit 102,109 in the present embodiment uses cylindrical lens and catoptron to change the wave front shape, but also can use other means, for example deformable lens such as liquid crystal lens, liquid lens, EO element (electric light conversion element) etc.In this case, do not need the mobile lens position just can change the wave front shape.In addition, replace cylindrical lens, can realize the miniaturization of whole device by using diffraction element to wait.

Scanner section 103,108 makes the light beam from wave front shape changing unit 102,109 carry out two-dimensional scan towards deflector 104,108 respectively.Scanner section the 103, the 108th can change the small-sized monolithic catoptron of angle on two-dimensional directional, more specifically, be MEMS (Micro-Electro-Mechanical-System: MEMS (micro electro mechanical system)) catoptron.In addition, scanner section 103,108 also can by horizontal scanning with and vertical scanning realize with the combination of so two or more scanner section.Deflector 104,107 makes scanner section 103,108 beam directions that scanned respectively towards the direction deflection of eyes of user.In the deflector 104,107, the inboard of eyeglass 11,12 (eyes one side) is formed with for example photosensitive polymer layer, and on photosensitive polymer layer, form Lippmann's volume hologram, make thus and send as an envoy to from the beam diffraction of scanner section 103,108, the optically focused deflector to the pupil of eyes of user.On photosensitive polymer layer, both can overlap to form 3 holograms of the light that reflection Red, green, blue laser light source 211,212,213 respectively send, also can the corresponding 3 layers of hologram of stacked and versicolor light.In addition, utilize the selectivity of hologram to wavelength, only the light to optical source wavelength carries out diffraction, and most light beyond the optical source wavelength, that constitute extraneous light is not carried out diffraction, in this manner, just can produce the display of transmission-type.

In addition, deflector 104,107 is not limited to utilize diffraction elements such as hologram to carry out deflection, also can be lens such as catoptrons such as concave mirror or convex lens.In addition, deflector 104,107 also comprises following mode, that is, light beam irradiates is dispersed after to the screen of reflection type screen or rear projection screen and so on, and its result makes a part from the diverging light of screen to the deflection of eyes of user direction.

Control part 105,111 comprises the integrated circuit that is used to control the HMD each several part.The output of the laser that sends from light source 101,110 by control part 105,111 control and the action of wave front shape changing unit 102,109 and scanner section 103,108.In addition, control part 105,108 possesses the means that the shown image of subtend user is processed.

As shown in Figure 3, left eye comprises with control part 105: sweep limit configuration part 1051, it makes a scanner section among the scanner section 103,108 carry out beam flying with the 1st scanning angle that only can scan a part of original image, makes another scanner section to carry out beam flying greatly and smaller or equal to the 2nd scanning angle of the scanning angle that can scan original image integral body than the 1st scanning angle; Image quality configuration part 1052, the scanning angle that it sets according to sweep limit configuration part 1051, the image quality of setting scanner section 103,108 images that scanned.In addition, the 2nd scanning angle in the 1st embodiment is set at the scanning angle (maximal value of the 2nd scanning angle) that scans original image integral body.

In addition, image quality configuration part 1052 comprises: resolution setting portion 1053 is used to change left eye is used image with image and right eye resolution; Frame per second configuration part 1054 is used to change left eye is used image with image and right eye frame per second.

Resolution setting portion 1053 makes left eye export the image of the 1st resolution with light source 101 and right eye with the light source that is set at the 1st scanning angle among the light source 110, makes the image of light source output the 2nd low resolution than the 1st resolution that is set at the 2nd scanning angle.

Frame per second configuration part 1054 makes left eye export the image of the 1st frame per second with light source 101 and right eye with the light source that is set at the 1st scanning angle among the light source 110, makes the image of light source output the 2nd little frame per second than the 1st frame per second that is set at the 2nd scanning angle.

In addition, control part 105,111 also can comprise Department of Communication Force, carries out wireless connections with external unit such as mobile phone, receives image and voice signal.If obtain image from external unit, those just need be at the inner memory storage that is used for recording image or the demoder etc. of being equipped with of display device, miniaturization that therefore can implement device.

The image control part that comprises in the control part 105,111 (omitting diagram) both can possess storer and be used to preserve the image of showing to the user, perhaps also can obtain the image of showing to the user from external unit by wireless mode.

In addition, control part 105,111 can have only one, some by among the control part 105,111 is to controlling with the action of the corresponding light source 101,110 of right and left eyes, wave front shape changing unit 102,109, scanner section 103,108 and earphone portion 106,112.In this case, can realize the miniaturization of HMD, also realize easily in addition image in the right and left eyes synchronously.

Earphone portion 106,112 possesses loudspeaker, output sound.In addition, earphone portion also can possess the battery for the power supply of HMD each several part.

In addition, each device and each parts among Fig. 1 both can be built in 1 HMD, also can not be built in 1 HMD.For example, both can comprise the whole parts among Fig. 1 in 1 HMD, also can not have earphone portion 106,112.In addition, each parts also can be a decentralized configuration.For example, control part 105,111 can be included among scanner section 103,108 or the wave front shape changing unit 102,109 as its part.Also can be by each parts of the shared Fig. 1 of multiple devices.For example, can be by 2 HMD common light source 101,110.

The image quality that is used to improve display image among the present invention " melting the picture effect " then, is described.The so-called picture effect of melting refers to the phenomenon that image that the user sees right and left eyes synthesizes an image and discerned.Fig. 4 A～Fig. 4 C shows the example that melts the picture effect.Fig. 4 A is the left eye image 601 that shows at user's left eye, and Fig. 4 B is the right eye image 602 that shows at user's right eye.When showing image shown in Fig. 4 A and Fig. 4 B at right and left eyes, people's brain can synthesize the image of right and left eyes an image and be discerned.That is, the display image seen of user be by left eye with image 601 and right eye with the image 602 synthetic general images 603 that obtain.The zone that is surrounded by dotted box among Fig. 4 C is the zone that only depends on right eye or left eye to see, but the user can't recognize this point, but has seen general image 603.

Then, people's the visual field and the relation of eyesight are described.People's eyesight is also inequality in the whole visual field scope, but the core in the visual field has higher eyesight, and user's eyesight can be along with descending away from center, the visual field.Fig. 5 shows user's the visual field and the relation of eyesight.As shown in the drawing, people's eyes can keep the field range of high-resolution to be confined in the central field of vision about user's direction of visual lines ± 5 °.Therefore, even the image quality of the part outside the central field of vision is relatively poor, messenger's eyes also are not easy to notice the decline of image quality in general.

Among the present invention, utilize the phenomenon that changes along with the visual field as effect and eyesight of melting of this eyes, improve the image quality of the display image of being watched.The image that is arranged in the customer center area of visual field among the present invention's image that beam flying type display device is shown is presented at the eyes of a side with high image quality, and the image of wide open is presented in the eyes of opposite side with low image quality.But the user can only limit to the zone of high resolution identification image in the central field of vision, therefore, can not notice that the image in the wide open is to hang down image quality, and consequently, it is the high resolution image of wide open that the image that shows is identified as.The present invention utilizes this principle, has improved the image quality that spectacle HMD watched.

Beam flying type display device with Fig. 1 is an example below, shows to utilize described melting as effect to improve the viewed image quality that arrives of display image.

Wherein, in the present embodiment, suppose scanner section the 103, the 108th, have the mirror device of same configuration.In addition, shown in Figure 74, suppose that this mirror device is to utilize driving element to drive the device of monolithic catoptron in the enterprising line scanning of two-dimensional directional.

Scanner section 103,108 in the present embodiment designs in such a way, that is, incident laser is scanned with α 1 degree horizontal scanning angle, β 1 degree vertical scanning angle, and to have reveal competence resolution be Nx1 _Max, vertical resolution is Ny1 _MaxThe ability of image.In addition, the driving frequency of supposing the horizontal direction of scanner section 103,108 is that the driving frequency of Hx1, vertical direction is Hy1.And then, during scanner section 103,108 action of (the 1st direction) enterprising line scanning pixel in the horizontal direction, on one side on vertical direction (with the 2nd direction of the 1st direction quadrature) shift position successively, repeatedly repeat this action on one side, depict 1 two field picture thus.

Show the example that improves the viewed frame per second that arrives of display image by the demonstration that changes left and right sides below.This is handled by step 801 shown in Figure 6～804 and implements.

(step 801: left and right sides share)

In this step, which was used for showing and the corresponding center image of central field of vision among scanner section 103,108 was determined in sweep limit configuration part 1051.Here be chosen as the scanner section that is used for the display centre image with less than the laser of common scanning angle (the 1st scanning angle) scanning from light source 101,110.In the present embodiment, in sweep limit configuration part 1051, preestablished right eye with scanner section 108 as the scanner section that is used for the display centre image.

In addition, also can use by the user and utilize user interface to carry out appointed method, be identified for showing the scanner section of center image.In this case, the user can determine image that display resolution is high in a branch hole eyeball of oneself seeing clearly easily etc.

For example, also can the eyesight of which branch hole eyeball of user is good (imitating the I order) such information be saved in advance in the sweep limit configuration part 1051, thereby the scanner section of selection and corresponding that side of clearsighted eyes is used for the display centre image.In this case, just can show high-precision image to the branch hole eyeball that the user sees clearly easily.

In addition, also user's eyesight information can be saved in the sweep limit configuration part 1051 in advance, thus select with eyesight preferably the corresponding scanner section of eyes come the display centre image.In this case, just can to user's eyesight preferably a branch hole eyeball show the more image of high image quality.

(step 802: indication range determine)

In this step, definite zone that among the entire image that the user shows, shows as center image 1001.

Original image 901 shown in Fig. 7 A～Fig. 7 C is images that the HMD of Fig. 1 shows to the user, and its horizontal resolution is that Nx1, vertical resolution are that Ny1, frame per second are fps1.In addition, suppose that the horizontal field of view angle when watching this image among the HMD of Fig. 1 is that γ 1, vertical field of view angle are δ 1.

The scope of the original image 901 interior images that show as center image 1001 is determined in sweep limit configuration part 1051 according to mode shown in Figure 8.In the present embodiment, sweep limit configuration part 1051 is defined as center image 1001 that the horizontal field of view angle is γ 1 when using HMD to watch _c, the vertical field of view angle is δ 1 _cThe zone.

At this moment, the horizontal resolution Nx1 of center image 1001 _cWith vertical resolution Ny1 _cCan use formula (5) and formula (6) to calculate according to itself and the resolution of original image 901 and the relation of field angle.The value of resolution, N x1, the Ny1 of original image 901, field angle γ 1, δ 1 can determine when design HMD that therefore, in the present embodiment, these values offer left eye control part 105 in advance.

[formula 5]

Hx1 _c＝Nx1×tan(γ1 _c/2)/tan(γ1/2) (5)

[formula 6]

Ny1 _c＝Ny1×tan(δ1 _c/2)/tan(δ1/2) (6)

Try to achieve the resolution, N x1 of center image 1001 _c, Ny1 _cAfter, sweep limit configuration part 1051 is the center with the central part pixel of original image 901, determines highly to be Ny1 _c, width is Nx1 _cResolution, be center image 1001 as the image of central field of vision.

In addition, the value of resolution, N x1, the Ny1 of original image 901 both can be obtained by analysis image with control part 105 by left eye, also can obtain according to the metadata that is attached on the original image 901.The field angle γ 1 of original image 901, δ 1 also can use following method to ask for, that is, utilize the first-class shooting of shooting to project to the shape of the laser on the deflector 104,107 from scanner section 103,108, are calculated according to this shape with control part 105 by left eye.In this case, even variation has taken place the position of scanner section 103,108 and deflector 104,107 relation, also can correctly try to achieve field angle γ 1, δ 1.

In addition, the zone of center image 1001 is determined in user's sight line position that sweep limit configuration part 1051 also can detect based on optical detection part 214.For example, shown in Fig. 9 A and Fig. 9 B, the point that optical detection part 214 detected user's sight lines and original image 901 intersected calculates, as intersection point A (sight line position).Then, determining to comprise intersection point A is Nx1 in interior, horizontal resolution _c, vertical resolution is Ny1 _cThe zone, as center image 1001.

(step 803: the reduction of display pixel)

Resolution when resolution setting portion 1053 determines in being presented at previous step determined center image 1001 and original image 901 in this step.

If resolution, N x1, the Ny1 of original image have surpassed the resolution, N x1 that left eye can show with 103 of scanner sections _Max, Ny1 _Max, it is Nx1 that resolution setting portion 1053 just generates horizontal resolution by the pixel roughening that makes original image 901 _Max, vertical resolution is Ny1 _MaxThe wide open image.If the resolution, N x1 that the resolution of original image 901 can show with 103 of scanner sections smaller or equal to left eye _Max, Ny1 _Max, then original image 901 is set at the wide open image.

The right side scanner section 108 that is used for display centre image 1001 is γ 1 to user's reveal competence field angle _c, the vertical field of view angle is δ 1 _cImage, for this reason, it is α 1 that the scanning angle (the 1st scanning angle) of laser scanning is set at the horizontal scanning angle _c, the vertical scanning angle is β 1 _c Field angle γ 1 _c, δ 1 _cWith scanning angle α 1 _c, β 1 _cRelation be what when the design of HMD shown in Figure 1, to determine, therefore, left eye with control part 105 with field angle γ 1 _c, δ 1 _cWith scanning angle α 1 _c, β 1 _cRelation table be saved in advance in the storage part (omit diagram), can calculate the value of scanning angle thus according to field angle.

When right eye uses scanner section 108 with horizontal scanning angle α 1 _c, vertical scanning angle β 1 _cWhen carrying out laser scanning, suppose that displayable horizontal direction resolution is Nx1 _Cmax, vertical direction resolution is Ny1 _Cmax, Nx1 then _Cmax, Ny1 _CmaxCan try to achieve by formula (7) and formula (8).

[formula 7]

Nx1 _cmax＝Nx1 _max×α1 _c/α1 (7)

[formula 8]

Ny1 _cmax＝Ny1 _max×β1 _c/β1 (8)

If the resolution, N x1 of the center image of trying to achieve in the previous step 1001 _c, Ny1 _cSurpassed resolution, N x1 _Cmax, Ny1 _Cmax, resolution setting portion 1053 just carries out roughened to the pixel of center image 1001, is Nx1 with horizontal resolution _Cmax, vertical resolution is Ny1 _CmaxImage be defined as narrow field-of-view image.In addition, if the resolution, N x1 of center image 1001 _c, Ny1 _cSmaller or equal to resolution, N x1 _Cmax, Ny1 _Cmax, just center image 1001 is defined as narrow field-of-view image.

(step 804: frame per second determine)

Frame per second when in this step, the wide open image of being tried to achieve and narrow field-of-view image are determined in frame per second configuration part 1054 in showing previous step.

Here, suppose with scanning angle α 1 _c, β 1 _cDrive right eye with under the situation of scanner section 108, the maximum drive frequency that can realize on the horizontal direction is Hx1 _Max, the maximum drive frequency that can realize on the vertical direction is Hy1 _MaxFrame per second configuration part 1054 has been stored the relation table of scanning angle and driving frequency in advance in storage part, calculate maximum drive frequency Hx1 corresponding with scanning angle, that can realize thus _MaxAnd Hy1 _MaxValue.

At this moment, frame per second configuration part 1054 is according to the formula (1) of the relation of the vertical direction driving frequency of described expression frame per second and scanner section 103,108, with the frame per second fps1 of wide open image _wBe set at the value of 2 * Hy1, with the frame per second fps1 of narrow field-of-view image _nBe set at 2 * Hy1 _MaxValue.

As mentioned above, with horizontal scanning angle α 1, vertical scanning angle β 1 driving laser, demonstrate the horizontal field of view angle to the user thus is that γ 1, vertical field of view angle are the wide open image of δ 1 to left eye with scanner section 103.In addition, left eye uses scanner section 108 with horizontal scanning angle α 1 _c, vertical scanning angle β 1 _cCome driving laser, demonstrating the horizontal field of view angle to the user thus is γ 1 _c, the vertical field of view angle is δ 1 _cNarrow field-of-view image.

Figure 10 shows each angle [alpha] 1, the α 1 relevant with the horizontal direction of this scanner section 103,108 _c, γ 1, γ 1 _cRelation.As shown in the drawing, be the required scanning angle α 1 (the 2nd scanning angle) of the image of γ 1 greater than in order to show that field angle is γ 1 in order to show field angle _cThe required scanning angle α 1 of image _c(the 1st scanning angle).Similarly, in vertical direction, the scanning angle β 1 of vertical direction (the 2nd scanning angle) is also greater than β 1 _c(the 1st scanning angle).Usually, scanning angle is more little, and the driving frequency of scanner section 103,108 can be high more, therefore, can make Hy1 _MaxValue greater than Hy1.

As mentioned above, the relation of the frame per second fps of image and vertical direction driving frequency Hy satisfies the relation of formula (1).Therefore, the frame per second fps1 of narrow field-of-view image _nCan be set at frame per second fps1 greater than the wide open image _w

In addition, also can use following method, that is,, be determined at value, should be worth circular to left eye control part 105 with 103,108 o'clock driving frequencies of regulation scanning angle driven sweep portion by sensor installation on scanner section 103,108.In this case, the actual driving frequency of scanner section 103,108 can be detected, frame per second can be determined more accurately.

(step 805: image control)

In this step, control part 105,111 is controlled light source 101,110, wave front shape changing unit 102,109 and scanner section 103,108 corresponding to the narrow field-of-view image of determining in previous step and the resolution and the frame per second of wide open image.

Right eye is used to show that with control part 111 control right eye with user's the corresponding image of central field of vision with light source 110, makes its output and the corresponding laser of narrow field-of-view image.In addition, the control right eye is α 1 with scanner section 108 with the horizontal scanning angle _c, the vertical scanning angle is β 1 _c, the horizontal direction driving frequency is Hx1 _Max, the vertical direction driving frequency is Hy1 _MaxMode scan.

Left eye is controlled the left eye light source 101 that is used to show entire image with control part 105, makes its output and the corresponding laser of wide open image.In addition, the control left eye is that α 1, vertical scanning angle are that β 1, horizontal direction driving frequency are that Hx1, vertical direction driving frequency are that the mode of Hy1 scans with scanner section 103 with the horizontal scanning angle.

Use Figure 11～Figure 14 that the example of the image that the user seen at this moment is shown.Wherein, for the sake of simplicity, use the frame per second fps1 of original image 901 and the frame per second fps1 of narrow field-of-view image _nEquate, the fps1 of wide open image _wEqual fps1 _nFigure during half numerical value carries out example.

Figure 11 shows original image 901, and each frame switches with the interval of 1/fps1.

Figure 12 shows the demonstration of wide open image, and left eye is controlled in such a way with control part 105,, extracts fps1 from the frame of original image 901 that is _nThe frame of/fps1 is with fps1 _wFrame per second show.In this example, fps1 _w/ fps1 equals 0.5, and therefore, half among the frame of original image 901 be selected, show.

Figure 13 shows the demonstration of narrow field-of-view image, and right eye is controlled in such a way with control part 111,, extracts fps1 from the frame of original image 901 that is _nThe frame of/fps1, and with the image of its core with fps1 _nFrame per second show.In this example, fps1 _n/ fps1 equals 1, and therefore, whole frames of original image 901 are all selected, show.

Show in left eye in Figure 12, the right eye to show Figure 13 that consequently, utilize melting as effect of eyes, what the user saw is image shown in Figure 14.

What as shown in figure 14, the user saw is that center image 1001 is with high frame per second fps1 _n(the 1st frame per second) demonstration, remainder are with low frame per second fps1 _wThe image that (the 2nd frame per second) shows.At the higher core of eye eyesight, demonstrate ghost by improving frame per second to the user and feel few image, and, then show the image of wide open with low frame per second in the lower part of eyesight, thus the image field-of-view angle that can extend one's service and experience.

In addition, the execution sequence of step 803 and step 804 both can be put upside down, and also can handle simultaneously.

In addition, determine display packings by left eye with control part 105 in the present embodiment, but also can decide with control part 111, perhaps also can use and share the method for processing by two control parts 105,111 by right eye.

(the 2nd embodiment)

Show the different situation of mirror device structure of the left and right sides scanner section 103,108 of Fig. 1 in the present embodiment.Below with left eye with scanner section 103 as the wide open scanner section, with right eye with scanner section 108 as narrow visual field scanner section.

As shown in figure 15, be designed to scanner section 103 as the left eye of wide open with scanner section, it uses from the incident laser of left eye with light source 101, with horizontal scanning angle α 2 _LDegree, vertical scanning angle β 2 _LDegree scans, and to have reveal competence resolution be Nx2 _L, vertical resolution is Ny2 _LThe ability of image.In addition, suppose that left eye is Hx2 with the driving frequency of the horizontal direction of scanner section 103 _L, vertical direction driving frequency be Hy2 _L, the suitable resolution of per 1 degree scanning angle is Δ Nx _L, Δ Ny _LAnd then, suppose that left eye is D2 with the diameter of the monolithic catoptron that is comprised in the scanner section 103 _L

As shown in figure 16, be designed to scanner section 108 as the right eye of the narrow visual field with scanner section, it uses from the incident laser of right eye with light source 110, with horizontal scanning angle α 2 _RDegree, vertical scanning angle β 2 _RDegree scans, and to have reveal competence resolution be Nx2 _R, vertical resolution is Ny2 _RThe ability of image.In addition, suppose that right eye is Hx2 with the driving frequency of the horizontal direction of scanner section 108 _R, vertical direction driving frequency be Hy2 _R, the suitable resolution of per 1 degree scanning angle is Δ Nx _R, Δ Ny _RAnd then, suppose that right eye is D2 with the diameter of the monolithic catoptron that is comprised in the scanner section 108 _R

The original image 1901 that is shown to the user has been shown among Figure 17 A～Figure 17 C.The horizontal direction resolution of original image 1901 is Nx2, and the resolution of vertical direction is Ny2.In addition, the frame per second of original image 1901 is fps2.In the present embodiment, design in such a way, that is, and when left eye uses scanner section 103 with horizontal scanning angle α 2 _L, vertical scanning angle β 2 _LWhen carrying out laser scanning, the user utilizes the horizontal field of view angle of the image that the laser scanning type HMD of Fig. 1 seen to be γ 2 _L, the vertical field of view angle is δ 2 _LThe horizontal scanning angle α 2 of left eye with scanner section 103 has been shown among Figure 15 _LThe horizontal field of view angle γ 2 that sees with the user _LRelation.

In the present embodiment, design in such a way, that is, and when right eye uses scanner section 108 with horizontal scanning angle α 2 _R, vertical scanning angle β 2 _RWhen carrying out laser scanning, the user utilizes the horizontal field of view angle of the image that the laser scanning type HMD of Fig. 1 seen to be γ 2 _R, the vertical field of view angle is δ 2 _RThe horizontal scanning angle α 2 of right eye with scanner section 103 has been shown among Figure 16 _RThe horizontal field of view angle γ 2 that sees with the user _RRelation.

Here, right eye with scanner section 108 be designed to high pixel show the visual field than left eye with the narrow image of scanner section 103.For this reason, the right eye diameter D2 of the catoptron of scanner section 108 _RBe designed to greater than the diameter D2 of left eye with the catoptron of scanner section 103 _L

The resolution of mirror device and scanning angle and the proportional relation of mirror image size.Therefore, with regard to the suitable resolution of per 1 degree scanning angle, the larger-size right eye of mirror image is with scanner section 108 higher (Δ Nx _R＞Δ Nx _L, Δ Ny _R＞Δ Ny _L).That is, in the present embodiment, compare with the shown image of scanner section 103, can show meticulousr pixel with the image that scanner section 108 shows by right eye with left eye.

The example that improves the resolution of the viewed display image that arrives by the demonstration that changes left and right sides is shown below.This processing is implemented by step 2101 shown in Figure 19～2104.

(step 2101: the selection of center image)

In this step, definite zone that among the entire image that the user shows, shows as center image 2001.

The scope of the image that shows as center image 2001 in the original image 1901 is determined in sweep limit configuration part 1051 according to mode shown in Figure 18 A～Figure 18 C.In the present embodiment, sweep limit configuration part 1051 is defined as center image 1001 that the horizontal field of view angle is γ 2 when using HMD to watch _R, the vertical field of view angle is δ 2 _RThe zone.

At this moment, the horizontal resolution Nx2 of center image 2001 _cWith vertical resolution Ny2 _cCan use formula (9) and formula (10) to calculate according to itself and the resolution of original image 1901 and the relation of field angle.Resolution, N x2, the Ny2 of original image 1901, field angle γ 2 _L, δ 2 _LValue can determine that therefore, in the present embodiment, these values offer left eye usefulness control part 105 in advance in design during HMD.

[formula 9]

Nx2 _c＝Nx2×tan(γ2 _R/2)/tan(γ2 _L/2) (9)

[formula 10]

Ny2 _c＝Ny2×tan(δ2 _R/2)/tan(δ2 _L/2) (10)

Try to achieve the resolution, N x2 of center image 2001 _c, Ny2 _cAfter, sweep limit configuration part 1051 is the center with the central part pixel of original image 1901, determines highly to be Ny2 _c, width is Nx2 _cResolution, be center image 2001 as the image of central field of vision.

In addition, the value of resolution, N x2, the Ny2 of original image 1901 both can be asked for by graphical analysis with control part 105 by left eye, also can ask for according to the metadata that is attached on the original image 1901.The field angle γ 2 of original image 1901 _L, δ 2 _LAlso can use following method to ask for, that is, utilize the first-class shooting of shooting to project to the shape of the laser on the deflector 104, calculate according to this shape with control part 105 by left eye from scanner section 103.In this case, even variation has taken place the position of scanner section 103 and deflector 104 relation, also can correctly try to achieve field angle γ 2 _L, δ 2 _L

In addition, also can utilize optical detection part 214, use and the same procedure described in the 1st embodiment, determine the zone of center image 2001 according to user's sight line.

(step 2102: the reduction of resolution)

Resolution when in this step, in previous step determined center image 2001 and original image 1901 are determined in display resolution configuration part 1053.

If resolution, N x2, the Ny2 of original image 1901 have surpassed the resolution, N x2 that left eye can show with 103 of scanner sections _L, Ny2 _L, resolution setting portion 1053 just carries out the processing of the pixel roughening that makes original image 1901, and the generation horizontal resolution is Nx2 _L, vertical resolution is Ny2 _LThe wide open image.If the resolution, N x2 that resolution, N x2, the Ny2 of original image 1901 can show with 103 of scanner sections smaller or equal to left eye _L, Ny2 _L, then original image 1901 is set at the wide open image.

In addition, if the resolution, N x2 of the center image of trying to achieve in the previous step 2001 _c, Ny2 _cSurpassed the resolution, N x2 that right eye can show with 108 of scanner sections _R, Ny2 _R, resolution setting portion 1053 just carries out the processing of the pixel roughening that makes center image 2001, and the generation horizontal resolution is Nx2 _R, vertical resolution is Ny2 _RNarrow field-of-view image.In addition, if the resolution, N x2 of center image 2001 _c, Ny2 _cThe resolution, N x2 that can show with 108 of scanner sections smaller or equal to right eye _R, Ny2 _R, just center image 2001 is defined as narrow field-of-view image.

(step 2103: frame per second)

Frame per second when in this step, the wide open image of being tried to achieve and narrow field-of-view image are determined in frame per second configuration part 1054 in showing previous step.

Frame per second configuration part 1054 is according to the formula (1) of the relation of the vertical direction driving frequency of described expression frame per second and scanner section 103,108, with the frame per second fps2 of wide open image _wBe set at 2 * Hy2 _LValue, with the frame per second fps2 of narrow field-of-view image _nBe set at 2 * Hy2 _RValue.

(step 2104: image control)

In this step, control part 105,111 is controlled light source 101,110, wave front shape changing unit 102,109 and scanner section 103,108 corresponding to the narrow field-of-view image of determining in previous step and the resolution and the frame per second of wide open image.

Right eye is used to show and the right eye light source 110 of the corresponding center image 2001 of user's central field of vision with control part 111 controls, makes its output and the corresponding laser of narrow field-of-view image.In addition, the control right eye is α 2 with scanner section 108 with the horizontal scanning angle _R, the vertical scanning angle is β 2 _R, the horizontal direction driving frequency is Hx2 _R, the vertical direction driving frequency is Hy2 _RMode scan.

Left eye is controlled the left eye light source 101 that is used to show entire image with control part 105, makes its output and the corresponding laser of wide open image.In addition, the control left eye is α 2 with scanner section 103 with the horizontal scanning angle _L, the vertical scanning angle is β 2 _L, the horizontal direction driving frequency is Hx2 _L, the vertical direction driving frequency is Hy2 _LMode scan.

Use Figure 20～Figure 23 that the example of the image that the user seen at this moment is shown.For the sake of simplicity, use the frame per second fps2 of original image 1901 and the frame per second fps2 of wide open image _wAnd the frame per second fps2 of narrow field-of-view image _nFigure when equating carries out example.

Figure 20 shows original image 1901, and each frame switches with the interval of 1/fps2.

Figure 21 shows the demonstration of wide open image, and left eye is controlled in such a way with control part 105,, extracts fps2 from the frame of original image 1901 that is _wThe frame of/fps2 is with fps2 _wFrame per second show.In this example, fps2 _w/ fps2 equals 1, and therefore, whole frames of original image 1901 are all selected, show.

Figure 22 shows the demonstration of narrow field-of-view image, and right eye is controlled in such a way with control part 111,, extracts fps2 from the frame of original image 1901 that is _nThe frame of/fps2, and with the image of its core with fps2 _nFrame per second show.In this example, fps2 _n/ fps2 equals 1, and therefore, whole frames of original image 1901 are all selected, show.

Show in left eye in Figure 21, the right eye to show Figure 22 that consequently, utilize melting as effect of eyes, what the user saw is image shown in Figure 23.

What as shown in figure 23, the user saw is the image that center image shows with low resolution (the 2nd resolution) with high resolving power (the 1st resolution) demonstration, remainder.At the higher core of eye eyesight, demonstrate the image of high-fineness by improving resolution to the user, and, then show the image of wide open with low resolution in the lower part of eyesight, thus the field-of-view angle of the image experienced of can extending one's service.

In addition, the execution sequence of step 2102 and step 2103 both can be put upside down, and also can handle simultaneously.

In addition, what enumerate in the present embodiment is to show the image in the narrow visual field in right eye, show the example of the image of wide open in left eye, but also can use the structure behind the right and left mutually changing to handle.In this case, at the high user of left vision, just can utilize the higher high image of a branch hole eyeball display resolution of eyesight.

In addition, determine display packings by left eye with control part 105 in the present embodiment, but also can decide with control part 111, perhaps also can use and share the method for processing by two control parts 105,111 by right eye.

(the 3rd embodiment)

The method that illustrates in the present embodiment is that by changing picture shape shown in the right and left eyes respectively, field-of-view angle dwindles when suppressing keystone correction.

With reference to Figure 1A, Figure 1B, Fig. 2 and Figure 24, the glasses type beam flying type display device (head mounted display: HMD) in the 3rd embodiment of the present invention is described.Wherein, the structure shown in Figure 1A, Figure 1B, Fig. 2 is identical with the 1st embodiment, therefore omits its explanation.

Control part 105,111 possesses the integrated circuit that is used to control the HMD each several part.The output of the laser that sends from light source 101,110 by control part 105,111 control and the action of wave front shape changing unit 102,109 and scanner section 103,103.

Figure 24 shows the functional block diagram of control part 105.Control part 105 possesses: keystone distortion detection unit 1801, rectangular area determination section 1802, remaining area determination section 1803, image control part 1804, depth-width ratio adjustment part 1805, distortion correction portion 1806 and output image control part 1807.In addition, control part 111 also is same structure.

The left eye that the light beam that 1801 pairs of keystone distortion detection units scan with scanner section 103 because of left eye is oblique injects the trapezoidal shape that left eye produces with deflector 104 is judged with the shape of distorted image.Similarly, right eye is judged with the shape of distorted image with the right eye that deflector 107 is produced.

Rectangular area determination section 1802 decision with left eye with the part on the long limit of distorted image be the 1st limit, with the 1st limit quadrature and link the end points on the 1st limit and left eye is that the left eye of the rectangular shape on the 2nd limit is used the rectangular area with the line segment of the hypotenuse of distorted image.When right eye with distorted projections on the deflector 107 right eye with under the situation of image, carry out same processing.

Remaining area determination section 1803 will be defined as the left eye remaining area with adjacent trapezoidal shape zone, rectangular area with the left eye that rectangular area determination section 1802 is determined.Similarly, will be defined as the right eye remaining area with adjacent trapezoidal shape zone, rectangular area with right eye.

Image control part 1804 carries out the mensuration and the comparison of picture size size, and between keystone distortion detection unit 1804, rectangular area determination section 1802, remaining area determination section 1803 and depth-width ratio adjustment part 1805 transmitting control information.

Depth-width ratio adjustment part 1804a according to the left eye that original image is housed in determined by rectangular area determination section 1802 with rectangular area and right eye with the mode in the synthetic zone, rectangular area, the height of original image and a certain side among the width are adjusted, produced correcting image.

The 1804b of distortion correction portion generate make correcting image in advance to the left eye correcting image of left eye with distorted image reverse direction distortion (oppositely proofreading and correct) so that left eye with deflector on projection produce distortionless left eye image.Also carry out same processing for right eye one side.

Output image control part 1804c controls light source 101, so as the output left eye with among the correcting image with left eye with rectangular area and left eye with the corresponding part of remaining area.Light source 110 for right eye one side also carries out same control.

In addition, control part 105,111 also can possess Department of Communication Force, carries out wireless connections with external unit such as mobile phone, receives image and voice signal.Image control part 1804 both can possess the storer that is used to preserve the image of showing to the user, perhaps also can obtain the image of showing to the user from external unit by wireless mode.

In addition, control part 105,111 can have only one, some by among the control part 105,111 is to controlling with the action of the corresponding light source 101,110 of right and left eyes, wave front shape changing unit 102,109, scanner section 103,108 and earphone portion 106,112.

Earphone portion 106,112 possesses loudspeaker, is used for output sound.In addition, earphone portion 106,112 also can possess the battery for the power supply of HMD each several part.

In addition, each device and each several part among Fig. 1 both can be built in 1 HMD, also can not be built in 1 HMD.For example, both can comprise the whole parts among Fig. 1 in 1 HMD, also can not have earphone portion 106,112.In addition, each parts also can be a decentralized configuration.For example, control part 105,111 can be included among scanner section 103,108 or the wave front shape changing unit 102,109 as its part.Also can be by each parts of the shared Fig. 1 of multiple devices.For example, can be by 2 shared LASER Light Source 211,212,213 of HMD.

Then explanation utilization is melted the method for the keystone distortion of display image being proofreaied and correct as effect.The example of the image fault in the beam flying display device shown in Figure 1 has been shown among Figure 25.As mentioned above, scanner section 103,108 is to deflector 104,107 oblique-angle projection light beams, and consequently, former image distorted projections on deflector 104,107 that should be shown as rectangle has become left eye distorted image 601a, right eye distorted image 602a.

In the present invention, by judge from the image of scanner section 103,108 with the vertical face of user's sight line on the shape that become, and the shape of this projection image controlled, thereby realizes the correction of keystone distortion.In the present embodiment, with deflector 104,107 as vertical with user's sight line in the face for the treatment of, therefore after this also with the left eye on the deflector 104,107 with distorted image 601a and right eye with distorted image 602a as handling with the projection image that on the vertical plane of user's sight line, forms equal image.

Be illustrated in below in the beam flying type display device of Fig. 1 and utilize the described example of keystone distortion shown in Figure 25 being proofreaied and correct as effect that melts.Carry out keystone correction by step 1001a shown in Figure 26～1011a.

(step 1001a: the shape of the projection image on the deflector is calculated)

In this step, the keystone distortion detection unit 1801 of control part 105,111 is extrapolated the distortion shape of image with respect to the vertical plane of user's sight line.In the present embodiment, deflector 104,107 is designed to the face vertical with user's direction of visual lines, therefore, in this step, judges the distorted image 601a on the deflector 104,107, the shape of 602a.

Use Figure 27, Figure 28 and formula (11)～formula (15) to illustrate below and judge the method for left eye with distorted image 601a shape.

(the 1. calculating of the distance of the projection image on scanner section and the deflector)

Figure 27 shows the projection of laser on left eye usefulness deflector 104 from left eye usefulness scanner section 103 from the HMD top.

From the left eye θ of the laser of scanner section 103 with horizontal direction _x(=θ _X2-θ _X1) projectional angle, towards left eye deflector 104 projections.At this moment, left eye with the limit LA-LB of distorted image 601a and left eye with can calculate by formula (11) between the scanner section 103 apart from d1.In addition, left eye with the limit LD-LC of distorted image 601a and left eye with can calculate by formula (12) between the scanner section 103 apart from d2.Here, OC represents from scanner section 103 towards left eye with the perpendicular line distance of deflector 104 extensions.In addition, the width W of left eye usefulness distorted image 601a on left eye usefulness deflector 104 _LCan calculate by formula (13).

[formula 11]

d1＝OC/cosθ _x1 (11)

[formula 12]

d2＝OC/cosθ _x2 (12)

[formula 13]

W _L＝d2×sinθ _x2-d1×sinθ _x1 (13)

Here, employed θ in formula (11)～formula (13) _X1, θ _X2With the value of OC be the value of determining when the design beam flying type display device shown in Figure 1, these values are offered keystone distortion detection unit 1801 in advance, just can utilize formula (11)～formula (13) to calculate d1, d2, W _LValue.

In addition, also can use at left eye to comprise the sensor that is used to judge current scanning angle in scanner section 103, obtain projectional angle θ thus _X1, θ _X2, and with the method for these value circulars to keystone distortion detection unit 1801.In this case, even under the situation of the estimated value when left eye has departed from design with the scanning angle of scanner section 103, also can correctly try to achieve projectional angle θ _X1, θ _X2Value.

In addition, also can use to comprise in scanner section 103 to be used to obtain, directly infer the method that d1, d2 according to catoptrical intensity or phase place from the catoptrical device of left eye with deflector 104 at left eye.In this case, become the situation of shape when being different from design etc. even distortion has taken place for the shape of beam flying type display device, also can correctly try to achieve d1, d2 value.

(2. according to the crevice projection angle calculating upper base of light source, the length of side of going to the bottom)

Then, judge left eye the limit LA-LB of distorted image 601a and the length of limit LD-LC.

Figure 28 shows being seen figure when observing left eye with distorted image 601a on the direction vertical with deflector 104.As shown in figure 28, from the light of scanner section 103 in vertical direction with projectional angle θ _yDisperse, therefore, the left eye length H of the limit LA-LB of distorted image 601a _L1 and the length H of limit LD-LC _L2 can calculate by formula (14) and formula (15) respectively.

[formula 14]

H _L1＝2×d1×tan(θ _y/2) (14)

[formula 15]

H _L2＝2×d2×tan(θ _y/2) (15)

Here, employed θ in formula (14) and the formula (15) _yValue be the value of when the design of Fig. 1, determining, should value offer keystone distortion detection unit 1801 in advance, just can calculate H _L1, H _L2 value.

In addition, also can use at left eye to comprise the sensor that is used to judge current scanning angle in scanner section 103, obtain projectional angle θ thus _y, and will be worth the method that circular is given keystone distortion detection unit 1801.In this case, even the situations of the estimated value when left eye has departed from design with the scanning angle of scanner section 103 etc. also can correctly be tried to achieve projectional angle θ _yValue.

In addition, what enumerate here is the example that calculates the distortion of the left eye usefulness distorted image 601a on the left eye usefulness deflector 104, and right eye also can calculate by same calculating formula with the distortion of distorted image 602a with the right eye on the deflector 107.

Illustrated among Figure 29 and Figure 30 and utilized keystone distortion detection unit 1801 to judge the left eye that obtains distorted image 601a and the right eye example of the size of distorted image 602a.In this step, judge the left eye that has obtained on the left eye usefulness deflector 104 height H of distorted image 601a _L1, H _L2, reach width W _L, right eye is with the height H of the right eye on the deflector 107 with distorted image 602a _R1, H _R2, reach width W _RThis result is circulated a notice of to image control part 1804.

In addition, also can use following method, that is, the shape of image on the face vertical with user's sight line that scanner section 103,108 projections of left and right sides are come is saved in the storage part in advance, reads this shape from storage part in step 1001a.In this case, can omit the processing of step 1001a.

In addition, also can use following method, that is, on beam flying type display device, camera is installed, the projection image on the deflector 104,107 is taken, according to the shape of shape decision projection image on the face vertical of projection image with user's direction of visual lines.In this case, even dislocation has taken place the position of scanner section 103,108, deflector 104,107 relation, also can correctly measure the shape of projection image.

(step 1002a: the size of left and right sides projection image relatively)

In this step, image control part 1804 compares left eye distorted image 601a and the right eye height of distorted image 602a based on the judged result of previous step 1001a, and determines the disposal route of keystone correction according to comparative result.

At H _L2 〉=H _R2 and H _R1 〉=H _LUnder 1 the situation, carry out the processing of 1003a.On the other hand, at H _L2＜H _R2 or H _R1＜H _LUnder 1 the situation, carry out the processing of 1009a.At this moment, comparative result is circulated a notice of to rectangular area determination section 1802 and remaining area determination section 1803.

Then, by execution in step 1003a～1007a, decision is used to show the zone of the image after the correction.Particularly, left eye with the viewing area of distorted image 601a among the left eye viewing area 601b that constituted with remaining area 1402a with rectangular area 1401a and left eye by left eye of decision.Similarly, right eye with the viewing area of distorted image 602a among the right eye viewing area 602b that constituted with remaining area 1502a with rectangular area 1501a and right eye by right eye of decision.

(step 1003a: proofread and correct determining of back image-region)

In this step, image control part 1804 determines the display image of left and right sides to melt the height H of the figure of being seen as the back user (Figure 31).Height H is set in and satisfies H _L1≤H≤H _L2 and H _R2≤H≤H _RIn the scope of 1 relation.The H value that is determined is given rectangular area determination section 1802 by circular.

In addition, when Decision Height H, also can adopt the mode of directly importing by the user interface of HMD by the user.In this case, can show the image size that adapts with user preferences.In addition, also can use in advance the height H value of expecting is saved in the storage part, when carrying out this step, from storage part, read the method for height H value.

(step 1004a: left eye rectangular area determine)

In this step, rectangular area determination section 1802 is used with the left eye on the deflector 104 at left eye and is determined left eye rectangular area 1401a in the 601b of viewing area.Use Figure 32 that this method is shown.

At first, determine the position of line Xl1-Xl2 in such a way, that is, make it parallel with limit LA-LB and the limit LC-LD of the usefulness of the left eye on the deflector 104 viewing area 601b with left eye, and the line segment length height H that equals in previous step, to determine.

Then, the intersection point of supposing perpendicular line from an Xl1 to limit LD-LC and limit LD-LC is LD1, the intersection point of the perpendicular line from an Xl2 to limit LD-LC and limit LD-LC is LC1.

At this moment, left eye with the left eye on the deflector 104 with in the 601b of viewing area, determine with left eye with the part (LD1-LC1) on the long limit of viewing area 601b as the 1st limit, will and link the left eye rectangular area 1401a (LD1-LC1-Xl2-Xl1) of the line segment (Xl1-LD1, Xl2-LC1) of the end points (LD1, LC1) on the 1st limit and the hypotenuse (limit LA-LD, limit LB-LC) that left eye is used viewing area 601b with the 1st limit quadrature as the 2nd limit.This result is circulated a notice of to remaining area determination section 1803 and image control part 1804.

(step 1005a: right eye rectangular area determine)

In this step, rectangular area determination section 1802 is used with the right eye on the deflector 107 at right eye and is determined right eye rectangular area 1501a in the 602b of viewing area.Use Figure 33 that this method is shown.

At first, determine the position of line Xr1-Xr2 in such a way, that is, make it parallel with the right eye on the deflector 107, and line segment length equals height H with limit RA-RB and the limit RC-RD of viewing area 602b with right eye.

Then, the intersection point of supposing perpendicular line from an Xr1 to limit RA-RB and limit RA-RB is RAr, the intersection point of the perpendicular line from an Xr2 to limit RA-RB and limit RA-RB is RBr.

At this moment, right eye with the right eye on the deflector 107 with in the 602b of viewing area, determine with right eye with the part (RAr-RBr) on the long limit of viewing area 602b as the 3rd limit, will and link the right eye rectangular area 1501a (RAr-RBr-Xr2-Xr1) of the line segment (Xr1-RAr, Xr2-RBr) of the end points (RAr, RBr) on the 3rd limit and the hypotenuse (limit RA-RD, limit RB-RC) that right eye is used viewing area 602b with the 3rd limit quadrature as the 4th limit.This result is circulated a notice of to remaining area determination section 1803 and image control part 1804.

(step 1006a: left eye remaining area determine)

In this step, remaining area determination section 1803 is used with the left eye on the deflector 104 at left eye and is determined left eye remaining area 1402a in the 601b of viewing area.Left eye is set to zone with the left side adjacency of rectangular area 1401a with the left eye of viewing area 601b with remaining area 1402a.Use Figure 32 that this method is shown.

Left eye is be the right (growing the limit), be the figure of the trapezoidal shape of hypotenuse with left eye with the part of the hypotenuse (Xl1-Xl3, Xl2-Xl4) of viewing area 601b with the limit Xl1-Xl2 (opposite side on the 1st limit) that determines in step 1004a with remaining area 1420a, if be W with its width means _L2, then determine in such a way.

(at W 〉=W _L1+W _RUnder 1 the situation)

Set W _L2=W _R1, determine parallel and apart from being W with limit Xl1-Xl2 _L2 limit Xl3-Xl4.At this moment, left eye just is confirmed as the zone that surrounded by limit Xl1-Xl2, limit Xl4-Xl2, limit Xl3-Xl4 and limit Xl3-Xl1 with remaining area 1402a.

(at W＜W _L1+W _RUnder 1 the situation)

Set W _L2=W-W _L1.At this moment, left eye just is confirmed as the zone that surrounded by limit LB-Xl2, limit LA-LB, limit LA-Xl1 and limit Xl1-Xl2 with remaining area 1402a.

This result is circulated a notice of to image control part 1804.

(step 1007a: right eye remaining area determine)

In this step, remaining area determination section 1803 is used with the right eye on the deflector 107 at right eye and is determined right eye remaining area 1502a in the 602b of viewing area.Right eye is set to and the zone of right eye with the right side adjacency of rectangular area 1501a with remaining area 1502a with the right eye of viewing area 602b.Use Figure 33 that this method is shown.

Right eye is be the left side (growing the limit), be the figure of the trapezoidal shape of hypotenuse with right eye with the part of the hypotenuse (Xr1-Xr3, Xr2-Xr4) of viewing area 602b with the limit Xr1-Xr2 (opposite side on the 3rd limit) that determines in step 1005a with remaining area 1502a, if be W with its width means _R2, then determine in such a way.

(at W 〉=W _L1+W _RUnder 1 the situation)

Set W _R2=W _L1, determine parallel and apart from being W with limit Xr1-Xr2 _R2 limit Xr3-Xr4.At this moment, right eye just is confirmed as the zone that surrounded by limit Xr1-Xr2, limit Xr2-Xr4, limit Xr3-Xr4 and limit Xr1-Xr3 with remaining area 1402a.

(at W＜W _L1+W _RUnder 1 the situation)

Set W _R2=W-W _R1.At this moment, right eye just is confirmed as the zone that surrounded by limit Xr2-RC, limit RD-RC, limit Xr1-RD and limit Xr1-Xr2 with remaining area 1402a.

This result is circulated a notice of to image control part 1804.

Then, with reference to Figure 35～Figure 42 left eye viewing area 601b and the right eye Flame Image Process of image shown among the 602b of viewing area is described.

(step 1008a: Flame Image Process)

In this step, 105,111 pairs of left eyes of control part are out of shape with image 602 with image 601 and right eye and export based on deformation result control laser, so that pixel only shows in the scope of determined rectangular area 1401a, 1501a and remaining area 1402a, 1502a by step 1004a～1006a.

Control part 105,111 is out of shape display image according to step 2801a shown in Figure 35～step 2804a.The example of anamorphose is shown below with reference to Figure 36 A～Figure 42.

(step 2801a: the depth-width ratio change of display image)

In this step 2801a, the image that 1805 pairs of depth-width ratio adjustment parts are shown to the user carries out the transformation of scale of depth-width ratio.Use Figure 36 A, Figure 36 B and formula (16) that this example is described.Original image 1901a is stored in the storage part (storer etc.) in the image control part 1804.The HMD of Fig. 1 is shown to the user with this entire image.

In this step 2801a, depth-width ratio adjustment part 1805 so that the depth-width ratio of the depth-width ratio of original image 1901a when equaling left eye overlapped with viewing area 602b with viewing area 601b and right eye (H: mode W1+W2) is out of shape.In the present embodiment, lateral dimension is dwindled or is enlarged into X ' from X, generate correcting image 1902a.Here, obtain X ' by formula (16).

[formula 16]

X′＝Y×(W _L1+W _R1)/H (16)

(step 2802a: the viewing area of display image determine)

In this step 2802a, determine the zone on the deflector 104,107 of will being shown among the correcting image 1902a after previous step 2801a distortion.Use Figure 37, Figure 38 and formula (17) and formula (18) that this example is described.Depth-width ratio adjustment part 1805 is determined will be shown to the width X of left eye with the zone on the deflector 104 among the correcting image 1902a _LHere, obtain X by formula (17) _LImage control part 1804 begins width from right-hand member from correcting image 1902a be X _LPart intercept, generate left eye parts of images 2001a.

[formula 17]

X _L＝X′×(W _L1+W _L2)/(W _L1+W _R1) (17)

Similarly, depth-width ratio adjustment part 1805 is determined will be shown to the width X of right eye with the zone on the deflector 107 among the correcting image 1902a _RHere, obtain X by formula (18) _RImage control part 1804 begins width from left end from correcting image 1902a be X _RPart intercept, generate right eye parts of images 2101a.

[formula 18]

X _R＝X′×(W _R1+W _R2)/(W _L1+W _R1) (18)

(step 2803a: the distortion of display image)

In this step 2803a, 1806 pairs of left eyes of distortion correction portion carry out keystone (contrary proofread and correct) with parts of images 2001a, make its to left eye with the distortion of distorted image 601a reverse direction, thereby demonstrate left eye image 601 at left eye on deflector 104.Similarly, right eye is carried out keystone (contrary proofread and correct) with parts of images 2101a, make its to right eye with the distortion of distorted image 602a reverse direction, thereby demonstrate right eye image 602 at right eye on deflector 107.Use Figure 39, Figure 40 and formula (19)～formula (22) that this example is described.

As shown in figure 39, distortion correction portion 1806 left eye is amplified with parts of images 2001a or be reduced into left eye with ladder diagram as 2201a.Here, left eye is with the go to the bottom Y of ladder diagram as 2201a _L1 and upper base Y _L2 calculate by formula (19) and formula (20).In the processing of this step 2803a, by longitudinal stretching, the image in right side (line segment P1-P2 is with the zone on the right side) is compressed left eye with the image in the left side (line segment P1-P2 is with the zone on a left side) of parts of images 2001a, generate left eye with ladder diagram as 2201a.Here, line segment P1-P2 be positioned at as shown in figure 39, make X _L1 and X _L2 length ratio is W _L2: W _L1 position.

[formula 19]

Y _L1＝Y×H/H _L1 (19)

[formula 20]

Y _L2＝Y×H/H _L2 (20)

Similarly, as shown in figure 40, distortion correction portion 1806 right eye is amplified with parts of images 2101a or be reduced into right eye with ladder diagram as 2301a.Here, right eye is with the go to the bottom Y of ladder diagram as 2301a _R1 and upper base Y _R2 calculate by formula (21) and formula (22).In the processing of this step 2803a, by longitudinal stretching, the image in left side (line segment P3-P4 is with the zone on a left side) is compressed right eye with the image on the right side (line segment P3-P4 is with the zone on the right side) of parts of images 2101a, generate right eye with ladder diagram as 2301a.Here, line segment P3-P4 be positioned at as shown in figure 40, make X _R1 and X _R2 length ratio is W _R1: W _R2 position.

[formula 21]

Y _R1＝Y×H/H _R1 (21)

[formula 22]

Y _R2＝Y×H/H _R2 (22)

(step 2804a: contrary keystone)

In this step 2804a, output image control part 1807 is so that the left eye after previous step 2803a distortion projects left eye with ladder diagram proofreaies and correct with the mode in the 601b of viewing area with the left eye on the deflector 104 as 2201a.Similarly, so that right eye projects right eye with ladder diagram as 2301a proofreaies and correct with the mode in the 602b of viewing area with the right eye on the deflector 107.Use Figure 41 and Figure 42 that this example is shown.

Here, with left eye with ladder diagram as being expressed as P5 with ladder diagram as the intersection point on the left side of 2201a as the perpendicular line on the left side of 2201a and left eye from a P1 to left eye with ladder diagram in the 2201a, be expressed as P6 with ladder diagram as the intersection point on the left side of 2201a as the perpendicular line on the left side of 2201a and left eye from a P2 to left eye with ladder diagram.At this moment, output image control part 1807 is zone and the zone below the line segment P2-P6 more than the intercepting line segment P1-P5 among the trapezoid area 2202a, obtains left eye projection image 2401a.

The left eye projection is by forming left eye on deflector 104 at left eye with the rectangular area 2402a of remaining area 1402a with form left eye on deflector 104 at left eye and constitute with the trapezoid area 2203a of rectangular area 1401 with image 2401a.In addition, if the control left eye projects the left eye projection on the deflector 104 with image 2401a with the output of light source 101, will demonstrate the image that does not have distortion on viewing area 601b at left eye shown in Figure 32.

Similarly, right eye with ladder diagram as 2301a in, will be from a P3 to right eye be expressed as P7 with ladder diagram as the intersection point on the right of 2301a as the perpendicular line on the right of 2301a and right eye, be expressed as P8 with ladder diagram as the intersection point on the right of 2301a as the perpendicular line on the right of 2301a and right eye from a P4 to right eye with ladder diagram with ladder diagram.At this moment, output image control part 1807 is zone and the zone below the line segment P4-P8 more than the intercepting line segment P3-P7 among the trapezoid area 2303a, obtains right eye projection image 2501a.

The right eye projection is by forming right eye on deflector 107 at right eye with the rectangular area 2502a of remaining area 1502a with form right eye on deflector 107 at right eye and constitute with the trapezoid area 2302a of rectangular area 1501a with image 2501a.In addition, if the control right eye projects the right eye projection on the right eye usefulness deflector 107 with image 2501a with the output of light source 110, will demonstrate the image that does not have distortion in viewing area 602b at right eye shown in Figure 33.

By carrying out above-mentioned steps 2801a～2804a, the left eye projection that is generated is subjected to the influence of keystone distortion with image 2401a and right eye projection with image 2501a on deflector 104,107, becomes the shape shown in the oblique line of Figure 32 and Figure 33.

Then, the user who has seen image shown on the deflector 104,107 will identify shown in Figure 34 melting as back figure 1601a because of melting as effect.The upper left corner of melting picture back figure 1601a shown in Figure 34 and the pixel in the lower left corner can only be seen by right eye, and the pixel in the upper right corner and the lower right corner can only be seen by left eye, and what see on the whole is exactly the rectangle that does not have keystone distortion.At this moment, the image that shows is consistent with the correcting image 1902a shown in Figure 36 B.

In addition, the height H of melting picture back figure 1601a satisfies H _L1≤H, H _RTherefore the relation of 2≤H, is compared with existing keystone method, and it has the effect that has improved the picture altitude after the keystone correction.

In addition, the execution of step 1004a and step 1005a both can transpose, also can carry out simultaneously.Similarly, the execution of step 1006a and step 1007a both can transpose, also can carry out simultaneously.

In addition, output image control part 1807 also can be by control light source 101,110, reduces the laser output of the part that the image at right and left eyes among Figure 34 overlaps.In addition, otherwise also can control light source 101,110, thereby improve laser output, so that only there is the brightness of the pixel that one-sided eyes see to improve among Figure 34 by output image control part 1807.By carrying out above-mentioned any one control, just can avoid occurring in the picture area states such as brightness spot.

In addition, image control part 1804 also can change the following processing of value repeated execution of steps 1004a of height H, up to value that makes height H and width W _L1 and W _RThe ratio of 1 sum reaches specific ratios (for example 16: 9 or 4: 3).In this case, just can be cosily show the images such as TV programme that broadcast with the depth-width ratio of 16: 9 or 4: 3 to the user.In addition, output image control part 1807 also not Display projector with any pixel that on deflector 104,107, becomes rectangular area 2402a, the 2502a of remaining area 1402a, 1502a among image 2401a, the 2501a.Trapezoid area 2203a in the pixel of rectangular area 2402a, 2502a and the opposite side eyes, the pixel of 2303a overlap, and therefore, even cut down the display pixel number, the user also is difficult to discover.

(step 1009a: the left eye rectangular area)

In this step, rectangular area determination section 1802 is determined the rectangular area according to the comparative result in step 1002a among the bigger image in left eye usefulness distorted image 601a and right eye usefulness distorted image 602a.

What describe below is at the left eye big (H of distorted image 601a _R1＜H _L1) embodiment under the situation is at H _L2＜H _RUnder 2 the situation, as long as the processing about exchange does not have difference in essence.

Use Figure 43 that the processing of this step is described.

Rectangular area determination section 1802 will through left eye with the some LA of distorted image 601a and perpendicular to the intersection point of the perpendicular line of LD-LC and limit LD-LC as LD1, will through a LB and perpendicular to the intersection point of the perpendicular line of limit LD-LC and limit LD-LC as LC1.At this moment, left eye is confirmed as LA-LB-LC1-LD1 with rectangular area 1401b.In addition, right eye is set at 0 with the area of rectangular area.This result is circulated a notice of to image control part 1804.

(step 1010a: the right eye trapezoid area)

In this step, remaining area determination section 1803 is according to the comparative result in step 1002a, in less image determines remaining area with distorted image 601a and right eye among with distorted image 602a at left eye.Use Figure 44 that this method is shown.In this step, according to W _LWith W _RThe magnitude relationship of value, different processing is carried out in difference.

(work as W _R＜W _LThe time)

Remaining area determination section 1803 is defined as right eye remaining area 1502b with right eye with the Zone Full of distorted image 602a.

(work as W _R〉=W _LThe time)

Remaining area determination section 1803 will be that the region R A-RB-Xr4-Xr3 of W is defined as right eye remaining area 1502b with the limit RA-RB of distorted image 602a (long limit) as the left side, width with right eye.In addition, left eye is set at 0 with the area of remaining area.This result is circulated a notice of to image control part 1804.

(step 1011a)

In this step, image control part 1804 in the mode that is demonstrated pixel by step 1009a and the determined left eye of 1010a with rectangular area 1401b and right eye in the scope with remaining area 1502b, is out of shape and controls the laser output of light source 101,110 with only with image 602 with image 601 and right eye to left eye.

At this moment, 1008a is identical with step, and control part 105 is carried out step 2801a～2804a shown in Figure 35 at the image of left and right sides.But, use distorted image 601a and right eye with less image among the distorted image 602a, be not execution in step 2802a, but replace the step 2805a below carrying out for left eye.

(step 2805a)

In this step 2805a, 1902a determines the viewing area according to correcting image.Use Figure 46, Figure 47 and formula (23) and formula (24) that this example is shown.

Use with the left eye on the deflector 104 under the highly lower situation of distorted image 601a when left eye, image control part 1804 is determined at the width X of left eye with the zone that shows on the deflector 104 according to correcting image 1902a _LHere, obtain X by formula (17) _LIn addition, determine at the height Y of left eye with the zone that shows on the deflector 104 _LHere, Y _LDetermine by formula (23).Image control part 1804 is according to mode shown in Figure 46, and to begin width from right-hand member be X in intercepting from correcting image 1902a _LAnd central authorities highly are Y at image _LThe zone, generate left eye parts of images 2601a.In addition, the whole zone with correcting image 1902a is set at right eye parts of images 2701a.

[formula 23]

Y _L＝Y×H _L2/H (23)

On the other hand, use with the right eye on the deflector 107 under the highly lower situation of distorted image 602a when right eye, image control part 1804 is determined at the width X of right eye with the zone that shows on the deflector 107 according to correcting image 1902a _RHere, obtain X by formula (18) _RIn addition, determine at the height Y of right eye with the zone that shows on the deflector 107 _RHere, Y _RDetermine by formula (24).Image control part 1804 is according to mode shown in Figure 47, and to begin width from left end be X in intercepting from correcting image 1902a _RAnd central authorities highly are Y at image _RThe zone, generate right eye parts of images 2701a.In addition, the whole zone with correcting image 1902a is set at left eye parts of images 2601a.

[formula 24]

Y _R＝Y×H _R1/H (24)

By above-mentioned processing, image control part 1804 carries out left eye image and the right eye distortion of image, and control light source 101,110, makes with the corresponding light beam projecting of deformation pattern and arrives deflector 104,107.

Consequently, the image that shows on deflector 104 at left eye becomes the shape that the oblique line of Figure 43 is described, and the image that shows on deflector 107 at right eye becomes the shape that the oblique line of Figure 44 is described.

At this moment, the shape of utilizing described eyes to melt to make as effect the image that the user sees as shown in figure 45.Change display pixel corresponding to highly higher projection image, thus the broad keystone distortion of field-of-view angle is proofreaied and correct.

In addition, the execution of step 1009a and step 1010a both can transpose, also can carry out simultaneously.

In addition, output image control part 1807 also can be controlled in such a way,, at the intersection of right and left eyes image among Figure 45, reduces laser output that is, thus make this part and the pixel only seen with single eyes between luminance difference can not appear.In addition, otherwise the output image control part also can be controlled in such a way, that is, at the pixel of only seeing with single eyes among Figure 45, export and improve its brightness by increasing laser, thereby make integral image can not produce luminance difference.In this case, just can show the good image that does not have the brightness spot to the user.

In addition, in the present embodiment, distorted image 601a, the 602a on the deflector 104,107 of left and right sides must not be complete trapezoidal, even on four limits distortion has taken place all, can use method of the present invention yet.In this case, even deflector is not dull and stereotyped but has concaveconvex shape, the field-of-view angle in the time of yet can utilizing melting of eyes to watch as the effect expansion.

In addition, in step 1002a, carry out branch process according to the height comparative result of distorted image 601a, 602a; Exist when user's binocular vision under the situation of certain difference, also can be branched off into step 1009a, the projection image that projects in the higher branch hole eyeball of eyesight is handled as projection image highly higher among the step 1009a.At this moment, in step 1010a, make that by controlling the rectangular area, the remaining area area that project to the projection image in the relatively poor eyes of eyesight all are 0, thereby can eliminate the influence of weak-eyed eyes.In addition,, both can be to use the method for family, also can be to use the method for analogizing according to the wave front curvature and the luminous point size on the retina of laser by the external interface input as the method that eyesight is judged.

In addition, both can also can carry out test near and distance in advance by input users' such as user interface eyesight size by show Lan Shi (Landolt) ring to the user.In addition, also can detect the luminous point size on the retina, carry out eyesight and infer according to the light feedback that projects to the light beam on the eyes.In this case, even, also can demonstrate preferable image for the user who does not understand self eyesight status.

In addition, in the present embodiment, deflector the 104, the 107th, the face vertical with user's sight line, but deflector 104,107 can tilt with respect to user's sight line, can not be flat shape also perhaps.In the case, processing of the present invention just imagination goes out a plane vertical with user's sight line, and the shape of the projection image on this imaginary plane is controlled, rather than the picture shape on the deflector 104,107 is controlled.

Below, with reference to Figure 48 the originally representative instance of the 3rd embodiment is described.Wherein, Figure 48 overlaps the figure (solid line part) that form with distorted image 601a and right eye shown in Figure 30 with distorted image 602a by left eye shown in Figure 29, and the part that in fact demonstrates image is illustrated by oblique line.

At first, left eye shown in Figure 29 is congruent figures with distorted image 602a with distorted image 601a and right eye shown in Figure 30 under typical situation.That is H, _L1=H _R2, H _L2=H _R1, W _L=W _RSet up.That is, in step 1002a, satisfy H _L2 〉=H _R2 and H _R1 〉=H _L1 condition therefore can execution in step 1003a～1008a.

Then, in step 1003a, suppose left eye W among the distorted image 601a _L1=W _L2=W _LThe height of/2 position is H.Similarly, suppose right eye W among the distorted image 602a _R1=W _R2=W _RThe height of/2 position is H.

Then, in step 1004a～1007a, determine left eye rectangular area 1401a, right eye rectangular area 1501a, left eye remaining area 1402a and right eye remaining area 1502a.At this moment, left eye viewing area 601b and right eye viewing area 602b congruence, height H is set in W _L1=W _L2=W _R1=W _R2=W _L/ 2=W _R/ 2 position, therefore, both just become shown in Figure 48 after overlapping.

That is, left eye becomes with the 4th limit (Xr1-RAr, Xr2-RBr) of rectangular area 1501a with the 2nd limit (Xl1-LD1, Xl2-LC1) of rectangular area 1401a and right eye and passes left eye with image 601b and the right eye straight line with the intersection point of each hypotenuse of image 602b.At this moment, the image (RAr-LD1-LC1-RBr) seen of user reaches maximum.

Then, the Flame Image Process of execution in step 2801a～step 2804a.At this moment, in step 2802a, X _L=X _R=X ', therefore, in the left and right sides, whole correcting image 1902a becomes display object.

In addition, determine display packings by left eye with control part 105 in the present embodiment, but also can decide with control part 111, perhaps also can use and share the method for processing by two control parts 105,111 by right eye.

(the 4th embodiment)

Illustrate in the present embodiment by change the method that the pixel count that shows improves the frame per second of display image in the left and right sides eyes.

With reference to Figure 1A, Figure 1B, Fig. 2 and Figure 49, the glasses type beam flying type display device (head mounted display: HMD) in the 4th embodiment of the present invention is described.Wherein, Figure 1A, Figure 1B are identical with the 1st embodiment with the structure shown in Fig. 2, therefore omit its explanation.

Control part 105,111 possesses the integrated circuit that is used to control the HMD each several part.The output of the laser that sends from light source 101,110 by control part 105,111 control and the action of wave front shape changing unit 102,109 and scanner section 103,108.

Figure 49 represents the functional block diagram of control part 105 of the left eye in the present embodiment.Left eye comprises the 801b of graphical analysis portion, driving frequency determination section 802b, the 803b of power management portion, shows image quality determination section 804b, user's configuration management 805b of portion, scan pattern determination section 806b and image control part 807b with control part 105.

The 801b of graphical analysis portion analyzes original image.Particularly, it obtains the content information etc. of resolution, frame per second and the expression original image content of original image.

Driving frequency determination section 802b is according to the testing result of power management portion, changes left eye with scanner section 103 and the right eye maximal value with both driving frequencies of scanner section 108.

The 803b of power management portion detects the dump energy of the battery that is assembled in the beam flying type display device.

Show image quality determination section 804b based on left eye with scanner section 103 and right eye maximum drive frequency with scanner section 108, a certain at least side that the frame per second of original image and display pixel are counted among both proofreaies and correct.

The image quality corrected value that the in store user of user's configuration management 805b of portion establishes at each content information, the information relevant etc. with user's eyesight.

Scan pattern determination section 806b makes left eye scanner section 103 and the right eye scanner section 108 scan pattern scanning light beam to stipulate respectively.Particularly, it makes left eye carry out beam flying with scanner section 103 and right eye respectively in such a way with scanner section 108, promptly, display image is divided into a plurality of scanning areas, left eye with scanner section 103 and right eye with the scanning area difference of scanner section 108 in each frame, and left eye with scanner section 103 and right eye with the scanning area difference in each comfortable adjacent frame of scanner section 108.

The output of image control part 807b control light source 101,110 is in order to the scan pattern that realizes being determined by scan pattern determination section 806b.

In addition, control part 105,111 also can possess Department of Communication Force, carries out wireless connections with external unit such as mobile phone, receives image and voice signal.Control part 105,111 both can possess storer and be used to preserve the image of showing to the user, perhaps also can obtain the image of showing to the user from external unit by wireless mode.

In addition, control part 105,111 can have only one, some to controlling with the action of the corresponding light source 101,110 of right and left eyes, wave front shape changing unit 102,109, scanner section 103,108 and earphone portion 106,112 by among the control part 105,111.In this case, can cut down the size of beam flying type display device.

Earphone portion 106,112 possesses loudspeaker, is used for output sound.In addition, earphone portion 106,112 also can be included as the battery of HMD each several part power supply.

In addition, each device and each several part among Fig. 1 both can be built in 1 HMD, also can not be built in 1 HMD.For example, both can comprise the whole parts among Fig. 1 in 1 HMD, also can not have earphone portion 106,112.In addition, each parts also can decentralized configuration.For example, control part 105,111 can be included among scanner section 103,108 or the wave front shape changing unit 102,109 as its part.Also can be by each parts of the shared Fig. 1 of multiple devices.For example, can be by 2 HMD common light source 101,110.

Beam flying type display device with Fig. 1 is an example below, illustrates to utilize the described processing example that melts the decline of the image quality of being watched as the frame per second and the inhibition simultaneously of effect raising display image.

Wherein, in the present embodiment, suppose scanner section the 103, the 108th, have the mirror device of same configuration.In addition, shown in Figure 74, suppose that this mirror device is to utilize driving element to drive the device of monolithic catoptron in the enterprising line scanning of two-dimensional directional.

In the present embodiment, scanner section 103,108 designs in such a way, that is, incident laser is scanned with α 4 degree horizontal scanning angles, β 4 degree vertical scanning angles, and to have reveal competence resolution be that Nx4, vertical resolution are the ability of the image of Ny4.In addition, the maximum drive frequency of supposing the horizontal direction of scanner section 103,108 is that the maximum drive frequency of Hx4, vertical direction is Hy4.In addition, during scanner section 103,108 action of (the 1st direction) enterprising line scanning pixel in the horizontal direction, on one side on vertical direction (with the 2nd direction of the 1st direction quadrature) shift position successively, repeatedly repeat this action on one side, depict 1 two field picture thus.In addition, in the present embodiment, the overscanning rate of supposing the display image of scanner section 103,108 is A.

The instantiation of the processing of the frame per second that is used for determining present embodiment and resolution is shown below.This processing realizes by carrying out step 701b shown in Figure 50～705b.

(step 701b)

In this step, the 801b of graphical analysis portion analyzes the picture material that shows the user.The HMD that Figure 51 example goes out Fig. 1 is an original image to the metadata of the image of user's demonstration.In this 4th embodiment, be Nx4 with horizontal resolution _Orgn(following parameter with " orgn (original) " expression original image), vertical resolution are Ny4 _Orgn, frame per second is fps4 _OrgnImage setting be original image.This original image both can be stored in the storage part in the control part 105, also can obtain from external unit via communication.

Display image analysis portion 801b obtains resolution, N x4 by analyzing the view data of original image _Orgn, Ny4 _OrgnWith frame per second fps4 _OrgnValue.

In addition, the 801b of graphical analysis portion judges that according to the metadata that is attached on the original image content (type) of original image is sports or film etc.Figure 52 example goes out the metadata that is attached in the present embodiment on the original image.Under the situation of the metadata that provides Figure 52, the 801b of graphical analysis portion is " music " with the type decision of original image.

In addition, the 801b of graphical analysis portion also can obtain resolution, N x4 according to the metadata that is attached on the original image _Orgn, Ny4 _OrgnWith frame per second fps4 _OrgnValue.In addition, also can preestablish the form of the handled image of HMD of Fig. 1, according to the resolution, N x4 of its setting value decision original image _Orgn, Ny4 _OrgnWith frame per second fps4 _OrgnValue.In this case, can cut down the processing cost that is used for analysis image.

In addition, the form of metadata both can adopt the exclusive XML shown in Figure 52 (eXtensibleMarkup Language) form, also can adopt the standardized XML form of following MPEG7 (Moving Picture ExpertsGroup7) etc.

In addition, metadata also can be the binary data that is embedded in the specific fields of view data.In this case, do not need other process metadata file, so image management is more easy.

(step 702b)

In this step, driving frequency determination section 802b proofreaies and correct maximum drive frequency Hx4, the Hy4 of scanner section 103,108.

The value of driving frequency determination section 802b decision horizontal frequency corrected value Xa, vertical frequency corrected value Ya multiply by Hx4, Hy4 respectively with them, allows driving frequency Hx4 with the maximum of the horizontal direction that generates scanner section 103,108 _MaxAllow driving frequency Hy4 with the maximum of vertical direction _MaxValue.

In the present embodiment, driving frequency determination section 802b obtains the current battery dump energy of HMD of Fig. 1 from the 803b of power management portion, and according to the residual electric quantity of battery, decision is as the horizontal frequency corrected value Xa of an example of image quality corrected value and the numerical value of vertical frequency corrected value Ya.The example of employed reckoner when Figure 53 shows driving frequency determination section 802b and calculates Xa, Ya value according to battery dump energy.In this example, the value of the reckoner of Figure 53 determines in such a way,, after battery dump energy is lower than 60%, just reduces the maximum drive frequency of scanner section 103,108 that is, to reduce power consumption.

In addition, determine corrected value Xa, Ya of driving frequency also can be determined by the value outside the battery dump energy.For example, because the use year number of scanner section 103,108 is managed, therefore also can be according to using year number long more, the mode that employed driving frequency is low is more handled.In this case, can consider the processing of the permanance of beam flying type display device.

In addition, also the sensor that is used to detect operating state can be installed on scanner section 103,108, detect the poor of maximum drive frequency on the design specification and actual maximum drive frequency according to the value of this sensor, determine the numerical value of driving frequency corrected value Xa, Ya in the mode that adapts with actual maximum drive frequency values.In this case, even 103,108 actions of actual scanner section and design load difference to some extent also can correctly be handled.

(step 703b)

In this step, the horizontal resolution Nx4 that shows each display image of left and right sides that image quality determination section 804b decision shows to the user in the HMD of Fig. 1 _Disp(following parameter), vertical resolution Ny4 with " disp (display) " expression display image _Disp, frame per second fps4 _Disp

As mentioned above, satisfy the relation of formula (4) between the vertical direction resolution, N y of the horizontal direction driving frequency Hx of scanner section 103,108, display image and the frame per second fps.Thereby, suppose with frame per second fps4 _OrgnThe demonstration vertical resolution is Ny4 _DispDisplay image the time required horizontal direction driving frequency be Hx4 _Orgn, Hx4 then _OrgnCan be expressed as formula (25).

[formula 25]

Hx4 _orgn＝Ny4 _orgn×fps4 _orgn/(2×A) (25)

Here, allow driving frequency Hx4 in the horizontal direction maximum of scanner section 103,108 _MaxValue surpassed the necessary horizontal direction driving frequency of demonstration original image Hx4 _OrgnSituation under, show the resolution, N x4 of image quality determination section 804b with display image _Disp, Ny4 _DispBe set at the Nx4 of original image _Orgn, Ny4 _Orgn, and with the frame per second fps4 of display image _DispBe set at the frame per second fps4 of original image _OrgnNumerical value, the processing of execution in step 704b.

On the other hand, at Hx4 _MaxValue be lower than Hx4 _OrgnSituation under, scanner section 103,108 can't show that vertical resolution is Ny4 _Orgn, frame per second is fps4 _OrgnImage.In this case, show that image quality determination section 804b must carry out the vertical resolution Ny4 of the display image that will show in the left and right sides eyes _DispNumerical value reduce to the vertical resolution Ny4 of original image _OrgnThe frame per second fps4 with display image is perhaps carried out in following processing _DispReduce to fps4 _OrgnThis two processing are perhaps carried out in following processing.

According to the relation shown in the formula (4), for showing that vertical resolution is Ny4 _Disp, frame per second is fps4 _DispThe necessary horizontal direction driving frequency of image Hx4 _DispProvide by formula (26).

[formula 26]

Hx4 _disp＝Ny4 _disp×fps4 _disp/(2×A) (26)

Show image quality determination section 804b decision resolution, N y4 _DispWith frame per second fps4 _DispValue so that Hx4 _DispValue smaller or equal to Hx4 _Max

In addition, in the present embodiment, show that image quality determination section 804b is considering that described eyes melt the resolution of decision display image on the picture basis of effect.The vertical resolution of the image that shows in the left and right sides eyes is Ny4 _DispThe time, utilize melting of eyes as effect, suppose that the vertical resolution of melting the image pattern picture that the user sees is Ny4 _Fusn(following parameter of melting the image pattern picture), then Ny4 with " fusn (fusion) " expression _DispVertical resolution Ny4 with original image _OrgnBetween satisfy the relation of formula (27).

[formula 27]

Ny4 _disp≤Ny4 _fusn≤2×Ny4 _disp≤Ny4 _orgn (27)

Formula (27) is expressed, under the situation that the display line in the left and right sides eyes on the vertical direction does not overlap, and Ny4 _FusnValue be Ny4 _Disp2 times of value.This is equivalent to show to the first half of right eye displaying original image, to left eye the latter half of original image.Utilize this picture effect of melting, even in order to improve the frame per second fps4 of display image _DispAnd with the vertical resolution Ny4 of display image _DispReduce to the vertical resolution Ny4 of original image _OrgnHalf, as long as its position is suitably selected in the demonstration of left and right sides, can prevent that also the resolution that the user is watched from descending when the identification display image.

In the present embodiment, show the content of image quality determination section 804b according to the information of the resulting original image of the 801b of graphical analysis portion, decision is used for determining frame per second fps4 _DispThe frame per second coefficient F of numerical value.Figure 54 shows the reckoner of the frame per second coefficient F that shows that image quality determination section 804b is preserved.

Here, frame per second coefficient F represents that the frame per second of the display image in the left and right sides eyes is with respect to original image frame per second fps4 _OrgnThe coefficient of decline degree, show that image quality determination section 804b is after having determined frame per second coefficient F, with F and fps4 _OrgnMultiply each other, determine the frame per second fps4 of display image thus _DispWhen the value of frame per second coefficient F is 1, do not reduce the frame per second of display image, but with the frame per second fps4 of display image _DispBe set at the frame per second fps4 of original image _OrgnIn addition, the value of frame per second coefficient F is more near 0, and the decline degree of the frame per second of display image is big more.In addition, work as fps4 _DispValue less than 1 o'clock, show that image quality determination section 804b is with fps4 _DispValue be set at 1.Under the situation of using the table shown in Figure 54, show that image quality determination section 804b determines the value of frame per second coefficient F in such a way, that is,, reduce the fall of frame per second for dynamically abundant images such as sports; And, then pay the utmost attention to resolution for the many information of Word messages such as news.

In addition, when showing that image quality determination section 804b calculates frame per second coefficient F, also can reflect the preference information of user to frame per second and resolution.Figure 55 shows the example as the frame per second coefficient correction value Fa of an example of image quality corrected value.Figure 55 shows the table of the relation of user's preference information and frame per second coefficient correction value Fa, is preserved by user's configuration management 805b of portion.

Utilize this table, can set the user and which kind of information priority to consider frame per second at.That is, the user payes attention to the frame per second of information more, and the numerical value of frame per second coefficient correction value Fa should be set highly more.Show that image quality determination section 804b receives frame per second coefficient correction value Fa from user's configuration management 805b of portion, after frame per second coefficient F and frame per second coefficient correction value Fa addition, with the frame per second fps4 of original image _OrgnMultiply each other, frame per second fps4 is revised in decision thus _Disp

In addition, surpass under 1 the situation, when frame per second coefficient correction value Fa and frame per second coefficient F sum fps4 _DispBe set at fps4 _OrgnIn addition, when frame per second coefficient correction value Fa and frame per second coefficient F sum smaller or equal to 0 situation under, with fps4 _DispBe set at 1.In addition, the value of frame per second coefficient correction value Fa both can directly be imported by user interface by the user, also can be generated automatically by user's configuration management 805b of portion.In this case, the user can in time set the frame per second that adapts with oneself hobby.

In addition, as mentioned above, satisfy the relation of formula (1) between the vertical frequency Hy of scanner section 103,108 and the frame per second fps of display image.Thereby, be fps4 in the frame per second of the display image that shows to the user _DispSituation under, the vertical direction driving frequency Hy4 that scanner section 103,108 is required _DispProvide by formula (28).Here, at Hy4 _DispThe value vertical direction maximum that surpassed scanner section 103,108 allow driving frequency Hy4 _MaxSituation under, show that image quality determination section 804b is with fps4 _DispValue be modified to Hy4 _MaxThe twice size.

[formula 28]

Hy4 _disp＝fps4 _disp/2 (28)

Show that image quality determination section 804b is at the frame per second fps4 that has determined display image _DispAfter, the then vertical direction resolution, N y4 of the display image that in 1 frame, shows separately on the left and right sides eyes of decision _DispIn the present embodiment, Ny4 _DispValue calculate by formula (29).

[formula 29]

Ny4 _disp＝(2×A×Hx4 _max)/fps4 _disp (29)

Wherein, the result of calculation when formula (29) is Ny4 _DispValue smaller or equal under the situation that shows the determined minimum resolution Ymin of image quality determination section 804b, utilize the calculating formula shown in the formula (30) to fps4 _DispValue revise, make Ny4 _Disp〉=Ymin.In addition, the value of supposing Ymin is set so that fps4 _Disp〉=1.

[formula 30]

fps4 _disp＝(2×A×Hx4 _max)/Ymin (30)

In addition, the result of calculation at formula (29) is Ny4 _DispValue surpassed Ny4 _OrgnThe situation of value under, with Ny4 _DispValue be set at Ny4 _Orgn, and with fps4 _DispValue the value of the calculating formula that provides by formula (31) is provided.

[formula 31]

fps4 _disp＝(2×A×Hx4 _max)/Ny4 _orgn (31)

At last, the horizontal direction resolution, N x4 that shows image quality determination section 804b decision display image _DispHere, as the horizontal resolution Nx4 of original image _OrgnSurpassed under the situation of the vertical resolution Nx4 that scanner section 103,108 can show, Nx4 _DispBe set at the value of Nx4.Under situation in addition, with Nx4 _DispBe set at Nx4 _OrgnValue.

In addition, also can adopt following method, that is, show that image quality determination section 804b determines the vertical resolution of display image in advance, and reduce the value of frame per second in order to realize this vertical resolution.So just can realize that the image of paying the utmost attention to resolution shows.

In addition, also can adopt by the user and directly import the vertical resolution of display image and the form of frame per second by user interface.User's configuration management 805b of portion also can generate the table shown in Figure 55 automatically based on user's input value.

In addition, in the present embodiment, with the frame per second fps4 of original image _OrgnResolution fps4 as display image _DispThe upper limit, but also can as speed doubly drive show with fps4 _DispBe set at and be higher than the original frame per second fps4 of original image _OrgnFrame rate value.In this case, set the resolution fps4 of display image _DispValue, make it satisfy the restriction shown in formula (3), the formula (4).So just can realize that image shows clearly.

(step 704b)

In this step, scan pattern determination section 806b determines the method that scanner section 103,108 carries out laser scanning.

Scan pattern determination section 806b is according to the frame per second fps4 that determines among the previous step 703b _Disp, from original image, extract fps4 _Disp/ fps4 _OrgnFrame then at each frame that is extracted, is carried out the decision processing of following vertical scanning scope and the decision of display image and is handled.

(decision of vertical scanning scope)

At first, the scope that scan pattern determination section 806b decision scanner section carries out laser scanning on the inherent vertical direction 103,108 each comfortable 1 image duration, i.e. vertical scanning scope.Figure 56 A～Figure 56 C shows the example of vertical scanning scope.In the scan pattern shown in Figure 56 A 1401, in 1 image duration, scan the scope identical in vertical direction with the height of display image.In the scan pattern shown in Figure 56 B 1402, in 1 image duration, scanning in vertical direction is equivalent to the scope of half height of display image.In the scan pattern shown in Figure 56 C 1403, in 1 image duration, scanning in vertical direction is equivalent to the scope of 1/4th height of display image.

In addition, scan pattern determination section 806b also can determine the vertical scanning scope respectively in the scanner section 103,108 of right and left eyes.Especially, under the inconsistent situation of the height of vertical scanning scope and display image, the vertical scanning scope of the scanner section 103,108 by making left and right sides does not overlap, and can utilize melting as effect of eyes to improve the resolution of being watched.

(decision of display pixel)

Then, according to the vertical resolution Ny4 that in previous step, is determined _Disp, horizontal resolution Nx4 _Disp, the pixel that decision scanner section 103,108 is described in described vertical scanning scope.

In the present embodiment, at vertical resolution Nx4 with original image _OrgnVertical resolution Nx4 divided by display image _DispThe merchant of gained is during as frame number Nf, and scan pattern determination section 806b selects the pixel in 1 frame in such a way, that is, make the scanner section 103,108 of left and right sides depict whole pixels by Nf frame at least respectively.

For example, when the value of frame number Nf was 2, in order to demonstrate whole pixels by 2 frames, scan pattern determination section 806b was with the first half of rendering image in the 1st frame, the mode of the latter half of rendering image determines scan pattern in next frame.

In addition, when the value of frame number Nf more than or equal to 2 the time, scan pattern determination section 806b determines scan pattern, can not overlap so that be displayed on the pixel of left and right sides in 1 frame.For example, a certain frame for original image determines scan pattern in such a way,, when showing the pixel of the first half in right eye, then shows the pixel of the latter half in the left eye that is.In addition, similarly, determine scan pattern in such a way, that is, when in right eye, showing odd-numbered line, then show even number line in the left eye.

In the manner described above, if the mode that does not overlap with the display pixel of the same frame seen in the left and right sides eyes determines scan pattern, that just can utilize eyes melts the picture effect, makes the vertical resolution Ny4 of the image that the user sees _FusnReach Ny4 _DispTwice, even under the situation of the resolution that has reduced display image in order to ensure the frame per second of display image, also can improve the image that is shown to the user the viewed resolution that arrives.

Below, in Figure 57～Figure 63, illustrated at the scan pattern of different left and right sides eyes and utilized the example that melts the display image that the user as effect sees of eyes.

Figure 57 is the vertical resolution Ny4 at left and right sides display image separately _DispVertical resolution Ny4 for original image _OrgnA half (Nf=2), when promptly display image being divided into 2 scanning areas in vertical direction at the scan pattern of left and right sides eyes and the example that melts the display image that obtains as effect that utilizes eyes.In this example, when demonstrating the first half of display image in the left eye, show the latter half of display image in the right eye.In addition, switch the demonstration of the first half of display image and the demonstration of the latter half frame by frame.In addition, the sweep limit of scanner section 103,108 is half of display image height in this example.

That is, left eye respectively in the frame of adjacency scans different scanning area with right eye with scanner section 108 with scanner section 103.In addition, left eye in each frame scans different scanning area with right eye with scanner section 108 with scanner section 103.In addition, the scanning area that scanned in the 3rd frame of scanner section 103,108 is identical with scanning area in the 1st frame.

Figure 58 is the vertical resolution Ny4 at left and right sides display image separately _DispVertical resolution Ny4 for original image _OrgnFour/for the moment (Nf=4), when promptly display image being divided into 4 scanning areas in vertical direction at the scan pattern of left and right sides eyes and the example that melts the display image that obtains as effect that utilizes eyes.

In this example, display image is divided in vertical direction 4 scanning areas.Then, left eye uses scanner section 103 to scan the scanning area of the top in the 1st frame, and several the 2nd scanning areas in the scanning in the 2nd frame scan several the 3rd scanning areas, the scanning area in the 4th frame below the scanning in the 3rd frame.On the other hand, the scanning area below right eye scan in the 1st frame with scanner section 108, scanning is from the 2nd several scanning areas down in the 2nd frame, and scanning scans the scanning area of the top from the 3rd several scanning areas down in the 4th frame in the 3rd frame.In addition, the sweep limit of scanner section 103,108 is 1/4th of display image height in this example.

That is, left eye with scanner section 103 and right eye with scanner section 108 different scanning area of scanning in the frame of adjacency respectively.In addition, left eye in each frame scans different scanning area with right eye with scanner section 108 with scanner section 103.In addition, the scanning area that scanned in the 5th frame of scanner section 103,108 is identical with scanning area in the 1st frame.

Figure 59 is the variation of Figure 58.Be with the difference of Figure 58, for 4 scanning areas, right eye with scanner section 108 according to last several the 3rd scanning areas, the scanning area, the order that goes up several the 2nd scanning areas of scanning area, the top of below scan.

In this example, left eye with scanner section 103 and right eye with the scanner section 108 also different scanning area of scanning in the frame of adjacency respectively.In addition, left eye in each frame scans different scanning area with right eye with scanner section 108 with scanner section 103.In addition, the scanning area that scanned in the 5th frame of scanner section 103,108 is identical with scanning area in the 1st frame.

Shown in Figure 57～Figure 59, display image is cut apart, so that each scanning area becomes the continuum that is connected on vertical scanning direction, can reduce left eye is used scanner section 108 with scanner section 103 and right eye scanning angle thus.

Figure 60 is the vertical resolution Ny4 at left and right sides display image separately _DispVertical resolution Ny4 for original image _OrgnA half (Nf=2), when promptly display image being divided into 2 scanning areas in vertical direction at the scan pattern of left and right sides eyes and the example that melts the display image that obtains as effect that utilizes eyes.

In this example, when the pixel of the odd-numbered line that demonstrates display image in the left eye, show the pixel of the even number line of display image in the right eye.In addition, switch the demonstration of odd-numbered line of display image and the demonstration of even number line frame by frame.In addition, the sweep limit of scanner section 103,108 is identical with the display image height in this example.

Figure 61 is at Ny4 _DispBe Ny4 _OrgnFour/for the moment (Nf=4), when promptly display image being divided into 4 scanning areas in vertical direction at the scan pattern of left and right sides eyes and the example that melts the display image that obtains as effect that utilizes eyes.

In this example, left eye scans the pixel of odd-numbered line of the first half of display image in the 1st frame with scanner section 103, the pixel of the odd-numbered line of scanning the latter half in the 2nd frame, the pixel of the even number line of scanning the latter half in the 3rd frame, the pixel of the even number line of scanning the first half in the 4th frame.At this moment, right eye shows with 108 pairs of row with the display line adjacency of left eye of scanner section.In addition, the scanning area that scanned in the 5th frame of scanner section 103,108 is identical with scanning area in the 1st frame.In addition, the sweep limit of scanner section 103,108 is 3/8ths of display image height in this example.

Figure 62 is the variation of Figure 61.Be with the difference of Figure 62, right eye scans the odd-numbered line of the latter half of display image in the 1st frame with scanner section 108, the even number line of scanning the latter half in the 2nd frame, the even number line of scanning the first half in the 3rd frame, the odd-numbered line of scanning the first half in the 4th frame.In addition, the scanning area that scanned in the 5th frame of scanner section 103,108 is identical with scanning area in the 1st frame.In addition, the sweep limit of scanner section 103,108 is 3/8ths of display image height in this example.

Figure 63 is at Ny4 _DispBe Ny4 _OrgnFour/for the moment (Nf=4), when promptly display image being divided into 4 scanning areas in vertical direction at the scan pattern of left and right sides eyes and the example that melts the display image that obtains as effect that utilizes eyes.

In this example, left eye uses scanner section 103 to scan the 4N-3 capable (the 1st row and the 5th row) of display image in the 1st frame, scanning 4N-2 capable (the 2nd row and the 6th row) in the 2nd frame, scanning 4N-1 capable (the 3rd row and the 7th row) in the 3rd frame, scanning 4N capable (the 4th row and eighth row) in the 4th frame.On the other hand, right eye scans 4N-1 capable (the 3rd row and the 7th row) with scanner section 108 in the 1st frame, scanning 4N capable (the 4th row and eighth row) in the 2nd frame, scanning 4N-3 capable (the 1st row and the 5th row) in the 3rd frame, scanning 4N-2 capable (the 2nd row and the 6th row) in the 4th frame.In addition, the scanning area that scanned in the 5th frame of scanner section 103,108 is identical with scanning area in the 1st frame.In addition, the sweep limit of scanner section 103,108 is 5/8ths of display image height in this example.

Shown in Figure 61～Figure 63, so that each scanning area becomes the mode of the area of isolation of separating on vertical scanning direction display image is cut apart, the pixel that left eye will scanning neighbor connects with scanner section 108 with scanner section 103 and right eye, thereby can obtain well to melt the picture effect.But, compare with the example of Figure 57～Figure 59, the sweep limit of scanner section 103,108 in each frame becomes big.

In addition, Figure 57～Figure 63 is an example, and scan pattern determination section 806b also can use other scan pattern.In addition, shown in the above-mentioned example be Nf value to 4 till example, even the Nf value surpasses 4, also the mode that can not overlap with the display pixel of left and right sides determines same scan pattern.In this case, can improve the density that in 1 frame, shows.

When the vertical scanning scope is that N/one of original image height, the value of Nf are Ny4 _OrgnN/one (N is a natural number) time, can adopt following method, that is, original image laterally is divided into N part, left eye is in accordance with the order from top to bottom, right eye shows the image that obtains after the division frame by frame according to order from top to bottom.In this case, the location of pixels that shows in the left and right sides eyes is scatter.

In addition, when the vertical scanning scope be that N/one of original image height, the value of Nf are Ny4 _OrgnN/one (N is a natural number) time, also can adopt following method, that is, original image laterally is divided into N part, left eye shows the image that obtains after the division in accordance with the order from top to bottom, right eye then show with left eye in the pixel in zone of the zone adjacency that shows.

In addition, value identical with the original image height when the vertical scanning scope, Nf is Ny4 _DispN/one (N is a natural number) time, also can adopt following method, that is, in the L frame of left eye, show the pixel (M is a natural number) of (NM-N+L) row, right eye then show with left eye in the pixel of row of the pixel adjacency that shows.At this moment, the later demonstration of N+1 frame repeats the demonstration of the 1st～N frame.

In addition, scan pattern determination section 806b also can select display pixel in the following manner, that is, do not make the display pixel of the left and right sides that is scanned different fully, but one part of pixel is overlapped.At this moment, utilize the vertical resolution Ny4 that melts the resulting display image of picture effect of left and right sides _FusnValue can descend, but, form easily the effect of melting picture so can obtain eyes because left and right sides has shown identical pixel.

In addition, the vertical scanning scope is more little, and scanner section 103,108 driving frequency in vertical direction is more little, and therefore, scan pattern determination section 806b also can adopt according to scanner section 103,108 maximum in vertical direction and allow driving frequency Ny4 _MaxThe method of value of value decision vertical scanning scope.

In addition, at fps4 as doubly speed drives _DispThe frame per second fps4 that is higher than original image _OrgnThe situation of value under, fps4 _Disp/ fps4 _OrgnValue greater than 1.At this moment, carry out former state before and after showing frame or generate the processing of difference frame etc. according to the front and back frame, generate the image of showing to the user.

(step 705: image control)

In this step, image control part 807b controls light source 101,110 and scanner section 103,108 frame by frame corresponding to the result of previous step 704b, realizes specified scan pattern.

In addition, step 704b and step 703b also can carry out by transpose.In the case, determine the resolution, N x4 of display image corresponding to scan pattern _Disp, Ny4 _DispWith frame per second fps4 _Disp

In addition, what enumerate in the present embodiment is the example that the scanning of vertical direction is handled as the low speed end, but the scanning that also can exchange horizontal direction and vertical direction is handled.

In addition, control and treatment in the respective embodiments described above both can realize by special-purpose H/W (electronic circuit etc.), also can realize by being kept at regulated procedure data in the memory storage (ROM, RAM, hard disk etc.), that can realize above-mentioned treatment step by CPU explanation execution.In this case, both can routine data be imported in the memory storage by recording medium, also can be from direct executive routine data on the recording medium.In addition, recording medium refers to the recording mediums such as storage card of CDs such as magnetic disk memory such as semiconductor memories such as ROM, RAM, flash memory, floppy disk or hard disk, CD-ROM or DVD, BD and SD card etc.In addition, the notion of recording medium also comprises communication medias such as telephone line or transmission channel.

In addition, embodiment can suitably change in the scope that does not break away from purport of the present invention.Use can certainly combine embodiments of the present invention.

The representative purposes of the beam flying type display device of the respective embodiments described above is described below with reference to Figure 64～Figure 73.The various devices of the beam flying type display device of having used the 1st embodiment will be described below, can certainly similarly use the 2nd～the 4th embodiment, perhaps also the 1st～the 4th embodiment can be combined in any way is applied.In addition, self-evident, the purposes of beam flying type display device is not limited only to following purposes.

In addition, determine display packings by left eye with control part 105 in the present embodiment, but also can decide with control part 111, perhaps also can use and share the method for processing by two control parts 105,111 by right eye.

(the 5th embodiment)

The laser scanning type HUD (head-up display) of the 5th embodiment of the present invention is described with reference to Figure 64～Figure 68.Wherein, Figure 64 is the side view of HUD, and Figure 65 is the general view of HUD, and Figure 66 and Figure 67 are the variation of Figure 66, and Figure 68 is the details drawing of the laser scan unit 2602 of Figure 64.

The inside of car 2601 has embedded left eye laser scan unit 2602 and right eye laser scan unit 2610. Laser scan unit 2602,2610 is installed in windshield 2603 belows (being the inside at instrument panel in the present embodiment) of car 2601, to realize the miniaturization of display device.

In addition, laser scan unit 2602,2610 also can be configured in instrument panel outside rather than instrument panel inside.In this case, change laser scan unit 2602,2610 or change its position easily.

In addition, laser scan unit 2602,2610 also can be configured on the ceiling 2607, rather than the instrument panel part.In this case, the required volume of instrument panel part can be reduced, interior space can be enlarged.

In addition, laser scan unit 2602,2610 except shown in Figure 65 like that double team the user and the method that disposes, also can adopt the method that the both is configured in user right shown in Figure 66.In this case, need therefore, can not enlarge space, the raising appearance design performance (in Figure 65, left eye is configured between driver and the copilot seat with laser scan unit 2602) of vehicle body central authorities in vehicle body central part configuration scanning element 2602.

The light that laser scan unit 2602,2610 scannings produce passes semi-transparent semi-reflecting lens 2604 after being installed in deflector 104,107 reflections on the windshield 2603, arrive driver 2605 eyeball 2606,2609, thereby form vision imaging.Utilize this HUD, can see through windshield 2603 on one side and confirm extraneous landscape, Yi Bian watch cartographic information or the warning message that shows by laser scan unit 2602,2610, thus driver 2605 security and convenience can be improved.After projecting to semi-transparent semi-reflecting lens 2604 reflections of reflected light through being arranged on the eyes of user front of the laser on user's the retina, detected by optical detection part 214.

In addition, except deflector 104,107 is configured in like that the method on the windshield 2603 respectively shown in Figure 67, also can use the method shown in Figure 65 and Figure 66,, realize monolithic hologram catoptron by multiexposure, multiple exposure on 1 hologram.In this case, can expand left eye deflector 104 and right eye deflector 107 area separately, thus can be to the broader image of user's display view angle.

In addition, both can prepare two semi-transparent semi-reflecting lens 2604 and be respectively applied for right eye and left eye, also can use the semi-transparent semi-reflecting lens of a wide shape of horizontal stroke.

Left eye includes light source 101, wave front shape changing unit 102, scanner section 103, control part 105 with laser scan unit 2602.In addition, right eye includes light source 110, wave front shape changing unit 109, scanner section 108, control part 111 with laser scan unit 2610.Figure 68 shows left eye in the present embodiment with the structure example of the light source 101 in the laser scan unit 2602, wave front shape changing unit 102, deflector 104.

Light source 101 among Figure 68 is identical with Fig. 2 of the 1st embodiment, includes red laser light source 211, blue laser light source 212 and green laser light source 213.In addition, in the present embodiment, optical detection part 214 is not included in the light source 101, but is configured in like that shown in Figure 64 on the ceiling 2607 of car 2601.By adopting this structure, can shorten user's retina and the distance between the optical detection part 214, thereby can easily detect the luminous point size on the retina.

In the wave front shape changing unit 102 shown in Figure 68, focal length horizontal component changing unit 3001 and focal length vertical component changing unit 3002 are arranged in series on the light path.Thus, just can change the curvature of beam level direction and the curvature of vertical direction independently.Focal length horizontal component changing unit 3001 in the present embodiment and focal length vertical component changing unit 3002 change the curvature of horizontal direction and vertical direction by the position that changes cylindrical lens.

In addition, focal length horizontal component changing unit 3001 is identical with focal length vertical component changing unit 202 with focal length horizontal component changing unit 201 shown in Figure 2 with focal length vertical component changing unit 3002, also can be by the combination of cylindrical lens and catoptron, change the position of catoptron, thereby change the wave front shape.In this case, by making the catoptron vibration at high speed, even when the dynamic menu of the image of display of high resolution or high frame per second, also can suitably change the wave front shape.

In addition, right eye adopts same structure with laser scan unit 2610 and left eye with laser scan unit 2602, therefore omits its explanation.

In addition, the deflector the 104, the 107th in the present embodiment is realized by transmission-type hologram.In the present embodiment, deflector the 104, the 107th is made in such a way, promptly, inboard (inboard of car) at windshield 2603 forms for example photosensitive polymer layer, and on photosensitive polymer layer, form Lippmann's volume hologram, make beam diffraction from scanner section 103,108, optically focused thus to the pupil of eyes of user.Both can overlap to form 3 holograms on photosensitive polymer layer, the light that sends of reflection Red, green, blue laser light source respectively also can the corresponding 3 layers of hologram of stacked and versicolor light.In addition, utilize the selectivity of hologram to wavelength, only the light to optical source wavelength carries out diffraction, and most light beyond the optical source wavelength, that constitute extraneous light is not carried out diffraction, in this manner, just can produce the display of transmission-type.

In addition, deflector 104,107 also can be made the form that can freely load and unload on windshield 2603.In this case, when not needing the demonstration of display, deflector 104,107 is disassembled, just can guarantee the transmittance of windshield 2603, improve driver 2605 security.

In embodiments of the present invention, semi-transparent semi-reflecting lens 2604 is set, will reflexes to optical detection part 214 from user's amphiblestroid reflected light by eyes front the user.Semi-transparent semi-reflecting lens 2604 is installed on the ceiling 2607 of car 2601 by support rod 2608.Utilize this structure, do not need force users head-mount device, just can the luminous point size on user's the retina be detected.In addition, semi-transparent semi-reflecting lens 2604 and optical detection part 214 also can not be arranged on the ceiling 2607 of car 2601, but are set on driver 2605 the glasses or cap.In this case, even rock before and after driver 2605 the head, the possibility that head touches semi-transparent semi-reflecting lens 2604 also decreases, and therefore can improve driver 2605 security.In addition, except the method for two optical detection parts 214 preparing to be used for left eye and right eye respectively, also 1 optical detection part 214 can only be set, be used to detect reflected light from a certain branch hole eyeball.In this case, do not need to increase the direction of visual lines that optical detection part 214 just can detect the user, therefore can cut down the cost of beam flying type display device.

Control part 105,111 possesses the integrated circuit that is used to control the HUD each several part.Output, wave front shape changing unit 102,109 and the scanner section 103,108 of the laser that sends from light source 101,110, the action of optical detection part 214 are controlled by control part 105.

In the present embodiment, optical detection part 214 is configured on the ceiling 2607, and control part 105,111 is arranged on instrument panel inside; Communicating by letter between optical detection part 214 and the control part 105,111 both can also can utilize radio communication to realize by realizing at car 2601 laid inside wire cables.

In addition, also can adopt one-sided some control parts 105,111 only are set, the method that left eye is controlled with laser scan unit 2610 both sides with laser scan unit 2602 and right eye.In this case, can reduce the size of beam flying type display device.

The beam flying type display device of present embodiment is utilized melting as effect of eyes by carrying out step 801～805 shown in Figure 6, improves the frame per second that the user is watched when the identification image.In addition, the contents processing of step 801～805 is identical with the 1st embodiment.

(the 6th embodiment)

Below, the binoculars 3101 of the 6th embodiment are described with reference to Figure 69～Figure 72.Wherein, Figure 69 is the general view of binoculars 3101, and Figure 70 is the side view of the left eye side display part 3101a of binoculars 3101, and Figure 71 is the side view of the right eye side display part 3101b of binoculars 3101, and Figure 72 is the figure of the variation of expression Figure 69.

At first, shown in Figure 69, binoculars 3101 possess the left eye side display part 3101a and the right eye side display part 3101b that is used at user's right eye display image that is used at user's left eye display image.Secondly, shown in Figure 70 and Figure 71, left eye side display part 3101a and right eye side display part 3101b possess camera 3103,3502 respectively.In addition, user 3105 is by spying on binoculars 3101, can watch the captured image of camera 3103,3502 or from the image of the external image equipment that is connected with external input terminals of binoculars 3101.By adopting this structure, user 3105 does not need as HMD can to use beam flying type display device easily at the head-mount device outdoor yet.

Shown in Figure 70, left eye side display part 3101a includes light source 101, wave front shape changing unit 102, scanner section 103, deflector 104, control part 105, camera 3103 and catoptron 3102, is used at left eye 3106 show images.On the other hand, shown in Figure 71, right eye side display part 3101b includes light source 110, wave front shape changing unit 109, scanner section 108, deflector 107, control part 111, camera 3502 and catoptron 3501, is used at right eye 3104 show images.

What illustrate in the above-described embodiment is the example that left eye side display part 3101a and right eye side display part 3101b possess camera 3103,3502 respectively, but the present invention is not limited to this, also can be shared by left eye side display part 3101a and right eye side display part 3101b and use same camera.But, shown in Figure 70 and Figure 71, also can utilize 2 cameras 3103,3502 that are provided with among left eye side display part 3101a and the right eye side display part 3101b take respectively right eye with and left eye show with image.Thus, can in user's eyes, show the image that has parallax, thereby can show three-dimensional image.

Light source 101,109 among Figure 70 and Figure 71 is identical with Fig. 2 of the 1st embodiment, includes red laser light source 211, blue laser light source 212, green laser light source 213 and optical detection part 214.

In the wave front shape changing unit 102,109 among Figure 70 and Figure 71, focal length horizontal component changing unit 201 and focal length vertical component changing unit 202 are arranged in series on the light path.Thus, just can change the curvature of beam level direction and the curvature of vertical direction independently.In the present embodiment, as shown in Figure 2,, change the position of catoptron, thereby change the wave front shape of vertical direction and horizontal direction by the combination of cylindrical lens and catoptron.

Light beam from wave front shape changing unit 102,109 is scanned portion's 103,108 scannings via catoptron 3102,3501 respectively, injects deflector 104,107 respectively.

Deflector the 104, the 107th is configured on the binoculars 3101 eyepiece near the eyes position, and the light of its portion of self-scanning in the future 103,108 gathers on user's the pupil.In addition, deflector 104,107 can not be convex lens also, but transmission-type hologram.In this case, eyepiece partly can be done thinly, be realized the miniaturization of binoculars 3101.

In addition, using hologram to realize under the situation of deflector 104,107, also can be unlike shown in Figure 72 separate configuration deflector 104,107, but use a slice hologram of multiexposure, multiple exposure to be deflector 104,107 as shown in Figure 69.In this case, can demonstrate the broad image in visual angle to the user.

Amphiblestroid reflected light from the user is advanced along the path identical with reflected light is reverse, is detected by optical detection part 214.

Control part 105,111 possesses the integrated circuit of the each several part that is used to control binoculars 3101.The output of the laser that sends from light source 101,110 by control part 105,111 control and the action of wave front shape changing unit 102,109, scanner section 103,108, optical detection part 214 and camera 3103,3502.

The beam flying type display device of present embodiment is carried out step 801～805 shown in Figure 6, utilizes melting as effect of eyes, improves the frame per second that the user is watched when the identification image.In addition, the contents processing of step 801～805 is identical with the 1st embodiment.

In addition, with regard to light source 101,110, also can adopt will be from the light beam beam split of light source 101, the method for the employed wave front shape of demonstration changing unit 102,109 that makes it inject right and left eyes respectively with prism etc.In this case, reduce needed light source, thereby can realize the miniaturization of binoculars 3101, and can reduce power consumption.

(the 7th embodiment)

Figure 73 shows the structural drawing (side view) of the laser scanning type console display 3401 in the 7th embodiment of the present invention.

Console display 3401 includes light source 101, wave front shape changing unit 102, scanner section 103, deflector 104 and control part 105.Particularly, the framework internal storage wave front shape changing unit 102, scanner section 103 and control part 105, and the framework surface has the display surface that is made of deflector 104.In addition, itself and binoculars 3101 similarly possess left side display part and right side display part.

And the user is arranged on this console display 3401 on the desk and is used.By adopting the structure of Figure 73, the user does not need as HMD at the head-mount device.In addition, do not need as binoculars 3101, to use for a long time the hand fulcrum arrangement yet, thereby do not bear, can use console display 3401 for a long time.

Industrial applicibility

Beam flying type display unit of the present invention have right eye with scanner section, left eye with scanner section etc., Can in the purposes such as display unit, display system, display packing, display routine, use this device.

Claims (35)

1. an image display device is used for display image on user's retina, possesses:

Left eye image efferent is exported with image the left eye that constitutes a part or whole original image;

The left eye deflector, the described left eye that described left eye is exported with the image efferent carries out deflection with image towards user's left eye direction;

Right eye image efferent is exported with image the right eye that constitutes a part or whole original image;

The right eye deflector, the described right eye that described right eye is exported with the image efferent carries out deflection with image towards user's right eye direction; And

Control part, described left eye is controlled with the image efferent with image efferent and described right eye, among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one mutually different described left eye image and described right eye image, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

2. image display device as claimed in claim 1 is characterized in that,

Described left eye comprises with the image efferent:

The left eye light source, output is to constituting the light beam that left eye is described with each pixel of image; And

The left eye scanner section makes from the beam flying described left eye deflector of described left eye with light source;

Described right eye comprises with the image efferent:

The right eye light source, output is to constituting the light beam that right eye is described with each pixel of image; And

The right eye scanner section makes from described right eye with the described right eye deflector of the beam flying of light source.

3. image display device as claimed in claim 2 is characterized in that,

Described control part comprises:

The sweep limit configuration part, make described left eye carry out beam flying with a scanner section among the scanner section with the 1st scanning angle of the part that only scans described original image with scanner section and described right eye, make another scanner section carry out beam flying with the 2nd scanning angle, described the 2nd scanning angle is bigger and smaller or equal to the scanning angle that can scan whole described original image than described the 1st scanning angle;

The different described left eye of image quality by controlling described left eye with image efferent and described right eye image efferent, thereby corresponding to the scanning angle that described sweep limit configuration part sets, is exported with image and described right eye image in the image quality configuration part.

4. image display device as claimed in claim 3 is characterized in that,

Described image quality configuration part comprises the frame per second configuration part,

This frame per second configuration part makes described left eye export the image of the 1st frame per second with image efferent and described right eye with the corresponding image efferent of the side with being set at described the 1st scanning angle among the image efferent, makes the image with the corresponding image efferent output of a side that is set at described the 2nd scanning angle 2nd frame per second littler than described the 1st frame per second.

5. image display device as claimed in claim 3 is characterized in that,

Described image quality configuration part comprises resolution setting portion,

This resolution setting portion makes described left eye export the image of the 1st resolution with image efferent and described right eye with the corresponding image efferent of the side with being set at described the 1st scanning angle among the image efferent, makes the image with the corresponding image efferent output of a side that is set at described the 2nd scanning angle 2nd resolution lower than described the 1st resolution.

6. image display device as claimed in claim 3 is characterized in that,

Described left eye is used the big or small different of scanner section with scanner section and described right eye,

Described sweep limit configuration part make described left eye with scanner section and described right eye with scanner section among both a larger-size side carry out beam flying with described the 1st scanning angle, make above-mentioned among both the less side of size carry out beam flying with described the 2nd scanning angle.

7. image display device as claimed in claim 3 is characterized in that,

Also comprise the line-of-sight detection portion that is used to detect user's sight line,

The sweep limit configuration part makes described left eye carry out beam flying to the sight line position that comprises the user in interior zone in the testing result of described line-of-sight detection portion with a side group that is set to described the 1st scanning angle among the scanner section with scanner section and described right eye.

8. image display device as claimed in claim 3 is characterized in that,

Described sweep limit configuration part makes described left eye carry out beam flying with the corresponding side of the clearsighted eyes user with described the 1st scanning angle with among the scanner section with scanner section and described right eye, makes opposite side carry out beam flying with described the 2nd scanning angle.

9. image display device as claimed in claim 3 is characterized in that,

Described sweep limit configuration part makes described left eye carry out beam flying with the corresponding side of the clear-eyed eyes user with described the 1st scanning angle with among the scanner section with scanner section and described right eye, makes opposite side carry out beam flying with described the 2nd scanning angle.

10. image display device as claimed in claim 2 is characterized in that,

Described control part comprises described scan pattern determination section, this scan pattern determination section makes described left eye carry out beam flying with scanner section and described right eye respectively in such a way with scanner section, promptly, described original image is divided into a plurality of scanning areas, at left eye described in each frame with scanner section and described right eye scanning area difference with scanner section, and at left eye described in the adjacent frame with scanner section and described right eye with scanner section scanning area difference separately.

11. image display device as claimed in claim 10 is characterized in that,

Described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye on one side with scanner section, on one side with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus;

Described scan pattern determination section is divided into a plurality of scanning areas with described original image, so that scan on described 2nd direction adjacent pixels with scanner section and described right eye with scanner section at left eye described in each frame.

12. image display device as claimed in claim 10 is characterized in that,

Described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye on one side with scanner section, on one side with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus;

Described scan pattern determination section is divided into a plurality of scanning areas with described original image, so that scan continuous scanning area on described the 2nd direction at left eye described in each frame respectively with scanner section with scanner section and described right eye.

13. image display device as claimed in claim 10 is characterized in that,

Described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye on one side with scanner section, on one side with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus;

Described scan pattern determination section makes described left eye carry out beam flying with scanner section and described right eye in such a way respectively with scanner section, that is, described left eye is opposite with the direction of scanning of scanner section on described the 2nd direction with scanner section and described right eye.

14. image display device as claimed in claim 10 is characterized in that,

Described control part comprises demonstration image quality determination section, this show image quality determination section based on described left eye with scanner section and described right eye maximum drive frequency with scanner section, generate the correcting image after the frame per second of described original image and at least any one party among the display pixel number proofreaied and correct;

Described scan pattern determination section will be divided into a plurality of scanning areas by the described correcting image that described demonstration image quality determination section generates, and make described left eye carry out beam flying with scanner section and described right eye respectively with scanner section.

15. image display device as claimed in claim 14 is characterized in that,

Described left eye repeatedly repeats the action of scanning element on the 1st direction with scanner section and described right eye on one side with scanner section, on one side with the 2nd direction of described the 1st direction quadrature on shift position successively, come scan image thus;

Described demonstration image quality determination section is proofreaied and correct for a less side among following two driving frequencies 2 times with the frame per second of described original image, and described two driving frequencies are described left eyes essential in order to show described original image with scanner section and described right eye with scanner section at the driving frequency on described the 2nd direction and described left eye with scanner section and described right eye with the maximum drive frequency of scanner section on described the 2nd direction.

16. image display device as claimed in claim 15 is characterized in that,

Described demonstration image quality determination section is proofreaied and correct once more to the described frame per second after proofreading and correct, so that according to the described frame per second after proofreading and correct and described left eye with scanner section and described right eye with the display pixel number of scanner section on described the 2nd direction that the driving frequency on the 1st direction is calculated more than or equal to predetermined, as to make described original image frame per second more than or equal to 1 numerical value, and smaller or equal to the display pixel number of described original image on described the 2nd direction.

17. image display device as claimed in claim 14 is characterized in that,

Described scan pattern determination section is divided into the scanning area of the quantity suitable with following numerical value with described original image, and this numerical value is the merchant that described left eye is counted gained with the total pixel number of any one in the image divided by the display pixel of each frame after proofreading and correct through described demonstration image quality determination section with image or described right eye.

18. image display device as claimed in claim 14 is characterized in that,

Described demonstration image quality determination section is also proofreaied and correct the frame per second of described original image and at least one side among the display pixel number based on the content information of the content of representing described original image.

19. image display device as claimed in claim 18 is characterized in that,

Control part also comprises user's configuration management portion, the image quality corrected value that this user's configuration management portion keeps the user that each content information is set,

Described demonstration image quality determination section based on the corresponding described image quality corrected value of the content information of described original image, the frame per second of described original image and at least one side among the display pixel number are proofreaied and correct.

20. image display device as claimed in claim 19 is characterized in that,

Described user's configuration management portion also keeps the information relevant with user's eyesight, described demonstration image quality determination section is proofreaied and correct the frame per second of described original image and at least one side among the display pixel number based on the information relevant with user's eyesight that described user's configuration management portion is kept.

21. image display device as claimed in claim 10,

Also comprise:

Battery is used to drive this image display device;

Power management portion is used to detect the surplus of described battery; And

The driving frequency determination section, according to the testing result of described power management portion, change described left eye with scanner section and described right eye with the two the maximal value of driving frequency of scanner section.

22. image display device as claimed in claim 2 is characterized in that,

Injecting described left eye and cause described left eye to become with image injecting described right eye and cause described right eye to become with image being deformed into the right eye of trapezoidal shape with deflector with deflector with deflector owing to described left eye is oblique with the light beam that scanner section scanned with distorted image and owing to described right eye is oblique with the light beam that scanner section scanned with under the situation of distorted image at described right eye at described left eye is deformed into trapezoidal shape with deflector left eye

Described control part comprises:

The rectangular area determination section, be used to determine left eye to use the rectangular area with rectangular area and right eye, described left eye is to be the 1st limit with described left eye with the part on the long limit of distorted image with the rectangular area, with with described the 1st limit quadrature and link the end points on described the 1st limit and described left eye is the rectangular shape on the 2nd limit with the line segment of the hypotenuse of distorted image, described right eye with the rectangular area be with described right eye with the part on the long limit of image as the 3rd limit that equates with described the 1st edge lengths, with with described the 3rd limit quadrature and link the end points on described the 3rd limit and described right eye is the rectangular shape on the 4th limit with the line segment of the hypotenuse of distorted image;

The depth-width ratio adjustment part is used to adjust the height of described original image and at least one side among the width, is height, is the correcting image of width with described the 2nd length of side and described the 4th length of side sum so that described original image becomes with described the 1st length of side;

Distortion correction portion, generation make described correcting image to described left eye left eye correcting image with the distortion of distorted image reverse direction, so that demonstrate described left eye image on deflector at described left eye, and generate make described correcting image to the right eye correcting image of described right eye with the distortion of distorted image reverse direction so that demonstrate described right eye image on deflector at described right eye; And

The output image control part, with described left eye with outputing to described left eye image efferent with described left eye with the corresponding part in rectangular area among the correcting image, and with described right eye with outputing to described right eye image efferent with described right eye with the corresponding part in rectangular area among the correcting image.

23. image display device as claimed in claim 22 is characterized in that,

Described rectangular area determination section determines described left eye to use the rectangular area with rectangular area and described right eye in such a way, promptly, described left eye is included in the minor face of distorted image with described left eye with distorted image with image and described right eye described right eye with the long limit of image among and described right eye when being included in described left eye and overlaping with the mode among the long limit of distorted image with the minor face of image, the described the 2nd and the 4th limit becomes passes described left eye with distorted image and the described right eye straight line with the intersection point of distorted image hypotenuse separately.

24. image display device as claimed in claim 22 is characterized in that,

Described control part comprises the remaining area determination section,

This remaining area determination section is used to determine left eye remaining area and right eye remaining area, described left eye remaining area is that the opposite side with described the 1st limit is long limit, is the trapezoidal shape of hypotenuse with described left eye with the part of the hypotenuse of distorted image, described the 4th limit of its aspect ratio is shorter, described right eye remaining area is to be long limit, to be the trapezoidal shape of hypotenuse with described right eye with the part of the hypotenuse of distorted image that with described the 3rd limit described the 2nd limit of its aspect ratio is shorter;

Described output image control part also with described left eye with outputing to described left eye image efferent with described left eye with the corresponding part of remaining area among the correcting image, and with described right eye with outputing to described right eye image efferent with described right eye with the corresponding part of remaining area among the correcting image.

25. image display device as claimed in claim 24 is characterized in that,

Described output image control part is by the described left eye of control image efferent and described right eye image efferent, reduce described left eye with remaining area and at described right eye with at least one the regional brightness among in the rectangular area and the zone that described left eye overlaps with remaining area, and reduce described right eye with remaining area and at described left eye with at least one the regional brightness among in the rectangular area and the zone that described right eye overlaps with remaining area.

26. image display device as claimed in claim 24 is characterized in that,

Described output image control part is by the described left eye of control image efferent and described right eye image efferent, increase the brightness of described right eye, and increase the brightness in the zone that does not overlap with remaining area with described right eye among the described left eye usefulness rectangular area with the zone that does not overlap with remaining area with described left eye among the rectangular area.

27. image display device as claimed in claim 22 is characterized in that,

Described rectangular area determination section determines the shape of described left eye rectangular area and described right eye rectangular area so that the ratio of width to height of described correcting image is the mode of the ratio of 16: 9 or 4: 3.

28. image display device as claimed in claim 22 is characterized in that,

Described rectangular area determination section in the eyesight difference of user's right and left eyes under the situation more than the certain numerical value, so that the pairing rectangular area of clear-eyed eyes becomes maximum, and make the pairing rectangular area of weak-eyed eyes become the shape that 0 mode determines described left eye rectangular area and described right eye rectangular area;

Described remaining area determination section is so that the pairing remaining area of clear-eyed eyes becomes 0, and the mode that makes the pairing remaining area of weak-eyed eyes become maximum determines the shape of described left eye remaining area and described right eye remaining area.

29. a method for displaying image is characterized in that, comprising:

Left eye is exported step with image, and the left eye that has constituted a part or whole original image is exported with image;

Left eye deflection step makes by described left eye and uses with the described left eye of image output step output

Image carries out deflection towards user's left eye direction;

Right eye is exported step with image, and the right eye that has constituted a part or whole original image is exported with image;

Right eye deflection step makes by described right eye and uses with the described right eye of image output step output

Image carries out deflection towards user's right eye direction; And

Controlled step, described left eye is controlled with the image efferent with image efferent and described right eye, among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one mutually different described left eye image and described right eye image, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

30. a program is characterized in that, makes computing machine carry out following steps:

Left eye is exported step with image, and the left eye that has constituted a part or whole original image is exported with image;

Left eye deflection step makes the described left eye of exporting with image output step by described left eye carry out deflection with image towards user's left eye direction;

Right eye is exported step with image, and the right eye that has constituted a part or whole original image is exported with image;

Right eye deflection step makes the described right eye of exporting with image output step by described right eye carry out deflection with image towards user's right eye direction; And

Controlled step, described left eye is controlled with the image efferent with image efferent and described right eye, among output pixel position, picture shape, image size, image resolution ratio and the display frame rate at least one mutually different described left eye image and described right eye image, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

31. an integrated circuit is characterized in that, comprising:

Left eye image efferent is exported with image the left eye that constitutes a part or whole original image;

The left eye deflector, the described left eye that described left eye is exported with the image efferent carries out deflection with image towards user's left eye direction;

Right eye image efferent is exported with image the right eye that constitutes a part or whole original image;

The right eye deflector, the described left eye that described right eye is exported with the image efferent carries out deflection with image towards user's right eye direction; And

Control part, described left eye is controlled with the image efferent with image efferent and described right eye, among output pixel position, picture shape, image size and the display frame rate at least one mutually different described left eye image and described right eye image, melt the picture effect thereby utilize, make the user go out described original image with image and described right eye with image recognition according to described left eye.

32. a glasses type head mounted display is characterized in that possessing:

The described image display device of claim 1;

The left eye eyeglass is configured in user's left eye position, and has described left eye deflector in the position on user's left eye opposite;

The right eye eyeglass is configured in user's right eye position, and has described right eye deflector in the position on user's right eye opposite;

Left side mirror leg, an end is connected to described left eye eyeglass, and the other end is fixed on user's left side of head; And

Right side mirror leg, an end are connected to described right eye eyeglass, and the other end is fixed on user's right side of head.

33. an automobile is characterized in that possessing:

The described image display device of claim 1; And

Windshield has described left eye with deflector and described right eye deflector.

34. binoculars is characterized in that possessing:

The described display device of claim 1;

Left eye eyepiece eyeglass has described left eye deflector; And

Right eye eyepiece eyeglass has described right eye deflector.

35. a console display is characterized in that possessing:

The described image display device of claim 1;

Be used to deposit the framework of described display device; And

The display surface that on described framework surface, constitutes with deflector with deflector and described right eye by described left eye.

Images