JP2019105723A - Retina-scanning type image projection device, retina-scanning type image projection method, and retina-scanning type image projection system - Google Patents

Abstract

To improve the accuracy of the discrimination of a color by a user.SOLUTION: A retina-scanning type image projection device includes a storage unit in which color vision characteristic data is stored, a plurality of laser light sources which generate laser beams for images based on image data, a laser irradiation unit which projects an image to the retina of the eyeball of the user by the laser beams for images, a laser output control unit which individually controls the light quantities of laser light outputted from the plurality of laser light sources respectively on the basis of the color vision characteristic data, and an optical member which converges the laser beams for images in the eyeball of the user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a retinal scanning image projector, a retinal scanning image projection system, and a retinal scanning image projection method.

  Heretofore, there have been a plurality of means for improving the visibility of patients with color vision abnormalities. As one of the means, the spectacle lens which has a spectral curve which can expand color discrimination ability is known. Further, as another means, there is known a display device such as an LCD (Liquid Crystal D display) which changes the characteristics of each color of image data to be displayed and displays a color-corrected image so that colors can be easily identified. .

JP, 2002-303832, A JP, 2014-165768, A

  The conventional spectacle lens described above can only dim because it is an optical filter, so when it is worn, the field of vision may be dark and it may be difficult to visually recognize. Further, in the conventional spectacle lens, it is difficult to realize high-accuracy spectroscopy because the wavelength distribution itself of the light source to be viewed is not separated.

  Further, in the above-described display device, the displayed image passes through the intermediate translucent body, which is the anterior eye of the eye, to reach the retina, so it depends on optical characteristics such as the chromatic aberration of the cornea and the lens of the anterior eye. . For this reason, the corrected color tone may not necessarily match the color perception characteristics of the user.

  The technology disclosed herein has been made in view of the above-described circumstances, and aims to improve the accuracy of color determination by the user.

  According to the disclosed technology, an image is transferred to the retina of the eye of the user by a storage unit in which color vision characteristic data is stored, a plurality of laser light sources for generating an imaging laser beam based on image data, and the imaging laser beam. The laser irradiation unit for projecting, the laser output control unit for individually controlling the light amount of the laser light output from the plurality of laser light sources based on the color vision characteristic data, and the user of the image laser beam And an optical member for focusing in the eyeball of the eye.

  It is possible to improve the accuracy of color determination by the user.

It is a figure explaining the composition of the image projection device of a first embodiment. It is the figure which expanded the projection mirror vicinity of an image projector. It is a figure explaining the vibration of a scanning mirror. It is a figure explaining the function of the laser output control part of 1st embodiment. It is a figure which shows the color gamut of the laser beam in xy chromaticity diagram, and the color gamut defined by NTSC. It is a figure explaining the relationship between a color vision characteristic and color vision characteristic data. It is a figure which shows an example of the color vision characteristic data of 1st embodiment. It is a flowchart explaining operation | movement of the laser output control part of 1st embodiment. It is a figure which shows an example of the image projection system of 2nd embodiment. It is a figure explaining the function of each apparatus of an image projection system. It is a figure which shows an example of the color vision characteristic data of 2nd embodiment. It is a figure explaining the image projector of 3rd embodiment. It is a figure explaining the hardware constitutions of the image projector of 3rd embodiment. It is a figure explaining the function of the image projector of 3rd embodiment. It is a flowchart explaining operation | movement of the image projector of 3rd embodiment.

(First embodiment)
The first embodiment will be described below with reference to the drawings. FIG. 1 is a view for explaining the arrangement of an image projection apparatus according to the first embodiment.

  In FIG. 1, the image projection apparatus 100 of the present embodiment utilizes Maxwell vision. In Maxwell vision, an imaging light beam based on image data is once converged at the center of the pupil and then projected onto the retina to allow the person to display an image represented by the image data without being influenced by the adjustment function of the human crystalline lens. It is a method to make it visible.

  The image projection apparatus 100 according to the present embodiment includes a laser output control unit 50 and a laser irradiation unit 60. The laser output control unit 50 controls the irradiation of the laser light by the laser irradiation unit 60. The image projection apparatus 100 according to the present embodiment may have, for example, a shape like general glasses or goggles.

  The laser irradiation unit 60 includes a projection unit 110, a temple 150 of an eyeglass-type frame, and a lens 151. The projection unit 110 includes a light source 111, a scanning mirror 112, a reflection mirror 115, and a projection mirror 116.

  The light source 111 is disposed on the temple 150. The light source 111 emits, for example, a light beam L of one or more wavelengths under the control of the laser power control unit 50. The light ray L is an image light ray for projecting an image on the retina 161 of the eye 160 of the user. In the following description, the light ray L is called an image light ray.

  The light source 111 has laser light sources of three colors of R, G, and B, and for example, red (R) laser light (wavelength: about 610 nm to about 660 nm), green (G) laser light (wavelength: about 515 nm to about 540 nm), And blue (B) laser light (wavelength: about 440 nm to 480 nm) is emitted. It emits red, green and blue laser light. The light source 111 of the present embodiment is realized as a light source 111 by, for example, a light source in which laser diode chips of RGB (red, green, and blue), a three-color combining device, and a microcollimator lens are integrated. The output value of is variable.

  In FIG. 1, the traveling direction in the projection mirror 116 of the light beam incident on the projection mirror 116 is taken as the X direction, and the direction orthogonal to the X direction at the projection mirror 116 is taken as the Y direction.

  The scanning mirror 112 is disposed on the temple 150. The scanning mirror 112 is, for example, a MEMS (Micro Electro Mechanical Systems) mirror, and scans a laser beam (light beam) L emitted from the light source 111 in a two-dimensional direction of horizontal direction and vertical direction. In addition, the scanning mirror 112 two-dimensionally scans the light beam L emitted from the light source 111 to obtain projection light for projecting an image on the retina 161 of the eye 160 of the user.

  The reflection mirror 115 reflects the light beam L scanned by the scanning mirror 112 toward the lens 151.

  A projection mirror 116 having a free-form surface is provided on the surface of the lens 151 on the side of the eye 160 of the user. The projection mirror 116 projects an image on the retina 161 by scanning the scanning mirror 112 and irradiating the light beam L reflected by the reflection mirror 115 to the retina 161 of the eyeball 160. That is, the user can recognize an image by the afterimage effect of the laser beam projected onto the retina 161. The projection mirror 116 is designed such that the convergence position of the light beam L scanned by the scanning mirror 112 is the pupil 162 of the eye 160. The ray L is incident on the projection mirror 116 almost immediately (that is, approximately in the -X direction).

  In the present embodiment, if the curvature of the free curved surface of the projection mirror 116 is increased, the distance from the reflection mirror 115 to the convergence position of the pupil 162 can be shortened, and the image projection apparatus 100 can be miniaturized. .

  The laser output control unit 50 of the present embodiment is realized by a processor such as a central processing unit (CPU) and a memory device such as a random access memory (RAM) and a read only memory (ROM).

  The processor and the memory may be mounted on, for example, the same substrate on which the scanning mirror 112 (MEMS mirror) is mounted.

  The laser output control unit 50 of the present embodiment causes the light source 111 to emit an image light beam based on the input image data. In addition, the laser output control unit 50 of the present embodiment vibrates the scanning mirror 112 (MEMS mirror), scans the image light beam emitted from the light source 111, and projects the image on the retina 161.

  In addition, the laser output control unit 50 of the present embodiment holds color vision characteristic data according to the color vision characteristic of the user of the image projection apparatus 100, and based on the color perception characteristic data, each of RGB included in the light source 111 Control the output value (light quantity) of the light source. The details of the laser output control unit 50 and the color vision characteristic data will be described later.

  Although the example of FIG. 1 shows the projection unit 110 corresponding to one eye, the image projection apparatus 100 includes the projection unit 110 corresponding to both eyes. These two projection units 110 have the same configuration.

  Next, projection of an image by the projection unit 110 of the image projector 100 will be described with reference to FIGS. 2 and 3. FIG. 2 is an enlarged view of the vicinity of a projection mirror of the image projector.

  As shown in FIGS. 2 and 3, the imaging light beam scanned by the scanning mirror 112 is reflected by the mirror 115 toward the lens 151. In the present embodiment, since the projection unit 110 is disposed on the surface of the lens 151 on the eyeball 160 side, the imaging light beam scanned by the scanning mirror 112 is incident on the projection unit (projection mirror) 116.

  The projection unit 116 is a half mirror having a free-form surface or a composite structure of a free-form surface and a diffractive surface in the area 116 a where the image light beam is incident. As a result, the imaging light beam incident on the projection unit 116 is converged in the vicinity of the pupil 162 of the eyeball 160 and then projected onto the retina 161.

  Thus, the user can recognize the image formed by the image light beam

  FIG. 3 is a diagram for explaining the vibration of the scanning mirror. Note that FIG. 3 shows the case where the scanning mirror 112 vibrates from point A to point B.

  As a method of scanning an image light beam by the scanning mirror 112 and projecting an image on the retina 161, a method of scanning light at high speed from the upper left to the lower right of the area on which the image is projected (eg, raster scan) ).

  In the present embodiment, as shown in FIG. 3, the scanning mirror 112 is larger than the region H (broken line range in FIG. 3) in which the image is projected on the retina 161 in order to scan the image light beam (light beam L). And vibrate in the horizontal direction (first direction) and in the vertical direction (second direction intersecting the first direction). In FIG. 3, the vibration of the scanning mirror 112 is indicated by reference numeral 61.

  When the image light beam is scanned at a portion where the scanning mirror 112 largely shakes to project the image on the retina 161, distortion of the image becomes large. Therefore, in the present embodiment, the imaging light beam is scanned at a place where the deflection of the scanning mirror 112 is small.

  Although FIG. 3 shows the case where the image light beam is scanned in a rectangular shape as an example, the present invention is not limited to this case, and other cases such as trapezoidal shape scanning may be used.

  Further, in the present embodiment, it is preferable that the area H where the image is projected has a size that covers the field of view of the user. The size that covers the user's field of vision is, for example, a size in which the image projected onto the retina covers about 60 degrees on the nose side and upper side, about 70 degrees on the lower side, and about 90 to 100 degrees on the ear side. It is.

  In addition, for users who know that there is a defect in a part of their visual field in advance, the region H where the image is projected is “under about 60 degrees on the nose side and upper side with one eye, It may be smaller than about 70 degrees, and about 90 to 100 degrees on the side of the ear.

  Next, with reference to FIG. 4, the laser output control unit 50 of the present embodiment will be described. FIG. 4 is a diagram for explaining the function of the laser output control unit of the first embodiment.

  The laser output control unit 50 of the present embodiment includes an image input unit 51, a storage unit 52, an output control unit 53, and a communication unit 54. These units are realized by the CPU and the memory device of the laser output control unit 50.

  The image input unit 51 receives an input of image data via the communication unit 54. The storage unit 52 holds color vision characteristic data 55. Incidentally, for example, when the user of the image projection apparatus 100 is determined, the laser output control unit 50 according to the present embodiment acquires the color vision characteristic data 55 according to the color perception characteristic of the user and causes the storage unit 52 to hold it. It is good. In addition, the laser output control unit 50 may receive the color vision characteristic data 55 from the external device via the network and the communication unit 54 and hold the color perception characteristic data 55 in the storage unit 52 or read it out from a portable recording medium or the like It may be held by the part 52.

  The output control unit 53 controls the output value of the laser light emitted from each of the RGB light sources based on the color vision characteristic data 55 when irradiating the laser light based on the input image data.

  In other words, when the output control unit 53 projects an image of a predetermined color gamut, the light source of each of RGB is projected based on the color vision characteristic data 55 so that the predetermined color gamut is projected as an image of another color gamut. Increase or decrease the light amount (output value) of the laser beam emitted from. The communication unit 54 communicates with other devices.

  Here, prior to the description of the color vision characteristic data 55, a mechanism for human beings to sense color will be described.

  There are two types of photoreceptors in the human eye's retina: a rod that works only in the dark and a cone that works only in bright places, and the cones are involved in color vision. There are three types of cones: L cones, M cones, and S cones.

  L cones are sensitive to red light in long wavelength sensitive cones. M cones are sensitive to green light in medium wavelength sensitive cones. S cones are sensitive to blue light in short wavelength sensitive cones.

  When three kinds of cones of L cone, M cone and S cone are aligned, it is said to be trichromatic. About 95% of Japanese men and 99% or more of women are included in trichromatic vision. In addition, among the three types of cones of L cone, M cone, and S cone, one color cone is not recognized and color is recognized only by two cones. It can be divided into type 1, type 2 and type 3 depending on which cones do not exist.

  Specifically, L cone lacks type 1 two color vision, M cone lacks type 2 two color vision, S cone lacks type 3 two color vision Call. In the following description, the user's color vision including type 1 dichroism, type 2 dichroism and type 3 dichroism is referred to as the user's color vision characteristics.

  In the present embodiment, when the user of the image projection apparatus 100 has any of 1 type 2 color vision, 2 type 2 color vision, and 3 type 2 color vision, color vision characteristic data 55 corresponding to the color vision characteristic of the user is used. The light amount of each of RGB emitted from the light source 111 is controlled and projected on the user's retina.

  The color vision characteristic data 55 of the present embodiment will be described below with reference to FIGS. 5 and 6. FIG. 5 is a diagram showing the color gamut of laser light in the xy chromaticity diagram and the color gamut defined by NTSC.

  In FIG. 5, a color gamut 501 indicates a range of colors that can be visually recognized by human eyes, a color gamut 502 indicates a color gamut defined by the National Television System Committee (NTSC), and the color gamut 503 indicates a laser. It shows the color gamut of light.

  The xy chromaticity diagram is an XYZ system of the CIE color system, which is represented by rectangular coordinates in which x in the chromaticity coordinates x, y and z is on the horizontal axis and y is on the vertical axis.

  In the xy chromaticity diagram, the color gamut 502 defined in NTSC is substantially similar to the color gamut of a liquid crystal display (LCD). Therefore, in the following description, the color gamut 502 indicates the color gamut of the liquid crystal display.

  As can be seen from FIG. 5, the color gamut 503 of the laser light is wider than the color gamut 502 of the LCD. That is, in the image projection apparatus 100 according to the present embodiment, an image in a wide color gamut can be viewed by the user as compared with a display device such as a liquid crystal display. In the present embodiment, paying attention to this point, the light amounts of the laser light of the three colors emitted from the light source 111 are controlled according to the color vision characteristic data 55 based on the color gamut 503.

  FIG. 6 is a diagram for explaining the relationship between color vision characteristics and color vision characteristics data. In FIG. 6, confusion lines are shown on the xy chromaticity diagram for each of the 1-type 2-color vision, the 2-type 2-color vision, and the 3-type 2-color vision.

  FIG. 6 (A) is a diagram showing a confusion line of type 1 two-color vision in the CIE chromaticity diagram, and FIG. 6 (B) is a diagram showing a confusion line of type 2 two-color vision in the CIE chromaticity diagram, FIG. 6C is a diagram showing a confusion line of type 3 two-color vision in the CIE chromaticity diagram.

  The confusion line will be described below. In the case of two-color vision, color distinction can not be made for specific color combinations. This indistinguishable color combination is called confusion color.

  If this confusion color is plotted on the xy chromaticity diagram, it is known that the colors perceived by the two color vision users to be the same color align in a straight line in the xy chromaticity diagram. This straight line is called a confused straight line.

  In the present embodiment, the confusion color in the image data is replaced with the color within the color gamut sandwiched between the confusion straight lines so that the user of bicolor vision can distinguish the confusion color.

  For example, as shown in FIG. 6A, the user of type 1 two color vision can not distinguish between the two colors plotted on the confusion line L11.

  Therefore, in the present embodiment, for example, the laser light of each of RGB is such that the color overlapping on the confusion line L11 is a color plotted on the straight line L21 in which the inclination of the confusion line L11 is changed in the xy chromaticity diagram. You may control the light quantity of.

  At this time, the straight line L21 may be, for example, a straight line having an angle that bisects the angle θ1 formed by the confusion straight line L11 and the confusion straight line L12 next to the confusion straight line L11.

  In the present embodiment, information indicating a function representing the straight line L21 may be held as the color vision characteristic data 55.

  Also, in this case, the memory unit 52 of the laser output control unit 50 performs color vision characteristic data on a function that indicates a line that bisects an angle formed between adjacent confusion lines for all confusion lines shown in FIG. 6A. You may hold as 55.

  In this embodiment, for example, it is assumed that the image represented by the image data input to the image projection apparatus 100 includes the pixel of the color G11 and the pixel of the color G12 plotted on the confusion straight line L11.

  In this case, for example, the laser output control unit 50 of the present embodiment increases or decreases the light amount of each of the RGB laser light emitted from the light source 111 so that the color G12 is projected as the color G21 deviated from the confusion line L12. . In this embodiment, by controlling the amount of light (output value) output from the light source 111 in this manner, two colors G11 and G12, which the user of type 1 two color vision could not distinguish, It can be distinguished as the color G11 and the color G21.

  Further, in this case, since the color G12 on the confusion line L11 is projected as the color G21 on the straight line L21 which is the farthest from each of the confusion line L11 and the confusion line L12 next to each other, The color G21 and the difference can be increased, and the colors can be easily distinguished.

  Furthermore, the color gamut 503 of the laser light includes a color gamut from red single light color to green single light color and a color gamut from red single light color to blue single light color. Therefore, in the present embodiment, the confusion color can be projected with a color that can not be represented by the LCD. In other words, according to the present embodiment, the color gamut to be replaced with the confusion color can be enlarged compared to the conventional case.

  For this reason, according to the present embodiment, it is possible to easily distinguish between a plurality of indistinguishable colors or a plurality of indistinguishable colors for the user.

  The same applies to the type 2 dichromatic vision shown in FIG. In this case, the storage unit 52 of the laser output control unit 50 is a function representing a straight line L41 equally dividing an angle θ2 formed by the confusion straight line L31 and the confusion straight line L32 as a part of the color vision characteristic data 55 corresponding to the type 2 two color vision. It may hold information indicating.

  The same applies to the type 3 two-color vision shown in FIG. In this case, the storage unit 52 of the laser output control unit 50 is a function representing a straight line L61 equally dividing the angle θ2 formed by the confusion straight line L51 and the confusion straight line L52 as a part of the color vision characteristic data 55 corresponding to the type 3 two color vision. It may hold information indicating.

  In the case of holding the color vision characteristic data 55 as the function described in FIG. 6, the laser output control unit 50 causes the color on the confusion straight line to be the color on the straight line indicated by the function held as the color perception characteristic data 55. The output values of the three color laser beams emitted from the light source 111 may be controlled.

  The color vision characteristic data 55 of the present embodiment may not be a function. The color vision characteristic data 55 of the present embodiment may be, for example, a table in which colors on the confusion line are associated with output values of RGB emitted from the light source 111.

  Further, the color vision characteristic data 55 is, for example, a predetermined value to be added to the value of x or y in the xy chromaticity diagram or a value to be subtracted from the value of x or y for the color on the confusion straight line It may be

  The color vision characteristic data 55 of the present embodiment may be information that corrects the RGB values of the colors plotted on the confusion line in the xy chromaticity diagram so as to be shifted from the confusion line.

  Below, with reference to FIG. 7, an example of the color vision characteristic data 55 is shown. FIG. 7 is a view showing an example of color vision characteristic data according to the first embodiment.

  The color vision characteristic data 55 shown in FIG. 7 is a table in which the confusion color is associated with the output value of each of the RGB light sources of the light source 111.

  In this table, for example, when projecting an image of color 1 which is a confusion color, the light amount (output value) of the laser light source emitting the red laser beam is set to “○”, and the green laser beam is emitted. Assuming that the light amount of the laser light source is “××” and the light amount of the laser light source emitting the blue laser light is “ΔΔ”, it indicates that the color 1 is projected as a color other than the confusion straight line There is.

  The unit of the light quantity is μW. Further, the value of the light amount included in the color vision characteristic data 55 shown in FIG. 7 is a value conforming to Class I of IEC60825-1.

  Next, the operation of the laser output control unit 50 of the present embodiment will be described with reference to FIG. FIG. 8 is a flow chart for explaining the operation of the laser output control unit of the first embodiment.

  The laser output control unit 50 according to the present embodiment determines whether the image input unit 51 receives an input of image data (step S801). In step S801, when the image data is not input, the laser output control unit 50 stands by until the image data is input.

  In step S801, when image data is input, the laser output control unit 50 causes the output control unit 53 to read out the color sense characteristic data 55 held in the storage unit 52 (step S802).

  Subsequently, the output control unit 53 causes the image to be projected on the user's retina while controlling the output value of each of the RGB laser light sources according to the color vision characteristic data 55 (step S803), and ends the processing.

  As described above, the laser output control unit 50 according to the present embodiment causes the light amount of the laser light emitted from the light source 111 of the laser irradiation unit 60 to be a value according to the color perception characteristics of the user of the image projection apparatus 100. To control the user's retina.

  Therefore, according to the image projection apparatus 100 of the present embodiment, the luminance of the image is not reduced according to the color perception characteristics of the user, and the influence of the intermediate light transmitting member which is the user's anterior eye part is eliminated. In addition, by projecting an image on the retina in a color that is easy for the user to visually recognize, it is possible to perform identification assistance of the user's color.

  Further, the image projection apparatus 100 according to the present embodiment may be shaped like glasses or goggles, and a camera may be provided to pick up an image in the direction of the line of sight of the user. In that case, the image data received by the image input unit 51 may be image data of an image captured by a camera, and the image projection apparatus 100 converts the image data into an image light beam and applies it to the user's retina. It may be projected.

  Also, the image input unit 51 may receive, for example, image data output from an external device, and the image projection apparatus 100 converts the image data into an image light beam and projects the light beam onto the user's retina. good.

  The external device may be a video device such as a video or a television, or a terminal device such as a smartphone. The external device may be any device as long as it outputs image data (moving image data, still image data).

  In this embodiment, by using such a configuration, an image displayed around the user's line of sight, an image displayed on a video, a smartphone, etc. is projected onto the retina in a color that is easy for the user to visually recognize. It is possible to provide an image projection apparatus capable of performing wearable color identification assistance.

Second Embodiment
The second embodiment will be described below with reference to the drawings. The second embodiment is different from the first embodiment only in that the image projection device 100 receives color vision characteristic data selected in an external terminal device. Therefore, in the following description of the second embodiment, only differences from the first embodiment will be described, and components having the same functional configuration as the first embodiment will be described in the first embodiment. The same code as the used code is given and the explanation is omitted.

  FIG. 9 is a diagram showing an example of the image projection system of the second embodiment. An image projection system 200 according to the present embodiment includes an image projection device 100 and a terminal device 300.

  In the image projection system 200 of the present embodiment, the terminal device 300 holds color vision characteristic data corresponding to a plurality of color vision characteristics including, for example, type 1 dichroism, type 2 dichroism, and type 3 dichroism. A list of color vision characteristics is displayed on the operation device 301. Then, the terminal device 300 outputs color vision characteristic data corresponding to the color vision characteristic selected in the list to the image projection device 100.

  FIG. 10 is a diagram for explaining the function of each device of the image projection system. The terminal device 300 included in the image projection system 200 includes a processor such as a central processing unit (CPU), a memory device such as a random access memory (RAM) and a read only memory (ROM), and a display operation device 301 such as a touch panel.

  The terminal device 300 according to this embodiment includes a display control unit 310, a storage unit 311, and a communication unit 312.

  The display control unit 310 causes the display operation device 301 to display a list of color vision characteristics, for example. The storage unit 311 holds color vision characteristic data 55A for each color vision characteristic. The communication unit 312 communicates with an external device.

  Below, with reference to FIG. 11, the example of the color vision characteristic data 55A which the memory | storage part 311 of the terminal device 300 has hold | maintained is shown. FIG. 11 is a view showing an example of color vision characteristic data according to the second embodiment.

  The color vision characteristic data 55A of the present embodiment includes color vision characteristic data associated with each color perception characteristic. The color vision characteristic data 55A shown in FIG. 11 are, for example, color vision characteristic data 55-1 corresponding to 1 type 2 color vision, color vision characteristic data 55-2 corresponding to 2 type 2 color vision, and color vision characteristic data corresponding to 3 type 2 color vision 55-3.

  As described above, in the present embodiment, the terminal device 300 holds color vision characteristic data for each color perception characteristic. Therefore, according to the present embodiment, color vision characteristic data corresponding to the color vision characteristic selected in the list of color vision characteristics displayed on the terminal device 300 is transmitted to the image projector 100, and stored in the storage unit 52 of the image projector 100. It can be held.

Third Embodiment
The third embodiment will be described below with reference to the drawings. The third embodiment is different from the first and second embodiments in that color vision characteristic data can be adjusted by the user. Therefore, in the following description of the third embodiment, only differences from the first embodiment will be described, and for those having the same functional configuration as the first embodiment, the description of the first embodiment The same reference numerals as the reference numerals used in FIG.

  FIG. 12 is a diagram for explaining an image projection apparatus according to the third embodiment.

  The image projection apparatus 100A of the present embodiment is installed on, for example, a pedestal 20 or the like, and adjustment (correction) of color vision characteristic data is performed in a state where the user P approaches the eyeball so as to look into the image projection apparatus 100A. It will be. Although the example in FIG. 12 shows an example in which the user P sits on a chair and uses the image projection apparatus 100A, the present invention is not limited to this. The user P may use the image projection device 100A in a standing state.

  The image projection apparatus 100A of the present embodiment holds color vision characteristic data for each color vision characteristic, and the R output value, the G output value, and the like that are associated with the confusion color in the color vision characteristic data according to the user's operation. B Change the output value.

  The hardware configuration of the image projection apparatus 100A of the present embodiment will be described below with reference to FIG. FIG. 13 is a diagram for explaining the hardware configuration of the image projection apparatus according to the third embodiment.

  The image projection apparatus 100A of the present embodiment includes a communication unit 20, a control unit 30, a storage unit 40, a laser output control unit 50, a laser irradiation unit 60, an input unit 70, and an output unit 80.

  The communication unit 20 is a communication device for communicating the image projection device 100A with an external device. Specifically, for example, the communication unit 20 communicates with the terminal device 1 via a network or the like. The communication method by the communication unit 20 may be any method as long as the image projection device 100A and the external device can communicate.

  The terminal device 1 may be provided, for example, in a medical institution or the like, or may be disposed in a store that provides the glasses-type image projection device 100 described in the first embodiment. The communication unit 20 may communicate with, for example, the glasses-type image projection apparatus 100 described in the first embodiment.

  The control unit 30 is, for example, an arithmetic processing unit or the like, and controls the entire operation of the image projection apparatus 100A of the present embodiment.

  The storage unit 40 stores a program executed by the control unit 30, various values acquired by calculation, and the like. In addition, the storage unit 40 may store image data of an image used for color adjustment for each color perception characteristic. Furthermore, the storage unit 40 may store the adjusted color vision characteristic data adjusted by the user together with the information specifying the user.

  The input unit 70 is for inputting various types of information to the image projection apparatus 100A. Specifically, for example, the input unit 70 is an input device operated by the user when adjusting the color to be projected instead of the confusion color, and, for example, a keyboard or the like on which arrows in the vertical and horizontal directions are printed , Joystick and the like are preferable.

  If the input unit 70 has such a configuration, it is possible to change the density, the saturation, and the like by pressing the keyboard or tilting the joystick in color adjustment.

  In addition, since the user P places his eyes on the laser irradiation unit 60, it is not efficient to remove the eyes from the laser irradiation unit 60 in order to look at the input unit 70. For this reason, if the input unit 70 is a keyboard, it is preferable to be able to dispose an operation unit that shows up, down, left, and right. Furthermore, it is more preferable to provide a projection or the like on the keyboard so that input can be made without looking at the keyboard. Furthermore, it is more preferable if the input unit 70 is a joystick.

  The output unit 80 is for outputting various types of information from the image projection apparatus 100A. Specifically, for example, the output unit 80 may be one for storing color vision characteristic data after adjusting a color to be substituted for the confusion color in the storage unit 40 or writing it out to a recording medium or the like. Further, the output unit 80 may be a display for displaying a list screen for selecting the color vision characteristic of the user.

  Next, the function of the image projection apparatus 100A of the present embodiment will be described. FIG. 14 is a diagram for explaining the function of the image projection apparatus of the third embodiment.

  Each unit illustrated in FIG. 14 is realized by the control unit 30 reading and executing a program stored in the storage unit 40.

  The image projection apparatus 100A of the present embodiment includes an input receiving unit 131, a display control unit 132, an adjustment image data output unit 133, a color vision characteristic data generation unit 134, and a data storage unit 135.

  The input receiving unit 131 receives an input of information from the input unit 70 or the like. The display control unit 132 controls display on a display that is the output unit 80.

  The adjustment image data output unit 133 reads from the data storage unit 135 the adjustment image data corresponding to the color vision characteristic selected in the list of color vision characteristics displayed on the display, and passes the read data to the laser output control unit 50.

  The color vision characteristic data generation unit 134 changes the R output value, the G output value, and the B output value of each color included in the adjustment image data according to the operation received by the input reception unit 131, and changes the R output value after the change. The user-specific color sense characteristic data including the G output value and the B output value is generated and stored in the data storage unit 135.

  The data storage unit 135 stores the adjustment image data 56 and the user-specific color sense characteristic data 57.

  The adjustment image data 56 of the present embodiment may be provided, for example, for each color perception characteristic. Further, the adjustment image data may be a gradation image or the like represented by colors on a straight line other than the confusion line shown in FIG.

  Specifically, for example, when the color vision characteristic is type 1 bicolor vision, the data storage unit 135 uses the color plotted on the straight line L21 of FIG. 6A as a part of the adjustment image data 56. It may hold an image of gradation to be expressed.

  Further, for example, when the color vision characteristic is type 2 dichromatic, the data storage unit 135 is represented by a color plotted on a straight line L41 shown in FIG. 6B as a part of the adjustment image data 56. Can hold an image of

  Next, with reference to FIG. 15, the operation of the image projection apparatus 100A of the present embodiment will be described. FIG. 15 is a flow chart for explaining the operation of the image projection apparatus of the third embodiment.

  In the image projection apparatus 100A of the present embodiment, the input receiving unit 131 determines whether the input of the user information has been received (step S1501). When the user information is not accepted in step S1501, the image projection apparatus 100A stands by. The user information may be any information that identifies the user, and may be, for example, the name of the user, or identification information (user ID) of the user.

  In step S1501, when the input of user information is accepted, the image projection apparatus 100A causes the output unit 80 to display a list of color vision characteristics (step S1502). Although not shown, information indicating a list of color vision characteristics may be held in the storage unit 40.

  Subsequently, the image projection apparatus 100A determines, by the input receiving unit 131, whether or not the selection of the color vision characteristic has been received (step S1503). In step S1503, when the selection of the color vision characteristic is not received, the image projection apparatus 100A waits until the selection is received.

  In step S1503, when the selection of the color vision characteristics is received, the image projection device 100A causes the adjustment image data output unit 133 to read out the adjustment image data corresponding to the selected color perception characteristics, and outputs it to the laser output control unit 50. The laser output control unit 50 causes the adjustment image data to be projected on the user's retina (step S1504).

  Subsequently, the image projection apparatus 100A determines, with the input receiving unit 131, whether or not an operation for adjusting the color has been received (step S1505). In step S1505, when the color adjustment is not received, the image projection apparatus 100A proceeds to step S1508 described later.

  In step S1505, when color adjustment is received, the image projection apparatus 100A notifies the laser output control unit 50 of the contents of the adjustment, and the output control unit 53 responds to the operation of the output value of each of the RGB laser light sources. The output value is changed (step S1506).

  Subsequently, the image projection apparatus 100A determines whether the color adjustment is completed (step S1507). Specifically, the image projection apparatus 100 </ b> A may determine whether the adjustment has ended, based on whether an operation indicating the end of the adjustment has been received.

  In step S1507, when the adjustment is not completed, the image projection device 100A returns to step S1505. In step S1507, when the adjustment is completed, the image projection device 100A causes the color vision characteristics data generation unit 134 to associate color confusion characteristics with color perception characteristics data in which each color of the adjustment image data is associated with the corresponding RGB output value. The user-specific color sense characteristic data 57 to which the user information is added is generated and stored in the data storage unit 135 (step S1508), and the process is ended.

  The image projection apparatus 100A of the present embodiment may directly transmit the user-specific color sense characteristic data 57 stored in the data storage unit 135 to the image projection apparatus 100 described in the first embodiment.

  As described above, according to the present embodiment, color vision characteristic data can be generated for each user.

  As mentioned above, although this invention was demonstrated based on each embodiment, this invention is not limited to the requirements shown to the said embodiment. These points can be modified without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

DESCRIPTION OF SYMBOLS 50 Laser output control part 51 Image input part 52 Memory | storage part 53 Output control part 55 Color vision characteristic data 60 Laser irradiation part 100, 100A Image projection apparatus 200 Image projection system 300 Terminal device

Claims (8)

A storage unit in which color vision characteristic data is stored;
A plurality of laser light sources for generating an imaging laser beam based on image data;
A laser irradiation unit for projecting an image onto a retina of a user's eye by the image laser beam;
A laser output control unit that individually controls the light amount of the laser light output from the plurality of laser light sources based on the color vision characteristic data;
An optical member for causing the imaging laser beam to converge in the eye of the user;
A retinal scanning image projector having: The image data is
Image data of an image obtained by imaging the user's gaze direction by a camera or image data input from an external device;
An image input unit that receives an input of the image data;
The retinal scanning image projector according to claim 1, which is wearable in the shape of glasses. The color vision characteristic data is
The retina scan according to claim 2, wherein the data is data in which the color of the confusion line corresponding to the color vision characteristic of the user on the chromaticity diagram is associated with the light amount of the laser light output from the plurality of laser light sources. Image projector. The light quantity of the laser beam output from the plurality of laser light sources is
The retinal scanning image projector according to claim 3, wherein the light quantity is a color other than the confusion straight line and projects an image of a color gamut represented by laser light emitted from the plurality of laser light sources. . It has an input unit that accepts user input operations,
The retinal scanning image projector according to any one of claims 1 to 4, wherein the color of the projected image is adjusted by an input operation from the input unit. It has a communication unit that communicates with external devices,
The retinal scanning image projector according to any one of claims 1 to 5, wherein the color vision characteristic data is acquired from the external device via the communication unit. A retinal scanning image projection method by a retinal scanning image projector, wherein the retinal scanning image projector is
Generating a laser beam for imaging based on image data by a plurality of laser light sources;
A procedure of projecting an image onto the retina of the eyeball of the user by the laser beam for image by the laser irradiation unit;
A procedure for individually controlling the light amount of the laser beam output from the plurality of laser light sources based on the color vision characteristic data stored in the storage unit;
And b. Focusing the imaging laser beam in the eye of the user by an optical member. What is claimed is: 1. A retinal scanning image projection system comprising a retinal scanning image projector and a terminal device, comprising:
The terminal device is
A storage unit in which color vision characteristic data for each color vision characteristic is stored;
A display control unit that displays a list of the color vision characteristics on a display unit;
A communication unit that outputs color vision characteristic data corresponding to the color vision characteristic selected in the list to the retinal scanning image projector;
The retina scanning image projector
A storage unit that stores the color vision characteristic data output from the terminal device;
A plurality of laser light sources for generating an imaging laser beam based on image data;
A laser irradiation unit for projecting an image onto a retina of a user's eye by the image laser beam;
A laser output control unit that individually controls the light amount of the laser light output from the plurality of laser light sources based on the color vision characteristic data;
An optical member for causing the imaging laser beam to converge in the eye of the user;
A retinal scanning image projection system.

Images