JP7133163B2 - Retinal scanning image projection device, Retinal scanning image projection method, Retinal scanning image projection system - Google Patents

Description

The present invention relates to a retinal scanning image projection apparatus, a retinal scanning image projection system, and a retinal scanning image projection method.

Conventionally, there are several means of improving the visibility of patients with color blindness. As one of such means, spectacle lenses having spectral curves capable of widening the color discrimination ability are known. As another means, a display device such as an LCD (Liquid Crystal Display) that changes the characteristics of each color of image data to be displayed and displays an image whose hue is corrected so that the colors can be easily identified is known. .

JP-A-2002-303832 JP 2014-165768 A

Since the conventional spectacle lenses described above are optical filters, they can only reduce light. Therefore, when they are worn, the field of view becomes dark and it becomes difficult to visually recognize them. In addition, since the wavelength distribution itself of the light source to be visually recognized is not separated in conventional spectacle lenses, it is difficult to realize highly accurate spectroscopy.

In addition, in the display device described above, the displayed image reaches the retina through the intermediate translucent body, which is the anterior segment of the eyeball, and therefore depends on optical characteristics such as chromatic aberration of the cornea and lens of the anterior segment of the eye. . Therefore, the corrected hue may not necessarily match the user's color vision characteristics.

The disclosed technique has been made in view of the circumstances described above, and aims to improve the accuracy of color discrimination by a user.

According to the disclosed technique, a plurality of laser light sources that generate image laser beams having a wider color gamut than the color gamut defined by the NTSC standard based on image data, and the image laser beams enable a user to A laser irradiation unit that projects an image onto the retina of the eyeball, a storage unit that stores color vision characteristic data based on a color gamut wider than the color gamut defined by the NTSC standard, and output from the plurality of laser light sources A retinal scanning image projection device comprising: a laser output control unit that individually controls the amount of laser light based on the color vision characteristics data; and an optical member that converges the imaging laser beam within the user's eyeball. It is a device.

It is possible to improve the accuracy of color discrimination by the user.

It is a figure explaining the structure of the image projection apparatus of 1st embodiment. It is the figure which expanded the projection mirror vicinity of an image projector. It is a figure explaining vibration of a scanning mirror. It is a figure explaining the function of the laser output control part of 1st embodiment. It is a figure which shows the color gamut of the laser beam in an xy chromaticity diagram, and the color gamut defined by NTSC. It is a figure explaining the relationship between a color vision characteristic and color vision characteristic data. It is a figure which shows an example of the color vision characteristic data of 1st embodiment. 4 is a flowchart for explaining the operation of the laser output control section of the first embodiment; It is a figure which shows an example of the image projection system of 2nd embodiment. FIG. 3 is a diagram for explaining the functions of each device of the image projection system; It is a figure which shows an example of the color vision characteristic data of 2nd embodiment. It is a figure explaining the image projection apparatus of 3rd embodiment. It is a figure explaining the hardware constitutions of the image projection apparatus of 3rd embodiment. It is a figure explaining the function of the image projection apparatus of 3rd embodiment. 9 is a flowchart for explaining the operation of the image projection device of the third embodiment;

(First embodiment)
A first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram for explaining the configuration of the image projection device of the first embodiment.

In FIG. 1, the image projection device 100 of this embodiment uses Maxwell's vision. Maxwell's vision is based on image data, and by converging light rays for imaging once at the center of the pupil and projecting them onto the retina, the image represented by the image data can be seen by the human eye without being affected by the accommodation function of the human lens. It is a method of visual recognition.

The image projection device 100 of this embodiment has a laser output control section 50 and a laser irradiation section 60 . The laser output control unit 50 controls irradiation of laser light by the laser irradiation unit 60 . Note that the image projection device 100 of this embodiment may be shaped like general eyeglasses or goggles, for example.

The laser irradiation unit 60 has a projection unit 110 , eyeglass-shaped frame temples 150 , and lenses 151 . The projection section 110 has a light source 111 , a scanning mirror 112 , a reflecting mirror 115 and a projection mirror 116 .

Light source 111 is arranged on temple 150 . The light source 111 emits, for example, a light beam L with a single wavelength or multiple wavelengths under the control of the laser output controller 50 . This light ray L is an imaging light ray for projecting an image onto the retina 161 of the user's eyeball 160 . In the following description, the ray L will be referred to as the imaging ray.

The light source 111 has three color laser light sources of R, G, and B. For example, red (R) laser light (wavelength: about 610 nm to 660 nm), green (G) laser light (wavelength: about 515 nm to 540 nm), and blue (B) laser light (wavelength: about 440 nm to 480 nm). It emits red, green, and blue laser light. The light source 111 of this embodiment is realized by, for example, a light source in which a laser diode chip for each of RGB (red, green, blue), a three-color synthesizing device, and a microcollimating lens are integrated. The output value of is variable.

In FIG. 1, the direction in which a light beam incident on the projection mirror 116 travels in the projection mirror 116 is the X direction, and the direction perpendicular to the X direction on the projection mirror 116 is the Y direction.

Scanning mirror 112 is located on temple 150 . The scanning mirror 112 is, for example, a MEMS (Micro Electro Mechanical Systems) mirror, and scans the laser light (light beam) L emitted from the light source 111 in two-dimensional directions of horizontal and vertical directions. Also, the scanning mirror 112 two-dimensionally scans the light beam L emitted from the light source 111 and converts it into projection light for projecting an image onto the retina 161 of the user's eyeball 160 .

Reflecting mirror 115 reflects light beam L scanned by scanning mirror 112 toward lens 151 .

A projection mirror 116 having a free-form surface is provided on the surface of the lens 151 on the side of the user's eyeball 160 . The projection mirror 116 projects an image onto the retina 161 of the eyeball 160 by irradiating the retina 161 of the eyeball 160 with the light beam L scanned by the scanning mirror 112 and reflected by the reflecting mirror 115 . In other words, the user can recognize an image by the afterimage effect of the laser light projected onto the retina 161 . The projection mirror 116 is designed so that the convergence position of the light beam L scanned by the scanning mirror 112 is the pupil 162 of the eyeball 160 . The light ray L enters the projection mirror 116 almost sideways (that is, almost from the -X direction).

In this embodiment, if the curvature of the free-form surface of the projection mirror 116 is increased, the distance from the reflection mirror 115 to the convergence position of the pupil 162 can be shortened, and the image projection apparatus 100 can be made compact. .

The laser output control unit 50 of this embodiment is implemented by a processor such as a CPU (Central Processing Unit) and a memory device such as a RAM (Random Access Memory) and a ROM (Read Only Memory).

The processor and memory may be mounted, for example, on the same substrate on which the scanning mirror 112 (MEMS mirror) is mounted.

The laser output control unit 50 of this embodiment causes the light source 111 to emit an imaging light beam based on the input image data. Further, the laser output control unit 50 of the present embodiment vibrates the scanning mirror 112 (MEMS mirror) to scan the imaging light beam emitted from the light source 111 and project an image on the retina 161 .

In addition, the laser output control unit 50 of the present embodiment holds color vision characteristic data corresponding to the color vision characteristic of the user of the image projection device 100. Based on this color vision characteristic data, each of RGB included in the light source 111 is Controls the output value (light intensity) of the light source. The details of the laser output control unit 50 and the color vision characteristic data will be described later.

Although the example of FIG. 1 shows the projection unit 110 corresponding to one eye, the image projection apparatus 100 has the projection units 110 corresponding to both eyes. These two projection units 110 are of similar construction.

Next, projection of an image by the projection unit 110 of the image projection device 100 will be described with reference to FIGS. 2 and 3. FIG. FIG. 2 is an enlarged view of the vicinity of the projection mirror of the image projection device.

As shown in FIGS. 2 and 3, the imaging light beam scanned by the scanning mirror 112 is reflected by the mirror 115 toward the lens 151 . In this embodiment, the projection unit 110 is arranged on the surface of the lens 151 on the eyeball 160 side, so the imaging light beam scanned by the scanning mirror 112 enters the projection unit (projection mirror) 116 .

The projection unit 116 is a half mirror having a free-form curved surface or a combined structure of a free-form curved surface and a diffractive surface in a region 116a where the imaging light beam is incident. As a result, the imaging light rays incident on the projection unit 116 are projected onto the retina 161 after being converged in the vicinity of the pupil 162 of the eyeball 160 .

Therefore, the user can recognize the image formed by the imaging light beam.

FIG. 3 is a diagram for explaining vibration of the scanning mirror. Note that FIG. 3 shows the case where the scanning mirror 112 oscillates from point A to point B. As shown in FIG.

As a method of projecting an image onto the retina 161 by scanning the image light beams with the scanning mirror 112, light is scanned at high speed from the upper left to the lower right of the image projection area to display the image (for example, raster scan). ).

In this embodiment, as shown in FIG. 3, the scanning mirror 112 is larger than the area H (broken line area in FIG. 3) where the image is projected on the retina 161 in order to scan the imaging light beam (light beam L). , in a horizontal direction (first direction) and a vertical direction (second direction crossing the first direction). In FIG. 3, the vibration of scanning mirror 112 is indicated by reference numeral 61 .

When an image is projected onto the retina 161 by scanning the imaging light beam at a location where the scanning mirror 112 has largely swung, the distortion of the image increases. Therefore, in this embodiment, the imaging light beam is scanned at a location where the deflection of the scanning mirror 112 is small.

Although FIG. 3 shows an example in which the imaging light beam is scanned in a rectangular shape, the image light beam is not limited to this case, and may be scanned in a trapezoidal shape or other cases.

Further, in this embodiment, it is preferable that the area H onto which the image is projected has a size that covers the user's visual field. The size that covers the user's field of view is, for example, the size that the image projected on the retina covers about 60 degrees on the nose side and upper side, about 70 degrees on the lower side, and about 90 to 100 degrees on the ear side in one eye. is.

It should be noted that for a user or the like who is known in advance to have a defect in a part of the visual field, the area H where the image is projected is approximately 60 degrees on the nasal side and upper side of one eye, and about 60 degrees on the lower side. It may be smaller than "a size that covers about 70 degrees to the ear side and about 90 to 100 degrees to the ear side."

Next, the laser output control section 50 of this embodiment will be described with reference to FIG. FIG. 4 is a diagram for explaining the function of the laser output control section of the first embodiment.

The laser output control section 50 of this embodiment has an image input section 51 , a storage section 52 , an output control section 53 and a communication section 54 . These units are implemented by the CPU and memory device of the laser output control unit 50 .

The image input unit 51 receives input of image data via the communication unit 54 . The storage unit 52 holds color vision characteristic data 55 . For example, when the user of the image projection apparatus 100 is determined, the laser output control unit 50 of the present embodiment acquires the color vision characteristic data 55 corresponding to the color vision characteristic of the user, and causes the storage unit 52 to store the data. can be In addition, the laser output control unit 50 may receive the color vision characteristic data 55 from an external device via the network and the communication unit 54 and store it in the storage unit 52, or read it from a portable recording medium or the like and store it. You may make it hold|maintain at the part 52. FIG.

The output control unit 53 controls the output value of the laser light emitted from each of the RGB light sources based on the color vision characteristic data 55 when irradiating the laser light based on the input image data.

In other words, when projecting an image of a predetermined color gamut, the output control unit 53 controls the RGB light sources so that the predetermined color gamut is projected as an image of another color gamut based on the color vision characteristic data 55. increases or decreases the light intensity (output value) of the laser light emitted from the . The communication unit 54 communicates with other devices.

Here, before explaining the color vision characteristic data 55, the mechanism by which humans perceive colors will be explained.

In the retina of the human eye, there are two types of photoreceptor cells, rods that work only in darkness and cones that work only in bright light, and cone cells are involved in color vision. There are three types of cones: L cones, M cones, and S cones.

L-cones are long-wavelength sensitive cones that respond sensitively to red light. M cones are medium-wavelength sensitive cones that respond sensitively to green light. The S cone is a short-wavelength sensitive cone that responds sensitively to blue light.

The presence of three types of cones, the L, M, and S cones, is called trichromacy, and approximately 95% of Japanese men and more than 99% of Japanese women are included in trichromacy. In addition, when one of the three types of cones (L-, M-, and S-cones) does not possess any one type of cone and only two types of cones are used to perceive colors, dichromacy is defined as dichromacy. It is classified into type 1, type 2, and type 3 depending on which cone is absent.

Specifically, lack of L cones is defined as type 1 dichromacy, deficiency of M cones is defined as type 2 dichromacy, and deficiency of S cones is defined as type 3 dichromacy. call. In addition, in the following description, the user's color vision including type 1 dichromacy, type 2 dichromacy, and type 3 dichromacy will be referred to as the user's color vision characteristics.

In the present embodiment, when the user of the image projection device 100 has any of type 1, 2, and 3, the color vision characteristic data 55 corresponding to the color vision characteristic of the user is used. , controls the amount of light of each of RGB emitted from the light source 111, and projects it onto the user's retina.

The color vision characteristic data 55 of this embodiment will be described below with reference to FIGS. 5 and 6. FIG. FIG. 5 is a diagram showing the color gamut of laser light in the xy chromaticity diagram and the color gamut defined by NTSC.

In FIG. 5, a color gamut 501 indicates the range of colors visible to the naked eye, a color gamut 502 indicates a color gamut defined by the NTSC (National Television System Committee), and a color gamut 503 indicates a laser range. It shows the color gamut of light.

The xy chromaticity diagram is the XYZ system of the CIE color system, and is represented by rectangular coordinates in which x is the horizontal axis and y is the vertical axis in the chromaticity coordinates x, y, and z.

In the xy chromaticity diagram, the NTSC-defined color gamut 502 is nearly identical to the color gamut of a liquid crystal display (LCD). Therefore, in the following description, the color gamut 502 indicates the color gamut of the liquid crystal display.

As can be seen from FIG. 5, the color gamut 503 of the laser light is wider than the color gamut 502 of the LCD. In other words, the image projection apparatus 100 of the present embodiment allows the user to visually recognize an image with a wider color gamut than a display apparatus such as a liquid crystal display. Focusing on this point, the present embodiment controls the amount of three-color laser light emitted from the light source 111 according to the color vision characteristics data 55 based on the color gamut 503 .

FIG. 6 is a diagram for explaining the relationship between color vision characteristics and color vision characteristics data. In FIG. 6, confusion straight lines are shown on the xy chromaticity diagram for each of protanopia, protanopia, and trichromacy.

FIG. 6 (A) is a diagram showing a confusion straight line for type 1 dichromacy in the CIE chromaticity diagram, and FIG. 6 (B) is a diagram showing a confusion straight line for type 2 dichromacy in the CIE chromaticity diagram, FIG. 6C is a diagram showing a confusion straight line for type 3 dichromacy in the CIE chromaticity diagram.

The confusion straight line will be explained below. In the case of dichromacy, color discrimination is not possible for certain color combinations. These indistinguishable color combinations are called mixed colors.

When the confused colors are plotted on an xy chromaticity diagram, it is known that colors that are perceived as the same by a user with dichromacy line up on a straight line on the xy chromaticity diagram. This straight line is called a confusion straight line.

In the present embodiment, by replacing the confused colors in the image data with the colors within the color gamut between the confusion straight lines, a user with dichromacy can distinguish between the confused colors.

For example, a user with type 1 dichromacy cannot distinguish two colors plotted on the confusion line L11 as shown in FIG. 6(A).

Therefore, in the present embodiment, for example, the colors overlapping the confusion straight line L11 are the colors plotted on the straight line L21 obtained by changing the slope of the confusion straight line L11 in the xy chromaticity diagram. may be controlled.

At this time, the straight line L21 may be, for example, a straight line having an angle that bisects the angle θ1 formed by the confusion straight line L11 and the confusion straight line L12 adjacent to the confusion straight line L11.

In this embodiment, information indicating a function representing this straight line L21 may be held as the color vision characteristic data 55. FIG.

Further, in this case, the storage unit 52 of the laser output control unit 50 stores a function indicating a straight line that bisects the angle formed by the adjacent confusion straight line with respect to all the confusion straight lines shown in FIG. 55 may be retained.

In this embodiment, for example, it is assumed that an image represented by image data input to the image projection device 100 includes pixels of color G11 and pixels of color G12 plotted on the confusion line L11.

In this case, the laser output control unit 50 of the present embodiment increases or decreases the light amount of each of the RGB laser beams emitted from the light source 111 so that, for example, the color G12 is projected as the color G21 deviated from the confusion straight line L12. . In the present embodiment, by controlling the amount of light (output value) output from the light source 111 in this way, the two colors G11 and G12, which cannot be distinguished by a user with protanopia, are They can be distinguished as a color G11 and a color G21.

Also, in this case, the color G12 on the confusion straight line L11 is projected as the color G21 on the straight line L21 that is farthest from the confusion straight line L11 and the confusion straight line L12, which are adjacent to each other. The difference from the color G21 can be increased, and the colors can be easily distinguished.

Furthermore, the color gamut 503 of the laser light includes a color gamut from a single red color to a single green color and a color gamut from a single red color to a single blue color. Therefore, in this embodiment, mixed colors can be projected in colors that could not be represented by an LCD. In other words, according to the present embodiment, the color gamut that can be replaced with the confused color can be enlarged compared to the conventional art.

Therefore, according to the present embodiment, a plurality of colors that are indistinguishable or difficult for a user to distinguish can be easily distinguished.

The same applies to type 2 dichromacy shown in FIG. 6(B). In this case, the storage unit 52 of the laser output control unit 50 stores, as a part of the color vision characteristic data 55 corresponding to type 2 dichromacy, a function representing a straight line L41 that equally divides the angle θ2 formed by the confusion straight line L31 and the confusion straight line L32. You may hold the information which shows.

The same applies to type 3 dichromacy shown in FIG. 6(C). In this case, the storage unit 52 of the laser output control unit 50 stores, as a part of the color vision characteristic data 55 corresponding to dichromacy type 3, a function representing a straight line L61 that equally divides the angle θ2 formed by the confusion straight line L51 and the confusion straight line L52. You may hold the information which shows.

When the color vision characteristic data 55 is held as the function described with reference to FIG. 6, the laser output control unit 50 adjusts the color on the confusion straight line to the color on the straight line indicated by the function held as the color vision characteristic data 55. Second, the output values of the three-color laser beams emitted from the light source 111 may be controlled.

Incidentally, the color vision characteristic data 55 of this embodiment may not be a function. The color vision characteristic data 55 of the present embodiment may be, for example, a table that associates colors on the confusion straight line with output values of RGB emitted from the light source 111 .

The color vision characteristic data 55 is, for example, a predetermined value to be added to the x value or the y value in the xy chromaticity diagram or a predetermined value to be subtracted from the x value or the y value for the color on the confusion straight line. can be

The color vision characteristic data 55 of the present embodiment may be information that corrects the RGB values of colors plotted on the confusion straight line in the xy chromaticity diagram so as to deviate from the confusion straight line.

An example of the color vision characteristic data 55 is shown below with reference to FIG. FIG. 7 is a diagram showing an example of color vision characteristic data according to the first embodiment.

The color vision characteristic data 55 shown in FIG. 7 is a table that associates confused colors with the output values of the respective RGB light sources of the light source 111 .

In this table, for example, when projecting an image of color 1, which is a mixed color, the light amount (output value) of the laser light source that emits red laser light is set to "○○", and green laser light is emitted. If the amount of light from the laser light source is "xx" and the amount of light from the blue laser light source is "△△", then color 1 is projected as a color other than the colors on the confusion straight line. there is

Note that the unit of the value of the light amount is μW. Also, the values of the light amounts included in the color vision characteristics data 55 shown in FIG. 7 are values conforming to Class I of IEC60825-1.

Next, referring to FIG. 8, the operation of the laser output control section 50 of this embodiment will be described. FIG. 8 is a flow chart for explaining the operation of the laser output control section of the first embodiment.

The laser output control unit 50 of this embodiment determines whether or not the image input unit 51 has received an input of image data (step S801). In step S801, if image data is not input, the laser output control unit 50 waits until image data is input.

When image data is input in step S801, the laser output control unit 50 causes the output control unit 53 to read out the color vision characteristic data 55 held in the storage unit 52 (step S802).

Subsequently, the output control unit 53 projects an image onto the retina of the user while controlling the output values of the respective RGB laser light sources according to the color vision characteristic data 55 (step S803), and ends the process.

As described above, the laser output control unit 50 of the present embodiment sets the light amount of the laser light emitted from the light source 111 of the laser irradiation unit 60 to a value corresponding to the color vision characteristic of the user of the image projection device 100. to illuminate the user's retina.

Therefore, according to the image projection apparatus 100 of the present embodiment, the brightness of the image is not lowered, and the intermediate translucent body, which is the anterior segment of the user, is not affected by the color vision characteristics of the user. In addition, by projecting an image onto the retina in colors that are easy for the user to visually recognize, it is possible to assist the user in identifying colors.

Further, the image projection device 100 of the present embodiment may be shaped like glasses or goggles, and may be provided with a camera that captures an image in the line-of-sight direction of the user. In this case, the image data received by the image input unit 51 may be image data of an image captured by a camera. You can project.

Further, the image input unit 51 may receive, for example, image data output from an external device, and the image projection device 100 may convert this image data into image light rays and project them onto the user's retina. good.

The external device may be a video device such as a video or television, or may be a terminal device such as a smart phone. The external device may be any device as long as it outputs image data (moving image data, still image data).

In this embodiment, by adopting such a configuration, surrounding images including the direction of the user's line of sight, images displayed on videos, smartphones, etc. can be projected onto the retina in colors that are easy for the user to see. It is possible to provide an image projection device having a wearable color identification assisting function.

(Second embodiment)
A second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment only in that the image projection device 100 receives color vision characteristic data selected by an external terminal device. Therefore, in the following description of the second embodiment, only differences from the first embodiment will be described, and those having the same functional configuration as the first embodiment will be described in the first embodiment The same reference numerals as the used reference numerals are given, and the explanation thereof is omitted.

FIG. 9 is a diagram showing an example of an image projection system according to the second embodiment. An image projection system 200 of this embodiment has an image projection device 100 and a terminal device 300 .

In the image projection system 200 of the present embodiment, the terminal device 300 holds color vision characteristic data corresponding to a plurality of color vision characteristics including, for example, protanopia, protanopia, and protanopia, and displays it. A list of color vision characteristics is displayed on the operating device 301 . Then, the terminal device 300 outputs the color vision characteristics data corresponding to the color vision characteristics selected in the list to the image projection device 100 .

FIG. 10 is a diagram explaining the function of each device of the image projection system. A terminal device 300 included in the image projection system 200 includes a processor such as a CPU (Central Processing Unit), a memory device such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and a display operation device 301 such as a touch panel.

The terminal device 300 of this embodiment has a display control section 310 , a storage section 311 and a communication section 312 .

The display control unit 310, for example, causes the display operation device 301 to display a list of color vision characteristics. Storage unit 311 holds color vision characteristic data 55A for each color vision characteristic. A communication unit 312 communicates with an external device.

An example of the color vision characteristic data 55A held by the storage unit 311 of the terminal device 300 is shown below with reference to FIG. FIG. 11 is a diagram showing an example of color vision characteristic data according to the second embodiment.

The color vision characteristic data 55A of the present embodiment includes color vision characteristic data associated with each color vision characteristic. The color vision characteristic data 55A shown in FIG. 11 includes, for example, color vision characteristic data 55-1 corresponding to type 1 bichromacy, color vision characteristic data 55-2 corresponding to type 2 bichromacy, and color vision characteristic data corresponding to type 3 bichromacy. Including 55-3.

In this embodiment, the terminal device 300 thus holds color vision characteristic data for each color vision characteristic. Therefore, according to the present embodiment, the color vision characteristic data corresponding to the color vision characteristic selected in the list of color vision characteristics displayed on the terminal device 300 is transmitted to the image projection device 100, and stored in the storage unit 52 of the image projection device 100. can be retained.

(Third embodiment)
A third embodiment will be described below with reference to the drawings. The third embodiment differs from the first and second embodiments in that the user can adjust the color vision characteristic data. Therefore, in the following description of the third embodiment, only differences from the first embodiment will be described. are assigned the same reference numerals as those used in , and the description thereof is omitted.

FIG. 12 is a diagram for explaining the image projection device of the third embodiment.

The image projection device 100A of the present embodiment is installed, for example, on a pedestal 20 or the like, and the color vision characteristic data is adjusted (corrected) while the user P brings his or her eyeballs closer to look into the image projection device 100A. will be Although the example of FIG. 12 shows an example in which the user P sits on a chair and uses the image projection device 100A, the present invention is not limited to this. The user P may use the image projection device 100A in a standing state.

The image projection device 100A of the present embodiment holds color vision characteristic data for each color vision characteristic, and according to the user's operation, the R output value, G output value, and G output value associated with the confused color in the color vision characteristic data. Change the value of the B output value.

The hardware configuration of the image projection device 100A of this embodiment will be described below with reference to FIG. FIG. 13 is a diagram illustrating the hardware configuration of the image projection device of the third embodiment.

The image projection apparatus 100A of this embodiment has a communication section 20, a control section 30, a storage section 40, a laser output control section 50, a laser irradiation section 60, an input section 70, and an output section 80.

The communication unit 20 is a communication device for performing communication between the image projection device 100A and an external device. Specifically, for example, the communication unit 20 communicates with the terminal device 1 via a network or the like. Note that the method of communication by the communication unit 20 may be any method as long as the image projection device 100A and the external device can communicate with each other.

The terminal device 1 may be provided in, for example, a medical institution or the like, or may be arranged in a store or the like that provides the glasses-type image projection device 100 described in the first embodiment. Further, the communication unit 20 may communicate with, for example, the spectacles-type image projection device 100 described in the first embodiment.

The control unit 30 is, for example, an arithmetic processing device or the like, and controls the entire operation of the image projection device 100A of this embodiment.

The storage unit 40 stores programs executed by the control unit 30, various values obtained by calculation, and the like. Further, the storage unit 40 may store image data of images used for color adjustment for each color vision characteristic. Furthermore, the storage unit 40 may store the adjusted color vision characteristic data adjusted by the user together with information identifying the user.

The input unit 70 is for inputting various kinds of information to the image projection device 100A. Specifically, for example, the input unit 70 is an input device operated by the user when adjusting the color to be projected instead of the confused color. , joysticks, etc. are suitable.

If the input unit 70 has such a configuration, it is possible to change density, saturation, etc. by pressing the keyboard or tilting the joystick in color adjustment.

In addition, since the user P puts his or her eye on the laser irradiation section 60, it is inefficient to remove the eye from the laser irradiation section 60 in order to see the input section . For this reason, if the input unit 70 is a keyboard, it is possible to dispose an operation unit indicating up, down, left, and right, which is preferable. Furthermore, it is more preferable to provide a keyboard with projections or the like so that input can be performed without looking at the keyboard. Furthermore, it is more preferable if the input unit 70 is a joystick.

The output unit 80 is for outputting various kinds of information from the image projection device 100A. Specifically, for example, the output unit 80 may store the color vision characteristic data after adjusting the color to replace the confused color in the storage unit 40 or write it to a recording medium or the like. Also, the output unit 80 may be a display that displays a list screen for allowing the user to select the color vision characteristic.

Next, functions of the image projection device 100A of this embodiment will be described. FIG. 14 is a diagram for explaining the functions of the image projection device of the third embodiment.

Each unit shown in FIG. 14 is implemented by the control unit 30 reading and executing a program stored in the storage unit 40 .

The image projection device 100</b>A of this embodiment has an input reception unit 131 , a display control unit 132 , an adjustment image data output unit 133 , a color vision characteristic data generation unit 134 and a data storage unit 135 .

The input reception unit 131 receives input of information from the input unit 70 or the like. The display control unit 132 controls display on the display that is the output unit 80 .

The adjustment image data output unit 133 reads from the data storage unit 135 the adjustment image data corresponding to the color vision characteristic selected in the list of color vision characteristics displayed on the display, and transfers the read image data to the laser output control unit 50 .

The color vision characteristic data generation unit 134 changes the R output value, the G output value, and the B output value of each color included in the adjustment image data according to the operation received by the input receiving unit 131, and changes the R output value after the change. , G output value, and B output value are generated and stored in the data storage unit 135 .

The data storage unit 135 stores adjustment image data 56 and user-specific color vision characteristics data 57 .

The adjustment image data 56 of the present embodiment may be provided, for example, for each color vision characteristic. Further, the adjustment image data may be a gradation image or the like expressed by colors on a straight line other than the confusion straight line shown in FIG.

Specifically, for example, when the color vision characteristic is type 1 dichromacy, the data storage unit 135 stores, as part of the adjustment image data 56, the color plotted on the straight line L21 in FIG. An image of the gradation to be expressed may be held.

In addition, for example, when the color vision characteristic is type 2 dichromacy, the data storage unit 135 stores, as a part of the adjustment image data 56, colors that are plotted on a straight line L41 shown in FIG. 6B. It is also possible to hold an image with a gradation that

Next, with reference to FIG. 15, the operation of the image projection device 100A of this embodiment will be described. FIG. 15 is a flow chart for explaining the operation of the image projection device of the third embodiment.

The image projection apparatus 100A of the present embodiment determines whether or not input of user information has been received by the input reception unit 131 (step S1501). In step S1501, if the user information is not accepted, the image projection device 100A waits. The user information may be any information that identifies the user, and may be, for example, the name of the user or identification information (user ID) of the user.

In step S1501, upon receiving input of user information, the image projection device 100A causes the output unit 80 to display a list of color vision characteristics (step S1502). Information indicating a list of color vision characteristics may be held in the storage unit 40, although not shown.

Subsequently, the image projection device 100A determines whether or not the input reception unit 131 has received the selection of the color vision characteristic (step S1503). In step S1503, if the selection of the color vision characteristic is not accepted, the image projection device 100A waits until the selection is accepted.

In step S1503, when the selection of the color vision characteristic is received, the image projection device 100A reads the adjustment image data corresponding to the selected color vision characteristic by the adjustment image data output unit 133 and outputs the adjustment image data to the laser output control unit 50. Then, the laser output control unit 50 projects the image data for adjustment onto the retina of the user (step S1504).

Subsequently, the image projection apparatus 100A determines whether or not the input reception unit 131 has received an operation for color adjustment (step S1505). If the color adjustment is not accepted in step S1505, the image projection apparatus 100A proceeds to step S1508, which will be described later.

In step S1505, when color adjustment is received, the image projection apparatus 100A notifies the laser output control unit 50 of the content of the adjustment, and causes the output control unit 53 to set the output values of the respective RGB laser light sources according to the operation. The output value is changed (step S1506).

Subsequently, the image projection device 100A determines whether or not the color adjustment is finished (step S1507). Specifically, the image projection device 100A may determine whether or not the adjustment has ended, depending on whether or not an operation indicating the end of the adjustment has been received.

In step S1507, if the adjustment is not finished, the image projection device 100A returns to step S1505. In step S1507, when the adjustment is completed, the image projection device 100A causes the color vision characteristic data generation unit 134 to generate color vision characteristic data in which the confused color and the RGB output values corresponding to the respective colors of the image data for adjustment are associated with each other. , the user-specific color vision characteristic data 57 to which the user information is assigned is generated, stored in the data storage unit 135 (step S1508), and the process is terminated.

The image projection apparatus 100A of this embodiment may directly transmit the user-specific color vision characteristics data 57 stored in the data storage unit 135 to the image projection apparatus 100 described in the first embodiment.

As described above, according to this embodiment, color vision characteristic data can be generated for each user.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed within the scope of the present invention, and can be determined appropriately according to the application form.

50 laser output control unit 51 image input unit 52 storage unit 53 output control unit 55 color vision characteristic data 60 laser irradiation unit 100, 100A image projection device 200 image projection system 300 terminal device

Claims (9)

a plurality of laser light sources that generate imaging laser beams having a wider color gamut than the color gamut defined by the NTSC standard based on image data;
a laser irradiation unit that projects an image onto the retina of a user's eyeball using the imaging laser beam;
a storage unit storing color vision characteristics data based on a wider color gamut than the color gamut defined by the NTSC standard;
a laser output control unit that individually controls the amounts of laser light output from the plurality of laser light sources based on the color vision characteristic data;
an optical member that converges the imaging laser beam within the user's eyeball;
A retinal scanning image projection device having a. The color gamut of each color of the image laser beams generated by the plurality of laser light sources has chromaticity coordinates (x, y) in the CIE color system of (0.1, 0.6), (0.2, 0.6), (0.1, 0.7), and (0.2, 0.7) are included within the color gamut . The image data is
Including image data of an image captured by a camera in the line-of-sight direction of the user or image data input from an external device,
An image input unit that receives input of the image data,
3. The retinal scanning image projection device according to claim 1, which is eyeglass-shaped and wearable. The color vision characteristic data is
Any one of claims 1 to 3, wherein the data associates the color of the confusion straight line corresponding to the user's color vision characteristics on the chromaticity diagram with the light amount of the laser light output from the plurality of laser light sources. 3. The retinal scanning image projector according to claim 1. The amount of laser light output from the plurality of laser light sources is
5. The retinal scanning image projection apparatus according to claim 4, wherein the amount of light is an amount of light for projecting an image of a color outside the confusion straight line and in a color gamut represented by the laser beams emitted from the plurality of laser light sources. . Equipped with an input unit that accepts user input operations,
6. The retinal scanning image projector according to claim 1, wherein the color of said projected image is adjusted by an input operation from said input unit. having a communication unit that communicates with an external device;
The retinal scanning image projector according to any one of claims 1 to 6, wherein the color vision characteristic data is acquired from the external device via the communication unit. A retinal scanning image projection method using a retinal scanning image projector, wherein the retinal scanning image projector includes:
A procedure for generating image laser beams with a wider color gamut than the color gamut defined by the NTSC standard based on image data using a plurality of laser light sources;
a step of projecting an image onto the retina of a user's eyeball using the imaging laser beam by a laser irradiation unit;
The light intensities of the laser beams output from the plurality of laser light sources are individually controlled based on the color vision characteristics data based on the color gamut wider than the color gamut defined by the NTSC standard, stored in the storage unit. and
and a step of converging the imaging laser beam within the user's eyeball by an optical member. A retinal scanning image projection system having a retinal scanning image projection device and a terminal device,
The terminal device
a storage unit in which color vision characteristic data based on a wider color gamut than the color gamut defined by the NTSC standard is stored for each color vision characteristic;
a display control unit for displaying a list of the color vision characteristics on a display unit;
a communication unit that outputs color vision characteristics data corresponding to the color vision characteristics selected in the list to the retinal scanning image projection device;
The retinal scanning image projection device comprises:
a storage unit that stores the color vision characteristic data output from the terminal device;
a plurality of laser light sources that generate imaging laser beams having a wider color gamut than the color gamut defined by the NTSC standard based on image data;
a laser irradiation unit that projects an image onto the retina of a user's eyeball using the imaging laser beam;
a storage unit for storing color vision characteristic data output from the terminal device and based on a wider color gamut than the color gamut defined by the NTSC standard;
a laser output control unit that individually controls the amounts of laser light output from the plurality of laser light sources based on the color vision characteristic data;
an optical member that converges the imaging laser beam within the user's eyeball;
A retinal scanning image projection system, comprising:

Images