WO2012137532A1

WO2012137532A1 - Display device, electronic apparatus equipped with display device, and projection unit

Info

Publication number: WO2012137532A1
Application number: PCT/JP2012/052620
Authority: WO
Inventors: 堀川嘉明
Original assignee: オリンパス株式会社
Priority date: 2011-04-04
Filing date: 2012-02-06
Publication date: 2012-10-11
Also published as: JPWO2012137532A1; JP5330623B2

Abstract

For the purpose of providing a practical display device in which the focus can be adjusted easily even for a person with presbyopia, an electronic apparatus equipped with the display device, and a projection unit, the display device of this invention is characterized by comprising: a periodic pattern-formed section in which a periodic pattern is formed; a micro lens array disposed to face the periodic pattern-formed section and projecting the periodic pattern onto a pupil of an observer; and an image position adjustment unit for causing an image of the periodic pattern projected by the micro lens array to follow the movement of the pupil.

Description

Display device, electronic apparatus including the display device, and projection unit

The present invention relates to a display device, an electronic apparatus including the display device, and a projection unit.

There are liquid crystal displays and plasma displays as display devices (displays) for displaying images and characters. These display devices cannot adjust diopter. With the progress of an aging society, the number of elderly people with presbyopia (presbyopia) is increasing, and a display device capable of adjusting diopter, particularly a flat panel display (FPD), is desired. With the spread of mobile phones and the spread of digital cameras, the opportunity to view FPD displays outdoors is increasing. Furthermore, the use of electronic books instead of books is increasing. Thus, it is very troublesome to remove the reading glasses every time when viewing the FPD of a mobile device such as a mobile phone or a digital camera.

Mobile phones are often used for sending and receiving emails, games, etc., rather than being used as phones. In this case, the user needs to see the FPD. Digital SLR cameras use FPDs as a live view monitor. In this digital single-lens reflex camera, you can wear and remove reading glasses each time to see a live view monitor while viewing a distant subject. It is not practical to do. In addition, a GUI (graphical user interface) using the monitor is often used for changing the shooting mode, and the necessity for viewing the monitor is high.

Also, when looking at the monitor of the car navigation system, the observer is driving. For this reason, it is dangerous to remove reading glasses, and it is virtually impossible to remove reading glasses. As another scene, it is troublesome for the observer to wear reading glasses every time when observing a liquid crystal screen of a personal computer (PC). Accordingly, there is a demand for an electronic device that allows a monitor to be viewed without removing reading glasses.

For example, Patent Document 1 shows a configuration example in which a Fresnel lens is attached in front of an FPD that is a monitor of a digital camera and the FPD is looked into like a loupe.

JP 2009-63624 A

In the configuration disclosed in Patent Document 1, it is necessary to provide a certain distance between the loupe and the display unit in order to observe an appropriate image. For this reason, an apparatus will become large. Specifically, in order to correct presbyopia, the Fresnel lens needs to be separated from the FPD by about several centimeters, which is not practical.
Patent Document 1 also shows a configuration in which a microlens array is used for each pixel instead of a Fresnel lens. Here, if a microlens array is simply used, a pixel is enlarged by each microlens. For this reason, adjacent pixels are observed in an overlapping manner, which is not practical.

Thus, conventionally, there is no FPD that can see a focused image without wearing reading glasses. There are no electronic devices equipped with such a monitor.

The present invention has been made in view of the above, and an object of the present invention is to provide a practical display device that is easily focused, an electronic device including the display device, and a projection unit.

In order to solve the above-described problems and achieve the object, a display device according to the present invention includes a periodic pattern forming unit in which a periodic pattern is formed,
A microlens array that is arranged to face the periodic pattern forming unit and projects the periodic pattern onto the pupil of an observer;
An image position adjustment unit that follows the movement of the pupil with the image of the periodic pattern projected by the microlens array;
It is characterized by having.
In another aspect, an electronic apparatus according to the present invention includes the above-described display device.

According to the present invention, there is an effect that it is possible to provide a practical display device that is easily focused, an electronic device including the display device, and a projection unit.

It is a figure explaining the view of the display method using the effect which narrows down a pupil. It is a figure explaining each imaging relationship of a light emission point and a lens. It is a figure explaining that there is an effect equivalent to restrict | squeezing a pupil to image-form with the projection light beam of a magnitude | size smaller than a pupil. It is a flowchart explaining the procedure which follows the motion of a pupil and makes the image (light beam) of a light emission point inject into an observer's pupil. It is a block diagram of the structure which follows the motion of a pupil and makes the image (light beam) of the light emission point inject into an observer's pupil. It is a figure which shows the structure which inclines the unit comprised by the microlens and the pinhole with respect to display devices, such as a liquid crystal. It is a figure which shows schematic structure of the display apparatus which concerns on 2nd Embodiment. It is a figure which shows the detail of a one part structure of the display apparatus which concerns on 2nd Embodiment. It is a figure which shows the projection image of a light emission point group. It is a figure which shows the isometric view structure of the digital camera which is an example of the electronic device which concerns on 3rd Embodiment. It is a figure which shows the isometric view structure of the mobile telephone which concerns on 4th Embodiment. It is a figure which shows the structure which shifts the relative position of the permeation | transmission board in which the periodic pattern in a projection unit was formed, and a micro lens array. It is a flowchart which shows the procedure which adds to the function to follow the observer's pupil in 5th Embodiment, and measures and reflects the distance to an observer. It is a figure which shows the movement of the light emission point in a display device. (A), (b) is a figure which shows the state which the light emission point in 6th Embodiment moves.

The operation and effect of the configuration of the display device of the present embodiment, the electronic device including the display device, and the projection unit will be described. In addition, this invention is not limited by this embodiment. That is, in describing the embodiment, a lot of specific details are included for the purpose of illustration, but various variations and modifications may be added to these details without exceeding the scope of the present invention. Accordingly, the exemplary embodiments of the present invention described below are set forth without loss of generality or limitation to the claimed invention.

(First embodiment)
A display device according to the first embodiment will be described. First, the basic concept of this embodiment will be described.
In the first place, presbyopic people have a reduced ability to focus. This makes it difficult for presbyopic people to focus on near points.
Here, in the camera, the depth of field increases when the lens aperture is reduced. As a result, it is possible to take a focused photograph from the front to the back as viewed from the observer of the subject. Therefore, the depth of field can be expanded by artificially reducing the pupil of the eye. As a result, even a presbyopic can focus on near points that are difficult to focus on.

At this time, even if the relative position of the observer and the display device changes, it is preferable to maintain the above effect by detecting the movement of the observer's pupil. Hereinafter, more specific description will be given with reference to the drawings.

FIG. 1 is a diagram for explaining the concept of a display method using the effect of narrowing the pupil. The light emitted from the

light emission points

1a, 1b, and 1c is projected by the

lenses

2a, 2b, and 2c so that the respective images are superimposed on the pupil of the lens 3 of the viewer's eye. For simplicity, only three

light exit points

1a, 1b, 1c and

lenses

2a, 2b, 2c are shown, but the number of light exit points and lenses arranged is not limited to three.

The size of the projected light beam (light exit point image) 4 at the pupil positions of the

light exit points

1a, 1b, 1c is set smaller than the diameter of the pupil. That is, the diameter of the projected light beam 4 passing through the pupil is smaller than that of the pupil. The

lenses

2a, 2b, and 2c are projected onto the retina 5 by the eye lens 3. Thereby,

lens images

6a, 6b, and 6c are formed.

In this embodiment, the

lenses

2a, 2b, and 2c are considered as pixels. The

lens images

6a, 6b, and 6c are pixel images. In this state, if an image signal is given to the

light emission points

1a, 1b, and 1c, the observer can see the image.

In the case of presbyopic human eyes, the focus is not on the retina 5. Here, a

lens

2a, 2b, 2c, which is a pixel, is imaged on the retina 5 as a projection light beam 4 having a size smaller than that of the pupil, so that even a presbyopic person can see a focused image.

This will be described with reference to FIG. The light emission point is not necessarily a point but has a finite size.
First, the image formation relationship between the light emission point 1 and the lens 2 will be described with reference to FIG. The light exit point 1 is projected onto the eye lens 3 by the lens 2. The

points

9a and 9b on the light emission point 1 become

points

10a and 10b on the lens 3 of the eye by the

light rays

7a and 7b and the light rays 7c and 7d, respectively.

The image of the lens 2 is formed in the vicinity of the retina 5 by the

light rays

7a, 8a, 7c, 8c by the eye lens 3 and the

light rays

7b, 8b, 7d, 8d. The distance between the lens 2 and the eye lens 3 is Ff, and the distance between the lens 2 and the light exit point 1 is Fb. When the focal length of the lens 2 is F, the relationship 1 / Ff + 1 / Fb = 1 / F is established.

In FIG. 1, the pitch (repetitive interval) of the

light emission points

1a, 1b, and 1c (or a light emission point group described later) is Pp, and the

lenses

2a, 2b, and 2c (corresponding to lenses of a microlens array described later). When the pitch is Lp, it is necessary to satisfy Lp / Pp = (Ff−F) / Ff.
This pitch may be different in the horizontal direction and the vertical direction of the display device. Such a case will be described in detail in a third embodiment to be described later.

It will be described with reference to FIGS. 3A, 3 </ b> B, and 3 </ b> C that an image formed with a light beam (size) smaller than the pupil has the same effect as narrowing the pupil.
Consider a case where points A and B are viewed in FIG. A person with presbyopia has a weak refractive power of the eye lens 3 and cannot focus on the retina 5.

Therefore, the images of the points A and B are spread like the points A ′ and B ′ by the light beams 11 and 12 transmitted through the entire pupil of the eye lens 3. For this reason, as shown in FIG. 3C, the points A ′ and B ′ cannot be resolved (decomposed). Therefore, a focused image cannot be seen.

On the other hand, the images of the points A and B formed by the light beams 13 and 14 (see FIG. 3B) by the light exit point image smaller than the pupil become small as points A ″ and B ″. Therefore, as shown in FIG. 3C, the points A ″ and B ″ that are images can be resolved.

In the present embodiment, the light beam smaller than the pupil is projected onto the pupil, so that the pupil is equivalently stopped and the depth of field is increased.

Referring back to FIG. The

light emission points

1a, 1b, and 1c correspond to the light emission points of the organic EL or the like when the

light emission points

1a, 1b, and 1c are formed of self-luminous elements such as the organic EL. The

light emission points

1a, 1b, and 1c correspond to the light transmission points limited by the openings in the case of a transmissive type using a backlight such as a liquid crystal panel. In addition, the light emission point and the light transmission point referred to here are not necessarily points, but include cases where they have a finite area. Although a circular shape is preferable as shown in FIG. 1, it is not necessarily round.

In other words, when the light emitting element is composed of a self light emitting element such as an organic EL, the

light emission points

1a, 1b, and 1c of the self light emitting element itself correspond to the periodic pattern forming portion.
In the case of a transmissive type using a backlight like a liquid crystal panel, the periodic pattern forming portion corresponds to a light transmission point limited by a transmissive plate formed by a pinhole array or the like, or an opening of the liquid crystal panel.
In either case, the periodic pattern forming unit and the microlens constitute a projection unit (hereinafter referred to as “unit” as appropriate).
Here, in the case of a self-luminous element such as an organic EL, the periodic pattern forming portion and the microlens constitute a projection unit, and this also serves as a display device.

Here, a pixel of a flat panel display (FPD) such as a liquid crystal panel or organic EL which is a display device is referred to as an “information pixel” in distinction from the

lenses

2a, 2b and 2c which are pixels in the present embodiment. The light emission points may correspond to the information pixels on a one-to-one basis, or a plurality of light emission points may be provided for one information pixel. An example of providing a plurality of light emission points in one information pixel will be described in a third embodiment to be described later.

Ordinary liquid crystal panels, display devices such as organic EL, etc. may perform color display by constituting one information pixel with R (red), G (green), and B (blue) sub-pixels. If the

light emission points

1a, 1b, and 1c are made to correspond to sub-pixels, RGB color display can be performed.

In this embodiment, since a light beam having a diameter smaller than the pupil diameter is incident on the pupil, the brightness is reduced by the smaller light beam diameter. In order to compensate for the decrease in brightness, measures such as increasing the luminance of information pixels, for example, organic EL, and increasing the luminance of the liquid crystal panel are desirable. When the pixels of the liquid crystal panel are information pixels, it is desirable to use LEDs or LDs as the backlight light source.

Note that the

light emission points

1a, 1b, and 1c are formed with a pitch Pp. When the

light emission points

1a, 1b, and 1c are openings such as a pinhole array, they correspond to a periodically patterned transmission plate. The periodic pattern is projected onto the observer's pupil by the microlens array.

Next, with reference to the flowchart of FIG. 4 and the functional block diagram of FIG. 5, a configuration in which the image of the light exit point (light beam) is reliably incident on the observer's pupil following the movement of the pupil will be described.
In step S100, the pupil photographing unit 203, for example, the camera photographs the observer's pupil. The captured pupil image is sent to the control unit 201.

In step S101, the pupil position measurement unit 206 extracts the pupil from the image by face recognition image processing or the like, and specifies the position of the pupil (pupil movement) with respect to the unit (projection unit). The unit will be described later. Information on the calculated pupil position is sent to the calculation unit 205 via the control unit 201.

Here, the memory 202 stores a positional relationship between a unit as shown in FIGS. 6A and 6B and a periodic pattern image.
Information on the positional relationship between the unit and the periodic pattern image stored in the memory 202 can be stored in the memory by the following two procedures, for example.
(1) At the time of shipment of the display device and the electronic device, the position of the periodic pattern image projected from the display device and the electronic device with respect to the display device and the electronic device is determined in advance, and the information is stored in the memory.
(2) When an observer of the display device or the electronic device determines that a predetermined state has been reached, information on the state is stored in the memory. Here, the predetermined state refers to, for example, a state in which it is determined that the periodic pattern is projected on the pupil position when the observer uses the display device or the electronic device. That is, it refers to a state where the display looks good for the observer. The positional relationship between the unit and the periodic pattern image can be stored in the memory by pressing a button provided on the display device or the electronic device. In this case, the information stored in the memory can be used when the display device or the electronic device is used next time.

In step S102, the computing unit 205 projects the projected light flux (

light emission points

1a, 1b, 1b, and 2b) based on the positional relationship information between the unit and the periodic pattern image from the memory 202 and the pupil position information with respect to the unit. 1c) and the relative position of the pupil whose position is specified.

In step S103, it is determined whether or not the pupil position of the observer matches the position of the projected light beam (projected images of the

light exit points

1a, 1b, and 1c). If the determination result in step S103 is Yes (true), the process returns to step S100. Thereafter, the same procedure as that after step S100 is performed.

If the determination result in step S103 is No (false), that is, it is determined that the position of the projected light beam (projected image of the

light exit points

1a, 1b, and 1c) and the pupil position of the specified observer are different. If so, in step S104, the calculation unit 205 calculates the amount of deviation and the direction of both. Then, information on the amount and direction of moving the periodic pattern image is sent to the control unit 201. The control unit 201 sends a drive signal to the drive mechanism 204.
The control unit 201, the pupil photographing unit 203, and the calculation unit 205 constitute a CPU.

In step S105, the drive mechanism 204 moves the position of the projected light beam (projected images of the

light emission points

1a, 1b, and 1c) based on the drive signal. Details of the mechanism relating to the movement will be described later. For example, the projection light beam is made incident on the observer's pupil by adjusting the inclination of the unit composed of the microlens and the pinhole array. The configuration shown in FIG. 5 corresponds to the image position adjustment unit.
As described above, the image position adjustment unit matches the position of the projected light beam (projected images of the

light exit points

1a, 1b, and 1c) with the pupil position of the specified observer.

6A and 6B show a configuration example in which a unit 16 (projection unit) composed of a microlens and a pinhole is tilted with respect to a display device 15 such as a liquid crystal.

6A, four piezoelectric elements 17 are arranged at the four corners of the rectangular display device 15. In FIG. The piezoelectric element 17 is sandwiched between the unit 16 and the display device 15.

The drive mechanism 204 applies a voltage to any one of the piezoelectric elements 17 at the four corners. Thereby, the thickness (height) of the piezoelectric element 17 is changed. As a result, the inclination of the unit 16 with respect to the display device 15 can be changed.

FIG. 6A shows a state where the display device 15 and the unit 16 are not relatively inclined. On the other hand, in FIG. 6B, a voltage is applied to the two piezoelectric elements 17 on the right side toward the paper surface so that the unit 16 is higher than the display device 15 on the right side compared to the left side. It shows the state tilted.

Thus, by using the piezoelectric element 17, for example, it can be easily inclined as compared with the parallel movement.

As described above, in the display device according to the present embodiment, the unit (projection unit) 16 includes the transmission plate on which the

light emission points

1a, 1b, and 1c having a periodic pattern are formed, and the microlens array (

lenses

2a, 2b, and 2c). ). In addition, a display device may be added to this configuration.

Furthermore, when a self-luminous display device such as an organic EL is used, the unit (projection unit) 16 includes a display device and a microlens array (

lenses

2a, 2b, and 2c). The drive mechanism of the unit is attached to the unit. Based on the above-described flowchart procedure and the configuration shown in the functional block diagram, the direction of the unit is changed in accordance with the movement of the observer's pupil based on the control signal from the CPU, and the projected light beam follows the observer's pupil. Can do.

The drive mechanism 204 can move the transmission plate and the microlens array integrally. Thereby, the position of the projection light beam can be moved more reliably.
Further, the drive mechanism 204 may be configured to move the display device, the transmission plate, and the microlens array integrally. As a result, the movement of the projected light beam can be further increased.

Further, when a self-luminous display device such as an organic EL is used, the drive mechanism 204 may be configured to move the display device and the microlens array integrally.
Further, the drive mechanism 204 can be configured to relatively move the positions of the display device and the microlens array.
Also by these, the position of the projection light beam can be moved.

The drive mechanism 204 can be composed of an actuator such as a piezoelectric element, for example. Further, the relative position between the transmission plate on which the periodic pattern in the projection unit is formed and the microlens array may be shifted to cause the projected light beam to follow the observer's pupil.

Next, a detailed configuration for shifting the relative positions of the transmission plate 41 and the micro lens array 43 in which the periodic pattern in the projection unit is formed will be described.
12 (a), 12 (b), and 12 (c), the relative position between the transmission plate 41 on which the periodic pattern in the projection unit is formed and the microlens array 43 are shifted so that the projected light beam follows the observer's pupil. The structure of the projection unit is shown. As described above, the projection unit includes the microlens array 43 and the transmission plate 41 on which a periodic pattern is formed.

FIG. 12A is a side view of a configuration in which a frame 42 including a microlens array 43 (FIG. 12C) and a transmission plate 41 on which a periodic pattern is formed are overlapped. FIG. 12B is a diagram of the projection unit viewed from the observer's direction. Actually, the cover of the structure of the projection unit is installed so as not to be seen by the observer.

As shown in FIG. 12B, the microlens array 43 is biased (connected) to the frame 45 by leaf springs (biasing members) 44 disposed above and below the microlens array 43. The microlens array 43 is also connected to the frame 45 by actuators 46 arranged on the left and right sides thereof.

The microlens array 43 is urged (connected) to the frame 45 by a leaf spring 44, and can move up and down. The amount of movement is controlled by the expansion and contraction of the actuator 46.

The frame 45 is biased (connected) to the frame 42 by leaf springs 47 arranged on the left and right sides thereof. The frame 45 is also connected to the frame 42 by actuators 48 disposed above and below it. Since the frame 45 is urged (connected) to the frame 42 by the leaf spring 47, the frame 45 can move left and right. The movement is controlled by the expansion and contraction of the actuator 48.

Thus, the microlens array 43 can be moved left and right and up and down in FIG. That is, it is possible to shift the relative positions of the transmission plate 41 and the microlens array 43 on which the periodic pattern is formed.

FIG. 12C shows an example of a state in which the microlens array 43 is moved in the lower right direction with respect to the frame 42. By contracting the actuator 46, the microlens array 43 moves downward. At this time, the microlens array 43 can be moved by the deformation of the plate springs 44 disposed above and below.

The microlens array 43 is moved in the right direction by extending the length of the actuator 48. At this time, when the leaf springs 47 arranged on the left and right are deformed, the microlens array 43 moves to the right. In this way, the microlens array can be moved in any direction left, right, up, and down in the drawing by controlling the

actuators

46 and 48.

Also, since the

leaf springs

44 and 47 are used, it is possible to move and change the position in the left, right, up and down directions with high accuracy without rotating the microlens array 43. Note that the microlens array 43 may be fixed and the transmission plate 41 on which the periodic pattern is formed may be moved. As the

actuators

46 and 48, piezoelectric elements, ultrasonic motors, voice coil motors, or the like can be used.

Returning to the functional block diagram of FIG.
As described above, the CPU configured by the control unit 201 and the calculation unit 205 recognizes the pupil of the eye from the image of the observer photographed by the pupil photographing unit 203, for example, a camera. Then, the CPU compares the position of the pupil with the position of the light emission point group image (19a, 19b, 19c in FIG. 7 or 24 in FIG. 9) known in advance.
A control signal is generated based on the positional difference between the two.

The CPU function may be shared with the CPU of an electronic device such as a mobile phone or a digital camera in which a display device is installed. Furthermore, a camera that captures the eyes of the observer may be a camera that is provided in advance in an electronic device in which a display device is installed.

With such a configuration, the unit tilt adjustment amount can be minimized by adjusting the direction of the unit so that the pupil coincides with the closest light flux among the projected light fluxes.

(Second Embodiment)
FIG. 7 shows a schematic configuration of the display device according to the second embodiment. Light

emission point groups

18a, 18b, and 18c having a plurality of light emission points corresponding to the

lenses

2a, 2b, and 2c, which are pixels, are provided. For simplicity, only three light

exit point groups

18a, 18b, and 18c and

lenses

2a, 2b, and 2c are shown. However, the number of light exit point groups and lenses is limited to three. Not.

The light

emission point groups

18a, 18b, and 18c are configured by light emission points included in information pixels or sub-pixels. The first embodiment shown in FIG. 1 is a case where the number of light emission points included in the light emission point group in the second embodiment is one. The light

emission point groups

18a, 18b, and 18c are projected by the lens 2b to form light emission

point group images

19a, 19b, and 19c.

The images of the light

exit point groups

18a and 18b by the lens 2a are light

exit point images

19b and 19c. The images of the light

exit point groups

18b and 18c by the lens 2c are light

exit point images

19a and 19b.

The light emitted from the

light emission points

20a, 20b, and 20c in the light

emission point groups

18a, 18b, and 18c is reflected on the pupil of the lens 3 of the eye of the display observer by the

lenses

2a, 2b, and 2c. Are projected so as to overlap. This is the same as described above in the first embodiment.

Lenses

2a, 2b, and 2c are projected onto the retina by the eye lens 3 to form

lens images

21a, 21b, and 21c. When an image signal is given to the

light emission points

20a, 20b, and 20c, the observer can see the image.

Similarly, the relationship between the pitch Pp of the light

emission point groups

18a, 18b, and 18c and the pitch Lp of the

lenses

2a, 2b, and 2c is Lp / Pp = (Ff−F) / Ff. There are many projected light exit point images, and if one of them is incident on the pupil, the observer can see the image.

Other effects and operations in this embodiment are the same as those in the first embodiment. A color image can be displayed by making the light

emission point groups

18a, 18b, and 18c correspond to R (red), G (green), and B (blue).

FIG. 8 shows details of a part of the configuration of the display device of the present embodiment. For simplicity, 3 × 3 pixels (lenses) are shown. The perspective structure which looked at the part comprised by the micro lens array 22 and the light emission point group 23 from the observer side is shown.

The light emission point group 23 is provided corresponding to the lenses of the microlens array 22. The lens pitches Lpx and Lpy of the microlens array 22 are Ppx and Ppy, where the pitch of the light emission point group (usually corresponding to the pitch of the information pixels) is
Lpx = Ppx (Ff−F) / Ff
Lpy = Ppy (Ff−F) / Ff
It becomes.

Here, Ff and Fb are the distance from the light exit point group 23 to the pupil and the distance between the light exit point group 23 and the lens of the microlens array 22, respectively. Further, the light emission point group 23 is not limited in the relative position with respect to the microlens array 22 as long as the condition of the above formula is satisfied. For example, as long as the condition of the above formula is satisfied, there is no problem even if the light emission point group 23 and the lenses of the microlens array 22 are slightly shifted left and right.

However, if there is an inclination between the light exit point group 23 and the microlens array 22, the projected light exit point does not overlap when projected near the pupil of the observer's eye. For this reason, it is desirable that the inclination is small.

When a liquid crystal panel is used as a display device, each light emission point group 23 corresponds to each information pixel.

When an organic EL device or the like that is a self-luminous device is used as the display device, each light emission point group 23 can be formed by the organic EL device itself. In this case, the organic EL device itself functions as each information pixel. When it functions as an information pixel without forming a light emission point, it functions as a normal display device.

As shown in FIG. 7, the light

emission point groups

18a, 18b, and 18c are arranged with a period of the pitch Pp. When the light emission point group is an opening such as a pinhole array, it is a transmission plate having a transmission structure. When the light emission point group is an organic EL or the like, the light emitting structure has a period Pp. Then, as described above, the periodic pattern is projected onto the observer's pupil by the microlens array.

FIGS. 9A, 9B, and 9C show projection images of the light emission point group. Many projected light exit point images 24 are distributed.
As shown in FIG. 9A, when the light exit point image 24 is located within the pupil 25 of the observer, an effect of expanding the depth of field is obtained. For this reason, the observer can see a focused image.

On the other hand, as shown in FIGS. 9B and 9C, when the position of the light exit point image 24 does not match the position of the pupil 25 of the observer, the observer cannot observe the image. Therefore, it is necessary to move the light exit point image 24 so that the position of the light exit point image 24 matches the position of the pupil 25.

A configuration in which the light exit point image 24 is reliably incident on the observer's pupil 25 will be described again using the flowchart of FIG. In step S101, a camera for photographing the pupil is provided, and the pupil 25 is extracted from the image. In step S102, the position of the observer's pupil 25 relative to the unit is specified.

In step S102, the relative position between the projected light exit point image 24 and the pupil 25 whose position has been specified is obtained. In step S103, when the position of the pupil 25 of the observer coincides with the light emission point image 24, the process proceeds to step S100, and the pupil 25 is extracted again from the next image acquired by the camera or the like. Then, the position is specified, and the relative position with respect to the light emission point image is obtained.

If it is determined in step S103 that the light exit point image 24 and the position of the identified observer's pupil 25 are different from each other, the process proceeds to step S104, and the shift amount and direction of the position are calculated. In step S <b> 105, the tilt of the display device or the like is adjusted, and the projected light beam is incident on the observer's pupil.

Thereby, the projection position of the light exit point image 24 can be moved by inclining the pinhole array and the microlens array together. All the light exit point images move simultaneously as an image of the light exit point group.

As shown in FIG. 9B, when the position of the observer's pupil 25 is slightly deviated from the light emission point image 24 ′ that was initially matched, the light is corrected in the direction to correct the deviation. Move the injection point cloud.

On the other hand, as shown in FIG. 9 (c), the position of the observer's pupil 25 is greatly shifted from the position of the coincident light emission point image 24 ′, and the position of the other light emission point image 24 ″. Is close to the position of the pupil 25, the light emission point group is moved so that the light emission point image enters the observer's pupil.

Here, the same adjustment can be made by tilting the display device, pinhole array, and microlens array together. Alternatively, the position of the light emission point group 24 can be moved by shifting the relative positions of the pinhole array and the microlens array.

Further, when the opening of the light emission point group 24 is formed by a liquid crystal panel, the light emission point group 24 can be moved by moving the opening formed in the liquid crystal panel.
In the case of an organic EL device, the same effect can be produced by moving the light emission position.

As a camera for photographing the movement of the pupil, a videophone camera 37 for photographing a user, which is provided in the mobile phone 38 as shown in FIG. 12, can be used as it is. The cellular phone 38 will be described later.

The camera 37 can image the pupil of the user of the mobile phone 38, that is, the observer watching the display device 39. The display device 39 is provided with the pinhole array and the microlens array of this embodiment. With the configuration and control described above, even a presbyopic person who is out of focus can see a focused display.

(Third embodiment)
FIG. 10 shows a perspective configuration of a digital camera which is an example of an imaging apparatus according to the third embodiment. The digital camera 33 includes an imaging lens (not shown) on the front surface thereof. A release button 34, a mode button 35, and a display device 36 are provided.

Also, a camera 32 that tracks the movement of the user's pupil is provided. The user takes a picture by pressing the release button 34 while confirming an image taken through the imaging lens on the display device 36.

In the present embodiment, a display device having a pixel configuration having a microlens array and a light emission point shown in FIG. Therefore, even a person with presbyopia, nearsightedness, or astigmatism can check the displayed image without putting on or taking off the glasses.

This makes it easy to check the focus and composition. In addition, since an in-focus image can be confirmed, a GUI (graphical user interface) can be confirmed, and a desired photographing mode can be selected and photographed with the mode button 35.

That is, a monitor (display device 36) is provided that allows a person with presbyopia, hyperopia, myopia, or astigmatism to check the display without wearing glasses. Thereby, the original function of the digital camera can be used.

The mode button 35 is a switch for setting shooting conditions such as shooting sensitivity, landscape mode, night view mode, and includes a zoom lever (zoom operation switch) (not shown). Here, only one mode button 35 is shown, but a plurality of mode buttons 35 may be provided.
Recently, a touch panel that is used as an input device by being superimposed on a flat panel display (FPD) has been put into practical use. Also in this embodiment, a touch panel can be superimposed on the display device 36 to provide an input device. That is, a touch panel can be used instead of the mode button 35.

(Fourth embodiment)
Next, a mobile phone will be described as an example of a portable electronic device according to the fourth embodiment.
FIG. 11 shows a perspective configuration of a mobile phone according to the fourth embodiment. The cellular phone 38 includes a call switch, a numeric keypad 40 for inputting characters, and a display device 39. The mobile phone 38 is provided with a display device for acquiring information not only by the phone but also by mail or internet connection.

The mobile phone 38 of the present embodiment uses a pixel-structured organic EL device having a microlens array and a light emission point as shown in FIG. As a result, presbyopia, myopia, and astigmatism can view the information displayed on the display device in a focused state without putting on or taking off glasses.

Therefore, it is possible to email practically as well as call. Further, by pressing a camera mode switch (not shown), it is possible to take a picture with a camera (not shown) that is provided integrally with the mobile phone 38.

According to the present embodiment, a person with presbyopia, myopia, or astigmatism can take a picture while confirming the composition and focus without taking off reading glasses. That is, since a monitor (display device 39) that allows a person with presbyopia, hyperopia, myopia, or astigmatism to check the display without wearing glasses, the function added to the mobile phone can be used. .

Note that the display device according to the present embodiment using a liquid crystal panel may be used as the display device 39. Note that the videophone camera 37 that captures the user also serves as a camera that tracks the movement of the pupil.

(Fifth embodiment)
Next, a display device according to a fifth embodiment will be described.
In FIG.
The distance between the lens 2 and the lens 3 of the eye is Ff,
The pitch of the light emission point is Pp,
The pitch of the lens (lens of the micro lens array) is Lp,
When the focal length F of the lens is set, the following formula is established.
Lp / Pp = (Ff−F) / Ff

Therefore, the position of the observer is preferably a position satisfying Ff = Pp × F / (Pp−Lp) from the display device.

However, the observer does not always observe the display device at a certain position. If the distance between the observer and the display device is greatly different from the distance Ff, the light flux from each microlens may not enter the observer's pupil at the same time, and the image may be shaded.

It is not practical to change the pitch Lp of the microlens array. On the other hand, by changing the light emission point or the pitch Pp of the light emission point group, it is possible to project an image (projection light beam) of the light emission point at the position of the observer's pupil.

That is, the observation distance of the display device can be changed by changing the light emission point or the pitch Pp of the light emission point group. As a result, the observer can see a focused image without a shadow.

For example, by using an organic EL element, which is a self-luminous element, as the light emission point, the pitch of the light emission position can be changed. Thereby, the pitch Pp of a light emission point (light emission point group) can be changed.

Further, when the opening of the light emission point or the light emission point group is formed by the liquid crystal panel, the pitch of the openings formed in the liquid crystal panel is changed. Thereby, the pitch Pp of the light emission point or the light emission point group can be changed.

Next, a configuration in which the distance to the observer is measured and the image of the light exit point (projected light beam) is incident on the observer's pupil with high accuracy will be described. For example, the distance to the pupil is measured using a camera. The distance to the observer is measured by the automatic focus detection function. Alternatively, the distance can be estimated from the size of the face of the observer and the size of the pupil.

Note that this can be achieved simultaneously with the function of following the movement of the observer's pupil described above with reference to FIGS. Alternatively, it is desirable to simultaneously follow the movement of the observer's pupil and measure the distance to the pupil.

FIG. 13 is a flowchart showing a procedure for measuring and reflecting the distance to the observer in addition to the function of following the observer's pupil. Here, it is assumed that the light emission point is a self-luminous element, and the distance to the observer is estimated by the size of the pupil. Note that the functional blocks for executing this flowchart are the same as those described above with reference to FIG.
The same steps as those in the flowchart shown in FIG.

In step S100, the pupil photographing unit 203, for example, the camera photographs the observer's pupil. The captured pupil image is sent to the control unit 201.

In step S101, the pupil position measurement unit 206 extracts the pupil from the photographed image of the pupil of the observer by face recognition image processing or the like, and sets the pupil position (pupil movement) to a unit (projection unit). To identify.

In step S102, the calculation unit 205 obtains the relative position between the projected light beam (projected image of the light exit point) and the pupil whose position is specified based on the information stored in the memory and the pupil position information.

In step S103, it is determined whether or not the pupil position of the observer matches the position of the projected light beam. When the determination result in step S103 is Yes (true), in step S106, the calculation unit 205 estimates the distance to the observer from the obtained pupil size.
In step S107, it is determined whether the distance to the observer has changed. The initial value is a design value distance. If the determination result of step S107 is No (false), the process returns to step S100. When the determination result in step S107 is Yes (true), in step S108, the calculation unit 205 obtains the light emission point pitch Pp using a calculation formula.
Here, the calculation unit 205 includes a distance measurement unit that calculates the distance to the observer, and changes the period of the periodic pattern according to the distance.

In step S109, the control unit 201 changes the light emission pattern of the self-luminous display element that forms the light emission point (light emission point group). Then, it returns to step S100.

If the determination result in step S103 is No (false), that is, if it is determined that the position of the projected light beam is different from the position of the identified observer's pupil, the process proceeds to step S104.

In step S104, the calculation unit 205 calculates the amount of displacement and the direction of displacement of both positions. In step S105, the amount and direction of moving the display image on the self-luminous display device on which the periodic pattern of light emission point groups is formed are sent to the control unit of the self-luminous display device. Thereafter, the process proceeds to step S106.

Note that it is preferable to focus when projecting the light exit point or the light exit point group onto the pupil.
As a technique for changing the focal length of a lens, for example, a liquid crystal lens is known. By using a liquid crystal lens array in which liquid crystal lenses are arranged in a lens array, it is possible to focus when projecting the light exit point on the pupil.

According to the present embodiment, the image of the light exit point or the light exit point group (projected light beam) can be reliably incident on the pupil of the observer.

(Sixth embodiment)
Next, a display device according to a sixth embodiment will be described. A description of the same parts as those in the above embodiments will be omitted. FIG. 14 shows a configuration using an organic EL device which is a self-luminous device as a display device.
The operation when the position of the pupil is detected and the light emission position is moved and the distance to the pupil is measured and the pitch of the light emission position is changed will be described.

An organic EL device, as is known, causes an organic EL material to emit light by sandwiching an organic EL material between thin film electrodes and applying a voltage between the electrodes. Generally, a pixel electrode that is an electrode for each information pixel and an integral electrode that is not distinguished for each information pixel on the opposite side.

When displaying information, the information is displayed by applying a voltage to the pixel electrode to be displayed. When the light emission point is moved as indicated by an arrow in the figure, the electrode for applying a voltage from the circular pixel electrode 50 to the pixel electrode 51 is changed. Thereby, the light emission position can be moved in the direction indicated by the arrow.

Here, when the movement of the light emitting point is large, it may occur that the light emission point image projected on the observer moves too much. Therefore, more preferably, it is desirable that the light emission point for self-light emission is constituted by a plurality of pixel electrodes in advance as shown in FIGS.

15A and 15B, the black square and the white square are the

pixel electrodes

52 and 53, respectively. The pixel electrode 52 to which no voltage is applied is indicated by a black square. For this reason, the information pixel formed by the pixel electrode 52 does not emit light.

On the other hand, the pixel electrode 53 to which a voltage is applied is indicated by a white square. The information pixel composed of the pixel electrode 53 emits light. Among the pixel electrodes, a voltage is applied to the pixel electrode 53 indicated by a region 53a having a substantially circular range. As a result, the region 53a emits light in a substantially circular shape. This is one light exit point and is projected onto the observer's pupil by the microlens array.

As shown in FIG. 15B, when the light emission point is moved (including the case of changing the pitch), from the pixel electrode 53 to which a voltage is applied to the pixel electrode 54 (indicated by a hatched square). change. As a result, the light emitting region changes from the region 53a to the region 54a. Thereby, as shown by the arrow 55, the light emission point moves a little.

In this embodiment, since the light emission point can be moved little by little in this way, the light emission point image (projected light beam) projected on the observer's pupil can be moved smoothly.

As described above, the display device according to each of the above embodiments and the electronic apparatus including the display device can see a focused display by causing a light beam having a diameter smaller than the pupil diameter to enter the pupil of the observer. effective. When a light beam having a diameter smaller than the pupil diameter is incident, there is an effect of expanding the depth of focus of the eye. As a result, it is possible to provide a display device and an electronic device in which the depth of field is expanded and a person who is not focused on the display position can view the focused display.

Furthermore, following the movement of the pupil of the observer, the above-described effect can be reliably exhibited by making the light beam incident on the pupil of the observer.
By using the display device or electronic device of each of the above embodiments, even a presbyopic person can see a focused display without wearing (removing) reading glasses. Furthermore, the display device or electronic device according to each of the above embodiments can reduce the burden on the eyes of a presbyopic observer and can be observed without adding reading glasses or other optical members.

Therefore, mobile devices such as mobile phones, digital cameras, electronic books, car navigation systems, PC monitor screens, etc. according to the above embodiments are not focused on reading glasses, and even in presbyopic people are in focus. You can see the display. Furthermore, even a person with hyperopia or nearsightedness can see a focused image (all displayed information such as characters as well as pictures) without using glasses.

For this reason, in the electronic device according to each of the above embodiments, even a person with presbyopia or myopia or astigmatism who cannot see the display with a normal electronic device understands the display content with a focused display and accurately Electronic devices can be operated.

As described above, the display device, the electronic device including the display device, and the projection unit according to the present invention are useful for mobile devices such as a mobile phone, an imaging device, a mobile phone including an FPD, a digital camera, and an electronic book.

DESCRIPTION OF SYMBOLS 1

Light exit point

1a, 1b, 1c Light exit point 2

Lens

2a, 2b, 2c Lens 3 Eye lens 4 Light exit point image 5

Retina

6a, 6b,

6c Lens image

7a, 7b, 7c,

7d Ray

8a, 8b , 8c,

8d Ray

9a, 9b

Light exit point

10a,

10b Point

11, 12, 13, 14 Light flux 15 Display device 16 Unit (projection unit)
17

Piezoelectric elements

18a, 18b, 18c Light

exit point group

19a, 19b, 19c Light exit

point group image

20a, 20b, 20c

Light exit point

21a, 21b, 21c Lens image 22 Microlens array 23 Light exit point group 24 Light exit point Image 25 Pupil 32 Camera 33 Digital camera 34 Release button 35 Mode button 36 Display device 37 Camera 38 Mobile phone 39 Display device 40 Numeric keypad 41 Transmission plate with periodic pattern 42 Frame 43 Micro lens array 44 Plate spring 45 Frame 46 Actuator 47 Leaf spring 48

Actuator

50, 51, 52, 53, 54

Pixel electrode

53a, 53b Region 201 Control unit 202 Memory 203 Pupil photographing unit 204 Drive mechanism 205 Calculation unit

Claims

A periodic pattern forming portion in which a periodic pattern is formed;
A microlens array that is arranged to face the periodic pattern forming unit and projects the periodic pattern onto the pupil of an observer;
An image position adjustment unit that follows the movement of the pupil with the image of the periodic pattern projected by the microlens array;
A display device comprising:
The display device according to claim 1, wherein a projection position of the image is adjusted to a position of the pupil.
The display device according to claim 1, further comprising a detection unit that detects the movement of the pupil.
4. The display device according to claim 3, wherein the detection unit includes a camera that photographs the pupil.
The periodic pattern is formed with a period Pp,
The microlens is formed with a period Lp,
5. The display device according to claim 1, wherein the period Pp and the period Lp satisfy the following conditional expression.
Lp / Pp = (Ff−F) / Ff
Here, F is the focal length of the microlens, and Ff is the distance between the microlens and the periodic pattern image.
The periodic pattern forming portion is
A display device;
A transmission plate having a periodic pattern for transmitting information displayed on the display device;
The display device according to claim 1, comprising:
The display device according to claim 6, wherein the image position adjustment unit moves the transmission plate and the microlens array integrally.
The display device according to claim 6, wherein the image position adjustment unit moves the display device, the transmission plate, and the microlens array integrally.
The display device according to claim 6, wherein the image position adjustment unit relatively moves the positions of the transmission plate and the microlens array.
The display device according to claim 6, wherein the image position adjusting unit moves a periodic pattern of the transmission plate.
11. The display device according to claim 6, wherein the transmission plate is a liquid crystal panel.
12. The display device according to claim 6, wherein the transmission plate is a pinhole array.
13. The display device according to claim 12, wherein a diameter of a projected image of pinholes constituting the pinhole array is smaller than a diameter of the pupil.
6. The display device according to claim 1, wherein the periodic pattern forming unit includes a display device having a periodic light emitting structure.
The display device according to claim 14, wherein the image position adjusting unit moves the display device and the microlens array integrally.
The display device according to claim 14, wherein the image position adjustment unit relatively moves the positions of the display device and the microlens array.
The display device according to claim 14, wherein the image position adjustment unit moves a light emission pattern of the display device.
The display device according to any one of claims 14 to 17, wherein the display device is an organic EL device.
An electronic apparatus comprising the display device according to any one of claims 1 to 18.
A periodic pattern forming portion in which a periodic pattern is formed;
A microlens array that is arranged to face the periodic pattern forming unit and projects the periodic pattern onto the pupil of an observer;
An image position adjustment unit that follows the movement of the pupil with the image of the periodic pattern projected by the microlens array;
A projection unit comprising:
An urging member and an actuator,
The display device according to claim 9, wherein the positions of the transmission plate and the microlens array are relatively moved.
The display device according to claim 5, further comprising a distance measuring unit that measures a distance to an observer, and changing a period of the periodic pattern according to the measured distance.
The display device according to claim 22, wherein the periodic pattern is displayed by a self-luminous display device.
The display device according to claim 22, wherein the lens of the microlens array is a liquid crystal lens.
The periodic pattern forming unit has a self-luminous display device,
6. The display device according to claim 1, wherein the periodic pattern forming unit also functions as an information pixel.