JP2013228573A - Electronic device with rsd function, control method for electronic device with rsd function, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device with an RSD function, in which even when the electronic device carried by an operator is swayed or the face of the operator is swayed, an image can be always shone on the retina of the operator.SOLUTION: An electronic device with an RSD function, includes: two cameras which are provided on the right and left with respect to an RSD as a center and adapted to image an eye of an operator; positional information acquisition means for acquiring, on the basis of image data imaged by each of the two cameras, positional information of eyes of the operator; a light source unit for receiving an image signal from the outside so as to output an image by laser beam; a horizontal scanning mirror for scanning in a horizontal direction the laser beam output from the light source unit; a vertical scanning mirror for scanning in a vertical direction laser beam reflected at the horizontal scanning mirror; a reflection mirror for reflecting at a predetermined angle laser beam reflected at the vertical scanning mirror; and reflection angle control means for controlling a reflection angle of the reflection mirror on the basis of positional information of the eyes.

Description

  The present invention relates to an electronic device with an RSD function, a method for controlling an electronic device with an RSD function, and a computer program.

  There is a mobile phone equipped with a retinal scanning display (hereinafter referred to as RSD) and two cameras mounted at equal intervals on the right and left of the RSD, hereinafter referred to as a mobile phone with a retinal scanning display. There are the following Patent Documents 1 to 5 as technologies related to the mobile phone with a retinal scanning display.

  In the technique described in Patent Document 1, two CCD cameras used for measuring the interocular distance of the observer are provided at locations where the visual field ahead of the observer is not obstructed. The left eye of the observer is imaged with one CCD camera, and the right eye of the observer is imaged with the other CCD camera, and the output of both cameras is given to the control unit. That is, the position of the pupil is calculated. The hologram combiner is designed on the basis of a state where the interocular distance is 65 mm. For people whose interocular distance is other than 65 mm, the incident angle of the image light to the hologram combiner is changed, and the convergence point of the light diffracted by the hologram combiner is changed to adjust the interocular distance. It is described.

  The technique described in Patent Document 2 is a virtual image on a retina of a user's eye through a telephone body having a wireless transmission / reception function of video and audio and an imaging optical system including a concave mirror optical system from video information driving unit. A virtual image optical display device is formed. It is described that the virtual image optical display device has a pre-shaped prism, makes light from the video information driving unit incident on the pre-shaped prism, and gives video light to the user's eyes from the light emission of the pre-shaped prism. Yes.

  Patent Document 3 describes that when scanning light whose optical path is changed by reflection of an optical member is incident on a human eye, an image is displayed two-dimensionally on the retina of the eye.

  The retinal projection display device described in Patent Document 4 uses Maxwell's vision in which an image is directly projected onto the retina through the pupil. For example, there is described a laser light source section that includes an imaging device such as a CCD and includes a semiconductor laser light source that outputs laser light in accordance with the output image data of digitized image data. In addition, there is described a MEMS scanning mirror unit that is driven according to image data output from the image data output unit and reflects laser light output from the laser light source unit toward the pupil of the user. In addition, a movable mirror that is provided on the optical path of the laser light reflected by the scanning mirror unit and reflects the laser beam, a pupil position detection unit that detects the movement of the pupil, and a posture of the movable mirror according to the movement of the pupil And a movable mirror control unit for controlling.

  In Patent Document 5, a retinal scanning display is provided with a display control unit, a light source unit, an optical fiber, an optical scanning unit, an eyepiece, and a focus unit. It describes that light emitted from a light source unit is scanned by an optical scanning unit, projected to the user with the pupil of one eye as a target through an eyepiece, and a display image is visually recognized by the user. It is described that the focus unit includes an infrared light source that emits infrared light, an infrared imaging unit that images a retinal projection, and a focus control unit that performs focus control.

Japanese Patent No. 3698582 JP 2002-290871 A Japanese Patent No. 4337652 JP 2009-122550 A JP 2010-134051 A

  The display of the mobile phone uses a display panel such as a liquid crystal or an organic EL. Also, many recent smartphones have a touch panel function added to the display panel. However, these display panels have a problem of poor visibility under direct sunlight. In addition, since the touch panel is operated with a finger, there is a problem that the display surface is soiled with finger grease.

  In order to solve such a problem, there is an example in which an RSD is incorporated in a mobile phone as in Patent Documents 1-5, but since a relay lens or the like is arranged in front of the eyes, an apparatus form such as a spectacle type is used. It was. This is because when the distance from the RSD light source to the eyes is increased, it is impossible to irradiate the retina with an image even with a slight angle shift.

  However, in such a form, every time an image is viewed, a glasses-type device must be put on, and there is a problem that convenience and portability as a mobile phone are lacking.

  An object of the present invention is to provide an RSD function-equipped electronic device capable of constantly irradiating an image on the retina of the operator, even if the electronic device held by the operator is shaken or the operator's face is shaken, RSD To provide a method for controlling an electronic device with a function and a computer program.

  In order to solve the above-described problem, according to the first embodiment of the present invention, there are two RSD function-equipped electronic devices that are provided on the left and right with the RSD and the RSD at the center, and each captures the eyes of the operator. And the position information acquisition means for acquiring the position information of the eyes of the operator based on the image data captured by each of the two cameras and the two cameras; A light source unit that outputs, a horizontal scanning mirror that scans the laser beam output from the light source unit in the horizontal direction, a vertical scanning mirror that scans the laser beam reflected by the horizontal scanning mirror in the vertical direction, and a reflection by the vertical scanning mirror A reflection mirror that reflects the laser beam at a predetermined angle, and a reflection angle control unit that controls a reflection angle of the reflection mirror based on eye position information.

  According to a second aspect of the present invention, there is provided a control method for an electronic device with an RSD function that arranges two cameras around the RSD and images the eyes of the operator. Based on the captured eye image data, a step of acquiring the operator's position information, a step of irradiating a laser beam based on an external video signal, and a position of the operator's eye And a step of moving the reflecting mirror so that the laser beam from the RSD can be irradiated.

  According to the third aspect of the present invention, a light source unit that receives an image signal from the outside and outputs an image with laser light, a horizontal scanning mirror that horizontally scans the laser light output from the light source unit, and a horizontal RSD having a vertical scanning mirror that scans the laser beam reflected by the scanning mirror in the vertical direction, a reflection mirror that reflects the laser beam reflected by the vertical scanning mirror at a predetermined angle, and a right and left centered on the RSD. A computer program for controlling an electronic device with an RSD function, each having two cameras that capture the eyes of an operator, the computer based on image data captured by each of the two cameras Position information acquisition means for acquiring eye position information of the operator, reflection angle control means for controlling the reflection angle of the reflection mirror based on the eye position information, and To function Te.

  In the present invention, the cameras on both sides of the RSD recognize the positional relationship between the operator's eyes and the mobile phone, so that the reflecting mirror provided in the RSD is appropriately moved, and the laser beam is always transmitted to the operator. Can be irradiated to the eyes.

  As a result, there is no need to fix the positional relationship between the mobile phone and the operator, so the operator can view the image while holding the mobile phone in hand, so that the image can be viewed while operating. There is.

It is a block diagram of the mobile telephone with an RSD function by 1st Embodiment of this invention. It is a block diagram of RSD in FIG. It is a figure which shows a reflective mirror and a piezoelectric element. It is explanatory drawing for demonstrating the operation | movement of RSD. It is a block diagram of the mobile telephone with an RSD function by 2nd Embodiment of this invention.

  A first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an appearance of a mobile phone 1 according to the first embodiment of the present invention.

  As shown in FIG. 1, a display panel 10 is provided on the surface of the mobile phone 1 according to the first embodiment of the present invention, an RSD 12 is mounted on the upper side thereof, and cameras 14L and 14R are respectively provided on the left and right sides thereof. Installed.

  FIG. 2 shows a cross-sectional view of the mobile phone where the RSD 12 is located. The RSD 12 includes a light source unit 20 that receives an image signal from the outside and outputs an image with RGB laser light, a horizontal scanning mirror 22, a vertical scanning mirror 24, a collimator lens 26, a reflection mirror 28, and a focus adjustment lens 30. .

  Since the RSD 12 uses the afterimage effect of the human eye, the laser light output from the light source unit 20 first strikes the horizontal scanning mirror 22. The horizontal scanning mirror 22 is connected to a drive system such as a motor (not shown), and is a mirror that moves at high speed in the horizontal direction with respect to an image.

  The laser beam reflected by the horizontal scanning mirror 22 then strikes the vertical scanning mirror 24. The vertical scanning mirror 24 is also connected to a motor or the like, and is a mirror that moves at high speed in the vertical direction with respect to the image.

  FIG. 3 is a configuration diagram of the reflecting mirror 28 in FIG. As shown in FIG. 3, a voltage corresponding to the tilt angle of the target mirror is applied to the piezoelectric element 40, so that the piezoelectric element 40 expands and contracts according to the voltage and tilts at a desired tilt. .

  The laser beam reflected by the vertical scanning mirror 24 finally hits the reflection mirror 28. As shown in FIG. 3, the reflection mirror 28 can be tilted in a desired direction by a plurality of piezoelectric elements 40 or the like, and even if the operator's face moves, the piezoelectric element 40 does not move. By tilting the reflecting mirror 28, the laser beam can be irradiated to the operator's eyes.

  Further, there is a focus adjustment lens 30 at the tip of the reflection mirror 28, which focuses on the front and rear according to the distance between the mobile phone 1 and the operator.

  FIG. 4 is an explanatory diagram of the operation of the mobile phone 1 of FIG. When the operator holds the mobile phone 1 and activates the RSD 12, the left camera 14L and the right camera 14R on the left and right of the RSD 12 are also activated simultaneously. The two cameras 14L and 14R continue to take images of the operator's face. The light source unit 20 emits R, G, and B laser light source lasers corresponding to the image data output from the cameras 14L and 14R, and outputs the image data.

  The operator previously sets the eye (right eye or left eye) that receives the image irradiation of the RSD 12 in the mobile phone 1. Image data of the operator's face captured by each of the cameras 14L and 14R is sent to the CPU 56. The CPU 56 calculates position information of the eyes to be irradiated from image data of the operator's face captured by the cameras 14L and 14R, and functions as position information acquisition means. Then, the calculated distance and angle data from the mobile phone 1 to the eyes are sent to the controller 58.

  The controller 58 moves the piezoelectric element 40 and the focus adjustment lens 30 so as to adjust the angle of the reflection mirror 28 so that the laser beam hits the eye of the operator from the distance from the mobile phone 1 to the eye and the angle data 57. The signal is sent to the piezoelectric element 40 and the focus adjustment lens 30. Thus, it functions as a reflection angle control means and a focus adjustment control means.

  The piezoelectric element 40 expands and contracts according to the received signal and moves the reflecting mirror 28 to an appropriate position. In parallel, when the operator moves his / her face close to or away from the mobile phone 1, an appropriate focus is obtained by moving the focus adjustment lens 30 back and forth.

  In this way, even if the operator moves his face or the mobile phone 1 moves, the cameras 14L and 14R always shoot the face of the operator, and accordingly the reflection mirror 28 and the focus adjustment lens. 30 moves. As a result, the operator can always receive an image from the RSD 12 with the eyes.

  Further, according to the present invention, the cameras 14L and 14R on both sides of the RSD 12 recognize the positional relationship between the operator's eyes and the mobile phone 1, thereby appropriately moving the reflection mirror 28 provided in the RSD 12, and the laser. The light can always be irradiated to the operator's eyes.

  As a result, since it is not necessary to fix the positional relationship between the mobile phone 1 and the operator, the operator can view the image while holding the mobile phone 1 in his / her hand. effective.

  Further, by making all the displays RSD, it is possible to eliminate the display LCD and the organic EL. As a result, a large display panel is not necessary, and the mobile phone can be made small. In addition, since the RSD directly captures an image on the retina without being affected by visual acuity, a clear image can be seen even under direct sunlight.

  FIG. 5 shows a mobile phone 100 according to the second embodiment. Components that are substantially the same as those in FIG. 1 are denoted by the same reference numerals. In the first embodiment, the display panel and the RSD are mounted. However, in the second embodiment, only the RSD 12 is used as shown in FIG. Therefore, in the first embodiment, the operator uses the display panel and the RSD 12 properly, but the display panel is large, so the size of the device itself is larger than the display panel.

  However, if the display panel is eliminated as in the second embodiment, the surface of the mobile phone 100 can be configured with only the touch panel 102 or the keys, so that the apparatus can be downsized.

  The present invention can be applied to a mobile phone with an RSD function, a digital camera, a video display device, and the like.

1, 100 Mobile phone with RSD function 10 Display panel 12 RSD
14L, 14R Camera 20 Light source unit 22 Horizontal scanning mirror 24 Vertical scanning mirror 28 Reflecting mirror 30 Focus adjustment lens 40 Piezoelectric element 102 Touch panel

Claims (4)

RSD,
Two cameras provided on the left and right with the RSD as the center, respectively, for imaging the eyes of the operator
Position information acquisition means for acquiring position information of the eyes of the operator based on image data captured by each of the two cameras;
A light source unit that receives an image signal from the outside and outputs an image with a laser beam;
A horizontal scanning mirror that horizontally scans the laser beam output from the light source unit;
A vertical scanning mirror that vertically scans the laser beam reflected by the horizontal scanning mirror;
A reflection mirror that reflects the laser beam reflected by the vertical scanning mirror at a predetermined angle;
An electronic device with an RSD function, comprising: a reflection angle control unit that controls a reflection angle of the reflection mirror based on the position information of the eyes. Focusing means;
The electronic device with RSD function according to claim 1, further comprising: a focus adjustment control unit that controls a focus position of the focus adjustment unit based on the position information. A method of controlling an electronic device with an RSD function that arranges two cameras around the RSD and images the eyes of an operator,
Obtaining position information of the operator based on the image data of the eyes imaged by the two cameras;
Irradiating a laser beam based on an external video signal;
A method of controlling an electronic device with an RSD function, comprising: moving a reflection mirror so that the laser beam from the RSD can be irradiated to the eyes of the operator based on the position information of the operator. A light source unit that receives an image signal from the outside and outputs an image with laser light, a horizontal scanning mirror that horizontally scans the laser light output from the light source unit, and the laser reflected by the horizontal scanning mirror An RSD having a vertical scanning mirror that scans light in a vertical direction, and a reflection mirror that reflects the laser light reflected by the vertical scanning mirror at a predetermined angle, are provided on the left and right with the RSD as a center, respectively. A computer program for controlling an electronic device with an RSD function having two cameras for imaging a person's eyes,
The computer,
Position information acquisition means for acquiring position information of the eyes of the operator based on image data captured by each of the two cameras;
A computer program that functions as reflection angle control means for controlling the reflection angle of the reflection mirror based on the eye position information.

Images