US20160321970A1 - Display device, head-mounted display device, display system, and control method for display device - Google Patents
Display device, head-mounted display device, display system, and control method for display device Download PDFInfo
- Publication number
- US20160321970A1 US20160321970A1 US15/208,992 US201615208992A US2016321970A1 US 20160321970 A1 US20160321970 A1 US 20160321970A1 US 201615208992 A US201615208992 A US 201615208992A US 2016321970 A1 US2016321970 A1 US 2016321970A1
- Authority
- US
- United States
- Prior art keywords
- display
- image
- image screen
- user
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 13
- 210000003128 head Anatomy 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 4
- 230000003287 optical effect Effects 0.000 description 25
- 230000006870 function Effects 0.000 description 10
- 208000003464 asthenopia Diseases 0.000 description 5
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 210000001525 retina Anatomy 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000011347 resin Substances 0.000 description 2
- 229920005989 resin Polymers 0.000 description 2
- 230000002207 retinal effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
- G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
Definitions
- the present invention relates to a transmission-type display device, a head-mounted display device, a display system and a control method for a display device for making the user visually recognize a display image screen as a virtual image.
- an optical transmission-type head-mounted display device mounted on the user's head is known (see JP-A-2012-163637).
- This display device is configured in such a way that the user can visually recognizes an image as a virtual image and can also directly visually recognize the exterior (real scenery).
- the display device of this type uses a light guide panel having a half mirror portion to make the user visually recognize a virtual image. That is, the display device is configured to reflect and guide image light to the user's eyes by the half mirror portion, thereby making the user visually recognize a display image screen as a virtual image in the user's field of vision.
- the related-art configuration can lead to eye fatigue and sick feeling due to the user's shifting his/her line of sight out of the display image screen (half mirror portion). That is, as the user shifts his/her line of sight out of the display image screen, the line of sight shifts to a part where there is no half mirror portion of the light guide panel and therefore the user sees the exterior through that part. Consequently, the field of vision can be distorted, causing the user to feel uncomfortable and leading to eye fatigue and sick feeling. Moreover, it is also conceivable that the line of sight may shift out of the light guide panel. In such a case, moving the line of sight into and out of the light guide panel can involve repeated focusing and therefore can lead to eye fatigue and sick feeling.
- An advantage of some aspects of the invention is to provide a display device, a head-mounted display device, a display system and a control method for a display device that can restrain the shift of the user's line of sight out of the display image screen, to the utmost.
- An aspect of the invention is directed to a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Another aspect of the invention is directed to a transmission-type head-mounted display device which is mounted on a user's head and makes the user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Still another aspect of the invention is directed to a transmission-type display system which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Yet another aspect of the invention is directed to a control method for a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: causing a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and displaying the guide image.
- center used here may refer to the center in vertical direction of the display image screen or may be the center in horizontal direction of the display image screen. The center may also be the center both in vertical direction and in horizontal direction.
- the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the center of the display image screen by using the perspective method, to be displayed as the guide image on the display image screen.
- the plural image objects are one of icon, menu, and reduced application window.
- the image objects are converted in such a way that the longitudinal direction of the image objects corresponds to the direction of depth (direction of concentration lines) so that the image objects can easily function as concentration lines. Also, it is preferable that the image objects before conversion have a substantially rectangular outer shape so that the image objects can easily function as concentration lines.
- the display control unit causes plural guide lines extending toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- the user's line of sight can be guided effectively, using the plural guide lines extending toward the center from the outer edge side.
- the display control unit causes one of a frame-like image surrounding the center of the display image screen and a ring-shaped image surrounding the center of the display image screen, to be displayed as the guide image on the display image screen.
- the user's line of sight can be guided effectively, using the frame-like image or the ring-shaped image.
- the display control unit causes a gradation image which becomes darker toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- the user's line of sight can be guided effectively. It should be noted that a different technique may be used to guide the user's line of sight, with a guide image that generates a perspective optical illusion regarding the center as the back end.
- the display control unit causes plural moving objects that move toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- the user's line of sight can be guided effectively, using the moving objects.
- the display control unit causes the guide image to be displayed, avoiding a predetermined area at the center of the display image screen.
- the user's line of sight can be guided effectively by displaying the guide image avoiding the area at the center. Also, since the area to allow a view of the exterior can be secured at the center of the field of vision, visibility of the exterior can be improved.
- the display unit includes an image light output unit which outputs image light, and a light guide unit which guides the outputted image light to the user's eyes, and that the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
- a transmission-type display device which has a simple configuration and is inexpensive can be provided, by using a so-called virtual image projection-type display device.
- FIG. 1 is an explanatory view showing the outer configuration of a head-mounted display device according to an embodiment.
- FIG. 2 illustrates an example of a virtual image and exterior that the user can visually recognize.
- FIG. 3 is a block diagram illustrating the control configuration of the head-mounted display device.
- FIG. 4 illustrates a display image screen
- FIG. 5 illustrates a display image screen according to a first modification.
- FIG. 6 illustrates a display image screen according to a second modification.
- FIGS. 7A to 7C show image transition illustrating a display image screen according to a third modification.
- the head-mounted display device is a display device mounted on the user's head and also called HMD (head mounted display).
- the head-mounted display device of this embodiment is a optical transmission-type head-mounted display device (transmission-type head-mounted display device, see-through-type head-mounted display) which makes the user visually recognize an image as a virtual image and also enables direct visual recognition of the exterior (real scenery), and is in the form of spectacles (goggles).
- a head-mounted display device 1 includes a right holding section 11 , a right display drive section 12 , a left holding section 13 , a left display drive section 14 , a right optical image display section 15 , a left optical image display section 16 , a right earphone 18 for right ear, and a left earphone 19 for left ear.
- the right optical image display section 15 and the left optical image display section 16 are arranged at the positions corresponding to the front of the user's right and left eyes when the user wears the head-mounted display device 1 .
- One end of the right optical image display section 15 and one end of the left optical image display section 16 are connected together at the position corresponding to the user's glabella when the user wears the head-mounted display device 1 .
- the right holding section 11 extends from an end ER, which is the other end of the right optical image display section 15 .
- the left holding section 13 extends from an end EL, which is the other end of the left optical image display section 16 .
- the right holding section 11 is a member extending substantially at right angles to the right optical image display section 15 , from the end ER of the right optical image display section 15 to the position corresponding to the user's temporal region when the user wears the head-mounted display device 1 .
- the left holding section 13 is a member extending substantially at right angles to the left optical image display section 16 , from the end EL of the left optical image display section 16 to the position corresponding to the user's temporal region when the user wears head-mounted display device 1 .
- the right holding section 11 and the left holding section 13 hold the head-mounted display device 1 on the user's head, like the temples (bows, earpieces) of spectacles.
- the right display drive section 12 is arranged on the inner side of the right holding section 11 , that is, on the side facing the user's head when the user wears the head-mounted display device 1 and on the side of the end ER of the right optical image display section 15 .
- the left display drive section 14 is arranged on the inner side of the left holding section 13 and on the side of the end EL of the left optical image display section 16 .
- the right earphone 18 and the left earphone 19 are mounted on the user's right and left ears, respectively, and output various sounds to the right and left ears, when the user wears head-mounted display device 1 .
- FIG. 2 in the field of vision 21 of the user wearing the head-mounted display device 1 , a display image screen 26 generated by the head-mounted display device 1 is displayed as a virtual image 22 .
- a display image screen 26 where plural icons 81 for calling each application are arranged is displayed, and the display image screen 26 is displayed in the entire range of a virtual image display area 27 where the virtual image 22 is displayed (the virtual image 22 can be displayed).
- a GUI graphical user interface
- the display image screen 26 a GUI (graphical user interface) that improves visibility of the exterior 23 and guides the line of sight to the center of the display image screen 26 is realized by the display image screen 26 .
- the user can view the exterior 23 through the right optical image display section 15 and the left optical image display section 16 . That is, the device is configured in such a way that the user can visually recognize the virtual image 22 and the exterior 23 at the same time within the field of vision 21 .
- the head-mounted display device 1 includes a display unit 30 which makes the user visually recognize the virtual image 22 , the right earphone 18 , the left earphone 19 , a power supply unit 32 , an interface 33 , and a control unit 34 which controls each of these units.
- the power supply unit 32 supplies electric power to each part of the head-mounted display device 1 .
- the interface 33 is for connecting various external devices OA which serve as sources of contents such as images (still images, dynamic images), sounds and the like.
- the external devices OA may include, for example, personal computer (PC), potable terminal (mobile phone, smartphone or the like), gaming terminal and the like.
- a USB interface, micro USB interface, memory card interface, wireless LAN interface or the like can be employed as the interface 33 .
- the display unit 30 includes the right display drive section (image light output unit) 12 , the left display drive section (image light output unit) 14 , a right light guide panel (light guide unit) 46 as the right optical image display section 15 , and a left light guide panel (light guide unit) 47 as the left optical image display section 16 .
- the right display drive section 12 includes a right backlight (BL) control unit 51 and right backlight (BL) 52 which function as a light source, a right LCD (liquid crystal display) control unit 53 and right LCD 54 which function as a display element, and a right projection system 55 .
- BL right backlight
- BL right backlight
- BL right backlight
- LCD liquid crystal display
- the right backlight control unit 51 controls driving of the right backlight 52 , based on an inputted control signal.
- the right backlight 52 is, for example, a light emitting body such as LED (light emitting diode) or electroluminescence (EL).
- the right LCD control unit 53 controls driving of the right LCD 54 , based on inputted display data.
- the right LCD 54 is a transmission-type liquid crystal panel in which plural pixels are arranged in a matrix.
- the right projection system 55 is configured to project (output) image light emitted from the right LCD 54 and uses, for example, a collimating lens.
- the right light guide panel 46 as the right optical image display section 15 is made of a light-transmitting resin material or the like and has a half mirror layer HM.
- the half mirror layer HM guides the image light outputted from the right projection system 55 to the user's right eye while reflecting the image light along a predetermined optical path.
- the right light guide panel 46 also transmits external light (light from the exterior 23 ) and causes the external light to become incident on the user's eye together with the image light.
- the half mirror layer HM forms the virtual image display area 27 .
- the user's line of sight is within the virtual image display area 27 , the user sees the half mirror layer HM and therefore sees the exterior 23 through the half mirror layer HM. Meanwhile, if the user's line of sight shifts out of the virtual image display area 27 , the user sees a part that is not the half mirror layer HM of the right light guide panel 46 and therefore ends up seeing the exterior 23 through that part.
- the left display drive section 14 includes a left backlight (BL) control unit 61 , a left backlight (BL) 62 , a left LCD control unit 63 , a left LCD 64 , and a left projection system 65 , similarly to the right display drive section 12 .
- the configuration and function of each element included in the left display drive section 14 are similar to those of each element included in the right display drive section 12 and therefore will not be described further in detail here.
- the left light guide panel 47 as the left optical image display section 16 is made of a light-transmitting resin material or the like and has a half mirror layer HM.
- the half mirror layer HM guides the image light outputted from the left projection system 65 to the user's left eye while reflecting the image light along a predetermined optical path.
- the left light guide panel 47 also transmits external light and causes the external light to become incident on the user's eye together with the image light.
- the half mirror layer HM forms the virtual image display area 27 , as in the right light guide panel 46 .
- the user visually recognizes the virtual image 22 (display image screen 26 ) within the virtual image display area 27 , for example, as shown in FIG. 2 .
- forming an image on the retina with the image light is referred to as “display” or “to display”.
- the control unit 34 has a CPU (central processing unit) 67 and a storage unit 68 .
- the storage unit 68 includes a ROM (read only memory), RAM (random access memory) and the like and stores various computer programs.
- the CPU 67 reads out and executes the computer programs from the storage unit 68 , thereby functioning as an operating system (OS) 71 , a display control unit 74 , a display state control unit 75 , an audio processing unit 76 , and an application execution unit 77 .
- OS operating system
- the display control unit 74 generates display data and transmits the display data to the display unit 30 (right LCD control unit 53 and left LCD control unit 63 ).
- the display control unit 74 generates display data of the display image screen 26 where the plural icons 81 are arranged, and transmits this display data to the display unit 30 .
- This causes the display unit 30 to display the display image screen 26 and to display the plural icons 81 on the display image screen 26 . That is, in the head-mounted display device 1 , the display control unit 74 generates the display data of the display image screen 26 and transmits the display data to the display unit 30 (display control process), and the display unit 30 displays the display image screen 26 including the plural icons 81 (forms an image on the retina with image light), based on the transmitted display data (display process).
- the display state control unit 75 generates a control signal to control the right display drive section 12 and the left display drive section 14 and transmits the control signal to the display unit 30 , thus controlling the image display state in the display unit 30 .
- the display state control unit 75 separately controls, with the control signal, ON/OFF of the driving of the right LCD 54 by the right LCD control unit 53 , ON/OFF of the driving of the right backlight 52 by the right backlight control unit 51 , ON/OFF of the driving of the left LCD 64 by the left LCD control unit 63 , ON/OFF of the driving of the left backlight 62 by the left backlight control unit 61 , and the like, and thus controls the generation and emission of the image light by each of the right display drive section 12 and the left display drive section 14 .
- the audio processing unit 76 transmits an audio signal to the right earphone 18 and the left earphone 19 and causes the right earphone 18 and the left earphone 19 to output the audio.
- the application execution unit 77 executes each application according to the user's operation using the display image screen 26 .
- the icons 81 of the display image screen 26 are configured to be selectable (clickable) by a controller, not shown, and the application execution unit 77 accepts the selection of an icon 81 and executes (starts up) the application corresponding to the icon 81 .
- the display image screen 26 of the head-mounted display device 1 is, for example, the home screen of the head-mounted display device 1 .
- the display image screen 26 includes plural icons (image objects) 81 arranged on the left and right in the display image screen 26 , a perspective guide 82 formed in the entire area of the display image screen 26 except the center, and a double circle-like target 83 arranged at the center of the display image screen 26 .
- a vision securing area (predetermined area) 84 to view the exterior 23 is set in advance at the center of the display image screen 26 .
- the background of the display image screen 26 is fully transmissive.
- the plural icons 81 are arranged only in left and right escape areas 85 avoiding the vision securing area 84 .
- the plural icons 81 are divided into two groups in the left and right escape areas 85 and arranged in the respective escape areas 85 .
- a rectangular icon image converted into a perspective image using the perspective method is arranged.
- a rectangular icon image converted into a perspective image that has a vanishing point at the center of the display image screen 26 and faces inward to the vision securing area 84 (toward the vision securing area 84 ) is arranged. That is, a rectangular icon image provided with perspective is arranged.
- the rectangular icon images of the plural icons 81 are displayed as if these icons images were sticking to the left and right walls from a perspective point of view from the user.
- the perspective guide 82 includes plural first guide lines 91 corresponding to vanishing lines to the vanishing point at the center of the display image screen 26 , plural second guide lines 92 corresponding to horizontal lines, and plural third guide lines 93 corresponding to vertical lines.
- the plural first guide lines 91 extend toward the center from the outer edge side of the display image screen 26 .
- the plural first guide lines 91 extend from the outer edge of the display image screen 26 up to points short of the vision securing area 84 , avoiding the vision securing area 84 .
- guide lines mentioned in the appended claims is formed by the first guide lines 91 .
- the plural second guide lines 92 are arranged in top and bottom end parts of the display image screen 26 , extending in left and right directions and avoiding the vision securing area 84 .
- the plural third guide lines 93 are arranged in left and right end parts of the display image screen 26 , extending in up and down directions and avoiding the vision securing area 84 . Therefore, in the top and bottom end parts of the display image screen 26 , the first guide lines 91 and the second guide lines 92 form the top and bottom walls from a perspective point of view. Meanwhile, in the left and right end parts of the display image screen 26 , the first guide lines 91 and the third guide lines 93 form the left and right walls from a perspective point of view. That is, the first guide lines 91 , the second guide lines 92 and the third guide lines 93 form a room-like (box-like) shape without front and rear walls from a perspective point of view.
- the target 83 includes two ring-shaped images 94 surrounding the center of the display image screen 26 .
- the two ring-shaped images 94 are formed as concentric circles having different diameters and a center point at the center of the display image screen 26 .
- the plural icons 81 , the perspective guide 82 and the target 83 as described above function as a guide image that restrains the shift of the user's line of sight out of the display image screen 26 and guides the line of sight to the center of the display image screen 26 (toward the center). Also, as the plural icons 81 and the perspective guide 82 are arranged avoiding the vision securing area 84 , the field of vision 21 for the exterior 23 can be secured. That is, the GUI based on the display image screen 26 has both a vision securing function and a line of sight guiding function.
- the shift of the user's line of sight out of the display image screen 26 can be restrained to the utmost. That is, the user can be prompted (guided) to change the orientation of the body or the orientation of the head to shift the field of vision, instead of moving the eyes. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling.
- the plural icons 81 since the plural icons 81 with perspective having a vanishing point at the center of the display image screen 26 , the plural icons 81 for calling applications can be used to guide the user's line of sight. Also, the plural icons 81 generate a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
- the user's line of sight can be guided effectively.
- the perspective guide 82 generates a perspective optical illusion regarding the center as the back end and therefore can guide the user's line of sight more effectively.
- the user's line of sight can be effectively guided.
- the plural icons 81 and the perspective guide 82 are displayed avoiding the center area, the user's line of sight can be effectively guided. Moreover, since an area where the exterior 23 can be seen can be secured at the center of the field of vision 21 , visibility of the exterior 23 can be improved.
- the target 83 in the embodiment is formed by the ring-shaped images 94
- the target 83 may also be formed by two frame-like images 101 surrounding the center of the display image screen 26 , as shown in FIG. 5 .
- the target 83 may be formed by a single ring-shape image 94 or a single frame-like image 101 .
- a gradation image 102 that becomes darker toward the center from the outer edge side of the display image screen 26 may be displayed as a guide image on the display image screen 26 , as shown in FIG. 6 .
- the bright-dark gradation image 102 generates a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
- plural moving objects 103 moving toward the center from the outer edge side of the display image screen 26 are displayed as a guide image on the display image screen 26 , as shown in FIGS. 7A to 7C . According to this configuration, the user's line of sight can be effectively guided by using the moving objects 103 .
- the guide image is not limited to the above examples as long as the guide image guides the user's line of sight to the center (toward the center of the display image screen 26 or to the center part of the display image screen 26 ).
- the user's line of sight may be guided by adjusting the size of letters in the text.
- escape areas 85 in the embodiment are the left and right areas avoiding the vision securing area 84 (left and right escape areas), the escape areas 85 may be top and bottom areas avoiding the vision securing area 84 (top and bottom escape areas). Also, all the other areas than the vision securing area 84 , of the virtual image display area 27 , may be the escape areas 85 .
- the vision securing area 84 is the area at the center of the display image screen 26 (center of the user's field of vision 21 ) in the embodiment, this example is not limiting.
- the bottom half of the display image screen 26 may be used as the vision securing area 84 in order to secure the field of vision at the user's feet, or the left or right half or the top half of the display image screen 26 maybe used as the vision securing area 84 .
- the vision securing area 84 is not limited to a rectangular area and may be a circular or elliptic area.
- the head-mounted display device 1 further includes an object detection unit which detects the position of a predetermined real object in the user's field of vision. If the predetermined real object is situated within the vision securing area 84 as a result of the detection by the object detection unit, the display control unit 74 causes the plural icons 81 to be displayed in the escape areas 85 . If the predetermined real object is situated in the escape areas 85 , the display control unit 74 causes the plural icons 81 to be displayed in the vision securing area 84 .
- the plural icons 81 are displayed on the display image screen 26 in the embodiment, this example is not limited as long as an image object for calling applications is displayed on the display image screen 26 .
- a menu representing each application or a reduced application window may be displayed on the display image screen 26 .
- plural image objects for calling each file or each folder may be displayed on the display image screen 26 , instead of the plural image objects for calling each application.
- image objects to carry out each user operation for example, radio button, select button, soft keyboard or the like
- each of the image objects is displayed as an image converted into a perspective image having a vanishing point at the center of the display image screen 26 .
- the head-mounted display device 1 may have a controller, not shown, and the controller may be equipped with a part or all of the display control unit 74 , the display state control unit 75 , the audio processing unit 76 and the application execution unit 77 .
- the controller may be wire-connected to the control unit 34 or the display unit 30 and the like (display unit 30 , right earphone 18 and left earphone 19 ) via a cord or the like, or may be wirelessly connected to the control unit 34 or the display unit 30 and the like via wireless LAN, infrared communication, Bluetooth (trademark registered) or the like.
- the functions of the controller may also be realized by a personal computer (PC), a portable information terminal (PDA, mobile phone, watch-type portable terminal, smartphone) or the like.
- the head-mounted display device 1 for both eyes is illustrated as an example of the display device in the embodiment, the invention may also be applied to, for example, other formats of head-mounted display device such as a single-eye type.
- the head-mounted display device 1 of a spectacles type covering the front of the eyes is illustrated, this example is not limited and the invention can also be applied to a head-mounted display device of a type that does not completely cover the front of the eyes (a type that partly covers the front of the eyes).
- the invention can also be applied to other display devices than the head-mounted display device, such as head-up display.
- the image light output unit in the embodiment has the backlight control units (right backlight control unit 51 and left backlight control unit 61 ), the backlights (right backlight 52 and left backlight 62 ), the LCD control units (right LCD control unit 53 and left LCD control unit 63 ), and the LCDs (right LCD 54 and left LCD 64 ), this embodiment is simply an example.
- the image light output unit may have a component unit to realize a different method, in addition to or instead of these component units.
- the image light output unit may have an organic EL (organic electro-luminescence) display and an organic EL control unit.
- the image light output unit may have an LCOS (liquid crystal on silicon; LCOS is a trademark registered) or digital micro mirror device or the like, instead of the LCDs.
- the invention is applied to the so-called virtual image projection-type head-mounted display device 1 (head-mounted display) in the embodiment, the invention may also be applied to, for example, a laser retinal projection-type (so-called retinal scan-type) head-mounted display device.
- a laser retinal projection-type so-called retinal scan-type
- the image light output unit in the embodiment has the projection systems (right projection system 55 and left projection system 65 ) and is configured to project image light emitted from the LCDs
- the image light output unit may have, for example, a scanning system including a MEMS mirror instead of the projection system and may have a signal light modulation unit (signal light forming unit) which emits signal light to the scanning system.
- the signal light formed and emitted from the signal light modulation unit becomes incident on the scanning system (MEMS mirror) as a scanning unit.
- the scanning system emits the signal light as scanning light to a light guide member having a half mirror layer, and the scanning light is scanned on the surface of the half mirror layer, thus forming a virtual image with the image light. As the user's eyes catch this virtual image, the user can recognize the image.
- the invention may also be applied to a display system in which the head-mounted display device 1 and an external device OA or external server are connected to each other via a network.
- the external device OA or external server side is equipped with a part or all of the display control unit 74 , the display state control unit 75 , the audio processing unit 76 and the application execution unit 77 .
Abstract
A transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, including a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen, and a display unit which displays the guide image. The display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
Description
- The present of application is a continuation application of U.S. patent application Ser. No. 14/328,065 filed Jul. 10, 2014, which claims priority from Japanese Patent Application No. 2013-158575 filed Jul. 31, 2013, which are expressly incorporated by reference herein.
- 1. Technical Field
- The present invention relates to a transmission-type display device, a head-mounted display device, a display system and a control method for a display device for making the user visually recognize a display image screen as a virtual image.
- 2. Related Art
- According to the related art, as a display device of this type, an optical transmission-type head-mounted display device mounted on the user's head is known (see JP-A-2012-163637). This display device is configured in such a way that the user can visually recognizes an image as a virtual image and can also directly visually recognize the exterior (real scenery).
- Meanwhile, the display device of this type uses a light guide panel having a half mirror portion to make the user visually recognize a virtual image. That is, the display device is configured to reflect and guide image light to the user's eyes by the half mirror portion, thereby making the user visually recognize a display image screen as a virtual image in the user's field of vision.
- However, the related-art configuration can lead to eye fatigue and sick feeling due to the user's shifting his/her line of sight out of the display image screen (half mirror portion). That is, as the user shifts his/her line of sight out of the display image screen, the line of sight shifts to a part where there is no half mirror portion of the light guide panel and therefore the user sees the exterior through that part. Consequently, the field of vision can be distorted, causing the user to feel uncomfortable and leading to eye fatigue and sick feeling. Moreover, it is also conceivable that the line of sight may shift out of the light guide panel. In such a case, moving the line of sight into and out of the light guide panel can involve repeated focusing and therefore can lead to eye fatigue and sick feeling.
- An advantage of some aspects of the invention is to provide a display device, a head-mounted display device, a display system and a control method for a display device that can restrain the shift of the user's line of sight out of the display image screen, to the utmost.
- An aspect of the invention is directed to a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Another aspect of the invention is directed to a transmission-type head-mounted display device which is mounted on a user's head and makes the user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Still another aspect of the invention is directed to a transmission-type display system which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
- Yet another aspect of the invention is directed to a control method for a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: causing a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and displaying the guide image.
- According to these configurations, since the guide image for guiding the user's line of sight to the center of the display image screen is displayed, the shift of the user's line of sight out of the display image screen can be restrained to the utmost. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling. The term “center” used here may refer to the center in vertical direction of the display image screen or may be the center in horizontal direction of the display image screen. The center may also be the center both in vertical direction and in horizontal direction.
- In the display device described above, it is preferable that the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the center of the display image screen by using the perspective method, to be displayed as the guide image on the display image screen.
- In this case, it is preferable that the plural image objects are one of icon, menu, and reduced application window.
- According to these configurations, by adding perspective to the plural image objects with a vanishing point at the center of the display image screen, it is possible to cause the plural image objects to function as concentration lines. Therefore, the user's line of sight can be guided, using the plural image objects for calling applications. It is preferable that the image objects are converted in such a way that the longitudinal direction of the image objects corresponds to the direction of depth (direction of concentration lines) so that the image objects can easily function as concentration lines. Also, it is preferable that the image objects before conversion have a substantially rectangular outer shape so that the image objects can easily function as concentration lines.
- Also, it is preferable the display control unit causes plural guide lines extending toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- According to this configuration, the user's line of sight can be guided effectively, using the plural guide lines extending toward the center from the outer edge side.
- Moreover, it is preferable that the display control unit causes one of a frame-like image surrounding the center of the display image screen and a ring-shaped image surrounding the center of the display image screen, to be displayed as the guide image on the display image screen.
- According to this configuration, the user's line of sight can be guided effectively, using the frame-like image or the ring-shaped image.
- Furthermore, it is preferable that the display control unit causes a gradation image which becomes darker toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- According to this configuration, since the bright-dark gradation image generates a perspective optical illusion regarding the center as the back end, the user's line of sight can be guided effectively. It should be noted that a different technique may be used to guide the user's line of sight, with a guide image that generates a perspective optical illusion regarding the center as the back end.
- Also, it is preferable that the display control unit causes plural moving objects that move toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
- According to this configuration, the user's line of sight can be guided effectively, using the moving objects.
- Meanwhile, it is preferable that the display control unit causes the guide image to be displayed, avoiding a predetermined area at the center of the display image screen.
- According to this configuration, the user's line of sight can be guided effectively by displaying the guide image avoiding the area at the center. Also, since the area to allow a view of the exterior can be secured at the center of the field of vision, visibility of the exterior can be improved.
- Also, it is preferable that the display unit includes an image light output unit which outputs image light, and a light guide unit which guides the outputted image light to the user's eyes, and that the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
- According to this configuration, a transmission-type display device which has a simple configuration and is inexpensive can be provided, by using a so-called virtual image projection-type display device.
- The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
-
FIG. 1 is an explanatory view showing the outer configuration of a head-mounted display device according to an embodiment. -
FIG. 2 illustrates an example of a virtual image and exterior that the user can visually recognize. -
FIG. 3 is a block diagram illustrating the control configuration of the head-mounted display device. -
FIG. 4 illustrates a display image screen. -
FIG. 5 illustrates a display image screen according to a first modification. -
FIG. 6 illustrates a display image screen according to a second modification. -
FIGS. 7A to 7C show image transition illustrating a display image screen according to a third modification. - Hereinafter, a display device, a head-mounted display device, a display system and a control method for a display device according to an embodiment of the invention will be described with reference to the accompanying drawings. In this embodiment, a head-mounted display device employing the display device according to the invention is illustrated. The head-mounted display device is a display device mounted on the user's head and also called HMD (head mounted display). The head-mounted display device of this embodiment is a optical transmission-type head-mounted display device (transmission-type head-mounted display device, see-through-type head-mounted display) which makes the user visually recognize an image as a virtual image and also enables direct visual recognition of the exterior (real scenery), and is in the form of spectacles (goggles).
- As shown in
FIG. 1 , a head-mounteddisplay device 1 includes aright holding section 11, a rightdisplay drive section 12, aleft holding section 13, a leftdisplay drive section 14, a right opticalimage display section 15, a left opticalimage display section 16, aright earphone 18 for right ear, and aleft earphone 19 for left ear. - The right optical
image display section 15 and the left opticalimage display section 16 are arranged at the positions corresponding to the front of the user's right and left eyes when the user wears the head-mounteddisplay device 1. One end of the right opticalimage display section 15 and one end of the left opticalimage display section 16 are connected together at the position corresponding to the user's glabella when the user wears the head-mounteddisplay device 1. Theright holding section 11 extends from an end ER, which is the other end of the right opticalimage display section 15. Similarly, theleft holding section 13 extends from an end EL, which is the other end of the left opticalimage display section 16. - The
right holding section 11 is a member extending substantially at right angles to the right opticalimage display section 15, from the end ER of the right opticalimage display section 15 to the position corresponding to the user's temporal region when the user wears the head-mounteddisplay device 1. Similarly, theleft holding section 13 is a member extending substantially at right angles to the left opticalimage display section 16, from the end EL of the left opticalimage display section 16 to the position corresponding to the user's temporal region when the user wears head-mounteddisplay device 1. Theright holding section 11 and theleft holding section 13 hold the head-mounteddisplay device 1 on the user's head, like the temples (bows, earpieces) of spectacles. - The right
display drive section 12 is arranged on the inner side of theright holding section 11, that is, on the side facing the user's head when the user wears the head-mounteddisplay device 1 and on the side of the end ER of the right opticalimage display section 15. The leftdisplay drive section 14 is arranged on the inner side of theleft holding section 13 and on the side of the end EL of the left opticalimage display section 16. - The
right earphone 18 and theleft earphone 19 are mounted on the user's right and left ears, respectively, and output various sounds to the right and left ears, when the user wears head-mounteddisplay device 1. - Next, an example of a
virtual image 22 and an exterior 23 which the user wearing the head-mounteddisplay device 1 can visually recognize will be described with reference toFIG. 2 . As shown inFIG. 2 , in the field ofvision 21 of the user wearing the head-mounteddisplay device 1, adisplay image screen 26 generated by the head-mounteddisplay device 1 is displayed as avirtual image 22. Here, adisplay image screen 26 whereplural icons 81 for calling each application are arranged is displayed, and thedisplay image screen 26 is displayed in the entire range of a virtualimage display area 27 where thevirtual image 22 is displayed (thevirtual image 22 can be displayed). As will be described in detail later, in the head-mounteddisplay device 1, a GUI (graphical user interface) that improves visibility of the exterior 23 and guides the line of sight to the center of thedisplay image screen 26 is realized by thedisplay image screen 26. In the user's field ofvision 21, the user can view the exterior 23 through the right opticalimage display section 15 and the left opticalimage display section 16. That is, the device is configured in such a way that the user can visually recognize thevirtual image 22 and the exterior 23 at the same time within the field ofvision 21. - Next, the control configuration of the head-mounted
display device 1 will be described with reference toFIG. 3 . As shown inFIG. 3 , the head-mounteddisplay device 1 includes adisplay unit 30 which makes the user visually recognize thevirtual image 22, theright earphone 18, theleft earphone 19, apower supply unit 32, aninterface 33, and acontrol unit 34 which controls each of these units. - The
power supply unit 32 supplies electric power to each part of the head-mounteddisplay device 1. Theinterface 33 is for connecting various external devices OA which serve as sources of contents such as images (still images, dynamic images), sounds and the like. The external devices OA may include, for example, personal computer (PC), potable terminal (mobile phone, smartphone or the like), gaming terminal and the like. As theinterface 33, for example, a USB interface, micro USB interface, memory card interface, wireless LAN interface or the like can be employed. - The
display unit 30 includes the right display drive section (image light output unit) 12, the left display drive section (image light output unit) 14, a right light guide panel (light guide unit) 46 as the right opticalimage display section 15, and a left light guide panel (light guide unit) 47 as the left opticalimage display section 16. - The right
display drive section 12 includes a right backlight (BL)control unit 51 and right backlight (BL) 52 which function as a light source, a right LCD (liquid crystal display)control unit 53 andright LCD 54 which function as a display element, and aright projection system 55. - The right
backlight control unit 51 controls driving of theright backlight 52, based on an inputted control signal. Theright backlight 52 is, for example, a light emitting body such as LED (light emitting diode) or electroluminescence (EL). The rightLCD control unit 53 controls driving of theright LCD 54, based on inputted display data. Theright LCD 54 is a transmission-type liquid crystal panel in which plural pixels are arranged in a matrix. - The
right projection system 55 is configured to project (output) image light emitted from theright LCD 54 and uses, for example, a collimating lens. The rightlight guide panel 46 as the right opticalimage display section 15 is made of a light-transmitting resin material or the like and has a half mirror layer HM. The half mirror layer HM guides the image light outputted from theright projection system 55 to the user's right eye while reflecting the image light along a predetermined optical path. The rightlight guide panel 46 also transmits external light (light from the exterior 23) and causes the external light to become incident on the user's eye together with the image light. The half mirror layer HM forms the virtualimage display area 27. Therefore, if the user's line of sight is within the virtualimage display area 27, the user sees the half mirror layer HM and therefore sees the exterior 23 through the half mirror layer HM. Meanwhile, if the user's line of sight shifts out of the virtualimage display area 27, the user sees a part that is not the half mirror layer HM of the rightlight guide panel 46 and therefore ends up seeing the exterior 23 through that part. - The left
display drive section 14 includes a left backlight (BL)control unit 61, a left backlight (BL) 62, a leftLCD control unit 63, aleft LCD 64, and aleft projection system 65, similarly to the rightdisplay drive section 12. The configuration and function of each element included in the leftdisplay drive section 14 are similar to those of each element included in the rightdisplay drive section 12 and therefore will not be described further in detail here. The leftlight guide panel 47 as the left opticalimage display section 16 is made of a light-transmitting resin material or the like and has a half mirror layer HM. The half mirror layer HM guides the image light outputted from theleft projection system 65 to the user's left eye while reflecting the image light along a predetermined optical path. The leftlight guide panel 47 also transmits external light and causes the external light to become incident on the user's eye together with the image light. In the leftlight guide panel 47, the half mirror layer HM forms the virtualimage display area 27, as in the rightlight guide panel 46. - As the image lights guided to the user's eyes in the head-mounted
display device 1 thus form an image on the retinas, the user visually recognizes the virtual image 22 (display image screen 26) within the virtualimage display area 27, for example, as shown inFIG. 2 . Here, forming an image on the retina with the image light is referred to as “display” or “to display”. - The
control unit 34 has a CPU (central processing unit) 67 and astorage unit 68. Thestorage unit 68 includes a ROM (read only memory), RAM (random access memory) and the like and stores various computer programs. TheCPU 67 reads out and executes the computer programs from thestorage unit 68, thereby functioning as an operating system (OS) 71, adisplay control unit 74, a displaystate control unit 75, anaudio processing unit 76, and anapplication execution unit 77. - The
display control unit 74 generates display data and transmits the display data to the display unit 30 (rightLCD control unit 53 and left LCD control unit 63). Thedisplay control unit 74 generates display data of thedisplay image screen 26 where theplural icons 81 are arranged, and transmits this display data to thedisplay unit 30. This causes thedisplay unit 30 to display thedisplay image screen 26 and to display theplural icons 81 on thedisplay image screen 26. That is, in the head-mounteddisplay device 1, thedisplay control unit 74 generates the display data of thedisplay image screen 26 and transmits the display data to the display unit 30 (display control process), and thedisplay unit 30 displays thedisplay image screen 26 including the plural icons 81 (forms an image on the retina with image light), based on the transmitted display data (display process). - The display
state control unit 75 generates a control signal to control the rightdisplay drive section 12 and the leftdisplay drive section 14 and transmits the control signal to thedisplay unit 30, thus controlling the image display state in thedisplay unit 30. Specifically, the displaystate control unit 75 separately controls, with the control signal, ON/OFF of the driving of theright LCD 54 by the rightLCD control unit 53, ON/OFF of the driving of theright backlight 52 by the rightbacklight control unit 51, ON/OFF of the driving of theleft LCD 64 by the leftLCD control unit 63, ON/OFF of the driving of theleft backlight 62 by the leftbacklight control unit 61, and the like, and thus controls the generation and emission of the image light by each of the rightdisplay drive section 12 and the leftdisplay drive section 14. - The
audio processing unit 76 transmits an audio signal to theright earphone 18 and theleft earphone 19 and causes theright earphone 18 and theleft earphone 19 to output the audio. - The
application execution unit 77 executes each application according to the user's operation using thedisplay image screen 26. Specifically, theicons 81 of thedisplay image screen 26 are configured to be selectable (clickable) by a controller, not shown, and theapplication execution unit 77 accepts the selection of anicon 81 and executes (starts up) the application corresponding to theicon 81. - Next, the
display image screen 26 of the head-mounteddisplay device 1 will be described with reference toFIG. 4 . Thedisplay image screen 26 is, for example, the home screen of the head-mounteddisplay device 1. As shown inFIG. 4 , thedisplay image screen 26 includes plural icons (image objects) 81 arranged on the left and right in thedisplay image screen 26, aperspective guide 82 formed in the entire area of thedisplay image screen 26 except the center, and a double circle-like target 83 arranged at the center of thedisplay image screen 26. Also, a vision securing area (predetermined area) 84 to view theexterior 23 is set in advance at the center of thedisplay image screen 26. The background of thedisplay image screen 26 is fully transmissive. - The
plural icons 81 are arranged only in left andright escape areas 85 avoiding thevision securing area 84. Theplural icons 81 are divided into two groups in the left andright escape areas 85 and arranged in therespective escape areas 85. As eachicon 81, a rectangular icon image converted into a perspective image using the perspective method is arranged. Specifically, a rectangular icon image converted into a perspective image that has a vanishing point at the center of thedisplay image screen 26 and faces inward to the vision securing area 84 (toward the vision securing area 84) is arranged. That is, a rectangular icon image provided with perspective is arranged. Thus, the rectangular icon images of theplural icons 81 are displayed as if these icons images were sticking to the left and right walls from a perspective point of view from the user. - The
perspective guide 82 includes pluralfirst guide lines 91 corresponding to vanishing lines to the vanishing point at the center of thedisplay image screen 26, pluralsecond guide lines 92 corresponding to horizontal lines, and pluralthird guide lines 93 corresponding to vertical lines. The pluralfirst guide lines 91 extend toward the center from the outer edge side of thedisplay image screen 26. Specifically, the pluralfirst guide lines 91 extend from the outer edge of thedisplay image screen 26 up to points short of thevision securing area 84, avoiding thevision securing area 84. The term “guide lines” mentioned in the appended claims is formed by the first guide lines 91. - The plural
second guide lines 92 are arranged in top and bottom end parts of thedisplay image screen 26, extending in left and right directions and avoiding thevision securing area 84. Meanwhile, the pluralthird guide lines 93 are arranged in left and right end parts of thedisplay image screen 26, extending in up and down directions and avoiding thevision securing area 84. Therefore, in the top and bottom end parts of thedisplay image screen 26, thefirst guide lines 91 and thesecond guide lines 92 form the top and bottom walls from a perspective point of view. Meanwhile, in the left and right end parts of thedisplay image screen 26, thefirst guide lines 91 and thethird guide lines 93 form the left and right walls from a perspective point of view. That is, thefirst guide lines 91, thesecond guide lines 92 and thethird guide lines 93 form a room-like (box-like) shape without front and rear walls from a perspective point of view. - The
target 83 includes two ring-shapedimages 94 surrounding the center of thedisplay image screen 26. The two ring-shapedimages 94 are formed as concentric circles having different diameters and a center point at the center of thedisplay image screen 26. - The
plural icons 81, theperspective guide 82 and thetarget 83 as described above function as a guide image that restrains the shift of the user's line of sight out of thedisplay image screen 26 and guides the line of sight to the center of the display image screen 26 (toward the center). Also, as theplural icons 81 and theperspective guide 82 are arranged avoiding thevision securing area 84, the field ofvision 21 for the exterior 23 can be secured. That is, the GUI based on thedisplay image screen 26 has both a vision securing function and a line of sight guiding function. - According to the configuration of this embodiment, since the guide image that guides the user's line of sight to the center of the
display image screen 26 is displayed, the shift of the user's line of sight out of thedisplay image screen 26 can be restrained to the utmost. That is, the user can be prompted (guided) to change the orientation of the body or the orientation of the head to shift the field of vision, instead of moving the eyes. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling. - Also, since the
plural icons 81 with perspective having a vanishing point at the center of thedisplay image screen 26, theplural icons 81 for calling applications can be used to guide the user's line of sight. Also, theplural icons 81 generate a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight. - Moreover, by using the plural
first guide lines 91 extending from the outer edge side toward the center are used, the user's line of sight can be guided effectively. Also, theperspective guide 82 generates a perspective optical illusion regarding the center as the back end and therefore can guide the user's line of sight more effectively. - Furthermore, by using the ring-shaped
images 94 surrounding the center of thedisplay image screen 26, the user's line of sight can be effectively guided. - Also, since the
plural icons 81 and theperspective guide 82 are displayed avoiding the center area, the user's line of sight can be effectively guided. Moreover, since an area where the exterior 23 can be seen can be secured at the center of the field ofvision 21, visibility of the exterior 23 can be improved. - While the
target 83 in the embodiment is formed by the ring-shapedimages 94, thetarget 83 may also be formed by two frame-like images 101 surrounding the center of thedisplay image screen 26, as shown inFIG. 5 . Also, thetarget 83 may be formed by a single ring-shape image 94 or a single frame-like image 101. - Also, in the embodiment, a
gradation image 102 that becomes darker toward the center from the outer edge side of thedisplay image screen 26 may be displayed as a guide image on thedisplay image screen 26, as shown inFIG. 6 . According to this configuration, the bright-dark gradation image 102 generates a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight. - Moreover, in the embodiment, it is preferable that plural moving
objects 103 moving toward the center from the outer edge side of thedisplay image screen 26 are displayed as a guide image on thedisplay image screen 26, as shown inFIGS. 7A to 7C . According to this configuration, the user's line of sight can be effectively guided by using the moving objects 103. - Furthermore, the guide image is not limited to the above examples as long as the guide image guides the user's line of sight to the center (toward the center of the
display image screen 26 or to the center part of the display image screen 26). For example, in the case of displaying a text on thedisplay image screen 26, the user's line of sight may be guided by adjusting the size of letters in the text. Also, it is possible to display only one type of the above guide images. In the case of displaying two or more types of the above guide images, the combination thereof is not limited to the above examples. - While the
escape areas 85 in the embodiment are the left and right areas avoiding the vision securing area 84 (left and right escape areas), theescape areas 85 may be top and bottom areas avoiding the vision securing area 84 (top and bottom escape areas). Also, all the other areas than thevision securing area 84, of the virtualimage display area 27, may be theescape areas 85. - Also, while the area at the center of the display image screen 26 (center of the user's field of vision 21) is the
vision securing area 84 in the embodiment, this example is not limiting. For example, the bottom half of thedisplay image screen 26 may be used as thevision securing area 84 in order to secure the field of vision at the user's feet, or the left or right half or the top half of thedisplay image screen 26 maybe used as thevision securing area 84. Also, thevision securing area 84 is not limited to a rectangular area and may be a circular or elliptic area. - Moreover, in the embodiment, the position of a predetermined real object (for example, an obstacle) in the user's field of vision may be detected and the arrangement of the
plural icons 81 may be changed, based on this position. Specifically, the head-mounteddisplay device 1 further includes an object detection unit which detects the position of a predetermined real object in the user's field of vision. If the predetermined real object is situated within thevision securing area 84 as a result of the detection by the object detection unit, thedisplay control unit 74 causes theplural icons 81 to be displayed in theescape areas 85. If the predetermined real object is situated in theescape areas 85, thedisplay control unit 74 causes theplural icons 81 to be displayed in thevision securing area 84. - While the
plural icons 81 are displayed on thedisplay image screen 26 in the embodiment, this example is not limited as long as an image object for calling applications is displayed on thedisplay image screen 26. For example, as the image object, a menu representing each application or a reduced application window may be displayed on thedisplay image screen 26. - Also, plural image objects for calling each file or each folder (for example,
icons 81, shortcuts or the like) may be displayed on thedisplay image screen 26, instead of the plural image objects for calling each application. Alternatively, image objects to carry out each user operation (for example, radio button, select button, soft keyboard or the like) may be displayed on thedisplay image screen 26, instead of the plural image objects for calling each application. In such cases, too, each of the image objects is displayed as an image converted into a perspective image having a vanishing point at the center of thedisplay image screen 26. - Moreover, in the embodiment, the head-mounted
display device 1 may have a controller, not shown, and the controller may be equipped with a part or all of thedisplay control unit 74, the displaystate control unit 75, theaudio processing unit 76 and theapplication execution unit 77. In such a case, the controller may be wire-connected to thecontrol unit 34 or thedisplay unit 30 and the like (display unit 30,right earphone 18 and left earphone 19) via a cord or the like, or may be wirelessly connected to thecontrol unit 34 or thedisplay unit 30 and the like via wireless LAN, infrared communication, Bluetooth (trademark registered) or the like. The functions of the controller may also be realized by a personal computer (PC), a portable information terminal (PDA, mobile phone, watch-type portable terminal, smartphone) or the like. - Also, while the head-mounted
display device 1 for both eyes (optical transmission-type head-mounted display device) is illustrated as an example of the display device in the embodiment, the invention may also be applied to, for example, other formats of head-mounted display device such as a single-eye type. Also, while the head-mounteddisplay device 1 of a spectacles type covering the front of the eyes is illustrated, this example is not limited and the invention can also be applied to a head-mounted display device of a type that does not completely cover the front of the eyes (a type that partly covers the front of the eyes). Moreover, the invention can also be applied to other display devices than the head-mounted display device, such as head-up display. - Furthermore, while the image light output unit in the embodiment has the backlight control units (right
backlight control unit 51 and left backlight control unit 61), the backlights (right backlight 52 and left backlight 62), the LCD control units (rightLCD control unit 53 and left LCD control unit 63), and the LCDs (right LCD 54 and left LCD 64), this embodiment is simply an example. The image light output unit may have a component unit to realize a different method, in addition to or instead of these component units. - For example, the image light output unit may have an organic EL (organic electro-luminescence) display and an organic EL control unit. Alternatively, for example, the image light output unit may have an LCOS (liquid crystal on silicon; LCOS is a trademark registered) or digital micro mirror device or the like, instead of the LCDs.
- Moreover, while the invention is applied to the so-called virtual image projection-type head-mounted display device 1 (head-mounted display) in the embodiment, the invention may also be applied to, for example, a laser retinal projection-type (so-called retinal scan-type) head-mounted display device.
- Furthermore, while the image light output unit in the embodiment has the projection systems (
right projection system 55 and left projection system 65) and is configured to project image light emitted from the LCDs, the image light output unit may have, for example, a scanning system including a MEMS mirror instead of the projection system and may have a signal light modulation unit (signal light forming unit) which emits signal light to the scanning system. In such a case, the signal light formed and emitted from the signal light modulation unit becomes incident on the scanning system (MEMS mirror) as a scanning unit. The scanning system emits the signal light as scanning light to a light guide member having a half mirror layer, and the scanning light is scanned on the surface of the half mirror layer, thus forming a virtual image with the image light. As the user's eyes catch this virtual image, the user can recognize the image. - Also, while the invention is applied to the head-mounted
display device 1 in the embodiment, the invention may also be applied to a display system in which the head-mounteddisplay device 1 and an external device OA or external server are connected to each other via a network. In such a case, the external device OA or external server side is equipped with a part or all of thedisplay control unit 74, the displaystate control unit 75, theaudio processing unit 76 and theapplication execution unit 77.
Claims (19)
1. A transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding a user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
2. The transmission-type display device according to claim 1 , wherein the vision securing area is positioned in a center of the display image screen.
3. The transmission-type display device according to claim 1 , wherein the vision securing area is positioned in a bottom half or a top half of the display image screen.
4. The transmission-type display device according to claim 1 , wherein the vision securing area is positioned in a right half or a left half of the display image screen.
5. The transmission-type display device according to claim 1 , wherein the vision securing area is a substantially rectangular-shaped area of the display image screen.
6. The transmission-type display device according to claim 1 , wherein the vision securing area is a substantially circular-shaped or substantially elliptic-shaped area of the display image screen.
7. The transmission-type display device according to claim 1 , wherein the display control unit causes at least two frame-like images surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
8. The transmission-type display device according to claim 1 , wherein the display control unit causes at least two ring-shaped images surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
9. The transmission-type display device according to claim 1 , wherein the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the vision securing area of the display image screen by using the perspective method to be displayed on the display image screen as a part of the guide image.
10. The transmission-type display device according to claim 9 , further comprising:
an object detection unit which detects a position of a predetermined real object in the user's field of vision,
wherein
if the position of the predetermined real object is detected to be in the vision securing area, the display control unit causes the plural image objects to be displayed in an area of the display image screen other than the vision securing area, and
if the position of the predetermined real object is detected to be in the area of the display image screen other than the vision securing area, the display control unit causes the plural image objects to be displayed in the vision securing area.
11. The transmission-type display device according to claim 9 , wherein the plural image objects are one or more of an icon, a menu, and a reduced application window.
12. The transmission-type display device according to claim 1 , wherein the display control unit causes plural guide lines extending toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
13. The transmission-type display device according to claim 1 , wherein the display control unit causes a gradation image which becomes darker toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
14. The transmission-type display device according to claim 1 , wherein the display control unit causes plural moving objects that move toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
15. The transmission-type display device according to claim 1 , wherein the display control unit causes the guide image to be displayed avoiding a predetermined area at the vision securing area of the display image screen.
16. The transmission-type display device according to claim 1 , wherein the display unit includes:
an image light output unit which outputs image light; and
a light guide unit which guides the outputted image light to the user's eyes, and
wherein the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
17. A transmission-type head-mounted display device which is mounted on a user's head and allows the user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
18. A transmission-type display system which allows a user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
19. A control method for a transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, comprising:
causing a guide image for guiding the user's line of sight to be displayed on the display image screen; and
displaying the guide image,
wherein one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen is displayed as the guide image on the display image screen.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/208,992 US9483968B1 (en) | 2013-07-31 | 2016-07-13 | Display device, head-mounted display device, display system, and control method for display device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013158575A JP2015031703A (en) | 2013-07-31 | 2013-07-31 | Display device, head-mounted display device, display system, and control method of display device |
JP2013-158575 | 2013-07-31 | ||
US14/328,065 US9418581B2 (en) | 2013-07-31 | 2014-07-10 | Display device, head-mounted display device, display system, and control method for display device |
US15/208,992 US9483968B1 (en) | 2013-07-31 | 2016-07-13 | Display device, head-mounted display device, display system, and control method for display device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/328,065 Continuation US9418581B2 (en) | 2013-07-31 | 2014-07-10 | Display device, head-mounted display device, display system, and control method for display device |
Publications (2)
Publication Number | Publication Date |
---|---|
US9483968B1 US9483968B1 (en) | 2016-11-01 |
US20160321970A1 true US20160321970A1 (en) | 2016-11-03 |
Family
ID=52427189
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/328,065 Active 2034-09-16 US9418581B2 (en) | 2013-07-31 | 2014-07-10 | Display device, head-mounted display device, display system, and control method for display device |
US15/208,992 Active US9483968B1 (en) | 2013-07-31 | 2016-07-13 | Display device, head-mounted display device, display system, and control method for display device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/328,065 Active 2034-09-16 US9418581B2 (en) | 2013-07-31 | 2014-07-10 | Display device, head-mounted display device, display system, and control method for display device |
Country Status (2)
Country | Link |
---|---|
US (2) | US9418581B2 (en) |
JP (1) | JP2015031703A (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9857588B2 (en) | 2013-08-01 | 2018-01-02 | Seiko Epson Corporation | Display device, head mounted display, display system, and control method for display device |
US9886796B2 (en) | 2013-08-02 | 2018-02-06 | Seiko Epson Corporation | Display device, head mounted display, display system, and control method for display device |
CN108693649A (en) * | 2017-03-31 | 2018-10-23 | 三美电机株式会社 | Display device |
US10350495B2 (en) | 2016-03-28 | 2019-07-16 | Bandai Namco Entertainment Inc. | Simulation control device and information storage medium |
US10761600B2 (en) | 2016-03-28 | 2020-09-01 | Bandai Namco Entertainment Inc. | Simulation control device and information storage medium |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10459236B2 (en) * | 2016-12-09 | 2019-10-29 | Lg Electronics Inc. | Head-mounted display device with earbud holder |
JP2018137505A (en) * | 2017-02-20 | 2018-08-30 | セイコーエプソン株式会社 | Display device and control method thereof |
US10430924B2 (en) * | 2017-06-30 | 2019-10-01 | Quirklogic, Inc. | Resizable, open editable thumbnails in a computing device |
JP2022018244A (en) * | 2020-07-15 | 2022-01-27 | キヤノン株式会社 | Electronic apparatus and method for controlling the same |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3447308B2 (en) * | 1992-05-26 | 2003-09-16 | オリンパス光学工業株式会社 | Head-mounted display |
JP2005084569A (en) * | 2003-09-11 | 2005-03-31 | Brother Ind Ltd | Picture display device |
JP2005346177A (en) * | 2004-05-31 | 2005-12-15 | Nissan Motor Co Ltd | Information presenting device for vehicle |
JP2005343351A (en) * | 2004-06-04 | 2005-12-15 | Olympus Corp | Drive supporting device |
JP2010098567A (en) * | 2008-10-17 | 2010-04-30 | Seiko Epson Corp | Head mount full-face type image display device |
JP5646923B2 (en) * | 2010-09-03 | 2014-12-24 | 矢崎総業株式会社 | Vehicle display device and vehicle display system |
US10083639B2 (en) * | 2011-02-04 | 2018-09-25 | Seiko Epson Corporation | Control device for controlling image display device, head-mounted display device, image display system, control method for the image display device, and control method for the head-mounted display device |
JP5919624B2 (en) | 2011-02-04 | 2016-05-18 | セイコーエプソン株式会社 | Head-mounted display device and method for controlling head-mounted display device |
US9081177B2 (en) * | 2011-10-07 | 2015-07-14 | Google Inc. | Wearable computer with nearby object response |
-
2013
- 2013-07-31 JP JP2013158575A patent/JP2015031703A/en not_active Withdrawn
-
2014
- 2014-07-10 US US14/328,065 patent/US9418581B2/en active Active
-
2016
- 2016-07-13 US US15/208,992 patent/US9483968B1/en active Active
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9857588B2 (en) | 2013-08-01 | 2018-01-02 | Seiko Epson Corporation | Display device, head mounted display, display system, and control method for display device |
US9886796B2 (en) | 2013-08-02 | 2018-02-06 | Seiko Epson Corporation | Display device, head mounted display, display system, and control method for display device |
US10350495B2 (en) | 2016-03-28 | 2019-07-16 | Bandai Namco Entertainment Inc. | Simulation control device and information storage medium |
US10761600B2 (en) | 2016-03-28 | 2020-09-01 | Bandai Namco Entertainment Inc. | Simulation control device and information storage medium |
CN108693649A (en) * | 2017-03-31 | 2018-10-23 | 三美电机株式会社 | Display device |
Also Published As
Publication number | Publication date |
---|---|
US9418581B2 (en) | 2016-08-16 |
JP2015031703A (en) | 2015-02-16 |
US9483968B1 (en) | 2016-11-01 |
US20150035727A1 (en) | 2015-02-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9483968B1 (en) | Display device, head-mounted display device, display system, and control method for display device | |
US9886796B2 (en) | Display device, head mounted display, display system, and control method for display device | |
US10162412B2 (en) | Display, control method of display, and program | |
JP6107276B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
US9269193B2 (en) | Head-mount type display device | |
JP5884576B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6089705B2 (en) | Display device and control method of display device | |
JP5958689B2 (en) | Head-mounted display device | |
US9857588B2 (en) | Display device, head mounted display, display system, and control method for display device | |
KR20160048881A (en) | Head mounted display device and control method for head mounted display device | |
JP6268778B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6337534B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6252002B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6369583B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6273677B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
JP6375662B2 (en) | Head-mounted display device | |
JP6217772B2 (en) | Head-mounted display device and method for controlling head-mounted display device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |