US20160321970A1 - Display device, head-mounted display device, display system, and control method for display device - Google Patents

Display device, head-mounted display device, display system, and control method for display device Download PDF

Info

Publication number
US20160321970A1
US20160321970A1 US15/208,992 US201615208992A US2016321970A1 US 20160321970 A1 US20160321970 A1 US 20160321970A1 US 201615208992 A US201615208992 A US 201615208992A US 2016321970 A1 US2016321970 A1 US 2016321970A1
Authority
US
United States
Prior art keywords
display
image
image screen
user
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US15/208,992
Other versions
US9483968B1 (en
Inventor
Shinichi Kobayashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seiko Epson Corp
Original Assignee
Seiko Epson Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Seiko Epson Corp filed Critical Seiko Epson Corp
Priority to US15/208,992 priority Critical patent/US9483968B1/en
Application granted granted Critical
Publication of US9483968B1 publication Critical patent/US9483968B1/en
Publication of US20160321970A1 publication Critical patent/US20160321970A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406Control of illumination source
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0123Head-up displays characterised by optical features comprising devices increasing the field of view
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0141Head-up displays characterised by optical features characterised by the informative content of the display
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0464Positioning
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • G09G2340/145Solving problems related to the presentation of information to be displayed related to small screens
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Definitions

  • the present invention relates to a transmission-type display device, a head-mounted display device, a display system and a control method for a display device for making the user visually recognize a display image screen as a virtual image.
  • an optical transmission-type head-mounted display device mounted on the user's head is known (see JP-A-2012-163637).
  • This display device is configured in such a way that the user can visually recognizes an image as a virtual image and can also directly visually recognize the exterior (real scenery).
  • the display device of this type uses a light guide panel having a half mirror portion to make the user visually recognize a virtual image. That is, the display device is configured to reflect and guide image light to the user's eyes by the half mirror portion, thereby making the user visually recognize a display image screen as a virtual image in the user's field of vision.
  • the related-art configuration can lead to eye fatigue and sick feeling due to the user's shifting his/her line of sight out of the display image screen (half mirror portion). That is, as the user shifts his/her line of sight out of the display image screen, the line of sight shifts to a part where there is no half mirror portion of the light guide panel and therefore the user sees the exterior through that part. Consequently, the field of vision can be distorted, causing the user to feel uncomfortable and leading to eye fatigue and sick feeling. Moreover, it is also conceivable that the line of sight may shift out of the light guide panel. In such a case, moving the line of sight into and out of the light guide panel can involve repeated focusing and therefore can lead to eye fatigue and sick feeling.
  • An advantage of some aspects of the invention is to provide a display device, a head-mounted display device, a display system and a control method for a display device that can restrain the shift of the user's line of sight out of the display image screen, to the utmost.
  • An aspect of the invention is directed to a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Another aspect of the invention is directed to a transmission-type head-mounted display device which is mounted on a user's head and makes the user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Still another aspect of the invention is directed to a transmission-type display system which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Yet another aspect of the invention is directed to a control method for a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: causing a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and displaying the guide image.
  • center used here may refer to the center in vertical direction of the display image screen or may be the center in horizontal direction of the display image screen. The center may also be the center both in vertical direction and in horizontal direction.
  • the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the center of the display image screen by using the perspective method, to be displayed as the guide image on the display image screen.
  • the plural image objects are one of icon, menu, and reduced application window.
  • the image objects are converted in such a way that the longitudinal direction of the image objects corresponds to the direction of depth (direction of concentration lines) so that the image objects can easily function as concentration lines. Also, it is preferable that the image objects before conversion have a substantially rectangular outer shape so that the image objects can easily function as concentration lines.
  • the display control unit causes plural guide lines extending toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • the user's line of sight can be guided effectively, using the plural guide lines extending toward the center from the outer edge side.
  • the display control unit causes one of a frame-like image surrounding the center of the display image screen and a ring-shaped image surrounding the center of the display image screen, to be displayed as the guide image on the display image screen.
  • the user's line of sight can be guided effectively, using the frame-like image or the ring-shaped image.
  • the display control unit causes a gradation image which becomes darker toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • the user's line of sight can be guided effectively. It should be noted that a different technique may be used to guide the user's line of sight, with a guide image that generates a perspective optical illusion regarding the center as the back end.
  • the display control unit causes plural moving objects that move toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • the user's line of sight can be guided effectively, using the moving objects.
  • the display control unit causes the guide image to be displayed, avoiding a predetermined area at the center of the display image screen.
  • the user's line of sight can be guided effectively by displaying the guide image avoiding the area at the center. Also, since the area to allow a view of the exterior can be secured at the center of the field of vision, visibility of the exterior can be improved.
  • the display unit includes an image light output unit which outputs image light, and a light guide unit which guides the outputted image light to the user's eyes, and that the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
  • a transmission-type display device which has a simple configuration and is inexpensive can be provided, by using a so-called virtual image projection-type display device.
  • FIG. 1 is an explanatory view showing the outer configuration of a head-mounted display device according to an embodiment.
  • FIG. 2 illustrates an example of a virtual image and exterior that the user can visually recognize.
  • FIG. 3 is a block diagram illustrating the control configuration of the head-mounted display device.
  • FIG. 4 illustrates a display image screen
  • FIG. 5 illustrates a display image screen according to a first modification.
  • FIG. 6 illustrates a display image screen according to a second modification.
  • FIGS. 7A to 7C show image transition illustrating a display image screen according to a third modification.
  • the head-mounted display device is a display device mounted on the user's head and also called HMD (head mounted display).
  • the head-mounted display device of this embodiment is a optical transmission-type head-mounted display device (transmission-type head-mounted display device, see-through-type head-mounted display) which makes the user visually recognize an image as a virtual image and also enables direct visual recognition of the exterior (real scenery), and is in the form of spectacles (goggles).
  • a head-mounted display device 1 includes a right holding section 11 , a right display drive section 12 , a left holding section 13 , a left display drive section 14 , a right optical image display section 15 , a left optical image display section 16 , a right earphone 18 for right ear, and a left earphone 19 for left ear.
  • the right optical image display section 15 and the left optical image display section 16 are arranged at the positions corresponding to the front of the user's right and left eyes when the user wears the head-mounted display device 1 .
  • One end of the right optical image display section 15 and one end of the left optical image display section 16 are connected together at the position corresponding to the user's glabella when the user wears the head-mounted display device 1 .
  • the right holding section 11 extends from an end ER, which is the other end of the right optical image display section 15 .
  • the left holding section 13 extends from an end EL, which is the other end of the left optical image display section 16 .
  • the right holding section 11 is a member extending substantially at right angles to the right optical image display section 15 , from the end ER of the right optical image display section 15 to the position corresponding to the user's temporal region when the user wears the head-mounted display device 1 .
  • the left holding section 13 is a member extending substantially at right angles to the left optical image display section 16 , from the end EL of the left optical image display section 16 to the position corresponding to the user's temporal region when the user wears head-mounted display device 1 .
  • the right holding section 11 and the left holding section 13 hold the head-mounted display device 1 on the user's head, like the temples (bows, earpieces) of spectacles.
  • the right display drive section 12 is arranged on the inner side of the right holding section 11 , that is, on the side facing the user's head when the user wears the head-mounted display device 1 and on the side of the end ER of the right optical image display section 15 .
  • the left display drive section 14 is arranged on the inner side of the left holding section 13 and on the side of the end EL of the left optical image display section 16 .
  • the right earphone 18 and the left earphone 19 are mounted on the user's right and left ears, respectively, and output various sounds to the right and left ears, when the user wears head-mounted display device 1 .
  • FIG. 2 in the field of vision 21 of the user wearing the head-mounted display device 1 , a display image screen 26 generated by the head-mounted display device 1 is displayed as a virtual image 22 .
  • a display image screen 26 where plural icons 81 for calling each application are arranged is displayed, and the display image screen 26 is displayed in the entire range of a virtual image display area 27 where the virtual image 22 is displayed (the virtual image 22 can be displayed).
  • a GUI graphical user interface
  • the display image screen 26 a GUI (graphical user interface) that improves visibility of the exterior 23 and guides the line of sight to the center of the display image screen 26 is realized by the display image screen 26 .
  • the user can view the exterior 23 through the right optical image display section 15 and the left optical image display section 16 . That is, the device is configured in such a way that the user can visually recognize the virtual image 22 and the exterior 23 at the same time within the field of vision 21 .
  • the head-mounted display device 1 includes a display unit 30 which makes the user visually recognize the virtual image 22 , the right earphone 18 , the left earphone 19 , a power supply unit 32 , an interface 33 , and a control unit 34 which controls each of these units.
  • the power supply unit 32 supplies electric power to each part of the head-mounted display device 1 .
  • the interface 33 is for connecting various external devices OA which serve as sources of contents such as images (still images, dynamic images), sounds and the like.
  • the external devices OA may include, for example, personal computer (PC), potable terminal (mobile phone, smartphone or the like), gaming terminal and the like.
  • a USB interface, micro USB interface, memory card interface, wireless LAN interface or the like can be employed as the interface 33 .
  • the display unit 30 includes the right display drive section (image light output unit) 12 , the left display drive section (image light output unit) 14 , a right light guide panel (light guide unit) 46 as the right optical image display section 15 , and a left light guide panel (light guide unit) 47 as the left optical image display section 16 .
  • the right display drive section 12 includes a right backlight (BL) control unit 51 and right backlight (BL) 52 which function as a light source, a right LCD (liquid crystal display) control unit 53 and right LCD 54 which function as a display element, and a right projection system 55 .
  • BL right backlight
  • BL right backlight
  • BL right backlight
  • LCD liquid crystal display
  • the right backlight control unit 51 controls driving of the right backlight 52 , based on an inputted control signal.
  • the right backlight 52 is, for example, a light emitting body such as LED (light emitting diode) or electroluminescence (EL).
  • the right LCD control unit 53 controls driving of the right LCD 54 , based on inputted display data.
  • the right LCD 54 is a transmission-type liquid crystal panel in which plural pixels are arranged in a matrix.
  • the right projection system 55 is configured to project (output) image light emitted from the right LCD 54 and uses, for example, a collimating lens.
  • the right light guide panel 46 as the right optical image display section 15 is made of a light-transmitting resin material or the like and has a half mirror layer HM.
  • the half mirror layer HM guides the image light outputted from the right projection system 55 to the user's right eye while reflecting the image light along a predetermined optical path.
  • the right light guide panel 46 also transmits external light (light from the exterior 23 ) and causes the external light to become incident on the user's eye together with the image light.
  • the half mirror layer HM forms the virtual image display area 27 .
  • the user's line of sight is within the virtual image display area 27 , the user sees the half mirror layer HM and therefore sees the exterior 23 through the half mirror layer HM. Meanwhile, if the user's line of sight shifts out of the virtual image display area 27 , the user sees a part that is not the half mirror layer HM of the right light guide panel 46 and therefore ends up seeing the exterior 23 through that part.
  • the left display drive section 14 includes a left backlight (BL) control unit 61 , a left backlight (BL) 62 , a left LCD control unit 63 , a left LCD 64 , and a left projection system 65 , similarly to the right display drive section 12 .
  • the configuration and function of each element included in the left display drive section 14 are similar to those of each element included in the right display drive section 12 and therefore will not be described further in detail here.
  • the left light guide panel 47 as the left optical image display section 16 is made of a light-transmitting resin material or the like and has a half mirror layer HM.
  • the half mirror layer HM guides the image light outputted from the left projection system 65 to the user's left eye while reflecting the image light along a predetermined optical path.
  • the left light guide panel 47 also transmits external light and causes the external light to become incident on the user's eye together with the image light.
  • the half mirror layer HM forms the virtual image display area 27 , as in the right light guide panel 46 .
  • the user visually recognizes the virtual image 22 (display image screen 26 ) within the virtual image display area 27 , for example, as shown in FIG. 2 .
  • forming an image on the retina with the image light is referred to as “display” or “to display”.
  • the control unit 34 has a CPU (central processing unit) 67 and a storage unit 68 .
  • the storage unit 68 includes a ROM (read only memory), RAM (random access memory) and the like and stores various computer programs.
  • the CPU 67 reads out and executes the computer programs from the storage unit 68 , thereby functioning as an operating system (OS) 71 , a display control unit 74 , a display state control unit 75 , an audio processing unit 76 , and an application execution unit 77 .
  • OS operating system
  • the display control unit 74 generates display data and transmits the display data to the display unit 30 (right LCD control unit 53 and left LCD control unit 63 ).
  • the display control unit 74 generates display data of the display image screen 26 where the plural icons 81 are arranged, and transmits this display data to the display unit 30 .
  • This causes the display unit 30 to display the display image screen 26 and to display the plural icons 81 on the display image screen 26 . That is, in the head-mounted display device 1 , the display control unit 74 generates the display data of the display image screen 26 and transmits the display data to the display unit 30 (display control process), and the display unit 30 displays the display image screen 26 including the plural icons 81 (forms an image on the retina with image light), based on the transmitted display data (display process).
  • the display state control unit 75 generates a control signal to control the right display drive section 12 and the left display drive section 14 and transmits the control signal to the display unit 30 , thus controlling the image display state in the display unit 30 .
  • the display state control unit 75 separately controls, with the control signal, ON/OFF of the driving of the right LCD 54 by the right LCD control unit 53 , ON/OFF of the driving of the right backlight 52 by the right backlight control unit 51 , ON/OFF of the driving of the left LCD 64 by the left LCD control unit 63 , ON/OFF of the driving of the left backlight 62 by the left backlight control unit 61 , and the like, and thus controls the generation and emission of the image light by each of the right display drive section 12 and the left display drive section 14 .
  • the audio processing unit 76 transmits an audio signal to the right earphone 18 and the left earphone 19 and causes the right earphone 18 and the left earphone 19 to output the audio.
  • the application execution unit 77 executes each application according to the user's operation using the display image screen 26 .
  • the icons 81 of the display image screen 26 are configured to be selectable (clickable) by a controller, not shown, and the application execution unit 77 accepts the selection of an icon 81 and executes (starts up) the application corresponding to the icon 81 .
  • the display image screen 26 of the head-mounted display device 1 is, for example, the home screen of the head-mounted display device 1 .
  • the display image screen 26 includes plural icons (image objects) 81 arranged on the left and right in the display image screen 26 , a perspective guide 82 formed in the entire area of the display image screen 26 except the center, and a double circle-like target 83 arranged at the center of the display image screen 26 .
  • a vision securing area (predetermined area) 84 to view the exterior 23 is set in advance at the center of the display image screen 26 .
  • the background of the display image screen 26 is fully transmissive.
  • the plural icons 81 are arranged only in left and right escape areas 85 avoiding the vision securing area 84 .
  • the plural icons 81 are divided into two groups in the left and right escape areas 85 and arranged in the respective escape areas 85 .
  • a rectangular icon image converted into a perspective image using the perspective method is arranged.
  • a rectangular icon image converted into a perspective image that has a vanishing point at the center of the display image screen 26 and faces inward to the vision securing area 84 (toward the vision securing area 84 ) is arranged. That is, a rectangular icon image provided with perspective is arranged.
  • the rectangular icon images of the plural icons 81 are displayed as if these icons images were sticking to the left and right walls from a perspective point of view from the user.
  • the perspective guide 82 includes plural first guide lines 91 corresponding to vanishing lines to the vanishing point at the center of the display image screen 26 , plural second guide lines 92 corresponding to horizontal lines, and plural third guide lines 93 corresponding to vertical lines.
  • the plural first guide lines 91 extend toward the center from the outer edge side of the display image screen 26 .
  • the plural first guide lines 91 extend from the outer edge of the display image screen 26 up to points short of the vision securing area 84 , avoiding the vision securing area 84 .
  • guide lines mentioned in the appended claims is formed by the first guide lines 91 .
  • the plural second guide lines 92 are arranged in top and bottom end parts of the display image screen 26 , extending in left and right directions and avoiding the vision securing area 84 .
  • the plural third guide lines 93 are arranged in left and right end parts of the display image screen 26 , extending in up and down directions and avoiding the vision securing area 84 . Therefore, in the top and bottom end parts of the display image screen 26 , the first guide lines 91 and the second guide lines 92 form the top and bottom walls from a perspective point of view. Meanwhile, in the left and right end parts of the display image screen 26 , the first guide lines 91 and the third guide lines 93 form the left and right walls from a perspective point of view. That is, the first guide lines 91 , the second guide lines 92 and the third guide lines 93 form a room-like (box-like) shape without front and rear walls from a perspective point of view.
  • the target 83 includes two ring-shaped images 94 surrounding the center of the display image screen 26 .
  • the two ring-shaped images 94 are formed as concentric circles having different diameters and a center point at the center of the display image screen 26 .
  • the plural icons 81 , the perspective guide 82 and the target 83 as described above function as a guide image that restrains the shift of the user's line of sight out of the display image screen 26 and guides the line of sight to the center of the display image screen 26 (toward the center). Also, as the plural icons 81 and the perspective guide 82 are arranged avoiding the vision securing area 84 , the field of vision 21 for the exterior 23 can be secured. That is, the GUI based on the display image screen 26 has both a vision securing function and a line of sight guiding function.
  • the shift of the user's line of sight out of the display image screen 26 can be restrained to the utmost. That is, the user can be prompted (guided) to change the orientation of the body or the orientation of the head to shift the field of vision, instead of moving the eyes. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling.
  • the plural icons 81 since the plural icons 81 with perspective having a vanishing point at the center of the display image screen 26 , the plural icons 81 for calling applications can be used to guide the user's line of sight. Also, the plural icons 81 generate a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
  • the user's line of sight can be guided effectively.
  • the perspective guide 82 generates a perspective optical illusion regarding the center as the back end and therefore can guide the user's line of sight more effectively.
  • the user's line of sight can be effectively guided.
  • the plural icons 81 and the perspective guide 82 are displayed avoiding the center area, the user's line of sight can be effectively guided. Moreover, since an area where the exterior 23 can be seen can be secured at the center of the field of vision 21 , visibility of the exterior 23 can be improved.
  • the target 83 in the embodiment is formed by the ring-shaped images 94
  • the target 83 may also be formed by two frame-like images 101 surrounding the center of the display image screen 26 , as shown in FIG. 5 .
  • the target 83 may be formed by a single ring-shape image 94 or a single frame-like image 101 .
  • a gradation image 102 that becomes darker toward the center from the outer edge side of the display image screen 26 may be displayed as a guide image on the display image screen 26 , as shown in FIG. 6 .
  • the bright-dark gradation image 102 generates a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
  • plural moving objects 103 moving toward the center from the outer edge side of the display image screen 26 are displayed as a guide image on the display image screen 26 , as shown in FIGS. 7A to 7C . According to this configuration, the user's line of sight can be effectively guided by using the moving objects 103 .
  • the guide image is not limited to the above examples as long as the guide image guides the user's line of sight to the center (toward the center of the display image screen 26 or to the center part of the display image screen 26 ).
  • the user's line of sight may be guided by adjusting the size of letters in the text.
  • escape areas 85 in the embodiment are the left and right areas avoiding the vision securing area 84 (left and right escape areas), the escape areas 85 may be top and bottom areas avoiding the vision securing area 84 (top and bottom escape areas). Also, all the other areas than the vision securing area 84 , of the virtual image display area 27 , may be the escape areas 85 .
  • the vision securing area 84 is the area at the center of the display image screen 26 (center of the user's field of vision 21 ) in the embodiment, this example is not limiting.
  • the bottom half of the display image screen 26 may be used as the vision securing area 84 in order to secure the field of vision at the user's feet, or the left or right half or the top half of the display image screen 26 maybe used as the vision securing area 84 .
  • the vision securing area 84 is not limited to a rectangular area and may be a circular or elliptic area.
  • the head-mounted display device 1 further includes an object detection unit which detects the position of a predetermined real object in the user's field of vision. If the predetermined real object is situated within the vision securing area 84 as a result of the detection by the object detection unit, the display control unit 74 causes the plural icons 81 to be displayed in the escape areas 85 . If the predetermined real object is situated in the escape areas 85 , the display control unit 74 causes the plural icons 81 to be displayed in the vision securing area 84 .
  • the plural icons 81 are displayed on the display image screen 26 in the embodiment, this example is not limited as long as an image object for calling applications is displayed on the display image screen 26 .
  • a menu representing each application or a reduced application window may be displayed on the display image screen 26 .
  • plural image objects for calling each file or each folder may be displayed on the display image screen 26 , instead of the plural image objects for calling each application.
  • image objects to carry out each user operation for example, radio button, select button, soft keyboard or the like
  • each of the image objects is displayed as an image converted into a perspective image having a vanishing point at the center of the display image screen 26 .
  • the head-mounted display device 1 may have a controller, not shown, and the controller may be equipped with a part or all of the display control unit 74 , the display state control unit 75 , the audio processing unit 76 and the application execution unit 77 .
  • the controller may be wire-connected to the control unit 34 or the display unit 30 and the like (display unit 30 , right earphone 18 and left earphone 19 ) via a cord or the like, or may be wirelessly connected to the control unit 34 or the display unit 30 and the like via wireless LAN, infrared communication, Bluetooth (trademark registered) or the like.
  • the functions of the controller may also be realized by a personal computer (PC), a portable information terminal (PDA, mobile phone, watch-type portable terminal, smartphone) or the like.
  • the head-mounted display device 1 for both eyes is illustrated as an example of the display device in the embodiment, the invention may also be applied to, for example, other formats of head-mounted display device such as a single-eye type.
  • the head-mounted display device 1 of a spectacles type covering the front of the eyes is illustrated, this example is not limited and the invention can also be applied to a head-mounted display device of a type that does not completely cover the front of the eyes (a type that partly covers the front of the eyes).
  • the invention can also be applied to other display devices than the head-mounted display device, such as head-up display.
  • the image light output unit in the embodiment has the backlight control units (right backlight control unit 51 and left backlight control unit 61 ), the backlights (right backlight 52 and left backlight 62 ), the LCD control units (right LCD control unit 53 and left LCD control unit 63 ), and the LCDs (right LCD 54 and left LCD 64 ), this embodiment is simply an example.
  • the image light output unit may have a component unit to realize a different method, in addition to or instead of these component units.
  • the image light output unit may have an organic EL (organic electro-luminescence) display and an organic EL control unit.
  • the image light output unit may have an LCOS (liquid crystal on silicon; LCOS is a trademark registered) or digital micro mirror device or the like, instead of the LCDs.
  • the invention is applied to the so-called virtual image projection-type head-mounted display device 1 (head-mounted display) in the embodiment, the invention may also be applied to, for example, a laser retinal projection-type (so-called retinal scan-type) head-mounted display device.
  • a laser retinal projection-type so-called retinal scan-type
  • the image light output unit in the embodiment has the projection systems (right projection system 55 and left projection system 65 ) and is configured to project image light emitted from the LCDs
  • the image light output unit may have, for example, a scanning system including a MEMS mirror instead of the projection system and may have a signal light modulation unit (signal light forming unit) which emits signal light to the scanning system.
  • the signal light formed and emitted from the signal light modulation unit becomes incident on the scanning system (MEMS mirror) as a scanning unit.
  • the scanning system emits the signal light as scanning light to a light guide member having a half mirror layer, and the scanning light is scanned on the surface of the half mirror layer, thus forming a virtual image with the image light. As the user's eyes catch this virtual image, the user can recognize the image.
  • the invention may also be applied to a display system in which the head-mounted display device 1 and an external device OA or external server are connected to each other via a network.
  • the external device OA or external server side is equipped with a part or all of the display control unit 74 , the display state control unit 75 , the audio processing unit 76 and the application execution unit 77 .

Abstract

A transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, including a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen, and a display unit which displays the guide image. The display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.

Description

  • The present of application is a continuation application of U.S. patent application Ser. No. 14/328,065 filed Jul. 10, 2014, which claims priority from Japanese Patent Application No. 2013-158575 filed Jul. 31, 2013, which are expressly incorporated by reference herein.
  • BACKGROUND
  • 1. Technical Field
  • The present invention relates to a transmission-type display device, a head-mounted display device, a display system and a control method for a display device for making the user visually recognize a display image screen as a virtual image.
  • 2. Related Art
  • According to the related art, as a display device of this type, an optical transmission-type head-mounted display device mounted on the user's head is known (see JP-A-2012-163637). This display device is configured in such a way that the user can visually recognizes an image as a virtual image and can also directly visually recognize the exterior (real scenery).
  • Meanwhile, the display device of this type uses a light guide panel having a half mirror portion to make the user visually recognize a virtual image. That is, the display device is configured to reflect and guide image light to the user's eyes by the half mirror portion, thereby making the user visually recognize a display image screen as a virtual image in the user's field of vision.
  • However, the related-art configuration can lead to eye fatigue and sick feeling due to the user's shifting his/her line of sight out of the display image screen (half mirror portion). That is, as the user shifts his/her line of sight out of the display image screen, the line of sight shifts to a part where there is no half mirror portion of the light guide panel and therefore the user sees the exterior through that part. Consequently, the field of vision can be distorted, causing the user to feel uncomfortable and leading to eye fatigue and sick feeling. Moreover, it is also conceivable that the line of sight may shift out of the light guide panel. In such a case, moving the line of sight into and out of the light guide panel can involve repeated focusing and therefore can lead to eye fatigue and sick feeling.
  • SUMMARY
  • An advantage of some aspects of the invention is to provide a display device, a head-mounted display device, a display system and a control method for a display device that can restrain the shift of the user's line of sight out of the display image screen, to the utmost.
  • An aspect of the invention is directed to a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Another aspect of the invention is directed to a transmission-type head-mounted display device which is mounted on a user's head and makes the user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Still another aspect of the invention is directed to a transmission-type display system which makes a user visually recognize a display image screen as a virtual image, including: a display control unit which causes a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and a display unit which displays the guide image.
  • Yet another aspect of the invention is directed to a control method for a transmission-type display device which makes a user visually recognize a display image screen as a virtual image, including: causing a guide image for guiding the user's line of sight to the center of the display image screen, to be displayed on the display image screen; and displaying the guide image.
  • According to these configurations, since the guide image for guiding the user's line of sight to the center of the display image screen is displayed, the shift of the user's line of sight out of the display image screen can be restrained to the utmost. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling. The term “center” used here may refer to the center in vertical direction of the display image screen or may be the center in horizontal direction of the display image screen. The center may also be the center both in vertical direction and in horizontal direction.
  • In the display device described above, it is preferable that the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the center of the display image screen by using the perspective method, to be displayed as the guide image on the display image screen.
  • In this case, it is preferable that the plural image objects are one of icon, menu, and reduced application window.
  • According to these configurations, by adding perspective to the plural image objects with a vanishing point at the center of the display image screen, it is possible to cause the plural image objects to function as concentration lines. Therefore, the user's line of sight can be guided, using the plural image objects for calling applications. It is preferable that the image objects are converted in such a way that the longitudinal direction of the image objects corresponds to the direction of depth (direction of concentration lines) so that the image objects can easily function as concentration lines. Also, it is preferable that the image objects before conversion have a substantially rectangular outer shape so that the image objects can easily function as concentration lines.
  • Also, it is preferable the display control unit causes plural guide lines extending toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • According to this configuration, the user's line of sight can be guided effectively, using the plural guide lines extending toward the center from the outer edge side.
  • Moreover, it is preferable that the display control unit causes one of a frame-like image surrounding the center of the display image screen and a ring-shaped image surrounding the center of the display image screen, to be displayed as the guide image on the display image screen.
  • According to this configuration, the user's line of sight can be guided effectively, using the frame-like image or the ring-shaped image.
  • Furthermore, it is preferable that the display control unit causes a gradation image which becomes darker toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • According to this configuration, since the bright-dark gradation image generates a perspective optical illusion regarding the center as the back end, the user's line of sight can be guided effectively. It should be noted that a different technique may be used to guide the user's line of sight, with a guide image that generates a perspective optical illusion regarding the center as the back end.
  • Also, it is preferable that the display control unit causes plural moving objects that move toward the center from an outer edge side of the display image screen, to be displayed as the guide image on the display image screen.
  • According to this configuration, the user's line of sight can be guided effectively, using the moving objects.
  • Meanwhile, it is preferable that the display control unit causes the guide image to be displayed, avoiding a predetermined area at the center of the display image screen.
  • According to this configuration, the user's line of sight can be guided effectively by displaying the guide image avoiding the area at the center. Also, since the area to allow a view of the exterior can be secured at the center of the field of vision, visibility of the exterior can be improved.
  • Also, it is preferable that the display unit includes an image light output unit which outputs image light, and a light guide unit which guides the outputted image light to the user's eyes, and that the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
  • According to this configuration, a transmission-type display device which has a simple configuration and is inexpensive can be provided, by using a so-called virtual image projection-type display device.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
  • FIG. 1 is an explanatory view showing the outer configuration of a head-mounted display device according to an embodiment.
  • FIG. 2 illustrates an example of a virtual image and exterior that the user can visually recognize.
  • FIG. 3 is a block diagram illustrating the control configuration of the head-mounted display device.
  • FIG. 4 illustrates a display image screen.
  • FIG. 5 illustrates a display image screen according to a first modification.
  • FIG. 6 illustrates a display image screen according to a second modification.
  • FIGS. 7A to 7C show image transition illustrating a display image screen according to a third modification.
  • DESCRIPTION OF EXEMPLARY EMBODIMENTS
  • Hereinafter, a display device, a head-mounted display device, a display system and a control method for a display device according to an embodiment of the invention will be described with reference to the accompanying drawings. In this embodiment, a head-mounted display device employing the display device according to the invention is illustrated. The head-mounted display device is a display device mounted on the user's head and also called HMD (head mounted display). The head-mounted display device of this embodiment is a optical transmission-type head-mounted display device (transmission-type head-mounted display device, see-through-type head-mounted display) which makes the user visually recognize an image as a virtual image and also enables direct visual recognition of the exterior (real scenery), and is in the form of spectacles (goggles).
  • As shown in FIG. 1, a head-mounted display device 1 includes a right holding section 11, a right display drive section 12, a left holding section 13, a left display drive section 14, a right optical image display section 15, a left optical image display section 16, a right earphone 18 for right ear, and a left earphone 19 for left ear.
  • The right optical image display section 15 and the left optical image display section 16 are arranged at the positions corresponding to the front of the user's right and left eyes when the user wears the head-mounted display device 1. One end of the right optical image display section 15 and one end of the left optical image display section 16 are connected together at the position corresponding to the user's glabella when the user wears the head-mounted display device 1. The right holding section 11 extends from an end ER, which is the other end of the right optical image display section 15. Similarly, the left holding section 13 extends from an end EL, which is the other end of the left optical image display section 16.
  • The right holding section 11 is a member extending substantially at right angles to the right optical image display section 15, from the end ER of the right optical image display section 15 to the position corresponding to the user's temporal region when the user wears the head-mounted display device 1. Similarly, the left holding section 13 is a member extending substantially at right angles to the left optical image display section 16, from the end EL of the left optical image display section 16 to the position corresponding to the user's temporal region when the user wears head-mounted display device 1. The right holding section 11 and the left holding section 13 hold the head-mounted display device 1 on the user's head, like the temples (bows, earpieces) of spectacles.
  • The right display drive section 12 is arranged on the inner side of the right holding section 11, that is, on the side facing the user's head when the user wears the head-mounted display device 1 and on the side of the end ER of the right optical image display section 15. The left display drive section 14 is arranged on the inner side of the left holding section 13 and on the side of the end EL of the left optical image display section 16.
  • The right earphone 18 and the left earphone 19 are mounted on the user's right and left ears, respectively, and output various sounds to the right and left ears, when the user wears head-mounted display device 1.
  • Next, an example of a virtual image 22 and an exterior 23 which the user wearing the head-mounted display device 1 can visually recognize will be described with reference to FIG. 2. As shown in FIG. 2, in the field of vision 21 of the user wearing the head-mounted display device 1, a display image screen 26 generated by the head-mounted display device 1 is displayed as a virtual image 22. Here, a display image screen 26 where plural icons 81 for calling each application are arranged is displayed, and the display image screen 26 is displayed in the entire range of a virtual image display area 27 where the virtual image 22 is displayed (the virtual image 22 can be displayed). As will be described in detail later, in the head-mounted display device 1, a GUI (graphical user interface) that improves visibility of the exterior 23 and guides the line of sight to the center of the display image screen 26 is realized by the display image screen 26. In the user's field of vision 21, the user can view the exterior 23 through the right optical image display section 15 and the left optical image display section 16. That is, the device is configured in such a way that the user can visually recognize the virtual image 22 and the exterior 23 at the same time within the field of vision 21.
  • Next, the control configuration of the head-mounted display device 1 will be described with reference to FIG. 3. As shown in FIG. 3, the head-mounted display device 1 includes a display unit 30 which makes the user visually recognize the virtual image 22, the right earphone 18, the left earphone 19, a power supply unit 32, an interface 33, and a control unit 34 which controls each of these units.
  • The power supply unit 32 supplies electric power to each part of the head-mounted display device 1. The interface 33 is for connecting various external devices OA which serve as sources of contents such as images (still images, dynamic images), sounds and the like. The external devices OA may include, for example, personal computer (PC), potable terminal (mobile phone, smartphone or the like), gaming terminal and the like. As the interface 33, for example, a USB interface, micro USB interface, memory card interface, wireless LAN interface or the like can be employed.
  • The display unit 30 includes the right display drive section (image light output unit) 12, the left display drive section (image light output unit) 14, a right light guide panel (light guide unit) 46 as the right optical image display section 15, and a left light guide panel (light guide unit) 47 as the left optical image display section 16.
  • The right display drive section 12 includes a right backlight (BL) control unit 51 and right backlight (BL) 52 which function as a light source, a right LCD (liquid crystal display) control unit 53 and right LCD 54 which function as a display element, and a right projection system 55.
  • The right backlight control unit 51 controls driving of the right backlight 52, based on an inputted control signal. The right backlight 52 is, for example, a light emitting body such as LED (light emitting diode) or electroluminescence (EL). The right LCD control unit 53 controls driving of the right LCD 54, based on inputted display data. The right LCD 54 is a transmission-type liquid crystal panel in which plural pixels are arranged in a matrix.
  • The right projection system 55 is configured to project (output) image light emitted from the right LCD 54 and uses, for example, a collimating lens. The right light guide panel 46 as the right optical image display section 15 is made of a light-transmitting resin material or the like and has a half mirror layer HM. The half mirror layer HM guides the image light outputted from the right projection system 55 to the user's right eye while reflecting the image light along a predetermined optical path. The right light guide panel 46 also transmits external light (light from the exterior 23) and causes the external light to become incident on the user's eye together with the image light. The half mirror layer HM forms the virtual image display area 27. Therefore, if the user's line of sight is within the virtual image display area 27, the user sees the half mirror layer HM and therefore sees the exterior 23 through the half mirror layer HM. Meanwhile, if the user's line of sight shifts out of the virtual image display area 27, the user sees a part that is not the half mirror layer HM of the right light guide panel 46 and therefore ends up seeing the exterior 23 through that part.
  • The left display drive section 14 includes a left backlight (BL) control unit 61, a left backlight (BL) 62, a left LCD control unit 63, a left LCD 64, and a left projection system 65, similarly to the right display drive section 12. The configuration and function of each element included in the left display drive section 14 are similar to those of each element included in the right display drive section 12 and therefore will not be described further in detail here. The left light guide panel 47 as the left optical image display section 16 is made of a light-transmitting resin material or the like and has a half mirror layer HM. The half mirror layer HM guides the image light outputted from the left projection system 65 to the user's left eye while reflecting the image light along a predetermined optical path. The left light guide panel 47 also transmits external light and causes the external light to become incident on the user's eye together with the image light. In the left light guide panel 47, the half mirror layer HM forms the virtual image display area 27, as in the right light guide panel 46.
  • As the image lights guided to the user's eyes in the head-mounted display device 1 thus form an image on the retinas, the user visually recognizes the virtual image 22 (display image screen 26) within the virtual image display area 27, for example, as shown in FIG. 2. Here, forming an image on the retina with the image light is referred to as “display” or “to display”.
  • The control unit 34 has a CPU (central processing unit) 67 and a storage unit 68. The storage unit 68 includes a ROM (read only memory), RAM (random access memory) and the like and stores various computer programs. The CPU 67 reads out and executes the computer programs from the storage unit 68, thereby functioning as an operating system (OS) 71, a display control unit 74, a display state control unit 75, an audio processing unit 76, and an application execution unit 77.
  • The display control unit 74 generates display data and transmits the display data to the display unit 30 (right LCD control unit 53 and left LCD control unit 63). The display control unit 74 generates display data of the display image screen 26 where the plural icons 81 are arranged, and transmits this display data to the display unit 30. This causes the display unit 30 to display the display image screen 26 and to display the plural icons 81 on the display image screen 26. That is, in the head-mounted display device 1, the display control unit 74 generates the display data of the display image screen 26 and transmits the display data to the display unit 30 (display control process), and the display unit 30 displays the display image screen 26 including the plural icons 81 (forms an image on the retina with image light), based on the transmitted display data (display process).
  • The display state control unit 75 generates a control signal to control the right display drive section 12 and the left display drive section 14 and transmits the control signal to the display unit 30, thus controlling the image display state in the display unit 30. Specifically, the display state control unit 75 separately controls, with the control signal, ON/OFF of the driving of the right LCD 54 by the right LCD control unit 53, ON/OFF of the driving of the right backlight 52 by the right backlight control unit 51, ON/OFF of the driving of the left LCD 64 by the left LCD control unit 63, ON/OFF of the driving of the left backlight 62 by the left backlight control unit 61, and the like, and thus controls the generation and emission of the image light by each of the right display drive section 12 and the left display drive section 14.
  • The audio processing unit 76 transmits an audio signal to the right earphone 18 and the left earphone 19 and causes the right earphone 18 and the left earphone 19 to output the audio.
  • The application execution unit 77 executes each application according to the user's operation using the display image screen 26. Specifically, the icons 81 of the display image screen 26 are configured to be selectable (clickable) by a controller, not shown, and the application execution unit 77 accepts the selection of an icon 81 and executes (starts up) the application corresponding to the icon 81.
  • Next, the display image screen 26 of the head-mounted display device 1 will be described with reference to FIG. 4. The display image screen 26 is, for example, the home screen of the head-mounted display device 1. As shown in FIG. 4, the display image screen 26 includes plural icons (image objects) 81 arranged on the left and right in the display image screen 26, a perspective guide 82 formed in the entire area of the display image screen 26 except the center, and a double circle-like target 83 arranged at the center of the display image screen 26. Also, a vision securing area (predetermined area) 84 to view the exterior 23 is set in advance at the center of the display image screen 26. The background of the display image screen 26 is fully transmissive.
  • The plural icons 81 are arranged only in left and right escape areas 85 avoiding the vision securing area 84. The plural icons 81 are divided into two groups in the left and right escape areas 85 and arranged in the respective escape areas 85. As each icon 81, a rectangular icon image converted into a perspective image using the perspective method is arranged. Specifically, a rectangular icon image converted into a perspective image that has a vanishing point at the center of the display image screen 26 and faces inward to the vision securing area 84 (toward the vision securing area 84) is arranged. That is, a rectangular icon image provided with perspective is arranged. Thus, the rectangular icon images of the plural icons 81 are displayed as if these icons images were sticking to the left and right walls from a perspective point of view from the user.
  • The perspective guide 82 includes plural first guide lines 91 corresponding to vanishing lines to the vanishing point at the center of the display image screen 26, plural second guide lines 92 corresponding to horizontal lines, and plural third guide lines 93 corresponding to vertical lines. The plural first guide lines 91 extend toward the center from the outer edge side of the display image screen 26. Specifically, the plural first guide lines 91 extend from the outer edge of the display image screen 26 up to points short of the vision securing area 84, avoiding the vision securing area 84. The term “guide lines” mentioned in the appended claims is formed by the first guide lines 91.
  • The plural second guide lines 92 are arranged in top and bottom end parts of the display image screen 26, extending in left and right directions and avoiding the vision securing area 84. Meanwhile, the plural third guide lines 93 are arranged in left and right end parts of the display image screen 26, extending in up and down directions and avoiding the vision securing area 84. Therefore, in the top and bottom end parts of the display image screen 26, the first guide lines 91 and the second guide lines 92 form the top and bottom walls from a perspective point of view. Meanwhile, in the left and right end parts of the display image screen 26, the first guide lines 91 and the third guide lines 93 form the left and right walls from a perspective point of view. That is, the first guide lines 91, the second guide lines 92 and the third guide lines 93 form a room-like (box-like) shape without front and rear walls from a perspective point of view.
  • The target 83 includes two ring-shaped images 94 surrounding the center of the display image screen 26. The two ring-shaped images 94 are formed as concentric circles having different diameters and a center point at the center of the display image screen 26.
  • The plural icons 81, the perspective guide 82 and the target 83 as described above function as a guide image that restrains the shift of the user's line of sight out of the display image screen 26 and guides the line of sight to the center of the display image screen 26 (toward the center). Also, as the plural icons 81 and the perspective guide 82 are arranged avoiding the vision securing area 84, the field of vision 21 for the exterior 23 can be secured. That is, the GUI based on the display image screen 26 has both a vision securing function and a line of sight guiding function.
  • According to the configuration of this embodiment, since the guide image that guides the user's line of sight to the center of the display image screen 26 is displayed, the shift of the user's line of sight out of the display image screen 26 can be restrained to the utmost. That is, the user can be prompted (guided) to change the orientation of the body or the orientation of the head to shift the field of vision, instead of moving the eyes. This can prevent the uncomfortable feeling on the user's side and can eliminate a factor contributing to eye fatigue and sick feeling.
  • Also, since the plural icons 81 with perspective having a vanishing point at the center of the display image screen 26, the plural icons 81 for calling applications can be used to guide the user's line of sight. Also, the plural icons 81 generate a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
  • Moreover, by using the plural first guide lines 91 extending from the outer edge side toward the center are used, the user's line of sight can be guided effectively. Also, the perspective guide 82 generates a perspective optical illusion regarding the center as the back end and therefore can guide the user's line of sight more effectively.
  • Furthermore, by using the ring-shaped images 94 surrounding the center of the display image screen 26, the user's line of sight can be effectively guided.
  • Also, since the plural icons 81 and the perspective guide 82 are displayed avoiding the center area, the user's line of sight can be effectively guided. Moreover, since an area where the exterior 23 can be seen can be secured at the center of the field of vision 21, visibility of the exterior 23 can be improved.
  • While the target 83 in the embodiment is formed by the ring-shaped images 94, the target 83 may also be formed by two frame-like images 101 surrounding the center of the display image screen 26, as shown in FIG. 5. Also, the target 83 may be formed by a single ring-shape image 94 or a single frame-like image 101.
  • Also, in the embodiment, a gradation image 102 that becomes darker toward the center from the outer edge side of the display image screen 26 may be displayed as a guide image on the display image screen 26, as shown in FIG. 6. According to this configuration, the bright-dark gradation image 102 generates a perspective optical illusion regarding the center as the back end and therefore can effectively guide the user's line of sight.
  • Moreover, in the embodiment, it is preferable that plural moving objects 103 moving toward the center from the outer edge side of the display image screen 26 are displayed as a guide image on the display image screen 26, as shown in FIGS. 7A to 7C. According to this configuration, the user's line of sight can be effectively guided by using the moving objects 103.
  • Furthermore, the guide image is not limited to the above examples as long as the guide image guides the user's line of sight to the center (toward the center of the display image screen 26 or to the center part of the display image screen 26). For example, in the case of displaying a text on the display image screen 26, the user's line of sight may be guided by adjusting the size of letters in the text. Also, it is possible to display only one type of the above guide images. In the case of displaying two or more types of the above guide images, the combination thereof is not limited to the above examples.
  • While the escape areas 85 in the embodiment are the left and right areas avoiding the vision securing area 84 (left and right escape areas), the escape areas 85 may be top and bottom areas avoiding the vision securing area 84 (top and bottom escape areas). Also, all the other areas than the vision securing area 84, of the virtual image display area 27, may be the escape areas 85.
  • Also, while the area at the center of the display image screen 26 (center of the user's field of vision 21) is the vision securing area 84 in the embodiment, this example is not limiting. For example, the bottom half of the display image screen 26 may be used as the vision securing area 84 in order to secure the field of vision at the user's feet, or the left or right half or the top half of the display image screen 26 maybe used as the vision securing area 84. Also, the vision securing area 84 is not limited to a rectangular area and may be a circular or elliptic area.
  • Moreover, in the embodiment, the position of a predetermined real object (for example, an obstacle) in the user's field of vision may be detected and the arrangement of the plural icons 81 may be changed, based on this position. Specifically, the head-mounted display device 1 further includes an object detection unit which detects the position of a predetermined real object in the user's field of vision. If the predetermined real object is situated within the vision securing area 84 as a result of the detection by the object detection unit, the display control unit 74 causes the plural icons 81 to be displayed in the escape areas 85. If the predetermined real object is situated in the escape areas 85, the display control unit 74 causes the plural icons 81 to be displayed in the vision securing area 84.
  • While the plural icons 81 are displayed on the display image screen 26 in the embodiment, this example is not limited as long as an image object for calling applications is displayed on the display image screen 26. For example, as the image object, a menu representing each application or a reduced application window may be displayed on the display image screen 26.
  • Also, plural image objects for calling each file or each folder (for example, icons 81, shortcuts or the like) may be displayed on the display image screen 26, instead of the plural image objects for calling each application. Alternatively, image objects to carry out each user operation (for example, radio button, select button, soft keyboard or the like) may be displayed on the display image screen 26, instead of the plural image objects for calling each application. In such cases, too, each of the image objects is displayed as an image converted into a perspective image having a vanishing point at the center of the display image screen 26.
  • Moreover, in the embodiment, the head-mounted display device 1 may have a controller, not shown, and the controller may be equipped with a part or all of the display control unit 74, the display state control unit 75, the audio processing unit 76 and the application execution unit 77. In such a case, the controller may be wire-connected to the control unit 34 or the display unit 30 and the like (display unit 30, right earphone 18 and left earphone 19) via a cord or the like, or may be wirelessly connected to the control unit 34 or the display unit 30 and the like via wireless LAN, infrared communication, Bluetooth (trademark registered) or the like. The functions of the controller may also be realized by a personal computer (PC), a portable information terminal (PDA, mobile phone, watch-type portable terminal, smartphone) or the like.
  • Also, while the head-mounted display device 1 for both eyes (optical transmission-type head-mounted display device) is illustrated as an example of the display device in the embodiment, the invention may also be applied to, for example, other formats of head-mounted display device such as a single-eye type. Also, while the head-mounted display device 1 of a spectacles type covering the front of the eyes is illustrated, this example is not limited and the invention can also be applied to a head-mounted display device of a type that does not completely cover the front of the eyes (a type that partly covers the front of the eyes). Moreover, the invention can also be applied to other display devices than the head-mounted display device, such as head-up display.
  • Furthermore, while the image light output unit in the embodiment has the backlight control units (right backlight control unit 51 and left backlight control unit 61), the backlights (right backlight 52 and left backlight 62), the LCD control units (right LCD control unit 53 and left LCD control unit 63), and the LCDs (right LCD 54 and left LCD 64), this embodiment is simply an example. The image light output unit may have a component unit to realize a different method, in addition to or instead of these component units.
  • For example, the image light output unit may have an organic EL (organic electro-luminescence) display and an organic EL control unit. Alternatively, for example, the image light output unit may have an LCOS (liquid crystal on silicon; LCOS is a trademark registered) or digital micro mirror device or the like, instead of the LCDs.
  • Moreover, while the invention is applied to the so-called virtual image projection-type head-mounted display device 1 (head-mounted display) in the embodiment, the invention may also be applied to, for example, a laser retinal projection-type (so-called retinal scan-type) head-mounted display device.
  • Furthermore, while the image light output unit in the embodiment has the projection systems (right projection system 55 and left projection system 65) and is configured to project image light emitted from the LCDs, the image light output unit may have, for example, a scanning system including a MEMS mirror instead of the projection system and may have a signal light modulation unit (signal light forming unit) which emits signal light to the scanning system. In such a case, the signal light formed and emitted from the signal light modulation unit becomes incident on the scanning system (MEMS mirror) as a scanning unit. The scanning system emits the signal light as scanning light to a light guide member having a half mirror layer, and the scanning light is scanned on the surface of the half mirror layer, thus forming a virtual image with the image light. As the user's eyes catch this virtual image, the user can recognize the image.
  • Also, while the invention is applied to the head-mounted display device 1 in the embodiment, the invention may also be applied to a display system in which the head-mounted display device 1 and an external device OA or external server are connected to each other via a network. In such a case, the external device OA or external server side is equipped with a part or all of the display control unit 74, the display state control unit 75, the audio processing unit 76 and the application execution unit 77.

Claims (19)

What is claimed is:
1. A transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding a user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
2. The transmission-type display device according to claim 1, wherein the vision securing area is positioned in a center of the display image screen.
3. The transmission-type display device according to claim 1, wherein the vision securing area is positioned in a bottom half or a top half of the display image screen.
4. The transmission-type display device according to claim 1, wherein the vision securing area is positioned in a right half or a left half of the display image screen.
5. The transmission-type display device according to claim 1, wherein the vision securing area is a substantially rectangular-shaped area of the display image screen.
6. The transmission-type display device according to claim 1, wherein the vision securing area is a substantially circular-shaped or substantially elliptic-shaped area of the display image screen.
7. The transmission-type display device according to claim 1, wherein the display control unit causes at least two frame-like images surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
8. The transmission-type display device according to claim 1, wherein the display control unit causes at least two ring-shaped images surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
9. The transmission-type display device according to claim 1, wherein the display control unit causes plural image objects for calling each application and converted into perspective images having a vanishing point at the vision securing area of the display image screen by using the perspective method to be displayed on the display image screen as a part of the guide image.
10. The transmission-type display device according to claim 9, further comprising:
an object detection unit which detects a position of a predetermined real object in the user's field of vision,
wherein
if the position of the predetermined real object is detected to be in the vision securing area, the display control unit causes the plural image objects to be displayed in an area of the display image screen other than the vision securing area, and
if the position of the predetermined real object is detected to be in the area of the display image screen other than the vision securing area, the display control unit causes the plural image objects to be displayed in the vision securing area.
11. The transmission-type display device according to claim 9, wherein the plural image objects are one or more of an icon, a menu, and a reduced application window.
12. The transmission-type display device according to claim 1, wherein the display control unit causes plural guide lines extending toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
13. The transmission-type display device according to claim 1, wherein the display control unit causes a gradation image which becomes darker toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
14. The transmission-type display device according to claim 1, wherein the display control unit causes plural moving objects that move toward the vision securing area from an outer edge side of the display image screen to be displayed on the display image screen as a part of the guide image.
15. The transmission-type display device according to claim 1, wherein the display control unit causes the guide image to be displayed avoiding a predetermined area at the vision securing area of the display image screen.
16. The transmission-type display device according to claim 1, wherein the display unit includes:
an image light output unit which outputs image light; and
a light guide unit which guides the outputted image light to the user's eyes, and
wherein the light guide unit transmits external light and causes the external light to become incident on the user's eyes together with the image light.
17. A transmission-type head-mounted display device which is mounted on a user's head and allows the user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
18. A transmission-type display system which allows a user to visually recognize a display image screen as a virtual image, comprising:
a display control unit which causes a guide image for guiding the user's line of sight to be displayed on the display image screen; and
a display unit which displays the guide image,
wherein the display control unit causes one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen to be displayed as the guide image on the display image screen.
19. A control method for a transmission-type display device which allows a user to visually recognize a display image screen as a virtual image, comprising:
causing a guide image for guiding the user's line of sight to be displayed on the display image screen; and
displaying the guide image,
wherein one of a frame-like image surrounding a vision securing area of the display image screen where the user's line of sight is guided and a ring-shaped image surrounding the vision securing area of the display image screen is displayed as the guide image on the display image screen.
US15/208,992 2013-07-31 2016-07-13 Display device, head-mounted display device, display system, and control method for display device Active US9483968B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/208,992 US9483968B1 (en) 2013-07-31 2016-07-13 Display device, head-mounted display device, display system, and control method for display device

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2013158575A JP2015031703A (en) 2013-07-31 2013-07-31 Display device, head-mounted display device, display system, and control method of display device
JP2013-158575 2013-07-31
US14/328,065 US9418581B2 (en) 2013-07-31 2014-07-10 Display device, head-mounted display device, display system, and control method for display device
US15/208,992 US9483968B1 (en) 2013-07-31 2016-07-13 Display device, head-mounted display device, display system, and control method for display device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/328,065 Continuation US9418581B2 (en) 2013-07-31 2014-07-10 Display device, head-mounted display device, display system, and control method for display device

Publications (2)

Publication Number Publication Date
US9483968B1 US9483968B1 (en) 2016-11-01
US20160321970A1 true US20160321970A1 (en) 2016-11-03

Family

ID=52427189

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/328,065 Active 2034-09-16 US9418581B2 (en) 2013-07-31 2014-07-10 Display device, head-mounted display device, display system, and control method for display device
US15/208,992 Active US9483968B1 (en) 2013-07-31 2016-07-13 Display device, head-mounted display device, display system, and control method for display device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/328,065 Active 2034-09-16 US9418581B2 (en) 2013-07-31 2014-07-10 Display device, head-mounted display device, display system, and control method for display device

Country Status (2)

Country Link
US (2) US9418581B2 (en)
JP (1) JP2015031703A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9857588B2 (en) 2013-08-01 2018-01-02 Seiko Epson Corporation Display device, head mounted display, display system, and control method for display device
US9886796B2 (en) 2013-08-02 2018-02-06 Seiko Epson Corporation Display device, head mounted display, display system, and control method for display device
CN108693649A (en) * 2017-03-31 2018-10-23 三美电机株式会社 Display device
US10350495B2 (en) 2016-03-28 2019-07-16 Bandai Namco Entertainment Inc. Simulation control device and information storage medium
US10761600B2 (en) 2016-03-28 2020-09-01 Bandai Namco Entertainment Inc. Simulation control device and information storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10459236B2 (en) * 2016-12-09 2019-10-29 Lg Electronics Inc. Head-mounted display device with earbud holder
JP2018137505A (en) * 2017-02-20 2018-08-30 セイコーエプソン株式会社 Display device and control method thereof
US10430924B2 (en) * 2017-06-30 2019-10-01 Quirklogic, Inc. Resizable, open editable thumbnails in a computing device
JP2022018244A (en) * 2020-07-15 2022-01-27 キヤノン株式会社 Electronic apparatus and method for controlling the same

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3447308B2 (en) * 1992-05-26 2003-09-16 オリンパス光学工業株式会社 Head-mounted display
JP2005084569A (en) * 2003-09-11 2005-03-31 Brother Ind Ltd Picture display device
JP2005346177A (en) * 2004-05-31 2005-12-15 Nissan Motor Co Ltd Information presenting device for vehicle
JP2005343351A (en) * 2004-06-04 2005-12-15 Olympus Corp Drive supporting device
JP2010098567A (en) * 2008-10-17 2010-04-30 Seiko Epson Corp Head mount full-face type image display device
JP5646923B2 (en) * 2010-09-03 2014-12-24 矢崎総業株式会社 Vehicle display device and vehicle display system
US10083639B2 (en) * 2011-02-04 2018-09-25 Seiko Epson Corporation Control device for controlling image display device, head-mounted display device, image display system, control method for the image display device, and control method for the head-mounted display device
JP5919624B2 (en) 2011-02-04 2016-05-18 セイコーエプソン株式会社 Head-mounted display device and method for controlling head-mounted display device
US9081177B2 (en) * 2011-10-07 2015-07-14 Google Inc. Wearable computer with nearby object response

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9857588B2 (en) 2013-08-01 2018-01-02 Seiko Epson Corporation Display device, head mounted display, display system, and control method for display device
US9886796B2 (en) 2013-08-02 2018-02-06 Seiko Epson Corporation Display device, head mounted display, display system, and control method for display device
US10350495B2 (en) 2016-03-28 2019-07-16 Bandai Namco Entertainment Inc. Simulation control device and information storage medium
US10761600B2 (en) 2016-03-28 2020-09-01 Bandai Namco Entertainment Inc. Simulation control device and information storage medium
CN108693649A (en) * 2017-03-31 2018-10-23 三美电机株式会社 Display device

Also Published As

Publication number Publication date
US9418581B2 (en) 2016-08-16
JP2015031703A (en) 2015-02-16
US9483968B1 (en) 2016-11-01
US20150035727A1 (en) 2015-02-05

Similar Documents

Publication Publication Date Title
US9483968B1 (en) Display device, head-mounted display device, display system, and control method for display device
US9886796B2 (en) Display device, head mounted display, display system, and control method for display device
US10162412B2 (en) Display, control method of display, and program
JP6107276B2 (en) Head-mounted display device and method for controlling head-mounted display device
US9269193B2 (en) Head-mount type display device
JP5884576B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6089705B2 (en) Display device and control method of display device
JP5958689B2 (en) Head-mounted display device
US9857588B2 (en) Display device, head mounted display, display system, and control method for display device
KR20160048881A (en) Head mounted display device and control method for head mounted display device
JP6268778B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6337534B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6252002B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6369583B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6273677B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP6375662B2 (en) Head-mounted display device
JP6217772B2 (en) Head-mounted display device and method for controlling head-mounted display device

Legal Events

Date Code Title Description
STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4