JP2010081559A - Wearable display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology by which a screen operation can be performed while matching user's directional sense with an operation direction in the screen operation. <P>SOLUTION: A wearable display device includes: a mounting part which is mounted to the head of a user; a display part for displaying an image thereon; an operation member which enables a screen operation displayed on the display part to be performed while matching left and right directions of the user with left and right directions in the screen operation; and a support part which is provided in the mounting part for holding the display part at a position opposed to both eyes or one eye of the user, so that an indication on the display part can be included in a field of view of both the eyes or the one eye of the user. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a wearable display device.

  In recent years, there have been various wearable display devices (or head mounted display devices or HMDs) mounted on the head equipped with a small liquid crystal panel (hereinafter referred to as LCD) so that users can view images and videos. Has been developed.

For example, in Patent Document 1, in order to improve operability, in order to make the movement direction of the pointer for performing an instruction response displayed on the LCD screen match the sense of direction of the user, the operation button is connected to the headphones. An HMD disposed on the rear side is disclosed.
JP 2008-35206 A

  In the arrangement of the operation buttons in the conventional HMD, matching the sense of the user in the vertical direction with the vertical direction of the pointer displayed on the LCD is simply by pressing the button in the vertical direction on a headset or the like worn on the user's head. It only needs to be arranged and can be achieved relatively easily.

  However, in order to make the left and right movements of the user and the left and right movements of the pointer coincide with each other, for example, in Patent Document 1, it is arranged behind the headphones, but the position of the operation button is not directly visible to the user. However, it is still difficult to understand the direction of the camera, and there is a problem that an erroneous operation is caused.

  SUMMARY OF THE INVENTION In view of the above-described problems of the related art, an object of the present invention is to provide a technique capable of performing a screen operation by matching a user's sense of direction with an operation direction in screen operation.

  In order to solve the above-described problem, the wearable display device of the present invention includes a wearing unit that is worn on the user's head, a display unit that displays an image, and a screen operation displayed on the display unit. An operation member that can be operated with the right direction and the left and right directions in the screen operation coincided with each other, and is provided on the mounting unit, and the display unit displays the user's eyes or one side at a position facing both or both eyes of the user. And a support portion that holds the display portion so as to enter the visual field of the eye.

  In the present invention, the operation member can be operated in the screen operation displayed on the display unit so that the upper and lower directions of the user coincide with the upper and lower directions in the screen operation.

  Moreover, in this invention, an operation member is installed in a display part or a support part.

  Moreover, in this invention, an operation member is installed in the side part of a display part.

  Moreover, in this invention, an operation member is installed in the side part of the support part of the side facing a user's eyes.

  In the present invention, the support portion is provided so as to be rotatable with respect to the mounting portion, and the operation member moves to the left and right directions of the user and the left in the screen operation displayed on the display portion as the support portion rotates. And it switches so that the right direction may correspond.

  Further, in the present invention, the support portion is provided so as to be rotatable with respect to the mounting portion, and the operation member is an upper portion in the screen operation displayed on the upper and lower directions of the user and the display portion as the support portion rotates. And it switches so that a downward direction may correspond.

  According to the present invention, it is possible to perform the screen operation by matching the sense of direction of the user with the operation direction in the screen operation.

  1A and 1B are external views of an HMD 100 according to an embodiment of the present invention, in which FIG. 1A is a front view and FIG. 1B is a top view as viewed from directly above when the user is worn. FIG. 2 shows a schematic diagram of the configuration of the HMD 100.

  As shown in FIG. 1, the HMD 100 includes a headband 10, left and right headphones 11 </ b> L and headphones 11 </ b> R, a side arm 12 connected to the left headphones 11 </ b> L via a connecting portion 15, and a display installed at the tip of the side arm 12. The unit 13 is installed on the back of the display unit 13 and includes a cross button 14 for performing a screen operation displayed on the display unit 21 shown in FIG. Then, the headband 10 of the HMD 100 presses the left and right ears of the user via the left and right headphones 11L and the headphones 11R by the elastic force, whereby the entire HMD 100 is fixed to the user's head (FIG. 1). (B)).

  In the present embodiment, it is assumed that the display unit 13 is arranged so as to enter the field of view of the user's left eye. In the present embodiment, the side arm 12 can also be disposed so as to enter the visual field of the user's right eye by rotating 180 degrees around the connecting portion 15 as an axis.

  On the other hand, as shown in FIG. 2, the HMD 100 includes a display unit 21 in the display unit 13 and a sound output unit 22 in each of the left and right headphones 11L and 11R. Further, the HMD 100 includes an operation member 23 that is a cross button 14, an image output interface (image output I / F) 24, an acoustic output interface (acoustic output I / F) 25, a CPU 26, a communication unit 27, and a PC connection unit 28. The storage device 29 and the battery 30 are included. In the present embodiment, it is assumed that the image output I / F 24, the sound output I / F 25, the CPU 26, the communication unit 27, the PC connection unit 28, the storage device 29, and the battery 30 are installed in the headband 10.

  The display unit 21 is disposed on the display unit 13 at a position that enters the left eye field on the side facing the user's left eye, and displays an image or video transferred from the CPU 26, an operation setting screen, or the like as an image output I / F 24. Thus, the converted signal is displayed for display on the display unit 21. An LCD or the like can be appropriately selected and used for the display unit 21.

  The sound output unit 22 is installed in each of the headphone 11L and the headphone 11R, and converts sound signals such as audio and music added to the video and the like transferred from the CPU 26 from digital to analog signals by the sound output I / F 25. Is output as a signal. For the sound output unit 22, a general speaker or the like can be used.

  The operation member 23 generates an operation signal such as pointer movement or selection determination for performing a screen operation displayed on the display unit 21, for example, selecting music or adjusting the volume, and transmits the operation signal to the CPU 26. In the present embodiment, the operation member 23 is installed so that the user's sense of direction matches the direction in the screen operation displayed on the display unit 21. Therefore, in order to achieve this object, the operation member 23 is installed on the back surface of the display unit 13 in this embodiment. The operation member 23 includes, for example, a cross button 14 as shown in FIG. 1, up / down / left / right and determination buttons, independent sticks, a stick-type switch that can instruct up / down / left / right directions and determination, or a capacitive sensor. Such a touch sensor can be appropriately selected and used.

  When the user presses a power button (not shown), the CPU 26 turns on the power of the HMD 100, reads a control program stored in the storage device 29, and initializes the HMD 100. Upon receiving an instruction from the user via the operation member 23, the CPU 26 displays an image or video on the display unit 21 or an audio signal or music acoustic signal added to the video on the sound output unit 22 based on the control program. Control the output of.

  The communication unit 27 transmits and receives radio communication radio waves such as a wireless LAN signal for performing browsing and the like by connecting to the Internet. The communication unit 27 can be a communication antenna such as a general wireless LAN.

  The PC connection unit 28 is a connection unit for connecting the HMD 100 to a personal computer (PC) and transmitting and receiving images, video and music data, setting information of the HMD 100, and the like. For the PC connection unit 28, a connection unit to which a USB terminal, IEEE-1394, or the like can be connected can be appropriately selected and used.

  The storage device 29 holds a control program for the CPU 26 to control the HMD 100, data such as an image downloaded from the Internet via the communication unit 27, or image data transferred from a PC via the PC connection unit 28. . The program held in the storage device 29 can be referred to from the CPU 26 as appropriate. As the storage device 29, a storage device such as a general hard disk device, a magneto-optical disk device, or a removable memory card can be selected and used.

  The battery 30 is a power source for driving the HMD 100, and a general battery can be appropriately selected and used. In the present embodiment, the CPU 26 also performs power management of the battery 30. When the remaining amount of power of the battery 30 becomes a predetermined value or less, a warning is displayed on the display unit 21 to prompt the user to replace the battery 30.

Next, in a state where the HMD 100 is mounted on the user's head (FIG. 1 (b)), the user operates the screen operation displayed on the display unit 21, and the operation when viewing music or the like. Will be described.
≪Operation for screen operation≫
When the user presses a power button (not shown) of the HMD 100, the CPU 26 reads a control program stored in the storage device 29 of the HMD 100 and initializes the HMD 100. The CPU 26 displays a predetermined initial image stored in the storage device 29 or a menu as shown in FIG.

  FIG. 3B shows a positional relationship between a part of the side arm 12, the display unit 13 and the display unit 21 when viewed from the user side, and FIG. 3A shows menu items displayed on the display unit 21. An example of a list of buttons 40 is shown. When a predetermined initial image is displayed, the menu list shown in FIG. 3A may be displayed by pressing the OK determination button in the middle of the cross button 14. Of the item buttons 40 on the menu of the display unit 21, the black item button 40 indicates the current position of the pointer.

  In FIG. 3B, the cross button 14 is indicated by a dotted line because it is not directly visible because it is installed on the back surface of the display unit 13. However, in the present embodiment, the cross button 14 is arranged on the back surface of the display unit 13, so that the sense of the user in the up / down / left / right direction, the up / down / left / right direction of the cross button 14, and the up / down in the screen operation displayed on the display unit 21. The left and right directions coincide with each other. Thereby, it is possible to operate the screen via the cross button 14 with the sense of the user in the vertical and horizontal directions. That is, the user issues an up / down / left / right instruction via the cross button 14, and the CPU 26 moves the pointer to the item button 40 desired by the user based on the instruction. When the user presses the center determination button of the cross button 14, the CPU 26 determines that the item has been selected, reads data for performing the operation of the selected item, etc. from the storage device 29, and selects the selected item. Do work.

As shown in FIG. 1, the description so far has been about the case where the display unit 13 is arranged at the position of the visual field of the user's left eye. However, as described above, in the present embodiment, the side arm 12 can be rotated 180 degrees by the rotation mechanism of the connecting portion 15. If the user puts the headphones 11L of the HMD 100 on the right ear and puts the headphones 11R on the left ear, the display unit 13 can be arranged so as to be in the field of view of the user's right eye. At this time, in this embodiment, the CPU 26 senses the rotation of the connecting portion 15 and automatically switches so that the headphones 11L output the right acoustic signal and the headphones 11R output the left acoustic signal. The up / down / left / right directions of the display of the cross button 14 and the display unit 21 are also automatically switched to match the sense of the user's up / down / left / right direction.
≪When performing a predetermined operation≫
A case where the user selects the music item button 40 on the menu screen of FIG. When selected by the user, the CPU 26 reads the artist name and song name list data stored in the storage device 29 and displays the list on the display unit 21 via the image output I / F 24.

  The user moves the pointer by operating the cross button 14, and when the pointer comes to the position of the artist or song to be listened to, presses the decision button of the cross button 14 to select it. The CPU 26 reads the artist's album song selected by the user or one predetermined song from the storage device 29 and outputs it to the sound output unit 22 via the sound output I / F 25. At the same time, as shown in FIG. 4, the CPU 26 displays information related to the currently played song on the display unit 21 and operates the play button, stop button, fast forward button, rewind button, etc. Buttons are also displayed. Further, for example, as shown in FIG. 4, if the scale bar for adjusting the volume is displayed, the user operates the left and right buttons of the cross button 14 so that the CPU 26 follows the sound output unit 22 accordingly. It is preferable to adjust the sound volume from. Thus, the user can perform various operations sequentially.

  In the above description, it has been described how the CPU 26 operates and music is reproduced based on the screen operation by the user's cross button 14 when the user selects music. The network connection, movie, album, and the like shown in FIG. 3A are basically performed by the same operation as in the case of music.

  For example, when the item button 40 of the net connection is selected, the CPU 26 activates the browser on the display unit 21 and performs the operation with the cross button 14 in the same manner as the button operation such as the play button or stop button for music performance. In response, the pointer and cursor are operated so that a click operation in browsing, an advance button, a return button, and the like can be performed.

  When the movie item button 40 is selected, the CPU 26 reads the movie file stored in the storage device 29 and displays the image output I / O at the display position of the artist name, song name, etc. in FIG. The movie is displayed via F24.

  When the album item button 40 is selected, the CPU 26 reads thumbnails of still images stored in the storage device 29 and displays them as a list. The user operates the cross button 14 in the sense of up / down / left / right direction of the user, and the CPU 26 moves the pointer. When the user moves the pointer to the position of the desired image, the user presses the enter button of the cross button 14, and the CPU 26 displays the image on the display unit 21 in a large size.

  As described above, in the present embodiment, the operation member 23 that is the cross button 14 is installed on the back surface of the display unit 13, so that the user senses the up / down / left / right direction, the up / down / left / right direction of the cross button 14, and the display unit 21. It is possible to always match the vertical and horizontal directions in the screen operation.

Further, since the CPU 26 can sense the rotation operation by the connecting portion 15, the vertical and horizontal directions of the display portion 21 and the cross button 14 can be automatically reversed by rotating the side arm 12. The display unit 13 can be easily arranged so as to be in the left eye field or the right eye field.
≪Supplementary items for the embodiment≫
In the present embodiment, the cross button 14 is used as the operation member 23, but the present invention is not limited thereto. For example, instead of the cross button 14, as shown in FIG. 5 (a), the up / down / left / right buttons and the decision button may be independent buttons, or a stick type that can indicate the up / down / left / right direction and decision. It may be a touch sensor such as a switch or a capacitive sensor. FIG. 5B is a view of a part of the side arm 12 and the display unit 13 as viewed from the back.

  Further, as shown in FIG. 5B, the independent left button, right button, and enter button are installed on the back of the display unit 13, the upper button is the upper side of the display unit 13, and the lower button is the lower part of the display unit 13. You may make it install in each side.

  Alternatively, since the vertical direction can be matched with the user's sense of direction in the prior art, independent left buttons, right buttons and decision buttons are installed on the back of the display unit 13 as shown in FIG. The upper button and the lower button (not shown) may be installed on one side surface of the headphone 11L or the headphone 11R. Note that the left button, the right button, and the enter button may be a slide switch 16 operable in the left-right direction, as shown in FIG. 6B.

  In the present embodiment, the cross button 14 is installed on the back surface of the display unit 13, but the present invention is not limited thereto. If the user's sense of direction matches the up / down / left / right direction of the instruction response displayed on the display unit 21, for example, as shown in FIG. The cross buttons 14 may be installed on the upper and lower side surfaces of the display unit 13 as shown in FIG. 7B.

  In the present embodiment, the display unit 13 is installed at the tip of the side arm 12, but the present invention is not limited to this. As shown in FIG. 8, the display unit 13 is installed on the side of the side arm 12 via a connecting portion 17, and the cross button 14 is installed on the back surface facing the side surface on which the display unit 13 is installed. May be. Here, FIG. 8A is a view of the appearance of the HMD 100, and a part of the display unit 13 and the side arm 12 are viewed from the front, and FIG. 8B is a view from directly above when the user is wearing. FIG. Also in this case, the cross button 14 is provided in FIG. 8 as the operation member 23. However, the present invention is not limited thereto, and the case of the display unit 13 in FIGS. 5 and 6A and 6B. Similarly, a button, a stick-type switch, a touch sensor, or a slide-type switch may be appropriately selected and installed on a side portion such as the back surface of the side arm 12.

  In the present embodiment, the display unit 13 of the HMD 100 is installed so as to be in the visual field of the user's left eye or right eye, but the present invention is not limited to this. For example, the display unit 13 may be provided so as to be in the field of view of both sides of the user. Alternatively, the side arm 12 is installed in each of the headphones 11L and the headphones 11R, and each side arm 12 supports one display unit 13 or each side arm 12 supports one display unit 13 each. Thus, it may be provided so as to fall within the field of view of both sides of the user. When two display units 13 are used, it is preferable that the operation member 23 be installed on the back surface of both or one display unit 13.

  In the present embodiment, the HMD 100 has a headphone type shape as shown in FIG. 1, but the present invention is not limited to this, and the HMD 100 may have a glasses type shape. For example, it is formed by installing the operation member 23 on the back of the display unit 13 or on the frame part of the display unit 13 (display part) corresponding to the vine and nose pad (mounting part), frame part (support part), lens, and lens. The glasses-type HMD100 may be used.

  It should be noted that the present invention can be implemented in various other forms without departing from the spirit or main features thereof. For this reason, the above-described embodiment is merely an example in all respects and should not be construed in a limited manner. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

External view of HMD100 which concerns on one Embodiment of this invention Schematic of the configuration of the HMD 100 of the present embodiment The figure which showed the relationship between the operation direction of the cross button 14, and the direction of the menu displayed on the display part 21. Display example of the display unit 21 when music is selected Other arrangement examples of the operation member 23 installed on the back surface of the display unit 13 Other arrangement examples of the operation member 23 installed on the back surface of the display unit 13 Other arrangement examples of the operation member 23 installed on the back surface of the display unit 13 The figure when cross button 14 is installed in the back of side arm 12 to display unit 13

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Headband, 11L, 11R Headphone, 12 Side arm, 13 Display unit, 14 Cross button, 15, 17 Connection part, 16 Slide type switch, 21 Display part, 22 Sound output part, 23 Operation member, 24 Image output I / F, 25 Sound output I / F, 26 CPU, 27 Communication unit, 28 PC connection unit, 29 Storage device, 30 Battery, 40 Item button, 100 HMD

Claims (7)

A wearing part to be worn on the user's head;
A display for displaying an image;
In the screen operation displayed on the display unit, an operation member that can be operated by matching the left and right directions of the user with the left and right directions in the screen operation;
A support unit that is provided in the mounting unit and holds the display unit so that the display of the display unit is in the field of view of both eyes or one eye of the user at a position facing both eyes or one eye of the user. And a wearable display device. The wearable display device according to claim 1,
The wearable display device characterized in that the operation member can be operated in a screen operation displayed on the display unit so that an upward and downward direction of the user coincides with an upward and downward direction in the screen operation. The wearable display device according to claim 1 or 2,
The wearable display device, wherein the operation member is installed on the display unit or the support unit. The wearable display device according to claim 3,
The wearable display device, wherein the operation member is installed on a side portion of the display unit. The wearable display device according to claim 3,
The wearable display device, wherein the operation member is installed on a side portion of the support portion on a side facing the eyes of the user. The wearable display device according to claim 1,
The support part is provided to be rotatable with respect to the mounting part,
The operation member is switched so that the left and right directions of the user and the left and right directions in the screen operation displayed on the display unit coincide with the rotation of the support unit. Wearable display device. The wearable display device according to claim 2,
The support part is provided to be rotatable with respect to the mounting part,
The operation member is switched so that the upper and lower directions of the user and the upper and lower directions in the screen operation displayed on the display unit coincide with the rotation of the support unit. Wearable display device.

Images