JP2005321479A - Head mounted type display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a head mounted type display device in which an image is observed without a sense of incongruity in the same way as an ordinary installation type display device is observed at a desired installation position. <P>SOLUTION: The head mounted type display device comprises; a see-through image display part 6 which projects the image on an observer's eye as a virtual image; a remote control part 5 for adjusting an initial position of the image to be displayed by the see-through image display part 6; an angular velocity sensor 81/84 used for detecting a tilt angle of the observer's head on the basis of the initial position of the image; an LCD driver 105 and a first and a second CPUs 111 and 112 which control to move the image to be displayed to the opposite direction of the detected tilt direction of the observer's head by an amount corresponding to the detected angle so that the position of the virtual image may be certain when observed from the observer, in spite of the tilt of the observer's head. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a head-mounted display device, and more particularly to a head-mounted display device that displays an image so that the image can be observed while being mounted on the head.

  2. Description of the Related Art Conventionally, display devices such as HMD (head mounted display) and HUD (head up display) that are worn on the head and observe images are known.

  As such a display device, for example, one described in Japanese Patent Application Laid-Open No. 2003-248194 can be cited. The video display device described in the publication projects an image arranged in a spectacle-shaped frame onto a hologram optical element as a combiner, and guides the image reflected by the hologram optical element to the eyes of an observer. The virtual image of the image is displayed so as to overlap the outside world.

  On the other hand, Japanese Patent Application Laid-Open No. 6-78247 describes a head-mounted display device that can easily perform a switching operation from an electronic image to an external image. Further, in this publication, even if the tilt angle of the head is changed, a display is made so that the virtual screen is fixedly observed at a predetermined position in the outside world, and an image of the outside world is displayed in a portion outside the virtual screen. A technique that enables observation is described (see the description of paragraph numbers [0035] to [0044] of the publication, particularly the description of [0041] and the like).

By the way, the human eye, which is called a cone, has particularly high visual acuity distributed at a high density in the center of the retina, and the density rapidly decreases as it goes to the periphery. There are three types of cones, and the respective spectral sensitivity characteristics have peaks at R, G, and B. Thus, color vision is established only in a region within a radius of 20 ° to 30 ° from the center of the retina. A region within 3 ° from the center of the retina where cones are distributed at a particularly high density is called a fovea. On the other hand, when going from the center of the retina to the periphery, instead of cones, cells called rods that are sensitive only to the brightness and respond to only brightness are distributed. This rod gradually decreases in density as it goes to the periphery, with the density peak at about 20 ° from the center of the retina. It is known that the visual acuity of the human eye having such a structure varies depending on the luminance, but when the luminance is high, it is the highest in the fovea and decreases rapidly when going to the periphery a little. FIG. 33 shows the visual acuity at each part of the retina using luminance as a parameter (Mitsuo Ikeda: “Latest Applied Physics Series 3, Visual Psychophysics, p194, 1975”, Morikita Publishing). As shown in the figure, when the brightness is relatively high, cones distributed at a high density around the fovea function effectively, so that the eyesight is particularly high at the center of the retina, whereas the brightness is low, The cone does not function effectively, and the difference in visual acuity between the center and the periphery of the retina is not so great. The two-point identification resolution of the fovea of the eye is generally said to be about 1 ′.
JP 2003-248194 A JP-A-6-78247 Mitsuo Ikeda: "Latest Applied Physics Series 3, Visual Psychophysics, p194, 1975", Morikita Publishing

  The conventional HMD and HUD as described above have a feeling that the screen always clings to the head because the observed virtual image moves together with the head when the head is moved even a little. This was a factor that caused stress in wearing time.

  Further, since the conventional display device as described above is small and lightweight and excellent in portability, it tends to perform a normal action while being worn. However, if the display screen remains displayed in the viewer's field of view, it may be a hindrance when taking normal actions. Therefore, in order to prevent obstruction, it is necessary to remove the display device or to turn off the display device before taking a normal action. However, as can be seen by taking glasses as an example, it is troublesome to remove the glasses before taking any action. Similarly, when taking a normal action, it is still troublesome to remove the display device or turn off the display device.

  And what was described in the said Unexamined-Japanese-Patent No. 2003-248194 is not described at all about how to set the initial position of a virtual screen. As shown in FIG. 11 of Japanese Patent Application Laid-Open No. 6-78247, if the virtual screen is displayed in front, it will hinder the action when taking a normal action facing the front. In addition, it is inconvenient because it is necessary to remove the head-mounted display device every time it is used. On the other hand, if the virtual screen is set to be displayed when the head is tilted slightly downward, inconvenience occurs when trying to refer to a document at hand, for example. Thus, if the position where the virtual screen is displayed is fixed, inconvenience may occur due to the purpose of use or individual differences.

  The present invention has been made in view of the above circumstances, and is a head-mounted type capable of observing an image without a sense of incongruity with the same feeling as observing a normal installation type display device at a desired installation position. The object is to provide a display device.

  In order to achieve the above object, a head-mounted display device according to a first invention comprises a display means for projecting an image onto an observer's eye so that the image can be observed as a virtual image, The angle detection means for detecting the inclination angle of the head of the person and the angle detection means so that the position of the virtual image when viewed from the observer is substantially constant regardless of the inclination of the head of the observer A movement control means for controlling the image displayed by the display means to move by an amount corresponding to the angle detected by the angle detection means in a direction opposite to the detected tilt direction of the head of the observer; Adjusting means for adjusting the initial position of the image displayed by the display means, wherein the movement control means detects the tilt angle of the head by the angle detection means with reference to the initial position of the image. Perform the Based on the issued angle, and controls the display position of the image to be displayed by the display means.

  The head-mounted display device according to the second invention is the head-mounted display device according to the first invention, wherein the adjustment means moves the image to a desired position by the movement control means. The initial position of the image is adjusted.

  The head-mounted display device according to the third invention is the head-mounted display device according to the first invention, wherein the adjusting means adjusts the initial position of the image to a predetermined initial position. It is.

  According to the head-mounted display device of the present invention, it is possible to observe an image without a sense of incongruity with the same feeling as observing a normal installation type display device at a desired installation position.

  Embodiments of the present invention will be described below with reference to the drawings.

  1 to 32 show Embodiment 1 of the present invention, and FIG. 1 is a perspective view showing a usage pattern of a head-mounted information display device.

  The information display device according to the present embodiment is a head-mounted information display device (head-mounted display device) as described below.

  As shown in FIG. 1, the information display device 1 includes a head wearing part 2 having a substantially glasses shape, and a control / main body part connected to the head wearing part 2 via, for example, a cable 3 serving as a connecting means. It is roughly divided into a recording unit 4 and a remote control unit (hereinafter abbreviated as a remote control unit) 5 for remotely performing operation input related to the information display device 1.

  The head mounting unit 2 is configured to be able to substantially directly observe an observation target (external world) during see-through display, and to be able to observe information superimposed on the observation target. It is. The head mounting part 2 is mounted on the head and used in the same manner as general glasses for diopter correction, as can be seen from the shape of the glasses. Etc. are also reduced in size and weight so as to approximate to normal glasses as much as possible.

  The cable 3 connects the connection terminal 3a provided on one end side to the cable connection terminal 21 (see FIG. 2 and the like) of the head mounting portion 2 and connects the connection terminal 3b provided on the other end side to the control / recording unit. The head mounting unit 2 and the control / recording unit 4 are connected to each other by connecting to the cable connection terminal 49 (see FIG. 6). Here, as the connection means for electrically connecting the head mounting unit 2 and the control / recording unit 4, a wired cable 3 is used. However, the present invention is not limited to this, and for example, means for communicating with each other wirelessly May be used.

  The control / recording unit 4 is configured to control the entire information display device 1 and to reproduce information observed by the head-mounted unit 2. The control / recording unit 4 can be used in various states such as a state where it is attached to a waist belt or the like, or a state where it is stored in an inner pocket of a jacket, etc. The size and weight are reduced. Of course, it is also possible to use the control / recording unit 4 in a state of being accommodated in a bag or the like by using a long cable 3 or the like.

  The remote controller 5 is for the observer to perform operations that are relatively frequently performed on the information display device 1 by remote operation. Accordingly, the remote control unit 5 is configured to be small and light enough to fit in the palm of one hand, for example, and communicate with the control / recording unit 4 wirelessly, for example. It has become.

  The head mounting unit 2, the control / recording unit 4, and the remote control unit 5 are configured separately from each other in the present embodiment, and thereby the mounting feeling by reducing the size and weight of the head mounting unit 2 is achieved. Improvement of operability by adopting the remote control unit 5 and the like.

  Next, with reference to FIGS. 2 to 4, the appearance and outline of the head mounting portion 2 will be described. 2 is a front view showing the head mounting portion, FIG. 3 is a plan view showing the head mounting portion, and FIG. 4 is a right side view showing the head mounting portion.

  The head mounting part 2 is a front part 11 which is a part corresponding to a lens, a rim, a bridge, a wisdom, etc. in general spectacles, and is directed from the left and right sides of the front part 11 to the rear (opposite to the observation target) And a temple portion 12 that is each extended and foldable with respect to the front portion 11.

  The front portion 11 includes a frame portion 13 and transparent optical members 14 and 15 that are light guide members attached to the frame portion 13 so as to correspond to the left and right eyes, respectively. .

  At the center of the frame portion 13, a nose pad portion 19 for placing the head mounting portion 2 on the nasal bridge, and a bridge portion formed on the upper portion between the transparent optical members 14 and 15. 20 is provided.

  The temple portion 12 is connected to the front portion 11 using hinges 24 and 25, and can be folded with respect to the front portion 11. That is, when not in use, the temple portion 12 can be bent toward the center portion of the front portion 11, and the folded position can be taken along the front portion 11. It is possible to do. Further, tip cell moderns 26 and 27 are provided at the distal end portions of the left and right temple portions 12 to be put on ears.

  Furthermore, the temple part 12 on the left eye side (that is, the right side in FIGS. 2 and 3) has an electrical component 30a, and the temple part 12 on the right eye side (that is, the left side in FIGS. 2 and 3) has an electrical component. The part 30b is provided integrally with each temple part 12, respectively. These electrical parts 30a and 30b are mainly for housing an electronic circuit for controlling see-through display. Therefore, when the temple part 12 is folded, these electrical parts 30 a and 30 b are also folded according to the temple part 12. As described above, since the electric parts 30a and 30b are arranged in the bendable temple part 12, the information display device 1 can be stored in a compact manner.

  Further, a cable connection terminal 21 for connecting a connection terminal 3a disposed on one end side of the cable 3 to a lower end portion on the rear side (side closer to the observer's ear) of the electrical component 30a on the left eye side. Is provided. Note that the electronic circuit of the see-through image display unit 6 (see FIG. 11), which will be described later, is distributed and arranged in the front unit 11 and the electrical units 30a and 30b. Appropriate shape and weight balance to ensure a good fit.

  The portion between the right side of the front portion 11 and the hinge 24 and the portion between the left side of the front portion 11 and the hinge 25 are the circuits inside the front portion 11 and the electrical components 30a and 30b. A box portion 33 in which a flexible printed circuit board and the like for connecting circuits to each other by a configuration shown in FIGS. 19 and 20 described later is stored.

  Next, the external appearance and outline of the control / recording unit 4 will be described with reference to FIGS. 5 is a plan view showing the control / recording unit with the operation panel closed, FIG. 6 is a right side view showing the control / recording unit with the operation panel closed, and FIG. 7 is a control with the operation panel closed. FIG. 8 is a plan view showing operation switches arranged on the operation panel, and FIG. 9 is a perspective view showing the control / recording unit in a state where the operation panel is opened.

  The control / recording unit 4 includes a control / recording main body 41 and an operation panel 42 that can be opened and closed with respect to the control / recording main body 41 via a hinge 43. .

  The control / recording main body 41 incorporates circuits as will be described later, and an LCD display element (hereinafter abbreviated as “LCD”) which is a liquid crystal monitor at a position where observation is possible when the operation panel 42 is opened. 48) is provided. The LCD 48 displays information (for example, reproduces and displays recorded images or displays a screen input via a personal computer (PC) connection terminal 51 as described later). In addition to the above, the information display device 1 is also used for displaying a menu screen for setting various modes according to the information display device 1. Further, the control / recording main body 41 is formed with a recess 45 so that a fingertip or the like can be easily applied when the operation panel 42 is opened and closed.

  Further, as shown in FIG. 6, a lid 52 that can be opened and closed with respect to the control / recording main body 41 by a hinge 46 is provided on the right side surface of the control / recording main body 41. The locked portion 52a is locked to the locked portion 52b on the control / recording main body 41 side so that the closed state is maintained. When the lid 52 is opened, as shown in FIG. 6, the cable connection terminal 49 connected to the cable connection terminal 21 of the head mounting portion 2 via the cable 3 is connected to the television. The AV / S connection terminal 50 that is a terminal of the PC and the PC connection terminal 51 that is a terminal for connecting to a personal computer (PC) are exposed. In this way, the cords are connected together on the right side of the control / recording main body 41, so that the cords do not extend from the other side, Annoyance can be reduced.

  On the other hand, as shown in FIG. 7, a lid 53 that can be opened and closed with respect to the control / recording main body 41 by a hinge 47 is provided on the left side surface of the control / recording main body 41. The closed state is maintained by locking the locking portion 53a to the locked portion 53b on the control / recording main body 41 side. When the lid 53 is opened, as shown in FIG. 7, a recording memory insertion port 54 for inserting a recording memory 120 (see FIG. 11 etc.), which is a detachable recording means such as a card memory, and a power source And a battery insertion port 55 for removably inserting a battery for supplying the battery.

  As shown in FIG. 5, the operation panel 42 is provided with a power switch 44 on the outer side exposed to the outside even in the closed state, and further on the inner side exposed to be operable only in the opened state. Various operation switches as shown in FIG.

  That is, on the inner surface side of the operation panel 42, a speaker 56 for reproducing sound, a switch 57 for increasing the volume of the sound generated from the speaker 56, and a switch 58 for decreasing the volume A playback / stop switch 59 for playing back or pausing the image information recorded in the recording memory 120, a switch 61 for fast-forwarding and searching for an image, and a forward-looking image. Switch 62 for fast-forwarding and searching, menu button 63 for displaying on the LCD 48 a menu screen for setting various functions and dates related to the information display device 1, and the menu screen. To move the item of interest in each item up, down, left, right, or to scroll the display information in each direction A menu selection switch 66, 67, 68, 69 of the confirmation switch 65 for determining the focused item or the like displayed are disposed.

  In the information display device 1 according to the present embodiment, as will be described later, when the time when the image disappears from the display frame indicating the image display area is equal to or longer than the predetermined time Ts, the information display device 1 The low power consumption mode for reducing the overall power consumption is automatically set. The predetermined time Ts at this time is also set by operating the menu selection switches 66, 67, 68, 69, etc. Can be done.

  As described above, the switches arranged on the operation panel 42 are mainly switches for setting information whose change frequency is relatively low.

  Next, the external appearance and outline of the remote control unit 5 will be described with reference to FIG. FIG. 10 is a plan view showing the configuration of the remote control unit.

  As described above, the remote controller 5 is provided with switches for changing information related to the information display device 1 at a relatively high frequency. As shown in FIG. And a dome pointer operation unit 72 and an antenna 73.

  The keyboard 71 is mainly an input means for inputting character data. The character data input from the keyboard 71 can be displayed on at least one of the see-through image display unit 6 (see FIG. 11) in the head-mounted unit 2 and the LCD 48 in the control / recording unit 4. It has become. Further, the keyboard 71 includes a key that also serves as scrolling means for scrolling the displayed items and character information up or down, or left or right.

  The dome pointer operation unit 72 is a scroll unit, and includes a pointer 74, a left button 75, and a right button 76. The pointer 74 is a pointing device that can move the mouse pointer, for example, by operating with a fingertip. That is, the operation of the pointer 74 corresponds to an operation of moving a mouse that is widely used in personal computers and the like. The left button 75 and the right button 76 correspond to a left button and a right button in a normal mouse, respectively. Therefore, by operating the pointer 74, the mouse pointer on the screen is moved, and by operating the left button 75 or the right button 76 at a desired position, the same operation as that performed by moving the mouse and clicking is performed. Done.

  The antenna 73 is a transmission means for transmitting information input to the remote control unit 5 by such an operation to the control / recording unit 4. The control / recording unit 4 executes processing according to the operation content in accordance with the information received from the remote control unit 5 in this way.

  FIG. 11 is a block diagram showing a configuration mainly related to an electronic circuit of the information display device.

  As described above, the configuration of the information display device 1 is roughly divided into the head-mounted unit 2, the control / recording unit 4, and the remote control unit 5. Among these, the head mounting unit 2 includes a see-through image display unit 6 as a main electronic circuit. The control / recording unit 4 and the see-through image display unit 6 are connected via the cable 3, and the control / recording unit 4 and the remote control unit 5 are connected via radio.

  The control / recording unit 4 includes a memory 116, a D / A conversion circuit 117, the LCD 48, an LCD driver 118, a compression / decompression circuit 119, a selection circuit 121, the recording memory 120, and a hard disk 122. The speaker 56, the receiving circuit 123, the display memory 125, the character generator 126, the first operation switch 113, the EEPROM 114, the power supply circuit 124, and the first CPU 111. .

  The memory 116 is a first storage unit that constitutes a display unit, and includes information such as images and characters generated by the first CPU 111 or images and characters stored in the recording memory 120 and the hard disk 122. It is configured by a frame buffer or the like that reads information and temporarily stores the read signal.

  The D / A conversion circuit 117 converts the digital signal stored in the memory 116 into an analog signal.

  The LCD 48 is also shown in FIG. 9 and displays an image based on the analog image signal converted by the D / A conversion circuit 117 or displays other information. .

  The LCD driver 118 is for controlling and driving the LCD 48.

  The compression / decompression circuit 119 includes a compression circuit unit and an expansion circuit unit. The compression / decompression circuit 119 compresses the digital signal stored in the memory 116 by the compression circuit unit and records the recording by the expansion circuit unit. The compressed digital signal read from the memory 120 is expanded.

  The selection circuit 121 is a circuit for selecting a signal input destination and an output destination bidirectionally based on a control signal from the first CPU 111. Here, bidirectional means that any of the memory 116, the recording memory 120, the hard disk 122, and the compression / decompression circuit 119 can be either an input destination or an output destination. For example, the selection circuit 121 selects whether the digital signal compressed by the compression / decompression circuit 119 is output to the recording memory 120, the hard disk 122, or the memory 116. When the information recorded in the recording memory 120 or the hard disk 122 is taken into the memory 116 for reproduction display, the selection circuit 121 is connected to the recording memory 120 based on the control signal from the first CPU 111. An output signal from either one of the hard disk 122 is selected and output to the compression / decompression circuit 119. Further, the selection circuit 121 compresses data transfer from the memory 116 to the recording memory 120 or the hard disk 122 or from the recording memory 120 or the hard disk 122 to the memory 116 based on a control signal from the first CPU 111. It is also possible to select whether to perform via the / decompression circuit 119 or not via the compression / decompression circuit 119. When the information is, for example, image data other than character data (hereinafter, “image data” collectively refers to information excluding character data), a compression process or a decompression process is performed via the compression / decompression circuit 119. Transfer is performed after decompression processing. On the other hand, if the data is character data, the transfer is performed without going through the compression / decompression circuit 119.

  As described above, the recording memory 120 is composed of, for example, a removable memory card or the like, and records the digital signal compressed by the compression / decompression circuit 119 when selected by the selection circuit 121. To do.

  The hard disk 122 is built in the control / recording unit 4 and records the digital signal compressed by the compression / decompression circuit 119 when selected by the selection circuit 121. .

  Based on the control of the first CPU 111, the speaker 56 (see FIG. 8, etc.) reproduces the sound when reproducing an image accompanied by sound, or generates a warning sound if necessary. Is for.

  The receiving circuit 123 is for receiving a signal transmitted wirelessly from a transmitting circuit 133 (to be described later) of the remote controller 5.

  The display memory 125 is a second storage unit that constitutes a display unit, and stores image data to be displayed on the see-through image display unit 6. The display memory 125 includes memory cells that correspond one-to-one to display pixels provided on the LCD 104 (to be described later) of the see-through image display unit 6.

  The character generator 126 is for generating character data corresponding to a key input operation of the remote controller 5.

  The first operation switch 113 is an input means for performing various operation inputs related to the information display device 1, and serves as both an adjustment means and a time setting means, such as various switches as shown in FIG. It is comprised including the kind.

  The EEPROM 114 is a third storage unit that constitutes a display control unit, and is for recording various data used in the information display device 1. The EEPROM 114 stores a correspondence relationship relating to mapping between original information stored in the memory 116 and memory cells of the display memory 125 as a table as described later.

  The power supply circuit 124 includes, for example, a battery configured to be detachable. The power supply circuit 124 not only supplies power to the control / recording unit 4 but also shows a see-through image of the head-mounted unit 2. The display unit 6 can also be supplied with power via the cable 3.

  The first CPU 111 controls each circuit in the control / recording unit 4 and also controls the see-through image display unit 6 by communicating with a second CPU 112 described later in the see-through image display unit 6. There is an integrated control means for the information display device, which also serves as a display means, a display control means, a movement control means, and an adjustment means.

  The operation of the control / recording unit 4 is almost as follows.

  Information in the memory 116 is compressed by the compression circuit unit in the compression / decompression circuit 119 and then stored in the recording memory 120 or the hard disk 122.

  Further, information already recorded in the recording memory 120 or the hard disk 122 is selected by operating the menu button 63 of the first operation switch 113, the menu selection switches 66, 67, 68, 69, the confirmation switch 65, and the like. When a playback instruction is issued by operating the playback / stop switch 59, information recorded in the recording memory 120 or the hard disk 122 is read and temporarily recorded in the memory 116. At this time, if the information recorded in the recording memory 120 or the hard disk 122 is image data, the information is decompressed by the decompression circuit unit in the compression / decompression circuit 119 and then transferred to the memory 116. If the information recorded in the recording memory 120 or the hard disk 122 is character data, it is transferred as it is from the selection circuit 121 to the memory 116 without passing through the compression / decompression circuit 119.

  The information stored in the memory 116 is displayed on the LCD 48 after being converted into an analog image signal by the D / A conversion circuit 117, or after a predetermined mapping process as will be described later is performed. The image is displayed on the LCD 104 described later of the image display unit 6. When the display is performed on the LCD 48, the operation of the LCD 48 is controlled by a signal generated from the LCD driver 118. On the other hand, when the display is performed on the LCD 104 of the see-through image display unit 6, the process of mapping the image data stored in the memory 116 to the memory cell of the display memory 125 with reference to the table stored in the EEPROM 114. Is done. Thus, the mapped image data stored in the display memory 125 is output to the LCD 104 of the see-through image display unit 6.

  When a key input operation is performed from the keyboard 71 or the like of the remote controller 5, the character generator 126 generates character data in response to the operation. The character data is combined with predetermined image data and the like by the first CPU 111, temporarily recorded in the memory 116, and displayed on the LCD 48 or the LCD 104 of the see-through image display unit 6 as described above.

  Next, the see-through image display unit 6 projects an image, characters, and the like onto the observer's eye 99 by a holographic optical element (hereinafter referred to as “HOE (Holographic Optical Element)”) as a reflective combiner. And display means for displaying as a virtual image in front of the observer's visual field direction. Further, the see-through image display unit 6 also serves as a means for detecting the tilt angles of the head mounting unit 2 in the yaw direction and the pitch direction (these directions will be described later).

  That is, the see-through image display unit 6 includes an LED driver 101, an LED 102, a condenser lens 103, an LCD 104, an LCD driver 105, a first HOE 106, a second HOE 107, an angular velocity sensor 81, an angular velocity sensor 84, The amplifier 82 includes an amplifier 85, an A / D conversion circuit 83, and a second CPU 112.

  The LED driver 101 causes the LED 102 described later to emit light based on the control of the second CPU 112.

  The LED 102 is a light source that emits light when driven by the LED driver 101, and is a component of the display means.

  The condensing lens 103 condenses the light emitted by the LED 102 and is a component of the display means.

  The LCD 104 is a display element made of transmissive liquid crystal or the like for displaying information such as an image, and is configured by arranging a plurality of pixels as display pixels at equal intervals in a two-dimensional manner. The LCD 104 is a component of the display means, and is illuminated from the back side by the light of the LED 102 via the condenser lens 103.

  The LCD driver 105 drives the LCD 104 based on the control of the second CPU 112 to display information such as an image, and constitutes a part of movement control means.

  The first HOE 106 is a reflective optical member that reflects light emitted through the LCD 104 downwardly (see FIG. 16) while correcting aberrations as will be described later, and constitutes display means. ing.

  The second HOE 107 reflects and diffracts the light from the first HOE 106 toward the observer's eyes, thereby projecting information such as images and characters displayed on the LCD 104 so as to be observable and observing external light. Is a combiner configured to be transmitted toward the eyes of a person, and constitutes display means.

  The angular velocity sensor 81 constitutes an angle detection means, and is for detecting an angular velocity in the yaw direction (see FIG. 13 described later) of the head mounting portion 2.

  The amplifier 82 is for amplifying the output of the angular velocity sensor 81.

  The angular velocity sensor 84 constitutes an angle detection means, and is for detecting an angular velocity in the pitch direction (see FIG. 12 described later) of the head mounting portion 2.

  The amplifier 85 is for amplifying the output of the angular velocity sensor 84.

  The A / D conversion circuit 83 converts the output of the angular velocity sensor 81 output via the amplifier 82 and the output of the angular velocity sensor 84 output via the amplifier 85 into digital signals, respectively, and outputs the first signal. 2 for outputting to the CPU 112.

  The second CPU 112 is a control means for mainly controlling the see-through image display unit 6 and also serves as a display means, a display control means, an angle detection means, a movement control means, and an adjustment means. The second CPU 112 also serves as angle detection means for detecting the tilt angle of the observer's head based on the angular velocity information output from the angular velocity sensors 81 and 84. The second CPU 112 is bi-directionally connected to the first CPU 111, and performs predetermined operations in cooperation with each other while communicating with each other.

  Subsequently, the remote control unit 5 includes a second operation switch 131, a decoder 132, a transmission circuit 133, and a power supply circuit 134.

  The second operation switch 131 is an input means including switches as shown in FIG. 10 and also serves as an adjustment means and a time setting means.

  The decoder 132 is for converting the operation input from the second operation switch 131 into a signal for wireless transmission.

  The transmission circuit 133 is for wirelessly transmitting the signal converted by the decoder 132 to the reception circuit 123 of the control / recording unit 4 via the antenna 73.

  The power circuit 134 is for supplying power to each circuit in the remote controller 5 and includes a battery and the like.

  Next, the mainly optical configuration of the see-through image display unit 6 will be described with reference to FIGS. 12 is a diagram for explaining the pitch direction, FIG. 13 is a diagram for explaining the yaw direction, FIG. 14 is a diagram for explaining the principle of the optical system of the see-through image display unit, and FIG. 15 is a see-through image display unit. FIG. 16 is a left side view showing one configuration example of the optical system of the see-through image display unit, and FIG. 17 is another configuration example of the optical system of the see-through image display unit. FIG. 18 is a plan sectional view showing the configuration of the optical system of the see-through image display unit.

  The see-through image display unit 6 can superimpose and display information such as images and characters on the observation target that is actually observed by the observer as a virtual image. Hereinafter, the display is referred to as see-through display. Note that “substantially directly observing” means not only when observing with the naked eye, but also when observing through a substantially flat transparent member formed of glass or plastic, or This includes the case of observation through a diopter adjustment lens.

  First, terms relating to the tilt of the head will be described with reference to FIGS. “Pitch direction” refers to the inclination of the head in the front-rear direction, as shown in FIG. In addition, the “yaw direction” refers to the tilt of the head in the left-right direction, as shown in FIG. The head mounting unit 2 is configured to be used in a state where the observer is mounted on the head. Therefore, the head mounting unit 2 detects the inclination of the head mounting unit 2 and the head of the observer. Detecting the tilt is almost synonymous.

  With reference to FIG. 14, the principle of displaying a see-through image by the optical system of the see-through image display unit 6 in the first embodiment (hereinafter referred to as “see-through image display optical system”) will be described.

  The light emitted from the LED 102 is condensed by the condenser lens 103 and illuminates the LCD 104 from the back. Here, the LED 102 includes a diode capable of emitting light of three colors of R (red), G (green), and B (blue), respectively. For example, only the (green) diode can emit light.

  The second CPU 112 generates a signal corresponding to information such as an image or text and outputs it to the LCD driver 105. The LCD driver 105 drives the LCD 104 based on this signal, thereby causing the LCD 104 to display images, characters, and the like.

  Images and characters emitted from the LCD 104 upon receiving the light from the LED 102 are reflected by the second HOE 107 and then guided to the eyes of the observer. Thus, the observer can observe the image or character as a virtual image VI. In FIG. 14, since the principle is described, the first HOE 106 is not shown.

  The second HOE 107 is a volume phase holographic optical element using a photosensitive material such as a photopolymer or dichromated gelatin, and emits light with the maximum reflectance at each wavelength of R, G, B emitted from the LED 102. Designed to have reflective properties. Therefore, for example, when G light is emitted when displaying a character, the green character is clearly displayed as a virtual image. On the other hand, when displaying a color image so as to be observable, the color image is displayed on the LCD 104 and light of R, G, and B colors is emitted from the LED 102. HOE has excellent wavelength selectivity, and exhibits high reflection characteristics in the extremely narrow wavelength range for the light beams of the above-described R, G, and B wavelengths, while it has a high reflection characteristic for light beams of other wavelengths. Show high transmission characteristics. Accordingly, external light in the same wavelength region as the display light is diffracted and reflected and does not reach the observer's pupil, but external light in other wavelength regions reaches the observer's pupil. In general, since visible light has a wide wavelength bandwidth, it is possible to observe an external field image without any trouble even if light having an extremely narrow wavelength width including R, G, and B wavelengths does not arrive. is there.

  The first HOE 106 has a function of not only reflecting the light from the LCD 104 so as to guide it to the second HOE 107 but also correcting image plane distortion. Although the first HOE 106 is used here, a free-form optical element can be used instead. Since a free-form optical element is small and light, it can correct complex aberrations, and thus can display a clear image with little aberration without increasing the weight.

  Subsequently, a specific arrangement example of the see-through image display optical system will be described with reference to FIGS. 15 to 18.

  The LED 102, the condensing lens 103, the LCD 104, and the first HOE 106 are located on the observation object side inside the frame portion 13 and at a position above the transparent optical member 14 (or / and the transparent optical member 15). They are arranged in order as shown in FIG. These members are fixed so as to be sandwiched between holding frames 144 and 145 as shown in FIG. At this time, the LED 102 is fixed by the holding frames 144 and 145 while being mounted on the electric circuit board 141. In addition, as described above, the first HOE 106 is tilted so as to reflect the light from the LED 102 vertically downward.

  As shown in FIGS. 16 and 17, the transparent optical member 14 (or / and the transparent optical member 15) includes light guide members 142 and 143 formed to have a predetermined thickness using transparent glass, plastic, or the like. The second HOE 107 is disposed so as to be inclined so as to reflect light backward while being sandwiched between the light guide members 142 and 143. In such a configuration, the light reflected from the first HOE 106 passes through the inside of the light guide member 142 arranged on the upper side of the second HOE 107 and reaches the second HOE 107. The light propagation inside the light guide member 142 may be transmitted only as shown in FIG. 16, or a combination of transmission and total internal reflection as shown in FIG. It doesn't matter. When the optical design as shown in FIG. 17 is performed, the transparent optical member 14 (or / and the transparent optical member 15) can be thinned, and thus the head mounting portion 2 can be further reduced in weight. be able to.

  Further, as shown in FIG. 18, an electric circuit board 146 on which the LED driver 101 and the LCD driver 105 are mounted is provided on the observer's head side (opposite to the observation target) inside the frame portion 13. The holding frame 144 is disposed on the opposite side of the see-through image display optical system.

  The see-through image display optical system includes the LED 102, the condenser lens 103, the LCD 104, the first HOE 106, the second HOE 107, and the light guide members 142 and 143 among the above-described members. It has become.

  For example, the following two examples can be considered as to how the see-through image display unit 6 is arranged so that an observer generally observes an observation target with both eyes.

  First, in the first configuration example, only the portion corresponding to one eye of both eyes is configured by the see-through image display optical system as shown in FIG. 15 and the like, and the portion corresponding to the other eye is It is configured by a simple transparent optical member that does not have a see-through image display function. At this time, it is desirable that the transparent optical member corresponding to the other eye has the same luminous transmission characteristic as that of the transparent optical member 14 (or the transparent optical member 15). It is possible to reduce eye fatigue.

  Next, in the second configuration example, a see-through image display optical system as shown in FIG. 15 is configured corresponding to each of both eyes. When such a pair of see-through image display optical systems are used, it is possible to further reduce eye fatigue and to display an image observed stereoscopically as necessary.

  Next, a configuration for electrically connecting the electrical component of the front portion 11 and the electrical component 30a of the temple portion 12 will be described with reference to FIGS. 19 and 20. 19 is a plan view including a partial cross section showing the structure of the connecting portion including the front portion 11, the hinge portion 200, and the temple portion 12. FIG. 20 shows the connecting portion between the hinge portion 200 and the temple portion 12. As shown in FIG. It is the figure seen from the left side of FIG.

  Here, the hinge part 200 is a general term for the part including the hinge 24 and connecting the temple part 12 and the front part 11 (or the frame part 13).

  As shown in FIG. 3, the information display device 1 has the left and right temple portions 12 in a state of being substantially perpendicular to the front portion 11 when in use, and the hinges 24 and 25 are not used when not in use. As a center of rotation, it can be folded inward toward the front portion 11. Here, the vicinity of the hinge part 200 including the right hinge 24 will be described, but the same applies to the hinge part including the left hinge 25.

  The hinge 24 in the hinge part 200 is configured as an elbow joint, and as shown in FIG. 20, a U-shaped bearing provided with a cylindrical screw hole 193a provided on the front part 11 side. 193 and a bearing 194 provided with a cylindrical hole 194a provided on the temple portion 12 side are combined so that the respective holes 193a and 194a pass through, and these holes 193a and 194a are used as connecting pins. It is configured by inserting a shaft 191 that performs the function. In FIG. 20, the portion belonging to the temple portion 12 is hatched with a dotted line.

  As shown in FIG. 19, the electric circuit board 184 provided in the front portion 11 is electrically connected to one end side of the flexible printed board 185. The flexible printed circuit board 185 is disposed from the front portion 11 to the hinge portion 200, and the other end is electrically connected to a plurality of contacts 187 as shown in FIG. These contact points 187 are provided on a wall portion 195 erected in the hinge portion 200, and the connection between the flexible printed circuit board 185 and each contact point 187 is made via the connection portion 186. .

  On the other hand, the bearing 194 on the temple portion 12 side that is rotated relative to the bearing 193 on the front portion 11 side has a conductor 188 that is a coaxial contact that forms an arc shape along the circumferential surface. A plurality are provided along. These conductors 188 correspond to the plurality of contacts 187, respectively, are embedded in an insulator, and the surface exposed from the insulator is, for example, plated with gold. Note that the conductor 188 may have a gold plated surface.

  With such a configuration, the electrical connection between the contact 187 and the conductor 188 is maintained even if the front portion 11 and the temple portion 12 rotate relatively. In addition, since it is not necessary to connect the circuit unit related to image projection such as the LED driver 101 and the LCD driver 105 and the circuit unit disposed in the electrical component 30a by wiring a cable, a printed board, or the like. Can be kept clean and beautiful. In particular, the head mounting portion 2 of the information display device 1 is a portion that is used by being mounted on the head, and since the appearance is conspicuous to a third party, by adopting such a configuration, A great effect can be obtained.

  The contact point 187 is electrically connected to one end side of the flexible printed circuit board 190 via a connecting portion 189 on the peripheral surface of the bearing 194. Although not shown, the other end side of the flexible printed circuit board 190 is connected to an electric circuit board related to the electrical equipment section 30a of the temple section 12, and further connected to the control / recording section 4 via the cable 3 and the electric circuit board. Connected.

  With such a configuration, a signal for driving the LED driver 101 and the LCD driver 105 of the see-through image display unit 6 disposed in the frame unit 13 is transmitted from, for example, the second CPU 112 disposed in the electrical unit 30a. It has become so. For example, assuming that the angular velocity sensors 81 and 84, the amplifiers 82 and 85, and the A / D conversion circuit 83 are disposed in the electrical component 30b, the detection signals from these signals are similarly transmitted to the front unit 11. To the second CPU 112 of the electrical unit 30a.

  Next, an overview of image display by the information display device 1 will be described with reference to FIGS. FIG. 21 is a diagram showing an original image to be displayed, FIG. 22 is a diagram showing correspondence between pixels of the LCD 104 and the original image, and FIG. 23 is a diagram showing correspondence between an image projected as a virtual image and the original image.

  Assume that the original image 151 to be displayed is as shown in FIG. Here, since the purpose is to clarify the correspondence between the original image 151, the image displayed on the LCD 104, and the image observed as a virtual image, the original image 151 is divided into appropriate regions. Each area is hatched. In FIG. 21 to FIG. 23, the image areas to which common hatching is applied are areas corresponding to each other. The original image data is stored in the memory 116 as described above.

  In FIG. 21, one grid corresponds to one pixel constituting the original image 151. When the original image 151 is image data obtained by imaging with an image sensor, for example, one cell corresponds to one pixel of the image sensor. Information on each pixel indicated by such a cell is stored in the memory 116.

  In the original image 151 as shown in FIG. 21, a 6 × 6 pixel region at the center is a region a, and a region having a width of 1 pixel consisting of 10 pixels on one side with a width of 1 pixel around it is a region b. A region of 1 pixel width consisting of 16 pixels per side with a width of 2 pixels around the region is a region c, and a region of 1 pixel width consisting of 24 pixels per side with a width of 3 pixels around the region is a region c. d. In this manner, thinning is performed at wider intervals (coarsely) from the central area a to the peripheral area d.

  Next, the display surface 152 of the LCD 104 as a display element is as shown in FIG. In FIG. 22, one cell on the display surface 152 represents one display pixel. The display image data for the LCD 104 is stored in the display memory 125. At this time, as described above, data for display on the display pixel is stored in the memory cell of the display memory 125 so that the display pixel and the memory cell have a one-to-one correspondence. At this time, the display image data stored in the display memory 125 is mapped as described below with reference to a table stored in the EEPROM 114, for example, from the original image data stored in the memory 116. It was created by. As described above, the table stored in the EEPROM 114 maps the pixel data at which position in FIG. 21 to which position on the LCD 104 shown in FIG. 22, that is, at each address of the memory 116 in which the original image 151 is stored. It is stored in advance which memory address of the display memory stores the stored information.

  Specifically, the image data of the area a shown in FIG. 21 is displayed in the area a composed of 6 × 6 display pixels at the center of the LCD 104. Accordingly, the image data in the area a is maintained at a constant resolution (here, the resolution of the original image) in both the horizontal and vertical directions. Next, the image data of the area b is displayed around the area a so as to be in close contact with the area a, that is, without a gap. However, since the area b displayed at this time is composed of 8 display pixels per side, the area b of the original image 151 is composed of 10 pixels per side. By referring to, appropriate mapping is performed. The mapping at this time is a mapping that substantially performs subtractive pixel processing for converting pixel data of 10 pixels per side into pixel data of 8 display pixels per side. Similarly, the area c is arranged outside the area b in the LCD 104, and is composed of 10 display pixels per side. Therefore, the area c is mapped from 16 pixels per side to 10 display pixels per side. Further, the area d is arranged on the LCD 104 without any gap outside the area c, and is composed of 12 display pixels per side. Accordingly, in the area d, mapping from 24 pixels per side to 12 display pixels per side is performed.

  When a display image on the LCD 104 as shown in FIG. 22 is projected using a see-through image display optical system, an image as shown in FIG. 23 is observed as a virtual image 153 at a predetermined distance position. ing. That is, in the observed virtual image 153, the display image on the LCD 104 is an image that is extended in the peripheral direction from the center toward the periphery. More specifically, stretching in the peripheral direction is performed so that a certain pixel on the virtual image 153 has the same positional relationship as the corresponding pixel in the original image 151 (more precisely, a similar positional relationship). ing. Therefore, the see-through image display optical system is an optical system designed to restore the pixel positional relationship of the original image 151 by extending the peripheral portion of the image to the periphery of the image.

  The virtual image 153 as shown in FIG. 23 decreases in resolution as it goes to the periphery, but this is because it matches the characteristics of human visual acuity that decreases rapidly from the center of the retina to the periphery. In addition, as long as the observer gazes at the center of the image, there is no practical problem.

  According to such a configuration, since the number of display pixels (pixels) constituting the LCD 104 can be reduced, the information display device 1 can be reduced in size and price.

  In the relationship as shown in FIGS. 21 and 22, the display pixels as shown in FIG. 22 are generated by thinning out the pixels of the original image 151 as shown in FIG. However, the present invention is not limited to this, and one display pixel may be calculated using pixel data of a plurality of original images 151 (that is, calculated by interpolation or the like). In the case of sampling by thinning, since the processing load is light, there is an advantage that processing can be performed at high speed and low power consumption. On the other hand, when calculating by interpolation or the like, it is possible to display an image more faithful to the original image 151.

  Next, FIGS. 24 to 26 show other examples of image display by the information display device 1. 24 is a diagram showing an original image to be displayed, FIG. 25 is a diagram showing a correspondence between pixels of the LCD 104 and the original image, and FIG. 26 is a diagram showing a correspondence between an image projected as a virtual image and the original image.

  In the examples shown in FIGS. 21 to 23, the resolution is reduced two-dimensionally from the center to the periphery of the screen, that is, in the vertical and horizontal directions. However, the examples shown in FIGS. The resolution is changed only in the vertical direction of the screen.

  In the original image 151 shown in FIG. 24, a region a, a region b, a region c, and a region d are taken as regions having the full width of the image in the horizontal direction as shown. That is, the region a is set so that the vertical direction includes 6 pixels in the central portion and the horizontal direction includes all horizontal pixels so as to include the central portion of the original image 151. The region b is set as a band-like region on the upper side and the lower side of the region a so as to have a width of one pixel in the vertical direction and all horizontal pixels in the horizontal direction with an interval of one pixel. . The area c is set as a band-shaped area on the upper and lower sides of the area b with an interval of two pixels, a width of one pixel in the vertical direction, and all horizontal pixels in the horizontal direction. ing. Furthermore, the area d is set as a band-like area on the upper side and the lower side of the area c with a width of 1 pixel in the vertical direction and all horizontal pixels in the horizontal direction with an interval of 3 pixels. ing. In this way, thinning is performed at a wider interval (coarsely) from the central region a to the peripheral region d in the vertical direction. Thus, in the example shown in FIG. 24, sampling is performed so that the resolution in the vertical direction decreases toward the periphery while the horizontal resolution is kept constant.

  Next, the display surface 152 of the LCD 104 as a display element is as shown in FIG.

  The image data of the area a is displayed in the area a having 6 pixels in the vertical direction and all horizontal pixels in the horizontal direction at the center of the LCD 104. Therefore, a constant resolution is maintained in the horizontal / vertical direction for the image data in the region a (more precisely, in the example shown in FIGS. 24 and 25, the resolution of the original image is maintained in the vertical direction. However, in the horizontal direction, the resolution decreases according to the relationship between the total number of horizontal pixels of the original image data and the total number of horizontal display pixels of the LCD 104.) Above and below, the image data of the region b is displayed so as to be in close contact with the region a, that is, without a gap. Further, the area c is arranged outside the area b in the LCD 104 without leaving a gap. The area d is arranged outside the area c in the LCD 104 without leaving a gap. At this time, the mapping from the original image 151 to the pixels of the LCD 104 (that is, mapping from the memory 116 to the memory cells of the display memory 125) is performed by referring to the table of the EEPROM 114 as described above.

  Note that while the vertical and horizontal pixel configurations of the LCD 104 are constant, the vertical and horizontal pixel configurations of the original image to be displayed are various (for example, still images and moving images are different. Since there are resolution images, vertical position images, horizontal position images, and the like, it is difficult to store mapping table data for all original images in the EEPROM 114. Accordingly, only table data for mapping an original image having a pixel configuration that is generally widely used is stored in the EEPROM 114, and the other CPUs are mapped by calculation by the first CPU 111. Good. In this way, representative data can be processed and displayed at high speed, and original image data having a pixel configuration that is not stored as a table can be displayed as desired.

  Then, when the display image on the LCD 104 as shown in FIG. 25 is projected using the see-through image display optical system, an image as shown in FIG. 26 is observed as a virtual image 153 at a predetermined distance position. It has become. That is, in the observed virtual image 153, the display image on the LCD 104 is an image that is extended in the vertical direction from the center to the upper and lower peripheral portions. Therefore, the see-through image display optical system is an optical system that enlarges an image toward the periphery in the vertical direction. At this time, the vertical extension is performed so that a certain pixel on the virtual image 153 has the same positional relationship (similar positional relationship) as the corresponding pixel in the original image 151, as described above. .

  Therefore, in the virtual image as shown in FIG. 25, the resolution in the vertical direction decreases as it goes to the periphery, but the resolution in the horizontal direction is kept constant.

  If the configuration that realizes the correspondence relationship of the pixel data as shown in FIGS. 24 to 26 is adopted, the resolution of the image observed by the observer is changed only in the one-dimensional direction. Compared with mapping in which the resolution is changed in the dimensional direction, mapping of pixel data from the memory 116 to the display memory 125 can be performed more easily.

  In addition to the examples shown in FIGS. 21 to 23 or the examples shown in FIGS. 24 to 26, the LCD 104 is centered on a predetermined position (for example, the center position of the display surface). It is also possible to perform mapping so that the resolution becomes coarse according to only the distance from the center without depending on the direction seen from the center, that is, the resolution becomes coarser toward the concentric periphery.

  Since FIGS. 21 to 26 are examples for explaining the technical idea, the illustrated example is different from the actual original image and the configuration of the LCD 104 (that is, the actual number of pixels and the number of pixels). There are many more, and the original image has various pixel configurations as described above.) Accordingly, various specific values for the number of pixels and the sampling interval of the original image take various values depending on the design.

  Furthermore, in order for the observed image as shown in FIGS. 23 and 26 to be similar to the original image as shown in FIGS. 21 and 24, an image from the original image to the LCD 104 as a display element is displayed. Is the first mapping, and the process of displaying the image mapped on the LCD 104 by the optical system is the second mapping, the first mapping and the second mapping are mutually inverse mappings (more precisely, Since the irreversible change in which the number of pixels is reduced, the reverse mapping cannot be performed, and only the geometric positional relationship is the reverse mapping. In order to secure this relationship, it is easier to adjust the mapping process according to the characteristics of the optical system by a program than to design the characteristics of the optical system according to the mapping process. It is.

  As described above, according to the present technology, an original image is displayed on a display element at a lower resolution with a predetermined position as the center, and the image displayed on the display element is displayed on the periphery via an optical system. The display is enlarged as you go.

  Next, the operation of mapping the original image information stored in the memory 116 to each address of the display memory 125 and displaying it on the LCD 104 will be described.

  The memory 116 illustrated in FIG. 11 stores an original image to be displayed, and this original image is, for example, a high-definition image. Which address in the memory 116 is written to which address in the display memory 125 is previously stored in the EEPROM 114 as a table in association with each other as described above.

  Each memory address of the display memory 125 is configured to correspond to 1: 1 for a predetermined pixel of the LCD 104. The LCD 104 is driven by the LCD driver 105 to display the data in the display memory 125 as an image.

  In the configuration as described above, the first CPU 111 maps the data in the memory 116 to each address in the display memory 125 while referring to the table stored in the EEPROM 114.

  The table stored in the EEPROM 114 is stored in advance as a table that realizes reverse mapping of the mapping of the see-through image display optical system that projects an image as a virtual image so as to enlarge the peripheral portion as described above. Is. Therefore, the optical properties of the see-through image display optical system (those determined by design may be used, but those measured for each product may be used in consideration of individual differences of the optical system. The table can be calculated by calculating a mapping based on the above, calculating the inverse mapping thereof, and further performing a process of subtracting pixels.

  The information mapped to the display memory 125 is displayed on the LCD 104, reflected by the first HOE 106, and guided to the observer's eye 99 by the second HOE 107 as a combiner.

  Thereby, the observer can observe the image as shown in FIG. 23 or FIG. 26 as a virtual image at a predetermined position.

  The table stored in the EEPROM 114 is determined by design as described above, but various manufacturing errors may occur in the process of manufacturing the information display device 1. Therefore, such errors are corrected by the following means.

  In order to perform this correction, an image of a test chart 155 as shown in FIG. 27 is prepared as an original image and stored in the memory 116. FIG. 27 is a diagram illustrating an example of a test chart. The test chart 155 is, for example, a chart in which a plurality of vertical straight lines and horizontal straight lines are arranged at equal intervals, thereby drawing a line in a grid pattern.

  Then, the data of the test chart 155 stored in the memory 116 is mapped to the display memory 125 while referring to the table stored in the EEPROM 114.

  The data stored in the display memory 125 is displayed on the LCD 112 and is projected onto the observer's eyes as a virtual image whose periphery is enlarged by a see-through image display optical system including the first HOE 106 and the second HOE 107. A figure similar to the test chart 155 stored in the memory 116 can be observed.

  Here, an image displayed via the second HOE 107 is picked up by an image pickup device provided for acquiring correction data at the time of manufacture. It is assumed that this image pickup apparatus does not cause image distortion or has known information about image distortion. Information on the geometric distortion of the test chart 155 generated in the information display device 1 is analyzed and acquired from the image data obtained from the imaging device. Then, based on the analysis data, a process of correcting the table of the EEPROM 114 is performed so that the distortion can be corrected. At this time, the image data obtained by the imaging device may be displayed on the adjustment monitor so that the displayed image and the state of correcting the image can be observed.

  For example, a line to be displayed as a horizontal straight line (that is, this line is a line 157 to be achieved after correction) is lifted upward as it goes to the left and right peripheral portions as shown in FIG. It is assumed that such a curve 156 is displayed on the observer's eyes. FIG. 28 is a diagram showing a state before and after correction of a straight line in one horizontal direction in the test chart shown in FIG. Here, assuming that the center of the image is the origin and the x axis is in the horizontal right direction and the y axis is in the vertical upward direction, vertical distortion Δy occurs at a certain position P (x, y) of the display image. Will be. Therefore, the distortion Δy is obtained, and the table of the EEPROM 114 is corrected so that the image of the display image P (x, y) is displayed at the corrected position Q based on the magnitude of the distortion Δy. Become. If such a detection of the distortion Δy at a certain position P (x, y) is performed for all the pixels constituting the image, it takes a long time for the processing, and therefore several locations in the image are required. It is only necessary to determine representative points, detect the distortion Δy for these representative points, and estimate the distortion Δy for other points by interpolation or the like. Thus, when the distortion Δy related to all the pixels is obtained, the table of the EEPROM 114 is corrected so that the distortion Δy can be corrected.

  Such a correction is not impossible by an inspector manually, but it is not so realistic considering productivity, cost, individual differences among inspectors, etc. It is preferable to use an inspection correction system that automatically corrects the table data by performing the above. However, when the observer performs correction at the time of use, it may be performed manually while observing the image of the test chart 155 through the second HOE 107.

  In the above description, the vertical distortion Δy as shown in FIG. 28 is the target of correction. However, the distortion to be corrected is not limited to this, and horizontal distortion, rotational distortion, and the like. Various geometric distortions can be targeted.

  If the original image information in the memory 116 is input information, the table information in the EEPROM 114 is intermediate information, and the image observed as a virtual image is output information, the table correction method stored in the EEPROM 114 as described above is the input information described above. This indicates that the intermediate information can be obtained experimentally from the relationship between the output information and the output information. The characteristics of the intermediate information are determined by the optical system, but the method of obtaining such experimental intermediate information does not depend on the specific optical system. It is possible to ask. Accordingly, various optical systems can be widely applied without being limited to the optical system described in the present embodiment as long as the optical system is adapted to the technical idea of enlarging a peripheral image.

  FIG. 29 is a flowchart showing a process for adjusting the initial position of the display screen. The process shown in FIG. 29 will be described with reference to FIGS. FIG. 31 is a diagram showing a display example when the initial position of the display screen is adjusted, and FIG. 32 is a diagram showing a display example when the initial position of the display screen is adjusted.

  As will be described later, the information display device 1 according to the present embodiment can display the display image as if it is fixed to the outside world, regardless of the movement of the observer's head. Therefore, when the observer tilts the head, the image is shifted by an amount corresponding to the tilt amount in a direction opposite to the tilt of the head according to the movement. The process shown in FIG. 29 is a process for adjusting which tilt angle of the head is used for such a shift.

  Now, it is assumed that a screen as shown in FIG. 31 is displayed when the observer is just facing the front, for example. In FIG. 31, the displayable range 91 is indicated by a dotted line, and a display frame 92 is displayed at a lower right position in the displayable range 91, and the inside of the display frame 92 is a display screen 93. Yes.

  In such a state, when the information display device 1 is set to the adjustment mode by performing a predetermined key operation by the observer using the remote control unit 5, the left side in the displayable range 91 is shown in FIG. As shown, a character 94 “ADJ” indicating the adjustment mode is displayed (step S1).

  Next, when the pointer 74 of the remote control unit 5 is operated up, down, left and right, the first CPU 111 of the control / recording unit 4 detects the key input via wireless (step S2).

  If the detected upward key operation is detected, the display frame 92 and the display screen 93 are moved upward within the displayable range 91 at a predetermined moving speed while the key operation is being performed. (Step S3).

  If the detected key operation is downward, the display frame 92 and the display screen 93 are moved downward within the displayable range 91 at a predetermined moving speed while the key operation is being performed. (Step S4).

  Further, when the left key operation is detected, the display frame 92 and the display screen 93 are moved leftward within the displayable range 91 at a predetermined moving speed while the key operation is being performed. (Step S5).

  If the detected right key operation is detected, the display frame 92 and the display screen 93 are moved to the right within the displayable range 91 at a predetermined moving speed while the key operation is being performed. (Step S6).

  When any of these operations in steps S3 to S6 is completed, it waits for the left button 75 of the remote controller 5 to be clicked (step S7). Here, until the left button 75 is clicked, the process proceeds to step S2 to continue the key input process.

  On the other hand, when the left button 75 is clicked, the position of the display frame 92 is confirmed. At the same time, the character 94 “ADJ” indicating the adjustment mode disappears. Thereby, for example, the display frame 92 and the display screen 93 in the state shown in FIG. 32 are displayed as virtual images.

  Thereafter, the head yaw and pitch angle data θy and θp calculated based on the outputs of the angular velocity sensors 81 and 84 are reset (step S8), and the position adjustment of the display screen is completed.

  By performing such adjustment, the positions of the display frame 92 and the display screen 93 in the initial state are determined, and the angle data θy and θp are measured thereafter using the initial state as a base point.

  In the example shown in FIGS. 31 and 32, the display frame 92 is clearly shown using a boundary line, but it is not always necessary to make it clear.

  Here, the adjustment of the initial position is performed by executing the process as shown in FIG. 29, but the present invention is not limited to this. For example, when the head has a predetermined inclination angle (specifically, when the observer puts the head at an inclination angle that the observer wants to set to the initial position), for example, a predetermined key input operation (for example, the above-mentioned By performing an operation of clicking the left button 75), the display screen may be set at a predetermined position and the angle data θy and θp may be reset. By adopting such an operation system, the initial positions of the display frame 92 and the display screen 93 can be adjusted more easily.

  Next, FIG. 30 is a flowchart illustrating processing for controlling the display position of an image.

  The process shown in FIG. 30 is a process that gives the feeling of observing an externally fixed monitor by shifting the display area of the screen in the direction opposite to the tilt angle of the head. Yes.

  When shifting the display area of the monitor according to the tilt angle of the head, it is good that the change of the display area follows the change of the tilt angle of the head quickly and smoothly. Since there is a limit, the smoothness of updating the display area may be impaired. Therefore, in this embodiment, the display area is updated only when an angle change of a predetermined value or more that does not significantly impair smoothness occurs.

  However, even if the processing is performed in this way, the display area is updated with a certain delay every time the tilt angle of the head slightly fluctuates. . Therefore, in this embodiment, the head tilt angle change threshold value is changed when the head tilt changes in the forward direction and immediately after the head tilt changes. That is, the above-mentioned uncomfortable feeling is reduced by providing a so-called hysteresis characteristic that increases the angle change immediately after detecting the angle change in the reverse direction with respect to the angle change in the forward direction in which the display area is updated. (See Steps S15 to S19 and Step S22 described later). In this embodiment, when a scroll operation is performed, the display area is updated so as to scroll the image in the display area (see steps S23 to S25 described later).

  Such processing will be described in detail with reference to FIG.

  When this processing is started, first, angular velocity information in the yaw direction of the observer's head detected by the angular velocity sensor 81 is input (step S11), and the pitch direction of the observer's head detected by the angular velocity sensor 84 is entered. Is input (step S12).

  Then, the angular velocity Δθy [rad] in the yaw direction is calculated by time-integrating the angular velocity in the yaw direction acquired in step S11 (step S13), and the angular velocity in the pitch direction acquired in step S12 is time-integrated. As a result, an angle change Δθp [rad] in the pitch direction is calculated (step S14).

  Next, at least one of the absolute value | Δθy | of the angle change in the yaw direction and the absolute value | Δθp | of the angle change in the pitch direction within a predetermined time (predetermined time) is a predetermined value ( It is determined whether or not it is larger than a predetermined first threshold value α1, that is, whether or not at least one of | Δθy |> α1 and | Δθp |> α1 is established (step S15).

  If it is determined that at least one of | Δθy | and | Δθp | is greater than the predetermined value α1, the angle change Δθy or Δθp determined to be larger than the predetermined value α1 It is determined whether or not the value is in the opposite direction to the detected value (that is, whether or not the sign is opposite to that at the previous detection) (step S16). This process is a process for determining whether the change in the tilt angle of the head remains in the forward direction or in the reverse direction.

  If it is determined in step S16 that the value is in the opposite direction, at least one of the absolute value | Δθy | of the angle change in the yaw direction and the absolute value | Δθp | Whether one is greater than a second predetermined value (predetermined second threshold) α2 (where the second predetermined value α2 is a value satisfying α2> α1), that is, | Δθy |> α2. It is further determined whether or not at least one of | Δθp |> α2 holds (step S17).

  If it is determined in step S17 that at least one of | Δθy | and | Δθp | is greater than the second predetermined value α2, or if it is determined in step S16 that the direction is not the opposite direction, The amount of movement of the display frame 92 (and display screen 93) corresponding to Δθy or Δθp is calculated (step S18). This calculation of the amount of movement is performed by calculating L × Δθy or L × Δθp, where L is the distance from the observer's eye to the screen.

  Next, based on the calculated amount of movement, whether the display frame 92 (and the display screen 93) after movement is at least partially within the displayable range 91 or is entirely outside. Are determined (step S19).

  If it is determined that the entire display frame 92 is outside the displayable range 91, the time measured by the timer provided in the first CPU 111 is the entire display frame 92. Is initially outside the displayable range 91, it is continuously determined whether or not the predetermined time Ts previously stored in the EEPROM 114 is reached (step S20).

  If it is determined in step S20 that the predetermined time Ts has elapsed, the information display device 1 is set in the low power consumption mode, and the power supplied from the power supply circuit 124 is reduced (step S21). After that, this process is terminated. The predetermined time Ts is set to a desired time length by operating the menu button 63, the menu selection switches 66, 67, 68, 69, the confirmation switch 65, etc. shown in FIG. Can be done. Specifically, in the low power consumption mode, except for operations related to some functions of the first CPU 111 and the second CPU 112, other operations of the first CPU 111 and the second CPU 112, or operations of blocks other than the CPU This is done by stopping the process, which is similar to known means.

  On the other hand, when it is determined in step S19 that at least a part of the display frame 92 is in the displayable range 91 and an image can be displayed, or in step S20, the display frame 92 is not displayed. When the measured time is shorter than the predetermined time Ts, the amount corresponding to the amount of movement calculated in step S18 in the direction opposite to the angle change in the yaw direction or pitch direction of the observer's head. The information of the display frame 92 and the information of the display screen 93 are mapped and stored in the display memory 125 so as to move the display screen only (step S22). Thereafter, the process returns to step S11 and the above-described processing is repeated.

  On the other hand, if it is determined in step S15 that both | Δθy | and | Δθp | are equal to or smaller than the predetermined value α1, or in step S17, both | Δθy | and | Δθp | If it is determined that the value is equal to or less than the predetermined value α2 of 2, it is determined whether or not an operation for scrolling the display screen 93 in the display frame 92 is performed (step S23). This scrolling operation is performed by operating the pointer 74 of the remote control unit 5 up, down, left, and right. While any of these key operations is performed, the scroll operation is performed according to the key operation. The display screen 93 is scrolled in the designated direction.

  If it is detected in step S23 that the scroll operation is being performed, the display screen 93 is scrolled to the position of the memory cell corresponding to the display frame 92 in the display memory 125 in accordance with the scroll operation. As described above, the original image is read from the memory 116, mapped, and stored (step S24).

  Thereafter, it is determined whether or not the scroll operation has been completed (step S25), and the process returns to step S24 until the process is completed, and the mapping process as described above is repeated.

  If it is determined that the scroll operation has been completed in this way, or if it is determined in step S23 that the scroll operation has not been performed, the process returns to step S11 and the operations described above are repeated. .

  The processing as described with reference to FIG. 30 is mainly performed by the first CPU 111 (see FIG. 11), but the second CPU 112 receives the processing according to the magnitude of the load on the first CPU 111. You may perform the distributed processing which bears a part of processing.

  In the above description, display data for display on the LCD 104 is generated based on the original image stored in the memory 116. For example, character data generated by the character generator 126, other standard data, and the like are generated. May be directly written in the display memory 125 without going through the memory 116. However, at this time, referring to the table of the EEPROM 114, the processing corresponding to the display position is performed and then the data is written in the display memory 125, as in the case of the original image stored in the memory 116. .

  On the other hand, the original image data read out from the memory 116 is processed in real time and output from the second CPU 112 so as to be synchronized with the display control by the LCD driver 105 without being written in the display memory 125. It is also possible to make it.

  Furthermore, in the above description, an information display device of the type that projects a display image with reduced resolution in the peripheral area onto the eyes of the observer so that the geometric similarity with the original image is substantially maintained is taken as an example. However, the present invention is not limited to this, and it is possible to apply a technique for reducing the resolution of the peripheral portion to a projector apparatus that projects and displays an image on a screen or the like.

  According to the first embodiment, in consideration of the characteristics of the human eye, the resolution of the image corresponding to the central portion of the retina with good visual acuity is increased and the peripheral portion of the retina with poor visual acuity is supported. Since the resolution of the image to be reduced is reduced, it is possible to observe a high resolution image while effectively using a limited number of pixels provided in the display element. As a result, in order to obtain the same resolution as in the prior art, it is possible to use a small and inexpensive display element with a smaller number of pixels. Alternatively, when a display element similar to the conventional one is used, a higher resolution can be obtained.

  At this time, since the observed image is substantially similar to the original image, a natural image can be observed without the peripheral portion of the image being compressed or expanded.

  In addition, since the resolution in the peripheral area is reduced by mapping from the original image to the memory cell, processing can be performed at high speed, and the delay time until the image is displayed is reduced as much as possible. Can do. At this time, by storing the mapping correspondence as a table in the EEPROM, it is possible to perform processing at high speed without imposing much load on the CPU or the like.

  Then, by setting the predetermined reference position as one point in the image, it is possible to improve the sense of resolution by using the pixels of the display element more efficiently.

  Also, by making the predetermined reference position a straight line passing through one point in the image, the mapping process can be performed more easily and at high speed.

  Such a configuration can be used particularly effectively in a head-mounted information display device of a type that is used by being worn on the observer's head and projects display information onto the observer's eyes.

  In addition, since the display information in the display area can be scrolled, desired information can be displayed in a portion where the highest resolution can be obtained. This makes it possible to clearly observe an arbitrary image while being a small and light device.

  Also, regardless of the tilt of the observer's head, the image is moved in the direction opposite to the tilt direction of the observer's head so that the position of the virtual image when viewed from the observer is substantially constant. Therefore, the observer can observe the image as if he / she is observing a display screen (for example, a large-size) fixed to the outside world.

  Furthermore, since the initial position of the image to be displayed can be adjusted, an optimal initial position can be selected according to the individual differences of the observer and the purpose of use. Therefore, for example, when used as a monitor for a personal computer on a train, it is possible to set a display screen obliquely downward and input characters using the remote control unit. Then, in order to detect the tilt angle of the head with reference to this initial position, it is possible to observe an image centered on the position of the head when it is a natural body, for example. Such adjustment of the initial position of the display screen makes it feel as if the display screen installed in the outside world is installed at an optimal position, which is a convenient function.

  In addition, when the initial position of the image can be moved to a desired position, the degree of freedom of adjustment is increased. On the other hand, when the image is adjusted to a predetermined initial position, the operation is simplified. .

  Even when the angle of the head changes, if the amount of change in angle within a predetermined time is equal to or less than the first threshold, the display screen is not shifted in the opposite direction to the change in angle of the head. Therefore, it is not necessary to perform calculation every time the head changes slightly, and the load on the CPU can be reduced.

  Furthermore, when the head angle changes in the opposite direction, the threshold for determining whether or not to perform the process of shifting the display screen in the direction opposite to the head angle change is compared with that in the same direction. Therefore, it is possible to effectively prevent the screen from flickering due to the minute vibration of the head centering on the predetermined position.

  When the display frame deviates from the displayable range and is not displayed for a predetermined time or longer, the information display device is automatically switched to the low power consumption mode. Even if it is not performed, the power consumption can be reduced and the battery life and the like can be extended. For example, as described above, when used as a monitor for a personal computer in a train or the like and the display screen is set obliquely downward, the head is lifted when getting off the train. Since the screen disappears from the field of view and the outside world can be observed without obstruction, normal actions can be taken safely without removing the display device, and power consumption can be reduced without turning off the display device. Can be achieved. In this way, it becomes a wearable portable information display device that can provide advanced functions while being easy to use.

  In addition, since the predetermined time until switching to the low power consumption mode can be set to a desired length of time, usage according to the needs of the observer is possible.

  In addition, this invention is not limited to the Example mentioned above, Of course, a various deformation | transformation and application are possible within the range which does not deviate from the main point of invention.

  INDUSTRIAL APPLICABILITY The present invention can be suitably used for a display device that displays so that an image can be observed while being worn on the head.

1 is a perspective view showing a usage pattern of a head-mounted information display device in Example 1 of the present invention. The front view which shows the head mounting part of the said Example 1. FIG. The top view which shows the head mounting part of the said Example 1. FIG. The right view which shows the head mounting part of the said Example 1. FIG. FIG. 3 is a plan view showing a control / recording unit in a state where an operation panel is closed in the first embodiment. In the said Example 1, the right view which shows the control / recording part of the state which closed the operation panel. In the said Example 1, the left view which shows the control / recording part of the state which closed the operation panel. In the said Example 1, the top view which shows the operation switches arrange | positioned at the operation panel. In the said Example 1, the perspective view which shows the control / recording part of the state which opened the operation panel. The top view which shows the structure of the remote control part in the said Example 1. FIG. FIG. 3 is a block diagram showing a configuration mainly related to an electronic circuit of the information display device in the first embodiment. The figure for demonstrating the pitch direction in the said Example 1. FIG. The figure for demonstrating the yaw direction in the said Example 1. FIG. FIG. 3 is a diagram for explaining the principle of the optical system of the see-through image display unit in the first embodiment. FIG. 3 is a front view including a partial cross section illustrating a configuration of an optical system of a see-through image display unit in the first embodiment. FIG. 3 is a left side view illustrating a configuration example of an optical system of a see-through image display unit in the first embodiment. FIG. 6 is a left side view illustrating another configuration example of the optical system of the see-through image display unit in the first embodiment. FIG. 3 is a cross-sectional plan view showing a configuration of an optical system of a see-through image display unit in the first embodiment. In the said Example 1, the top view containing the partial cross section which shows the structure of the connection part containing a front part, a hinge part, and a temple part. The figure which looked at the connection part of a hinge part and a temple part from the left side of FIG. 19 in the substantially right direction in the said Example 1. FIG. FIG. 3 is a diagram illustrating an original image to be displayed in the first embodiment. FIG. 3 is a diagram showing a correspondence between LCD pixels and an original image in the first embodiment. In the said Example 1, the figure which shows a response | compatibility with the image projected as a virtual image, and an original image. FIG. 6 is a diagram illustrating another example of an original image to be displayed in the first embodiment. FIG. 6 is a diagram showing another example of correspondence between LCD pixels and original images in the first embodiment. In the said Example 1, the figure which shows the other example of a response | compatibility with the image projected as a virtual image, and an original image. The figure which shows the example of the test chart in the said Example 1. FIG. The figure which shows the mode before and behind correction of the straight line of one horizontal direction in the test chart shown in the said FIG. 5 is a flowchart showing processing for adjusting an initial position of a display screen in the first embodiment. 7 is a flowchart illustrating processing for controlling the display position of an image in the first embodiment. The figure which shows the example of a display of a screen when adjusting the initial position of a display screen in the said Example 1. FIG. The figure which shows the example of a display of a screen when the initial position of a display screen is adjusted in the said Example 1. FIG. Diagram showing visual acuity at each part of the retina with luminance as a parameter.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Information display apparatus 2 ... Head mounting part 3 ... Cable 4 ... Control / recording part 5 ... Remote control part 6 ... See-through image display part (display means)
DESCRIPTION OF SYMBOLS 11 ... Front part 12 ... Temple part 13 ... Frame part 14, 15 ... Transparent optical member 19 ... Nose pad part 20 ... Bridge part 21 ... Cable connection terminal 24, 25 ... Hinge 26, 27 ... Tip cell modern 30a, 30b ... Electrical equipment Reference numeral 33: Box part 41: Control / recording body part 42: Operation panel 44 ... Power switch 48 ... LCD display element 49 ... Cable connection terminal 50 ... AV / S connection terminal 51 ... PC connection terminal 54 ... Recording memory insertion port 55 ... Battery insertion port 56 ... Speaker 59 ... Play / stop switch 63 ... Menu button 65 ... Confirmation switch 66,67,68,69 ... Menu selection switch 71 ... Keyboard 72 ... Dome pointer operation section (scroll means)
73 ... Antenna 74 ... Pointer 75 ... Left button 76 ... Right button 81 ... Angular velocity sensor (yaw direction) (angle detection means)
82, 85 ... Amplifier 83 ... A / D conversion circuit 84 ... Angular velocity sensor (pitch direction) (angle detection means)
91: Displayable range 92 ... Display frame 93 ... Display screen 94 ... Character 101 ... LED driver 102 ... LED
103 ... Condensing lens 104 ... LCD display element (display means, display element)
105 ... LCD driver (movement control means)
106: First holographic optical element (first HOE) (display means, optical system)
107: Second holographic optical element (second HOE) (display means, optical system)
111... First CPU (control means, display means, display control means, movement control means, adjustment means)
112 ... Second CPU (control means, display means, display control means, angle detection means, movement control means, adjustment means)
113 ... 1st operation switch (adjustment means, time setting means)
114... EEPROM (display means, display control means, third storage means)
116: Memory (display means, first storage means)
117 ... D / A conversion circuit 118 ... LCD driver 119 ... compression / decompression circuit 120 ... recording memory (recording means)
121 ... Selection circuit 122 ... Hard disk (recording means)
123. Reception circuit 124 ... Power supply circuit 125 ... Display memory (display means, second storage means)
126: Character generator 131: Second operation switch (adjustment means, time setting means)
132 ... Decoder 133 ... Transmission circuit 134 ... Power supply circuit 141, 146 ... Electric circuit board 142, 143 ... Light guide member 151 ... Original image 152 ... Display surface 153 ... Virtual image 155 ... Test chart 184 ... Electric circuit board 185, 190 ... Flexible Printed circuit boards 186, 189 ... connecting part 187 ... contact 188 ... conductor 191 ... shaft 193, 194 ... bearing 200 ... hinge part
Agent Patent Attorney Susumu Ito

Claims (3)

Display means for projecting an image on the eyes of the observer to display the image as a virtual image so as to be observable;
An angle detection means for detecting the tilt angle of the observer's head;
Regardless of the inclination of the observer's head, the direction of the observer's head detected by the angle detection means is the opposite direction so that the position of the virtual image when viewed from the observer is substantially constant And a movement control means for controlling the image displayed by the display means to move by an amount corresponding to the angle detected by the angle detection means,
Adjusting means for adjusting the initial position of the image displayed by the display means;
Comprising
The movement control means detects the tilt angle of the head by the angle detection means with reference to the initial position of the image, and displays the display position of the image displayed by the display means based on the detected angle. A head-mounted display device that controls the head.   The head-mounted display device according to claim 1, wherein the adjusting means adjusts an initial position of the image by moving the image to a desired position by the movement control means.   The head-mounted display device according to claim 1, wherein the adjusting unit adjusts an initial position of the image to a predetermined initial position.

Images