JP2017191424A - Head-mounted type display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a head-mounted type display device having a user interface which is operated by a foot of a user and suitable for a wearable apparatus.SOLUTION: A head-mounted type display device includes: an image display unit which is mounted on a head of a user; a load detection type foot input part that detects a load applied to a sole of the user; and a display setting part that sets a display image to be displayed on the image display unit according to the load detected by the load detection type foot input part.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a head-mounted display device.

  A head-mounted display device (Head Mounted Display, HMD) that is a display device mounted on the head is known. For example, the head-mounted display device generates image light representing an image using a liquid crystal display and a light source, and causes the user to visually recognize the generated image light using a projection optical system or a light guide plate. The HMD is a wearable device that is worn on a so-called user's body.

  Patent Literature 1 describes a pointing device that can move a cursor displayed on a screen by an operation with a foot.

JP-A-8-179879 JP 2001-67179 A JP2013-72729A JP-A-2006-122 JP 2014-326713 A JP-A-10-55248

  However, although the technique described in Patent Document 1 can change the position of the cursor as a display image by operating the foot, a space for installing a pointing device that accepts the operation is required, and the pointing device is not included in the wearable device. There was a problem that it was not suitable.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms.

(1) According to one aspect of the present invention, a head-mounted display device is provided. The head-mounted display device includes an image display unit mounted on a user's head; a load detection type foot input unit that detects a load on the sole of the user's foot; and the load detection type foot input unit A display setting unit configured to set a display image to be displayed on the image display unit according to the detected load. According to this form of the head-mounted display device, the user can set a display image in a hands-free state, and the convenience for the user is improved. In addition, since the load detection type foot input unit is a wearable device attached to the sole of the user's foot, the user's body and head-mounted display device do not occupy space for operation, and the head Partially mounted display devices are used in various environments.

(2) The head-mounted display device according to the above aspect further includes: a state specifying unit that specifies an activity state of the user; and the display setting unit is not a moving state in which the user is moving as the activity state When the display image is set according to the load detected by the load detection type foot input unit, and when it is specified that the user is not moving as the active state, The setting of the set display image may be continued. According to the head-mounted display device of this aspect, it is possible to improve the convenience of the user while preventing a malfunction in which the display image is changed due to a change in the load due to the user's activity state. .

(3) In the head-mounted display device of the above aspect, the load detection type foot input unit detects a load distribution within a predetermined range; the display setting unit displays a preset pointer image as the image display The display position of the pointer image on the image display unit may be changed according to a change in the distribution of the load detected by the load detection type foot input unit. According to the head-mounted display device of this form, the user can change the display position of the pointer image in a hands-free manner and the convenience of the user is improved.

(4) In the head mounted display device of the above aspect, the load detection type foot input unit includes a right load detection type foot input unit that detects a load on the right foot and a left load detection type foot input that detects a load on the left foot. The display setting unit according to the change in the load detected by the right load detection type foot input unit and the change in the load detected by the left load detection type foot input unit, A display image may be set. According to the head-mounted display device of this form, the user can change the load applied to the right foot and the load applied to the left foot, so that the display image is sensed by a combination of the load on the right foot and the load on the left foot. The user convenience can be improved.

(5) In the head-mounted display device of the above aspect, the load detection type foot input unit specifies a change in position between the right load detection type foot input unit and the left load detection type foot input unit; The display setting unit may execute enlargement or reduction of at least a part of the display image in accordance with the change in the position. According to the head-mounted display device of this embodiment, the user can sensibly enlarge or reduce the display image by changing the positional relationship between the right foot and the left foot, which is convenient for the user. improves.

(6) In the head-mounted display device of the above aspect, the display setting unit; displays a preset pointer image on the image display unit; and distribution of the right load detected by the right load detection type foot input unit The position of the pointer image is changed according to the distribution of the left load detected by the left load detection type foot input unit, and the amount of change in the display position of the pointer image that changes according to the change in the distribution of the right load And the amount of change in the display position of the pointer image that changes according to the change in the distribution of the left load. According to the head-mounted display device of this embodiment, the user performs fine adjustment of the display position of the pointer image with the dominant foot, and performs rough adjustment of the display position of the pointer image with the foot different from the dominant foot. Can do. Thereby, the user can set the display position of the pointer image more finely by using the left foot and the right foot properly.

(7) The head-mounted display device according to the above aspect further includes: an inertial sensor formed separately from the load detection type foot input unit and the image display unit; and the display setting unit includes the inertial sensor The display image may be set according to the inertia data acquired by and the load detected by the foot mounting portion. According to this form of the head-mounted display device, the load of the shoe sole of the shoe worn by the user and the detected value acquired by the inertial sensor of the other part of the user are used to teach the user. The user can efficiently perceive the movement to be performed.

(8) In the head-mounted display device according to the above aspect, when the display setting unit can set the display image according to the load detected by the load detection type foot input unit, the load detection type foot input unit An image representing the position may be displayed on the image display unit. According to the head-mounted display device of this aspect, the position of the load detection type foot input unit can be recognized by the user, and the operability for the user is improved.

(9) In the head mounted display device of the above aspect, the load detection type foot input unit has a surface shape corresponding to the sole of a user's foot, and can detect a load on at least a part of the surface shape. The display setting unit may cause the image display unit to display an image representing the position of the sensor with respect to the surface shape as an image representing the position of the load detection type foot input unit. According to this form of the head-mounted display device, the user can recognize the detailed position of the sensor capable of detecting the load, and the operability for the user is further improved.

  The present invention can also be realized in various forms other than the head-mounted display device. For example, a display device, a user interface for operating various devices, a head-mounted display device and a display device control method, a control system, a head-mounted display system, a control system, and a display device for realizing the functions The present invention can be realized in the form of a computer program, a recording medium recording the computer program, a data signal including the computer program and embodied in a carrier wave, and the like.

It is a schematic diagram of a user wearing a head-mounted display device (HMD) in the present embodiment. It is explanatory drawing which shows the external appearance structure of an image display part, a control part, and its peripheral device. It is a block diagram which shows the structure of HMD in this embodiment functionally. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing showing the position of the 2nd operation part arrange | positioned at a shoe sole. It is an image figure of the control signal output by the change of the load which the 2nd operation part received. It is an image figure of the control signal output by the change of the load which the 2nd operation part received. It is explanatory drawing of the arrow image which changes a display position according to the control signal which the 2nd operation part detected. It is explanatory drawing of the arrow image which changes a display position according to the control signal which the 2nd operation part detected. It is a block diagram of the load detection type foot input part in a 2nd embodiment. It is the schematic of a right foot sensor and a left foot sensor. It is the schematic of a right foot sensor and a left foot sensor. It is a block diagram which shows functionally the structure of HMD in 4th Embodiment. It is explanatory drawing of the input part image showing the position of the 2nd operation part with respect to the load detection type | mold foot input part displayed only on the right optical image display part. It is explanatory drawing showing the position of the 2nd operation part of the modification 1 arrange | positioned at the shoe sole. It is explanatory drawing showing the position of the load detection type | mold foot input part of the modification 2 arrange | positioned at the shoe sole. It is explanatory drawing showing the position of the load detection type | mold foot input part of the modification 3 arrange | positioned at the shoe sole. It is explanatory drawing which shows the external appearance structure of HMD in a modification. It is explanatory drawing which shows the external appearance structure of HMD in a modification.

A. First embodiment:
FIG. 1 is a schematic diagram of a user US wearing a head-mounted display device 100 (HMD 100) according to this embodiment. The HMD 100 is a display device mounted on the head, and is also called a head mounted display (HMD). As shown in FIG. 1, the HMD 100 is disposed on the control unit 10, the image display unit 20 worn on the head of the user US, the left earphone 34, and the shoe sole of the shoe worn by the user US. And a load detection type foot input unit 80. In the HMD 100 of the present embodiment, the user US can visually recognize the image displayed on the image display unit 20 and can also directly view the outside scene that has passed through the image display unit 20. Note that the HMD 100 also includes configurations other than those described above, which will be described later.

  FIG. 2 is an explanatory diagram showing an external configuration of the image display unit 20 and the control unit 10 and their peripheral devices. FIG. 2 shows a device other than the load detection type foot input unit 80 in the HMD 100. The control unit 10 (controller 10) controls the image display unit 20.

  The image display unit 20 can display an image such as content. The image display unit 20 is a mounting body attached to the head of the user US, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 60. And. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user US when the user US wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user US when the user US wears the image display unit 20.

  The right holding unit 21 extends from the end ER that is the other end of the right optical image display unit 26 to a position corresponding to the temporal region of the user US when the user US wears the image display unit 20. It is a member provided. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the temporal region of the user US when the user US wears the image display unit 20. It is a member provided by being stretched. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the head of the user US like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are arranged on the side facing the user US's head when the user US wears the image display unit 20. Hereinafter, the right holding unit 21 and the left holding unit 23 are collectively referred to simply as “holding units 21 and 23”, and the right display driving unit 22 and the left display driving unit 24 are simply referred to as “display driving unit 22”. , 24 ", and the right optical image display unit 26 and the left optical image display unit 28 are also collectively referred to simply as" optical image display units 26, 28 ".

  The display drive units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 (see FIG. 3). Details of the configuration of the display driving units 22 and 24 will be described later. The optical image display units 26 and 28 as optical members include light guide plates 261 and 262 (see FIG. 3) and a light control plate. The light guide plates 261 and 262 are formed of a light transmissive resin material or the like, and guide the image light output from the display drive units 22 and 24 to the eyes of the user US. The light control plate is a thin plate-like optical element, and is disposed so as to cover the front side of the image display unit 20 which is the side opposite to the eye side of the user US. The light control plate protects the light guide plates 261 and 262 and suppresses damage to the light guide plates 261 and 262 and adhesion of dirt. Further, by adjusting the light transmittance of the light control plate, the amount of external light entering the eyes of the user US can be adjusted to adjust the ease of visual recognition of the display image. The light control plate can be omitted. The camera 60 images an outside scene. The camera 60 is disposed at a position where one end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48, a right cord 42, a left cord 44, and a connecting member 46 connected to the control unit 10. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24. The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. A connector (not shown) that fits each other is provided at each of the end of the main body cord 48 opposite to the connecting member 46 and the control unit 10. By fitting / releasing the connector of the main body cord 48 and the connector of the control unit 10, the control unit 10 and the image display unit 20 are connected or disconnected. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for controlling the HMD 100. The control unit 10 includes a determination key 11, a lighting unit 12, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. Yes. The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control unit 10. The lighting unit 12 notifies the operation state of the HMD 100 according to the light emission state. The operation state of the HMD 100 includes, for example, power ON / OFF. For example, an LED is used as the lighting unit 12. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example. The track pad 14 detects the operation of the finger of the user US on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the HMD 100 by detecting a slide operation of the switch.

  FIG. 3 is a block diagram functionally showing the configuration of the HMD 100 in the present embodiment. As shown in FIG. 3, the control unit 10 includes a storage unit 120, a power source 130, a first communication unit 132, a first operation unit 135, a CPU 140, an interface 180, a transmission unit 51 (Tx51), and transmission. Part 52 (Tx52). The first operation unit 135 receives an operation by the user, and includes a determination key 11, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. The power supply 130 supplies power to each part of the HMD 100. As the power supply 130, for example, a secondary battery can be used. The first communication unit 132 performs wireless communication with other devices such as a content server, a television, and a personal computer in accordance with a predetermined wireless communication standard such as a wireless LAN or Bluetooth (registered trademark).

  The storage unit 120 includes a ROM that stores computer programs, and a RAM that is used when the CPU 140 executes writing and reading of various computer programs.

  The CPU 140 reads a computer program stored in the ROM of the storage unit 120 and writes and reads the computer program in the RAM of the storage unit 120, whereby the operating system 150 (OS 150), the display control unit 190, the audio processing unit 170, It functions as an image processing unit 160 and an image setting unit 165.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 controls driving of the right LCD 241 by the right LCD control unit 211, driving ON / OFF of the right backlight 221 by the right backlight control unit 201, and left LCD control unit according to control signals. The left LCD 242 driving ON / OFF by 212, the left backlight 222 driving ON / OFF by the left backlight control unit 202, and the like are individually controlled. Thus, the display control unit 190 controls the generation and emission of image light by the right display driving unit 22 and the left display driving unit 24, respectively. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals to the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal as image data (RGB data) of the target image in the DRAM in the storage unit 120 for each frame. Note that the image processing unit 160 may execute image processing such as various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. . Note that the image data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and a speaker (not shown) in the right earphone 32 and a speaker (not shown) connected to the connecting member 46 ( An audio signal is supplied to (not shown). For example, when the Dolby (registered trademark) system is adopted, processing on the audio signal is performed, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, for example.

  The state specifying unit 168 specifies the activity state of the user US of the HMD 100 based on a control signal transmitted from a load detection type foot input unit 80 described later. Specifically, the state specifying unit 168 specifies the activity state of the user US based on the change in the load of the user US detected by the load detection type foot input unit 80. For example, when the load of the user US detected by the load detection type foot input unit 80 is increasing or decreasing at a constant cycle, the state specifying unit 168 is in a walking movement state in which the user US is walking. Identifies it. As another example of the active state, when the load of the user US detected by the load detection type foot input unit 80 is constant and does not change, the state specifying unit 168 does not move or move the user US. Identify as standing.

  The image setting unit 165 performs various settings for an image (display image) to be displayed on the image display unit 20. For example, the image setting unit 165 sets the display position of the display image, the size of the display image, the brightness of the display image, or the like, or allows the user to visually recognize the display image as a three-dimensional image three-dimensionally (3D). The right-eye image data and the left-eye image data are set so as to form binocular parallax (also simply referred to as “parallax”). Although details will be described later, the image setting unit 165 changes the load detected by the load detection type foot input unit 80 when the state specifying unit 168 specifies that the activity state of the user US is not moving. Accordingly, the display image to be displayed on the optical image display units 26 and 28 is set. In other words, when the state specifying unit 168 specifies that the activity state of the user US is the moving state, the image setting unit 165 does not depend on the change in the load detected by the load detection type foot input unit 80. The display image already set and displayed on the optical image display units 26 and 28 is continued without being changed. The image setting unit 165 corresponds to a display setting unit in claims.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the control unit 10. Examples of the external device OA include a personal computer (PC), a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, or the like can be used.

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a camera 60. And.

  The right display driving unit 22 includes a receiving unit 53 (Rx53), a right backlight control unit 201 (right BL control unit 201) and a right backlight 221 (right BL221) that function as a light source, and a right LCD that functions as a display element. A control unit 211, a right LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201 and the right backlight 221 function as a light source. The right LCD control unit 211 and the right LCD 241 function as display elements. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the reception unit 53. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimating lens that converts the image light emitted from the right LCD 241 into a light beam in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user US while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”.

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes a receiving unit 54 (Rx54), a left backlight control unit 202 (left BL control unit 202) and a left backlight 222 (left BL222) that function as a light source, and a left LCD that functions as a display element. A control unit 212 and a left LCD 242 and a left projection optical system 252 are included. The left backlight control unit 202 and the left backlight 222 function as a light source. The left LCD control unit 212 and the left LCD 242 function as display elements. The left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are also collectively referred to as “image light generation unit”. The left projection optical system 252 is configured by a collimating lens that converts the image light emitted from the left LCD 242 into a light beam in a parallel state. The left light guide plate 262 as the left optical image display unit 28 guides the image light output from the left projection optical system 252 to the left eye LE of the user US while reflecting the image light along a predetermined optical path. The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “light guide unit”.

  FIG. 4 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal at each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221 into an image. Is modulated into an effective image light PL representing The same applies to the left side. As shown in FIG. 3, the backlight system is adopted in the present embodiment, but the image light may be emitted using a front light system or a reflection system.

  The load detection type foot input unit 80 detects the distribution of a predetermined range of the load applied to the shoe sole by the movement of the user US. The load detection type foot input unit 80 includes a second communication unit 81, a second operation unit 82, and a battery 83. The battery 83 supplies power to the second communication unit 81 and the second operation unit 82. As the battery 83, for example, a secondary battery can be used. The second communication unit 81 transmits the control signal output from the second operation unit 82 to the first communication unit 132. The second communication unit 81 performs wireless communication with the first communication unit 132 in accordance with a predetermined wireless communication standard such as a wireless LAN or Bluetooth. The 2nd operation part 82 is a load sensor arrange | positioned at the shoe sole.

  FIG. 5 is an explanatory diagram showing the position of the second operation unit 82 arranged on the shoe sole. As shown in FIG. 5, the second operation unit 82 is disposed in the vicinity of the toe of the shoe sole of the right shoe worn on the right foot of the user US as the load detection type foot input unit 80. The second operation unit 82 is arranged at a position corresponding to the vicinity of the position of the thumb of the right foot of the user US when the user US wears the right shoe. FIG. 5 shows an X axis, a Y axis, and a Z axis, which are orthogonal to each other, in order to express the relationship between positions and orientations in FIGS. 6 and 7 described later. The X axis is an axis parallel to the horizontal direction in FIG. 5, the Y axis is an axis parallel to the vertical direction in FIG. 5, and the Z axis is an axis orthogonal to the surface of the shoe sole.

  FIGS. 6 and 7 are image diagrams of control signals that are output according to changes in the distribution of loads received by the second operation unit 82. As shown in FIGS. 6 and 7, when the second operation unit 82 detects a change in load distribution in the load direction D1 along the positive direction of the Y axis, the second operation unit 82 outputs a control signal along the positive direction of the Y axis. Output. In this case, for example, the image setting unit 165 changes the display position of the pointer image displayed on the optical image display units 26 and 28 in accordance with the control signal output by the second operation unit 82. The second operation unit 82 outputs a control signal in a direction along the detected load directions D2, D3, D4. Note that the image setting unit 165 of the present embodiment validates the control signal transmitted from the load detection type foot input unit 80 when the state specifying unit 168 determines that the activity state of the user US is not a moving state. handle. In other words, when the state specifying unit 168 determines that the activity state of the user US is the moving state, the image setting unit 165 handles the control signal transmitted from the load detection type foot input unit 80 as invalid. .

  8 and 9 are explanatory diagrams of the arrow image CS1 in which the display position is changed according to the control signal detected by the second operation unit 82. FIG. FIG. 8 shows a display image IMG1 displayed on the optical image display units 26 and 28 before corresponding to the change in the distribution of the load detected by the second operation unit 82. FIG. 9 shows a display image IMG2 displayed on the optical image display units 26 and 28 after corresponding to the load distribution change detected by the second operation unit 82. The display image IMG1 includes four icon images IC1, IC2, IC3, IC4, and an arrow image CS1. The icon image IC1 is a selection image for executing imaging of an outside scene by the camera 60 when selected. The icon image IC2 is a selection image for connecting to the Internet and displaying various home pages as images when selected. The icon image IC3 is a selection image for exchanging messages with other devices via the first communication unit 132 when selected. The icon image IC4 is a selection image for opening a menu screen for executing an operation such as termination of display of the display image IMG1 when selected. The arrow image CS1 is an image that changes the display position in the display image IMG1 according to the change in the load detected by the second operation unit 82. When the determination operation is performed in a state where the arrow image CS1 overlaps the icon image, a program corresponding to the overlapped icon image is executed. Examples of the determination operation include an operation of pressing the determination key 11 of the first operation unit 135.

  FIG. 9 shows a display image IMG2 in which the position of the arrow image CS1 is changed to the arrow image CS2 as compared with FIG. In FIG. 9, the position of the arrow image CS1 in the display image IMG1 that is not actually displayed is indicated by a broken line. The arrow image CS2 is an image after the second operation unit 82 detects a change in load distribution along the load direction D1 (FIGS. 6 and 7) from the state of the arrow image CS1. The image setting unit 165 changes the display position of the arrow image CS1 included in the display image IMG1 according to the change in the distribution of the load detected by the second operation unit 82. In other words, the user US can freely change the display position of the arrow image CS1 in the display image IMG1 by changing the distribution of the load applied to the shoe sole by the thumb of the right foot. The arrow images CS1 and CS2 correspond to pointer images in the claims.

  As described above, in the HMD 100 according to the present embodiment, the image setting unit 165 performs the optical image according to the load of the user US detected by the second operation unit 82 that is a load sensor of the load detection type foot input unit 80. A display image to be displayed on the display units 26 and 28 is set. Therefore, in the HMD 100 of the present embodiment, the user US can move the pointer image as a display image in a hands-free state and the convenience of the user US is improved. Further, since the load detection type foot input unit 80 is a wearable device arranged on the sole of the footwear worn by the user US, the HMD 100 does not occupy more space than necessary for the operation. Used in various environments.

  Moreover, in HMD100 of this embodiment, the state specific | specification part 168 specifies whether the active state of the user US is a movement state according to the load which the load detection type | mold foot input part 80 detected. The image setting unit 165 sets a display image according to the load detected by the load detection type foot input unit 80 only when the activity state of the user US is not a moving state. Therefore, in the HMD 100 according to the present embodiment, it is possible to improve the convenience of the user US while preventing a malfunction in which the display image is changed due to a change in the load due to the movement state of the user US.

  In the HMD 100 of the present embodiment, the image setting unit 165 displays the arrow images CS1 and CS2 displayed on the optical image display units 26 and 28 in accordance with the change in the distribution of the load detected by the load detection type foot input unit 80. Change the display position of. Therefore, in the HMD 100 of the present embodiment, the user US can change the display positions of the arrow images CS1 and CS2 in a hands-free manner and the convenience of the user US is improved.

B. Second embodiment:
FIG. 10 is a block diagram of the load detection type foot input unit 80a in the second embodiment. The HMD 100a of the second embodiment is different from the HMD 100 of the first embodiment in the load detection type foot input unit 80a, and the other configurations are the same as those of the HMD 100 of the first embodiment. Therefore, in the second embodiment, details of the load detection type foot input unit 80a different from the first embodiment will be described, and description of the same configuration as that of the first embodiment will be omitted.

  As shown in FIG. 10, the load detection type foot input unit 80 a of the second embodiment includes a right foot sensor 821 and a left foot sensor 822. The right foot sensor 821 is a load sensor disposed on the bottom of the right shoe worn on the right foot of the user US. The left foot sensor 822 is a load sensor disposed on the bottom of the left shoe worn on the left foot of the user US. The right foot sensor 821 and the left foot sensor 822 also function as an acceleration sensor that can detect the acceleration of the foot of the user US that is worn. The right foot sensor 821 corresponds to the right load detection type foot input unit in the claims, and the left foot sensor 822 corresponds to the left load detection type foot input unit in the claims.

  FIG. 11 is a schematic diagram of the right foot sensor 821 and the left foot sensor 822. As shown in FIG. 11, the right foot sensor 821 is disposed at a position corresponding to the right foot below the thumb when the user US wears shoes on the right foot, like the second communication unit 81 of the first embodiment. The The left foot sensor 822 is disposed at a position corresponding to the bottom of the left foot when the user US wears shoes on the left foot. When the right foot sensor 821 detects acceleration along the load direction D5 and the left foot sensor 822 detects acceleration along the direction of the load direction D6 opposite to the load direction D5, the image setting unit 165 displays an arrow image. An image in a predetermined range centering on the display position of CS1 is enlarged. In short, when the right foot sensors 821 and 822 detect a change in position such that the right foot and the left foot of the user US are separated, the image setting unit 165 enlarges the display image in a predetermined range.

  FIG. 12 is a schematic diagram of the right foot sensor 821 and the left foot sensor 822. As shown in FIG. 12, when the right foot sensor 821 detects acceleration along the load direction D6 and the left foot sensor 822 detects acceleration along the load direction D5, the image setting unit 165 displays the arrow image CS1. An image in a predetermined range centering on the position is reduced. In brief, when the right foot sensor 821 and the left foot sensor 822 detect a change in position such that the right foot and the left foot of the user US approach each other, the image setting unit 165 reduces the display image in a predetermined range.

  As described above, in the HMD 100a of the second embodiment, the second operation unit 82 includes the right foot sensor 821 that detects acceleration as a change in the position of the right foot of the user US, and the change in the position of the left foot of the user US. And a left foot sensor 822 for detecting acceleration. The image setting unit 165 changes the positions of the optical image display units 26 and 28 according to changes in the positions of the right foot of the user US wearing the right foot sensor 821 and the left foot of the user US wearing the left foot sensor 822. Set the display image. Furthermore, the image setting unit 165 enlarges or reduces the display image according to a change in the position of the right foot of the user US wearing the right foot sensor 821 and the left foot of the user US wearing the left foot sensor 822. Execute. Therefore, in HMD100a of 2nd Embodiment, the user US can operate a display image sensuously by changing the positional relationship of a right foot and a left foot, and the convenience of the user US improves.

C. Third embodiment:
In the third embodiment, as in the second embodiment, the second operation unit 82a includes the right foot sensor 821 and the left foot sensor 822, and the image setting unit 165b executes as compared with the second embodiment. Control is different. In the third embodiment, the image setting unit 165b changes the display positions of the arrow images CS1 and CS2 according to the change in the distribution of the load detected by the right foot sensor 821 and the change in the distribution of the load detected by the left foot sensor 822. Change. In the third embodiment, the image setting unit 165b includes a change amount of the display position of the arrow image CS1 corresponding to the load change amount detected by the right foot sensor 821, and an arrow corresponding to the load change amount detected by the left foot sensor 822. Control is performed so that the amount of change in the display position of the image CS1 is different. Specifically, in the third embodiment, the change amount of the display position of the arrow image CS1 with respect to the change amount of the load distribution detected by the right foot sensor 821 is the arrow image of the change amount of the load distribution detected by the left foot sensor 822. It is smaller than the change amount of the display position of CS1.

  As described above, in the HMD 100b of the third embodiment, the amount of change in the display position of the arrow image CS1 corresponding to the change in the distribution of the load detected by the right foot sensor 821, and the change in the distribution of the load detected by the left foot sensor 822. The amount of change in the display position of the arrow image CS1 corresponding to is different. Therefore, in the HMD 100b of the third embodiment, the user US performs fine adjustment of the display position of the arrow image CS1 with his dominant foot, and performs rough adjustment of the display position of the arrow image CS1 with his foot different from the dominant foot. Can do. Thereby, the user US can set the display position of the arrow image CS1 more finely by using the left foot and the right foot properly.

D. Fourth embodiment:
FIG. 13 is a block diagram functionally showing the configuration of the HMD 100c in the fourth embodiment. Compared with the HMD 100 of the first embodiment, the HMD 100c of the fourth embodiment has an inertial sensor 90 that is mounted at a position other than the head of the user US and the sole of the shoe worn by the user US. The image setting unit 165c sets the display image based on the detection value of the inertial sensor 90 and the detection value of the load detection type foot input unit 80. Other configurations are the same as those in the first embodiment. It is the same as HMD100. In FIG. 13, the block diagram of the content connected to the interface 180 shown in FIG. 3 is omitted and not shown.

  As shown in FIG. 13, the HMD 100 c according to the fourth embodiment includes an inertial sensor 90. The inertial sensor 90 is mounted on the knee of the user US and detects the motion of the user US. The inertial sensor 90 includes a third communication unit 91, an acceleration sensor 92, and a battery 93. The battery 93 supplies power to the third communication unit 91 and the acceleration sensor 92. As the battery 93, for example, a secondary battery can be used. The third communication unit 91 transmits the control signal output from the acceleration sensor 92 to the first communication unit 132c. The acceleration sensor 92 detects acceleration based on the direction of gravity. Therefore, the inertial sensor 90 specifies the operation of the user US based on the acceleration detected by the acceleration sensor 92. The acceleration detected by the acceleration sensor 92 corresponds to the inertia data in the claims.

  The image setting unit 165c validates the load detected by the load detection type foot input unit 80 only when the inertial sensor 90 hardly detects a change in operation (for example, a state where the user US is stopped), and The display position of the image CS1 is changed. In addition, the image setting unit 165c uses the detected values of the inertial sensor 90 and the detected value of the load detection type foot input unit 80 as numerical values or graphs according to the operation received by the first operating unit 135, as optical image display units 26 and 28. Can be displayed.

  The state specifying unit 168c of the fourth embodiment can specify the activity state of the user US based on the acceleration detected by the inertial sensor 90 and the change in the distribution of the load detected by the load detection type foot input unit 80. The state specifying unit 168c indicates that the change in acceleration detected by the inertial sensor 90 fluctuates at a constant period with respect to the direction of gravity, and that the user US is moving along a plane parallel to the direction of gravity. By detecting, it can identify that user US is a movement state.

  As described above, in the HMD 100c according to the fourth embodiment, the image setting is performed according to the detection value detected by the inertial sensor 90 attached to a portion different from the head worn by the user US and the shoe worn by the user US. The unit 165c sets a display image. For this reason, in the HMD 100c of the fourth embodiment, control by a combination of the detection value of the load detection type foot input unit 80 and the detection value of the inertial sensor 90 is possible, and thus various controls can be executed. Further, in the HMD 100c of the fourth embodiment, the ideal of the user US such as dance is used by using the load on the sole of the shoe worn by the user US and the detected values of other parts in the user US. It can be applied to perceive typical body movements. Examples of the movement of the body of the user US include a golf swing, a balance between left and right feet of a ski, and the like.

E. Fifth embodiment:
FIG. 14 is an explanatory diagram of an input unit image IM80 showing the position of the second operation unit 82 with respect to the load detection type foot input unit 80 displayed only on the right optical image display unit 26. Compared to the first embodiment, the HMD of the fifth embodiment is different from the first embodiment in that the image setting unit 165 displays the input unit image IM80 only on the right optical image display unit 26. This is the same as the HMD 100 of the first embodiment. Therefore, in the fifth embodiment, the input unit image IM80 will be described, and description of the same processing and the same configuration as those of the first embodiment will be omitted.

  As illustrated in FIG. 14, the image setting unit 165 displays the display image IMG3 on the right optical image display unit 26. In the upper right of the display image IMG3, an input part image IM80 representing the position of the second operation part 82 capable of detecting the load of the user US in the load detection type foot input part 80 shown in FIG. 5 is included. In the fifth embodiment, the image setting unit 165 causes the left optical image display unit 28 to display the display image IMG3 that does not include the input unit image IM80. In another embodiment, the same display image IMG3 displayed on the right optical image display unit 26 may be displayed on the left optical image display unit 28.

  The input unit image IM80 is a surface-shaped image corresponding to the back surface of the right foot of the user US. The input unit image IM80 includes an operation position image IM82. The position of the operation position image IM82 in the input unit image IM80 is the same as the position of the second operation unit 82 in the load detection type foot input unit 80. In other words, the input part image IM80 is an image for allowing the user US to recognize in which part the operation position image IM82 is located in the input part image IM80.

  As described above, in the HMD of the fifth embodiment, the image setting unit 165 causes the right optical image display unit 26 to display the input unit image IM80 including the operation position image IM82. The input unit image IM80 is an image representing the position of the second operation unit 82 with respect to the load detection type foot input unit 80. Therefore, in the HMD of the fifth embodiment, the user US can recognize the position of the second operation unit 82 to which a load is applied in order to execute the operation by visually recognizing the input unit image IM80. Thereby, the operability for the user US is improved. Furthermore, the input unit image IM80 representing the load detection type foot input unit 80 attached to the right foot of the user US is displayed only on the right optical image display unit 26 corresponding to the right eye RE of the user US. Further, the input part image IM80 is included on the right side of the display image IMG3. Therefore, the user US can more intuitively recognize that the load detection type foot input unit 80 corresponds to the right foot, and the operability of the user US is further improved.

F. Variations:
In addition, this invention is not limited to the said embodiment, It can implement in a various aspect in the range which does not deviate from the summary, For example, the following deformation | transformation is also possible.

F-1. Modification 1:
In the first embodiment, the load detection type foot input unit 80 detects the distribution of the load applied to the shoe sole. However, the concept of pressure and vibration is also included in the “load” in the present specification and claims. . For example, the load detection type foot input unit 80 may be any one of a pressure sensor, a pressure sensor, an impact sensor, and a contact sensor. In the first embodiment, as an example of the load detection type foot input unit 80, which is arranged on the shoe sole, the load detection type foot input unit 80 is not an insole as in the first embodiment. It may be directly formed in the shoe, may be a sandal type, or may be attached to the outside of the shoe.

  In the first embodiment, the second operation unit 82 is arranged on the shoe sole of the shoe mounted on the user US so as to correspond to the position where the thumb of the user US is placed. About the part by which 82 is arrange | positioned, various deformation | transformation is possible. FIG. 15 is an explanatory diagram illustrating the position of the second operation unit 82d of Modification 1 disposed on the shoe sole. As shown in FIG. 15, the second operation unit 82d of the load detection type foot input unit 80d of the fourth embodiment includes five fingers on the right foot of the user US in the right shoe worn on the right foot of the user US. A load sensor is arranged at a portion corresponding to the position of the base. In the load detection type foot input unit 80d of this modification, the user US can control the display images of the optical image display units 26 and 28 not by the right toe but by the entire weight of the right foot. In other embodiments, the load sensor may be disposed on the entire sole, or the position at which the load sensor is disposed may be different between the right foot and the left foot.

F-2. Modification 2:
In the above embodiment, the change in the display position of the arrow image CS1 has been mainly described as the display image set by the image setting unit 165. However, the display image to be set can be variously modified. For example, in response to a change in the load detected by the load detection type foot input unit 80, a function corresponding to mouse click, double click, and drag, which is a user interface of the PC, is executed, and the change associated with the execution is changed in the image. It may be output as a change.

  FIG. 16 is an explanatory diagram illustrating the position of the load detection type foot input unit 80e according to the second modified example disposed on the shoe sole. Similar to the load detection type foot input unit 80a of the second embodiment, the load detection type foot input unit 80e of the second modification includes a right foot sensor 821e and a left foot sensor 822e. Similarly to the second embodiment, the left foot sensor 822e is disposed at a position corresponding to the thumb of the left foot of the user US in the left shoe worn on the left foot of the user US. The right foot sensor 821e includes a first left foot sensor 823 and a second left foot sensor 824. The first left foot sensor 823 is arranged at a position corresponding to the thumb of the right foot of the user US in the right shoe worn on the right foot of the user US. The second left foot sensor 824 is disposed at a position corresponding to the ring finger and the little finger of the right foot of the user US in the right shoe worn on the right foot of the user US. The left foot sensor 822e, the first left foot sensor 823, and the second left foot sensor 824 detect an ON signal so as to correspond to pressing of the button when a load equal to or greater than a preset threshold is applied. The left foot sensor 822e corresponds to a mouse double click (left) function when a load equal to or greater than a threshold is detected. The first left foot sensor 823 corresponds to a mouse left click function when a load equal to or greater than a threshold is detected. The second left foot sensor 824 corresponds to a right click of the mouse when a load equal to or greater than a threshold is detected. The function settings of the left foot sensor 822e, the first left foot sensor 823, and 824 can be variously modified. When the left foot sensor 822e detects a load of a threshold value or more twice within a predetermined time, A click function may be performed. In the second modification, not only the display position of the arrow image CS1 can be changed, but also control for determining various menus and display image change based on the control can be executed.

F-3. Modification 3:
FIG. 17 is an explanatory diagram illustrating the position of the load detection type foot input unit 80f according to the third modified example disposed on the shoe sole. Similar to the load detection type foot input unit 80a of the second embodiment, the load detection type foot input unit 80f of Modification 3 includes a left foot sensor 822f and a right foot sensor 821f. As shown in FIG. 17, the left foot sensor 822f is a load sensor disposed on the entire sole of the left shoe worn on the left foot of the user US. When the left foot sensor 822f detects a change in the distribution of the load while the right foot sensor 821f detects the load, the image setting unit 165f changes the display position of the arrow image CS1 along the four directions of the load direction D9. . When the left foot sensor 822f detects a change in load distribution in a state where the right foot sensor 821f is not detecting a load (for example, a state where the user US is raising the right foot), the image setting unit 165f Set the display image that served as the control. The right foot sensor 821f is a load sensor partially disposed on the sole of the right shoe worn on the right foot of the user US.

  As shown in FIG. 17, the right foot sensors 821f are discretely arranged at three locations on the shoe sole. One is placed at a position corresponding to the base of the thumb, one of the remaining two is placed at a position corresponding to the base of the little finger, and the other one is placed at a position corresponding to the heel. Yes. When the left foot sensor 822f detects a load, the image setting unit 165f determines the load according to the change in the distribution of the load detected by the two load sensors at positions corresponding to the bases of the thumb and the little finger in the right foot sensor 821f. The display position of the arrow image CS1 is changed along the direction D8. The image setting unit 165f responds to a change in the load detected by at least one of a load sensor arranged on the heel of the right foot sensor 821f, a load sensor corresponding to the thumb position, and a load sensor corresponding to the little finger position. Thus, the display position of the arrow image CS1 is changed along the load direction D7 orthogonal to the load direction D8. When any load sensor of the right foot sensor 821f detects a change in load in a state where the left foot sensor 822f has not detected a load, the image setting unit 165f sets a display image that functions as the “determination” control. As described above, the image setting unit 165f changes the setting of the display image assigned to the load detected by the load detection type foot input unit 80f according to the combination of the loads detected on the right foot and the left foot of the user US. May be.

F-4. Modification 4:
In the embodiment described above, the display positions of the arrow images CS1 and CS2 have been changed. However, the images themselves of the arrow images CS1 and CS2 may be changed depending on the load detected by the load detection type foot input unit 80. For example, in the load detection type foot input unit 80f according to the third modification, the image setting unit 165f uses the load detected by the left foot sensor 822f to change the display position of the arrow image CS1 and the load detected by the right foot sensor 821f. The color and shape of the arrow image CS1 may be set differently when the display position of the arrow image CS1 is changed.

  In the above embodiment, the user US is not considered, but the HMD 100 may be set corresponding to each user US. For example, by setting the weight of each user US in advance, the threshold value of the load detected by the load detection type foot input unit 80 may be set to a different value for each user US.

  The change in the load detected by the load detection type foot input unit 80 is set to correspond to the shape of the sole for each user US because the area of the sole contacting the shoe sole and the shape of the sole differ depending on the user US. May be. For example, before the operation based on the detection value of the load detection type foot input unit 80 is executed, data when the user US applies a load to the right or a load on the heel is acquired and acquired. Based on the data, the threshold value of the load detected by the load detection type foot input unit 80 and the degree of change direction of the load may be set.

  In the fourth embodiment, the image setting unit 165c sets the display image according to the combination of the detection value of the load detection type foot input unit 80c and the detection value of the inertial sensor 90, but the load detection type foot input unit Different controls may be associated with the detected value of 80c and the detected value of the inertial sensor 90, respectively. For example, the image setting unit 165c changes the display position of the arrow image CS1 based on the detection value of the load detection type foot input unit 80, and sets a display image corresponding to the “decision” function based on the detection value of the inertial sensor 90. Also good.

  In the above embodiment, the battery 83 included in the load detection type foot input unit 80 may be formed using a piezo element, and may store electric power generated by the movement of the user US.

  In the above embodiment, the load detection type foot input unit 80 detects the change in the load distribution, but it is not always necessary to detect the load distribution. For example, the load detection type foot input unit 80 may detect a change in the load on the sole of the user US according to the load applied to the plurality of load sensors arranged discretely. The load detection type foot input unit 80 may detect only one point of load, and the image setting unit 165 may set a display image corresponding to “determination” in accordance with the detection of the load.

  In the first embodiment, the movement state is described as an example of the activity state of the user US identified by the state identification unit 168. However, the activity state of the user US can be variously modified. For example, the activity state of the user US includes a step in a certain cycle, a preload that occurs at the time of front turning, a rear load in the case of reverse of the preload, a right load, a left load, and the like. In addition, the state specifying unit 168 can also combine changes in the activity state at a predetermined time or at a plurality of predetermined timings. The image setting unit 165 can set a display image based on the activity state and the combination of the activity states of the user US specified by the state specifying unit 168.

F-5. Modification 5:
In the fifth embodiment, the image setting unit 165 displays the input unit image IM80 representing the load detection type foot input unit 80 worn on the right foot of the user US as the display image IMG3 displayed on the right optical image display unit 26. However, the display mode of the input part image IM80 can be variously modified. For example, when the load detection type foot input unit 80 is worn on the left foot of the user US, the image setting unit 165 may display the input unit image IM80 only on the left optical image display unit 28.

  The image setting unit 165 may display an image of a bar graph that changes in real time on the display image IMG3 in order to indicate which portion of the load sensor in the predetermined range illustrated in FIG. . In addition, when the image setting unit 165 includes a plurality of load sensors to which specific functions illustrated in FIG. 16 are assigned, the image setting unit 165 displays an image indicating which function corresponds to which load sensor on the display image IMG3. May be. The image setting unit 165 uses the optical image display unit to display a character image of “right toe” indicating a position where a load sensor such as the second operation unit 82 is arranged instead of the input unit image IM80 representing the surface shape of the shoe sole. 26 and 28 may be displayed.

F-6. Modification 6:
In the above embodiment, the first operation unit 135 is formed in the control unit 10, but the mode of the first operation unit 135 can be variously modified. For example, a mode in which a user interface that is the first operation unit 135 is provided separately from the control unit 10 may be used. In this case, since the first operation unit 135 is separate from the control unit 10 in which the power supply 130 and the like are formed, the first operation unit 135 can be reduced in size and the operability of the user US is improved. Further, although the camera 60 is arranged in the image display unit 20, the camera 60 may be configured separately from the image display unit 20 and can capture an outside scene. Alternatively, the HMD 100 in which the CPU 140 and the power supply 130 that are included in the control unit 10 are all mounted in the image display unit 20 may be used. The HMD 100 can be further downsized because there is no controller configured separately from the image display unit 20. Further, by mounting the CPU 140 on each of the control unit 10 and the image display unit 20, the control unit 10 may be used as a single controller and the image display unit 20 may be used as a single display device.

  For example, the image light generation unit may include an organic EL (Organic Electro-Luminescence) display and an organic EL control unit. Further, for example, the image light generation unit may use LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like instead of the LCD. Further, for example, the present invention can be applied to the laser retinal projection type HMD 100. The image display maximum area PN may be configured by a MEMS shutter type display that opens and closes a MEMS shutter formed in each pixel.

  Alternatively, the image light generation unit may be an HMD 100 that employs a scanning optical system using a MEMS mirror and utilizes MEMS display technology. As a specific configuration, the HMD 100 forms a virtual image by a signal light forming unit, a scanning optical system having a MEMS mirror that scans light emitted from the signal light forming unit, and light scanned by the scanning optical system. You may provide an optical member as a light emission part. When the HMD 100 has this configuration, the light emitted by the signal light forming unit is reflected by the MEMS mirror, enters the optical member, is guided to the optical member, and reaches a virtual image forming surface (for example, a reflecting surface). When the MEMS mirror scans light, a virtual image is formed on the virtual image forming surface, and the user US recognizes the image when the user US visually recognizes the formed virtual image.

  Further, for example, the HMD 100 may be used as a head-mounted display in which the optical image display unit covers only a part of the eyes of the user US, in other words, the optical image display unit does not completely cover the eyes of the user US. Good. The HMD 100 may be a so-called monocular type head mounted display. Instead of being mounted on the head of the user US instead of the HMD 100, a handheld display that is fixed by the user US with his / her hand like a binocular may be used as the image display device. Although the HMD 100 is a binocular optical transmission type, the present invention can be similarly applied to other types of head-mounted display devices such as a video transmission type.

  Moreover, HMD100 may be used with the display apparatus only for displaying the image based on the image signal received from the other apparatus. Specifically, it is used as a display device corresponding to a desktop PC monitor. For example, by receiving an image signal from a desktop PC, an image is displayed in the maximum image display area PN of the image display unit 20. May be.

  Moreover, HMD100 may be used so that it may function as a part of system. For example, the HMD 100 may be used as a device for executing a part of functions of a system including an aircraft, and the system in which the HMD 100 is used is not limited to a system including an aircraft, but is a system including an automobile or a bicycle. There may be.

  The earphone may be an ear-hook type or a headband type, or may be omitted. Further, for example, it may be configured as a head-mounted display device mounted on a vehicle such as an automobile or an airplane. For example, it may be configured as a head-mounted display device built in a body protective device such as a helmet.

F-7. Modification 7:
The configuration of the HMD 100 in the above embodiment is merely an example and can be variously modified. For example, the direction key 16 provided in the control unit 10 may be omitted, or another operation interface such as an operation stick may be provided in addition to the direction key 16 and the track pad 14. Moreover, the control part 10 is a structure which can connect input devices, such as a keyboard and a mouse | mouth, and is good also as what receives an input from a keyboard or a mouse | mouth.

  As the image display unit, instead of the image display unit 20 worn like glasses, another type of image display unit such as an image display unit worn like a hat may be adopted. Further, the earphones 32 and 34 can be omitted as appropriate. Moreover, in the said embodiment, although LCD and a light source are utilized as a structure which produces | generates image light, it replaces with these and you may employ | adopt other display elements, such as an organic EL display.

  FIG. 18 and FIG. 19 are explanatory diagrams showing an external configuration of the HMD in the modification. In the example of FIG. 18, the difference from the HMD 100 shown in FIG. 2 is that the image display unit 20 x includes a right optical image display unit 26 x instead of the right optical image display unit 26, and the left optical image display unit 28. It is a point provided with the left optical image display part 28x instead of. The right optical image display unit 26x is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely above the right eye RE of the user US when the HMD 100x is worn. Similarly, the left optical image display unit 28x is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely above the left eye LE of the user US when the HMD 100x is worn. In the example of FIG. 19, the difference from the HMD 100 shown in FIG. 2 is that the image display unit 20 y includes a right optical image display unit 26 y instead of the right optical image display unit 26, and the left optical image display unit 28. It is a point provided with the left optical image display part 28y instead of. The right optical image display unit 26y is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely below the right eye RE of the user US when the head mounted display is mounted. The left optical image display unit 28y is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely below the left eye LE of the user US when the head mounted display is mounted. Thus, it is sufficient that the optical image display unit is disposed in the vicinity of the eyes of the user US. The size of the optical member forming the optical image display unit is also arbitrary, and the optical image display unit covers only a part of the eyes of the user US, in other words, the optical image display unit covers the eyes of the user US. It is realizable as HMD100 of the aspect which is not completely covered.

  In the above embodiment, the HMD 100 may guide image light representing the same image to the left and right eyes of the user US to cause the user US to visually recognize a two-dimensional image, or to the left and right eyes of the user US. Image light representing different images may be guided to make the user US visually recognize the three-dimensional image.

  In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. Good. For example, in the above-described embodiment, the image processing unit 160 and the sound processing unit 170 are realized by the CPU 140 reading and executing a computer program, but these functional units may be realized by a hardware circuit. Good.

  In addition, when part or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. In the present invention, the “computer-readable recording medium” is not limited to a portable recording medium such as a flexible disk or a CD-ROM, but an internal storage device in a computer such as various RAMs and ROMs, a hard disk, etc. It also includes an external storage device fixed to the computer.

  In the above embodiment, as shown in FIG. 2 and FIG. 3, the control unit 10 and the image display unit 20 are formed as separate configurations, but the configuration of the control unit 10 and the image display unit 20 is as follows. However, the present invention is not limited to this, and various modifications are possible. For example, all of the components formed in the control unit 10 may be formed inside the image display unit 20 or a part thereof may be formed. In addition, the power source 130 in the above embodiment may be formed independently and replaceable, or the configuration formed in the control unit 10 may be overlapped and formed in the image display unit 20. For example, the CPU 140 shown in FIG. 3 may be formed in both the control unit 10 and the image display unit 20, or a function performed by the CPU 140 formed in the control unit 10 and the CPU formed in the image display unit 20. May be configured separately.

  The present invention is not limited to the above-described embodiments and modifications, and can be realized with various configurations without departing from the spirit of the present invention. For example, the technical features in the embodiments and the modifications corresponding to the technical features in each form described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

  IC1, IC2, IC3, IC4 ... icon image, 10 ... control part, 11 ... decision key, 12 ... lighting part, 13 ... display switching key, 14 ... track pad, 15 ... luminance switching key, 16 ... direction key, 17 ... Menu key, 18 ... Power switch, 20, 20x, 20y ... Image display unit, 21 ... Right holding unit, 22 ... Right display driving unit, 23 ... Left holding unit, 24 ... Left display driving unit, 26, 26x, 26y ... Right optical image display unit, 28, 28x, 28y ... Left optical image display unit, 30 ... Earphone plug, 32 ... Right earphone, 34 ... Left earphone, 40 ... Connection unit, 42 ... Right cord, 44 ... Left cord, 46 ... Connecting member 48 ... Body code 51,52 ... Transmitting unit 53,54 ... Receiving unit 60 ... Camera 80, 80a, 80c, 80d, 80e, 80f ... Load detection type foot input unit 81 ... Second communication Part, 2, 82a, 82d ... second operation unit, 83, 93 ... battery, 90 ... inertial sensor, 91 ... third communication unit, 92 ... acceleration sensor, 100, 100a, 100b, 100c, 100x, 100y ... HMD (head) Wearable display device), 120, storage unit, 130, power supply, 132, 132c, first communication unit, 135, first operation unit, 140, CPU, 150, operating system, 160, image processing unit, 165, 165b, 165c, 165f ... image setting unit, 168, 168c ... state specifying unit, 170 ... audio processing unit, 180 ... interface, 190 ... display control unit, 201 ... right backlight control unit, 202 ... left backlight control unit, 211 ... Right LCD controller 212 ... Left LCD controller 221 ... Right backlight 222 ... Left backlight 251 ... Projection optical system, 252 ... Left projection optical system, 261 ... Right light guide plate, 262 ... Left light guide plate, 821, 821e, 821f ... Right foot sensor, 822, 822e, 822f ... Left foot sensor, 823 ... First left foot sensor, 824 ... Second left foot sensor, AP ... tip, CS1, CS2 ... arrow image, D1, D2, D3, D4, D5, D6, D7, D8, D9 ... load direction, EL ... end of left optical image display, ER ... end of right optical image display unit, HSync ... horizontal synchronization signal, IL ... illumination light, IMG1, IMG2, IMG3 ... display image, IM80 ... input part image, IM82 ... operation position image, LAN ... wireless, LCD 24 ... left, LE ... Left eye, OA ... External device, PCLK ... Clock signal, PL ... Image light, PN ... Image display maximum area, RE ... Right eye, US ... User, VSync ... Vertical sync signal

Claims (9)

A head-mounted display device,
An image display unit mounted on the user's head;
A load detection type foot input unit for detecting the load on the sole of the user's foot;
A head-mounted display device comprising: a display setting unit configured to set a display image to be displayed on the image display unit according to a load detected by the load detection type foot input unit. The head-mounted display device according to claim 1, further comprising:
It has a state identification part that identifies the user's activity state,
The display setting unit sets the display image according to the load detected by the load detection type foot input unit when it is specified that the activity state is not a moving state in which a user is moving. A head-mounted display device that continues setting of the display image that has already been set when it is specified that the user is not moving as a state. The head-mounted display device according to claim 1 or 2,
The load detection type foot input unit detects a load distribution within a predetermined range,
The display setting unit displays a preset pointer image on the image display unit, and displays the pointer image on the image display unit according to a change in the distribution of the load detected by the load detection type foot input unit. Head mounted display device that changes position. The head-mounted display device according to any one of claims 1 to 3,
The load detection type foot input unit includes a right load detection type foot input unit that detects a load on the right foot, and a left load detection type foot input unit that detects a load on the left foot,
The display setting unit sets the display image according to a change in load detected by the right load detection type foot input unit and a change in load detected by the left load detection type foot input unit. Part-mounted display device. The head-mounted display device according to claim 4,
The load detection type foot input unit identifies a change in position between the right load detection type foot input unit and the left load detection type foot input unit,
The head-mounted display device, wherein the display setting unit executes enlargement or reduction of at least a part of the display image in accordance with the change in the position. The head-mounted display device according to claim 4 or 5,
The display setting unit
A preset pointer image is displayed on the image display unit,
The position of the pointer image is changed according to the distribution of the right load detected by the right load detection type foot input unit and the distribution of the left load detected by the left load detection type foot input unit, and the right load A head-mounted display device that makes the amount of change in the display position of the pointer image that changes due to a change in distribution differ from the amount of change in the display position of the pointer image that changes due to a change in the distribution of the left load. The head-mounted display device according to any one of claims 1 to 6, further comprising:
The load detection type foot input unit and the image display unit include an inertial sensor formed separately,
The head-mounted display device, wherein the display setting unit sets the display image according to inertia data acquired by the inertia sensor and a load detected by the load detection type foot input unit. The head-mounted display device according to any one of claims 1 to 7,
When the display setting unit can set the display image according to the load detected by the load detection type foot input unit, the display unit displays an image representing the position of the load detection type foot input unit on the image display unit. Head-mounted display device. The head-mounted display device according to claim 8,
The load detection type foot input unit has a surface shape corresponding to the sole of a user's foot, and a sensor capable of detecting a load is disposed on at least a part of the surface shape,
The head setting display device, wherein the display setting unit displays an image representing the position of the sensor with respect to the surface shape on the image display unit as an image representing the position of the load detection type foot input unit.

Images