JP5990958B2 - Head-mounted display device - Google Patents

Description

  The present invention relates to an information processing device and an optically transmissive head-mounted display device.

  In the information processing apparatus, the control unit controls the information processing apparatus by an operation received from the operation unit in order to process various types of information. For example, a button or a track pad is used as the operation unit. In the operation unit of such an information processing apparatus, it is desirable to improve operability while achieving downsizing.

  In the information processing apparatus, when a user's finger touches a button arranged on the operation unit, the detection unit formed on the button senses the contact, and the image display unit configured integrally with the operation unit A technique is known in which a button touched by a user's finger is highlighted to display an image, thereby reducing the size of an operation unit while improving operability (see, for example, Patent Document 1).

JP 2004-355606 A

  However, the conventional information processing apparatus has room for improvement in terms of both miniaturization of the operation unit and improvement in operability.

  SUMMARY An advantage of some aspects of the invention is that it provides a technique for further improving operability while reducing the size of an operation unit in an information processing apparatus.

In order to solve at least a part of the above problems, the present invention can be realized as the following forms or application examples. One aspect of the present invention is an optically transmissive head-mounted display device, an acquisition unit that acquires image data; and image light is generated based on the image data, and the image light is transmitted to a user as a virtual image. An image display unit that outputs the image light to be visually recognized as; an operation unit that receives an operation; and a control unit that controls the image display unit in accordance with the received operation; A first input unit that is disposed on one surface of the operation unit and receives the operation; and a second input unit that is disposed on a surface different from the one surface of the operation unit and receives the operation; The control unit changes the transmittance of an outside scene in the image display unit in accordance with a reception input unit that has received the operation among the first input unit and the second input unit. If it is such a form, since the control part changes the transmittance of the outside scene in the image display part visually recognized by the user in accordance with the reception input part that has accepted the operation, the operability of the user is improved. Can do. According to another aspect of the present invention, there is provided an optically transmissive head-mounted display device, an acquisition unit that acquires image data; image light is generated based on the image data, and the image is transmitted to a user. An image display unit that outputs the image light to make light visible as a virtual image; an operation unit that receives an operation; and a control unit that controls the image display unit according to the received operation; A first input unit that is disposed on one surface of the operation unit and receives the operation; a second input unit that is disposed on a surface different from the one surface of the operation unit and receives the operation; A detection unit that detects an acceleration of the operation unit and notifies the control unit; and the control unit includes at least one of the first input unit and the second input unit according to the acceleration. Input direction of the operation that one side accepts , Change the contents of controlling the image display unit, the relationship. In such a form, the control unit automatically provides the user with an operation in an appropriate direction according to the direction of the operation unit, so that the operability of the user can be improved.

Application Example 1 An information processing apparatus,
An operation unit for receiving an operation;
A control unit that controls the information processing apparatus according to the accepted operation,
The operation unit is disposed on one surface of the operation unit and receives the operation, and a second input unit is disposed on a surface different from the one surface of the operation unit and receives the operation. And an information processing apparatus.

  In this information processing apparatus, the operation unit receives an operation from the user, and the control unit controls the information processing apparatus in accordance with the operation. The operation unit includes a first input unit that receives the operation on one surface, and a second input unit that receives the operation on a surface different from the first input unit. for that reason. In this information processing apparatus, since the operation unit includes a plurality of input units, the operation unit can be further reduced in size and the operability can be improved.

Application Example 2 In the information processing apparatus according to Application Example 1, the control unit includes a first operation received by the first input unit and a second operation received by the second input unit. An information processing apparatus that performs the control based on a new operation corresponding to a combination of operations.

  In this information processing apparatus, the control unit is a combination of the operation received by the first input unit and the operation received by the second input unit, and only the first input unit or the second input unit. Control is performed based on a new operation that is different from the operation accepted by only. Therefore, in this information processing apparatus, control is performed according to a new operation based on a combination of operations received by different input units, so that the operation unit can be reduced in size.

Application Example 3 In the information processing apparatus according to Application Example 1 or Application Example 2, in the operation unit, the first input unit and the second input unit are formed in a front-back positional relationship. Information processing device.

  In this information processing apparatus, in the operation unit, since the first input unit and the second input unit are formed in a front-back positional relationship, the operation unit can be further downsized.

Application Example 4 The information processing apparatus according to any one of Application Example 1 to Application Example 3, wherein the control unit includes a control unit power source, and the operation unit includes an operation unit power source. The control unit and the operation unit are detachable from the information processing apparatus.

  In this information processing apparatus, the control unit is supplied with power from the control unit power supply, the operation unit is supplied with power from the operation unit power supply, and the control unit and the operation unit are detachable. Therefore, in this information processing apparatus, even if the control unit and the operation unit are separated, the information processing apparatus can be controlled by an operation received by the operation unit, so that the portability of the operation unit can be improved.

Application Example 5 The information processing apparatus according to Application Example 4, wherein the operation unit is different in an operation reception method in the first input unit and the second input unit.

  In this information processing apparatus, since the operation unit is different in the operation receiving method in the first input unit and the second input unit, the user can select an appropriate operation unit according to the type of control content to be processed. Therefore, the operability for the user can be further improved.

Application Example 6 The information processing apparatus according to Application Example 5, wherein the operation unit is replaceable with a different operation unit, and an authentication signal transmission unit transmits an authentication signal to cause the control unit to authenticate The control unit includes an authentication processing unit that authenticates the operation unit based on the authentication signal from the authentication signal transmission unit, and performs the control based on the operation received by the authenticated operation unit. An information processing apparatus that does not accept the control based on the operation accepted by the unauthenticated operation unit.

  In this information processing apparatus, the operation unit can be exchanged with a different operation unit, and has an authentication signal transmission unit that transmits an authentication signal for authentication processing with the control unit. Signals are exchanged with the authentication signal transmission unit of the unit, and the authentication process of the operation unit is executed. The control unit controls the information processing apparatus in accordance with an operation received by the authenticated operation unit. Therefore, in this information processing apparatus, since the information processing apparatus is controlled according to the authentication signal and the operation received by the operation unit by the authentication processing unit, the operability of the user can be improved.

Application Example 7 The information processing apparatus according to Application Example 6, wherein the authentication processing unit exclusively authenticates one of the replaceable operation units.

  In this information processing apparatus, the authentication processing unit authenticates one operation unit exclusively, and does not authenticate the other operation unit even if there is an authentication request from the other operation unit. Since the operation of the operation unit is not accepted, erroneous operations can be reduced.

[Application Example 8] The information processing apparatus according to any one of Application Example 4 to Application Example 7, wherein the operation unit is supplied from the control unit power supply when connected to the control unit. An information processing device that operates with electric power.

  In this information processing apparatus, since the operation unit operates with power supplied from the control unit power supply when connected to the control unit, it is not always necessary to incorporate an independent operation unit power supply. Can be miniaturized.

Application Example 9 In the information processing apparatus according to any one of Application Example 1 to Application Example 8, at least one of the control unit and the operation unit includes a relative position between the control unit and the operation unit, and The control unit has a connection unit capable of changing a direction, and the control unit is different from the operation received by at least one of the first input unit and the second input unit according to the relative position and the direction. An information processing apparatus that performs the control of contents.

  In this information processing apparatus, the operation unit is connected to the control unit via the connection unit, and the relative position and direction between the control unit and the operation unit can be changed using the connection unit as a fulcrum. The control unit differs in content from the information processing device to an operation accepted by at least one of the first input unit and the second input unit according to the relative position and orientation between the control unit and the operation unit detected by the connection unit Control. Therefore, in this information processing apparatus, the content of the control for the user's operation differs depending on the relative position and orientation between the control unit and the operation unit, so that the user can automatically select and use the appropriate input unit The user's operability can be improved.

[Application Example 10] The information processing apparatus according to any one of Application Example 1 to Application Example 9, wherein the operation unit includes a detection unit that detects an acceleration of the operation unit and notifies the control unit of the acceleration. The control unit changes the relationship between the input direction of the operation in the control unit and the content of the control in accordance with the acceleration.

  In this information processing apparatus, the detection unit detects the direction of the operation unit with respect to the direction of gravity, and the control unit changes the relationship between the received operation direction and the control content according to the direction. Therefore, in this information processing apparatus, since the control unit automatically provides the user with an operation in an appropriate direction according to the direction of the operation unit, the operability of the user can be improved.

[Application Example 11] The information processing apparatus according to any one of Application Examples 1 to 10, wherein the control unit is a third input unit that receives the operation, and the first input unit and An information processing apparatus including a third input unit that functions as one input unit integrally with at least one of the second input units.

  In this information processing apparatus, since the control unit includes a third input unit that functions as one input unit integrated with at least one of the first input unit and the second input unit, Even if the operation unit itself is not enlarged, the operation surface can be widened, so that the operability for the user can be improved.

[Application Example 12] The information processing apparatus according to any one of Application Example 1 to Application Example 11, in which the control unit and the operation received by the first input unit according to the content of control An information processing apparatus that performs the control based on one selected from the operation received by the second input unit.

  In this information processing apparatus, the control unit is configured to process the information processing apparatus based on one operation selected from the operation received by the first input unit or the operation received by the second input unit, depending on the content of the control to be controlled. Therefore, the user can automatically select an operation from an appropriate input unit, and the operability of the user can be improved.

Application Example 13 An optically transmissive head-mounted display device that generates image data based on the acquisition unit that acquires image data and visually recognizes the image light as a virtual image to the user An image display unit that outputs the image light, an operation unit that receives an operation, and a control unit that controls the image display unit according to the received operation. A first input unit that is disposed on one surface of the unit and receives the operation; and a second input unit that is disposed on a surface different from the one surface of the operation unit and receives the operation. Wearable display device.

  In this head-mounted display device, the acquisition unit acquires image data, the image display unit generates image light based on the image data, causes the user to visually recognize the generated image light as a virtual image, and the operation unit uses An operation from the person is accepted, and the control unit controls the image display unit according to the accepted operation. The operation unit includes a first input unit that receives the operation on one surface, and a second input unit that receives the operation on a surface different from the first input unit. Therefore, in this head-mounted display device, since the operation unit includes a plurality of input units, the operation unit can be further downsized and the operability can be improved.

Application Example 14 In the head-mounted display device according to Application Example 13, the operation unit includes an operation unit power supply, the control unit is integrated with the image display unit, and the operation unit Head-mounted display device that is separate from the head.

  In this head-mounted display device, the operation unit is supplied with power from the operation unit power supply, and the control unit is integrated with the image display unit and separated from the operation unit. Can be further reduced in size.

Application Example 15 In the head-mounted display device according to Application Example 13 or Application Example 14, the operation unit includes a plurality of input units, and the control unit includes the input unit among the plurality of input units. A head-mounted display device that changes the transmittance of an outside scene in the image display unit according to a reception input unit that has received an operation.

  In this head-mounted display device, the control unit changes the outside scene transmittance in the image display unit visually recognized by the user in accordance with the reception input unit that has received the operation, thereby improving the operability of the user. be able to.

Application Example 16 The head-mounted display device according to Application Example 15, wherein the input unit transmits an input unit position signal for causing the control unit to authenticate the position of the input unit. A signal transmission unit, and the image display unit includes a display unit position signal transmission unit that transmits a display unit position signal for authenticating the position of the image display unit to the control unit, and the control unit includes the reception unit. A position authentication processing unit that authenticates a positional relationship between the reception input unit and the image display unit based on the input unit position signal and the display unit position signal of the input unit, and displays the image according to the positional relationship. A head-mounted display device that changes the transmittance of the outside scene in the section.

  In this head-mounted display device, the control unit changes the transmittance of the outside scene in the image display unit according to the positional relationship between the reception input unit and the image display unit, thereby improving the operability for the user. Can do.

Application Example 17 In the head-mounted display device according to Application Example 16, the positional relationship is such that the virtual image that the image display unit visually recognizes and the reception input unit overlap each other. A head-mounted display device.

  In this head-mounted display device, when the virtual image visually recognized by the user and the reception input unit overlap in the image display unit, the control unit changes the transmittance of the outside scene of the overlapped part. Therefore, the reception input unit is easy to visually recognize, and the operability for the user can be improved.

Application Example 18 The head-mounted display device according to any one of Application Example 15 to Application Example 17, wherein the control unit is configured to display the virtual image in the virtual image that is visually recognized by a user according to the reception input unit. Head-mounted display device with different operation display methods.

  In this head-mounted display device, since the display method of the operation in the virtual image differs depending on the reception input unit, the reception input unit operated by the user can be recognized by the virtual image, and the operability of the user is improved. Can be improved.

  Note that the present invention can be realized in various modes, for example, an information processing device and a control method for the information processing device, a display device and a control method for the display device, a head-mounted display device, and a head-mounted device. Type display apparatus control method, information processing system, head-mounted display system, computer program for realizing the functions of these methods, apparatus or system, recording medium recording the computer program, carrier wave including the computer program It can be realized in the form of a data signal embodied in the inside.

It is explanatory drawing which shows the external appearance structure of the head mounted display apparatus 100 as an information processing apparatus in the Example of this invention. 3 is an explanatory diagram functionally showing the configuration of the head-mounted display device 100. FIG. 4 is an explanatory diagram illustrating an example of an external configuration of a control unit 10 and an operation unit 80. FIG. 4 is an explanatory diagram illustrating an example of an external configuration of a control unit 10 and an operation unit 80. FIG. 4 is an explanatory diagram illustrating an example of an external configuration of a control unit 10 and an operation unit 80. FIG. 4 is an explanatory diagram illustrating an example of an external configuration of a control unit 10 and an operation unit 80. FIG. It is explanatory drawing which shows an example of the external appearance structure of the operation part 80a in 2nd Example. It is explanatory drawing which shows an example of the external appearance structure of the control part 10b and the operation part 80b in 3rd Example. It is explanatory drawing which shows an example of the external appearance structure of the control part 10c and the operation part 80c in a modification. It is explanatory drawing which shows an example of the external appearance structure of the control part 10d and the operation part 80d in a modification. It is explanatory drawing which shows an example of the external appearance structure of the operation part 80e in a modification.

Next, embodiments of the present invention will be described in the following order based on examples.
A. First embodiment:
A-1. Configuration of head mounted display device:
A-2. Detailed configuration of control unit and operation unit:
B. Second embodiment:
C. Third embodiment:
D. Variations:

A. First embodiment:
A-1. Configuration of head mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device 100 as an information processing device according to an embodiment of the present invention. The head-mounted display device 100 is a display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display device 100 according to this embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene.

  The head-mounted display device 100 includes an image display unit 20 that allows a user to visually recognize a virtual image when mounted on the user's head, a control unit (controller) 10 that controls the image display unit 20, and an operation unit 80. And.

  The image display unit 20 is a mounting body that is worn on the user's head, and is formed in the shape of glasses in this embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, and a left optical image display unit 28. It is out. The right optical image display unit 26 and the left optical image display unit 28 are disposed at positions corresponding to the right and left eyes of the user when the head-mounted display device 100 is worn. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are respectively connected at positions corresponding to the user's eyebrows when the head-mounted display device 100 is worn. The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28.

  The image display unit 20 also includes a right earphone 32 for the right ear and a left earphone 34 for the left ear. The right earphone 32 and the left earphone 34 are respectively attached to the right and left ears when the user wears the image display unit 20.

  The right holding unit 21 is substantially perpendicular to the right optical image display unit 26 from the end ER of the right optical image display unit 26 to a position corresponding to the user's temporal region when the head-mounted display device 100 is worn. It is the member provided by extending | stretching so that. Similarly, the left holding unit 23 extends from the end EL of the left optical image display unit 28 to a position corresponding to the user's temporal region when the head-mounted display device 100 is worn. It is a member provided by extending so as to form a substantially right angle. The right holding unit 21 and the left holding unit 23 hold the head-mounted display device 100 on the user's head like a temple of glasses.

  The right display drive unit 22 is inside the right holding unit 21 (in other words, the side facing the user's head when the head-mounted display device 100 is worn), and It arrange | positions at the edge part ER side. The left display driving unit 24 is disposed inside the left holding unit 23 and on the end EL side of the left optical image display unit 28. In the following, the right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical image display unit 26 and the left optical image display unit 28 are collectively referred to simply as “optical image display”. Also called “part”.

  The display driving units 22 and 24 include an LCD (Liquid Crystal Display), a projection optical system, and the like (not shown). Details will be described later. The optical image display units 26 and 28 as optical members include a light guide plate (not shown) and a light control plate. The light guide plate is formed of a light transmissive resin material or the like, and emits image light taken from the display driving units 22 and 24 toward the eyes of the user. The light control plate is a thin plate-like optical element, and is disposed so as to cover the front side of the head-mounted display device 100 (the side opposite to the eye side of the user). The light control plate protects the light guide plate, suppresses damage to the light guide plate, adhesion of dirt, etc., and adjusts the light transmittance of the light control plate to adjust the amount of external light entering the user's eyes. The ease of visual recognition of the virtual image can be adjusted. The light control plate can be omitted.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48 connected to the control unit 10, a right cord 42 in which the main body cord 48 branches into two, a left cord 44, and a connecting member 46 provided at the branch point. Yes. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. Each end of the main body cord 48 opposite to the connecting member 46 and the control unit 10 are provided with connectors (not shown) that are fitted to each other. The connector of the main body cord 48 and the control unit 10 The control unit 10 and the image display unit 20 are connected to or disconnected from each other by the fitting / releasing of the connector. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for controlling the head-mounted display device 100. The control unit 10 is connected to the operation unit 80 and controls the head-mounted display device 100 according to an operation received by the operation unit 80. Details of the operation unit 80 will be described later.

  FIG. 2 is an explanatory diagram functionally showing the configuration of the head-mounted display device 100. As shown in FIG. 2, the control unit 10 includes a CPU 140, a storage unit 120 configured by a ROM, a RAM, and the like, a control unit power supply 130 that supplies power to each unit of the head-mounted display device 100, an image An interface 180 for connecting various external devices OA (for example, a personal computer PC, a mobile phone terminal, and a game terminal) that are sources of content data such as (still images, moving images) and audio, and a transmission unit (Tx ) 51 and 52. For example, a secondary battery may be used as the power supply 130 for the control unit, and a USB interface, a memory card interface, a wireless LAN interface, or the like may be employed as the interface 180, for example.

  Various computer programs are stored in the storage unit 120, and the CPU 140 reads out and executes the computer programs from the storage unit 120, whereby an operating system (OS) 150, an image processing unit 160, a display control unit 190, It functions as an audio processing unit 170, a detection processing unit 165, and an authentication processing unit 175.

  The image processing unit 160 generates a clock signal PCLK, a vertical synchronization signal VSync, a horizontal synchronization signal HSync, and image data Data based on content input through the interface 180, and outputs these signals to the image through the connection unit 40. This is supplied to the display unit 20. Specifically, the image processing unit 160 acquires an image signal included in the content. For example, in the case of a moving image, the acquired image signal is generally an analog signal composed of 30 frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit (not shown) or the like according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync.

  The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal as image data Data (RGB data) of the target image in the DRAM in the storage unit 120 for each frame. Note that the image processing unit 160 may execute image processing such as various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. . The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The display control unit 190 generates a control signal for controlling the display driving units 22 and 24. Specifically, the display control unit 190 uses the control signal to turn on / off the right LCD 241 by the right LCD control unit 211, turn on / off the right backlight 221 by the right backlight control unit 201, and control the left LCD. By separately controlling ON / OFF driving of the left LCD 242 by the unit 212 and ON / OFF driving of the left backlight 222 by the left backlight control unit 202, the image light of each of the display driving units 22, 24 is controlled. Control generation and injection. For example, the display control unit 190 causes both the display drive unit 22 and the left display drive unit 24 to generate image light, generates only one image light, or does not both generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals for the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The audio processing unit 170 acquires an audio signal included in the content data, amplifies the acquired audio signal, and supplies the acquired audio signal to the right earphone 32 and the left earphone 34 of the image display unit 20 via the connection unit 40.

  The detection processing unit 165 acquires information notified of the position of the operation unit 80 detected by the detection unit 86 in the operation unit 80 described later. In the present embodiment, the detection processing unit 165 is notified of the acceleration of the operation unit 80 detected by the detection unit 86 that is an acceleration sensor, and acquires information on the direction of the operation unit 80 with respect to the direction of gravity.

  The authentication processing unit 175 exchanges signals with the authentication processing unit 87 included in the operation unit 80 and executes authentication processing of the operation unit 80. The control unit 10 controls the image display unit 20 in accordance with an operation received by the authenticated operation unit 80. In the present embodiment, the authentication processing unit 175 exclusively authenticates one operation unit 80. That is, when there is an authenticated operation unit 80, the authentication processing unit 175 does not authenticate the other operation unit 80 even if there is an authentication request from the other operation unit 80.

  The operation unit 80 that receives an operation by the user supplies power to the detection unit 86 that detects information about the position of the operation unit 80, an authentication processing unit 87 that performs authentication processing with the control unit 10, and the operation unit 80. A power supply 83 for the operation unit to be supplied; an interface 88 for connecting the operation unit 80 and the control unit 10; and an input unit 85 having a button, a trackpad, and the like and receiving an operation from the user. Yes. The authentication processing unit 87 corresponds to the authentication signal transmission unit in the present invention.

  The detection unit 86 includes an acceleration sensor that detects the acceleration of the operation unit 80. The acceleration sensor is a voltage output type triaxial acceleration sensor, and detects the acceleration of the three axes (X axis, Y axis, Z axis) of the operation unit 80. The detection unit 86 can detect the gravitational acceleration and the inclination of the operation unit 80 with respect to the direction of gravity, that is, in which direction the operation surface of the operation unit 80 is directed.

  As the interface 88, a USB interface, a wireless LAN interface, Bluetooth (registered trademark), or the like can be adopted. Details of the input unit 85 will be described later.

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a right earphone. 32 and a left earphone 34.

  The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are included.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 has a function of driving the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 has a function of driving the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the reception unit 53. Have The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. As long as a light guide part makes a user visually recognize a virtual image using image light, arbitrary systems can be used, for example, a diffraction grating may be used and a transflective film may be used.

  The left display driving unit 24 includes a receiving unit (Rx) 54, a left backlight (BL) control unit 202 and a left backlight (BL) 222 that function as a light source, a left LCD control unit 212 and a left that function as a display element. An LCD 242 and a left projection optical system 252 are included. The right display driving unit 22 and the left display driving unit 24 are paired, and each unit of the left display driving unit 24 has the same configuration and operation as each unit described in the right display driving unit 22, so detailed description will be given. Omitted.

  In this way, the image light guided to both eyes of the user of the head-mounted display device 100 forms an image on the retina, so that the user visually recognizes the virtual image.

A-2. Detailed configuration of control unit and operation unit:
FIGS. 3 to 6 are explanatory diagrams illustrating examples of external configurations of the control unit 10 and the operation unit 80. In FIG. 3, the control unit 10 includes a connection unit 50, and the operation unit 80 is connected to the control unit 10 via the connection unit 50. The operation unit 80 can be attached and detached by removing the connection with the connection unit 50 in the control unit 10. In FIG. 3, the connection unit 40 and the like (FIG. 1) that connect the control unit 10 and the image display unit 20 are not illustrated.

  As shown in FIG. 3, the appearance of the operation unit 80 in the present embodiment has a substantially rectangular parallelepiped shape. A first input unit 81 is formed on one surface of the operation unit 80. The first input unit 81 includes a determination key 11, a lighting unit 12, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. , Is arranged. The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the first input unit 81. The lighting unit 12 notifies the operation state of the head-mounted display device 100 (for example, ON / OFF of the power supply) according to the light emission state. For example, an LED (Light Emitting Diode) can be used as the lighting unit 12. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example. The track pad 14 detects the operation of the user's finger on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head-mounted display device 100 by detecting a slide operation of the switch.

  4 shows that the control unit 10 and the operation unit 80 are separated from the control unit 10 with the connection unit 50 as a fulcrum from the state of FIG. 3, that is, the control unit 10 and the operation unit 80 are opened from the folded state. It shows the state when it is in the state. As shown in FIG. 4, the operation unit 80 can change the relative position and orientation with respect to the control unit 10 with the connection unit 50 in the control unit 10 as a fulcrum, and the first input unit 81 and the front and back of the operation unit 80 can be changed. A second input unit 82 is formed on the other surface in the positional relationship. A keyboard 84 on which a plurality of buttons are arranged is disposed on the second input unit 82. The buttons arranged on the keyboard 84 detect a pressing operation and output a signal for determining the content operated by the operation unit 80. The first input unit 81 and the second input unit 82 correspond to the input unit 85 (FIG. 2).

  In FIG. 5, the operation unit 80 is rotated 180 degrees with the connection unit 50 as a fulcrum, so that the surface of the first input unit 81 and the operation unit contact surface 25 (FIG. 4) of the control unit 10 face each other. Thus, an operation unit 80 in which the second input unit 82 is used as the input unit 85 is shown. As shown in FIG. 5, the operation unit 80 rotates the connection unit 50 with the control unit 10 as a fulcrum, so that the first input unit 81 or the second input unit 82 is selected as the input unit 85. The control unit 10 and the operation unit 80 can be integrally deformed into a substantially rectangular parallelepiped shape.

  The operation unit 80 includes a detection unit 86 that is an acceleration sensor. Since the detection unit 86 detects the acceleration of the operation unit 80 in the three axes, the detection processing unit 165 is an angle between the direction of the first input unit 81 and the second input unit 82 in the operation unit 80, that is, the direction of gravity. Can be calculated. Further, for example, the connection unit 50 includes a sensor that detects a relative position relationship between the control unit 10 and the operation unit 80 based on the direction of the force applied to the connection unit 50. In the present embodiment, when the angle formed between the operation unit contact surface 25 in the control unit 10 and the operation surface in the operation unit 80 is less than 180 degrees, the control unit 10 receives an operation surface that is not oriented in the direction of gravity. Only the operation is controlled as an effective operation. The sensor that detects the relationship between the relative positions of the control unit 10 and the operation unit 80 does not need to be included in the connection unit 50. For example, an infrared receiving unit disposed in the control unit 10 and the operation unit 80 and The relationship may be detected by an infrared transmitter.

  FIG. 6 shows a state in which the operation unit 80 connected to the control unit 10 by the connection unit 50 is separated. The control unit 10 separated from the operation unit 80 is operated by being supplied with power from the control unit power supply 130 in the same manner as when connected. On the other hand, when the operation unit 80 is connected to the control unit 10, the operation unit 80 operates with power supplied from the control unit power supply 130, but when the operation unit 80 is separated from the control unit 10, the operation unit 80 has a built-in operation. The power supply is supplied from the departmental power supply 83 to operate.

  In the present embodiment, even if the operation unit 80 is separated from the control unit 10, the control unit 10 and the operation unit 80 transmit and receive control signals and the like via a wireless LAN or the like. Control can be performed in accordance with the operation received by 80.

  Even when the operation unit 80 is separated from the control unit 10, the detection processing unit 165 determines the direction of the operation unit 80 (angle formed by the gravity direction) detected by the detection unit 86 of the operation unit 80 through the interface 180. Can be obtained through. In the present embodiment, when the operation unit 80 is separated from the control unit 10, the control unit 10 controls only an operation received by an operation surface that does not face the direction of gravity in the operation unit 80 as an effective operation.

  In the control unit 10 and the operation unit 80 of the present embodiment, the operation unit 80 separated from the control unit 10 can be replaced with a different operation unit 80 '. For example, the operation unit 80 ′ can be replaced with a dedicated game machine controller, a device including a voice input unit, or the like. If the authentication processing unit 87 ′ capable of executing the authentication processing is built in the operation unit 80 ′, the authentication processing unit 175 exchanges signals with the authentication processing unit 87 ′ to authenticate the operation unit 80 ′. Execute the process. The control unit 10 controls the image display unit 20 in accordance with an operation received by the authenticated operation unit 80 '. In this case, in the present embodiment, the control unit 10 does not execute the authentication signal of the operation unit 80 before replacement, and therefore does not control the image display unit 20 according to the operation accepted by the operation unit 80. . Note that the authentication method of either the operation unit 80 or the operation unit 80 ′ as an operation unit that receives an operation may be selected depending on the distance between the control unit 10 and the operation unit 80, or the authentication processing unit 175 may control the control unit 10. When the signals of a plurality of operation units are detected at a certain distance from the control unit 10, the control unit 10 displays the facts on the image display unit 20, and the user operates the operation unit 80 before replacement. You may make it selectable. The control unit 10 may control the image display unit 20 by receiving operations from a plurality of operation units.

  As described above, in the head-mounted display device 100 according to the present embodiment, the operation unit 80 that receives an operation from the user, and the control unit 10 that controls the head-mounted display device 100 according to the operation. It is equipped with. The operation unit 80 has a substantially rectangular parallelepiped shape. The first input unit 81 is formed on one surface, and the second input unit 82 is formed on a surface different from the first input unit 81. Yes. Therefore, in the head-mounted display device 100, since the operation unit 80 includes a plurality of input units, the operation unit 80 can be further reduced in size and operability can be improved.

  Further, in the head-mounted display device 100 according to the present embodiment, in the operation unit 80, the first input unit 81 and the second input unit 82 are formed so as to have a front-back positional relationship. The operation unit 80 can be further downsized.

  Further, in the head-mounted display device 100 according to the present embodiment, the operation unit 80 can be detached by removing the connection with the connection unit 50 in the control unit 10. The control unit 10 separated from the operation unit 80 is operated by being supplied with power from the control unit power supply 130 in the same manner as when connected. When the operation unit 80 is separated from the control unit 10, the operation unit 80 operates by being supplied with power from the operation unit power supply 83 built in the operation unit 80. Therefore, in the head-mounted display device 100 according to the present embodiment, the image display unit 20 can be controlled by the operation received by the operation unit 80 even if the control unit 10 and the operation unit 80 are separated. Portability can be improved.

  In the head-mounted display device 100 according to the present embodiment, the operation unit 80 is an input unit that receives different operations from the first input unit 81 and the second input unit 82. Since the operation unit including the input unit 85 that accepts an appropriate operation can be selected according to the type of control content to be performed, the operability for the user can be further improved.

  In the head-mounted display device 100 according to the present embodiment, the operation unit 80 includes an authentication processing unit 87 that executes authentication processing with the control unit 10. The authentication processing unit 175 in the control unit 10 exchanges signals with the authentication processing unit 87 included in the operation unit 80 and executes the authentication process of the operation unit 80. The control unit 10 controls the image display unit 20 in accordance with an operation received by the authenticated operation unit 80. The authentication processing unit 175 exclusively authenticates one of the replaceable operation units 80, and does not authenticate the other operation unit 80 even if an authentication request is received from another operation unit 80. The operation to the unauthenticated operation unit 80 is not accepted. Therefore, in the head-mounted display device 100 according to the present embodiment, the image display unit 20 is controlled according to the authentication signal and the operation received by the operation unit by the authentication processing unit, and the operation of the operation unit 80 that is not authenticated. Therefore, the operability of the user can be improved and erroneous operations can be reduced.

  In the head-mounted display device 100 according to the present embodiment, the control unit 10 includes the connection unit 50, and the operation unit 80 is connected to the control unit 10 via the connection unit 50. The relative position and orientation with respect to the control unit 10 can be changed using the connection unit 50 as a fulcrum. The connection unit 50 includes a sensor that detects a relative position relationship between the control unit 10 and the operation unit 80 based on the direction of the force applied to the connection unit 50, and the operation unit contact surface 25 in the control unit 10 and the operation unit 80 When the angle formed with the operation surface is less than 180 degrees, the control unit 10 controls only an operation received by the operation surface not directed in the direction of gravity as an effective operation. Therefore, in the head-mounted display device 100 according to the present embodiment, the operation received by the first input unit 81 and the second input unit 82 are determined according to the relative position and orientation between the control unit 10 and the operation unit 80. Since the content of control differs depending on the received operation, the head-mounted display device 100 is automatically controlled by the operation received by the appropriate input unit for the user, and the operability for the user can be improved.

  Further, in the head-mounted display device 100 according to the present embodiment, the operation unit 80 is operated by being supplied with power from the control unit power supply 130 when connected to the control unit 10, and thus is always operated independently. It is not necessary to incorporate the power supply 83 for the unit, and the operation unit 80 can be reduced in size.

B. Second embodiment:
FIG. 7 is an explanatory diagram illustrating an example of an external configuration of the operation unit 80a according to the second embodiment. 7A shows the first input unit 81a in the operation unit 80a, and FIG. 7B shows the second input unit 82 in the operation unit 80a. In the operation unit 80a in the second embodiment, the first input unit 81a is different from the operation unit 80 in the first embodiment. The detection processing unit 165 can acquire the direction (angle formed with the direction of gravity) of the operation unit 80a detected by the detection unit 86, as in the first embodiment. Moreover, the 2nd input part 82 in 1st Example and 2nd Example is the same input part. The first input unit 81a and the second input unit 82 correspond to the input unit 85a.

  As shown in FIG. 7A, a track pad 14a is formed in the first input portion 81a. In the operation unit 80a in the second embodiment, the first input unit 81a and the second input unit 82 can simultaneously receive an operation from the user. For example, the first input unit 81a is directed in the direction of gravity, that is, the back side is the first input unit 81a, the front side is the second input unit 82, and the user presses the button on the keyboard 84. The track pad 14a can be operated.

  In the operation unit 80a according to the second embodiment, the operation unit 80a is a combination of the operation received by the first input unit 81a and the operation received by the second input unit 82, and the operation unit 80a is the first input unit 81a. Only, or an operation different from the operation accepted only from the second input unit 82 is performed. For example, the user operates the track pad 14a in the first input unit 81a while pressing a specific button on the keyboard 84 in the second input unit 82, thereby performing an operation different from the case where only the track pad 14a is operated. It can be performed.

  In addition, when the first input unit 81a is rotated, that is, when the track pad 14a is rotated, even if the operation is performed in the same direction for the user, if the orientation is different on the operation surface of the track pad 14a, the user The intended operation and the control of the control unit 10 may be different. In the head-mounted display device 100a of the second embodiment, the detection unit 86 detects the direction of the operation unit 80a with respect to the direction of gravity and notifies the control unit 10 of the direction, and the control unit 10 receives the notified operation unit. The relationship between the operation received by the first input unit 81a and the control content is changed according to the direction of 80a. Specifically, regardless of the orientation of the track pad 14a, the control unit 10 can perform control reflecting the operation intended by the user depending on the relationship between the operation unit 80a and the direction of gravity.

  As described above, in the head-mounted display device 100a according to the second embodiment, the operation unit is configured by the combination of the operation received by the first input unit 81a and the operation received by the second input unit 82. 80a performs a new operation different from the operation accepted only from the first input unit 81a or only from the second input unit 82, and the control unit 10 controls the head-mounted display device 100a according to the operation. I do. Therefore, in the head-mounted display device 100a of the second embodiment, since a new operation is assigned by a combination of operations to different input units, the operation unit 80a can be reduced in size.

  In the head-mounted display device 100a according to the second embodiment, the detection unit 86 detects the direction of the operation unit 80a with respect to the direction of gravity and notifies the control unit 10 of the direction, and the control unit 10 is notified. The relationship between the operation received by the first input unit 81a and the control content is changed according to the direction of the operation unit 80a. Therefore, in the head-mounted display device 100a according to the second embodiment, the control unit 10 automatically provides the user with an operation in an appropriate direction according to the direction of the operation unit 80a, thereby improving operability. be able to.

C. Third embodiment:
FIG. 8 is an explanatory diagram illustrating an example of an external configuration of the control unit 10b and the operation unit 80b in the third embodiment. FIG. 8 shows one integrated input unit 89 configured by the control unit 10b and the first input unit 81b in the operation unit 80b. The integrated input unit 89 of the third embodiment includes a keyboard 84b (first input unit 81b) in the operation unit 80b and a keyboard 31 in the third input unit 30 formed in the control unit 10b. The third embodiment is different from the above embodiment in that a keyboard 31 that is a third input unit 30 is formed in the control unit 10b.

  In FIG. 8, the control part 10b and the operation part 80b are integrally formed by the connection part 50b. The control unit 10b and the operation unit 80b can be folded at the connection unit 50b so that the keyboard 84b and the keyboard 31 face each other. The third input unit 30 is integrated with the first input unit 81 b and receives an operation from the user as the integrated input unit 89.

As described above, in the head-mounted display device 100b according to the third embodiment, the third input unit 30 in the control unit 10b and the first input unit 81b in the operation unit 80b are integrated and integrated. The unit 89 operates. Therefore, in the head-mounted display device 100b according to the third embodiment, since the control unit 10b is used as a part of the integrated input unit 89, the operation surface can be widened without increasing the operation unit 80b itself. Therefore, user operability can be improved.
D. Variations:
The present invention is not limited to the above-described examples and embodiments, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

D1. Modification 1:
In the above-described embodiment, the head-mounted display device 100 is used as the information processing device. For example, the information processing apparatus may be a personal computer or a game machine.

  In the above embodiment, in the head-mounted display device 100, the control unit 10 is separated from the image display unit 20, but is not limited to this mode and can be variously modified. For example, the control unit 10 may be configured integrally with the image display unit 20. In the head-mounted display device 100, since the control unit 10 is configured integrally with the image display unit 20, the head-mounted display device 100 can be further downsized.

D2. Modification 2:
In the above-described embodiment, the first input unit 81 and the second input unit 82 are controlled according to the relationship between the control unit 10 and the operation unit 80. However, the control unit 10 depends on the control content to be controlled. Thus, the control may be performed based on an operation selected from the operation received by the first input unit 81 or the operation received by the second input unit 82. For example, if the image data displayed on the image display unit 20 in the head-mounted display device 100c is content for selecting one of a plurality of options, the control unit 10 in the second embodiment described above. Only the user's operation from the keyboard 84 of the second input unit 82 is accepted, and control that does not accept the operation from the track pad 14a in the first input unit 81a is performed. On the other hand, if the image data displayed on the image display unit 20 is content specifying a specific point from the image, the control unit 10 performs an operation from the track pad 14a in the first input unit 81a. Control is performed so that the operation from the keyboard 84 in the second input unit 82 is not accepted. In the head-mounted display device 100c of this modified example, the control unit 10 selects from the operation received by the first input unit 81 and the operation received by the second input unit 82 according to the control content to be controlled. Since the control is performed based on the operation, the user can automatically select an operation from an appropriate input unit, and the operability of the user can be improved.

  Moreover, in the said Example, the control part 10 may change the display method of operation in which the image display part 20 of the head mounted display apparatus 100c is visually recognized by the user with the input part which received operation. For example, when the control unit 10 receives an operation from the track pad 14a of the first input unit 81a in the second embodiment, the image display unit 20 causes the user to visually recognize an arrow-shaped pointer. On the other hand, when the control unit 10 inputs a sentence at a predetermined place using the keyboard 84 in the second input unit 82, the control unit 10 causes the image display unit 20 to blink the place where the sentence is to be input and visually recognize it. Therefore, in the head-mounted display device 100c according to this modification, the control unit 10 has a different display method of the operation to be visually recognized by the user depending on the input unit that has received the operation, and visually recognizes the input unit that has received the operation by the user. Therefore, the operability for the user can be improved.

  Moreover, in the said Example, the control part 10 may change the transmittance | permeability of the outside scene in the image display part 20 of the head mounted display apparatus 100c according to the input part which received operation. For example, when the control unit 10 receives an operation from the track pad 14a of the first input unit 81a in the second embodiment, the image display unit 20 causes the user to visually recognize an arrow-shaped pointer. The transmittance of the outside scene in the unit 20 is not changed. On the other hand, when accepting an operation with the keyboard 84 in the second input unit 82, the control unit 10 increases the transmittance of the outside scene in the image display unit 20 so that the user can easily see the keyboard 84. Therefore, in the head-mounted display device 100c according to this modification, the control unit 10 changes the external scene transmittance in the image display unit 20 in accordance with the input unit that receives the operation. Can be improved.

  Moreover, in the said Example, the control part 10 changes the transmittance | permeability of the outside scene in the image display part 20 with the positional relationship of the input part which received operation, and the image display part 20 of the head mounted display apparatus 100c. Also good. For example, the authentication processing unit 87c in the second input unit 82 transmits a position signal such as an infrared ray to cause the control unit 10 to authenticate the position of the second input unit 82. In addition, the image display unit 20 includes a display unit position signal transmission unit that transmits a position signal such as infrared rays in order to cause the control unit 10 to recognize the position of the image display unit. The authentication processing unit 175 c in the control unit 10 receives the position signal transmitted by the authentication processing unit 87 c of the second input unit 82 and the position signal transmitted by the position authentication processing unit of the image display unit 20. The control unit 10 authenticates the positional relationship between the second input unit 82 and the image display unit 20 based on the received position signal. When the virtual image visually recognized by the user on the image display unit 20 and the second input unit 82 overlap with each other in the positional relationship, the control unit 10 increases the transmittance of the outside scene in the overlapping portion. For this reason, in the head-mounted display device 100c of this modification, the transmittance of the outside scene in the image display unit 20 is changed according to the positional relationship between the second input unit 82 and the image display unit 20, so that the image display Even when the display image of the unit 20 and the input unit receiving the operation overlap, it is easy for the user to visually recognize the input unit, and the operability for the user can be improved. The authentication processing unit 87c corresponds to the input unit position signal transmission unit in the present invention, and the authentication processing unit 175c corresponds to the position authentication processing unit.

D3. Modification 3:
FIG. 9 is an explanatory diagram illustrating an example of an external configuration of the control unit 10c and the operation unit 80c in the modification. FIG. 9 shows a state in which the second input unit 82c is formed in the control unit 10c. Unlike the control unit 10 of the first embodiment, the control unit 10c in this modification also functions as an operation unit 80c. As shown in FIG. 9, a second input unit 82c used for a controller of the game machine is formed on the operation unit contact surface 25c of the control unit 10c (hereinafter also referred to as “operation unit 80c”). Like the operation unit 80c shown in this modification, a part of the control unit 10c may be arranged as a part of the operation unit 80c to reduce the size of the operation unit 80c.
D4. Modification 4:

  FIG. 10 is an explanatory diagram illustrating an example of an external configuration of the control unit 10d and the operation unit 80d in a modification. FIG. 10A shows a state in which the first input unit 81d on the liquid crystal display surface 36 of the operation unit 80d can be operated. In FIG. 10B, the liquid crystal display surface 36 and the operation unit contact surface 25d in the operation unit 80d are slid, and the second input in the first input unit 81d and the operation unit contact surface 25d on the liquid crystal display surface 36 is performed. The state which can operate the part 82 is shown.

  As shown in FIG. 10A, a liquid crystal display unit 35 is disposed on the liquid crystal display surface 36 of the operation unit 80d. The liquid crystal display unit 35 includes a liquid crystal image display unit 37 that displays the same image as the image visually recognized by the image display unit 20 in the head-mounted display device 100d, and a touch panel of the first input unit 81d. And a soft keyboard of the type. The first input unit 81d can be hidden from the liquid crystal display unit 35 by operating the input unit, and the liquid crystal image display unit 37 can be enlarged. In addition, since the type of the keyboard in the first input unit 81d can be changed by operating a predetermined soft keyboard of the first input unit 81d, the first input unit 81d is appropriate depending on the intention of the user. This makes it possible to select an appropriate keyboard type and improve user operability.

  As shown in FIG. 10B, the second input portion 82 is disposed on the operation portion contact surface 25d, as in the above embodiment. The control unit 10d performs control according to the operation received by the first input unit 81d and the second input unit 82 in the operation unit 80. Further, by operating the keyboard 84 in the second input unit 82, the type of the soft keyboard of the first input unit 81 can be changed, and the first input unit 81d can be hidden from the liquid crystal display unit 35. Further, since the same image as the display image of the image display unit 20 in the head-mounted display device 100d can be displayed on the liquid crystal display unit 35, a third party other than the user of the head-mounted display device 100d can operate the operation unit 80d. By operating, the user of the head-mounted display device 100d can visually recognize the image intended by the third party.

D5. Modification 5:
FIG. 11 is an explanatory diagram illustrating an example of an external configuration of the operation unit 80e according to a modification. An operation unit 80e shown in FIG. 11 is different from the operation unit 80a of the second embodiment in a first input unit 81e. The first input unit 81e in the operation unit 80e is a slide-type numeric keypad (keyboard) 91 formed on the side surface of the operation unit 80e. The first input unit 81e is an input unit that can be stored in the operation unit 80e by pressing the side surface of the first input unit 81e in the operation unit 80e. Therefore, in the operation unit 80e in this modification, the first input unit 81e can be operated when necessary for the user, and when not necessary, the operation unit 80e can be stored to reduce the size of the operation unit 80e, and the user's operation can be performed. Can be improved.

D6. Modification 6:
In the configuration of the head-mounted display device 100 of the above embodiment, the operating system 150, the image processing unit 160, the display control unit 190, the sound processing unit 170, the detection processing unit 165, and the authentication processing unit 175 are configured by the CPU 140. Although it is realized by executing software, it may be realized by hardware such as an electronic circuit. In addition, when part or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. In the present invention, the “computer-readable recording medium” is not limited to a portable recording medium such as a flexible disk or a CD-ROM, but an internal storage device in a computer such as various RAMs and ROMs, a hard disk, etc. It also includes an external storage device fixed to the computer.

  In the above embodiment, content data is supplied from the external device OA. However, the content data is stored in the storage unit 120 of the control unit 10 of the head-mounted display device 100 and stored in the storage unit 120. An image may be formed based on the content data.

  Further, in the configuration of the head-mounted display device 100 of the above embodiment, the control unit 10 and the image display unit 20 are connected by wire through the connection unit 40, but the control unit 10 and the image display unit 20 are It may be connected via a signal transmission path such as a wireless LAN, infrared communication, or Bluetooth (registered trademark).

  In the configuration of the head-mounted display device 100 of the above embodiment, the image display unit 20 is an HMD that is worn like glasses, but the image display unit 20 is an ordinary flat display device (liquid crystal display device). A plasma display device, an organic electroluminescence (EL) display device, or the like. Also in this case, the connection between the control unit 10 and the image display unit 20 may be a connection via a wired signal transmission path or a connection via a wireless signal transmission path. . In this way, the control unit 10 can be used as a remote controller for a normal flat display device. Further, instead of the image display unit 20 worn like glasses, an image display unit having another shape such as an image display unit worn like a hat may be adopted as the image display unit. Further, the earphones 32 and 34 may be omitted.

  In addition, among the constituent elements in the above-described embodiment, elements other than the elements described in the independent claims are additional elements, and can be omitted or combined as appropriate.

DESCRIPTION OF SYMBOLS 10 ... Control part 11 ... Decision key 12 ... Illumination part 13 ... Display switching key 14 ... Trackpad 15 ... Luminance switching key 16 ... Direction key 17 ... Menu key 18 ... Power switch 20 ... Image display part 21 ... Right holding part 22 ... Right display drive unit 23 ... Left holding unit 24 ... Left display drive unit 25 ... Operation unit contact surface 26 ... Right optical image display unit 28 ... Left optical image display unit 30 ... Third input unit 31 ... Keyboard 32 ... Right earphone 34 ... Left earphone 35 ... Liquid crystal display part 36 ... Liquid crystal display surface 37 ... Liquid crystal image display part 40 ... Connecting part 42 ... Right cord 44 ... Left cord 46 ... Connecting member 48 ... Main body cord 50 ... Connecting part 51 ... Transmitting part 52 ... Transmission Unit 53... Receiving unit 54... Receiving unit 80 .. Operation unit 81... First input unit 82... Second input unit 83 ... Power source for operation unit 84. ... authentication processing unit 88 ... interface 89 ... integrally input unit 91 ... numeric keypad 100 ... head-mounted display device 120 ... storage unit 130 ... control unit power supply 140 ... CPU
DESCRIPTION OF SYMBOLS 150 ... Operating system 160 ... Image processing part 165 ... Detection processing part 170 ... Audio | voice processing part 175 ... Authentication processing part 180 ... Interface 190 ... Display control part 201 ... Right backlight control part 202 ... Left backlight control part 211 ... Right LCD Control unit 212 ... Left LCD control unit 221 ... Right backlight 222 ... Left backlight 241 ... Right LCD
242 ... Left LCD
251 ... Right projection optical system 252 ... Left projection optical system 261 ... Right light guide plate 262 ... Left light guide plate OA ... External equipment

Claims (14)

An optically transmissive head-mounted display device,
An acquisition unit for acquiring image data;
An image display unit that generates image light based on the image data and outputs the image light to allow a user to visually recognize the image light as a virtual image;
An operation unit for receiving an operation;
A control unit that controls the image display unit according to the accepted operation,
The operation unit is disposed on one surface of the operation unit and receives the operation, and a second input unit is disposed on a surface different from the one surface of the operation unit and receives the operation. And including
The control unit is a head-mounted type that changes a transmittance of an outside scene in the image display unit according to a reception input unit that has received the operation among the first input unit and the second input unit. Display device. The head-mounted display device according to claim 1,
The operation unit includes an operation unit position signal transmission unit that transmits an operation unit position signal for causing the control unit to authenticate the position of the operation unit,
The image display unit includes a display unit position signal transmission unit that transmits a display unit position signal for causing the control unit to authenticate the position of the image display unit,
The control unit includes a position authentication processing unit that authenticates a positional relationship between the operation unit and the image display unit based on the operation unit position signal and the display unit position signal of the operation unit. A head-mounted display device that changes the transmittance of the outside scene in the image display unit accordingly. The head-mounted display device according to claim 2,
The positional relationship is a head-mounted display device in which the virtual image that the image display unit causes a user to visually recognize and the reception input unit overlap. The head-mounted display device according to any one of claims 1 to 3,
The control unit is a head-mounted display device in which a display method of the operation in the virtual image to be visually recognized by a user is different according to the reception input unit. An optically transmissive head-mounted display device,
An acquisition unit for acquiring image data;
An image display unit that generates image light based on the image data and outputs the image light to allow a user to visually recognize the image light as a virtual image;
An operation unit for receiving an operation;
A control unit that controls the image display unit according to the accepted operation,
The operation unit is disposed on one surface of the operation unit and receives the operation, and a second input unit is disposed on a surface different from the one surface of the operation unit and receives the operation. And an operation unit position signal transmission unit for transmitting an operation unit position signal for causing the control unit to authenticate the position of the operation unit,
The image display unit includes a display unit position signal transmission unit that transmits a display unit position signal for causing the control unit to authenticate the position of the image display unit,
The control unit includes a position authentication processing unit that authenticates a positional relationship between the operation unit and the image display unit based on the operation unit position signal and the display unit position signal of the operation unit. A head-mounted display device that changes the control content for controlling the image display unit accordingly.   The head-mounted display device according to claim 5,
  The location authentication processing unit
    Based on the received infrared rays as the operation unit position signal, specify an operation unit distance that is a distance between the control unit and the operation unit,
    Based on the received infrared rays as the display unit position signal, specify the display unit distance that is the distance between the control unit and the image display unit,
  A head-mounted display device that authenticates the positional relationship based on the identified operation unit distance and the specified display unit distance.   The head-mounted display device according to claim 5 or 6,
  The control unit can select the operation unit that receives operations from the detected operation units when the position authentication processing unit authenticates the plurality of operation units within a predetermined distance from the control unit. A head-mounted display device that displays the image on the image display unit. The head-mounted display device according to any one of claims 1 to 7 ,
The control unit has a power supply for the control unit,
The operation unit has an operation unit power supply,
The control unit and the operation unit are detachable,
When the operation unit is connected to the control unit, the operation unit is operated by power supplied from the control unit power source. When the operation unit is not connected to the control unit, the operation unit is supplied from the operation unit power source. Head-mounted display device that operates with electric power. The head-mounted display device according to any one of claims 1 to 8 ,
The operation unit is replaceable with a different operation unit, and includes an authentication signal transmission unit that transmits an authentication signal to cause the control unit to authenticate,
The control unit includes an authentication processing unit that authenticates the operation unit based on the authentication signal from the authentication signal transmission unit, performs the control based on the operation received by the authenticated operation unit, and is not authenticated. A head-mounted display device that does not receive the control based on the operation received by the operation unit. The head-mounted display device according to any one of claims 1 to 9 ,
The head-mounted display device in which the first input unit or the second input unit accepts voice input. The head-mounted display device according to any one of claims 1 to 10 ,
The control unit performs the control based on a new operation corresponding to a combination of the first operation received by the first input unit and the second operation received by the second input unit at the same time. A head mounted display device. The head-mounted display device according to claim 11 ,
In the operation unit, the head-mounted display device in which the first input unit and the second input unit are formed in a front-back position relationship. The head-mounted display device according to any one of claims 1 to 12 ,
The operation unit has an operation unit power supply,
The head-mounted display device, wherein the control unit is integral with the image display unit and is separate from the operation unit. The head-mounted display device according to any one of claims 1 to 13 ,
The first input unit is a head-mounted display device that is a liquid crystal display surface capable of displaying an image to be visually recognized by a user in the same manner as the image light.

Images