JP6036140B2 - Head-mounted display device and method for controlling head-mounted display device - Google Patents

Description

  The present invention relates to a head-mounted display device that is a display device mounted on a head.

  2. Description of the Related Art A head mounted display (HMD) that is a display device that is used by being mounted on a head is known. The head-mounted display device, for example, generates image light representing an image using a liquid crystal display and a light source, and guides the generated image light to a user's eye using a projection optical system or a light guide plate Thus, the user is made to recognize the virtual image. In such a head-mounted display device, it is possible to enjoy images, videos, and sounds anywhere, regardless of location, while being worn like, for example, glasses.

  In the prior art, when a head-mounted display device is mounted, it is common for a user to always wear an earphone for sound output. Wearing earphones is time consuming and troublesome for the user, and is not preferable in terms of appearance. In addition, the use of the earphone for a long time has a problem in that the user may be stressed. In order to solve such a problem, for example, in the head-mounted display device described in Patent Document 1, an audio output unit capable of supplying audio in a state where the ear is not compressed is disposed around the user's ear Has been. In addition, the head-mounted display device described in Patent Document 2 includes a temple piece that extends from the side of the user's head toward the ear, and a speaker is attached to the temple piece by a pivotable arm.

JP-A-11-331730 JP-T-2002-515127

  With the technique described in Patent Document 1, it is not necessary to wear an earphone when the head-mounted display device is worn. However, the reality is that sufficient ingenuity has not been made with regard to the ease of listening to voice. Further, even with the technique described in Patent Document 2, although it is no longer necessary to wear an earphone, sufficient contrivance has not been made with respect to the ease of listening to voice.

  For this reason, in a head-mounted display device that does not include an earphone, it has been desired to improve the ease of listening to voice.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following application examples or forms. Examples of application of the present invention are:
A head-mounted display device,
An optical member disposed in the vicinity of the user's eye in a mounted state in which the head-mounted display device is mounted on the user's head;
Pronunciation body,
A contact member that extends from the optical member and is disposed along the head of the user;
A plurality of fixing portions arranged on a surface of the abutting member facing the head, and capable of fixing the sounding body at different positions;
An output control unit for controlling the volume of the sounding body according to a position where the sounding body is fixed on the surface;
A head-mounted display device comprising: The form of the present invention is as follows.

(1) According to one aspect of the present invention, a head-mounted display device is provided. The head-mounted display device includes: an optical member disposed in the vicinity of the user's eye when the head-mounted display device is mounted on the user's head; a sound generator; A contact member extending from the optical member and disposed along the user's head; a plurality of fixing portions disposed on the contact member and capable of fixing the sound generator at different positions; An output control unit for controlling the volume of the sounding body in accordance with the position where the sound is fixed. According to the head-mounted display device of this embodiment, the head-mounted display device fixes the sounding body at different positions to the contact member for holding the head-mounted display device on the user's head. The output control unit controls the volume of the sounding body according to the position where the sounding body is fixed. For this reason, in a head-mounted display device that does not include an earphone, it is possible to improve the ease of hearing a voice.

(2) In the head-mounted display device of the above aspect; the output control unit may further control an output frequency characteristic of the sounding body according to a position where the sounding body is fixed. According to the head-mounted display device of this aspect, the output control unit further controls the output frequency characteristics of the sounding body in addition to the volume of the sounding body in accordance with the position where the sounding body is fixed. For this reason, in a head-mounted display device that does not include an earphone, it is possible to further improve the ease of hearing a voice.

(3) In the head-mounted display device according to the above aspect, at least one of the plurality of fixing portions is inside the contact member and faces the user's ear in the wearing state. At least one of the plurality of fixing portions may be disposed inside the abutting member and at a position away from the user's ear in the wearing state. According to the head-mounted display device of this embodiment, the sounding body can be fixed to both the position facing the user's ear and the position away from the ear when the head-mounted display device is mounted. Parts are arranged. As a result, the user can concentrate on listening to the sound with the sounding body set to the position of his ear, or he can listen to the sound of the outside world with the position of the sounding body removed from the position of his ear. Emphasis can also be placed.

(4) In the head-mounted display device according to the above aspect; the plurality of fixing portions are portions located at the vertices of the polygon when the polygon is virtually spread on the inside of the contact member The sounding body may include a fitting body that fixes the sounding body to the contact member by fitting with at least one of the plurality of fixing portions. According to the head-mounted display device of this aspect, the fixing portion for fitting with the fitting body provided on the sounding body can be arranged evenly with respect to the inside of the contact member. As a result, a plurality of fixing portions can be provided without impairing the aesthetic appearance of the contact member of the head-mounted display device.

(5) In the head mounted display device according to the above aspect; the plurality of fixing portions are arranged on a straight line extending in a longitudinal direction of the contact member with respect to an inner side of the contact member; Is a fitting body that fixes the sounding body to the abutting member by fitting into one of the plurality of fixing portions, and holds the sounding body rotatably about the fitting body. A fitting body may be provided. According to the head-mounted display device of this aspect, the fixing portion for fitting with the fitting body provided on the sounding body can be arranged in the longitudinal direction of the contact member. Further, the fitting body of the sounding body can hold the sounding body so as to be rotatable about itself. As a result, in the head-mounted display device, the position where the sounding body is fixed to the contact member can be changed by two kinds of methods, and the degree of freedom of change can be increased.

(6) In the head-mounted display device according to the above aspect; the contact member further includes an ear hook disposed on the ear of the user and disposed on the inner side of the contact member; The portions are arranged at regular intervals between one end portion in the longitudinal direction of the ear hook and the other end portion; and the sounding body is fitted into one of the plurality of fixing portions, thereby You may provide the fitting body which fixes the said sounding body to a contact member. According to the head-mounted display device of this aspect, the fixing portion for fitting with the fitting body provided in the sounding body is provided between one end portion in the longitudinal direction of the ear hook of the contact member and the other end portion. To place. For this reason, a sounding body can always be arrange | positioned in the vicinity of a user's ear.

(7) In the head-mounted display device according to the above aspect; the sounding body may further include a distance adjusting unit that can change a distance between the fitting body and the sounding body. According to the head-mounted display device of this aspect, the distance between the sounding body and the fitting body can be made variable. Therefore, the position where the sounding body is fixed to the abutting member is determined from the fitting body that fits between the one end portion in the longitudinal direction of the ear hook and the other end portion and the fixing portion provided in the abutting member. The distance can be changed by two kinds of methods, and the degree of freedom of change can be increased.

(8) In the head-mounted display device according to the above aspect; a sensor for detecting whether or not the fitting body is fitted to each of the fixing parts in each of the plurality of fixing parts. May be built in. According to this form of the head-mounted display device, a sensor for detecting whether or not a fitting body is fitted to each of the fixed parts is incorporated in each of the fixed parts. For this reason, the output control unit can easily know the position where the sounding body is fixed using the detection values of these sensors.

  A plurality of constituent elements of each embodiment of the present invention described above are not essential, and some or all of the effects described in the present specification are to be solved to solve part or all of the above-described problems. In order to achieve the above, it is possible to appropriately change, delete, replace with a new component, and partially delete the limited contents of some of the plurality of components. In order to solve part or all of the above-described problems or to achieve part or all of the effects described in this specification, technical features included in one embodiment of the present invention described above. A part or all of the technical features included in the other aspects of the present invention described above may be combined to form an independent form of the present invention.

  For example, one aspect of the present invention is realized as an apparatus including some or all of the five elements of an optical member, a sounding body, a contact member, a fixing unit, and an output control unit. Is possible. That is, this apparatus may or may not have an optical member. In addition, this device may or may not have a sounding body. Further, this device may or may not have a contact member. Moreover, this apparatus may have a fixing | fixed part and does not need to have it. Further, this apparatus may or may not have an output control unit. Such a device can be realized, for example, as a head-mounted display device, but can also be realized as a device other than the head-mounted display device. Any or all of the technical features of each form of the head-mounted display device described above can be applied to this device.

  The present invention can be realized in various modes. For example, a head-mounted display device, a control method for the head-mounted display device, and a computer for realizing the functions of these methods or devices. It can be realized in the form of a program, a recording medium on which the computer program is recorded, or the like.

It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in one Embodiment of this invention. It is explanatory drawing for demonstrating a contact member and a speaker. It is a block diagram which shows the composition of a head mount display functionally. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing which shows an example of the virtual image recognized by the user. It is explanatory drawing which shows an example of a mode setting table. It is explanatory drawing which shows an example of the frequency characteristic of a speaker. It is explanatory drawing which shows an example of an area correspondence table. It is a flowchart which shows the procedure of a speaker control process. It is a flowchart which shows the procedure of a change detection process. It is a flowchart which shows the procedure of a speaker control process. It is explanatory drawing for demonstrating the contact member and speaker of the head mounted display apparatus of 2nd Embodiment. It is explanatory drawing for demonstrating the table structure in 2nd Embodiment. It is explanatory drawing for demonstrating the contact member and speaker of the head mounted display apparatus of 3rd Embodiment. It is explanatory drawing for demonstrating the contact member and speaker of the head mounted display apparatus of 3rd Embodiment. It is explanatory drawing for demonstrating the table structure in 3rd Embodiment. It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in a modification.

A. First embodiment:
A-1. Configuration of head mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device according to an embodiment of the present invention. The head-mounted display device HM is a head-mounted display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display HM of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene.

  The head-mounted display HM includes an image display unit 20 that allows the user to visually recognize a virtual image while being mounted on the user's head, and a control unit (controller) 10 that controls the image display unit 20.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right contact member 21, a right display drive unit 22, a left contact member 23, a left display drive unit 24, a right optical image display unit 26, and a left optical image display unit 28. Contains.

  The right optical image display unit 26 and the left optical image display unit 28 are located in the vicinity of the user's right eye and left eye (in front of the right eye and left eye in the example of the present embodiment) when the head mounted display HM is mounted. It is arranged at the corresponding position. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are respectively connected at positions corresponding to the eyebrows of the user when the head mounted display HM is mounted. The right abutting member 21 extends from the end ER which is the other end of the right optical image display unit 26. Similarly, the left contact member 23 extends from the end EL which is the other end of the left optical image display unit 28.

  The right abutting member 21 is substantially perpendicular to the right optical image display unit 26 from the end ER of the right optical image display unit 26 along the temporal region of the user when the head mounted display HM is mounted. It is a member provided by being stretched. Similarly, the left contact member 23 is substantially the same as the left optical image display unit 28 from the end EL of the left optical image display unit 28 to a position corresponding to the user's temporal region when the head mounted display HM is mounted. It is a member provided by extending so as to form a right angle. The right contact member 21 and the left contact member 23 hold the head mounted display HM on the user's head like a temple of glasses.

  The right display driving unit 22 is inside the right abutting member 21, in other words, on the side facing the user's head when the head mounted display HM is mounted, and the end ER of the right optical image display unit 26. Arranged on the side. The left display drive unit 24 is disposed inside the left abutting member 23 and on the end EL side of the left optical image display unit 28. In the following, the right contact member 21 and the left contact member 23 are collectively referred to simply as “contact member”, and the right display drive unit 22 and the left display drive unit 24 are simply referred to as “display drive unit”. The right optical image display unit 26 and the left optical image display unit 28 are collectively referred to simply as “optical image display unit”.

  The display driving unit includes an LCD (Liquid Crystal Display), a projection optical system, and the like (not shown). Details will be described later. The optical image display unit as an optical member includes a light guide plate (not shown) and a light control plate. The light guide plate is formed of a light transmissive resin material or the like, and emits image light taken from the display driving unit toward the user's eyes. The light control plate is a thin plate-like optical element, and is arranged so as to cover the front side of the head mounted display HM, in other words, the side opposite to the eye side of the user. The light control plate protects the light guide plate and suppresses damage to the light guide plate, adhesion of dirt, and the like. Moreover, the light control board can adjust the external light quantity which enters into a user's eyes by adjusting light transmittance, and can adjust the ease of visual recognition of a virtual image. The dimming plate can be omitted. The optical image display unit corresponds to an “optical member” in the claims.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48 connected to the control unit 10, a right cord 42 in which the main body cord 48 branches into two, a left cord 44, and a connecting member 46 provided at the branch point. Yes. The right cord 42 is inserted into the casing of the right abutting member 21 from the distal end AP in the extending direction of the right abutting member 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left contact member 23 from the distal end AP in the extending direction of the left contact member 23 and connected to the left display drive unit 24.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. Each end of the main body cord 48 opposite to the connecting member 46 and the control unit 10 are provided with connectors (not shown) that are fitted to each other. The connector of the main body cord 48 and the control unit 10 The control unit 10 and the image display unit 20 are connected to or disconnected from each other by the fitting / releasing of the connector. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for operating the head mounted display HM. The control unit 10 includes a lighting unit 12, a touch pad 14, a cross key 16, a power switch 18, and a volume adjustment button 19.

  The lighting unit 12 notifies the operation state of the head mounted display HM by the light emission state. The operating state of the head mounted display HM is, for example, power ON / OFF. For example, an LED (Light Emitting Diode) can be used as the lighting unit 12. The touch pad 14 detects a user's finger operation on the operation surface of the touch pad 14 and outputs a signal corresponding to the detected content. The cross key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head mounted display HM by detecting a slide operation of the switch. The volume control button 19 includes a + volume button for increasing the volume output from the speaker and a -volume button for decreasing the volume output from the speaker.

  FIG. 2 is an explanatory diagram for explaining the contact member and the speaker. The speaker corresponds to the “sound generator” in the claims. FIG. 2A is an enlarged view of the left contact member 23 as viewed from the inner side. The left contact member 23 includes a front contact member 23x, a rear contact member 23y, and a connecting portion 23z.

  The front contact member 23x is a member that occupies the left contact member 23 from the end EL of the left optical image display unit 28 to a position corresponding to the periphery of the user's temple when the head mounted display HM is mounted. . In other words, the front contact member 23 x extends from the end EL of the left optical image display unit 28 to the central portion in the longitudinal direction of the left contact member 23. In the present embodiment, “center” is used to mean not only the exact center but also “near the center”. A left display drive unit 24 is disposed inside the front contact member 23x.

  The rear abutting member 23y is a member that occupies from the tip of the front abutting member 23x to a position corresponding to the rear of the user's ear when the head mounted display HM is mounted. In other words, the rear abutting member 23 y extends from the center in the longitudinal direction of the left abutting member 23 to the distal end AP of the left abutting member 23. A plurality of holding holes 230 are formed inside the rear abutting member 23y, in other words, on the side facing the user's head when the head mounted display HM is mounted. Each holding hole 230 is arranged at a portion located at the vertex of the polygon when the polygon is virtually spread on the inner side of the rear abutting member 23y. In the present embodiment, the polygon is a triangle, but may be a quadrilateral, a pentagon, or a rhombus.

  The connecting portion 23z is a member that connects the front contact member 23x and the rear contact member 23y. The connecting portion 23z functions as a hinge that allows the distal end portion AP of the rear abutting member 23y to rotate in the horizontal direction.

  FIG. 2B is a schematic diagram illustrating a cross section of the rear contact member 23y and the left speaker 320. The left speaker 320 includes a ball 321, an elastic body 322, a main body 323, a cushion 324, and a protective cover 325. The ball 321 is produced by magnetizing a spherical magnetic body and has a magnetic force. The ball 321 functions as a “fitting body” that fixes the left speaker 320 to the rear contact member 23y by being fitted into one of the holding holes 230 of the rear contact member 23y. The elastic body 322 connects the ball 321 and the main body 323 with elasticity. The elastic body 322 can be formed by a coil spring or a leaf spring, for example. Note that the elastic body 322 may be omitted.

  The main body 323 is a speaker that converts electrical signals into physical vibrations and transmits them as sound waves to the user's ear canal. The vibration is transmitted from the ear canal in the order of the eardrum, the ossicle (middle ear), the inner ear (cochlea), the auditory nerve, and the auditory cortex of the brain, and is recognized as “sound” by the user. The speaker in the present embodiment includes a cylindrical voice coil, a cylindrical permanent magnet, and a diaphragm. A voice coil having a diameter slightly smaller than that of the hole portion is inserted into a cylindrical space corresponding to the hole of the permanent magnet. A diaphragm having a conical shape is fixed to the voice coil. The diaphragm is formed of cone paper or the like, for example. The cushion 324 is a cushioning material that includes the main body 323, the elastic body 322, and a part of the ball 321. The cushion 324 is preferably formed of a material with good skin perception such as rubber or polyurethane. If it does so, the mounting | wearing feeling of the head mounted display HM can be improved. The cushion 324 has an opening at a position corresponding to the conical spreading direction of the diaphragm of the main body 323. The protective cover 325 is disposed inside the opening of the cushion 324 and suppresses intrusion of dust from the outside. As the protective cover 325, for example, a metal net, a sponge, or the like can be employed.

  The holding hole 230 formed in the inner side surface IP of the rear abutting member 23y is a recess formed in a hemispherical shape and functions as a “fixing portion” for fixing the left speaker 320. In the present embodiment, the surface of the holding hole 230 is covered with metal so that the left speaker 320 can be held by the magnetic force of the ball 321. Each holding hole 230 has a sensor 232 incorporated therein. The sensor 232 detects that the ball 321 of the left speaker 320 is fitted in the holding hole 230. Various sensors can be used as the sensor 232. As the sensor 232, for example, a contact sensor that detects the contact of the ball 321, an proximity sensor that detects the approach of the ball 321, a magnetic sensor that detects the magnetic force of the ball 321, or the like can be used.

  In the above description, the left contact member 23 has been described as an example, but the right contact member 21 has the same configuration. That is, the right contact member 21 also includes a front contact member 21x, a rear contact member 21y, and a connecting portion 21z, and a plurality of holding holes 210 are formed inside the rear contact member 21y. The holding hole 210 functions as a fixing portion that fixes the right speaker 310.

  FIG. 3 is a block diagram functionally showing the configuration of the head mounted display HM. The control unit 10 includes an input information acquisition unit 110, a storage unit 120, a power source 130, a CPU 140, an interface 180, and transmission units (Tx) 51 and 52. The aforementioned units are connected to each other by a bus (not shown).

  The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user such as an operation input to the touch pad 14, the cross key 16, the power switch 18, and the like. The storage unit 120 is a storage unit including a ROM, a RAM, a DRAM, a hard disk, and the like. The storage unit 120 includes a mode setting table 122 and an area correspondence table 124. The mode setting table 122 and the area correspondence table 124 are tables used by the output control unit 171 to control the right speaker 310 and the left speaker 320. The mode setting table 122 and the area correspondence table 124 are stored in the storage unit 120 in advance. Details of each table will be described later. The power supply 130 supplies power to each part of the head mounted display HM. As the power supply 130, for example, a secondary battery can be used.

  The CPU 140 provides a function as an operating system (OS) 150 by executing a program installed in advance. The CPU 140 also functions as a detection unit 142, an image processing unit 160, a sound processing unit 170, and a display control unit 190 by developing firmware and computer programs stored in a ROM and a hard disk on the RAM and executing them. . The detection unit 142 detects the position of the holding hole 210 to which the right speaker 310 is fixed in the rear contact member 21y from the output values of a plurality of sensors built in the rear contact member 21y of the right contact member 21. . Similarly, the detection unit 142 determines whether the left speaker 320 is fixed to the rear contact member 23y from the output values of a plurality of sensors 232 built in the rear contact member 23y of the left contact member 23. Detect position.

  The image processing unit 160 generates a signal to be supplied to the image display unit 20 based on content input via the interface 180 and transmits the signal to the image display unit 20. The signal supplied to the image display unit 20 differs between the analog format and the digital format.

  For example, in the case of an analog format, the image processing unit 160 generates and transmits a clock signal PCLK, a vertical synchronization signal VSync, a horizontal synchronization signal HSync, and image data Data. Specifically, the image processing unit 160 acquires an image signal included in the content. For example, in the case of a moving image, the acquired image signal is generally an analog signal composed of 30 frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL circuit (not shown) or the like according to the period of the separated vertical synchronization signal VSync, horizontal synchronization signal HSync, and the like. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal in the DRAM in the storage unit 120 for each frame as image data Data of RGB data.

  For example, in the case of a digital format, the image processing unit 160 generates and transmits a clock signal PCLK and image data Data. Specifically, when the content is in a digital format, the clock signal PCLK is output in synchronization with the image signal. For this reason, A / D conversion of the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the analog image signal becomes unnecessary.

  The image processing unit 160 performs image processing such as resolution conversion processing, various tone correction processing such as adjustment of luminance and saturation, and keystone correction processing on the image data Data stored in the storage unit 120. May be executed.

  The image processing unit 160 transmits the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data stored in the DRAM in the storage unit 120 to the transmission unit 51 and the clock signal PCLK generated as described above. 52, respectively. Note that the image data Data transmitted through the transmission unit 51 is also referred to as “right-eye image data Data1”, and the image data Data transmitted through the transmission unit 52 is also referred to as “left-eye image data Data2”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 uses the control signal to turn on / off the right LCD 241 by the right LCD control unit 211, turn on / off the right backlight 221 by the right backlight control unit 201, and control the left LCD. The left display drive unit 22 and the left display drive unit 24 are controlled by individually controlling the ON / OFF of the left LCD 242 by the unit 212 and the ON / OFF of the left backlight 222 by the left backlight control unit 202. Each controls the generation and emission of image light. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals for the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and connects the main unit 313 of the right speaker 310 and the main unit 323 of the left speaker 320 of the image display unit 20 to each other. 40. For example, when a Dolby (registered trademark) system is employed, processing for an audio signal is performed. As a result, the right speaker 310 and the left speaker 320 output different sounds having different frequencies, for example. The audio processing unit 170 includes an output control unit 171. The output control unit 171 controls electric signals transmitted to the right speaker 310 and the left speaker 320 by speaker control processing described later.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the control unit 10. Examples of the external device OA include a personal computer PC, a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, a wireless LAN interface, or the like can be provided.

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a sensor 2120. And a sensor 232, a right speaker 310, and a left speaker 320.

  The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are also collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 has a function of driving the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 has a function of driving the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right eye image data Data1 input via the reception unit 53. Have The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  FIG. 4 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal corresponding to each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221. It has a function of modulating into effective image light PL representing an image. As shown in FIG. 4, the backlight system is adopted in this embodiment, but a configuration in which image light is emitted using a front light system or a reflection system may be used.

  The right projection optical system 251 in FIG. 3 is configured by a collimating lens that converts image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”. The light guide unit is in the vicinity of the user's eyes using image light, and any method can be used as long as a virtual image is formed. For example, a diffraction grating may be used or semi-transmissive A reflective film may be used.

  Since each part of the left display drive unit 24 has the same configuration and operation as each part described in the right display drive unit 22, detailed description thereof is omitted.

  FIG. 5 is an explanatory diagram illustrating an example of a virtual image recognized by the user. As described above, the image light guided to both eyes of the user of the head mounted display HM forms an image on the retina of the user, so that the user can visually recognize the virtual image. As shown in FIG. 5, a virtual image VI is displayed in the visual field VR of the user of the head mounted display HM. In addition, regarding the portion of the user's visual field VR where the virtual image VI is displayed, the user can see the outside scene SC via the virtual image VI of the optical image display unit. Further, the user can directly view the outside scene SC through the optical image display unit except for the portion of the user's visual field VR where the virtual image VI is displayed.

A-2. Table configuration:
FIG. 6 is an explanatory diagram showing an example of the mode setting table 122. The mode setting table 122 is a table that stores the sound reproduction mode of the speaker and the volume and frequency characteristics of the speaker in association with each other. The mode setting table 122 is used by the output control unit 171 to control the left and right speakers, that is, the right speaker 310 and the left speaker 320 in the speaker control process. The mode setting table 122 includes modes, volume levels, and frequency characteristics.

  In the mode field, a character string indicating the sound reproduction mode of the speaker is stored. In the volume field, a character string representing the volume of the left and right speakers corresponding to each mode is stored. In the example of FIG. 6, the volume is represented by a character string such as “Large”, but may be represented in other forms. For example, it may be represented by numbers such as 10 levels “9”. In the frequency characteristic field, a character string representing the frequency characteristics of the left and right speakers corresponding to each mode is stored.

  In the example of FIG. 6, in mode 1, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “low” and the frequency characteristic “A”. In mode 1, the volume and frequency characteristics are assumed in the “main viewing mode” in which the user concentrates on listening to the sound by aligning the left and right speakers with the positions of his / her ears. In mode 2, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “medium” and the frequency characteristic “B”. In mode 2, the user adjusts the left and right speakers slightly away from their ears, and listens to the sound of the outside world while listening to the sound. The characteristics are assumed. In mode 3, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “medium” and the frequency characteristic “B”. In the case of mode 4, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “high” and the frequency characteristic “B”. In mode 3 and mode 4, the volume in “while viewing mode” is focused on listening to the sound of the outside world by using the sound as background music by adjusting the left and right speakers from the position of their ears. And frequency characteristics are assumed. In the case of mode 5, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “none” and the frequency characteristic “none”, that is, the left and right speakers are turned off. Mode 5 assumes sound and frequency characteristics in a “silent mode” in which the user turns off the sound by setting the left and right speakers to the position farthest from the position of his / her ear.

  FIG. 7 is an explanatory diagram showing an example of frequency characteristics of a speaker. FIG. 7A shows a change in output (sound pressure level, dB) in the case of the frequency characteristic “A”. FIG. 7B shows a change in output (sound pressure level, dB) in the case of the frequency characteristic “B”. 7A and 7B, the vertical axis represents the sound pressure level (dB), and the horizontal axis represents the frequency (Hz). In the case of the frequency characteristic “A” shown in FIG. 7A, it can be seen that the speaker outputs a flat sound with no difference between the low sound range, the mid sound range and the high sound range. In the case of such frequency characteristics, the user can enjoy a sound that spreads uniformly from a low sound range to a high sound range. That is, the frequency characteristic “A” is suitable for the main viewing mode. On the other hand, in the case of the frequency characteristic “B” shown in FIG. 7B, it can be seen that the speaker outputs a sound in which the low sound range and the high sound range are suppressed and the mid sound range is emphasized. In general, male voices are said to be 300 to 500 Hz and female voices are said to be 400 to 700 Hz. Therefore, in the frequency characteristic “B”, the voice of the audio content is given priority. That is, in the frequency characteristic “B”, when the speaker is away from the ear, the user can easily hear the sound of the outside world and can easily hear the voice of the audio content. That is, the frequency characteristic “B” is suitable for the viewing mode.

  Note that the two frequency characteristics shown in FIG. 7 are merely examples. Various frequency characteristics suitable for the use scene assumed in the sound reproduction mode can be determined. For example, as a frequency characteristic for an audio playback mode that is particularly suitable for listening to language learning content, the frequency characteristic peak is set to 2 to 5 kHz, and a frequency characteristic that facilitates preferential passage of audio content “voice” is set. May be.

  FIG. 8 is an explanatory diagram showing an example of the area correspondence table 124. FIG. 8A shows an example of the area correspondence table 124. The area correspondence table 124 is a table that stores the positions where the left and right speakers are fixed and the sound reproduction modes of the speakers in association with each other. The area correspondence table 124 is used by the output control unit 171 to determine the sound reproduction mode of the speaker in the speaker control processing. The area correspondence table 124 includes areas and modes.

  The area field stores an identifier for identifying each area after the rear abutting member is virtually divided into a plurality of areas. In the mode field, a character string indicating the sound reproduction mode of the speaker is stored.

  FIG. 8B is an explanatory diagram for describing the area in detail. Here, the left contact member 23 will be described as an example. As described with reference to FIG. 2, a plurality of holding holes 230 are formed in the rear contact member 23 y of the left contact member 23. The rear contact member 23y is divided into virtual regions in which all the holding holes 230 belong to any region. For example, it can be divided into virtual regions from region 1 to region 6 as shown in the figure. Then, the “position where the left speaker 320 is fixed” can be identified as an area to which the holding hole 230 into which the ball 321 of the left speaker 320 is fitted belongs. The same applies to the right contact member 21.

A-3. Speaker control processing:
FIG. 9 is a flowchart showing a procedure of speaker control processing. The speaker control process is a process for controlling the volume and frequency characteristics of the speaker. The speaker control process is executed when the OS 150 of the head mounted display HM starts to reproduce the content, and determines the volume of the content or the like according to the position where the speaker is fixed. Note that the speaker control process is performed independently for the right speaker 310 of the right contact member 21 and the left speaker 320 of the left contact member 23. Hereinafter, the left speaker 320 of the left contact member 23 will be described as an example.

  The output control unit 171 causes the detection unit 142 to detect the position of the speaker (step S10). The detection unit 142 detects the position of the holding hole 230 where the left speaker 320 is fixed in the rear contact member 23y from the output value of the sensor 232 incorporated in the rear contact member 23y of the left contact member 23. The detection unit 142 transmits the detected position of the holding hole 230 to the output control unit 171. The output control unit 171 determines whether the position of the speaker has been detected (step S12). Specifically, the output control unit 171 determines that the position of the speaker has been detected when the position of the holding hole to which the speaker is fixed is received from the detection unit 142. In other cases, the output control unit 171 determines that the position of the speaker cannot be detected. When the position of the speaker cannot be detected (step S12: NO), the output control unit 171 causes the process to transition to step S10.

  When the position of the speaker can be detected (step S12: YES), the output control unit 171 determines the sound reproduction mode of the speaker based on the position of the holding hole to which the speaker is fixed (step S14). Specifically, the output control unit 171 refers to the area correspondence table 124, and sets the mode associated with the region to which the holding hole received in step S10 belongs as the speaker audio reproduction mode.

  After determining the mode, the output control unit 171 refers to the mode setting table 122 and drives the speaker with the volume and frequency characteristics corresponding to the mode determined in step S14 (step S16). Specifically, the output control unit 171 controls the electrical signal transmitted to the main body 323 of the left speaker 320 so that the target volume and frequency characteristics can be obtained from the left speaker 320. Thereafter, the output control unit 171 executes a change detection process (step S100).

A-3-1. Change detection processing:
FIG. 10 is a flowchart illustrating the procedure of the change detection process. The change detection process is a process for detecting the following operation during content reproduction and changing the volume and frequency characteristics of the speaker.
-When the user operates the control unit 10 to change the volume.
・ When the user changes the position where the speaker is fixed in the contact member.
The change detection process is executed as a subroutine of the speaker control process. Note that the speaker control process is performed independently for the right speaker 310 of the right contact member 21 and the left speaker 320 of the left contact member 23. Hereinafter, the left speaker 320 of the left contact member 23 will be described as an example.

  The output control unit 171 determines whether or not the position of the speaker has been changed (step S102). Specifically, the output control unit 171 determines that the position of the speaker has been changed when the position of the holding hole where the speaker is fixed is received again from the detection unit 142. In other cases, the output control unit 171 determines that the position of the speaker has not been changed. When the position of the speaker has not been changed (step S102: NO), the output control unit 171 causes the process to transition to step S108.

  When the position of the speaker is changed (step S102: YES), the output control unit 171 determines the sound reproduction mode of the speaker based on the changed position of the holding hole (step S104). Details are the same as step S14 in FIG. After determining the mode, the output control unit 171 refers to the mode setting table 122 and drives the speaker with the volume and frequency characteristics corresponding to the mode determined in step S104 (step S106). Details are the same as step S16 in FIG.

  The output control unit 171 determines whether or not the speaker volume operation has been performed (step S108). Specifically, when the output control unit 171 receives a volume adjustment request from the equalizer function provided by the OS 150 or detects that the volume control button 19 of the control unit 10 is pressed, the volume control of the speaker is performed. It is determined that In other cases, the output control unit 171 determines that the volume operation of the speaker is not performed. When the volume operation of the speaker is not performed (step S108: NO), the output control unit 171 shifts the process to step S102 and repeats the change detection process.

  When the volume operation of the speaker is performed (step S108: YES), the output control unit 171 drives the speaker with the volume received in step S108 (step S110). Details are the same as step S16 in FIG. In addition, when performing processing based on a volume adjustment request from the equalizer function in step S110, the output control unit 171 can obtain speaker performance based on other control parameters (frequency characteristics, etc.) in addition to volume. An electric signal transmitted to the main body portion 323 can be controlled.

  Thereafter, the output control unit 171 shifts the process to step S102 and repeats the change detection process. The change detection process is repeatedly executed until the reproduction of the content is stopped or the power of the head mounted display HM is turned off. In this way, the output control unit 171 detects a change operation of the volume during the reproduction of the content or a change operation of the position where the speaker is fixed, and appropriately changes the volume and frequency characteristics of the speaker. Can do.

  As described above, the head mounted display HM according to the first embodiment has the right contact member 21 and the left contact member 23 for holding the head mounted display HM (head mounted display device) on the user's head. The (contact member) has a plurality of holding holes 210 and holding holes 230 (fixing portions) that can fix the right speaker 310 and the left speaker 320 (sound generator) at different positions. Further, the output control unit 171 controls the volume and output frequency characteristics of the speakers according to the position where the left and right speakers are fixed. For this reason, in a head mounted display HM that does not include an earphone, it is possible to improve the ease of listening to sound.

  Further, in the head mounted display HM of the first embodiment, the holding hole 210 and the holding hole 230 (fixing portion) for fitting with the ball 311 and the ball 321 (fitting body) of the left and right speakers are provided in the right contact member 21. And it can arrange | position equally with respect to the inner side of the left contact member 23 (contact member). As a result, the plurality of holding holes 210 and the holding holes 230 (fixing portions) can be provided without impairing the aesthetic appearance of the right contact member 21 and the left contact member 23 (contact member) of the head mounted display HM.

A-4. Speaker control processing (variation):
FIG. 11 is a flowchart showing a procedure of speaker control processing different from FIG. The difference from the speaker control processing shown in FIG. 9 is that the volume of content is determined according to the setting in the equalizer function provided by the OS 150. In addition, the execution timing, the execution subject, the execution target, and the like are the same as those in the first embodiment of FIG.

  The output control unit 171 acquires the setting value of the equalizer function provided by the OS 150 (step S50). Specifically, for example, the output control unit 171 can obtain the setting values of the volume and frequency characteristics from a setting file used by a program that realizes the equalizer function. After acquiring the set value, the output control unit 171 drives the speaker with the volume and frequency characteristics corresponding to the set value acquired in step S50 (step S52). Details are the same as step S16 in FIG. Thereafter, the output control unit 171 executes the change detection process of FIG. 10 (step S100).

  When the speaker control process as shown in FIG. 11 is used, the speaker volume and frequency characteristics when content reproduction is started are determined based on the settings in the equalizer function. However, by the change detection process executed in step S100, the output control unit 171 detects a volume change operation during content playback or a position change operation where the speaker is fixed, and the volume and frequency characteristics of the speaker are detected. Can be changed as appropriate. For this reason, also in the speaker control processing as shown in FIG. 11, the same effect as in FIG. 9 can be obtained.

B. Second embodiment:
In the second embodiment of the present invention, an example in which the configuration of the contact member and the speaker is changed with respect to the head mounted display HM of the first embodiment will be described. Below, only the part which has a different structure and operation | movement from 1st Embodiment is demonstrated. In the figure, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment described above, and detailed description thereof is omitted.

B-1. Configuration of head mounted display device:
FIG. 12 is an explanatory diagram for explaining a contact member and a speaker of the head-mounted display device of the second embodiment. FIG. 12A is an enlarged view of the left contact member 23a as viewed from the inner side. The difference from the first embodiment shown in FIG. 2 is that the image display unit 20a of the head mounted display HMa is replaced with the right display drive unit 22 instead of the right display drive unit 22 and the left display drive unit 24 is replaced with the left display. The drive unit 24a is provided with a right contact member 21a instead of the right contact member 21 and a left contact member 23a instead of the left contact member 23.

  The left display driving unit 24a is different from the first embodiment only in that the left sub speaker 352 is incorporated. The left sub-speaker 352 has the same configuration as that of the main body 323 of the left speaker 320 described in the first embodiment, except for a portion having different frequency characteristics. The left sub-speaker 352 in the present embodiment is a speaker whose frequency characteristics are optimized so as to be excellent in high sound reproduction capability.

  The left contact member 23 a includes a holding hole 233 and a holding hole 234 instead of the holding hole 230, and includes a left speaker 340 instead of the left speaker 320. The holding hole 233 and the holding hole 234 are arranged on a straight line extending in the longitudinal direction of the left contact member 23a with respect to the inner side of the rear contact member 23ya.

  FIG. 12B is an enlarged view of the left speaker 340. The left speaker 340 has an elliptical shape with a thin upper end, a so-called teardrop shape, a point provided with a grip claw 321a instead of the ball 321 and a point not provided with an elastic body 322, Is substantially the same as the left speaker 320 of the first embodiment. The grip claw 321a has a shape in which circular plates are provided at both ends of a rod-like member, like a bobbin used in a sewing machine or the like. One circular plate of the gripping claws 321a is fitted into either the holding hole 233 or the holding hole 234 of the rear contact member 23ya, thereby fixing the left speaker 340 to the rear contact member 23ya. The other circular plate of the gripping claws 321 a is connected to a main body 323 built in the left speaker 340. Note that the ball 321 is disposed at substantially the center of the left speaker 320, but the gripping claws 321a of the present embodiment are disposed at the tapered portion of the left speaker 340, that is, the upper end portion. Further, the other circular plate of the gripping claws 321a incorporates a ratchet mechanism, so that the left speaker 340 can be rotated around the gripping claws 321a, and the left speaker 340 can be held at an arbitrary rotation angle. . In the present embodiment, the gripping claws 321a correspond to “fitting bodies” in the claims.

  A holding hole 233 and a holding hole 234 formed on the inner surface of the rear abutting member 23ya are depressions formed in a T shape whose cross section is rotated 90 degrees counterclockwise, and fix the left speaker 340. Functions as a “fixed part”. A sensor 235 is built in the holding hole 233. The sensor 235 detects that the holding claw 321 a of the left speaker 340 is fitted in the holding hole 233. Similarly, a sensor 236 is built in the holding hole 234. The sensor 236 detects that the holding claw 321 a of the left speaker 340 is fitted in the holding hole 234. Details of the sensors 235 and 236 are the same as those of the sensor 232 of the first embodiment.

  By adopting the configuration as described above, in the head mounted display HMa of this embodiment, the speaker 340 can be moved in the direction of the arrow in FIG. In the above description, the left display drive unit 24a and the left contact member 23a have been described as examples. However, the right display drive unit 22a and the right contact member 21a have the same configuration.

B-2. Table configuration:
FIG. 13 is an explanatory diagram for explaining a table configuration in the second embodiment. FIG. 13A shows an example of the mode setting table 122a in the second embodiment. The difference from the first embodiment shown in FIG. 6 is that a field for setting the sub-speaker is further included in addition to the mode and the volume and frequency characteristics of the left and right speakers. The sub speaker field stores ON / OFF classification of the left sub speaker 352 and the right sub speaker 351. In the example of FIG. 13A, in mode 1, the output control unit 171 controls the volume of the left and right speakers to “low” and the frequency characteristic “A”, and controls the left and right sub-speakers to OFF. I understand that. Similarly, in mode 2, it can be seen that the output control unit 171 controls the volume of the left and right speakers to “medium” and the frequency characteristic “B”, and controls the left and right sub-speakers to OFF. Since Mode 3 to Mode 5 are also as shown in the figure, description thereof is omitted. As for each mode of the mode setting table 122a of the second embodiment, the same viewing mode / viewing mode associating with the first embodiment is assumed.

FIG. 13B shows an example of the area correspondence table 124a in the second embodiment. A difference from the first embodiment shown in FIG. 8 is that a mode is associated with a combination of a region and a rotation angle. In the area correspondence table 124a of the present embodiment, the area is divided into the following two areas.
Region 1: When the speaker is held in the holding hole (that is, the holding hole 213 or the holding hole 233) on the connecting portion 23z side.
Region 2: When the speaker is held in the holding hole (that is, the holding hole 214 or the holding hole 234) on the tip end AP side of the contact member.

Further, in the area correspondence table 124a of the present embodiment, the rotation angle is defined as the following three angles.
・ Rotation angle 1: When the protective cover of the speaker is positioned vertically below the holding hole.
Rotation angle 2: When the speaker protective cover is located on the connecting portion 23z side.
Rotation angle 3: When the speaker protective cover is positioned on the tip end AP side of the contact member.
In this way, the “position where the left speaker 340 is fixed” is a combination of the position of the holding hole where the gripping claw 321a of the left speaker 340 is fitted and the rotation angle of the left speaker 340. Can be identified. The same applies to the right contact member 21a.

B-3. processing:
The speaker control process in the second embodiment is the same as that in the first embodiment shown in FIG. Similarly, the change detection process in the second embodiment is the same as that in the first embodiment shown in FIG. Also in the second embodiment, various modifications exemplified as “variations” in the first embodiment can be applied.

  As described above, even with the configuration of the second embodiment, the right contact member 21a and the left contact member 23a (the present contact) for holding the head mounted display HMa (head mounted display device) on the user's head. The contact member) has a plurality of holding holes 213, 214, 233, and 234 (fixing portions) in which the right speaker 330 and the left speaker 340 (sound generator) can be fixed at different positions. Further, the output control unit 171 controls the volume and output frequency characteristics of the speakers according to the position where the left and right speakers are fixed. For this reason, in the head mounted display HMa that does not include the earphone, it is possible to improve the ease of listening to the sound.

  Furthermore, in the head mounted display HMa of the second embodiment, holding holes 213, 214, 233, and 234 (fixing portions) for fitting with the gripping claws 311a and the gripping claws 321a (fitting bodies) provided on the left and right speakers. Can be arranged in the longitudinal direction of the right contact member 21a and the left contact member 23a (contact member). Further, the gripping claws 311a and the gripping claws 321a (fitting bodies) provided on the left and right speakers can hold the speakers so as to be rotatable about themselves. As a result, in the head mounted display HMa, the position where the speaker is fixed to the right contact member 21a and the left contact member 23a (contact member) can be changed by two types of methods, and the degree of freedom of change can be increased. Can do.

C. Third embodiment:
In the third embodiment of the present invention, an example in which the configuration of the contact member and the speaker is changed with respect to the head mounted display HM of the first embodiment will be described. Below, only the part which has a different structure and operation | movement from 1st Embodiment is demonstrated. In the figure, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment described above, and detailed description thereof is omitted.

C-1. Configuration of head mounted display device:
FIG. 14 is an explanatory diagram for explaining a contact member and a speaker of the head-mounted display device of the third embodiment. FIG. 15 is an explanatory diagram for explaining a contact member and a speaker of the head-mounted display device of the third embodiment. FIG. 14A is an enlarged view of the left contact member 23b as viewed from the inner side. The difference from the first embodiment shown in FIG. 2 is that the image display portion 20b of the head mounted display HMb is replaced with the right contact member 21b instead of the right contact member 21 and the left contact member 23 with a left contact. It is a point provided with each contact member 23b. The left contact member 23 b includes a left speaker 370 instead of the left speaker 320, and further includes an ear hook 237.

  FIG. 14B is an enlarged view of the ear hook 237 and the left speaker 370. The ear hook 237 is a rod-like member curved in a shape similar to the edge of a human pinna, and has a function of holding the head mounted display HMb on the user's head by being hooked on the user's ear. . The ear hook 237 is preferably formed of a highly flexible material in order to improve the wearing feeling. One end SP of the ear hook 237 is bonded to the inner side of the rear contact member 23yb of the left contact member 23b, and the other end EP is freely movable. A plurality of holding holes 238 are formed at regular intervals between one end SP of the ear hook 237 and the other end EP. The holding hole 238 formed in the ear hook 237 is a depression formed in a T shape whose cross section is rotated 90 degrees counterclockwise, and functions as a “fixing portion” for fixing the left speaker 370. The details are the same as those of the holding hole 233 described in the second embodiment. A sensor is built in each holding hole 238. The details are the same as those of the sensor 235 described in the second embodiment.

  FIG. 15A is a schematic diagram showing a cross section of the left speaker 370. The left speaker 370 includes a gripping claw 321b, a cord 371, a winding part 372, a main body part 373, a cushion 374, a protective cover 375, and an infrared sensor 356. The gripping claw 321b has the same shape as the gripping claw 321a described in the second embodiment, that is, a shape in which a circular plate is provided at both ends of the rod-shaped member, and one circular plate is fitted in one of the holding holes 238. By doing so, the left speaker 370 is fixed to the ear hook 237. A string-like cord 371 is joined to the other circular plate of the gripping claws 321b. The wound portion 372 is a member having a substantially T-shaped cross section, and holds the wound cord 371. In the present embodiment, the gripping claws 321b correspond to the “fitting body” in the claims, and the cord 371 and the winding portion 372 correspond to the “distance adjusting portion” in the claims.

  The structure of the main body 373 is substantially the same as that of the main body 323 of the first embodiment, but the main body 373 of the third embodiment is preferably formed thin and small. The cushion 374 is a cushioning material that includes the main body portion 373 and a part of the winding portion 372. The cushion 374 of the third embodiment is substantially the same as the cushion 324 of the first embodiment, but the cushion 374 of the third embodiment is preferably formed thin and small. The protective cover 375 is disposed in the opening of the cushion 374 and suppresses intrusion of dust from the outside. The details are the same as those of the protective cover 325 of the first embodiment. The infrared sensor 356 is provided at the lower end of the circular plate to which the cord 371 is joined. Infrared sensor 356 includes a light emitting element and a light receiving element. The light emitting element emits infrared rays in the vertical direction. The light receiving element receives the infrared light reflected by the cushion 374. In this way, the infrared sensor 356 can measure the distance L1 between the light emitting element and the upper surface of the left speaker 370.

  Further, as shown in FIG. 15B, when the left speaker 370 is held in the holding hole 238 closest to the end SP of the ear hook 237, the orientation of the left speaker 370 may be changed. This can be realized, for example, by incorporating a rotation shaft in the winding part 372 of the left speaker 370.

  By adopting the configuration as described above, in the head mounted display HMb of the present embodiment, the speaker 370 is moved in the direction of the arrow in FIG. 14B and the direction of the arrow in FIG. Can do. In the above description, the left contact member 23b has been described as an example, but the right contact member 21b has the same configuration.

C-2. Table configuration:
FIG. 16 is an explanatory diagram for explaining a table configuration in the third embodiment. The mode setting table in the third embodiment is the same as that in the first embodiment shown in FIG. The area correspondence table 124b in the third embodiment is different from the first embodiment shown in FIG. 8 in that modes are associated with combinations of regions and lengths. In the area correspondence table 124b of the present embodiment, the holding hole 238 closest to the end SP side of the ear hook 237 is set as the region 1, and one of the holding holes is increased while the region number is increased by 1 toward the end EP. One area number is assigned to. In the area correspondence table 124b of this embodiment, the length is the distance L1 measured by the infrared sensor 356. In this way, the “position where the left speaker 370 is fixed” means the position of the holding hole in which the gripping claw 321b of the left speaker 370 is fitted, and the upper surface of the infrared sensor 356 and the left speaker 370. It can be identified as a combination of the distance between. The same applies to the right contact member 21b.

C-3. processing:
The speaker control process in the third embodiment is the same as that in the first embodiment shown in FIG. Similarly, the change detection process in the third embodiment is the same as that in the first embodiment shown in FIG. Also in the third embodiment, various modifications exemplified as “variations” in the first embodiment can be applied.

  As described above, even with the configuration of the third embodiment, the right contact member 21b and the left contact member 23b (the present contact) for holding the head mounted display HMb (head-mounted display device) on the user's head. The contact member) has a plurality of holding holes 218 and 238 (fixing portions) that can fix the right speaker 360 and the left speaker 370 (sound generator) at different positions on the ear hook 217 and the ear hook 237 provided on the inner side thereof. Have. Further, the output control unit 171 controls the volume and output frequency characteristics of the speakers according to the position where the left and right speakers are fixed. For this reason, in the head mounted display HMb that does not include the earphone, it is possible to improve the ease of listening to the sound.

  Furthermore, in the head mounted display HMb of the third embodiment, the holding holes 218 and 238 for fitting with the gripping claws 311b and the gripping claws 321b (fitting bodies) provided on the right speaker 360 and the left speaker 370 (sounding body). The (fixed portion) is disposed between one end SP and the other end EP in the longitudinal direction of the ear hooks 217 and 237 of the right contact member 21b and the left contact member 23b (contact member). For this reason, a speaker can always be arrange | positioned in the vicinity of a user's ear.

  Furthermore, in the head mounted display HMb of the third embodiment, the distance L1 between the right speaker 360 and the left speaker 370 (sound generator) and the gripping claws 311b and the gripping claws 321b (fitting body) can be made variable. Therefore, the positions where the speaker is fixed are provided between the end portion SP and the other end portion EP in the longitudinal direction of the ear hooks 217 and 237, and in the right contact member 21b and the left contact member 23b (contact member). The holding claw 311b and the distance L1 from the holding claw 321b (fitting body) to be fitted to the holding holes 218 and 238 (fixed portions) can be changed by two methods, and the degree of freedom of change can be changed. Can be increased.

D. Variations:
In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. Good. In addition, the following modifications are possible.

・ Modification 1:
In the said embodiment, it illustrated about the structure of the head mounted display. However, the configuration of the head-mounted display can be arbitrarily determined without departing from the gist of the present invention. For example, each component can be added, deleted, converted, and the like.

  In the above embodiment, for convenience of explanation, the control unit includes a transmission unit, and the image display unit includes a reception unit. However, each of the transmission unit and the reception unit of the above-described embodiment has a function capable of bidirectional communication, and can function as a transmission / reception unit.

  For example, the connection unit may be omitted, and the control unit and the image display unit may be configured to perform wireless communication. Specifically, the control unit further includes a first wireless communication unit, and the image display unit further includes a second wireless communication unit and a power source. In this case, the first wireless communication unit functions as a transmission unit in the embodiment, and the second wireless communication unit functions as a reception unit in the embodiment.

  For example, the configurations of the control unit and the image display unit can be arbitrarily changed. Specifically, for example, the touch pad may be omitted from the control unit, and the operation may be performed using only the cross key. Further, the control unit may be provided with another operation interface such as an operation stick. Moreover, it is good also as what receives an input from a keyboard or a mouse | mouth as a structure which can connect devices, such as a keyboard and a mouse | mouth, to a control part. In addition, a communication unit using Wi-Fi (wireless fidelity) or the like may be provided in the control unit.

  For example, the control unit is assumed to be connected to the image display unit via a wired signal transmission path. However, the control unit and the image display unit may be connected by a connection via a wireless signal transmission path such as a wireless LAN, infrared communication, or Bluetooth (registered trademark).

  For example, the head mounted display is a binocular transmissive head mounted display, but may be a monocular head mounted display. Further, it may be configured as a non-transmissive head mounted display in which the transmission of the outside scene is blocked when the user wears the head mounted display.

  FIG. 17 is an explanatory diagram showing an external configuration of a head-mounted display in a modified example. In the example of FIG. 17A, the difference from the head-mounted display HM shown in FIG. 1 is that the image display unit 20c includes a right optical image display unit 26c instead of the right optical image display unit 26. Instead of the left optical image display unit 28, a left optical image display unit 28c is provided. The right optical image display unit 26c is formed smaller than the optical member of the first embodiment, and is disposed obliquely above the right eye of the user when the head mounted display is mounted. Similarly, the left optical image display unit 28c is formed smaller than the optical member of the first embodiment, and is disposed obliquely above the left eye of the user when the head mounted display is mounted. In the example of FIG. 17B, the difference from the head mounted display HM shown in FIG. 1 is that the image display unit 20d includes a right optical image display unit 26d instead of the right optical image display unit 26, and Instead of the left optical image display unit 28, a left optical image display unit 28d is provided. The right optical image display unit 26d is formed smaller than the optical member of the first embodiment, and is disposed obliquely below the right eye of the user when the head mounted display is mounted. The left optical image display unit 28d is formed smaller than the optical member of the first embodiment, and is disposed obliquely below the left eye of the user when the head mounted display is mounted. Thus, it is sufficient that the optical image display unit is disposed in the vicinity of the user's eyes. The size of the optical member forming the optical image display unit is also arbitrary, and the optical image display unit covers only a part of the user's eye, in other words, the optical image display unit completely covers the user's eye. It can also be realized as an unmounted head mounted display.

  For example, functional units such as an image processing unit, a display control unit, a detection unit, a sound processing unit, and an output control unit are realized by a CPU developing and executing a computer program stored in a ROM or a hard disk on the RAM. It was described as a thing. However, these functional units may be configured using an ASIC (Application Specific Integrated Circuit) designed to realize the function.

  For example, in the above-described embodiment, it is assumed that the image display unit is a head mounted display that is mounted like glasses, but the image display unit is a normal flat display device (liquid crystal display device, plasma display device, organic EL display device, etc. ). Also in this case, the connection between the control unit and the image display unit may be a connection via a wired signal transmission path or a connection via a wireless signal transmission path. If it does in this way, a control part can also be utilized as a remote control of a usual flat type display device.

  Further, as the image display unit, instead of the image display unit worn like glasses, an image display unit of another shape such as an image display unit worn like a hat may be adopted. Further, the earphone may be an ear-hook type or a headband type, or may be omitted. Further, for example, it may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet.

  For example, in the above-described embodiment, the secondary battery is used as the power source. However, the power source is not limited to the secondary battery, and various batteries can be used. For example, a primary battery, a fuel cell, a solar cell, a thermal cell, or the like may be used.

  For example, in the above embodiment, the image light generation unit is configured using a backlight, a backlight control unit, an LCD, and an LCD control unit. However, the above aspect is merely an example. The image light generation unit may include a configuration unit for realizing another method together with or in place of these configuration units.

  For example, the image light generation unit may include an organic EL (Organic Electro-Luminescence) display and an organic EL control unit. Further, for example, the present invention can be applied to a laser retinal projection type head-mounted display device.

  In the above embodiment, the image processing unit outputs the same image data as right-eye image data and left-eye image data. However, the image processing unit may be configured to allow the user to visually recognize a 3D virtual image by using different image data for the right eye image data and the left eye image data.

Modification 2
In the said embodiment, an example of the mode setting table and the area correspondence table was shown. However, the details of each table in the above embodiment are merely examples, and various changes can be made.

  For example, the mode setting table and the area correspondence table are predetermined and stored in the storage unit including the contents of each entry. However, the contents of the entries in the mode setting table and the area correspondence table may be configured so that the user of the head mounted display can newly create and change according to his / her preference.

  For example, it is possible to add, delete, and change fields in the mode setting table and the area correspondence table. Specifically, for example, a mode field for distortion that represents the degree of distortion of the audio signal is provided for the mode setting table, and the distortion rate can be controlled in addition to the volume and frequency characteristics. You can also

・ Modification 3:
In the said embodiment, an example of the speaker control process and the change detection process was shown. However, the processing procedures shown in FIGS. 9 to 11 are merely examples, and various modifications can be made. For example, some steps may be omitted, and other steps may be added. Further, the order of the steps to be executed may be changed.

For example, in step S14, by using the area correspondence table, the sound reproduction mode of the speaker is determined based on the position of the holding hole where the speaker is fixed. However, it is also possible to determine the speaker audio playback mode without using the area correspondence table. For example, it can be realized by the following methods (1) to (3). Moreover, you may use together the method of the said embodiment using an area corresponding | compatible table, and the following methods (1)-(3).
(1) At least one of the plurality of holding holes is predetermined as a “basic position”. Then, the sound reproduction mode of the speaker is determined according to the distance between the position of the holding hole where the speaker is currently fixed and the basic position.
(2) A pressure sensor is incorporated in the holding hole instead of a sensor that detects that a roller or a gripping claw is fitted in the holding hole. Then, the sound reproduction mode of the speaker is determined according to the detection value of the pressure sensor.
(3) A current position acquisition means such as GPS (Global Positioning System) is provided in the head mounted display. Then, the moving speed of the user wearing the head mounted display is obtained using the current position acquisition means, and the sound reproduction mode of the speaker is determined according to the obtained moving speed.

  For example, in addition to the determined audio playback mode of the speaker, the output control unit can satisfy various conditions such as the type of content being played back, the surrounding environmental sound, the presence / absence of instructions from the user, and the analysis result of the content. Based on this, the transmission of electrical signals to the speakers can be controlled.

  The speaker control process and the change detection process are executed independently for the right speaker of the right contact member and the left speaker of the left contact member. For this reason, for example, a method of using one speaker in contact with the ear and separating the other speaker from the ear is also possible. In this case, the audio playback modes for both speakers are different modes.

-Modification 4:
In the said embodiment, an example of the structure of the holding hole provided in a contact member and a sounding body was shown. However, the configuration of the holding hole and the sounding body can be arbitrarily determined without departing from the gist of the present invention, and for example, each component can be added, deleted, converted, or the like.

  For example, instead of a speaker, an earphone, a piezoelectric element, a bone conduction unit, or the like may be employed as a sounding body.

  For example, in the second embodiment, the configuration in which the sub speakers are provided in addition to the left and right speakers has been described. However, the sub-speaker can also be provided in the head mounted display of the first embodiment or the third embodiment. Further, the position where the sub-speaker is provided, the nature of the sub-speaker, and the like can be arbitrarily changed. For example, a bone conduction unit may be adopted as the sub speaker.

  For example, the speaker of 1st Embodiment illustrated the roller with magnetic force as a fitting body fitted to the fixing | fixed part of a contact member. Moreover, the speaker of 2nd, 3rd embodiment illustrated the grip nail which has a circular board as a fitting body fitted to the fixing | fixed part of a contact member. However, these are merely examples, and an arbitrary configuration can be adopted for the fixing portion formed on the contact member and the fitting body of the speaker.

-Modification 5:
The present invention is not limited to the above-described embodiments, examples, and modifications, and can be realized with various configurations without departing from the spirit thereof. For example, the technical features in the embodiments, examples, and modifications corresponding to the technical features in each embodiment described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the above-described effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

10. Control unit (controller)
DESCRIPTION OF SYMBOLS 12 ... Illuminating part 14 ... Touch pad 16 ... Cross key 18 ... Power switch 19 ... Volume control button 20 ... Image display part 21 ... Right contact member (contact member)
21x: Front abutting member 21y ... Back abutting member 21z ... Connecting portion 22 ... Right display driving portion 23 ... Left abutting member (abutting member)
23x: Front abutting member 23y ... Back abutting member 23z ... Connecting portion 24 ... Left display driving portion 26 ... Right optical image display portion (optical member)
28: Left optical image display unit (optical member)
DESCRIPTION OF SYMBOLS 40 ... Connection part 42 ... Right code 44 ... Left code 46 ... Connecting member 48 ... Main body code 51 ... Transmission part 52 ... Transmission part 53 ... Reception part 54 ... Reception part 110 ... Input information acquisition part 120 ... Storage part 122 ... Mode setting Table 124 ... Area correspondence table 130 ... Power supply 140 ... CPU
DESCRIPTION OF SYMBOLS 142 ... Detection part 160 ... Image processing part 170 ... Audio | voice processing part 171 ... Output control part 180 ... Interface 190 ... Display control part 201 ... Right backlight control part (image light generation part)
202 ... Left backlight control unit (image light generation unit)
211 ... Right LCD controller (display element, image light generator)
212 ... Left LCD controller (display element, image light generator)
210 ... Holding hole (fixing part)
213 ... Holding hole (fixing part)
214 ... Holding hole (fixing part)
218 ... Holding hole (fixed part)
221 ... Right backlight (image light generator)
222: Left backlight (image light generator)
230 ... Holding hole (fixing part)
232 ... Sensor 233 ... Holding hole (fixed part)
234 ... Holding hole (fixing part)
235 ... sensor 236 ... sensor 238 ... holding hole (fixed part)
241 ... Right LCD (display element, image light generator)
242 ... Left LCD (display element, image light generator)
251 ... Right projection optical system (light guide unit)
252 ... Left projection optical system (light guide)
261 ... Right light guide plate (light guide part)
262 ... Left light guide plate (light guide part)
310 ... Right speaker (sounding body)
311 ... Ball (fitting body)
311a: Holding claw (fitting body)
311b ... gripping claws (fitting body)
313 ... Main body 320 ... Left speaker (sound generator)
321 ... Ball (fitting body)
321a: gripping claw (fitting body)
321b ... gripping claw (fitting body)
322 ... Elastic body 323 ... Main body 324 ... Cushion 325 ... Protective cover 330 ... Right speaker (sounding body)
340 ... Left speaker (sounding body)
351 ... Right sub-speaker 352 ... Left sub-speaker 356 ... Infrared sensor 360 ... Right speaker (sounding body)
370 ... Left speaker (sounding body)
371 ... cord (distance adjustment part)
372 ... Winding part (distance adjusting part)
373 ... Body 374 ... Cushion 375 ... Protective cover 2120 ... Sensor PCLK ... Clock signal VSync ... Vertical sync signal HSync ... Horizontal sync signal Data ... Image data Data1 ... Right eye image data Data2 ... Left eye image data OA ... External equipment SC ... Outside view VI ... Virtual image IL ... Illumination light PL ... Image light VR ... Field of view EL, ER ... End L1 ... Distance SP ... End EP ... End HM, HMa ... Head-mounted display device (head mounted display)
PC ... Personal computer

Claims (8)

A head-mounted display device,
An optical member disposed in the vicinity of the user's eye in a mounted state in which the head-mounted display device is mounted on the user's head;
Pronunciation body,
A contact member that extends from the optical member and is disposed along the head of the user;
A plurality of fixing portions arranged on a surface of the abutting member facing the head, and capable of fixing the sounding body at different positions;
An output control unit for controlling the volume of the sounding body according to a position where the sounding body is fixed on the surface ;
A head-mounted display device comprising: A head-mounted display device,
An optical member disposed in the vicinity of the user's eye in a mounted state in which the head-mounted display device is mounted on the user's head;
Pronunciation body,
A contact member that extends from the optical member and is disposed along the head of the user;
A plurality of fixing portions arranged on the contact member and capable of fixing the sounding body at different positions;
An output control unit for controlling the volume of the sounding body according to a position where the sounding body is fixed;
Equipped with a,
The output control unit further includes:
A head-mounted display device that controls output frequency characteristics of the sounding body in accordance with a position where the sounding body is fixed . The head-mounted display device according to claim 1 or 2,
At least one of the plurality of fixing portions is disposed inside the contact member and at a position facing the user's ear in the wearing state,
At least one of the plurality of fixing portions is a head-mounted display device that is disposed inside the contact member and at a position away from the user's ear in the wearing state. The head-mounted display device according to any one of claims 1 to 3,
The plurality of fixing portions are arranged at a portion located at the vertex of the polygon when the polygon is virtually spread with respect to the inside of the contact member,
The head mounted display device, wherein the sounding body includes a fitting body that fixes the sounding body to the abutting member by being fitted to at least one of the plurality of fixing portions. The head-mounted display device according to any one of claims 1 to 3,
The plurality of fixing portions are arranged on a straight line extending in a longitudinal direction of the contact member with respect to the inside of the contact member,
The sounding body is a fitting body that fixes the sounding body to the abutting member by fitting into one of the plurality of fixing portions, and the sounding body is rotated about the fitting body. A head-mounted display device comprising a fitting body that can be held. The head-mounted display device according to any one of claims 1 to 3,
The contact member further includes:
An ear hook disposed on the inner side of the contact member and hung on the user's ear;
The plurality of fixing portions are arranged at regular intervals between one end portion in the longitudinal direction of the ear hook and the other end portion,
The head mounted display device, wherein the sounding body includes a fitting body that fixes the sounding body to the abutting member by being fitted to one of the plurality of fixing portions. The head-mounted display device according to claim 6,
The sounding body further comprises:
A head-mounted display device including a distance adjusting unit that makes a distance between the fitting body and the sounding body variable. The head-mounted display device according to any one of claims 4 to 7,
A head-mounted display device in which a sensor for detecting whether or not the fitting body is fitted to each of the fixed portions is incorporated in each of the plurality of fixed portions.

Images