JP2022108012A - Head-mounted device - Google Patents

Abstract

To provide a head-mounted device which can increase visual information provided to a user for a peripheral visual field outside an effective visual field.SOLUTION: In a head-mounted device 10 according to an embodiment, since a front right image is displayed on a right side region of a front display among images captured by wide-angle cameras 22, 26 of a front camera 20 on a sight line of front view and a front left image is displayed on a left side region of the front display, a user M can view the front right image and the front left image within a range equivalent to the visual field of both eyes via the front camera 20, also, since a right side image and a left side image captured by fisheye cameras 32, 36 of a lateral camera 30 in a lateral visual field of both eyes are displayed on a right side display 51 of the right eye and a left side display 52 of the left eye, the user M can visually recognize the image of the lateral visual field of both eyes, therefore, visual information provided to the user M for the peripheral visual field outside the effective visual field can be increased.SELECTED DRAWING: Figure 1

Description

The present invention relates to a head-mounted device worn on the head of a user.

As a head-mounted device that is worn on the head of a user, for example, there is a "head-mounted display device" disclosed in Patent Document 1 below. Devices of this type are used, for example, as xR goggles, xR glasses (xR glasses), and the like. xR is a general term for virtual reality, augmented reality, mixed reality, and the like. For example, AR goggles superimpose "some other information" on the actual scenery or the like that the user wearing the goggles actually sees and project it in the field of view of the user. As a result, the user can see the actual scenery as if there were a "signboard displaying additional information (such as place names and building names)" or the like in the scenery that the user actually sees. becomes possible.

In such AR goggles, for example, an optical transmission type that displays additional information superimposed on a real scene transmitted through a half-mirror type liquid crystal display, or a video image taken from the user's viewpoint and additional information There is a video transmissive type that synthesizes and displays on a liquid crystal display. In the "head-mounted display device" of Patent Document 1 below, in the latter video transmissive type, a wide-angle lens with a wider angle of view than a standard lens is used, and the distortion aberration of the wide-angle lens is corrected to enable stereoscopic viewing. do. This solves the problem that the field of view becomes narrower when wearing AR goggles or the like than when not wearing them.

JP 2011-205358 A

By the way, it is said that humans (hereinafter referred to as “humans”) can see with both eyes in a range of about 100 to 110 degrees (total range of about 200 degrees) without moving their eyeballs. there is Within this range, the area where visual acuity is particularly high and fine objects can be seen is called "central vision", and the other area where visual acuity is low is called "peripheral vision". In addition, in the peripheral range of the central visual field (range of about 30 degrees to the left and right), an area in which objects can be recognized almost clearly is called an "effective visual field" (the same applies hereinafter).

Most of the conventional head-mounted devices disclosed in the above-mentioned Patent Document 1 and the like solve the technical problems related to the image projected in such an effective field of view. There are few technologies for projecting images even in the peripheral vision. Therefore, when the user of the head-mounted device needs visual information about the peripheral vision in the vicinity of the side (temporal direction) of the user, it cannot be sufficiently provided to the user. There was a problem.

For example, when working with chemical substances such as chemicals, working with laser equipment that emits laser light, arc welding work, etc., protective goggles and light-shielding glasses ( Light-shielding glasses) are often used. In these situations, the worker needs to pay attention not only to the front of himself but also to the left and right sides of the work. In other words, during work, visual information is required around the effective visual field as well.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a head-mounted device capable of increasing visual information provided to the user regarding peripheral vision outside the effective field of view. .

In order to achieve the above object, the technical means of claim 1 described in the scope of claims are adopted. According to this means, the invention of the head-mounted device according to claim 1 comprises a right imaging section, a left imaging section, an image processing section, a first display section, a second display section, and a front lens section.

The right imaging unit captures an image of the right front field of view at a predetermined angle of view on the line of sight of the right eye in the front view of the user, and also captures the lateral field of view and the lower field of view of the right eye. An image processing unit that captures an image of the left front field of view at a predetermined angle of view on the line of sight of the left eye in front view, captures images of the lateral field of view and the lower field of view of the left eye, and receives the captured images, A predetermined range of the front right image, a predetermined range of the right side image, a predetermined range of the front left image, and a predetermined range of the left side image are output to the first display unit, and another range located below the range of the right side image is displayed. A lower left image in a separate area located below the lower right image and the left image is output to the second display unit. The first display section has a front display range, a right side display range, and a left side display range. In the first display section, the front display range including the right area facing the user's right eye and the left area facing the left eye is positioned so as to face both eyes of the user. When input, the front right image is displayed in the right area and the front left image is displayed in the left area. In addition, the right side display range located in front of the right side of the right eye displays the input right side image, and the left side display range located in front of the left side of the left eye displays the input left side image. In addition, when the lower right image and the lower left image are input, the second display unit, which has a right area that can face the right eye and a left area that can face the left eye, receives the right side area and the left side area. The lower image is displayed in the right area and the lower left image is displayed in the left area. The front lens unit positioned at a predetermined distance in the direction of both eyes from the front display unit optically aligns the range equivalent to the field of view of the right eye with the right side area and optically matches the range equivalent to the field of view of the left eye with the left side area. match the

As a result, the user wearing the head-mounted device on his or her head can view an image (for example, an image within the effective field of view) captured at a predetermined angle of view on the line of sight of the front view. In the display range, the front right image of a predetermined range is displayed in the right area facing the right eye, and the front left image of the predetermined range is displayed in the left area facing the left eye. It becomes possible to see the image and the front left image in the respective fields of view of both eyes. In addition, the right side image is displayed in the right side display range of the first display section positioned in front of the right side of the right eye, and the left side image is displayed in the left side display range of the first display section positioned in front of the left side of the left eye. Since it is displayed, the user can visually recognize the images of the side vision of each eye (the images of the peripheral vision outside the effective visual field). Further, the user can display the lower right image of a predetermined range on the second display unit from among the images captured at a predetermined angle of view (for example, the image within the effective field of view) on the line of sight of the front view. It is displayed in the right area that can face the eye, and the lower left image of a predetermined range is displayed in the left area that can face the left eye.

In the invention of the head-mounted device according to claim 1, the concept of the first display section and the second display section is that the display area of the same display section is configured to be different, and the display that is the first display section A case may be included in which the regions face the user's eyes and the display region, which is the second display unit, is located below the user's eyes. The concept of the first display unit consists of a right front display unit that displays the front right image facing the right eye and a left front display unit that displays the front left image facing the left eye. can include cases where The concept of the second display section includes a lower right display section that can face the right eye and displays the lower right image, and a lower left display section that can face the left eye and displays the lower left image. . Furthermore, the concept of the right imaging section and the left imaging section may include the case where they are aggregated and configured as one imaging section.

Moreover, in order to achieve the above object, the technical means of claim 2 described in the claims are adopted. According to this means, in the invention of the head mounted device according to claim 2, the right front imaging section, the left front imaging section, the right side imaging section, the left side imaging section, the front image processing section, the right side image processing section, the left side It has an image processing section, a front display section, a right side display section, a left side display section, and a front lens section.

The front right imaging section captures an image of the front right field of view at a predetermined angle of view on the line of sight of the right eye in front view of the user, and the front left imaging section captures a predetermined angle on the line of sight of the left eye in front view of the user. The front image processing unit captures images of the left front field of view at the angle of view, and receives the captured images, and outputs a predetermined range of the front right image and a predetermined range of the front left image to the front display unit. When the front right image and the front left image are input to the front display unit, the front display unit is positioned facing both eyes of the user and has a right area facing the right eye and a left area facing the left eye. , the front right image is displayed in the right area and the front left image is displayed in the left area. In addition, the front lens unit positioned at a predetermined distance in the direction of both eyes from the front display unit optically aligns the range equivalent to the field of view of the right eye with the right side area, and optically matches the range equivalent to the field of view of the left eye with the left side area. match the Also, the right side image capturing section captures an image of the side visual field of the user's right eye, and the right side image processing section to which the image is input outputs a right side image of a predetermined range. Then, the right side display section positioned in front of the right eye displays the right side image input from the right side image processing section. Further, the left side imaging section picks up the side visual field of the user's left eye, and the left side image processing section to which the image is input outputs a left side image of a predetermined range. The left side display section positioned in front of the left eye displays the left side image input from the left side image processing section.

As a result, the user wearing the head-mounted device on the head can view the front right image in a predetermined range from among the images captured at a predetermined angle of view (for example, the image within the effective field of view) on the line of sight of the front view. is displayed in the right area facing the right eye, and a predetermined range of the front left image is displayed in the left area facing the left eye. It becomes possible to see in the range equivalent to the field of view of . In addition, an image captured in the side field of view of the user's right eye is displayed on the right side display unit positioned in front of the right eye, and an image captured in the side field of view of the user's left eye is displayed on the left side. Since it is displayed on the left side display part located in front of the left side of the eye, the user can visually recognize the image of the side vision of each eye (the image of the peripheral vision outside the effective field of view). be possible.

In the invention of the head-mounted device according to claim 2, the concept of the front display section, the right side display section and the left side display section is that the same display section is configured to have different display areas. the display area facing the user's both eyes, the display area serving as the right side display area facing the user's right eye, and the display area serving as the left side display area facing the user's left eye respectively to the left of . The concept of the front display section consists of two parts: a right front display section that faces the right eye and displays the front right image, and a left front display section that faces the left eye and displays the front left image. can include cases where Also, the concepts of the front right imaging section and the front left imaging section may include the case where they are aggregated and configured as one front imaging section. Furthermore, the concepts of the front image processing unit, the right side image processing unit, and the left side image processing unit can be combined into one image processing unit and another image processing unit by combining two of them, or by combining three of them into one image processing unit. It may include a case where it is configured as an image processing unit. In addition, in each of the head-mounted device inventions according to claim 1 and claim 2, the concept of the front lens section includes a front right lens section that optically matches the field equivalent range of the right eye to the right side area, and a front lens section for the left eye. and a left front lens portion that optically aligns the field equivalent range of the left side region with the left side region.

Also, the technical means of claim 3 described in the scope of claims is adopted. According to this means, the invention of the head-mounted device according to claim 3 further comprises a lower display section positioned facing downward from both eyes, and the angle of view of the right side imaging section is greater than the angle of view of the right front imaging section. Also, the angle of view of the left side imaging section is larger than the angle of view of the left front imaging section. For example, when the right front imaging section and left front imaging section are cameras each having a wide-angle lens, the right side imaging section and left side imaging section are cameras each having a fisheye lens. Then, the right side image processing section outputs the right side image among the images acquired from the right side imaging section to the right side display section, and the left side image processing section outputs the left side image among the images acquired from the left side imaging section. The image is output to the left side display section.

As a result, compared to the case where the right side imaging section and the left side imaging section do not have such an angle of view and have the same angle of view as the right front imaging section and the left front imaging section, the lateral field of vision of both eyes is reduced. Since it is possible to capture a wide-angle image, it is possible to display the right side image and the left side image captured in a wide range on the right side display section and the left side display section, respectively. Further, the right side image processing section outputs a lower right side image of another range located below the predetermined range of the right side image to the right side area of the lower display section, and the left side image processing section outputs the predetermined range of the left side image. A lower left image in another range located below is output to the left area of the lower display unit. As a result, among the wide-angle images captured in the side visual field of both eyes by the right side imaging section and the left side imaging section, the image captured in the lower right visual field of the user's right eye and the lower left visual field of the left eye. can also be displayed on the lower display portion located below both eyes. The concept of the lower display section is divided into a lower right display section that displays the lower right image corresponding to the right side area and a lower left display section that displays the lower left image corresponding to the left side area. It can include the case where it is configured. Further, in the concept of the front display section and the lower display section, the same display section is configured to have different display areas, and the display area, which is the front display section, faces both eyes of the user and the lower display section. It may include the case where the display areas, which are parts, are positioned below both eyes of the user.

Also, the technical means of claim 4 described in the scope of claims is adopted. According to this means, in the invention of the head-mounted device according to claim 4, the right front imaging section has a view angle θ _R2 of the lower part of the right front field of view rather than the angle of view θ _R1 of the upper part of the right front field of view. is large. Further, in the left front imaging section, the angle of view θ _L2 of the lower portion of the left front field of view is larger than the angle of view θ _L1 of the upper portion of the left front field of view. As a result, since the range that can be imaged by the front right imaging section and the front left imaging section is wider than the top, the range that can be imaged by the front right imaging section and the front left imaging section is the line of sight of the front view. On the other hand, the lower field of view is wider than the upper field of view, and is closer to the human visual field. In addition, the front display part has an upward eccentric position determined by a distance obtained by F × tan θ _R1 and a distance obtained by F × tan θ _R2 with respect to the vertical width of the front display part, and when viewed from the front by the user. The position where the line of sight of the right eye intersects, and the eccentric position in the upward direction determined by the distance obtained by F×tan θ _L1 and the distance obtained by F×tan θ _L2 with respect to the vertical width of the front display part and the front of the user It is arranged so that it intersects with the line of sight of the left eye in vision. Note that F represents the separation distance between the front lens portion and the front display portion. As a result, at a position where the front lens unit is focused, the front display unit is arranged so that the display range of the lower display unit is wider than that of the upper display unit with respect to the vertical direction of the front display unit. In the image display of , the field of view is close to that of the human naked eye (the lower field of view is wider than the upper field of view with respect to the line of sight of the front view). The right front imaging section is positioned on the line of sight of the user's right eye in front view, and the left front imaging section is positioned on the line of sight of the user's left eye in front view. As a result, in the vertical direction, the height positions of the right front imaging section and the left front imaging section match the height positions of both eyes of the user. Therefore, it is possible to bring the imaging range of the right front imaging section and the left front imaging section closer to the field of view of both eyes that a person can see naturally.

Also, the technical means of claim 5 described in the scope of claims is adopted. According to this means, in the invention of the head-mounted device according to claim 5, the right side imaging section is positioned to the right of the lower end of the front display section, and the front field of view of the right side imaging section is wider than the angle of view of the left side portion. The angle of view of the right portion is larger, and the angle of view of the lower portion is larger than that of the upper portion. In addition, the left side imaging section is positioned on the left side of the lower end of the front display section. The angle of view of the lower portion of the front field of view is larger than the angle of view. As a result, the range that can be imaged by the right side imaging section is wider on the right side than on the left side, so the range that can be captured by the right side imaging section is made closer to the field of view that can be seen when the eyeball moves to the right. becomes possible. In addition, since the range that can be imaged by the left imaging section is wider on the left side than on the right side, it is possible to make the imaging range of the left imaging section closer to the field of view that can be seen when the eyeball moves to the left. be possible.

Also, the technical means of claim 6 described in the scope of claims is adopted. According to this means, in the invention of the head-mounted device according to claim 6, the front lens section includes an aspherical lens positioned in front of each eye, a flat lens positioned around the aspherical lens, have As a result, the user can see the front right image and the front left image displayed on the front display section through the aspherical lens in the central visual field located in the center of the effective visual field. In the peripherally located effective field of view, it becomes possible to see through a plane lens. In addition, since the planar lens is thinner than the aspherical lens, it is lightweight, and it is possible to reduce the weight of the front lens portion. The flat lens corresponds to, for example, a Fresnel lens or a part of an aspherical lens having a curvature larger than that of "an aspherical lens positioned in front of each eye".

Also, the technical means of claim 7 described in the scope of claims is adopted. According to this means, in the invention of the head-mounted device according to claim 7, the right side lens portion is positioned at a predetermined separation distance from the right side display portion in the direction of the right eye, and the left side display portion is positioned in the direction of the left eye. a left lateral lens portion positioned at a predetermined separation distance. The right side lens portion and the left side lens portion are flat lenses. As a result, in the peripheral vision of the user, the right side image displayed on the right side display section and the left side image displayed on the left side display section can be viewed through the flat lenses of the right side lens section and the left side lens section. It becomes possible to see In other words, in the peripheral field of vision, which has low visual acuity compared to the central field of view and the effective field of view, it is sufficient to view objects with vague (soft) outlines, so compared to aspherical lenses that can view objects with clear outlines. Plano lenses with soft contours are more suitable because they are less visually stimulating. The flat lens corresponds to, for example, a Fresnel lens or a part of an aspherical lens having a curvature larger than that of "an aspherical lens positioned in front of each eye".

According to the invention of claim 1, the user can see the front right image and the front left image in the respective visual field equivalent ranges of both eyes via the front lens section as images within the effective field of view. In addition, as images of the peripheral vision outside the effective field of view, it is possible to visually recognize the images of the side vision of each eye and the images of the lower vision of each eye. Become. Therefore, it is possible to increase the visual information provided to the user regarding the peripheral vision outside the effective visual field.

According to the invention of claim 2, the user can see the front right image and the front left image through the front lens portion as images within the effective field of view in respective visual field equivalent ranges of both eyes. In addition, it is possible to visually recognize images in the side visual fields of both eyes as images in the peripheral visual field outside the effective visual field. Therefore, it is possible to increase the visual information provided to the user regarding the peripheral vision outside the effective visual field.

In the third aspect of the invention, it is possible to display the right side image and the left side image captured in a wide range on the right side display section and the left side display section, respectively. In addition, it is possible to display an image captured in the lower right visual field of the user's right eye and the lower left visual field of the left eye on the lower display unit. Therefore, the user can also obtain visual information about his/her own feet, so that the visual information provided to the user regarding peripheral vision outside the effective visual field can be further increased.

According to the fourth aspect of the invention, it is possible to bring the imageable range of the right front imaging section and the left front imaging section closer to the field of view that humans can naturally see (the lower field of view is wider than the upper field of view). Therefore, the unnatural appearance within the effective field of view is suppressed, so that the user is less likely to feel discomfort.

In the fifth aspect of the invention, the imaging range of the right side imaging section is brought closer to the field of view that can be seen when the eyeball moves to the right side, and the imaging range of the left side imaging section is closer to the field of view that can be seen when the eyeball moves to the left side. It becomes possible to bring it closer to the field of view that can be seen. Therefore, it is possible to increase the visual information provided to the user even in the peripheral vision when the human eye moves left and right.

According to the invention of claim 6, the user can see the front right image and the front left image through the aspherical lens in the central visual field, and through the plane lens in the effective visual field. . Also, it becomes possible to lighten the front lens portion. Therefore, it is possible to visually recognize objects with sharp outlines in the central visual field that can be fixed, and to visually recognize objects with unclear (soft) outlines in the effective visual field around the central visual field that can be roughly grasped. can. Also, the weight of the head-mounted device can be reduced.

In the invention according to claim 7, the user can view the right side image displayed on the right side display section and the left side image displayed on the left side display section in the peripheral vision of the right side lens section and the left side lens section. It becomes possible to see through a plane lens. Therefore, in the peripheral vision, soft contours are visible, so visual stimulation is reduced and the eyes are less likely to get tired.

It is a perspective view showing an example of composition of a head mount device concerning one embodiment of the present invention. Fig. 2(A) is a diagram showing a configuration example of the head-mounted device of the present embodiment, Fig. 2(A) is a rear view seen from the user's side, Fig. 2(B) is taken along line 2B-2B shown in Fig. 2(A); Cross-sectional view, FIG. 2(C) is a cross-sectional view taken along line 2C-2C shown in FIG. 2(A). It is explanatory drawing which shows the example of the attachment or detachment structure, such as a front camera which comprises the head mounted device of this embodiment. Fig. 3(A) shows an example of the configuration of the back of the front right camera unit or the front left camera unit, Fig. 3(B) shows an example of the configuration of the mounting part of the front camera (front panel of the head-mounted device), and Fig. 3(C) It is an example of the correspondence of a front camera and an attachment part. It is a block diagram showing an example of an electrical configuration of the head mounted device of the present embodiment. It is a figure which shows the structural example of the head mounted device of this embodiment, FIG. 5(A) is explanatory drawing in a horizontal direction, FIG.5(B) is explanatory drawing in a vertical direction. FIG. 3 is an explanatory diagram showing correspondences and the like between images taken by a front camera and a side camera that constitute the head-mounted device of the present embodiment and respective displays that display those images. Fig. 6(A) is the imaging range of the front left camera unit (wide-angle camera), Fig. 6(B) is the imaging range of the front right camera unit (wide-angle camera), Fig. 6(C) is the left side camera unit (fisheye) 6(D) is the imaging range of the side right camera unit (fisheye camera), and FIG. 6(E) is the display range of each display. FIG. 7(A) is an explanatory diagram showing the layout of a certain room and the user of the head-mounted device standing in the center of it, and FIG. 7(B) is an image of an example of each display seen by the user. It is an explanatory diagram of 8(A) is an explanatory diagram showing a schematic configuration example of the variable mechanism of the modification, and FIGS. FIG. 5 is an explanatory diagram showing an operation example of a variable mechanism;

Embodiments of the head-mounted device of the present invention will be described below with reference to the drawings. First, the configuration of a head mounted device 10 (hereinafter referred to as "HMD 10") according to an embodiment of the present invention will be described with reference to FIGS. 1 to 6. FIG. Note that the terms “front”, “rear”, “left”, “right”, “upper”, and “lower” may be used as terms in the following description, but the , means front, back, left, right, up, down. In addition, even when simply expressing "user M", it is assumed that the user M is wearing the HMD 10, and "the user M not wearing the HMD 10" is Note that this is not assumed here.

As shown in FIGS. 1 and 2, the HMD 10 of the present embodiment can be used by a user M in situations such as, for example, work handling chemical substances such as chemicals, work handling a laser device that emits laser light, arc welding work, or the like. It is a head-mounted device that is worn on the head H of a person and used as protective goggles or light-shielding glasses (light-shielding glasses). The HMD 10 displays images captured by the front camera 20 and the side cameras 30 on the front display 40, the side display 50, and the lower display 60 for the user M to see. In this embodiment, the HMD 10 includes a housing 11, a headband 19, a front camera 20, a side camera 30, a front display 40, a side display 50, a lower display 60, a lens unit 70, an image processor 80, and the like. there is The driving power for the front camera 20, the side camera 30, the front display 40, the side display 50, the lower display 60, and the image processor 80 is, for example, an external power supply device (portable battery, etc.) carried by the user M. supplied from

The housing 11 holds the front camera 20 and the side camera 30 toward the outside, and accommodates the front display 40, the side display 50, the lower display 60, the lens unit 70, and the image processor 80 inside. is the body. The housing 11 is made of, for example, a synthetic resin (for example, dry carbon) excellent in light shielding properties, rigidity, and light weight, and when viewed from above when attached to the head H, the housing 11 has a "[" (tortoise shell bracket) shape. (See FIGS. 1 and 2(B)). In FIGS. 2, 5 and 8, for convenience of illustration, the displays 40, 50 (right side display 51, left side display 52), 60 (lower right display 61, lower left display 62) are shown. The part corresponding to is colored in gray.

The housing 11 mainly includes a front panel 11a, a side panel 11b, an upper panel 11c, a lower panel 11d, a rear panel 11e, and an inner frame 11f. These panels 11a, 11b, 11c, 11d, and 11e are integrally molded, for example. The front panel 11a is a rectangular plate-like portion that faces the face of the user M, and enables attachment of the front camera 20 and the side camera 30. The front panel 11a includes a side panel 11b, a top panel 11c, a bottom panel 11d, and an inner panel. Together with the frame 11f, an MPU housing chamber 14, which will be described later, can be formed. Since the mounting structure of these cameras 20 and 30 on the front panel 11a will be described later, it will be omitted here. Side panels 11b are connected to both sides of the front panel 11a in the longitudinal direction (horizontal direction).

The two side panels 11b are plate-shaped portions that face each other in the left-right direction and are formed such that the distance between them increases rearward from the front panel 11a. Each of these side panels 11b has a belt passage portion 18b on the outside, and is configured to be capable of forming a display accommodating chamber 15, which will be described later, together with the top panel 11c, the bottom panel 11d, the inner frame 11f, and the lens unit 70 on the inside. ing. An upper panel 11c is connected above the front panel 11a and the side panels 11b, and a lower panel 11d is connected below the front panel 11a and the side panels 11b.

The upper surface panel 11c and the lower surface panel 11d are plate-like portions facing each other in the lateral direction (vertical direction) of the front panel 11a. It forms the accommodation room 14 and the display accommodation room 15 . The front panel 11a has belt loops 18a at two locations apart in the left-right direction on the outside. These belt loops 18a have a role of attaching the headband 19 to the housing 11 in cooperation with the belt loops 18b of the side panel 11b. A notch 13 is formed in the lower panel 11d. This notch 13 has a role of avoiding contact between the user M's nose and the like and the bottom panel 11d.

The back panel 11e is a plate-like part that faces the front panel 11a and can come into contact with the user's M face. The rear panel 11e is formed with a recessed portion and a window portion 12 connected to the notch portion 13 described above. The window part 12 enables the user M to see the front display 40 and the like housed in the housing 11, and is formed in a rectangular shape, for example. In this embodiment, a lens unit 70 is attached inside the window portion 12 . Therefore, the user M can see the screen of the front display 40 or the like through the lens body 71 of the lens unit 70 .

The inner frame 11f separates the MPU accommodating chamber 14 and the display accommodating chamber 15 in the housing 11, and supports (holds) the image processor 80 and the like within the housing 11 by mounting the image processor 80, the front display 40, and the like. It is what you get. The inner frame 11f is formed with unevenness and holes (not shown), and these are used to mount the image processor 80, the front display 40, and the like, and to pass electrical wiring. The inner frame 11f is fixed to the side panel 11b, the top panel 11c, and the bottom panel 11d by screws or an adhesive, for example.

The headband 19 is a head-worn belt capable of maintaining the state in which the HMD 10 is attached to the head H of the user M. It is composed of departments, etc. These belts 19a, 19b, and 19c are made of, for example, a highly durable material with excellent abrasion resistance and heat resistance. Also, the joint portion 19d and the joint portion (not shown) are made of synthetic resin such as PE or ABS, for example. The top belt 19a and the side belts 19c are provided with a length adjusting mechanism (not shown) so that their lengths can be adjusted.

The two top belts 19a are attached at one end to two belt loops 18a of the top panel 11c so as to form an alphabetical "V" shape, and at the other end to one side of the joint 19d. It is connected. Both ends of the side belt 19c are attached to the belt loop portions 18b of the left and right side panels 11b, and a joint portion (not shown) is connected to the intermediate portion thereof. Both ends of the rear belt 19b are connected to the other side of the joint portion 19d and a joint portion (not shown). One end side of the rear belt 19b is connected to the other side of the joint portion 19d, and the other end side is connected to the intermediate portion of the side belt 19c via a joint portion (not shown).

The front camera 20 is composed of a front right camera unit 21 and a front left camera unit 25 . In this embodiment, these camera units 21 and 25 are detachably attached above the front panel 11 a of the housing 11 . Since these camera units 21 and 25 are both configured in the same manner, the front right camera unit 21 will be described as a representative here. From here on, description will be made with reference to FIGS. 3 to 6 as well. Regarding the front left camera unit 25, the reference numerals and the like relating to it are described in parentheses.

As shown in FIGS. 3A and 3C, the front right camera unit 21 (front left camera unit 25) has a base portion 21a (25a) having, for example, a shape combining a rectangle and a semicircle when viewed from the front. A wide-angle camera 22 (26) is provided on the front side of the base portion 21a (25a), and a connector 23 (27) and three magnets 24 (28) are provided on the back side. In this embodiment, the wide-angle camera 22 (26) has an angle of view θAFa (θAFb) set to 90 degrees, for example, and the front right camera unit 21 (front left camera unit 25) is attached to the housing 11. In the state, it is positioned above the line of sight LSa of the right eye of the user M (the line of sight LSb of the left eye), and the optical axis (chain double-dashed line) of the wide-angle lens is set to incline downward by θc ( (See Figures 5(A) and (B)).

In the present embodiment, the tilt angle θc of the optical axis (two-dot chain line) is set at 10 degrees, for example. A survey by the inventors of the present application has revealed that the visual field of humans is about 33 degrees for the upper field of view and about 55 degrees for the lower field of view when viewed with the naked eye. While the upper field of view and the lower field of view of a person are in such a range, the angle of view θAFa (θAFb) of the wide-angle camera 22 is 90 degrees. Therefore, in this embodiment, by tilting the optical axis (two-dot chain line) of the wide-angle camera 22 (26) downward by 10 degrees (=θc), the angle of view (upper angle of view) of the wide-angle camera 22 (26) in the vertical direction The front right camera unit 21 (front left camera unit 25).

In addition, the symbol FVc shown in FIG. 5(B) represents an example of an upper field of view (for example, 60 degrees) in a front view in a vertical field of view (hereinafter referred to as "upper front field of view FVc"). FVd represents an example of a lower field of view (for example, 70 degrees) in front view (hereinafter referred to as "lower front field of view FVd"). It is assumed that the upper front field of view FVc and the lower front field of view FVd appear in the same way for both the right eye and the left eye. In this way, the lower front field of view FVd is larger than the upper front field of view FVc, and it is possible to see almost straight down by moving the eyeball. On the other hand, the upper front field of view FVc is narrower than the lower front field of view FVd, and it is generally easier for people to see their feet below their heads than above their heads. Therefore, in this embodiment, as described above, the optical axes (chain lines) of the wide-angle cameras 22 and 26 of the front camera 20 are directed downward by 10 degrees.

The mounting structure of the camera 20 on the front panel 11a of the housing 11 is configured to be compatible with the connector 23 (27) and the three magnets 24 (28) of the front right camera unit 21 (front left camera unit 25). That is, it has a connector 16 that can be mechanically and electrically connected to the connector 23 (27), and three magnets 17 that can be magnetically attached to the three magnets 24 (28). In this embodiment, the three magnets 17 are positioned at the respective vertices of the isosceles triangle, and the connectors 16 are arranged in parallel outside the base of the isosceles triangle. Therefore, it is possible to accurately position the front right camera unit 21 and the front left camera unit 25 with respect to the connector 16 .

In the present embodiment, the front right camera unit 21 and the front left camera unit 25 that tilt forward at such an inclination angle θc, that is, the front camera 20, are attached to the front panel 11a of the housing 11 (HMD 10) at the lens unit described later. It is determined based on the focal length F of 70 and the angles of view θAFa and θAFb of the wide-angle cameras 22 and 26, and is also related to the vertical width Wh of the front display 40 in the vertical direction (transverse direction). Therefore, after describing the front display 40 and the lens unit 70, the mounting position of the front camera 20 will be described.

The side camera 30 is composed of a side right camera unit 31 and a side left camera unit 35. In the present embodiment, the side camera 30 is located near both lower corners of the front panel 11a of the housing 11 (the side right camera unit 31 is located at the right corner). The left side camera unit 35 is detachably attached near the left corner). These camera units 31 and 35 are similar to the front right camera unit 21 except that the respective cameras 32 and 36 are fisheye cameras and the tilt angle and direction of the optical axis (two-dot chain line) are different. and the front left camera unit 25 .

That is, the base portions 31a, 35a, connectors and magnets constituting the right side camera unit 31 and the left side camera unit 35 are connected to the base portion 21a, the connector 23 and the magnet 24 of the front right camera unit 21, and the front left camera unit. 25, the connector 27, and the magnet 28. As shown in FIG. Therefore, here, the angle of view of the fish-eye camera 32 of the right side camera unit 31 and the fish-eye camera 36 of the left side camera unit 35 and the tilt angle and direction of the optical axis (two-dot chain line) will be described.

The angle of view θASa and θASb of the fisheye camera 32 of the lateral right camera unit 31 and the fisheye camera 36 of the lateral left camera unit 35 are set to 110 degrees, for example. The optical axes (chain lines) of the fish-eye lenses of these fish-eye cameras 32 and 36 are set so as to incline outward (sideways) by θa and θb and downward by θd, respectively. (See FIGS. 5(A) and (B)).

In this embodiment, the tilt angle θa at which the fish-eye camera 32 of the lateral right camera unit 31 faces right outward and the tilt angle θb at which the fish-eye camera 36 of the lateral left camera unit 35 faces left outward are, for example, is set at 35 degrees. In addition, the inclination angle θd at which the fisheye cameras 32 and 36 face downward is also set to 35 degrees. In other words, the fisheye cameras 32 and 36 are set so that their respective optical axes (chain lines) are inclined outward and downward by 35 degrees.

The fisheye cameras 32 and 36 of the present embodiment have angles of view θASa and θASb of 110 degrees in both horizontal and vertical directions. By tilting by 35 degrees, the front angle of view is reduced to 20 degrees (=110 degrees/2-35 degrees), but the right side angle of view is increased to 90 degrees (=110 degrees/2+35 degrees). Also, by tilting 35 degrees downward, the upper angle of view decreases to 20 degrees (=110 degrees/2-35 degrees), but the lower angle of view increases to 90 degrees (=110 degrees/2+35 degrees). .

Similarly, by tilting the fisheye camera 36 of the left side camera unit 35 to the left outside by 35 degrees, the front angle of view is reduced to 20 degrees, but the left side angle of view is increased to 90 degrees. By tilting the camera by 35 degrees, the upper angle of view is reduced to 20 degrees, but the lower angle of view is increased to 90 degrees. Therefore, in this embodiment, the horizontal angle of view of the fisheye cameras 32 and 36 can be widened to the lateral direction (lateral angle of view of 90 degrees) in the outer direction (side), and the vertical angle of view is also downward. As for the direction (downward), the lateral right camera unit 31 and the lateral left camera unit 35 are configured so as to be able to extend to the bottom (downward angle of view of 90 degrees). If it is not necessary to include right beside or right below, it is not necessary to set the angles of view of the fisheye cameras 32 and 36 in this manner.

The symbol FVa shown in FIG. 5(A) represents an example of the effective visual field (for example, 30 degrees) of the right eye including the central visual field CV in front view in the horizontal visual field (hereinafter referred to as "right front The field of view FVa"), and the symbol FVb represents an example of the effective field of view (for example, 30 degrees) of the left eye including the central field of view CV in front view (hereinafter referred to as the "left front field of view FVb"). Note that the central visual field CV is 1.5 degrees in this example. In addition, symbol SVa shown in FIG. SVa"), and the symbol SVb represents an example of peripheral vision outside the effective field of vision (for example, 110 degrees) of the left eye in front view, excluding the effective field of view.

In this embodiment, the front right camera unit 21, the front left camera unit 25, the side right camera unit 31, and the side left camera unit 35 can be easily attached and detached in the front camera 20 and the side cameras 30 that constitute the HMD 10. Because of this configuration, for example, when each of these camera units 21, 25, 31, 35 breaks down, it can be easily replaced with a normal camera unit. Further, by preparing camera units in which the wide-angle cameras 22, 26 and fish-eye cameras 32, 36 of these camera units 21, 25, 31, 35 are replaced with infrared cameras or the like, It can be easily replaced with a camera unit having different functions (for example, an infrared camera unit or a high-sensitivity camera unit).

As shown in FIG. 2, the front display 40 is, for example, a horizontally long rectangular liquid crystal color display panel with dimensions of 15 cm (horizontal)×10.6 cm (vertical), for example. In this embodiment, the front display 40 is housed in the display housing chamber 15 with its longitudinal direction oriented in the left-right direction. Since the interface is compatible with, for example, HDMI, the front display 40 is connected to the CMPU 81 of the image processor 80 to be described later via the HDMI interface. Note that HDMI is a registered trademark (hereinafter the same).

As shown in FIG. 5A, the width (or display range) Ww in the left-right direction (longitudinal direction) of the front display 40 is the distance between the eyes of the user M (for example, 8 cm) or the width of the head H. The width in the horizontal direction (for example, 15 cm) or more is sufficient. Further, as shown in FIG. 5B, the vertical width (or the display range in the vertical direction) Wh in the vertical direction (transverse direction) is from the focal length (predetermined separation distance) F of the lens unit 70 as described later. Any desired value may be used. The front display 40 may be configured using two left and right display panels (for example, a right front display and a left front display) like the lower display 60 .

The side display 50 is composed of a right side display 51 and a left side display 52 . These displays 51 and 52 are liquid crystal color display panels having the same vertically long rectangular shape, and the dimensions are set to 5 cm (horizontal)×10.6 cm (vertical), for example. Since the interface, like the front display 40, is compatible with, for example, HDMI, these displays 51 and 52 are connected to the RMPU 82 and LMPU 83 of the image processor 80 to be described later via the HDMI interface. there is

The right side display 51 is housed in the space on the right side of the front display 40 in the display housing chamber 15 , and the left side display 52 is housed in the space on the left side of the front display 40 in the display housing chamber 15 . That is, these displays 51 and 52 are housed in the display housing chamber 15 so as to be positioned on the left and right sides of the head H of the user M wearing the HMD 10 (see FIG. 5(A)). θk shown in FIG. 5(A) is the inclination angle of the right side display 51 and the left side display 52 with respect to the front-rear direction of the user M (the head H and the side of the face), and is set to 15 degrees, for example. However, these angles θk may be angles (for example, 0 degrees to 45 degrees) that can be visually recognized by the user M based on the display characteristics of the displays 51 and 52 and the like.

The lower display 60 is composed of a lower right display 61 and a lower left display 62 . These displays 61 and 62 are liquid crystal color display panels having the same oblong rectangular shape, and the dimensions are set to 7.5 cm (horizontal)×4 cm (vertical), for example. These displays 61 and 62 are arranged side by side in the longitudinal direction and housed in the bottom space (immediately above the lower panel 11d) of the display housing chamber 15 located below the front display 40 (FIG. 2). (B)).

In this embodiment, the length obtained by connecting the lower right display 61 and the lower left display 62 in the longitudinal direction coincides with the lateral width Ww (15 cm (=7.5 cm+7.5 cm)) of the front display 40 in the lateral direction (longitudinal direction). However, it is appropriately set within a range where the user M can visually recognize the downward direction. In this embodiment, the width of the lower right display 61 and the lower left display 62 in the short direction is set to 4 cm, but any width that can be accommodated between the front display 40 and the lens unit 70 may be used. It should be noted that the lower display 60, like the front display 40, may be configured using a single left and right display panel (for example, the dimensions are 15 cm (horizontal)×4 cm (vertical)). Further, as will be described later, the lower display 60 may not be provided when there is no need to visually recognize the lower part of the user M's feet or the like.

As shown in FIG. 2, lens unit 70 is an optical unit having an optical lens positioned between user M's face and front display 40 . In this embodiment, it is attached to the window portion 12 of the housing 11 and the like so as to be positioned at a predetermined separation distance F from the front display 40 in the direction of both eyes. The lens unit 70 is composed of a lens body 71 and a lens frame 75 that supports (holds) it.

The lens body 71 is composed of a right lens portion 72 that covers a range equivalent to the visual field of the right eye of the user M, and a left lens portion 73 that covers a range equivalent to the visual field of the left eye. The lens portions 72 and 73 are integrally molded. The lens body 71 is generally a horizontally long rectangle and has a thin plate shape having a notch 71a in the shape of an upside-down letter "V" in the center in the longitudinal direction. When viewed from above or below in the up-down direction, it is formed in a katakana "U" shape with rounded corners. The lens body 71 is made of, for example, synthetic resin such as acrylic or polycarbonate. The lens body 71 may have the right lens portion 72 and the left lens portion 73 separately configured.

The right lens portion 72 has a right central portion 72a that can correspond to the effective visual field of the right eye when viewed from the front of the user M, and a right peripheral portion 72b that can correspond to the peripheral and lower visual fields of the right eye's effective visual field when viewed from the front. and a right side portion 72c that can correspond to the side visual field of the user's M right eye. The left lens portion 73 includes a left central portion 73a that can correspond to the effective visual field of the left eye when viewed from the front of the user M, and a left peripheral portion 73a that can correspond to the peripheral and lower visual fields of the left eye when viewed from the front. A portion 73b and a left side portion 73c that can correspond to the side visual field of the user M's left eye.

In the present embodiment, of these lens portions 72 and 73, a right central portion 72a, a right peripheral portion 72b, a left central portion 73a and a left peripheral portion 73b face the front of the user M's face, and a right lateral portion 72c faces the right side of user M's face, and left side 73c faces the left side of user M's face. The right central portion 72a faces the front of the user M's right eye, and the left central portion 73a faces the front of the user M's left eye. It is positioned so that the line of sight LSb of the left eye and the lens axis of the left central portion 73a can coincide. A curved portion of the connecting portion between the right peripheral portion 72b and the right side portion 72c is included in the right side portion 72c. Similarly, the curved portion of the connecting portion between the left peripheral portion 73b and the left side portion 73c is included in the left side portion 73c.

The right central portion 72a and the left central portion 73a are, for example, aspherical lenses, and the cross-sectional shape of the lens portion is configured to be biconvex (convex-convex) or plano-convex. The right central portion 72a and the left central portion 73a are positioned at a focal distance (predetermined separation distance) F from the front display 40, and cover the entire right half of the front display 40 (right side) in a range corresponding to the right front visual field FVa of the right eye. The function of optically matching the area 41 (see FIG. 6(E)) and the range corresponding to the left front visual field FVb of the left eye to the entire left half of the front display 40 (left area 42 (see FIG. 6(E)) reference))).

As shown in FIG. 2(A), in the present embodiment, the front display 40 has a horizontally long rectangular shape. The distance from the front display 40 to the lens body 71 is such that each aspherical lens of the portion 73a can optically match the range corresponding to the right front visual field FVa of the right eye and the range corresponding to the left front visual field FVb of the left eye. A separation distance, that is, a focal length F is set (see FIG. 5(B)).

The right peripheral portion 72b, the right side portion 72c, the left peripheral portion 73b, and the left side portion 73c are, for example, plane lenses. A typical example of a planar lens is a Fresnel lens that is substantially flat and has a thin plate shape, and is sometimes called a paper lens. The planar lens may have a lens shape obtained by slicing the surface of an aspherical lens whose curvature is orders of magnitude larger than the curvature of the lens surfaces of the right central portion 72a and the left central portion 73a. In addition, the right side display 51 that displays the image of the side view of the right eye and the left side display 52 that displays the image of the side view of the left eye are arranged without interposing the right side portion 72c and the left side portion 73c. It may be configured so that the user M can directly see it. Similarly, the lower display 60 that displays the image of the lower field of view of both eyes may also be configured to be directly visible to the user M without going through the right peripheral portion 72b or the left peripheral portion 73b.

The lens frame 75 is fixed to the housing 11 and holds the lens body 71 so that it can be attached to the window 12 of the housing 11 or the like. As described above, the lens body 71 held by the lens frame 75 has a thin plate shape having an oblong rectangular shape as a whole, and when it is attached to the housing 11, its shape when viewed from above or below is a katakana "ko". "" shape with rounded corners.

For this reason, the outer frame portion 76 is a frame that can surround the lens body 71 and is configured to have such a rounded U-shape. In addition, the central portion 77 is connected to the outer frame portion 76 in the shape of an upside-down letter "Y" at approximately the center in the longitudinal direction of the lens body 71 when attached to the housing 11 . there is The recessed portion of the "Y" portion of the central portion 77 corresponds to the notch portion 71a of the lens body 71, so that the periphery of the lens body 71 can be held, and the lens unit 70 itself fits on the nose of the user M. Prevents contact and obstruction.

As shown in FIG. 4, the image processor 80 is composed of a CMPU 81, an RMPU 82 and an LMPU 83 (these MPUs 81, 82 and 83 may be composed of one or two MPUs). These MPUs 81, 82, 83 are mainly composed of a CPU, a GPU, a DSP, a memory, and an input/output interface (HDMI interface, etc.). (See Fig. 2(B)). The CMPU 81 has an input side connected to the wide-angle camera 22 of the front right camera unit 21 and a wide-angle camera 26 of the front left camera unit 25, and an output side HDMI interface to which the front display 40 is connected. Since image data (images) captured by the wide-angle cameras 22 and 26 are input to the CMPU 81, the CMPU 81 performs image processing for cutting out an image of a predetermined range, and then generates a front right image IFa. and the front left image IFb to the front display 40 .

As shown in FIG. 6, for example, when the imaging range 22a of the wide-angle camera 22 is a circular range, a predetermined rectangular range is cut out from within the circular range (see FIG. 6B), The front right image IFa is output to the right area 41 of the front display 40 (see FIG. 6(E)). The same is true for the wide-angle camera 26, which cuts out a predetermined rectangular range from the circular imaging range 26a (see FIG. 6A) and outputs it to the left region 42 of the front display 40 as a front left image IFb (see FIG. 6A). See FIG. 6(E)). In these cases, the predetermined (rectangular) predetermined range is the right half (right side region 41 (FIG. 4; DCR 41)) and the left half (left side region 42 (FIG. 4; DCL 42)) of the front display range 40a of the front display 40. )).

In the present embodiment, the image data of the predetermined rectangular range output from the wide-angle cameras 22 and 26 to the CMPU 81 corresponds to the predetermined rectangular range. It is output to the front display 40 . As a result, it is possible to minimize the delay time of image display by the front display 40 caused by the intervention of the CMPU 81, since there is no need to perform image processing for clipping the image. Since the display of the front right image IFa and the front right image IFa by the front display 40 provides the user M with visual information in the right front field of view FVa and the left front field of view FVb (effective field of view), Immediateness is required compared to the right side visual field SVa and the left side visual field SVb (peripheral visual field outside the effective visual field), so the HMD 10 of this embodiment makes it possible.

As shown in FIG. 4, the input side of the RMPU 82 is connected to the fisheye camera 32 of the side right camera unit 31, and the output side of the HDMI interface is connected to the right side display 51 and the lower right side display 61. ing. Image data (image) captured by the fisheye camera 32 is input to the RMPU 82, so the RMPU 82 performs image processing for cutting out an image of a predetermined range, and converts the right side image ISa into a right side image ISa. The lower right image ILa is output to the lower right display 61 (DLR 61).

As shown in FIG. 6, for example, when the imaging range 32a of the fisheye camera 32 is a circular range, the right outside of a predetermined rectangular predetermined range 31x (corresponding to the range of the front right image IFa) A part of the arcuate shape located in the lower outer side (excluding the overlapping range with the arcuate shape located in the lower outer side) is cut out from within the circular range (see FIG. 6(D)), and is displayed in the right side display range 51a of the right side display 51. It is output as an image ISa (see FIG. 6(E)). In this embodiment, the RMPU 82 outputs the right side image ISa to the right side display 51 after changing the size of the right side image ISa to match the predetermined right side display range 51a. The image size adapted to the right side display range 51a is, for example, a size that allows the right side image ISa to be maximally displayed in the right side display range 51a.

In addition, for the lower right display 61, a portion of the arc located outside the lower outside of the predetermined rectangular range 31x (corresponding to the range of the front right image IFa) (with the arc located outside the left) 6(D)), and output as a lower right image ILa to the lower right display range 61a (see FIG. 6(E)). In this embodiment, the RMPU 82 outputs the lower right image ILa to the lower right display 61 after changing the image size of the lower right image ILa to match the predetermined lower right display range 61a. The image size adapted to the lower right display range 61a is, for example, a size that allows the lower right image ILa to be displayed in the lower right display range 61a at its maximum.

As shown in FIG. 4, the LMPU 83 has an input side connected to the fisheye camera 36 of the lateral left camera unit 35, and an output side HDMI interface connected to the left side display 52 and the left lower display 62. ing. Image data (image) captured by the fisheye camera 36 is input to the LMPU 83, so the LMPU 83 performs image processing for cutting out an image of a predetermined range, and converts the left side image ISb to the left side image ISb. The lower left image ILb is output to the lower left display 62 (DLL 62).

As shown in FIG. 6, for example, when the imaging range 36a of the fisheye camera 36 is a circular range, the left outside of a predetermined rectangular predetermined range 36x (corresponding to the range of the front left image IFb) A portion of the arcuate position (excluding the overlapping range with the arcuate position positioned on the lower outer side) is cut out from within the circular range (see FIG. 6(C)) and displayed on the left side display range 52a of the left side display 52. Output as image ISb (see FIG. 6(E)). In the present embodiment, the LMPU 83 changes the image size of the left side image ISb to match the predetermined left side display range 52a, and then outputs the left side image ISb to the left side display 52 . The image size adapted to the left side display range 52a is, for example, a size that allows the left side image ISb to be maximally displayed in the left side display range 52a.

In addition, for the left lower display 62, a portion of the arc located outside the lower outside of the predetermined rectangular range 36x (corresponding to the range of the front left image IFb) 6(C)), and output to the lower left display range 62a as the lower left image ILb (see FIG. 6(E)). In this embodiment, the LMPU 83 outputs the lower left image ILb to the lower left display 62 after changing the image size of the lower left image ILb to match the predetermined lower left display range 62a. The image size adapted to the lower left display range 62a is, for example, a size that allows the lower left image ILb to be displayed in the lower left display range 62a at its maximum.

In the present embodiment, the RMPU 82 and the LMPU 83 are accommodated in the MPU accommodation chamber 14 at a position away from the right side display 51 and the left side display 52. , and the LMPU 83 may be accommodated in the space behind the left side display 52 of the display accommodation chamber 15 . This makes it possible to bring the RMPU 82 and LMPU 83 closer to the displays 51 and 52, which are the output destinations of these MPUs 82 and 83, respectively, thereby shortening the wiring length of the electrical wiring.

Here, the vertical width Wh of the front display 40 (transverse direction) and the positional relationship of the front camera 20 (front right camera unit 21, front left camera unit 25) with respect to this vertical width Wh will be described. As shown in FIG. 5B, the mounting position of the front camera 20 mounted on the front panel 11a of the housing 11 in the vertical direction is such that the separation distance between the front display 40 and the lens unit 70 is the aspherical lens of the lens unit 70 ( In the case of the focal length F of the right central portion 72a or the left central portion 73a), the distance ha obtained by F×tan θ _R1 (or F×tan θ _L1 ) and F×tan θ _R2 (or F×tan θ _L2 ) are obtained. It is an upward eccentric part determined by the distance hb.

In this embodiment, since the front camera 20 is tilted forward at the tilt angle θc, θ _R1 (or θ _L1 ) is half the angle of view θAFa of the wide-angle camera 22 (or the angle of view θAFb of the wide-angle camera 26). , and θ _R2 (or θ _L2 ) is a value obtained by adding the tilt angle θc to half the angle of view θAFa (or θAFb). Specifically, since the angle of view θAFa (or θAFb) is 90 degrees, θ _R1 (or θ _L1 ) is 35 degrees (=90 degrees/2-10 degrees), and θ _R2 (or θ _L2 ) becomes 55 degrees (=90 degrees/2+10 degrees).

Therefore, as shown in FIG. 5(B), when the focal length F of the aspherical lens (the central right portion 72a and the central left portion 73a) is 5 cm, the distance ha is 3.5 cm (=5 cm× tan 35 degrees), and the distance hb is 7.1 cm (=5 cm x tan 55 degrees). Therefore, at the "position on the front display 40" (point of intersection P) eccentrically (biased) in the upward direction determined by such distances ha and hb, the lines of sight LSa and LSb of both eyes in the front view of the user M The vertical position of the front display 40 is determined and the front display 40 is arranged so that . Note that the intersection point P is imaginary and appears to be one in FIG. There are two overlapping . Also, the vertical width Wh (or vertical display range), which is the vertical width of the front display 40, is the sum of the distance ha and the distance hb, and must be 10.6 cm (=3.5 cm + 7.1 cm) or more. I understand.

In addition, when the vertical width Wh of the front display 40 is 10.6 cm, the mounting position of the front camera 20 is a position at a distance ha (=3.5 cm) from above or at a distance hb (=7.1 cm) from below. position. This is to match the height positions of the front right camera unit 21 and the front left camera unit 25 with the height positions of both eyes of the user M in the lateral direction (vertical direction) of the front panel 11a. In this case, the lens body 71 having the aspherical lenses (right central portion 72a and left central portion 73a) is also attached to the housing 11 so that the lens axes of the aspherical lenses are positioned above the front display 40 at a distance ha. (=3.5 cm) or a distance hb (=7.1 cm) from the bottom.

By setting the positional relationship between the vertical width Wh of the front display 40 and the front camera 20 in this way, both eyes of the user M and the aspherical lenses (right central portion 72a and left central portion 73a) of the lens unit 70 and the front The camera 20 is positioned on the line of sight LSa, LSb of both eyes of the user M in front view, and the vertical width Wh of the front display 40 and both eyes corresponds to the front fields of view FVa and FVb. In addition, the height position of the front camera 20 and the height position of both eyes of the user also match. As a result, the forward visual field seen by the user M with the naked eye and the forward visual fields FVa and FVb seen by the user M through the HMD 10 are substantially the same. Therefore, the user M can see the surrounding scenery and the like through the HMD 10 without any sense of incongruity. If it is not necessary to obtain such a technical effect, it is not necessary to set the vertical direction of the front display 40 at the upper eccentric position determined by the distances ha and hb.

In addition, in the "head-mounted display device" of the above-mentioned Patent Document 1 (Japanese Patent Application Laid-Open No. 2011-205358) and conventional head-mounted devices such as xR goggles, the upper field of view and the lower field of view of the user wearing it The difference in width (upper field of view < lower field of view) is not fully considered. Therefore, the relationship between the position (intersection position) where the display located in front of the user's eyes and the line of sight of the user in the front view intersects, and the line of sight in the front view of the user and the front field of view are imaged. The positional relationship with the camera has not been examined so far.

For this reason, when a conventional head-mounted device displays an image of the front field of view captured by a camera on a display in front of both eyes of the user, the visual field of the human eye (the lower field of view is lower than the upper field of view with respect to the line of sight of the front view). is wider) and the image of the scenery displayed on the display is likely to be misaligned. Such a positional deviation can make the view in the effective field of view through the head-mounted device, etc., unnatural. )was there.

Therefore, in the HMD 10 of the present embodiment, the positional relationship between the vertical position of the front display 40 and the line of sight of the user M and the positional relationship between the vertical position of the front camera 20 and the line of sight of the user M are adjusted. configured with consideration. Accordingly, in order to solve the above problems, it is possible to provide a head-mounted device that makes it difficult for the user to feel uncomfortable.

The configuration of the HMD 10 can be expressed as follows when grasping it as a creation of a technical idea.

[1] A head-mounted device worn on the head of a user, wherein the head-mounted device is worn on the head,
a right front imaging unit that captures a right front field of view at a predetermined angle of view on the line of sight of the right eye in front view of the user;
a left front imaging unit that captures a left front field of view at a predetermined angle of view on the line of sight of the left eye in front view of the user;
a front image processing unit that receives images captured by the right front imaging unit and the left front imaging unit, respectively, and outputs a predetermined range of front right image and a predetermined range of front left image;
displaying the front right image input from the front image processing section facing both eyes of the user in a right region facing the right eye and inputting the front image processing section from the front image processing section; a front display unit that displays a left image in a left area facing the left eye;
positioned at a predetermined distance in the direction of both eyes from the front display unit, optically aligning the range corresponding to the field of view of the right eye with the right side area and optically matching the range corresponding to the field of view of the left eye with the left side area and a front lens portion that fits the
When the separation distance between the front lens portion and the front display portion is F,
The right front imaging unit has an angle of view θ _R2 of the lower portion of the right front field of view larger than the angle of view θ _R1 of the upper portion of the right front field of view,
The left front imaging unit has a larger angle of view θ _L2 of the lower portion of the left front field of view than the angle of view θ _L1 of the upper portion of the left front field of view,
The front display portion has a position eccentric in the upward direction determined by a distance obtained by F×tan θ _R1 and a distance obtained by F×tan θ _R2 with respect to the vertical width of the front display portion, and the front view of the user. at which the line of sight of the right eye intersects with the vertical width of the front display unit and is eccentric upward determined by the distance obtained by F×tan θ _L1 and the distance obtained by F×tan θ _L2 and the use arranged so that the line of sight of the left eye in the front view of the person intersects,
A head-mounted device characterized by:

[2] The right front imaging unit is positioned on the line of sight of the user's right eye in front view,
The head mounted device according to [1], wherein the left front imaging section is positioned on the line of sight of the user's left eye in front view.

[3] a right side imaging section for imaging a side field of view of the right eye of the user;
a left side imaging unit that captures a side field of view of the left eye of the user;
a right side image processing unit that receives an image captured by the right side imaging unit and outputs a right side image of a predetermined range;
a left side image processing unit that receives an image captured by the left side imaging unit and outputs a left side image of a predetermined range;
a right side display unit positioned in front of the right eye and displaying the right side image input from the right side image processing unit;
a left side display unit positioned in front of the left eye and displaying the left side image input from the left side image processing unit;
The head mounted device according to the preceding item [1] or [2], further comprising:

[4] further comprising a lower display portion positioned facing the eyes below,
The angle of view of the right side imaging section is larger than the right side portion of the angle of view of the right front imaging section,
The right side image processing section outputs the right side image among the images acquired from the right side imaging section to the right side display section, and outputs the right side image to the right side image in another range located below the predetermined range. outputting the lower right image to the right area of the lower display unit;
The angle of view of the left side imaging section is larger than the left side portion of the angle of view of the left front imaging section,
The left side image processing section outputs the left side image among the images acquired from the left side imaging section to the left side display section, and outputs the left side image to the left side image in another range located below the predetermined range. The head mounted device according to any one of the preceding items [1] to [3], wherein the lower left image is output to the left area of the lower display unit.

The technical concept described in [1] above includes a front right imaging section, a front left imaging section, a front image processing section, a front display section, and a front lens section. The front right imaging section captures an image of the front right field of view at a predetermined angle of view on the line of sight of the right eye in front view of the user, and the front left imaging section captures a predetermined angle on the line of sight of the left eye in front view of the user. The front image processing section picks up the left front field of view at the angle of view and receives the picked up images, and outputs the front right image of a predetermined range and the front left image of the predetermined range to the front display section. When the front right image and the front left image are input to the front display unit, the front display unit is positioned facing both eyes of the user and has a right area facing the right eye and a left area facing the left eye. , the front right image is displayed in the right area and the front left image is displayed in the left area. In addition, the front lens unit positioned at a predetermined distance in the direction of both eyes from the front display unit optically aligns the range equivalent to the right eye's field of view with the right side area, and optically matches the range equivalent to the left eye's field of view with the left side area. match the

In the right front imaging section, the angle of view θ _R2 of the lower portion of the right front field of view is larger than the angle of view θ _R1 of the upper portion of the right front field of view. Further, in the left front imaging section, the angle of view θ _L2 of the lower portion of the left front field of view is larger than the angle of view θ _L1 of the upper portion of the left front field of view. As a result, since the range that can be imaged by the front right imaging section and the front left imaging section is wider than the top, the range that can be imaged by the front right imaging section and the front left imaging section is the line of sight of the front view. On the other hand, the lower field of view is wider than the upper field of view, and is closer to the human visual field. In addition, the front display part has an upward eccentric position determined by a distance obtained by F × tan θ _R1 and a distance obtained by F × tan θ _R2 with respect to the vertical width of the front display part, and when viewed from the front by the user. The position where the line of sight of the right eye intersects, and the eccentric position in the upward direction determined by the distance obtained by F×tan θ _L1 and the distance obtained by F×tan θ _L2 with respect to the vertical width of the front display part and the front of the user It is arranged so that it intersects with the line of sight of the left eye in vision. Note that F represents the separation distance between the front lens portion and the front display portion. As a result, at the position where the front lens unit is focused, the front display unit is arranged so that the lower display range is wider than the upper display range in the vertical direction of the front display unit. In the image display of some parts, the field of view becomes closer to the field of view of the human naked eye (the lower field of view is wider than the upper field of view with respect to the front view line of sight). Therefore, it is possible to bring the imaging range of the right front imaging section and the left front imaging section closer to the field of view of both eyes that a person can see naturally. Therefore, the unnatural appearance within the effective field of view is suppressed, so that the user is less likely to feel discomfort.

In the technical idea described in [1] above, the concept of the front display unit includes a right front display unit that displays a front right image facing the right eye and a front left image facing the left eye. and a front left display portion for displaying. Also, the concepts of the front right imaging section and the front left imaging section may include the case where they are aggregated and configured as one front imaging section. Furthermore, the concept of the front lens section includes a right front lens section that optically matches the field equivalent range of the right eye to the right side area, a left front lens section that optically matches the field equivalent range of the left eye to the left side area, It can include the case where it is configured with two of

In the technical idea described in the preceding item [2], the right front imaging unit is positioned on the line of sight of the user's right eye in front view, and the left front imaging unit is positioned on the line of sight of the user's left eye in front view. Located in As a result, in the vertical direction, the height positions of the right front imaging section and the left front imaging section match the height positions of both eyes of the user. Therefore, it is possible to make the height of the imageable range of the right front imaging unit and the left front imaging unit closer to the height of the visual field of both eyes that a person can see naturally. Therefore, the unnaturalness of the appearance within the effective field of view is further suppressed, so that the user is less likely to feel discomfort.

The technical concept described in [3] above further includes a right side imaging section, a left side imaging section, a right side image processing section, a left side image processing section, a right side display section, and a left side display section. The right side imaging section captures an image of the side visual field of the user's right eye, and the right side image processing section to which the image is input outputs a right side image of a predetermined range. Then, the right side display section positioned in front of the right eye displays the right side image input from the right side image processing section. Further, the left side imaging section picks up the side visual field of the user's left eye, and the left side image processing section to which the image is input outputs a left side image of a predetermined range. The left side display section positioned in front of the left eye displays the left side image input from the left side image processing section.

As a result, the user wearing the head-mounted device on his or her head can see an image captured in the lateral field of view by the user's right eye on the right side display unit located in front of the right eye, and the user can The image captured by the left eye in the side field of view is displayed on the left side display located in front of the left eye. (peripheral vision image) can be visually recognized. Therefore, in addition to making it more difficult for the user to feel uncomfortable, it is possible to increase the visual information provided to the user regarding the peripheral vision outside the effective visual field.

In the technical idea described in [3] above, the concept of the front display section, the right side display section, and the left side display section is that the same display section is configured to have different display areas. the display area facing the user's both eyes, the display area serving as the right side display area facing the user's right eye, and the display area serving as the left side display area facing the user's left eye respectively to the left of . In addition, the concept of the front image processing unit, the right side image processing unit, and the left side image processing unit is that two of these are aggregated into one image processing unit and another image processing unit, or three are aggregated into one image processing unit. It may include a case where it is configured as an image processing unit.

The technical idea described in the preceding item [4] further includes a lower display unit positioned facing the lower side of both eyes, the angle of view of the right side imaging unit is larger than the angle of view of the right front imaging unit, and the left side The angle of view of the side imaging section is larger than the angle of view of the left front imaging section. For example, when the right front imaging section and left front imaging section are cameras each having a wide-angle lens, the right side imaging section and left side imaging section are cameras each having a fisheye lens. Then, the right side image processing section outputs the right side image among the images acquired from the right side imaging section to the right side display section, and the left side image processing section outputs the left side image among the images acquired from the left side imaging section. The image is output to the left side display section.

As a result, compared to the case where the right side imaging section and the left side imaging section do not have such an angle of view and have the same angle of view as the right front imaging section and the left front imaging section, the lateral field of vision of both eyes is reduced. Since it is possible to capture a wide-angle image, it is possible to display the right side image and the left side image captured in a wide range on the right side display section and the left side display section, respectively. Further, the right side image processing section outputs a lower right side image of another range located below the predetermined range of the right side image to the right side area of the lower display section, and the left side image processing section outputs the predetermined range of the left side image. A lower left image in another range located below is output to the left area of the lower display unit. As a result, among the wide-angle images captured in the side visual field of both eyes by the right side imaging section and the left side imaging section, the image captured in the lower right visual field of the user's right eye and the lower left visual field of the left eye. can also be displayed on the lower display portion located below both eyes. Therefore, since it is possible for the user to obtain visual information about his or her own feet, in addition to making it more difficult for the user to feel a sense of discomfort, the peripheral vision outside the effective visual field is provided to the user. information can be further increased.

The concept of the lower display section is divided into a lower right display section that displays the lower right image corresponding to the right side area and a lower left display section that displays the lower left image corresponding to the left side area. It can include the case where it is configured. Further, in the concept of the front display section and the lower display section, the same display section is configured to have different display areas, and the display area, which is the front display section, faces both eyes of the user and the lower display section. It may include the case where the display areas, which are parts, are positioned below both eyes of the user.

As described above, in the HMD 10 of the present embodiment, the user M captures images ( For example, the image within the effective field of view), the front right image IFa of a predetermined range is displayed in the right region 41 of the front display 40 facing the right eye, and the front left image IFb of the predetermined range is displayed on the front display facing the left eye. 40, the front right image IFa and the front left image IFb can be seen in the respective visual field equivalent ranges of both eyes via the front camera 20. FIG. In addition, the right side image ISa captured at a predetermined angle of view θASa by the fisheye camera 32 of the side camera 30 in the side field of view of the right eye of the user M is displayed on the right side display 51 positioned in front of the right eye. A left side display on which a left side image ISb is displayed or captured at a predetermined angle of view θASb by the fisheye camera 36 of the side camera 30 in the side field of view of the left eye of the user M is positioned in front of the left eye. 52, it becomes possible for the user M to visually recognize the images in the lateral field of view of both eyes (images in the peripheral field of view outside the effective field of view).

Therefore, it is possible to increase the visual information provided to the user M with respect to the peripheral vision outside the effective visual field. For example, in situations such as work handling chemical substances such as chemicals, work handling laser equipment that emits laser light, arc welding work, or the like, the user M has an effective field of view or peripheral vision outside the effective field of view through the HMD 10. It becomes possible to visually recognize about. Therefore, both eyes of the user M are protected from harmful substances and harmful rays (arc light, laser light, ultraviolet rays, high-energy visible rays, etc.) that can come from the work object, its surroundings, and the feet of the user M himself. can be protected. Even when it is necessary to positively view the harmful rays, the user M can visually see through the wide-angle cameras 22, 26, the fisheye cameras 32, 36, the front display 40, the side displays 51, 52, and the like. Since information can be obtained, the harmful rays can be visually recognized while avoiding direct incidence of the harmful rays on both eyes of the user M.

In addition, the HMD 10 of the present embodiment includes a lower right display 61 and a lower left display 62 that face each other below both eyes. is larger than the angle of view θAFa of the wide-angle camera 22 of the front right camera unit 21, and the angle of view θASb (>θAFb) of the fish-eye camera 36 of the side left camera unit 35 is larger than that of the wide-angle camera 26 of the front left camera unit 25. angle of view θAFb. Then, the RMPU 82 outputs the right side image ISa among the images acquired from the side right camera unit 31 to the right side display 51, and the LMPU 83 outputs the left side image ISb among the images acquired from the side left camera unit 35. Output to the left side display 52 .

As a result, the side right camera unit 31 and the side left camera unit 35 do not have such angles of view θAFa and θAFb, and the angles of view θAFa and θAFb similar to those of the front right camera unit 21 and the front left camera unit 25 are set. Compared to the case of having the two eyes, it is possible to take a wide-angle image in the side visual field of both eyes (the right side visual field SVa and the left side visual field SVb). 51 and the left side display 52 can be displayed.

In addition, the RMPU 82 outputs the lower right image ILa of another range located below the predetermined range of the right side image ISa to the lower right display 61, and the LMPU 83 outputs another range located below the predetermined range of the left side image ISb. lower left image ILb is output to the lower left display 62 . As a result, out of the wide-angle images taken in the side visual field (the right side visual field SVa and the left side visual field SVb) of both eyes by the side right camera unit 31 and the side left camera unit 35, the right eye of the user M is captured. and the left lower visual field (lower front visual field FVd) of the left eye can also be displayed on the lower right display 61 and the lower left display 62 located below both eyes. Therefore, the user M can also obtain visual information about his/her own feet, so that the visual information provided to the user regarding peripheral vision outside the effective visual field can be further increased.

For example, as shown in FIG. 7A, in a room 100 in which two cabinets 104, two bookshelves 105, a whiteboard 106, a table 107, and foliage plants 108 are laid out, the HMD 10 is placed in the center of the room. When the user M who wears it is standing, the user M can see the image shown in FIG. 7(B) with both eyes. A straight line 109 is displayed on the floor 103 under which the user M stands. Reference numeral 101 indicates "ceiling" and reference numeral 102 indicates "wall".

That is, the right front visual field FVa in the range sandwiched between the dashed lines in FIG. 7(A) is displayed in the right area 41 of the front display 40 (see FIG. 7(B)), and is sandwiched between the dashed lines. The left front visual field FVb of the range is displayed in the left area 42 of the front display 40 (see FIG. 7(B)). In this example, in both areas 41 and 42, a foliage plant 108 is displayed approximately in the center, a part of the bookshelf 105 is displayed on the right end, and a part of the whiteboard 106 is displayed on the left end. There is a difference in how the bookshelves 105 and the whiteboards 106 at both ends are interrupted due to the shift of the field of view FVb in the horizontal direction. The range in which the right front field of view FVa and the left front field of view FVb overlap is colored in dark gray, and the range in which they do not overlap is colored in light gray.

In addition, the side portion of the right side visual field SVa in the range sandwiched by the dashed lines extending rightward in FIG. 7(A) is displayed on the right side display 51 (see FIG. 7(B)). The side portion of the left side visual field SVb within the range sandwiched by the extended dashed lines is displayed on the left side display 52 (see FIG. 7(B)). In this example, on the right side display 51, two bookshelves 105 laid out on the right side can be seen, and on the left side display 52, the table 107 laid out on the left side can be seen. Furthermore, the line 109 displayed at the feet of the user M can be visually recognized on the lower right display 61 and the lower left display 62 . The side portions of the right side visual fields SVa and SVb are colored in light gray.

Furthermore, in the HMD 10 of the present embodiment, the optical axes of the front cameras 20 (the wide-angle camera 22 of the front right camera unit 21 and the wide-angle camera 26 of the front left camera unit 25) are tilted downward by an angle θc (for example, 10 degrees). Since it is configured as above, the range that can be imaged by the front camera 20 is wider in the lower part than in the upper part. Therefore, when the angles of view θAFa and θAFb of the wide-angle cameras 22 and 26 are 90 degrees, respectively, the range that can be captured by the front right camera unit 21 and the front left camera unit 25 (upper angle of view of 35 degrees (=45 degrees−10 degree), and the lower angle of view of 55 degrees (=45 degrees + 10 degrees)) is close to the human visual field (upper field of view is about 33 degrees, and lower field of view is about 55 degrees).

The front display 40 has an upward eccentric position (intersection point P) determined by a distance ha obtained by F×tan θ _R1 and a distance hb obtained by F×tan θ _R2 with respect to the vertical width Wh, and the front of the user M. It is arranged so as to intersect with the line of sight LSa of the right eye in vision. In addition, the front display 40 has an upward eccentric position (intersection point P) determined by a distance ha obtained by F×tan θ _L1 and a distance hb obtained by F×tan θ _L2 with respect to the vertical width Wh, and the user M , and the line of sight LSb of the left eye in front view.

Note that F is the separation distance from the front display 40 to the lens body 71 (that is, the focal length of the aspherical lens (right central portion 72a and left central portion 73a)). Also, since the front camera 20 is tilted forward at the tilt angle θc, θ _R1 is a value obtained by subtracting the tilt angle θc from the half value of the angle of view θAFa of the wide-angle camera 22 (or the angle of view θAFb of the wide-angle camera 26). . θ _R2 is a value obtained by adding the tilt angle θc to the half value of the angle of view θAFa (or θAFb). The same applies to θ _L1 and θ _L2 . For example, when the angles of view θAFa and θAFb of the wide-angle cameras 22 and 26 are respectively 90 degrees, θ _R1 and θ _L1 are 35 degrees (=90 degrees/2−10 degrees), and θ _R2 and θ _L2 are 55 degrees. degrees (=90 degrees/2+10 degrees).

As a result, at a position where the aspherical lens (right central portion 72a and left central portion 73a) of the lens unit 70 is focused, the lower display range is wider than the upper display range in the vertical direction of the front display 40. Since the front display 40 is arranged in such a manner, the image display of the front display 40 is close to the human visual field (the lower field of view is wider than the upper field of view with respect to the front view line of sight). Therefore, it is possible to make the imaging range of the front right camera unit 21 (wide-angle camera 22) and the front left camera unit 25 (wide-angle camera 26) closer to the field of view of both eyes that a person can see naturally. Therefore, the unnaturalness of the appearance within the effective visual field is suppressed, so that the user M of the HMD 10 is less likely to feel uncomfortable.

In the above-described embodiment of the HMD 10, the central visual field CV and the right front visual field FVa by the right eye of the user M are imaged using the front right camera unit 21 (wide-angle camera 22), and the right lateral visual field SVa by the right eye is captured. Although images were captured using the lateral right camera unit 31 (fisheye camera 32), these fields of view CV, FVa, and SVa may be captured by a single right camera unit (right imaging section) (image of the right camera unit). angle θAXa, angle of view θAXb of the left camera unit). In addition, the central visual field CV and the left front visual field FVb by the left eye of the user M are captured using the front left camera unit 25 (wide-angle camera 26), and the left side visual field SVb by the left eye is captured by the lateral left camera unit 35 (fish camera). Although the images were captured using the eye camera 36), these fields of view CV, FVb, and SVb may be captured by a single left camera unit (left imaging section).

In these cases, the image output from one right camera unit (right imaging unit) that captures the central visual field CV, the right front visual field FVa, and the right lateral visual field SVa by the right eye, the central visual field CV by the left eye, and the left front visual field Images output from one left camera unit (left imaging unit) that captures FVb and left side field of view SVb are individually processed by CMPU 81, RMPU 82, and LMPU 83, like the image processor 80 that constitutes the HMD 10 of the above-described embodiment. , or may be input to one MPU (image processing unit).

In addition, a predetermined range of front right image IFa, a predetermined range of right side image ISa, a predetermined range of front left image IFb, and a predetermined range of left side image are output from the CMPU 81, RMPU 82, LMPU 83, or one MPU (image processing unit). The image ISb may be individually input to the front display 40, the right side display 51, and the left side display 52 like the HMD 10 of the above-described embodiment, or these displays 40, 51, and 52 may be collectively displayed. Input may be made on a single display (first display unit) that can be displayed on the front, right side, and left side.

Further, a lower right image ILa in a different range located below the range of the right side image ISa output from the CMPU 81, RMPU 82, LMPU 83, or one MPU (image processing unit), and The lower left image ILb located in another range may be individually input to the lower right display 61 or the lower left display 62 as in the HMD 10 of the above-described embodiment, or these displays 61 and 62 may be aggregated. may be input to one display (second display unit).

By configuring in this way, similarly to the HMD 10 of the present embodiment described above, it is possible to increase the visual information provided to the user M with respect to the peripheral vision outside the effective visual field, and the user M can Since it becomes possible to obtain visual information about one's own feet, it is possible to further increase the amount of visual information provided to the user.

Note that instead of the side right camera unit 31 and the side left camera unit 35, for example, a camera unit having a wide-angle camera with an angle of view of about 90 degrees (e.g., corresponding to the front right camera unit 21 and the front left camera unit 25) ) may be provided at an angle of 30 to 90 degrees downward. This makes it possible to obtain an image of the feet of the user M in the range of 30 degrees to 90 degrees.

Also, a variable mechanism 90 as shown in FIG. 8A may be provided between the outer frame portion 76 on one side of the lens unit 70 and the right side display 51 (or left side display 52). The variable mechanism 90 is composed of an equal length link 91 and two hinges 96 and 98 (two hinges on one side).

The equal-length links 91 include a first link 92 attached along the front-back direction of the right side display 51, a second link 94 attached along the front-back direction of the outer frame portion 76 of the lens unit 70, and these links 92. , 94 and two intermediate links 93 connecting the . The lengths of the first link 92 and the second link 94 are equal, and the lengths of the two intermediate links 93 are also equal. That is, it is an equal-length link (parallel link). The front display 40 and the right side display 51 are rotatably connected by a hinge 96 . Furthermore, the outer frame portion 76 has a portion that holds the right center portion 72a and the right peripheral portion 72b and a portion that holds the right side portion 72c (hereinafter referred to as a “right side portion holding portion 76a”). It is rotatably connected.

By configuring the variable mechanism 90 in this way, when the right side display 51 or the right side holding portion 76a rotates, one rotates in accordance with the other, and the right side display 51 and the right side holding portion 76a rotate. Separation increases or decreases. As a result, for example, the gap Wa between the right side display 51 and the left side display 52 including the lens unit 70 can be narrowed to the gap Wb (see FIG. 8B) or widened to the gap Wc (see FIG. 8C). ). Therefore, it is possible to freely change the distance Wa between the right side display 51 and the left side display 52 according to the size of the head H of the user M, so that regardless of the size of the head H. The HMD 10 can be worn comfortably.

In the above-described embodiment, the HMD 10 is used as protective goggles or light-shielding glasses (light-shielding glasses). Instead, the image captured by the imaging units (right imaging unit, left imaging unit, right front imaging unit, left front imaging unit, right imaging unit, left imaging unit) is processed by the image processing unit (front imaging unit, right imaging unit, right imaging unit, right imaging unit, left imaging unit). which can be displayed on the display unit (first display unit, second display unit, front display unit, right side display unit, left side display unit, bottom display unit) via the first display unit, second display unit, left side image processing unit) If so, it can be applied to xR goggles and xR glasses, for example. Note that xR is a general term for virtual reality, augmented reality, mixed reality, and the like.

Although specific examples of the present invention have been described in detail above, these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications or changes of the above-described specific examples. In addition, the technical elements described in this specification or in the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims as filed. Furthermore, the techniques exemplified in this specification or drawings achieve a plurality of purposes at the same time, and achieving one of them has technical utility in itself. It should be noted that descriptions in parentheses in the [Description of Reference Symbols] column can clearly indicate the correspondence between the terms used in the above-described embodiment and the terms described in the scope of claims.

10... HMD (head mounted device)
11... Housing 19... Headband 20... Front camera (right imaging unit, left imaging unit)
21 Front right camera unit 22 Wide-angle camera (right imaging section, right front imaging section)
25 Front left camera unit 26 Wide-angle camera (left imaging unit, left front imaging unit)
30... Side camera (right side imaging unit, left side imaging unit)
31... Side right camera unit 32... Fisheye camera (right side imaging unit)
35... Side left camera unit 36... Fisheye camera (left side imaging unit)
40 front display (first display unit, front display unit)
40a front display range 41 right side area 42 left side area 50 side display (first display section, right side display section, left side display section)
51 ... right side display (first display section, right side display section)
51a...Right side display range 52...Left side display (first display section, left side display section)
52a... Left side display range 60... Lower display (second display section, lower display section)
61 ... lower right display (second display section, lower display section)
61a... Lower right display range (right side area)
62 ... lower left display (second display section, lower display section)
62a... Lower left display range (left side area)
70... Lens unit 72... Right lens part (front lens part, right side lens part)
72a...Right central part (front lens part)
72b...Right peripheral portion (front lens portion)
72c... Right side part (right side lens part)
73... Left lens part (front lens part, left side lens part)
73a...Left central part (front lens part)
73b... Left peripheral portion (front lens portion)
73c... Left side part (left side lens part)
80... Image processor (image processing unit)
81... CMPU (image processing unit, front image processing unit)
82 RMPU (image processing unit, right side image processing unit)
83 LMPU (image processing unit, left side image processing unit)
F... Separation distance H... Head M... User Wh... Vertical width (vertical width of the front display part)
Ww... Width
CV…central visual field
FVa: right front visual field (effective visual field of right eye)
FVb: left front visual field (effective visual field of the left eye)
FVc: Upper forward field of view (upper field of view)
FVd: Lower forward field of view (lower field of view)
IFa…Front right image
IFb…Front left image
ILa: lower right image
ILb...lower left image
ISa... right side image
ISb... left side image
LSa…Gaze of the right eye
LSb…Gaze of the left eye
SVa: Right side visual field (side visual field with right eye, peripheral visual field with right eye)
SVb... left side visual field (side visual field with left eye, peripheral visual field with left eye)
θAFa: angle of view (angle of view of right front imaging unit)
θAFb: angle of view (angle of view of left front imaging unit)
θASa: angle of view (angle of view of the right imaging section)
θASb: angle of view (angle of view of the left imaging section)
θAXa: angle of view (angle of view of the right imaging unit)
θAXb ... angle of view (angle of view of the left imaging unit)

Claims (7)

A head-mounted device worn on the head of a user, wherein the head-mounted device is worn on the head,
a right imaging unit that captures an image of the right front field of view at a predetermined angle of view on the line of sight of the right eye in the front view of the user, and also captures the lateral field of view and the lower field of view of the right eye;
a left imaging unit that captures an image of the left front field of view at a predetermined angle of view on the line of sight of the left eye in the front view of the user, and also captures the side field of view and the lower field of view of the left eye;
Images captured by the right imaging unit and the left imaging unit are input, and a front right image of a predetermined range, a right side image of a predetermined range, a front left image of a predetermined range, and a left side image of a predetermined range are output. an image processing unit that outputs a lower right image in a separate range located below the range of the right side image and a lower left image in a separate range located below the range of the left side image;
displaying the front right image input from the image processing unit positioned facing both eyes of the user in a right area facing the right eye and the front left image input from the image processing unit; in the left area facing the left eye, a right side display range positioned in front of the right side of the right eye and displaying the right side image input from the image processing unit, and the left eye a first display unit positioned on the front left side and having a left side display range for displaying the left side image input from the image processing unit;
positioned at a predetermined distance in the direction of the both eyes from the front display range of the first display unit, optically aligning the range corresponding to the field of view of the right eye with the right side area and the range corresponding to the field of view of the left eye; a front lens portion optically aligned with the left region;
The lower right image input from the image processing unit located below the both eyes is displayed in the right area that can face the right eye, and the lower left image input from the image processing unit is displayed on the left image. a second display unit displayed in the left area facing the eye;
A head-mounted device comprising: A head-mounted device worn on the head of a user, wherein the head-mounted device is worn on the head,
a right front imaging unit that captures a right front field of view at a predetermined angle of view on the line of sight of the right eye in front view of the user;
a left front imaging unit that captures a left front field of view at a predetermined angle of view on the line of sight of the left eye in front view of the user;
a right side imaging unit that captures a side field of view of the right eye of the user;
a left side imaging unit that captures a side field of view of the left eye of the user;
a front image processing unit that receives images captured by the right front imaging unit and the left front imaging unit, respectively, and outputs a predetermined range of front right image and a predetermined range of front left image;
a right side image processing unit that receives an image captured by the right side imaging unit and outputs a right side image of a predetermined range;
a left side image processing unit that receives an image captured by the left side imaging unit and outputs a left side image of a predetermined range;
displaying the front right image input from the front image processing section facing both eyes of the user in a right region facing the right eye and inputting the front image processing section from the front image processing section; a front display unit that displays a left image in a left area facing the left eye;
a right side display unit positioned in front of the right eye and displaying the right side image input from the right side image processing unit;
a left side display unit positioned in front of the left eye and displaying the left side image input from the left side image processing unit;
positioned at a predetermined distance in the direction of both eyes from the front display unit, optically aligning the range corresponding to the field of view of the right eye with the right side area and optically matching the range corresponding to the field of view of the left eye with the left side area a front lens unit that fits the
A head-mounted device comprising: Further comprising a lower display portion positioned facing the both eyes below,
The angle of view of the right side imaging section is larger than the right side portion of the angle of view of the right front imaging section,
The right side image processing section outputs the right side image among the images acquired from the right side imaging section to the right side display section, and outputs the right side image to the right side image in another range located below the predetermined range. outputting the lower right image to the right area of the lower display unit;
The angle of view of the left side imaging section is larger than the left side portion of the angle of view of the left front imaging section,
The left side image processing section outputs the left side image among the images acquired from the left side imaging section to the left side display section, and outputs the left side image to the left side image in another range located below the predetermined range. 3. The head mounted device according to claim 2, wherein the lower left image is output to the left area of the lower display section. When the separation distance between the front lens portion and the front display portion is F,
The right front imaging unit has an angle of view θ _R2 of the lower portion of the right front field of view larger than the angle of view θ _R1 of the upper portion of the right front field of view,
The left front imaging unit has a larger angle of view θ _L2 of the lower portion of the left front field of view than the angle of view θ _L1 of the upper portion of the left front field of view,
The front display portion has a position eccentric in the upward direction determined by a distance obtained by F×tan θ _R1 and a distance obtained by F×tan θ _R2 with respect to the vertical width of the front display portion, and the front view of the user. where the _line of _sight of the right eye intersects with the user, and the user is arranged so that it intersects with the line of sight of the left eye in the front view of
The right front imaging unit is positioned on the line of sight of the user's right eye in front view,
The left front imaging unit is positioned on the line of sight of the user's left eye in front view,
4. The head mounted device according to claim 2 or 3, characterized in that: The right side imaging section is positioned on the right side of the lower end of the front display section. The angle of view of the lower part is larger than the angle of view,
The left side imaging section is positioned on the left side of the lower end of the front display section. 5. The head mounted device according to claim 2, wherein the angle of view of the lower portion is larger than the angle of view. 6. The method according to any one of claims 2 to 5, wherein the front lens section has an aspherical lens positioned in front of each of the eyes, and a planar lens positioned around the aspherical lens. A head-mounted device according to any one of the clauses. a right side lens portion positioned at a predetermined distance from the right side display portion toward the right eye;
a left side lens portion positioned at a predetermined distance from the left side display portion toward the left eye;
further comprising
The head mounted device according to any one of claims 2 to 6, wherein the right side lens section and the left side lens section are flat lenses.

Images