KR102498191B1 - Optical system for augmented reality with a reflective surface and a head mounted display apparatus using thereof - Google Patents

Abstract

The present invention relates to an optical system for augmented reality including a reflective surface, and more specifically, to an optical system for augmented reality, wherein augmented reality image light output from a display and incident is transmitted to the user's eye so that the augmented reality image reaches the user's eye. It includes a reflective surface that reflects in a direction, and the reflective surface is characterized in that it transmits at least a part of light so that the real world can be seen through the user's field of view.
In addition, the present invention relates to a head-mounted display device using an augmented reality optical system including a reflective surface, and more specifically, to a head-mounted display device, comprising: an HMD frame that can be worn on a user's head; and an optical system for augmented reality including a reflective surface for reflecting incident augmented reality image light output from a display toward the user's eyes so that the augmented reality image reaches the user's eyes wearing the HMD frame, wherein the optical system includes: The reflective surface of is characterized in that it transmits at least a part of the light so that the real world can be seen through the user's field of view.
According to the optical system for augmented reality including the reflective surface proposed in the present invention and the head-mounted display device using the same, the incident augmented reality image light output from the display is reflected in the direction of the user's eyes, and through the user's field of view. By including a reflection surface that transmits at least a part of light so that the real world can be seen, the structure of the optical system can be simplified and lightened, and the structure can be flexibly changed.

Description

Optical system for augmented reality including a reflective surface and head-mounted display device using the same

The present invention relates to an optical system for augmented reality and a head-mounted display device using the same, and more particularly, to an optical system for augmented reality including a reflective surface and a head-mounted display device using the same.

Various wearable devices are being developed according to the trend of light weight and miniaturization of digital devices. A head mounted display, which is a kind of wearable device, refers to various devices that can be worn on a user's head to receive multimedia contents and the like. Here, the head mounted display (HMD) is worn on the user's body and provides images to the user in various environments as the user moves. Head-mounted displays (HMDs) are classified into see-through and see-closed types. The see-through type is mainly used for Augmented Reality (AR), and the closed type is mainly used for virtual reality (VR). reality, VR).

FIG. 1 is a diagram showing a schematic configuration of a general eyeglass type head mounted display (HMD), and FIG. 2 is a diagram showing a schematic configuration of a general band type head mounted display (HMD). As shown in FIGS. 1 and 2 , a head-mounted display in the form of general glasses or a band projects augmented reality (AR) image information to the real world through a lens that is worn on the user's face or head and transmits it. will be provided to the user.

In order to implement augmented reality in such a head-mounted display, an optical device having a complicated structure is used, but the existing optical device has a problem in that it is large and heavy. In addition, since the real world must be seen through transmission, a reflective mirror through which image light is reflected cannot be disposed in front, and thus there is a limit to structural change.

On the other hand, as a prior art related to the present invention, Patent Registration No. 10-2058205 (title of invention: optical system for implementing augmented reality and device including the same, registration date: December 18, 2019) has been disclosed.

The present invention has been proposed to solve the above problems of the previously proposed methods, and reflects incident augmented reality image light output from a display in the direction of the user's eyes, so that the real world can be seen through the user's field of view. Optical system for augmented reality including a reflective surface, which can simplify and lighten the structure of the optical system, and can flexibly change the structure by including a reflective surface that transmits at least a part of light so as to be transparent, and a head-mounted display device using the same Its purpose is to provide

An optical system for augmented reality including a reflective surface according to the features of the present invention for achieving the above object,

As an optical system for augmented reality,

A reflective surface for reflecting incident augmented reality image light output from the display to the user's eyes so that the augmented reality image reaches the user's eyes,

The reflective surface is

It is characterized in that it transmits at least a part of the light so that the real world can be seen through the user's field of view.

Preferably, the reflective surface,

It may be configured to be concave in the display direction.

Preferably,

a first block located between the display and the reflective surface; and

Further comprising a second block coupled to the first block,

The coupling part of the first block and the second block may constitute the reflection surface.

More preferably, the reflective surface,

It may be configured by applying a reflective coating between the first block and the second block.

More preferably,

Further comprising a display outputting an augmented reality image light,

The display, the first block and the second block may be manufactured in the form of a single body.

More preferably, the second block,

It may be configured in the form of a cap thinner than the first block and attached to the first block.

Preferably,

An additional optical element positioned between the display and the reflective surface may be further included.

A head-mounted display device using an optical system for augmented reality including a reflective surface according to the features of the present invention for achieving the above object is,

As a head-mounted display device,

an HMD frame that a user can wear on their head; and

An optical system for augmented reality including a reflective surface for reflecting incident augmented reality image light output from a display toward the user's eyes so that the augmented reality image reaches the user's eyes wearing the HMD frame,

The reflective surface of the optical system,

It is characterized in that it transmits at least a part of the light so that the real world can be seen through the user's field of view.

According to the optical system for augmented reality including the reflective surface proposed in the present invention and the head-mounted display device using the same, the incident augmented reality image light output from the display is reflected in the direction of the user's eyes, and through the user's field of view. By including a reflection surface that transmits at least a part of light so that the real world can be seen, the structure of the optical system can be simplified and lightened, and the structure can be flexibly changed.

1 is a diagram showing a schematic configuration of a general glasses-type head mounted display (HMD);
2 is a diagram showing a schematic configuration of a general band type head mounted display (HMD);
3 is a view for explaining an optical system for augmented reality including a reflective surface according to an embodiment of the present invention.
4 to 6 are diagrams showing a detailed configuration of an optical system for augmented reality including a reflective surface according to an embodiment of the present invention.
7 and 8 are diagrams illustrating additional optical elements of an optical system for augmented reality including a reflective surface according to an embodiment of the present invention.
9 is a diagram showing the configuration of a head-mounted display device using an optical system for augmented reality including a reflective surface according to an embodiment of the present invention.

Hereinafter, preferred embodiments will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, in describing a preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and actions.

In addition, throughout the specification, when a part is said to be 'connected' to another part, this is not only the case where it is 'directly connected', but also the case where it is 'indirectly connected' with another element in between. include In addition, 'including' a certain component means that other components may be further included, rather than excluding other components unless otherwise specified.

3 is a diagram for explaining an optical system 100 for augmented reality including a reflective surface 120 according to an embodiment of the present invention. As shown in FIG. 3 , the optical system 100 for augmented reality including the reflective surface 120 may include the reflective surface 120 and may further include a display 110. .

The display 110 may output augmented reality image light. More specifically, the display 110 may output image light so that image information along with the real world can be provided on a screen optimized for the user. The display 110 may output image information for providing various types of information to the user based on augmented reality under the control of the control unit 300 to be described later. The display 110 may be implemented using various display 110 elements such as Organic Light Emitting Diodes (OLEDs).

At this time, the display 110 may be located on the left or right side of the optical system 100 in front of the user's eye 10, but may also be located on the upper side, and may be configured in various positions according to design needs. .

The reflective surface 120 may reflect incident augmented reality image light output from the display 110 toward the user's eye 10 so that the augmented reality image reaches the user's eye 10 . In addition, the reflective surface 120 may transmit at least a portion of light so that the real world can be seen through the user's field of view.

That is, by implementing the reflective surface 120 as a mirror-coated surface that transmits at least a portion of light and reflects at least a portion of the light, a portion of visible light incident in the real world is transmitted through the reflective surface 120 to reach the user's eyes 10. At the same time as reaching, the augmented reality image light reflected by the reflective surface 120 reaches the user's eyes 10 so that augmented reality can be implemented. In this case, the reflective surface 120 may reflect at least a portion of the image light output from the display 110 to provide augmented reality image information to the user.

Meanwhile, as shown in FIG. 3 , the reflective surface 120 may be concave in the direction of the display 110 . However, the curvature of the reflective surface 120 may have one value or several values in a process of optimizing an optical path of image light, and may be implemented as an aspherical surface.

4 to 6 are diagrams showing a detailed configuration of an optical system 100 for augmented reality including a reflective surface 120 according to an embodiment of the present invention. As shown in FIG. 4, the optical system 100 for augmented reality including the reflective surface 120 according to an embodiment of the present invention is a first block located between the display 110 and the reflective surface 120. (130) and a second block 140 coupled to the first block 130 may be further included, and the coupling portion of the first block 130 and the second block 140 forms the reflective surface 120. can be configured.

More specifically, the reflective surface 120 may be formed by reflective coating between the first block 130 and the second block 140 . The first block 130 and the second block 140 may be made of glass, plastic, synthetic resin, or the like, and one surface of the first block 130 and one surface of the second block 140 correspond to each other, reflecting the surface ( 120), the reflection surface 120 may be formed by assembling by applying a reflective coating between the two corresponding surfaces.

In particular, as shown in FIG. 4 , the display 110 , the first block 130 and the second block 140 may be manufactured in a single body shape. In this way, when the display 110, the first block 130, and the second block 140 are manufactured in a 1-body shape, the reflective surface 120 can be effectively protected. That is, by manufacturing in the form of a single body as shown in FIG. 4, it is possible to protect the reflective surface 120 from foreign substances or impact after manufacturing the optical system 100, and when assembling the optical system 100 to a head-mounted display device. Fixing and assembling of the optical system 100 may be easy.

Meanwhile, as shown in FIG. 5 , the thickness of the optical system 100 may be variously implemented as needed, and in the process of optimizing the light path of the image light, the display 110 includes the first block 130 and the second block. 140 may be coupled to be positioned obliquely with the body in which the reflective surface 120 is configured. That is, in various embodiments, the detailed configuration of the optical system 100 and the arrangement of each component may be implemented in various ways.

Meanwhile, as shown in FIG. 6 , the second block 140 may be configured in a cap shape thinner than the first block 130 and attached to the first block 130 . In addition, the second block 140 in the form of a cap may be implemented in a form fitted to the first block 130 . In this way, if the second block 140 is implemented in the form of a thin cap, the weight of the entire optical system 100 can be reduced. Depending on the embodiment, the shape of the second block 140 can be not only a cap shape but also various shapes as needed.

7 and 8 are diagrams illustrating an additional optical element 150 of the optical system 100 for augmented reality including a reflective surface 120 according to an embodiment of the present invention. 7 and 8, the optical system 100 for augmented reality including the reflective surface 120 according to an embodiment of the present invention is located between the display 110 and the reflective surface 120 An additional optical element 150 may be further included.

The additional optical element 150, as a lens or a mirror, may be positioned on an optical path and perform various functions such as changing the path of the augmented reality image light output from the display 110 and enlarging/reducing.

9 is a diagram showing the configuration of a head-mounted display device using the optical system 100 for augmented reality including a reflective surface 120 according to an embodiment of the present invention. As shown in FIG. 9, the head-mounted display device using the optical system 100 for augmented reality including the reflective surface 120 according to an embodiment of the present invention includes an HMD frame and an optical system 100. It may be configured, and may be configured to further include a GPS module, a camera, a power supply unit, a switch unit, and a communication unit.

Since the optical system 100 has already been described, the remaining components will be described in detail below.

The HMD frame 200 is a frame configuration of a head-mounted display device worn on the head by a user. The HMD frame 200 may be configured in the form of a helmet or goggles having a frame structure through which light may enter while worn on the head by a user. Here, when the HMD frame 200 is formed in the form of a helmet, it may be composed of a helmet (not shown) worn on the user's head and a frame (not shown) of the display 110 disposed in front of the helmet. In addition, when the HMD frame 200 is configured in the form of goggles, it may be configured with a band frame (not shown) that can be worn on the user's head and a goggle frame (not shown) fastened and fixed to the band frame.

The head-mounted display device using the optical system 100 for augmented reality including the reflective surface 120 according to an embodiment of the present invention generates augmented reality image information and controls the control to be transmitted to the display 110 ( 300), a GPS module 400 mounted on the HMD frame 200 to provide location information, a camera 500 mounted on the HMD frame 200 to capture an image in the direction of the user's gaze, and a head-mounted display A power supply unit 600 for supplying power for driving the device, a switch unit 700 for turning on/off the power supply unit 600, and a communication unit 800 performing data communication under the control of the control unit 300 It may be configured to further include.

Here, the GPS module 400 may provide location information of the user, and the camera 500 may capture the real world of the user's line of sight. The control unit 300 generates image information to be provided to the user based on information collected by the GPS module 400, the camera 500, and other various sensors, and controls the image information to be transmitted to the display 110 so that the user can Through augmented reality, it is possible to receive additional information about the external environment through an optimized screen.

In addition, the switch unit 700 may be formed by installing a switch for turning on/off the power supply unit 600 on one side of the HMD frame 200 or in a separate device connected to the HMD frame 200 by wire. can Meanwhile, the communication unit 800 is linked and connected to another adjacent head-mounted display device or server, and can perform data communication so that various information such as location information and sensing information can be shared with each other. Here, it can be understood that the communication unit 800 applies various wireless communication schemes including 3G/4G/5G and LTE capable of accessing the Internet.

Meanwhile, the optical system 100 may be located on the left eye and/or right eye of the user in the HMD frame 200 , respectively. That is, two optical systems 100 may be located in the HMD frame 200 for each of the user's left and right eyes, but depending on embodiments, the optical system 100 may be located only on either the left or right eye.

In addition, the display 110 may be located on both sides of the HMD frame 200, and depending on embodiments, two may be located above the position of both eyes of the user in the HMD frame 200.

In addition, the display 110 is positioned above the user's left and/or right eye in the HMD frame 200 and outputs image light toward the reflective surface 120 disposed in front of the user's left and/or right eye. Alternatively, the HMD frame 200 may be located on the side of the user's left and/or right eye and output image light toward the reflective surface 120 disposed in front of the user's left and/or right eye.

As described above, according to the augmented reality optical system 100 including the reflective surface 120 proposed in the present invention and the head-mounted display device using the same, the augmented reality image light output from the display 110 and incident thereon The structure of the optical system 100 can be simplified and lightened by including a reflective surface 120 that reflects light in the direction of the user's eyes 10 and transmits at least a part of the light so that the real world can be seen through the user's field of view. and can be flexibly modified.

The present invention described above can be variously modified or applied by those skilled in the art to which the present invention belongs, and the scope of the technical idea according to the present invention should be defined by the claims below.

10: eyes
100: optical system according to the features of the present invention
110: display
120: reflective surface
130: first block
140: second block
150: additional optical element
200: HMD frame
300: control unit
400: GPS module
500: camera
600: power supply
700: switch unit
800: communication department

Claims (8)

delete delete delete delete delete delete delete As a head-mounted display device,
Optical system for augmented reality (100);
An HMD frame 200 in the form of goggles that can be worn on a user's head and is composed of a band frame that can be worn on the user's head and a goggle frame structure fastened and fixed to the band frame;
A control unit 300 for generating augmented reality image information and controlling it to be transmitted to the display 110;
a GPS module 400 mounted on the HMD frame 200 to provide location information;
a camera 500 mounted on the HMD frame 200 to capture an image in the direction of the user's gaze;
a power supply unit 600 for supplying power for driving the head-mounted display device;
A switch unit 700 for turning on and off the power supply unit 600; and
A communication unit 800 connected in conjunction with other head-mounted display devices or servers under the control of the control unit 300 and performing data communication so that location information and sensing information can be shared with each other,
The optical system 100 for augmented reality,
Display 110 for outputting augmented reality image light;
A reflection surface 120 that reflects incident augmented reality image light output from the display 110 toward the user's eye 10 so that the augmented reality image reaches the user's eye 10;
a first block 130 positioned between the display 110 and the reflective surface 120;
a second block 140 coupled to the first block 130; and
an additional optical element 150 located between the display 110 and the reflective surface 120;
The coupling portion of the first block 130 and the second block 140 constitutes the reflective surface 120,
The reflective surface 120,
A mirror-coated surface that transmits at least a portion of light and reflects at least a portion of the image light output from the display 110 so that the real world can be seen through the user's field of view, and is configured to be concave in the direction of the display 110 is aspherical,
The first block 130 and the second block 140 are made of at least one of glass, plastic, and synthetic resin, and one surface of the first block 130 and one surface of the second block 140 correspond to each other, It is molded to have the curvature of the reflective surface 120, reflective coating is applied between the corresponding two surfaces, and the combined portion of the first block 130 and the second block 140 constitutes the reflective surface 120, ,
The display 110, the first block 130, and the second block 140 are manufactured in a single body shape to protect the reflective surface 120 from foreign substances or shocks,
The second block 140,
It is configured in the form of a cap that is thinner than the first block 130 and has a uniform thickness and is implemented in a form fitted to the first block 130 to lighten the weight of the entire optical system 100,
The additional optical element 150,
As a lens or mirror, it is located on an optical path and functions to change the path of the augmented reality image light output from the display 110, expand or reduce,
The controller 300,
Based on the information collected by the GPS module 400, the camera 500, and the sensor, image information to be provided to the user is generated and controlled to be transmitted to the display 110, so that the user can view the external environment through augmented reality. A head-mounted display device using an augmented reality optical system 100 including a reflective surface 120, characterized in that to receive additional information about.

Images