KR102519432B1 - Head-down type wearable augmented reality apparatus - Google Patents

Abstract

The present invention relates to a head-down type wearable augmented reality implementation device, and more particularly, to a wearable augmented reality implementation device, comprising: a wearable part worn on a neck and/or shoulder by a user; a main body connected to the wearing part; And it is connected to the main body, and provides augmented reality to the user in a state where the user wearing the wearable part has his or her head down, and is disposed in front of the user's eyes with the head down, so that the augmented reality image light output from the display is directed toward the head. It is characterized in that it includes an optical system to reach the eyes of the user lying down.
According to the head-down type wearable augmented reality implementation device proposed in the present invention, a wearable part that can be worn on the neck and/or shoulder by a user, and an augmentation output on a display are placed in front of the eyes of a user with his or her head down. By including an optical system that allows real image light to reach the eyes of a user with his/her head down, the user's head can move freely while providing augmented reality while the user's head is down, reducing the weight of the device when the user's head is down. It can be used for a long time by minimizing the fatigue caused by it, and augmented reality can be comfortably applied to the work of specific occupational groups such as dentists and engineers who have to work with the field of view facing downward.

Description

Head-down type wearable augmented reality implementation device {HEAD-DOWN TYPE WEARABLE AUGMENTED REALITY APPARATUS}

The present invention relates to a wearable augmented reality implementation device, and more particularly, to a head-down type wearable augmented reality implementation device.

Various wearable devices are being developed according to the trend of light weight and miniaturization of digital devices. A head mounted display, which is a kind of wearable device, refers to various devices that can be worn on a user's head to receive multimedia contents and the like. Here, the head mounted display (HMD) is worn on the user's body and provides images to the user in various environments as the user moves. Head-mounted displays (HMDs) are classified into see-through and see-closed types. The see-through type is mainly used for Augmented Reality (AR), and the closed type is mainly used for virtual reality (VR). reality, VR).

FIG. 1 is a diagram showing a schematic configuration of a general glasses-type head mounted display (HMD), and FIG. 2 is a diagram showing a schematic configuration of a general band-type head mounted display (HMD). As shown in FIGS. 1 and 2 , a head-mounted display in the form of general glasses or a band projects augmented reality (AR) image information to the real world through a lens that is worn on the user's face or head and transmits it. will be provided to the user.

Since such a head-mounted display is worn on the head in the form of glasses or goggles, it has the advantage of stably providing augmented reality. However, since it is worn on the head, if the weight is heavy, head movement becomes uncomfortable and cannot be worn for a long time, so there is a problem that a battery of a sufficient size cannot be configured or a battery must be provided as a separate device.

In addition, when applying augmented reality to the work of a specific occupational group, such as a dentist or an engineer, where the field of vision must be directed downward, the head-mounted display has a limit that makes it difficult to use because it is fatigued because the head is lowered due to its weight. there is.

On the other hand, as a prior art related to the present invention, Patent Publication No. 10-2016-0032656 (title of invention: optical device for augmented reality, publication date: March 24, 2016) has been disclosed.

The present invention has been proposed to solve the above problems of the previously proposed methods, and is arranged in front of the user's eyes with a wearing part that can be worn on the neck and / or shoulder by the user, and the display By including an optical system that allows the output augmented reality image light to reach the eyes of a user with his or her head down, allowing the user to freely move the user's head while receiving augmented reality while the user's head is down, so that when the user's head is lowered A head-down type wearable that can be used for a long time by minimizing the fatigue caused by the weight of the device and can comfortably apply augmented reality to certain occupational groups such as dentists and engineers who have to work with their eyesight downward. Its purpose is to provide an augmented reality implementation device.

Head-down type wearable augmented reality implementation device according to the features of the present invention for achieving the above object,

As a wearable augmented reality implementation device,

a wearable part worn by a user on the neck and/or shoulder;

a main body connected to the wearing part; and

It is connected to the main body and provides augmented reality to the user in a state where the user wearing the wearable part has his or her head down, but is disposed in front of the user's eyes with the head down, so that the augmented reality image light output from the display is lowered. It is characterized in that it includes an optical system to reach the user's eyes.

Preferably, the optical system,

In the form of a visor, a lower end may be connected to the wearing part.

Preferably, the optical system may be implemented by including a beam splitter.

Preferably,

A display for outputting image light may be further included so that image information along with the real world can be provided on a screen optimized for the user.

More preferably,

a sensor unit including an IMU sensor that collects head movement information of a user wearing the wearable unit; and

The control unit may further include a control unit that receives head movement information collected from the sensor unit and generates augmented reality image information to transmit and control the generated augmented reality image information to the display so that the augmented reality image information can be provided to a screen optimized for the user.

Even more preferably, the sensor unit,

The IMU sensor may be in the form of a head-worn band.

Even more preferably, the control unit,

Head movement information collected by the sensor unit may be transmitted through wireless communication.

Even more preferably,

a GPS module mounted on the main body or the sensor unit to provide location information;

a power supply unit built into the body and supplying power;

a switch unit for turning on/off the power supply unit; and

It may be configured to further include a communication unit that performs data communication with at least one of a sensor unit, another wearable augmented reality implementation device, and a server under the control of the controller.

According to the head-down type wearable augmented reality implementation device proposed in the present invention, a wearable part that can be worn on the neck and/or shoulder by a user, and an augmentation output on a display are placed in front of the eyes of a user with his or her head down. By including an optical system that allows real image light to reach the eyes of a user with his/her head down, the user's head can move freely while providing augmented reality while the user's head is down, reducing the weight of the device when the user's head is down. It can be used for a long time by minimizing the fatigue caused by it, and augmented reality can be comfortably applied to the work of specific occupational groups such as dentists and engineers who have to work with the field of view facing downward.

1 is a diagram showing a schematic configuration of a general glasses-type head mounted display (HMD);
2 is a diagram showing a schematic configuration of a general band type head mounted display (HMD);
3 is a diagram illustrating problems of a conventional head-mounted display device;
4 is a diagram showing the configuration of a head-down type wearable augmented reality implementation device according to an embodiment of the present invention.
5 is a view showing a user wearing a head-down type wearable augmented reality implementation device according to an embodiment of the present invention.
6 is a perspective view of a head-down type wearable augmented reality implementation device according to an embodiment of the present invention.
7 is a side view of a head-down type wearable augmented reality implementation device according to an embodiment of the present invention.

Hereinafter, preferred embodiments will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, in describing a preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and actions.

In addition, throughout the specification, when a part is said to be 'connected' to another part, this is not only the case where it is 'directly connected', but also the case where it is 'indirectly connected' with another element in between. include In addition, 'including' a certain component means that other components may be further included, rather than excluding other components unless otherwise specified.

3 is a diagram for explaining problems of a conventional head-mounted display device. As shown in FIG. 3, since the conventional head-mounted display device is worn on the head in the form of glasses or goggles, a battery is mounted on the back of the head to supply power for long-term use (hatched on the back of the head in FIG. 3). box), a separate battery is provided on the arm or waist, and there is a problem in that the battery and the head-mounted display device must be connected by wire (a box connected with a cable in FIG. 3). When the battery is mounted on the back of the head, its weight makes it difficult to move the head and makes it difficult to wear it for a long time, and in particular, it is more difficult to work with the head down. In addition, in the case of using a battery connected to the outside by wire, there is an inconvenience that operation is restricted due to the wired connection.

In addition, when a specific occupational group, such as a dentist or an engineer who needs to look downwards, applies augmented reality to work, it is difficult to use because the weight of the head-mounted display device greatly increases work fatigue.

4 is a diagram showing the configuration of a head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention to solve the problems of the prior art as described above. As shown in FIG. 4 , the head-down type wearable augmented reality device 100 according to an embodiment of the present invention includes a wearable part 110, a body 120, and an optical system 130. It may further include a display 140, a sensor unit 150, a controller 160, a GPS module 170, a camera unit 175, a power supply unit 180, a switch unit 185, and a communication unit 190. can be configured.

5 is a view showing a user wearing the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention. As shown in FIG. 5 , the head-down type wearable augmented reality device 100 according to an embodiment of the present invention can be worn by a user on the neck and/or shoulder through the wearable part 110. As such, in a state where the wearer holds his head up (head-up state), the real world can be recognized with the naked eye without augmented reality (left side of FIG. 5), and in a state where the head is lowered (head-down state), the optical system (130 ), it is possible to experience augmented reality in which image information is combined with the real world (right side of FIG. 5).

Hereinafter, each component of the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention will be described in detail with reference to FIGS. 4 and 5 .

The wearable part 110 is configured to be worn by a user on the neck and/or shoulder. The wearable part 110 may be configured so that the main body 120 and the optical system 130 can be worn on the neck, and may further include a shoulder wearable band so that the weight is distributed to the shoulder.

6 is a perspective view of a head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention. As shown in FIG. 6 , the wearable part 110 of the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention connects the main body 120 and the optical system 130 to the user's neck and / or may include a wearing band 111 for wearing on the shoulder and a fixing member 112 for fixing the wearing band 111 according to the user's body. The wearing band 111 may be in the form of an elastic band, but according to embodiments, it is molded to fit the body curve and may be made of various materials such as plastic, metal, and synthetic fiber that are easy to fasten and fix with the main body 120. In addition, the fixing member 112 may be Velcro, a button, a length-adjustable elastic band, a string, or the like. However, the wearable part 110 is not limited to the shape shown in FIG. 6, and as long as the main body 120 and the optical system 130 can be firmly fixed to the neck and shoulder, a necklace type, a neckband type, or a neck pillow It can be implemented in various forms, such as a shape or a vest form.

The main body 120 is a component connected to the wearable part 110, and includes components such as a display 140, a control unit 160, a GPS module 170, a power supply unit 180, and a communication unit 190 therein. can do. The main body 120 is configured to be detachable from the wearable part 110 so that it can be used by being separated or fastened as needed, and the wearable part 110 can be changed according to the user's physical condition or taste.

The optical system 130 is connected to the main body 120 and provides augmented reality to the user while the user wearing the wearable unit 110 has his or her head down, is disposed in front of the user's eyes with the head down, and displays the optical system 130 . The augmented reality image light output from 140 may reach the eyes of the user with his/her head down. That is, the optical system 130 allows the real world through the user's field of view to be transmitted and seen, and the augmented reality image light to reach the user's eyes, so that the real world and the visible through the optical system 130 are transmitted. Together, it is possible to provide augmented reality combined with augmented reality image information.

In particular, as shown on the right side of FIG. 5 , the optical system 130 is disposed in front of both eyes of the user when the user wearing the wearable part 110 lowers his or her head, providing augmented reality in a head-down state. can In the head-up state, the size, position, and angle of the optical system 130 may be adjusted so that the user can see the real world with the naked eye.

In this case, the shape and size of the main body 120 may be set so that the distance or angle between the optical system 130 and the user's eyes can be optimized when the user wears the wearable part 110 and lowers his or her head. Depending on the embodiment, the distance and position between the optical system 130 and the user's eyes can be adjusted by adjusting not only the shape and size of the main body 120, but also the shape of the wearable part 110 connected and fixed to the main body 120. may be

Meanwhile, as shown in FIGS. 5 and 6 , the optical system 130 has a visor shape and may have a lower end connected to the wearing part 110 . Also, the optical system 130 may be implemented by including a beam splitter.

7 is a side view of the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention. As shown in FIG. 7 , the optical system 130 of the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention may be composed of optical elements such as a beam splitter, a lens, and a mirror. there is. The optical system 130 using a beam splitter may be mainly used in a head-mounted display device implemented in the form of goggles, etc. In the present invention, the direction of the optical system 130 is modified to display the display 140 located on the main body 120. By outputting the augmented reality image light in the direction of the optical system 130, the head-down type wearable augmented reality implementation device 100 may be configured. In addition, the optical system 130 may be implemented with various optical systems 130 capable of implementing augmented reality.

The display 140 may output image light so that image information along with the real world may be provided to a user on a screen optimized for use. More specifically, the display 140 may output augmented reality image light toward the optical system 130 so that the image light may be incident to the user's eyes through the optical system 130 . The display 140 may output image information for providing various types of information to a user based on augmented reality under the control of a controller 160 to be described later. The display 140 may be mounted on the body 120 and may be implemented using various display 140 elements such as organic light emitting diodes (OLEDs).

The sensor unit 150 may include an IMU sensor that collects head movement information of a user wearing the wearable unit 110 . In this case, the sensor unit 150 may be implemented in the form of a head-worn band in which an IMU sensor is embedded. That is, as shown in FIGS. 5 and 7 , when the user wears the sensor unit 150 implemented in the form of a head-worn band having an IMU sensor, the user's head movement is accurately identified and optimized according to the head movement. Augmented reality image information may be provided.

In addition, the sensor unit 150 may further include a pupil recognition sensor for detecting a pupil position of the user. The pupil recognition sensor is provided at the upper end of the optical system 130 to precisely determine the position of the user's pupil when the user lowers his or her head, and transmits the position of the user's pupil to the control unit 160 to determine where the user is looking or where the user is looking. Augmented reality image information may be provided according to a viewing object.

In addition, the sensor unit 150 may include various sensors capable of collecting information such as ambient carbon dioxide concentration, concentration of harmful substances, temperature, humidity, and illumination, and may transmit the collected information to the control unit 160. .

The controller 160 receives the head movement information collected by the sensor unit 150, generates augmented reality image information, and transmits it to the display 140 so that the augmented reality image information can be provided to the user as an optimized screen. You can control it. In addition, information such as pupil location, carbon dioxide concentration, harmful substance concentration, temperature, humidity, and illuminance collected by the sensor unit 150 is received and analyzed, and augmented reality image information necessary for the user is generated and displayed on the display 140. can transmit

At this time, the controller 160 may receive head movement information collected by the sensor unit 150 through wireless communication. Therefore, even if the sensor unit 150 is implemented in the form of a band worn on the head, the user may be provided with optimized augmented reality image information without discomfort in head movement. At this time, the wireless communication used may use short-distance wireless communication such as Bluetooth, and various wireless communication methods including Wifi, mobile communication network, 3G / 4G / 5G and LTE may be used.

Meanwhile, the head-down type wearable augmented reality implementation device 100 according to an embodiment of the present invention includes a GPS module 170 mounted on the main body 120 or the sensor unit 150 to provide location information, the main body 120 or a camera mounted on the sensor unit 150 to capture an image in the direction of the user's gaze, a power supply unit 180 for supplying power for driving the wearable augmented reality device 100, and a power supply unit Performing data communication with at least one of the sensor unit 150, another wearable augmented reality implementation device 100, and a server under the control of the switch unit 185 for on/off of the unit 180 and the control unit 160 It may be configured to further include a communication unit 190.

Here, the GPS module 170 may provide the user's location information, and the camera unit 175 may capture the real world of the user's line of sight. The control unit 160 generates image information to be provided to the user based on information collected by the GPS module 170, the camera unit 175, and other various sensors, and controls the image information to be transmitted to the display 140, so that the user can receive additional information about the external environment through an optimized screen through augmented reality.

In addition, the switch unit 185 may install a switch for turning on/off the power supply unit 180 on one side of the main body 120 or may be formed in a separate device connected to the main body 120 by wire. . On the other hand, the communication unit 190 is linked and connected to the sensor unit 150, other wearable augmented reality implementation devices 100 and servers, and performs data communication so that various information such as location information and sensing information can be shared with each other. can do. Here, it may be understood that the communication unit 190 applies various wireless communication schemes including 3G/4G/5G and LTE capable of accessing the Internet.

At this time, the GPS module 170, the camera unit 175, the power supply unit 180, the communication unit 190, etc. may be embedded or mounted in the main body 120, in particular, the body 120 in which the weight is distributed to the neck and shoulders By embedding or mounting the power supply unit 180 in, there is an advantage of having a battery that can be used for a long time while the head movement is comfortable.

As described above, according to the head-down type wearable augmented reality implementation device 100 proposed in the present invention, the wearable part 110 that can be worn on the neck and/or shoulder by the user, and the By including an optical system 130 that is disposed in front of the eyes and allows the augmented reality image light output from the display 140 to reach the eyes of the user with the head down, while the user's head is free to move, while the user has the head down By providing augmented reality, it is possible to use it for a long time by minimizing the fatigue caused by the weight of the device when the head is down, and it is comfortable for certain occupational groups such as dentists and engineers who have to work with their eyesight downward augmented reality can be applied.

The present invention described above can be variously modified or applied by those skilled in the art to which the present invention belongs, and the scope of the technical idea according to the present invention should be defined by the claims below.

100: wearable augmented reality implementation device according to the features of the present invention
110: wearing part
111: wearing band
112: fixed member
120: body
130: optical system
140: display
150: sensor unit
160: control unit
170: GPS module
175: camera unit
180: power supply
185: switch unit
190: Ministry of Communications

Claims (8)

Wearing a head-down type in which the user can perceive the real world with the naked eye without augmented reality when the user is in a head-up state, and in a head-down state where the user's head is lowered, can experience augmented reality that combines image information with the real world. As a type augmented reality implementation device 100,
a wearable part 110 that can be worn on the neck and/or shoulder by a user;
a main body 120 connected to the wearing part 110;
In a state where the user wearing the wearing unit 110 has his head down, augmented reality is provided to the user, but the augmented reality image light output from the display 140 is disposed in front of the eyes of the user with his or her head down. An optical system 130 that reaches the eyes of a user lying down;
a display 140 installed in the main body 120 and outputting augmented reality image light toward the optical system 130 so that image information along with the real world can be provided to the user;
a sensor unit 150 including an IMU sensor that collects user's head movement information; and
Includes a controller 160 that receives head movement information collected from the sensor unit 150, generates augmented reality image information, and transmits and controls it to the display 140 so that the augmented reality image information can be provided to the user. and
The optical system 130,
In the form of a visor, the lower end of the visor is connected to the main body 120 and the wearing part 110,
In the head-up state, the real world can be seen with the naked eye, and in the head-down state, augmented reality is provided through the optical system 130,
The sensor unit 150,
a head wearing band 111 in which the IMU sensor is embedded and separated from the main body 120; and
A pupil recognition sensor that detects the position of the user's pupil and is provided at the upper end of the optical system 130 in the form of a visor to determine the position of the user's pupil when the user lowers his or her head and transmits it to the control unit 160,
The controller 160,
Receiving head movement information collected from the IMU sensor of the head worn band 111 through wireless communication, and generating the augmented reality image information using the head movement information and the user's pupil position transmitted from the pupil recognition sensor. Characterized in, the head-down type wearable augmented reality implementation device 100.
delete The method of claim 1, wherein the optical system 130,
Characterized in that implemented by including a beam splitter, head-down type wearable augmented reality implementation device 100.
delete delete delete delete According to claim 1,
a GPS module 170 mounted on the body 120 or the sensor unit 150 to provide location information;
A power supply unit 180 built into the main body 120 and supplying power;
a switch unit 185 for turning on/off the power supply unit 180; and
Characterized in that it further comprises a communication unit 190 that performs data communication with at least one of the sensor unit 150, another wearable augmented reality implementation device 100, and a server under the control of the control unit 160, Head-down type wearable augmented reality implementation device (100).

Images