KR102269833B1 - Smart glasses - Google Patents

Abstract

Smart glasses having a display device are disclosed. Smart glasses, a main frame having a spectacle frame shape; a support frame coupled to the central portion of the main frame; a first display supported by the support frame and displaying a first image; a second display supported by the support frame and displaying a second image; a first mirror reflecting the first image; a second mirror reflecting a second image; a first main lens for providing a first main image from the center to the inside of the main frame based on the first image reflected from the first mirror; and a second main lens for providing a second main image from the center to the inside of the main frame based on the second image reflected from the second mirror.

Description

Smart Glasses {SMART GLASSES}

An embodiment of the present invention relates to smart glasses, and more particularly, to smart glasses having a display device.

In general, a head mounted display (HMD) refers to a digital device that is worn on the head like glasses and displays a virtual image in a position close to the eyeball. Recently, HMDs are developing in combination with augmented reality technology and the like beyond a simple display function. For example, the HMD provides various conveniences to the user through the screen in front of the user's eyes, communicates with an external digital device to output the corresponding content, and receives user input for an external digital device or communicates with the external digital device. It also performs linked tasks.

Augmented reality is a technology that superimposes three-dimensional virtual objects on the real world and refers to a complex virtual reality that fuses reality and virtual environments. This complex virtual reality is being used in various fields such as military, entertainment, medical care, learning, film, architectural design, and tourism, and is gradually being applied to real life beyond the imaginary stage depicted in science fiction or movies.

Virtual reality systems include window systems, mirror systems, vehicle-based systems, and augmented reality systems. These systems are basically divided into output devices and input devices. Output devices are devices that allow users of virtual reality systems to perceive sight, hearing, touch, and movement through sensory channels. Such output devices include a visual display device, an auditory display device, a tactile display device, and a motion feedback and display device. Among the visual display devices, representative hardware includes an HMD and smart glasses.

The goal pursued by virtual reality is to allow users to experience telepresence. Originally, Presence means a sense of being in a certain environment. In this regard, remote presence allows the user to experience reality in a certain environment by means of a communication medium.

However, as the conventional smart glasses supply an image to one of the left or right eyeballs, and the user watches multimedia content with only one eye, various side effects such as dizziness or fatigue rapidly increase even after watching for a predetermined period of time. there is a problem.

The present invention has been devised to solve the above-described problems, and an object of the present invention is to reflect the multimedia content provided by one display unit in both directions and to reflect the contents enlarged by the magnifying lens unit to both eyes, so that the same An object of the present invention is to provide smart glasses that enable content observation and selectively implement augmented reality and virtual reality using 3D content if necessary.

Another object of the present invention is to provide smart glasses capable of simultaneously viewing or interacting with multimedia content implemented on a display unit in both eyes.

Another object of the present invention is to provide smart glasses that can implement augmented reality and virtual reality together in a head-up display device.

Smart glasses according to an aspect of the present invention for solving the above technical problem, a main frame having a spectacle frame shape; a support frame coupled to the central portion of the main frame; a first display supported by the support frame and displaying a first image; a second display supported by the support frame and displaying a second image; a first mirror reflecting the first image; a second mirror reflecting the second image; a first main lens for providing a first main image from the central part to the inside of the main frame based on the first image reflected from the first mirror; and a second main lens for providing a second main image from the central portion to the inside of the main frame based on the second image reflected from the second mirror.

In one embodiment, smart glasses, a first auxiliary lens disposed between the first mirror and the first main lens; and a second auxiliary lens disposed between the second mirror and the second main lens. Each of the first auxiliary lens and the second auxiliary lens enlarges the first image and the second image.

In an embodiment, the first or second auxiliary lens may include a plurality of aspherical lenses.

In an embodiment, the first main lens and the second main lens are formed of a plate-shaped reflective and transmissive member, and are disposed to be inclined at a predetermined angle with respect to the central axis of each of the first auxiliary lens and the second auxiliary lens.

In one embodiment, the thickness of the first main lens or the second main lens is several millimeters or less.

In an embodiment, the smart glasses may further include a communication and power board accommodated in a left or right frame portion of the main frame and connected to one or more of the first and second displays. The communication and power board is connected to an external control and power supply device by wire, and transmits signals and data communication between the control and power supply device and the first and second displays.

In one embodiment, both the application processor and the battery included in the control and power supply are disposed outside the smart glasses.

In one embodiment, the first display and the second display incorporate a display interface for controlling.

In an embodiment, the smart glasses further include a front camera installed on the outer surface of the central portion of the main frame to photograph the front and connected to the control and power supply through the communication and power board.

In one embodiment, the front camera includes a first front camera and a second front camera spaced apart by a predetermined interval.

In an embodiment, the smart glasses further include a rear camera or sensor that is installed on the inner surface of the central part of the main frame to photograph the rear side and is connected to the control and power device through the communication and power board.

In one embodiment, the rear camera or sensor detects the user's eyelids.

In one embodiment, the smart glasses include an actuator or actuator that is accommodated in at least one of a left frame portion and a right frame portion of the main frame and operates in response to a signal from the rear camera, the sensor, or the control and power supply device. include more

In one embodiment, the smart glasses are accommodated in any one or more of the left frame part and the right frame part of the main frame and output an alarm in response to a signal from the rear camera, the sensor, or the control and power supply device. include more

In an embodiment, the control and power supply device includes a control device and a power supply, and at least one of the control device and the power supply is supported by a main frame or mounted on an external device and includes data and It is connected to the communication and power board through a power line.

Smart glasses according to another aspect of the present invention for solving the above technical problem, a main frame having a spectacle frame shape; a support frame coupled to the central portion of the main frame; a first display supported by the support frame and configured to output a first image in a first direction; a first mirror for reflecting the first image in a second direction perpendicular to the first direction; a first main lens for reflecting the first image reflected from the first mirror toward the user's eye; a first convex lens installed between the first display and the first main lens to adjust a focal length of the virtual image of the first image seen through the first main lens; a second display supported by the support frame and outputting a second image in a first direction; a second mirror for reflecting the second image in a second direction perpendicular to the first direction and opposite to the second direction; a second main lens for reflecting the second image reflected from the second mirror toward the user's eyes; and a second convex lens installed between the second display and the second main lens to adjust a focal length of the virtual image of the second image viewed through the second main lens.

In an embodiment, the first convex lens may be disposed between the first display and the first mirror, and the second convex lens may be disposed between the second display and the second mirror.

* In an embodiment, the first convex lens may be disposed between the first mirror and the first main lens, and the first convex lens may be disposed between the second mirror and the second main lens.

In an embodiment, the first mirror and the second mirror may be concave mirrors.

In one embodiment, the first main lens and the second main lens may be formed of a plate-shaped reflective and transmissive member, and may be disposed to be inclined at a predetermined angle from the central axis of each of the first auxiliary lens and the second auxiliary lens. have.

Smart glasses according to another aspect of the present invention for solving the above technical problem, a main frame having a shape to be hung on one ear of a user and a length extending from the one ear to the front of one eye of the adjacent user; a support frame coupled to the front portion of the main frame corresponding to the front of one eye; a display supported by the support frame and outputting an image in a first direction; a mirror that reflects the image in a second direction orthogonal to the first direction; A main lens that reflects the image reflected from the mirror to the user's eyes; and a convex lens installed between the display and the main lens to adjust a focal length for a virtual image of an image viewed through the main lens.

In one embodiment, the convex lens may be disposed between the display and the mirror, or between the mirror and the main lens.

According to the present invention, there is an advantage in that a side viewing angle can be secured by configuring one or two display units disposed in the front center of the smart glasses to provide independent images to both eyes.

In addition, there is an effect that can effectively implement 2D and 3D images with one smart glasses, and implement augmented reality and virtual reality.

In addition, since the same multimedia content is provided to both eyes on one or two displays, there is an effect that the user does not feel any discomfort even after long-time use.

In addition, by reducing the thickness of the front main lens, it is possible to lighten the device and improve the feeling of use.

In addition, the user's eyelids are recognized through the rear camera or sensor, and a vibration or alarm is generated through an actuator, actuator, or speaker housed in the device according to the recognition result to warn a user, particularly a driver who is drowsy, of danger.

In addition, it is possible to provide operational stability and reliability for smart glasses by effectively discharging heat that may be generated when the device is used for a long time to a heat dissipation structure or a heat sink disposed on the front upper part of the main frame.

In addition, when the battery is removed from the smart glasses and power is supplied to the smart glasses through the battery to an external control and power device, the smart glasses can be effectively reduced in weight and wearability or convenience of use can be increased.

1 is a perspective view of smart glasses according to an embodiment of the present invention.
FIG. 2 is a side view of the smart glasses of FIG. 1 .
3 is a perspective view illustrating an operating state of the smart glasses of FIG. 1 .
FIG. 4 is a side view of the smart glasses of FIG. 3 .
5 is an exploded perspective view of the smart glasses of FIG. 1 .
6 is an exploded perspective view of smart glasses according to another embodiment of the present invention.
7 is a perspective view of smart glasses according to another embodiment of the present invention.
FIG. 8 is a front view of the smart glasses of FIG. 7 .
9 is a partial projection front view for explaining the internal structure of the smart glasses of FIG.
FIG. 10 is a right side view of the smart glasses of FIG. 7 .
11 is a partial projection right side view for explaining the internal structure of the smart glasses of FIG.
12 is a partially exploded perspective view for explaining the components of the smart glasses of FIG. 7 .
13 and 14 are diagrams for explaining a display path of a display image of the smart glasses of FIG. 7 .
15 is a block diagram of a control board that can be employed in the smart glasses of FIG. 7 .
16 is a block diagram for explaining another control board and power supply that can be employed in the smart glasses of FIG. 7 .
17 is a perspective view of smart glasses and a control system according to another embodiment of the present invention.
18 is a block diagram for explaining the main configuration of the smart glasses of FIG. 17 .
19 is a block diagram for explaining an operation of a control device for smart glasses according to another embodiment of the present invention.
20 and 21 are flowcharts for explaining the operation of a control device for smart glasses according to another embodiment of the present invention.
22 to 25 are diagrams of modifications of an optical system that can be employed in the smart glasses of FIG. 7 .
26 is a perspective view showing smart glasses according to another embodiment of the present invention.

Hereinafter, the configuration and operation of the embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a perspective view of smart glasses according to an embodiment of the present invention. FIG. 2 is a side view of the smart glasses of FIG. 1 . 3 is a perspective view illustrating an operating state of the smart glasses of FIG. 1 . FIG. 4 is a side view of the smart glasses of FIG. 3 . 5 is an exploded perspective view of the smart glasses of FIG. 1 .

1 and 2 , the smart glasses 100 according to the present embodiment include a first frame 50 and a second frame 51 , and the first frame 50 is a second frame 51 . It may be provided with a hinge-coupled structure using the first hinge portion 82 and the second hinge portion 83 with respect to the.

When the user intends to use the smart glasses only as glasses in daily life, the first frame 50 may be used in a state in which the glasses lenses 137a and 137b are positioned in the upper direction. The first frame 50 includes a display device, a mirror, a lens, and the like, and reflects and enlarges an image of the display device to be transmitted to the user's eyes.

When the user wants to implement augmented reality or virtual reality using content transmitted from an external digital device, as shown in FIGS. 3 and 4, the user attaches the first frame 50 to the spectacle lenses 137a and 138a. The contents of the smart glasses can be used by rotating it from the upper side to the lower direction so that a predetermined portion of the first frame 50 is positioned in front of the spectacle lenses 137a and 138a.

In addition, the multimedia content received from the external digital device may be output as it is, combined or converted on the display unit 10 . The display unit 10 may include a display such as a thin film transistor liquid crystal display (TFT LCD), an organic light emitting display (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), etc. It can be configured by selecting any one of the devices.

In addition, the content implemented in the display unit 10 is reflected in both directions by the reflection unit 20 . In order to reflect content in both directions, the reflector 20 may be formed of an X-Prism. A half-mirror coating that can be reflected and transmitted at the same time may be provided on the reflective surface of the reflective unit 20 on which the content is reflected. The reflector 20 is not limited to the X-prism, and any optical element that can simultaneously reflect and transmit, such as a beam splitter, a half mirror, or a combination thereof, may be used.

The content reflected by the reflection unit 20 passes through the magnifying lens unit 30 and is enlarged. The magnifying lens unit 30 may be composed of a plurality of aspherical lenses in order to magnify content and to eliminate spherical aberration and the like. In this embodiment, three aspherical lenses are used to enlarge content and eliminate spherical aberration. The three aspherical lenses may include a combination of optical elements in the form of a single-sided convex lens, a double-sided convex lens, and a single-sided convex lens when viewed on an optical path starting from the display device. A technique for designing contents using aspherical lenses in order to enlarge content and eliminate spherical aberration is well known, so it will not be specifically mentioned here.

The enlarged content passing through the magnifying lens unit 30 is reflected in the reflective and transmissive unit 40 in both eye directions. Since the reflection and transmission unit 40 is installed to not only reflect the enlarged content in the direction of the eyeball, but also to observe the contents for realizing virtual reality and augmented reality through the reflection and transmission unit, the reflective surface is reflective and transmitted It may be provided with a half-mirror coating that can be made at the same time.

In this embodiment, a transparent prism is used as the reflective and transmissive part 40, but it is not limited to a transparent prism, and any optical element that can simultaneously reflect and transmit, such as a beam splitter or a half mirror, can be used.

Each of the above-described components and their coupling relationship will be described in more detail as follows.

The display unit 10 , the reflection unit 20 , the magnifying lens unit 30 , and the reflection and transmission unit 40 are seated in the first frame 50 , and specifically, a front provided in the first frame 50 . It is seated in the case 52 .

The display unit 10 receives multimedia content from a main printed circuit board (PCB) 70 through a flexible PCB (FPCB) 60 . A battery 61 is connected to the FPCB 60 to supply necessary power to the display unit 10 and the like. The FPCB 60 is connected to transmit multimedia content from the main PCB 70 to the display unit 10 , and is connected to the battery 61 to supply power to the smart glasses 100a.

In addition, a wireless communication module (not shown) and a control unit (not shown) may be mounted on the main PCB 70 . In this embodiment, the wireless communication module receives multimedia content from an external digital device, and the control unit may control driving of the main PCB 70 and the display unit 10 .

The first frame 50 includes a first side case 80 and a second side case 81 coupled to the second frame 51 , a first hinge part 82 , and a second Each hinge is coupled through the hinge portion (83). The first frame 50 may rotate between the upper and lower directions (or the front of the spectacle lens) of the spectacle lenses 137a and 138a through the first and second hinges. In addition, the main PCB 70 and the battery 61 may be seated inside the first side case 80 and the second side case 81 , respectively.

In addition, the first frame 50 may further include a camera unit 90 . In addition, the second frame 51 may further include a power on/off button 91 and an indicator 92 such as a light emitting diode (LED).

The operating principle of the smart glasses of this embodiment will be described as follows.

When the user intends to implement augmented reality or virtual reality using smart glasses, the user rotates the first frame 50 of the smart glasses located above the spectacle lenses 137a and 138a in the downward direction to obtain the spectacle lens ( 101) can be manipulated to be located in front of it. In addition, the control unit of the main PCB 70 may receive multimedia content from an external digital device through the wireless communication module and transmit it to the display unit 10 .

When image content is output from the display unit 10 , the image content is reflected in both directions by the reflector 20 and transmitted to the magnifying lens unit 30 . The reflector 20 may include an X-Prism that transmits one piece of content in both directions. The enlarged content passing through the magnifying lens unit 30 is reflected by the reflection and transmission unit 40 and transmitted to both eyes, respectively.

When the content output from the display unit 10 is enlarged through the magnifying lens unit 30 , the distance from the magnifying lens unit 30 to the enlarged image may be adjusted as necessary. That is, the image enlarged by the magnifying lens unit 30 may be a virtual image, not a real image, and the length of the transmission path may be adjusted so that the user can see it through the smart glasses.

The distance li from the magnifying lens unit 30 to the virtual image felt by the user or driver is the focal length f of the magnifying lens unit 30 and the distance from the display unit 10 to the magnifying lens unit 30 ( lo) is regulated by the relationship between The relationship between the above distances satisfies Equation 1 below.

According to the present embodiment, smart glasses can be designed and manufactured so that an enlarged image is formed at a location desired by the user. In this embodiment, 20-inch-sized content can be implemented about 2.4 meters in front of the smart glasses. If 20 inches of content can be provided about 2 meters ahead of the smart glasses, users can conveniently implement augmented reality or virtual reality as needed.

6 is an exploded perspective view of smart glasses according to another embodiment of the present invention.

Referring to FIG. 6 , the smart glasses according to the present embodiment include main lenses 137 and 138 combined with spectacle lenses instead of spectacle lenses 137a and 138a in the center frame 51c of the second frame 51 . can The main lenses 137 and 138 may function as a bidirectional reflector that reflects the image of the display unit 10 to the user's eyes and also reflects the image in front of the user's eyes, in which case the above-described reflection and transmission unit 40 may be installed or replaced as a reflective member performing only a reflective function.

The smart glasses of this embodiment are substantially the same as the smart glasses of the embodiment described above with reference to FIGS. 1 to 5 except for using the main lenses 137 and 138 instead of the spectacle lenses 137a and 138a, so their specific configuration A description of the elements and their coupling relationship will be omitted.

7 is a perspective view of smart glasses according to another embodiment of the present invention. FIG. 8 is a front view of the smart glasses of FIG. 7 . 9 is a partial projection front view for explaining the internal structure of the smart glasses of FIG. FIG. 10 is a right side view of the smart glasses of FIG. 7 . 11 is a partial projection right side view for explaining the internal structure of the smart glasses of FIG. 12 is a partially exploded perspective view for explaining the components of the smart glasses of FIG. 7 .

The smart glasses 100 according to the present embodiment include a main frame 110 , a first display 131 , a second display 132 , a first mirror 133 , a second mirror 134 , and a first main lens. 137 and a second main lens 138 . In addition, the smart glasses 100 may further include a first auxiliary lens 135 and a second auxiliary lens 136 .

In addition, the smart glasses 100 include a controller including a processor (see 260 in FIG. 16 ), a display interface 160 for the first and second displays 131 and 132 , and soft printing connecting them. A circuit board (flexible printed circit board, FPCB, 164) may be provided. The controller may be referred to as a control and power supply and may have an embedded or separate communication and power board. The communication and power board may include connectors or means or components for relaying or interconnecting communication or power sources.

In addition, the smart glasses 100 may include one or more front cameras 151 and one or more rear cameras 153 . When the front camera 151 includes a first front camera and a second front camera spaced apart from each other by a predetermined distance, it is possible to facilitate input or application of 3D content. The front or rear camera may be a type of sensor or function as a sensor. In particular, the rear camera 153 or the sensor may be a means for detecting the operation of the user's eyelids or a device performing a function corresponding to the means.

In addition, the smart glasses 100 may further include an actuator or driver 194 that vibrates according to a signal from a camera, sensor, or control and power supply, or a speaker that outputs a sound signal in response to the signal. can The actuator 194 may include a vibration motor.

In addition, the smart glasses 100 may further include a heat dissipation structure or a heat sink for dissipating heat generated from the first display 131 , the second display 132 , the display interface 160 , and the like. At least one of the first display 131 and the second display 132 may be referred to as a display unit.

When each component is described in more detail, the main frame 110 is formed of a hard material having an approximately U-shape and has a spectacle frame shape or a frame shape of the spectacle frame. The main frame 110 may be formed as a single structure, in which case the main frame 110 includes the central frame portion 110c and the left frame portion 110a and the right frame portion ( 110b) may be provided. The left and right sides may be opposite sides from the user's point of view.

On the other hand, in the present embodiment, the main frame 110 is a coupling structure of a support frame disposed in the middle portion, a first side frame coupled to the left side of the support frame, and a second side frame coupled to the right side for ease of manufacture and weight reduction. can be provided. In this case, the support frame may be detachably formed with the first support frame 120a and the second support frame 120b in order to facilitate support, arrangement, and assembly of the display, mirror, auxiliary lens, and main lens.

Here, for convenience of description, the left frame part and the first side frame are denoted by a single reference numeral 110a, and the right frame part and the second side frame are denoted by a single reference numeral 110b. The support frame 120 in which the first support frame 120a and the second support frame 120b are combined may correspond to the front case 50 of FIG. 5 in terms of its function.

The display interface 160 is inserted into the central portion of the support frame 120 and may be electrically connected to the controller through a terminal of the FPCB 164 disposed on the upper central portion. And the display interface 160 is connected to the first display 131 and the second display 132 .

The FPCB 164 may be installed extending from the terminal of the central front part to the first side frame 110a and the second side frame 110b along the upper surface of the main frame 110 or the support frame 120 .

A first display 131 and a second display 132 are disposed on both sides of the box-shaped central portion of the support frame 120 to output the first image and the second image in opposite directions. The first display 131 or the second display 132 is a thin film transistor liquid crystal display (TFT LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), At least one selected from a digital light processing (DLP) based display may be included.

A first mirror 133 supported by a left inclined surface support structure portion of the support frame 120 is installed on the front surface of the first display 131 , and the first image of the first display 131 is substantially orthogonal to the left direction. It may be reflected in a first downward direction. Similarly, a second mirror 134 supported by a right inclined surface support structure portion of the support frame 120 is installed on the front surface of the second display 132 , and the second image of the second display 132 is displayed in a right direction. and may be reflected in a second downward direction substantially orthogonal to . The second downward direction may be a direction parallel to each other with a distance approximately equal to the distance between the user's two eyes.

The first image reflected by the first mirror 133 is enlarged by the first auxiliary lens 135 . The first auxiliary lens 135 may be supported by being inserted into the support structure of the support frame 120 in the form of a concave-convex structure. The first auxiliary lens 135 enlarges the first image and transmits it to the first main lens 137 .

Similarly, the second image reflected by the second mirror 134 is enlarged by the second auxiliary lens 136 . The second auxiliary lens 136 may be supported by being inserted into the support structure of the support frame 120 in the form of a concave-convex structure. The second auxiliary lens 136 enlarges the second image and transmits it to the second main lens 138 .

The first auxiliary lens 135 or the second auxiliary lens 136 has a stacked structure or overlap of a one-sided convex lens (the other surface concave lens), a two-sided convex lens, and a one-sided convex lens when the image is viewed from the input end side. An array may be provided. The first and second auxiliary lenses 135 and 136 described above are for enlarging the first image and the second image to a desired size and removing spherical aberration, and various modifications are possible according to implementation.

The first main lens 137 is disposed under the first auxiliary lens 135 . The first main lens 137 may have an arrangement structure in which a relatively thin plate-shaped lens member is installed at an angle to the central axis of the first auxiliary lens 135 . The first main lens 137 may be coupled to the lower portion of the support frame 120 or the central frame portion 110c (hereinafter, briefly referred to as the central frame) on the lower side of the first auxiliary lens 135 . The first main lens 137 is a beam splitter and may reflect the first image or the first image that has passed through the first auxiliary lens 135 toward the user's eyes at approximately right angles.

For example, the first image descending from the first mirror 133 in a substantially vertical direction forms an image facing the user's eyes and a virtual image facing the front of the user's eyes with the reflective surface of the first main lens 137 as the center. The distance from the reflective surface to the location where the river image is formed or the image plane may be about 20 meters.

Similarly, the second main lens 138 is disposed under the second auxiliary lens 136 . The second main lens 138 may have a structure in which a relatively thin plate-shaped lens member is installed at an angle to the central axis of the second auxiliary lens 136 . The second main lens 138 may be coupled to the lower side of the support frame 120 or the central frame 110c at the lower side of the second auxiliary lens 136 . The second main lens 138 is a beam splitter and may reflect the second image passing through the second auxiliary lens 136 toward the user's eyes at approximately right angles.

For example, the second image descending from the second mirror 134 in a substantially vertical direction forms an image facing the user's eyes and a virtual image facing the front of the user's eyes with the reflective surface of the second main lens 138 as the center.

The convex surfaces of the auxiliary lenses 135 and 136 described above may be installed to include three aspherical lenses in order to enlarge an image or content and to eliminate spherical aberration.

In addition, the nose piece member 140 may be connected to the central lower side of the support frame 120 . At least a portion of the nose piece member 140 may be made of a relatively soft material. The soft material may include a synthetic resin.

The upper cover 113 may be coupled to the central upper side of the main frame 110, the front upper cover 114 may be coupled to the central front upper side, and the front auxiliary cover 115 may be coupled to the center front uppermost center. The front upper cover 114 may place the first and second supporting frames 120a and 120b, and may be coupled to the rear cover 112c and the central frame 120c by fastening means such as screws or bolts. The auxiliary front cover 115 may cover the exposure lens portion of the front camera 151, in which case at least a portion of the front auxiliary cover 115 may be formed of a transparent or translucent material. In addition, depending on the implementation, the front auxiliary cover 115 may have an opening or a through hole for exposing the lens of the front camera 151 .

One end of the first side frame 110a may be connected to the left side of the support frame 120 , and the other end thereof may be connected to the first side connection frame 121 . The first side connection frame 121 may be connected to a first side end frame 122 . The first side termination frame 122 has an internal space for accommodating the first battery 172 , and the opening of the internal space facing the second side termination frame 125 to be described later is in the first flexible cover 123 . can be removably covered by The first side connection frame 121 and the first flexible cover 123 may be formed of rubber or a soft synthetic resin material in order to improve the wearing comfort as at least a surface portion of which is in contact with the user's ear and the back thereof.

Similarly, one end of the second side frame 110b may be connected to the right side of the support frame 120 , and the other end may be connected to the second side connection frame 124 . The second side connection frame 124 may be connected to a second side end frame 125 . The second side end frame 125 has an inner space for accommodating the second battery 171 , and the opening of the inner space facing the above-described first side end frame 122 or the first flexible cover 123 is It may be detachably closed by the second flexible cover 126 . The second side connection frame 124 and the second flexible cover 126 may be formed of a rubber or soft synthetic resin material in order to improve the wearing comfort as at least a surface portion of which is in contact with the user's left ear and the back thereof. The first battery 171 and the second battery 172 may be referred to as a power supply, and depending on implementation, one battery may be mounted, or even one battery may not be mounted, and both may be omitted.

A first side cover 112a may be installed on an outer surface of the first side frame 110a to accommodate a first printed circuit board (a first PCB, 161). The first printed circuit board 161 may be connected to the first battery 172 and connected to one end of the FPCB 164 . Similarly, the second side cover 112b may be coupled to the outer surface of the second side frame 110b to accommodate the second printed circuit board (a second PCB, 162 ). The second printed circuit board 162 may be connected to the second battery 171 and connected to the other end of the FPCB 164 .

The front side of the first side frame 110a and the second side frame 110b may be provided with a protrusion or concavo-convex portion for securing coupling force and positioning the shield (see 180 of FIG. 17 ) in combination. In addition, instead of the uneven portion, a magnet or a metallic material for attaching a magnet may be provided in the vicinity of the formation surface, thereby facilitating coupling with the shield and maintaining a stable coupling state.

The first printed circuit board 161 may include at least one port or a first connector for data transmission/reception with the outside or receiving power. The second printed circuit board 162 may include at least one port or a second connector for data transmission/reception with the outside or receiving power. Also, the first or second printed circuit boards 161 and 162 may include an earphone terminal.

The front camera 151 may include a lens exposed on the front of the main frame 110 or the center frame 120c. Two front cameras 151 may be installed, but the present invention is not limited thereto. The lens of the front camera 151 or its peripheral portion may be protected by the front auxiliary cover 115 . The front camera 151 may be electrically connected to another end or an extension of the FPCB 164 .

The rear camera 153 may include a lens exposed to the rear of the main frame 110 or the support frame 120 . One rear camera 153 may be installed, but is not limited thereto. The rear camera 153 may be electrically connected to another end or an extension of the FPCB 164 .

The processor (refer to 260 of FIG. 16 ) may be disposed on the first or second printed circuit boards 161 and 162 . The processor may operate and manage the operation or function of the smart glasses 100 by controlling the components of the smart glasses 100 . The processor may include an application processor (AP).

The display interface 160 may control the timing of signals transmitted to the first display 131 and the second display 132 under the control of the processor. The signal may include an image signal. In this embodiment, as the display interface 160, the first and second displays 131 and 132 and a dual and 3D MIPI DSI (Dual & 3D Mobile Industry Processor Interface Digital Serial Interface) suitable for application to 3D content (hereinafter simply DSI) ) or a means or device that performs a similar function.

In addition, the driver 194 may be built in the first or second side frames 110a and 110b. The driver 194 is electrically connected to the first or second printed circuit boards 161 and 162 and operates according to signals from the front camera 151, the rear camera 153, a sensor or a processor to generate vibration. . For example, when the user's eyelids are recognized through the rear camera 153 and it is recognized that the eyelids cover the eyes for a certain period of time or more, vibrations for the drowsiness prevention alarm may be generated according to a signal from the rear camera 153 .

In addition, a heat dissipation structure may be installed on an upper portion of the support frame 120 or a lower portion or a portion of the upper cover 113 . One end of the heat dissipation structure may be connected to the display interface 160 , the first display 131 , the second display 132 , and the backlight for LCD to emit heat generated from at least one of the above components. For effective heat dissipation, the heat dissipation structure may extend along the longitudinal outline of the upper end of the central frame 120c, and may be installed with a plurality of fins on at least one surface in a state in which the cross-sectional area is expanded. . In addition, according to implementation, the heat dissipation structure may be connected to a material having excellent conductivity installed in a predetermined width along the longitudinal direction of the upper cover 113 or may be formed integrally with the high conductivity material.

13 and 14 are diagrams for explaining a display path of a display image of the smart glasses of FIG. 7 .

In this embodiment, the optical system including the first main lens 137 will be mainly described, but of course, the same may be applied to the optical system including the second main lens 138 .

13 and 14 , the first main lens 137 according to the present embodiment faces the first auxiliary lens and is inclined in a range of approximately 30 degrees to 60 degrees. In addition, the first auxiliary lens includes a first uniconvex lens 135a , a first biconvex lens 135b , and a first convex lens 1372 .

One surface of the first one-surface convex lens 135a has a convex surface, and the other surface has a concave surface. The curvature of the concave surface of the first uniconvex lens 135a may be set to be substantially similar to or equal to the curvature of the opposite convex surface of the first biconvex lens 135b.

The first biconvex lens 135b has a convex surface on both one surface and the other surface thereof. The radius of curvature of the convex surface of one surface and the convex surface of the other surface may be the same, but is not limited thereto.

The first convex surface lens 1372 may have a convex surface facing the convex surface of the other surface of the first biconvex lens 135b, and the opposite surface of the convex surface may have a planar shape.

According to the above configuration, the first image and the second image output from the first and second displays 131 and 132 of the smart glasses according to the present embodiment are the first mirror 133 and the second mirror 134 . After each reflection from the first auxiliary lens 135 and the second auxiliary lens 136, the reflective surface of the first main lens 137 and the second main lens 138 are enlarged by the combination of the convex surfaces of each. It is divided and reflected on the reflective surface and projected to the rear and front surfaces of the main lenses 137 and 138, respectively. The reflective surface may be referred to as a beam splitting surface.

Here, the first image and the second image are enlarged by the combination of the convex surface of the first auxiliary lens 135 and the convex surface of the second auxiliary lens 136 , and the first auxiliary lens 135 and the second auxiliary lens 135 . The convex surface of the auxiliary lens 136 is formed as an aspherical surface, whereby spherical aberration can be eliminated.

Also, the first image and the second image focused at a predetermined position on the front surface of the first and second main lenses 137 and 138 may form a predetermined single image plane or a virtual image plane. Of course, in the case of a stereoscopic (3D) image, a virtual reality image, an augmented reality image, and the like, a multilayer image plane/virtual image plane may be provided.

In addition, in the smart glasses of the present embodiment, each of the main lenses 137 and 138 has an empty space between it and the side frame (see 112b in FIG. 7 ). In this way, there is an advantage in that it is possible to provide a maximum wide viewing angle without limiting the viewing angle of the smart glasses wearer by not arranging any components on the outer side of the side of each of the main lenses 137 and 138 .

Also, according to the present embodiment, the content implemented on the display may be enlarged using an auxiliary lens. In such a case, the distance from the auxiliary lens to the enlarged image may be adjusted as necessary. That is, the image enlarged by the auxiliary lens is a virtual image, not a real image, and its size or resolution can be easily adjusted so that the user can see it through the smart glasses.

The distance li to the virtual image felt by the user through the main lens may be adjusted by the relationship between the focal length f of the main lens and the distance lo from the display to the reflective surface of the main lens. The relationship between the distances satisfies Equation (1).

Therefore, it can be designed and manufactured so that an enlarged image can be formed at a location desired by the user. In this embodiment, it may be configured to implement content of about 20 inches in size about 2.4 meters in front of the smart glasses. According to this embodiment, about 20 inches of content can be provided about 2 meters in front of the smart glasses, and the user can easily implement and use augmented reality or virtual reality as needed.

15 is a block diagram of a control board that can be employed in the smart glasses of FIG. 7 .

Referring to FIG. 15 , the smart glasses 100 according to the present embodiment may include a controller 210 connected to the first and second displays D1 and D2; 131 and 132 . In addition, the smart glasses 100 may include a power supply unit 170 and a communication unit 190 . The power supply unit 170 may be referred to as a power supply device or a power supply device, and may include a battery or a power supply terminal. In addition, the communication unit 190 may include a subsystem for wired or wireless communication. At least a part of the power supply unit 170 and the communication unit 190 described above may be mounted on a printed circuit board. In that case, the printed circuit board may be referred to as a communication and power board.

The controller 210 may include a processor and a memory 220 . The controller 210 may control the operation of the power unit 170 and the communication unit 190 by a program stored in the memory 220 , and may control the operation of the smart glasses 100 . In the present embodiment, the controller 210 and the power supply unit 190 are integrally formed in the smart glasses 100 in a storage form, but are not limited thereto.

In the above embodiment, the display interface is described as a configuration separate from the controller 210, but the present invention is not limited to such a configuration, and the display interface may be implemented so that the display interface is integrally formed with the controller.

16 is a block diagram for explaining another control board and power supply that can be employed in the smart glasses of FIG. 7 .

Referring to FIG. 16 , in the smart glasses 100 according to the present embodiment, the power supply unit is installed as an auxiliary power unit 170 including a small battery or a single battery, and the main power supply device including a large or large capacity battery. 240 may be implemented to be detachably connected through the data and power line 192 from the outside of the smart glasses.

Here, the main power supply unit 240 may be accommodated in an external device (see 300 in FIG. 17 ), and in this case, the external device 300 may monitor and manage power supply through the display window.

17 is a perspective view of smart glasses and a control system according to another embodiment of the present invention. 18 is a block diagram for explaining the main configuration of the smart glasses of FIG. 17 .

17 and 18 , the smart glasses 100 according to the present embodiment may have a display interface, and a control device connected to the display interface may be implemented to be disposed outside the smart glasses 100 . In addition, the smart glasses 100 are implemented to place substantially all the batteries outside the smart glasses 100 .

Here, the display interface may be a means or device for performing a dual and 3D MIPI DSI (Dual & 3D Mobile Industry Processor Interface Digital Serial Interface, 210a) (hereinafter simply referred to as DSI) or a similar function. When such a display interface is used, it is suitable to implement 3D content with the first and second displays 131 and 132 .

For the above configuration, the smart glasses 100 include a first display 131 , a second display 132 , a display interface 160 , a camera 150 , and a communication and power board 164 .

The camera 150 may include a front or rear camera, and the communication and power board 164 is installed at an installation position of the first or second printed circuit board while being installed in an external main power supply (main power supply, MPS, 240 ) and the application processor (AP, 260 ). In this case, the external device 300 may externally control and monitor the operation of the smart glasses 100 as a control and power supply device.

In the present embodiment, the first battery 172 and the second battery 171 together with most of the controller or the first printed circuit board 161 and the second printed circuit board 162 may be omitted. That is, by installing the communication and power supply board 164 having a relatively simple structure at the position of the second printed circuit board 162 to relay the communication and power connection between the smart glasses 100 and the external device 300, the remaining electronic Most of the components for the part can be omitted.

According to the present embodiments, it is possible to significantly reduce the weight of the smart glasses 100, there is an advantage that can increase the usability. In addition, according to the use of an external battery, the battery capacity can be relatively increased by a certain amount, and if necessary, the power required for long-term use of smart glasses can be smoothly supplied by receiving power from commercial power or other auxiliary batteries through the power terminal. There are advantages to supply.

19 is a block diagram for explaining an operation of a control device for smart glasses according to another embodiment of the present invention.

Referring to FIG. 19 , the smart glasses control device according to the present embodiment may be referred to as an application processor, and includes a video interface 261 , a tracking module 262 , a rendering module 263 , and a measurement module 264 . may include The tracking module 262 , the rendering module 263 , and the measurement module 264 may be connected to a user interface (U/I, 265 ).

The video interface 261 may receive a video image stream input from the video cameras 151 and 152 and transmit an image of a desired section to the tracking module 262 .

The tracking module 262 may receive image data from the video interface 261 and transmit a measurement image and a pose estimation result to the rendering module. In this case, the tracking module 262 may receive adjustment information including adjustment parameters and the like through the user interface 265 , and recognize the marker using the marker information stored in the marker information database 266 . The marker functions as a medium between the real image and the virtual object. The marker information may include information about a size, a pattern, and the like of a marker. The marker information database 266 may be replaced with marker information stored in a predetermined storage unit.

The rendering module 263 is responsible for creating and removing virtual objects. The rendering module 263 may obtain adjustment information and the like through the user interface 265 . The adjustment information may include load or unload, rotation, movement (coordinate movement, etc.), scaling, and the like. The rendering module 263 may interwork with an engine that supports three-dimensional (3D) modeling (in short, a 3D modeling engine 268 ) or a means for performing such a function through the content resource database 267 . The 3D modeling engine 268 may generate a virtual object of the measurement image based on a virtual reality modeling language (VRML). The rendering module 263 may receive the virtual object from the content resource database 267 and render the measured image.

The measurement module 264 may check and process a distance between virtual objects, a distance and a direction measurement between generated coordinate systems, and interference between virtual objects. The measurement module 264 may receive the augmented image from the rendering module 263 and provide the augmented reality image to the display device according to object information input through the user interface 265 . The object information may include information on positive or negative registration, 3D point, collision, and the like.

20 and 21 are flowcharts for explaining the operation of a control device for smart glasses according to another embodiment of the present invention.

Referring to FIG. 20 , the smart glasses controller according to the present embodiment may acquire a stereoscopic image through a camera ( S201 ). The controller may generate a depth map image based on the stereoscopic image.

Next, the control device may detect or extract the hand image (S203). The controller may extract the hand image from the depth map image.

Next, the control device may extract a command corresponding to a series of hand images from the storage unit or the database (S205). The control device executes a preset command in response to a vector component pointed to by a series of hand images created by hand images extracted for a predetermined time, and an image area corresponding to the start and end points of the vector component or an object located in the image area. can recognize Here, the object may have different types of menus, icons, and the like in response to preset commands.

According to the present embodiment, the smart glasses controller may detect a hand motion through image processing and control the image displayed on the smart glasses based on the image processing. For example, the image control may include forward or reverse image flipping, image fast forwarding, image rewinding, and performing a preset command by recognizing a touch on a specific region of the image.

In addition, the control device recognizes a hand in an image frame input for hand gesture recognition, detects an image where the hand is located, or recognizes or predicts the direction of the hand movement, and places content on the screen or moves the current image accordingly. Alternatively, the current image may be overlapped with other images. Predicting hand motion may include recognizing a hand, a finger, or a combination thereof. Such gesture recognition may be performed based on image processing and preset gesture information.

According to this embodiment, it is possible to provide a user interface using hand gestures in not only augmented reality but also virtual reality, mixed reality, and the like, thereby effectively displaying various contents of smart glasses. It can be used, and user convenience can be greatly improved.

For example, according to this embodiment, when working at a desk without a monitor, or when shopping, wearing smart glasses and performing payment through augmented reality, using a navigation function through augmented reality, or playing an augmented reality game, , watching virtual reality videos, making video calls with augmented reality or virtual reality, working in the field with smart glasses while wearing smart glasses, or easily operating and using smartphone functions on the screen of smart glasses. have.

Also, referring to FIG. 21 , the smart glasses control device according to the present embodiment acquires a stereoscopic image through a camera (S201), detects or extracts a hand image based thereon (S203), and then Screen mirroring of a mobile computing device such as a mobile terminal or a notebook computer may be performed in response to a series of hand images (S206).

Screen mirroring may be referred to as screen mirroring, and refers to a function of wirelessly viewing a screen of a mobile computing device on a screen of smart glasses without connecting a separate line.

For screen mirroring, the control device of the smart glasses or the display interface of the control board encodes the screen information in the mobile computing device and transmits it in frequency, receiving and decoding the screen information and displaying the decoded image on the screen of the smart glasses through the display. can be printed on Wireless includes, but is not limited to, Bluetooth, and other short-range wireless communication methods may be used.

If you use screen mirroring, you can receive phone calls, make phone calls, make video calls, etc., receive text messages, check text contents, etc. on a mobile terminal with a communication function in smart glasses to conveniently provide services such as phone calls and text messages. can be made available for use.

22 to 25 are diagrams of modifications of an optical system that can be employed in the smart glasses of FIG. 7 .

Referring to FIG. 22 , in the smart glasses according to the present embodiment, a first auxiliary lens 135 , a second auxiliary lens 1372a and a first mirror 133 are disposed between the first display 131 and the main lens. can be The first auxiliary lens 135 and the second auxiliary lens 1372a may be disposed between the first display 131 and the first mirror 133 and sequentially arranged on the optical path.

The first auxiliary lens 135 and the second auxiliary lens 1372a may be convex lenses having the same shape and structure, but are not limited thereto. The reciprocal of the combined focal lengths of the first auxiliary lens 135 and the second auxiliary lens 1372a is equal to the sum of the reciprocals of the focal lengths of each auxiliary lens.

The reciprocal of the combined distance is the reciprocal of the distances from the first auxiliary lens 135 and the second auxiliary lens 1372a to the first display 131 and the first auxiliary lens 135 and the second auxiliary lens 1372a. It is equal to the sum of the reciprocal of the distance from to the virtual image passing through the first mirror 133 .

Also, referring to FIG. 23 , in the smart glasses according to the present embodiment, a first mirror 133 , a first auxiliary lens 135 , and a second auxiliary lens 1372a are disposed between the first display 131 and the main lens. may be sequentially disposed on the optical path in the order described. The first auxiliary lens 135 and the second auxiliary lens 1372a may be disposed between the first mirror 133 and the main lens or between the first mirror 133 and the user's eyes.

Also, referring to FIG. 24 , in the smart glasses according to the present embodiment, between the first display 131 and the main lens, the first auxiliary lens 135 and the first concave mirror 133a are described in the order of the optical path. may be sequentially arranged. The first auxiliary lens 135 may be disposed between the first display 131 and the first concave mirror 133a.

The first concave mirror 133a has a combined shape and function of a single convex lens and a mirror for an image transmitted to either one of the user's two eyes. A concave surface of the first concave mirror 133a corresponds to a reflective surface of light or an image.

Also, referring to FIG. 25 , in the smart glasses according to the present embodiment, the first concave mirror 133a and the first auxiliary lens 135 are arranged between the first display 131 and the main lens on the optical path. may be sequentially arranged. The first auxiliary lens 135 may be disposed between the first concave mirror 133a and the main lens.

26 is a perspective view showing smart glasses according to another embodiment of the present invention.

Referring to FIG. 26 , the smart glasses 100h according to the present embodiment are not limited to a configuration that provides independent images to both eyes of a user, but may have a form and structure that provides an image to only one eye of the user. can In the present embodiment, the smart glasses 100h are implemented as a device that provides an image to the user's left eye, but is not limited thereto, and may be implemented as a device that provides an image to the right eye.

Smart glasses 100h are a main frame having a spectacle frame shape, a support frame coupled to the central portion of the main frame, a display that is supported by the support frame and displays an image, a mirror that reflects an image, and an image reflected from the user's eyes. It includes a main lens 137 that reflects to the side.

That is, the smart glasses 100h include a main frame having a shape that is hung on one ear of a user and a length extending from the one ear to the front of one eye of the adjacent user; a support frame coupled to the front portion of the main frame corresponding to the front of one eye; a display supported by the support frame and outputting an image in a first direction; a mirror that reflects the image in a second direction orthogonal to the first direction; A main lens that reflects the image reflected from the mirror to the user's eyes; and a convex lens installed between the display and the main lens to adjust a focal length for a virtual image of an image viewed through the main lens.

The upper cover 113 may be coupled to the central upper side of the main frame, the front upper cover 114 may be coupled to the central front side, and the front auxiliary cover 115 may be coupled to the upper front top cover 114 . A nose pad member 140 may be coupled to a lower portion of the main frame.

A side frame may be coupled to the side of the main frame. A side cover 112b may be installed on the side frame to place the printed circuit board.

A side connection frame 124 may be connected to a distal end of the side frame, and a side end frame 125 may be coupled to one end of the side connection frame. A battery is accommodated in the inner space of the side end frame 125 , and the opening may be detachably covered by the flexible cover 126 .

According to the present embodiment, it is possible to provide smart glasses suitable for a user with a handicap in one eye or a user who has a reluctance to use smart glasses with both eyes.

As described above, in the detailed description of the present invention, specific embodiments have been described. However, various modifications are possible without departing from the scope of the present invention. The technical spirit of the present invention should not be limited to the embodiments described in the present invention, and should be defined by the claims as well as the claims and equivalents.

Claims (20)

delete delete delete a main frame having a spectacle frame shape;
a support frame coupled to the central portion of the main frame;
a first display supported by the support frame and configured to output a first image in a first direction;
a first mirror reflecting the first image in a second direction perpendicular to the first direction;
a first main lens for reflecting the first image reflected from the first mirror toward the user's eye;
a first convex lens installed between the first display and the first main lens to adjust a focal length of the virtual image of the first image seen through the first main lens;
a second display supported by the support frame and configured to output a second image in a first direction;
a second mirror for reflecting the second image in a second direction perpendicular to the first direction and opposite to the second direction;
a second main lens for reflecting the second image reflected from the second mirror toward the user's eyes; and
and a second convex lens installed between the second display and the second main lens to adjust a focal length of the virtual image of the second image seen through the second main lens,
The first convex lens is disposed between the first display and the first mirror, and the second convex lens is disposed between the second display and the second mirror,
the first main lens is a beam splitter and forms a virtual image of the first image in front of the user's eyes, the second main lens is a beam splitter and forms a virtual image of the second image in front of the user's eyes,
An actuator or actuator that vibrates according to a signal from a camera, sensor, or control and power supply device, or a speaker that outputs a sound signal in response to the signal,
Further comprising a heat dissipation structure or a heat sink for dissipating heat generated by the first display and the second display,
smart glasses.
delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images