KR102191433B1 - Smart glasses - Google Patents

Abstract

As a head-mounted display device, smart glasses having a display unit that can be employed in virtual reality, augmented reality, and video viewing are disclosed. Smart glasses are a frame assembly having a form of a spectacle frame that can be worn on the user's head, and an optical system that is coupled to the frame assembly so that the first main lens and the second main lens are positioned in front of the user's left and right eyes when worn on the head. , And a display device that provides an image in a direction in which the user's eyes are positioned through a first main lens and a second main lens of an optical system when worn on the head, wherein the first main lens and the second main lens It includes a plate-shaped beam splitter having a thickness of several millimeters that transmits and separates the image formed on a virtual image to the user's eyes.

Description

Smart glasses {SMART GLASSES}

Embodiments of the present invention relate to a head mounted display device, and more particularly, to smart glasses having a display unit that can be used for virtual reality, augmented reality, video viewing, and the like.

Head Mount Display (HMD) refers to a digital device that is worn on the face like glasses and displays a virtual image on glasses in a form close to the eyeball with multimedia contents.

HMD can provide various conveniences to users by combining augmented reality technology, etc., beyond a simple display function, and can communicate with external digital devices to output relevant contents, as well as users for external digital devices. It also supports receiving inputs or performing tasks linked with the corresponding external digital device. Recently, research and development on HMD has been actively conducted.

Augmented reality is one of the hybrid virtual reality technologies that combine reality and virtual environments by using technology to superimpose 3D virtual objects on the real world. Such augmented reality is gradually becoming a reality, out of the imaginary stage depicted in science fiction novels and movies, as it is used in various fields such as military, entertainment, medical care, learning, film, architectural design, and tourism.

Increased reality is a field of virtual reality, and virtual reality systems are classified into window systems, mirror systems, vehicle-based systems, and augmented reality systems. Can be.

The virtual reality system includes an input device and an output device. Output devices are devices that allow users to perceive sight, hearing, tactile sense, movement, etc. through sensory channels, and include a visual display device, an auditory display device, a tactile display device, a motion feedback and an image display device. Representative hardware among visual display devices is HMD and smart glasses.

The goal of virtual reality is to allow users to experience telepresence. Presence means a sense of being felt in a certain environment. In this sense, remote presence can refer to being in a certain virtual environment by a communication medium, and a virtual reality system or augmented reality system. Allows users to experience remote presence.

However, conventional smart glasses supply an image to one eyeball, either left or right, and the user observes multimedia content only with one eye, so that side effects such as dizziness occur even after observing only a certain time.

In order to improve this problem, to supply multimedia contents to both eyes, smart glasses having a small projector supplying contents to the left eye and a small projector supplying contents to the right eye, respectively, have been proposed. When content is sent to both eyes of a user, there is a problem that the user feels greatly uncomfortable, such as dizziness or a lot of fatigue because the content delivered to both eyes is not identical to each other in terms of the user's perspective and is not linked to each other.

Registered Patent Publication No. 10-1549074 (2015.08.26.) Registered Patent Publication No. 10-1588402 (2016.01.19.)

The present invention has been conceived to solve the above-described problem, and an object of the present invention is to provide a head mounted display device capable of greatly reducing a user's fatigue and dizziness by projecting an image from an upper or lower direction of a face.

Another object of the present invention is to reflect the multimedia content provided by the display in both directions through a mirror around the eye, and partially reflect the content magnified by the magnifying lens unit or the auxiliary lens to both eyes through a beam splitter, and partially transmit it to the front of the eyeball. The aim is to provide smart glasses that enable the observation of the same image content formed in a virtual image in both eyes and implement 3D content as necessary or easily implement augmented reality and virtual reality using 3D content.

Smart glasses according to an aspect of the present invention for solving the above technical problem, a frame assembly having an eyeglass form; Electrical components mounted on the frame assembly; A display system including a first display device and a second display device supported by the frame assembly, controlled by a control device of the electronic component, and disposed at an upper center side and a lower center side of the frame assembly; And a first image and a first image respectively output from the first display device and the second display device, which are horizontally coupled to the display system through a case assembly fixed to the frame assembly, and are arranged in a vertical direction within the display system. 2 It includes an optical system that transmits the image in both directions in the horizontal direction through a mirror positioned between the first display device and the second display device.

In one embodiment, the optical system reflects the first image input in a first direction from the upper central side toward the lower central side from a first surface and transmits the first image in a second direction orthogonal to the first direction, The second image, which is input from the lower central side toward the upper central side, is reflected from a second surface opposite to the first surface and is orthogonal to the first reverse direction, and is opposite to the second direction. A mirror transmitting in a second reverse direction; A first right lens in the form of a concave lens through which the first image transmitted from the mirror passes; A second right lens in the form of a convex lens for passing the first image passing through the first right lens again; The first main lens reflecting a first image passing through the second right lens and supported on one front side of the frame assembly; A first left lens in the form of a concave lens through which a second image transmitted from the mirror passes; A second left lens in the form of a convex lens for passing a second image passing through the first left lens again; And the second main lens reflecting a second image passing through the second left lens and supported on the other front side of the frame assembly.

In one embodiment, the first main lens or the second main lens, a hexahedral block-shaped body; And a mirror surface, a radial surface, or a beam split disposed in the body to be inclined with a projection direction of the first image passing through the second right lens or the second image passing through the second left lens.

In an embodiment, the control device may control the first display device or the second display device so that the second image is shifted by a predetermined pixel in one direction based on the first image to correspond to binocular parallax.

In one embodiment, the control device may control the first display device or the second display device to sequentially or alternately output the first image and the second image to display a three-dimensional image or a three-dimensional image. .

In one embodiment, the first display device or the second display device includes a liquid crystal display (LCD), a digtal light processing (DLP) projector, a liquid crystal on silicon (LCoS) device, a plasma dispaly panel (PDP), and a FED. (field emission display), ELD (elelctro-luminescent display), and may include any one of OLED (organic light emitting diode) device.

The smart glasses according to another aspect of the present invention for solving the above technical problem is an optical system that is worn on the user's face in the form of glasses to display an image in front of the user's eyes, and includes a front center upper side of a frame assembly provided in the form of glasses. The first image input in the first direction toward the lower front center side is reflected from the first surface and transferred in a second direction orthogonal to the first direction, and is directed toward the upper front center side from the lower front center side. A mirror that reflects the second image input in a first reverse direction from a second surface opposite to the first surface and transmits the second image in a second reverse direction perpendicular to the first reverse direction and opposite to the second direction; A first right lens in the form of a concave lens through which the first image reflected from the mirror passes; A second right lens in the form of a convex lens for passing the first image passing through the first right lens again; The first main lens reflecting a first image passing through the second right lens and supported on a left front side of the frame assembly; A first left lens in the form of a concave lens through which a second image reflected from the mirror passes; A second left lens in the form of a convex lens for passing a second image that has passed through the first left lens again; And the second main lens reflecting a second image passing through the second left lens and supported on the front right side of the frame assembly.

In one embodiment, the combination structure of the first right lens and the second right lens or the combination structure of the first left lens and the second left lens is viewed from the mirror side, the front or one side is concave and the rear or The other surface may have a convex single lens shape.

In one embodiment, the first main lens or the second main lens, a hexahedral block-shaped body; And a mirror surface, a radial surface, or a beam split disposed in the body to be inclined with a projection direction of the first image passing through the second right lens or the second image passing through the second left lens.

Smart glasses according to another aspect of the present invention for solving the above technical problem, a frame assembly worn on the user's head; An optical system including a first main lens and a second main lens coupled to the frame assembly and disposed in front of the left and right eyes of the user; And at least one display device that provides an image between the first main lens and the second main lens.

In one embodiment, the optical system includes: a mirror disposed at a central portion between the first main lens and the second main lens; A first intermediate lens disposed between the mirror and the first main lens; And a second intermediate lens disposed between the mirror and the second main lens.

In one embodiment, the first intermediate lens or the second intermediate lens may include a concave lens and a convex lens that are sequentially disposed described in a direction of travel of an image or light of the display device.

In one embodiment, the first direction in which the image or light of the display device is output to the mirror is a second direction orthogonal to the direction of the image or light output from the first or second main lens to the user's eyes Can be The display device may include: a first display device that outputs an image to a first surface of the mirror; And a second display device that outputs an image on a second surface of the mirror that is a surface opposite to the first surface. The first display device and the second display device may be disposed to face opposite surfaces of the mirrors with the mirror interposed therebetween.

In one embodiment, the mirror includes: a first mirror that transmits an image in a third direction toward the first main lens; And a second mirror that transmits an image in a direction opposite to a third direction toward the second main lens, wherein the first display device and the second display device are configured with respect to the first mirror and the second mirror. An image may be output in the first direction or in a direction opposite to the first direction.

In one embodiment, the first direction in which the image or light of the display device is output to the mirror may be a direction parallel to the direction of the image or light output from the first or second main lens to the user's eyes. have. The display device may include: a first display device that outputs an image to a first surface of the mirror; And a second display device that outputs an image on a second surface of the mirror that is a surface opposite to the first surface. The first display device and the second display device may be disposed to face opposite surfaces of the mirrors with the mirror interposed therebetween.

In one embodiment, the mirror includes: a first mirror that transmits an image in a third direction toward the first main lens; And a second mirror that transmits an image in a direction opposite to a third direction toward the second main lens, wherein the first display device and the second display device are configured with respect to the first mirror and the second mirror. An image may be output in the second direction or in a direction opposite to the second direction.

In one embodiment, the image or light of the display device is a third direction orthogonal to an image output from the first or second main lens to the user's eyes, or a second direction in which an extension line passing through the center extends Can be output as The display device may include: a first display unit that outputs an image toward the first main lens; And a second display unit that outputs an image toward the second main lens, and the first and second display units may be a double-sided display panel or a bidirectional display panel. The display device may include: a first display device that outputs an image toward the first main lens; And a second display device that outputs an image toward the second main lens. The first display device and the second display device may be independently controlled by a control device of an electronic component.

Smart glasses according to another aspect of the present invention for solving the above technical problem, a frame assembly having a form of a wearable glasses frame on the user's head; An optical system coupled to the frame assembly such that a first main lens and a second main lens are positioned in front of the user's left and right eyes when worn on the head; And a display device configured to provide an image in a direction in which the user's eyes are positioned through the first main lens and the second main lens of the optical system when worn on the head, wherein the first main lens and the second main lens 2 The main lens includes a plate-shaped beam splitter having a thickness of several millimeters, and transmits and separates the image to show an image formed in a virtual image in the user's eyes.

In one embodiment, the optical system includes a first auxiliary lens for enlarging a first image of a first display belonging to the display device through an aspherical convex surface and a first auxiliary lens for reflecting and transmitting a first image transmitted from the first auxiliary lens. A first optical system having a first main lens, a second auxiliary lens that magnifies a second image of a second display belonging to the display device through an aspherical convex surface, and a second image transmitted from the second auxiliary lens. It may include a second optical system having a second main lens that reflects and transmits.

In an embodiment, the optical system is disposed between the first display and the first auxiliary lens to reflect the first image, and the second display is disposed between the second auxiliary lens and the It may further include a second mirror reflecting the second image.

In one embodiment, the first image is disposed on the user's brow or nose in the first display and output to a first mirror positioned above one of the user's eyes, and by the first mirror It is reflected from the upper part of the eye to the lower part of the eye, is incident on the first auxiliary lens, is enlarged by the first auxiliary lens and transmitted to the first main lens, and is reflected and transmitted from the first main lens to the user's eye. Is shown. In addition, the second image is disposed on the user's eyebrow or nose in the second display, and is output to a second mirror positioned above the other eye of the user, and the second mirror Is reflected from the lower part of the eye and is incident on the second auxiliary lens, is enlarged by the second auxiliary lens and transmitted to the second main lens, and is reflected and transmitted from the second main lens to be seen by the user's eyes.

In one embodiment, in the smart glasses, each of the first main lens and the second main lens has an empty space between adjacent side frames.

In one embodiment, the smart glasses further include a communication and power board accommodated in a left or right frame portion of the main frame and connected to one or more of the first and second displays, and the communication and power board Is connected to an external control and power device by wire and transmits signal and data communication between the control and power device and the first and second displays.

In one embodiment, the smart glasses arranges both an application processor and a battery included in the control and power device outside the smart glasses.

In one embodiment, the smart glasses have a built-in display interface for controlling the first display and the second display.

In one embodiment, the smart glasses further include a front camera installed on an outer surface of the central portion of the main frame to photograph the front side and connected to the control and power supply device through the communication and power board.

In one embodiment, the front camera includes a first front camera and a second front camera spaced apart by a predetermined interval.

In one embodiment, the smart glasses further include a rear camera or sensor installed on the inner side of the central part of the main frame to photograph the rear side and connected to the control and power device through the communication and power board.

In one embodiment, the rear camera or sensor detects the user's eyelid.

In one embodiment, the smart glasses are accommodated in one or more of the left frame portion and the right frame portion of the main frame and operate in response to a signal from the rear camera, the sensor, or the control and power supply device or actuator. Include more.

In one embodiment, the smart glasses include a speaker that is accommodated in one or more of a left frame portion and a right frame portion of the main frame and outputs an alarm in response to a signal from the rear camera, the sensor, or the control and power supply device. Include more.

In one embodiment, the control and power supply device includes a control device and a power supply device, and at least one of the control device and the power supply device is supported by a main frame or mounted on an external device, and data to be mounted on the external device and It is connected to the communication and power board through a power line.

In the case of employing the smart glasses and the optical system thereof according to the present invention, it is possible to significantly reduce the fatigue and dizziness of the user's eyes, thereby improving the fit and convenience of use. In addition, it is possible to provide an excellent fit by minimizing weight and designing with an ergonomic structure and design. In addition, there is an advantage in that it is possible to easily supply power for a long time use by a battery replacement method.

In addition, by preventing fatigue and dizziness and increasing the fit, it is used for a long time when using contents such as virtual reality (VR), augmented reality (AR), converged reality (MR), and mixed reality (MR) using smart glasses. You can provide an environment. In addition, it can be applied effectively or easily to various fields such as working or working without a monitor, shopping, using as a navigation device, playing AR, VR or MR games, watching videos, or making video calls. There is this.

In addition, according to the present invention, there is an advantage of securing a side viewing angle by configuring to provide independent images to both eyes on one or two displays disposed at the front center of the smart glasses.

In addition, there is an effect of effectively implementing 2D and 3D images with one smart glasses, and implementing augmented reality and virtual reality.

In addition, by providing the same multimedia content to both eyes on one or two displays, there is an effect that the user does not feel uncomfortable even when used for a long time.

In addition, by reducing the thickness of the front main lens, the device can be lightened and the feeling of use can be improved.

In addition, by recognizing the user's eyelids through a rear camera or sensor and generating vibrations or alarms through actuators, actuators, or speakers housed in the device according to the recognition result, the user, in particular, a drowsy driver can be warned of danger.

In addition, it is possible to provide operational stability and reliability for smart glasses by effectively discharging heat that may be generated when the device is used for a long time through a heat dissipation structure or a heat sink disposed on the front top of the main frame.

In addition, when the battery is removed from the smart glasses and power is supplied to the smart glasses through the battery to an external control and power device, the smart glasses can be effectively lightened and the fit and convenience of use can be increased.

1 is a perspective view of smart glasses according to an embodiment of the present invention.
2 is an exploded perspective view of the smart glasses of FIG. 1.
3 is a partial exploded perspective view for explaining the main operating principle of the smart glasses of FIG. 1.
4 is a perspective view showing an enlarged structure of the rear case of the smart glasses of FIG. 3.
5 is a view for explaining an optical system employed in the smart glasses of FIG. 4.
6 is a perspective view of smart glasses according to another embodiment of the present invention.
7 is a plan view of the smart glasses of FIG. 6.
8 is a bottom view of the smart glasses of FIG. 7.
9 is a front view of the smart glasses of FIG. 7.
10 is a rear view of the smart glasses of FIG. 7.
11 is a left side view of the smart glasses of FIG. 7.
12 is a right side view of the smart glasses of FIG. 7.
13 is an exemplary view showing a wearing state of the smart glasses of FIG. 7.
14 is another exemplary view showing a state of wearing the smart glasses of FIG. 7.
15 is another exemplary view showing a state of wearing the smart glasses of FIG. 7.
16 is a block diagram illustrating a main configuration of a main control board that can be employed in smart glasses according to another embodiment of the present invention.
17 and 18 are diagrams for explaining a main configuration of smart glasses according to another embodiment of the present invention.
19 to 25 are diagrams for explaining an optical system employed in smart glasses according to still other embodiments of the present invention.
26 to 29 are diagrams for explaining an optical system employed in smart glasses according to still other embodiments of the present invention.
30 is a diagram for explaining a main configuration of smart glasses according to another embodiment of the present invention.
31 is a perspective view of smart glasses according to another embodiment of the present invention.
32 is a front view of the smart glasses of FIG. 31.
33 is a partial projection front view for explaining the internal structure of the smart glasses of FIG. 32.
34 is a right side view of the smart glasses of FIG. 31.
FIG. 35 is a partial projection right side view showing the internal structure of the smart glasses of FIG. 34.
36 is a partial exploded perspective view for explaining the components of the smart glasses of FIG. 31.
37 is a block diagram of a control board that can be employed in the smart glasses of FIG. 31.
38 is a perspective view of smart glasses and a control system according to another embodiment of the present invention.
39 is a block diagram illustrating a main configuration of the smart glasses of FIG. 38.
40 is a block diagram illustrating a control module that can be employed in the smart glasses of FIG. 38.
41 and 42 are flowcharts illustrating a main operating principle of the smart glasses of FIG. 38.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals shown in each drawing indicate the same member.

1 is a perspective view of smart glasses according to an embodiment of the present invention. 2 is an exploded perspective view of the smart glasses of FIG. 1. 3 is a partial exploded perspective view for explaining the main operating principle of the smart glasses of FIG. 1. 4 is a perspective view showing an enlarged structure of the rear case of the smart glasses of FIG. 3. And FIG. 5 is a diagram for describing an optical system employed in the smart glasses of FIG. 4.

1 to 5, the smart glasses 100 according to the present embodiment include a frame assembly 10, an electronic component, a display system 30, and an optical system 50. The display system 30 may include a case assembly 60 and an optical system 50 in addition to the first display device 31 and the second display device 32.

The display devices, the optical system 50, and the case assembly 60 may be cross-arranged in a form arranged on three different axes in a Cartesian coordinate system, and a mirror 51 is disposed at the center of this cross-array structure, The first display device 31 and the second display device 32 may be disposed on both sides with the mirror 51 interposed therebetween.

The frame assembly 10 forms a shape of glasses by a plurality of frames. The frame assembly includes an upper frame (11), a lower frame (12), a body frame (13), a right cover frame (14) and a left cover frame (15). ) Can be included. A nose pad 18 may be coupled to the body frame 13.

The lower frame 12 accommodates the main control board 21 in the central receiving portion. The central receiving portion may be covered by the upper frame 11. The lower frame 12 includes a first printed circuit board 23 and a first battery pack 24 connected to the first printed circuit board 23 in a first receiving part in a right side extension connected to the right side of the central receiving part. ) Can be stored. The first accommodating part may be covered by the right cover frame 14. A button-type power button 22 is installed on the right cover frame 14, and the power button 22 may be connected to the first printed circuit board 23. The first printed circuit board 23 may connect the battery management system in the first battery pack 24 and the control device 210 of the main control board 21.

In addition, the lower frame 12 is a second printed circuit board 25 and a second battery pack connected to the second printed circuit board 25 in the second receiving portion in the left side extension connected to the left side of the central receiving portion. (26) can be stored. The second storage unit may be covered by the left cover frame 15. The second printed circuit board 25 may connect the battery management system in the second battery pack 26 and the control device 210 of the main control board 21.

The body frame 13 is coupled to the lower portion of the lower frame 12. The body frame 13 is installed between the lower frame 12 and the case system 60 to support their coupling. In addition, the body frame 13 is coupled to the lower portion of the lower frame 12 to complement and increase the overall durability of the smart glasses.

The electronic components may be mounted or accommodated in the frame assembly 10. Electrical components include a main control board (21), a power switch (22), a first control board (23), a first battery pack (24), a second control board (25) and a second battery. Pack 26 may be included. The first control board 23 may correspond to a first printed circuit board, the second control board 25 may correspond to a second printed circuit board, and the battery pack may be simply referred to as a battery.

The first display device 31 and the second display device 32 are controlled by a control device of an electronic component, and may be disposed at an upper center side and a lower center side of the frame assembly, respectively.

In this embodiment, the first display device 31 or the second display device 32 includes an LCD (liquid crystal display). In this case, the first display device 31 and the second display device 32 may include backlight units 33 and 34.

On the other hand, the display device of the present invention is not limited to LCD, and reflective micro-display (liquid crystal on silicon, LCoS), plasma dispaly panel (PDP), field emission display (FED), electro-luminescent display (ELD), and OLED It can be replaced with any one of (organic light emitting diode).

The optical system 50 transmits the first image output from the first display device 31 and the second image output from the second display device 32 to both eyes of the user and controls the image size to control the first main lens ( 54) and the second main lens 57, respectively.

The optical system 50 includes a mirror 51, the first right lens 52, the second right lens 53, the first main lens 54, and A first left lens (55), a second left lens (56), and a second main lens (the second main lens) 57 may be included.

The mirror 51 reflects a first image input in a direction (first direction) from the front center of the smart glasses or from the upper side of the center of the optical system toward the lower side of the center (first direction), and reflects the second image orthogonal to the first direction. Pass in the direction. In addition, the mirror 51 reflects the second image input in a direction from the lower side of the center toward the upper side of the center (a first reverse direction facing the first direction) from a second surface opposite to the first surface. It can be transmitted in a second reverse direction orthogonal to the first reverse direction and opposite to the second direction.

The first right lens 52 may have a concave lens shape and may pass the first image transmitted from the mirror 51. The first right lens 52 may first pass the first image. The second right lens 53 may have a convex lens shape and may secondly pass the first image passing through the first right lens 52. The first right lens 52 and the second right lens 53 may form a single lens shape in which light incident through the concave surface of one end is emitted through the concave surface of the other surface.

The first main lens 54 may reflect and transmit the first image that has passed through the second right lens 54. The first main lens 54 may be supported by a frame assembly or a cover and may be disposed on one front side of the smart glasses. The first main lens 54 may be arranged in front of the user's right eye.

The first left lens 55 has a concave lens shape and may pass a second image transmitted from the mirror 51. The first left lens 55 may first pass the second image in a direction opposite to the first right lens 52. The second left lens 56 may have a convex lens shape and may secondly pass the second image passing through the first left lens 55. The first left lens 55 and the second left lens 56 may correspond to a single lens structure in which light incident through one concave surface is emitted through the convex surface of the other surface, but is not limited thereto.

The second main lens 57 may reflect and transmit the second image passing through the second left lens 56. The second main lens 57 may be supported by a frame assembly or a cover and may be disposed on one front side of the smart glasses. The second main lens 57 may be arranged in front of the user's left eye.

The combination of a circular point and a circle surrounding it on the first main lens 54 described above is for expressing that the first image comes out of the ground, and the circular point and the circle surrounding it on the second main lens 57 The combination is for expressing that the first image is a direction coming out of the ground (see Fig. 5).

In order to form a reliable structure of the above-described display devices and the optical system 50, in this embodiment, the two display devices of the optical system are orthogonal to the second direction (or horizontal direction) in which the components of the optical system 50 are arranged. Arrange in the first direction (or vertical direction). The two display devices 31 and 32 may be disposed above and below the mirror 51 of the optical system 50 at the center. The mirror 51 is also located in the center of the components of the optical system 50 arranged in the second direction, thereby having the components of the optical system 50 arranged to transmit image signals in two directions opposite to each other. .

To this end, the rear case 62 of the present embodiment, as shown in FIG. 4, the first seating groove 620 in which the mirror 51 is seated, and the first upper seating for seating the first display device 31 It includes a groove 621 and a first lower seating groove 622 for seating the second display device 32. When the first display device 31 is an LCD panel, a second upper mounting groove 631 for accommodating the backlight unit 33 may be further provided above the first upper mounting groove 621. Similarly, a second lower seating groove for accommodating the backlight unit 34 of the second display device 32 may be provided under the first lower seating groove 622.

Further, as shown in FIG. 4, the rear case 62 includes a second seating groove 625 for seating the first right lens 52 and the second right lens 53, and a first main lens 54. It may be provided with a third seating groove 626 for receiving and supporting. Similarly, the rear case 62 has a fourth seating groove 627 for seating the first left lens 55 and the second left lens 56, and for receiving and supporting the second main lens 57. A fifth seating groove 628 may be provided. The first main lens 54 and the second main lens 57 are primarily supported by the front case 61 and the rear case 62, and a front cover 63 surrounding the outside of the front case 61 Wow, it can be firmly supported by the coupling of the rear cover 64 surrounding the outside of the rear case 62.

In addition, the rear case 62 may include a fastening portion 629 for fastening with the body frame 13. The fastening part 629 may have a screw hole.

The front cover 63 may be referred to as a first outer case, in which case the front case 61 may be referred to as a first inner case. Similarly, the back cover 64 may be referred to as a second outer case, in which case the back case 63 may be referred to as a second inner case.

In this embodiment, the optical system does not provide the first image and the second image from the side of the user's face, but transmits the first image and the second image from the forehead and nose side to the glabellar side of the user's face. The image size is adjusted and focused through the concave lens and the convex lens while being transferred to the front, and the first main lens 54 and the second main lens 57 in front of the user's eyes are visible based on the user's perspective. One image and a second image can be displayed.

6 is a perspective view of smart glasses according to another embodiment of the present invention. 7 is a plan view of the smart glasses of FIG. 6. 8 is a bottom view of the smart glasses of FIG. 7. 9 is a front view of the smart glasses of FIG. 7. 10 is a rear view of the smart glasses of FIG. 7. 11 is a left side view of the smart glasses of FIG. 7. 12 is a right side view of the smart glasses of FIG. 7. 13 is an exemplary view showing a wearing state of the smart glasses of FIG. 7. 14 is another exemplary view showing a state of wearing the smart glasses of FIG. 7. 15 is another exemplary view showing a state of wearing the smart glasses of FIG. 7.

6 to 15, the smart glasses 100 according to the present embodiment are substantially the same as the smart glasses described above with reference to FIGS. 1 to 5, implemented through a 3D program, and The form is shown and its composition can be clearly seen.

As described above, in this embodiment, gesture recognition, 3D realization, virtual reality image playback, and increased reality services are provided through smart glasses having a simple structure, while eliminating problems arising from use such as dizziness or nausea of users, and convenient to use. A simple structure can provide smart glasses that can reduce manufacturing costs.

Among the services provided by the aforementioned Smarton glasses, basic signal processing technologies for gesture recognition, 3D implementation, virtual reality image reproduction, and increased reality services are well known in the art, and thus detailed descriptions thereof will be omitted.

16 is a block diagram illustrating a main configuration of a main control board that can be employed in smart glasses according to another embodiment of the present invention.

Referring to FIG. 16, in the main control board 21 according to the present embodiment, the control device 210 may include a communication unit 211, a processor 212, and a memory 213. The control device 2120 may include a controller or a computing device. The processor 212 may be referred to as a control unit.

The communication unit 211 connects the control device 210 to a network. The communication unit 211 may access the Internet or various servers on the network through a network, and may operate in cooperation or interworking with various servers. The server may include a server supporting virtual reality, a server supporting augmented reality, and the like.

The communication unit 211 may include one or more wired and/or wireless communication subsystems supporting one or more communication protocols. The wired communication subsystem is a public switched telephone network (PSTN), ADSL (Asymmetric Digital Subscriber Line) or VDSL (Very high-data rate Digital Subscriber Line) network, a subsystem for PES (PSTN Emulation Service), and IP (internet protocol). Multimedia subsystems (IMS), and the like. The wireless communication subsystem may include a radio frequency (RF) receiver, an RF transmitter, an RF transceiver, an optical (eg, infrared) receiver, an optical transmitter, an optical transceiver, or a combination thereof.

The wireless network basically refers to Wi-Fi, but is not limited thereto. In this embodiment, the communication unit 211 includes various wireless networks, for example, Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Code Division Multiple Access (CDMA), and W-Code Division Multiple Access (W-CDMA). Access), LTE (Long Term Evolution), LET-A (LET-Advanced), OFDMA (Orthogonal Frequency Division Multiple Access), WiMax, Wi-Fi (Wireless Fidelity), Bluetooth, etc. I can.

The processor 212 may provide various services through smart glasses by executing a software module or program stored in the internal memory or the memory 213. The processor 212 may be referred to as a microprocessor.

The processor 212 may be implemented as a processor or microprocessor including at least one central processing unit (CPU) or core. The central processing unit or core is a register storing instructions to be processed, an arithmetic logical unit (ALU) in charge of comparison, judgment, and operation, and the CPU internally for interpretation and execution of instructions. It may be provided with a control unit (control unit) to control, and an internal bus connecting them. The central processing unit or core may be implemented as a system on chip (SOC) in which a micro control unit (MCU) and a peripheral device (an integrated circuit for an external expansion device) are disposed together, but is not limited thereto.

Further, the processor 212 may include one or more data processors, image processors, or codecs, but is not limited thereto. The control unit 212 may include a peripheral device interface and a memory interface. The peripheral device interface may connect the processor 212 and an input/output system such as an output device or other peripheral devices, and the memory interface may connect the processor 212 and the memory 213.

In this embodiment, the processor 212 includes the first battery pack 24 and the second battery in order to secure a relatively long operating time for a single charge of the battery even under an operating condition that consumes a relatively large amount of power by the image display. Controls the pack 26. To this end, the processor 212 may be connected to and communicate with the battery management system (BMS) 240 of each battery pack. In addition, the processor 212 may be connected to a control device or a timing controller of at least one or both of the two display devices of the display system 30, and control the operation of the display device through this.

The memory 213 may store a software module for providing services such as object recognition, gesture recognition, virtual reality, and augmented reality through smart glasses. For example, the software module includes: a first module 215 for recognizing a control destination; A second module 216 for providing a 3D image or controlling 3D; A third module 217 for providing a display image service of virtual reality; It may include a fourth module 218 and the like for providing a display image service of an augmented reality that adds a virtual object to the currently visible real world image. Such a module may be implemented by the processor 212 and implemented as at least one task processor that performs a specific function or operation within the processor 212.

The above-described memory 213 is a semiconductor memory such as non-volatile random access memory (NVRAM), a typical volatile memory such as dynamic random access memory (DRAM), a hard disk drive (HDD), and optical storage. It can be implemented as a device, flash memory, or the like. In addition, the memory 56 may store an operating system, a program, an instruction set, and the like, in addition to software modules for implementing the print production service method.

Meanwhile, in the above-described embodiment, components of the smart glasses device may be implemented as functional blocks or modules mounted on various computing devices based on nonvolatile memory (NVRAM). For example, the software modules stored in the memory of the processor of FIG. 15 are stored in a computer-readable medium (recording medium) in the form of software for implementing a series of functions performed by them, or in a storage device in a remote server device in the form of a carrier. It may be implemented to operate on a specific computing device that is stored and connected via a network with the server device. Here, the computer-readable medium may include a plurality of computer devices connected through a network or a memory or storage device of a cloud system, and at least one of the plurality of computer devices or cloud systems provides various services in the smart glasses of the present embodiment. You can save the program or source code to implement.

Further, the computer-readable medium may be implemented in a form of singly or in combination with program instructions, data files, and data structures. The programs recorded on the computer-readable medium may include those specially designed and configured for the present invention or those known and usable to those skilled in computer software.

In addition, the computer-readable medium may include a hardware device specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Here, the program instruction may include a high-level language code that can be executed by a computer using an interpreter or the like as well as a machine language code that is generated by a compiler. The hardware device may be configured to operate as at least one software module to implement all services that can be provided through the smart glasses of the present embodiment, and vice versa.

17 and 18 are views for explaining the main configuration of smart glasses according to another embodiment of the present invention.

The smart glasses according to this embodiment may have a structure as shown in FIGS. 17 and 18. That is, the smart glasses according to the present embodiment have a rear case 62a having a different shape and structure, and the first display device 31, the second display device 32, and the first mirror are provided by the rear case 62a. (51a), second mirror (51b), first lenses (52, 55), second lenses (53, 56), first main lens (54) and second main lens (57) are combined in a single module form It can be provided.

The first mirror 51a may be referred to as a first reflective mirror, the second mirror 51b may be referred to as a second reflective mirror, and the first main lens 54 may be referred to as a first beam splitter. May be referred to as, and the second main lens 57 may be referred to as a second beam splitter.

In this embodiment, an LCD is used as a display device, and in that case, the rear case 62a may integrally combine the first backlight 33 and the second backlight 34 with the other components described above. Depending on the implementation, the backlight may be integrally provided in the LCD device.

Except for the structure of the rear case 62a, the first display device 31, the second display device 32, the first mirror 51a, the second mirror 51b, the first lenses 52, 55, Since the second lenses 53 and 56, the first main lens 54, and the second main lens 57 are substantially the same as the corresponding components of the above-described embodiment, detailed descriptions thereof will be omitted.

When an image is projected through two display devices with both eyes of the user for image projection, virtual reality, augmented reality, 3D viewing, etc., the rear case 62a is substantially used by most users even when used for a long time. It has a structure that does not cause dizziness. This structure may include disposing the first display device 31 and the second display device 32 to have a stepped portion (hereinafter, referred to as a first stepped portion) by the rear case 62a. According to the stepped portion, the first backlight 33 and the second backlight 34 coupled to the first display device 31 may also include a second stepped portion 33a corresponding to the first stepped portion.

In addition, a stepped portion 62s (hereinafter, a third stepped portion) may be provided on one side of the rear case 62a together with the structure of the above-described first stepped portion and/or the second stepped portion 33a. .

When the above-described stepped portions are configured so that the image projection position from the display device proceeds in both directions in which the main lenses are respectively located in the middle portion of the smart glasses corresponding to the user's nose or brow It can be a condition. In addition, the above-described stepped portions may be image alignment conditions corresponding to binocular parallax for providing a 3D image to a user.

Meanwhile, the present invention is not limited to a configuration including the above-described stepped portion, and may be implemented to adjust an image projection position or an image alignment condition by software without forming a stepped portion in the two display devices, the backlight or the rear case. .

In addition, the rear case 62a may include a core portion 62b positioned in the center when viewed from the front, and island-shaped openings 62c formed at both sides of the core portion 62b, respectively. In addition, the rear case 62a may have a concave opening formed on the lower side of the core portion 62b. According to this configuration, there is an advantage that the weight of the rear case 62a can be significantly reduced.

19 to 25 are diagrams for explaining an optical system employed in smart glasses according to still other embodiments of the present invention. 22 and 24 may correspond to a case where the optical system of the smart glasses is viewed from the user's eye side, and FIGS. 23 and 25 may correspond to a case where the optical system of the smart glasses is viewed from the user's head.

19 to 25, the smart glasses according to the present embodiment are coupled to a frame assembly worn on the user's head and disposed in front of the user's left and right eyes, and a first main lens and a second main lens. It includes an optical system (optical system, 50, 50A, 50B, 50C) including. At least one display device 31; 32; 31D that provides an image may be provided between the first main lens and the second main lens of the optical system.

The optical systems 50, 50A, and 50B include at least one mirror 51, 51a disposed in the center between the first main lens 54 and the second main lens 57, as shown in FIGS. 19 to 22. , 51b), a first intermediate lens disposed between the mirror and the first main lens 54, and a second intermediate lens disposed between the mirror and the second main lens 57 may be further included. The first intermediate lens or the second intermediate lens may include concave lenses 52 and 55 and convex lenses 53 and 56 that are sequentially disposed described in the direction of travel of the image or light of the display device.

The display device may include a first display device 31 that outputs an image to a first surface of the mirror, and a second display device 32 that outputs an image to a second surface of the mirror that is opposite to the first surface. I can. In addition, the first display device 31 and the second display device 32 may be disposed to face opposite surfaces of the mirror 51 with the mirror 51 interposed therebetween (see FIGS. 5 and 19 ).

On the other hand, the image of each of the first and second display devices with respect to the mirror 51 or the first direction in which light is output or the opposite direction to the first direction is an image output from the first or second main lens to the user's eyes. Alternatively, it may be a second direction orthogonal to the direction of light (see FIG. 5). However, the present invention is not limited to such a configuration. If the display device is positioned between the two main lenses, the first direction in which the image or light of each of the first and second display devices is output or a direction opposite to the first direction is the user from the first or second main lens. It may be an image output to the eyes of a person or a direction parallel to the direction of light (see FIG. 19).

In another embodiment, the mirror is a first mirror that transmits an image received from the first display device 31 to a third direction toward the first main lens 54, as shown in FIGS. 20 and 21. A second mirror 51b for transmitting an image 51a and an image received from the second display device 32 in a direction opposite to the third direction toward the second main lens 57 may be provided. In that case, the first display device 31 and the second display device 32 output images in the first direction or in a direction opposite to the first direction with respect to the first mirror 51a and the second mirror 51b. It can be arranged to be (see Fig. 20).

Of course, depending on the implementation, the direction in which the image or light of each display device 31 and 32 is output with respect to the first mirror 51a and the second mirror 51b is the first or second main lens 54 and 57 It may be a direction parallel to an image output to the user's eyes or a direction of light (second direction) in (see FIG. 21). In this case, the first display device 31 and the second display device 32 may be positioned between the user's face and the mirror when the user wears smart glasses, or may be disposed to face the user's face by posting a mirror. .

In another embodiment, the image or light of the display device is a third direction orthogonal to an image output from the first or second main lens to the user's eyes, or a second direction in which an extension line passing through the center thereof extends It can be output as (see Figs. 22 to 25).

In the above-described case, the display device 50B may include a first display unit that outputs an image to the first main lens 54 and a second display unit that outputs an image to the second main lens 57. . The first display unit and the second display unit may be a double-sided display panel or an interactive display panel 31D (see FIGS. 22 and 23 ). Of course, depending on the implementation, the first display unit and the second display unit may be disposed as separate display devices, respectively (see FIGS. 24 and 25).

The above-described first and second display devices or the first and second display units may be independently controlled by a control device of an electronic component.

26 to 29 are diagrams for explaining an optical system employed in smart glasses according to still other embodiments of the present invention. 30 is a diagram for explaining a main configuration of smart glasses according to another embodiment of the present invention.

In this embodiment, an optical system including the first auxiliary lenses 52a, 52b, 53 and the first main lens 54a will be described, but the second auxiliary lenses 55a, 55b, 56 and the second main lens ( It goes without saying that the same can be applied to the optical system including 57a).

26 to 29, the smart glasses 50D, 50E, 50F, and 50G according to the present embodiment include a first auxiliary lens 52a, 52b, 53 and a first main lens 54a. Or a right optical system, and a second or left optical system including the second auxiliary lenses 55a, 55b, and 56, and the second main lens 57a.

In this embodiment, the first main lens 54a and the second main lens 57a are formed of plate-shaped reflective and transmissive members, and the central axes of each of the first main lens 54a and the second main lens 57a And are arranged inclined in a certain angle range. The first main lens 54a and the second main lens 57a may be a beam splitter in the form of a plate member having a thickness of several millimeters or less.

In addition, the smart glasses of this embodiment may include at least one display device 31D, preferably two display devices 31 and 32, and may include one mirror 51 or two mirrors depending on the implementation. (51a, 51b) can be provided.

The display device is arranged to output an initial image in a front direction or a face direction of a user wearing smart glasses, or is arranged to output an initial image in a vertical direction from the upper side of the face to the lower side or from the lower side to the upper side. It may be arranged to output an initial image toward both eyes between the eyes (glabellar) or above the nose. The distance W1 between both eyes may substantially correspond to a distance between the centers of the first and second main lenses 54a and 57a.

Referring to FIG. 30, in the smart glasses 50H according to the present exemplary embodiment, the first main lens 54a faces the first auxiliary lens and is inclined in a range of approximately 30 degrees to 60 degrees. In addition, the first auxiliary lens includes a first convex one-sided lens 52a, a first two-sided convex lens 52b, and a first convex lens 53.

One surface of the first one-sided convex lens 52a has a convex surface, and the other surface has a concave surface. The curvature of the concave surface of the first convex lens 52a may be set to be substantially similar to or equal to the curvature of the convex surface facing the first convex lens 52b.

The first double-sided convex lens 52b has a convex surface on both its one side and the other side. The radius of curvature of the convex surface of one surface and the convex surface of the other surface may be the same, but is not limited thereto.

The first convex lens 53 may have a convex surface facing the convex surface of the other surface of the first double-convex lens 52b, and a surface opposite to the convex surface may have a planar shape.

According to the above-described configuration, the first and second images output from the first and second displays 31 and 32 of the smart glasses according to the present embodiment are the first and second mirrors 51a and 51b. After being reflected from each other, it is enlarged by a combination of the convex surfaces of the first auxiliary lens and the second auxiliary lens, and then divided and reflected from the reflection surface of the first main lens 54a and the reflection surface of the second main lens 57a. As a result, the main lenses 54a and 57a are projected to the rear and front surfaces of each. The reflective surface may be referred to as a beam split surface.

Here, the first image and the second image are enlarged by the combination of the convex surface of the first auxiliary lens and the convex surface of the second auxiliary lens, and the spherical surface by the aspherical convex surface of the first auxiliary lens and the second auxiliary lens. The aberration can be eliminated.

In addition, the first image and the second image to be focused at a predetermined position on the front surface of the first and second main lenses 54a and 57a may form a predetermined single image plane or a virtual image plane. Of course, in the case of a stereoscopic (3D) image, a virtual reality image, an augmented reality image, it is of course possible to provide a multi-layer image surface/virtual image surface.

In addition, in the smart glasses of the present embodiment, each of the main lenses 54a and 57a has an empty space between the side frame (see 112b in FIG. 31 ). In this way, by not disposing any components outside the side surfaces of each of the main lenses 54a and 57a, there is an advantage of providing the maximum wide viewing angle without limiting the viewing angle of the smart glasses wearer.

In addition, according to the present embodiment, the content implemented in the display can be enlarged using the auxiliary lens. In such a case, the distance from the auxiliary lens to the magnified image can be adjusted as necessary. That is, the image enlarged by the auxiliary lens is a virtual image, not a real image, and its size or resolution can be easily adjusted so that the user can see it through the smart glasses.

The distance (li) to the virtual image felt by the user through the main lens may be adjusted by a relationship between the focal length (f) of the main lens and the distance (lo) from the display to the reflective surface of the main lens. The relationship between the distances satisfies Equation 1.

According to this embodiment, it can be designed and manufactured so that an enlarged image can be formed at a location desired by the user. In addition, it can be configured to implement content of about 20 inches in front of the smart glasses about 2.4 meters. That is, about 20 inches of content can be provided about 2 meters in front of the smart glasses, and users can easily implement and use augmented reality or virtual reality as needed.

31 is a perspective view of smart glasses according to another embodiment of the present invention. 32 is a front view of the smart glasses of FIG. 31. 33 is a partial projection front view for explaining the internal structure of the smart glasses of FIG. 32. 34 is a right side view of the smart glasses of FIG. 31. FIG. 35 is a partial projection right side view showing the internal structure of the smart glasses of FIG. 34. 36 is a partial exploded perspective view for explaining the components of the smart glasses of FIG. 31.

The smart glasses 100 according to the present embodiment include a main frame 110, a first display 131, a second display 132, a first mirror 133, a second mirror 134, and a first main lens. (137) and a second main lens (138). In addition, the smart glasses 100 may further include a first auxiliary lens 135 and a second auxiliary lens 136.

In addition, the smart glasses 100 includes a controller including a processor (refer to 210 in FIG. 37), a display interface 160 for the first and second displays 131 and 132, and a flexible print connecting them. A flexible printed circuit board (FPCB) 164 may be provided. The controller may be referred to as a control and power device, and may be embedded or have separate communication and power boards. The communication and power board may include a connector or a means or component for relaying or interconnecting communication or power.

In addition, the smart glasses 100 may include one or more front cameras 151 and one or more rear cameras 153. When the front camera 151 includes a first front camera and a second front camera that are spaced apart from each other by a predetermined interval, it is possible to easily input or apply 3D content. The front or rear camera is a kind of sensor or can function as a sensor. In particular, the rear camera 153 or the sensor may be a means for detecting a user's eyelid motion or a device for performing a function corresponding to such a means.

In addition, the smart glasses 100 may further include an actuator or actuator 194 that vibrates in response to signals from a camera or sensor or a control and power supply device, or a speaker that outputs an acoustic signal in response to the signal. I can. The driver 194 may include a vibration motor.

In addition, the smart glasses 100 may further include a heat dissipation structure or a heat sink for dissipating heat generated from the first display 131, the second display 132, and the display interface 160. At least one of the first display 131 and the second display 132 may be referred to as a display unit. The display simply refers to a display device, and when the display is a liquid crystal display device, the display may include a backlight unit.

To describe each component in more detail, the main frame 110 is formed of a solid material having an approximately U-shape and has a shape of a frame or a frame of a frame. The main frame 110 may be formed of a single structure, and in that case, the main frame 110 includes a central frame portion 110c and a left frame portion 110a and a right frame portion ( 110b) may be provided. The left and right sides may be opposite sides from the user's point of view.

On the other hand, in this embodiment, the main frame 110 is a combination structure of a support frame disposed in the middle for ease of manufacture and weight reduction, a first side frame coupled to the left side of the support frame, and a second side frame coupled to the right side. It can be provided. In this case, the support frame may be detachably formed as the first support frame 120a and the second support frame 120b in order to facilitate support, arrangement, and assembly of the display, mirror, auxiliary lens, and main lens.

Here, for convenience of explanation, the left frame portion and the first side frame are denoted by a single reference numeral 110a, and the right frame portion and the second side frame are denoted by a single reference numeral 110b. The support frame 120 may refer to a form in which the first support frame 120a and the second support frame 120b are combined.

The display interface 160 is inserted in the central portion of the support frame 120 and may be electrically connected to the controller through a terminal of a flexible printed circuit board (FPCB) 164 disposed on the upper central side. In addition, the display interface 160 is connected to the first display 131 and the second display 132.

The FPCB 164 may be installed extending from the terminal at the central front portion to the first side frame 110a and the second side frame 110b along the upper surface of the main frame 110 or the support frame 120.

The first display 131 and the second display 132 are disposed on both side surfaces of the box-shaped central portion of the support frame 120 to output a first image and a second image in opposite directions. The first display 131 or the second display 132 is a thin film transistor liquid crystal display (TFT LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), It may include at least one selected from a digital light processing (DLP) based display.

A first mirror 133 supported by a support structure portion on the left inclined surface of the support frame 120 is installed in the front of the first display 131, and the first image of the first display 131 is substantially perpendicular to the left direction. It can reflect in the first downward direction. Similarly, a second mirror 134 supported by a support structure portion of the right inclined surface of the support frame 120 is installed on the front of the second display 132 and the second image of the second display 132 is directed to the right. It may reflect in a second downward direction approximately orthogonal to. The second downward direction may be a direction parallel to each other with a distance approximately equal to a distance between two eyes of the user.

The first image reflected by the first mirror 133 is enlarged by the first auxiliary lens 135. The first auxiliary lens 135 may be supported by being inserted into a support structure having an uneven structure of the support frame 120. The first auxiliary lens 135 magnifies the first image and transmits it to the first main lens 137.

Similarly, the second image reflected by the second mirror 134 is enlarged by the second auxiliary lens 136. The second auxiliary lens 136 may be supported by being inserted into a support structure having an uneven structure of the support frame 120. The second auxiliary lens 136 magnifies the second image and transmits it to the second main lens 138.

The first auxiliary lens 135 or the second auxiliary lens 136 is a stacked structure or overlapping of a single-sided convex lens (the other-sided concave lens), a double-sided convex lens, and a single-sided convex lens when the image is viewed from the input end side. May have an arrangement. The above-described first and second auxiliary lenses 135 and 136 are for enlarging the first image and the second image to a desired size and removing spherical aberration, and various modifications are possible according to implementation.

The first main lens 137 is disposed under the first auxiliary lens 135. The first main lens 137 may have an arrangement structure in which a relatively thin plate-shaped lens member is installed to be inclined with a central axis of the first auxiliary lens 135. The first main lens 137 may be coupled to the lower side of the support frame 120 or the central frame portion 110c (hereinafter, briefly the central frame) at the lower side of the first auxiliary lens 135. The first main lens 137 is a beam splitter and may reflect a first image or a first image passing through the first auxiliary lens 135 toward the user's eyes at a substantially right angle. The first main lens 137 may correspond to the first main lens 54a or the second main lens 57a of FIG. 30.

For example, a first image descending from the first mirror 133 in a substantially vertical direction forms an image directed toward the user's eyes and a virtual image toward the front of the user's eyes, centered on the reflective surface of the first main lens 137. The distance from the reflective surface to the location where the bed forms or the image plane may be about 20 meters.

Similarly, the second main lens 138 is disposed under the second auxiliary lens 136. The second main lens 138 may have an arrangement structure in which a relatively thin plate-shaped lens member is installed to be inclined with a central axis of the second auxiliary lens 136. The second main lens 138 may be coupled to a lower side of the support frame 120 or the central frame 110c from the lower side of the second auxiliary lens 136. The second main lens 138 is a beam splitter and may reflect a second image that has passed through the second auxiliary lens 136 toward the user's eye at a substantially right angle.

For example, the second image descending from the second mirror 134 in a substantially vertical direction forms an image directed toward the user's eye and a virtual image toward the front of the user's eye based on the reflective surface of the second main lens 138.

The convex surfaces of the auxiliary lenses 135 and 136 described above may be installed to include three aspherical lenses to enlarge an image or content and eliminate spherical aberration.

In addition, the nose ring member 140 may be connected to the lower central side of the support frame 120. At least a portion of the nose ring member 140 may be made of a relatively soft material. The soft material may include synthetic resin.

The upper cover 113 is coupled to the central upper side of the main frame 110, the front upper cover 114 is coupled to the central front upper side, and the front auxiliary cover 115 may be coupled to the upper center of the central front. The front upper cover 114 may include the first and second support frames 120a and 120b, and may be coupled to the central frame 120c by fastening means such as screws or bolts with the rear cover 112c. The front auxiliary cover 115 may cover the exposed lens portion of the front camera 151, and in that case, at least a portion of the front auxiliary cover 115 may be formed of a transparent or translucent material. In addition, depending on implementation, the front auxiliary cover 115 may have an opening or a through hole for exposing the lens of the front camera 151.

One end of the first side frame 110a may be connected to the left side of the support frame 120, and the other end may be connected to the first side connection frame 121. The first side connection frame 121 may be connected to a first side end frame 122. The first side end frame 122 has an inner space for accommodating the first battery 172, and the opening of the inner space facing the second side end frame 125 to be described later is in the first flexible cover 123 It can be covered detachably. The first side connection frame 121 and the first flexible cover 123 may be formed of rubber or a soft synthetic resin material in order to improve a fit with at least a surface portion thereof in contact with a user's ear and a rear portion thereof.

Similarly, one end of the second side frame 110b may be connected to the right side of the support frame 120 and the other end of the second side frame 110b may be connected to the second side connection frame 124. The second side connection frame 124 may be connected to a second side end frame 125. The second side end frame 125 has an inner space for accommodating the second battery 171, and the opening of the inner space facing the first side end frame 122 or the first flexible cover 123 described above is It may be detachably closed by the second flexible cover 126. The second side connection frame 124 and the second flexible cover 126 may be formed of rubber or a soft synthetic resin material in order to improve the fit with at least a portion of the surface portion in contact with the left ear and the rear of the user. The first battery 171 and the second battery 172 may be referred to as a power supply device, and depending on implementation, one battery may be mounted or a battery may not be mounted and all may be omitted.

A first side cover 112a may be installed on an outer surface of the first side frame 110a to accommodate a first printed circuit board 161. The first printed circuit board 161 may be connected to the first battery 172 and connected to one end of the FPCB 164. Similarly, a second side cover 112b may be coupled to an outer surface of the second side frame 110b to accommodate a second printed circuit board (a second PCB) 162. The second printed circuit board 162 may be connected to the second battery 171 and may be connected to the other end of the FPCB 164.

The front side of the first side frame 110a and the second side frame 110b may be provided with a protrusion or convex portion for securing a coupling force and designating a position when the shield (refer to 180 in FIG. 38) is coupled. In addition, instead of the uneven portion, a magnet or a metallic material to which the magnet is attached may be provided in the vicinity of the formed surface, thereby facilitating coupling with the shield and maintaining a stable coupling state.

The first printed circuit board 161 may include at least one port or a first connector for transmitting/receiving data to/from the outside or receiving power. The second printed circuit board 162 may include at least one port or a second connector for transmitting/receiving data to/from the outside or receiving power. In addition, the first or second printed circuit board 161; 162 may include an earphone terminal.

The front camera 151 may include a lens exposed to the front of the main frame 110 or the central frame 120c. Two front cameras 151 may be installed, but the present invention is not limited thereto. The lens of the front camera 151 or a peripheral portion thereof may be protected by the front auxiliary cover 115. The front camera 151 may be electrically connected to another end or extension of the FPCB 164.

The rear camera 153 may include a lens exposed to the rear of the main frame 110 or the support frame 120. One rear camera 153 may be installed, but is not limited thereto. The rear camera 153 may be electrically connected to another end or extension of the FPCB 164.

The processor (see 260 of FIG. 39) may be disposed on the first or second printed circuit boards 161 and 162. The processor may operate and manage an operation or function of the smart glasses 100 by controlling the components of the smart glasses 100. The processor may include an application processor (AP).

The display interface 160 may control timing of signals transmitted to the first display 131 and the second display 132 according to the control of the processor. The signal may include an image signal. In this embodiment, the display interface 160 includes the first and second displays 131 and 132 and a dual and 3D MIPI DSI (Dual & 3D Mobile Industry Processor Interface Digital Serial Interface) suitable for 3D content (hereinafter, briefly referred to as DSI). Or a means or device that performs a similar function.

In addition, a driver 194 may be incorporated in the first or second side frames 110a and 110b. The driver 194 may be electrically connected to the first or second printed circuit boards 161 and 162 and operate according to signals from the front camera 151, the rear camera 153, a sensor, or a processor to generate vibration. . As an example, when the user's eyelid is recognized through the rear camera 153 and it is recognized that the eyelid is covering the eyeball for a predetermined period of time or longer, a vibration for the anti-drowsiness alarm may be generated according to a signal from the rear camera 153.

In addition, a heat dissipation structure may be installed on the upper portion of the support frame 120 or at a lower portion or a portion of the upper cover 113. One end of the heat dissipation structure may be connected to the display interface 160, the first display 131, the second display 132, a backlight for an LCD, and the like to emit heat generated from at least one of the above components. For effective heat dissipation, the heat dissipation structure may extend along an outline in the longitudinal direction of the upper end of the central frame 120c, and may be installed in a state in which the cross-sectional area is expanded by providing a plurality of fins on at least one surface. . In addition, depending on the implementation, the heat dissipation structure may be connected to a material having excellent conductivity installed in a predetermined width along the length direction of the upper cover 113 or may be formed integrally with the highly conductive material.

37 is a block diagram of a control board that can be employed in the smart glasses of FIG. 31.

Referring to FIG. 37, the smart glasses 100 according to the present embodiment may include a controller 210 connected to the first and second displays D1 and D2 131 and 132. In addition, the smart glasses 100 may include a power supply unit 170 and a communication unit 190. The power supply unit 170 may be referred to as a power supply device or a power supply device, and may include a battery or a power supply terminal. In addition, the communication unit 190 may include a subsystem for wired or wireless communication. At least a portion of the above-described power supply unit 170 and the communication unit 190 may be mounted on a printed circuit board. In that case, the printed circuit board may be referred to as a communication and power board.

The controller 210 may include a processor and a memory 220. The controller 210 may control the operation of the power supply unit 170 and the communication unit 190 by a program stored in the memory 220 and control the operation of the smart glasses 100. In this embodiment, the controller 210 and the power supply unit 190 are integrally formed in the smart glasses 100 in a storage form, but are not limited thereto.

In the above-described embodiment, the display interface is described as being a separate configuration from the controller 210, but the present invention is not limited to such a configuration, and the display interface may be implemented to be integrally formed with the controller.

In addition, the smart glasses 100 according to the present embodiment includes one small battery or auxiliary battery as an auxiliary power supply unit, and a separate main power supply device including a large, large capacity or main battery is disposed outside the smart glasses. It may be configured to be connected through data and power lines (see 192 in FIG. 38).

38 is a perspective view of smart glasses and a control system according to another embodiment of the present invention. 39 is a block diagram illustrating a main configuration of the smart glasses of FIG. 38.

Referring to FIGS. 38 and 39, the smart glasses 100 according to the present embodiment may be implemented to have a display interface and to place a control device connected to the display interface outside the smart glasses 100. In addition, the smart glasses 100 are implemented to place substantially all batteries outside the smart glasses 100.

Here, the display interface may be a dual and 3D MIPI DSI (Dual & 3D Mobile Industry Processor Interface Digital Serial Interface, 210a) (hereinafter referred to as a DSI for short) or a means or device that performs a similar function. Using such a display interface, it is suitable for implementing 3D content with the first and second displays 131 and 132.

For the above-described configuration, the smart glasses 100 include a first display 131, a second display 132, a display interface 160, a camera 150, and a communication and power board 164.

The camera 150 may include a front or rear camera, and the communication and power board 164 is installed at an installation position of the first or second printed circuit board, and an external main power supply (MPS, MPS, etc.) 240) and the application processor (AP, 260). In this case, the external device 300 may externally control and monitor the operation of the smart glasses 100 as a control and power device.

In the present embodiment, the first battery 172 and the second battery 171 may be omitted along with most of the controller, the first printed circuit board 161 and the second printed circuit board 162. That is, a communication and power board 164 having a relatively simple structure is installed at the location of the second printed circuit board 162 to relay communication and power connection between the smart glasses 100 and the external device 300, and Most of the components for the part can be omitted.

According to the present embodiments, the weight of the smart glasses 100 can be significantly reduced, and there is an advantage of increasing the usability. In addition, it is possible to increase the battery capacity by a relatively certain amount according to the use of external batteries, and by receiving power through commercial power or other auxiliary batteries through the power terminal as necessary, the necessary power for long-term use of smart glasses can be smoothly supplied. There are advantages to supply.

40 is a block diagram illustrating a control module that can be employed in the smart glasses of FIG. 38.

Referring to FIG. 40, the control device for smart glasses according to the present embodiment may be referred to as an application processor, and includes a video interface 261, a tracking module 262, a rendering module 263, and a measurement module 264. Can include. The tracking module 262, the rendering module 263, and the measurement module 264 may be connected to a user interface (U/I, 265).

The video interface 261 may receive a video image stream input from the video cameras 151 or 152 and transmit an image of a desired section to the tracking module 262.

The tracking module 262 may receive image data from the video interface 261 and transmit a measurement image and a pose estimation result to the rendering module. In this case, the tracking module 262 may receive adjustment information including adjustment parameters, etc. through the user interface 265 and recognize the marker using marker information stored in the marker information database 266. The marker functions as a medium between the real image and the virtual object. The marker information may include information on the size and pattern of the marker. The marker information database 266 may be replaced with marker information stored in a predetermined storage unit.

The rendering module 263 is responsible for creating and removing virtual objects. The rendering module 263 may obtain adjustment information or the like through the user interface 265. The adjustment information may include load or unload, rotation, movement (coordinate movement, etc.), scaling, and the like. The rendering module 263 may interwork with an engine supporting 3D (3D) modeling (briefly, a 3D modeling engine 268) or a means for performing such a function and a content resource database 267. The 3D modeling engine 268 may generate a virtual object of a measurement image based on a virtual reality modeling language (VRML). The rendering module 263 may receive a virtual object from the content resource database 267 and perform rendering on the measured image.

The measurement module 264 may determine and process a distance between virtual objects, a distance and a direction between the generated coordinate systems, and whether there is interference between virtual objects. The measurement module 264 may receive an augmented image from the rendering module 263 and provide an augmented reality image to the display device according to object information input through the user interface 265. The object information may include information on positive or negative matching, 3D point, collision, and the like.

41 and 42 are flowcharts illustrating a main operating principle of the smart glasses of FIG. 38.

Referring to FIG. 41, the control device for smart glasses according to the present embodiment may acquire a stereoscopic image through a camera (S201). The control device may generate a depth map image based on the stereoscopic image.

Next, the control device may detect or extract the hand image (S203). The control device may extract a hand image from the depth map image.

Next, the control device may extract a command corresponding to a series of hand images from a storage unit or a database (S205). The control device provides a vector component indicated by a series of hand images created by the hand images extracted for a predetermined period of time, and an image area corresponding to the start and end points of the vector component, or a preset command corresponding to an object located in the image area. I can recognize it. Here, the object may have different types of menus, icons, etc. in response to a preset command.

According to the present embodiment, the control device of the smart glasses may detect hand motions through image processing and control an image viewed in the smart glasses based on this. For example, the image control may include forward or reverse an image, fast forward an image, rewind an image, and execute a preset command by recognizing a touch on a specific area of an image.

In addition, the control device recognizes a hand in an image frame input for hand motion recognition, detects an image in which the hand is located, or recognizes or predicts the movement direction of the hand, and places content on the screen or moves the current image accordingly. Alternatively, the current image can be arranged by overlapping with other images. Predicting hand motion may include recognizing a hand, a finger, or a combination thereof. Such gesture recognition may be performed based on image processing and preset gesture information.

In addition, according to the present embodiment, it is possible to provide a user interface using hand gestures in not only augmented reality, but also virtual reality, mixed reality, etc., thereby providing various contents of smart glasses. Can be used effectively, and user convenience can be greatly improved.

For example, according to the present embodiment, when working at a desk without a monitor, wearing smart glasses when shopping, performing payment through augmented reality, using a navigation function through augmented reality, or playing an augmented reality game, , You can watch virtual reality videos, make video calls in augmented reality or virtual reality, work in the field with augmented reality while the worker wears smart glasses, or easily manipulate and use the functions of the smartphone on the screen of the smart glasses. have.

Further, referring to FIG. 42, the control device of the smart glasses according to the present embodiment acquires a stereoscopic image through a camera (S201), detects or extracts a hand image based on this (S203), and then In response to a series of hand images, screen mirroring of a mobile computing device such as a portable terminal or a notebook may be performed (S206).

Screen mirroring may be referred to as screen mirroring, and refers to a function of allowing a screen of a mobile computing device to be viewed on a screen of a smart glasses wirelessly without connecting a separate line.

For screen mirroring, the control device of the smart glasses or the display interface of the control board receives and decodes the screen information when the mobile computing device encodes the screen information and transmits the screen information through the display. Can be printed on. Wireless includes Bluetooth, but is not limited thereto, and other short-range wireless communication methods may be used.

If you use screen mirroring, you can receive calls, phone calls, video calls, etc. from a mobile terminal with a communication function in smart glasses, or receive text messages and check text contents to conveniently provide services such as phone calls and text messages from mobile terminals. You can make it easy to use.

Although preferred embodiments of the present invention have been described above, those of ordinary skill in the technical field of the present invention can variously modify the present invention within the scope not departing from the spirit and scope of the present invention described in the following claims. It will be appreciated that it can be modified and changed.

Claims (15)

A frame assembly having a spectacle frame shape wearable on a user's head;
An optical system coupled to the frame assembly such that a first main lens and a second main lens are positioned in front of the user's left and right eyes when worn on the head; And
And a display device that provides an image in a direction in which the user's eyes are positioned through the first main lens and the second main lens of the optical system when worn on the head,
The optical system includes a first auxiliary lens for enlarging a first image of a first display belonging to the display device through an aspherical convex surface and a first main lens for reflecting and transmitting a first image transmitted from the first auxiliary lens. The provided first optical system, a second auxiliary lens for enlarging a second image of a second display belonging to the display device through an aspherical convex surface, and a second auxiliary lens for reflecting and transmitting a second image transmitted from the second auxiliary lens 2 A second optical system having a main lens, a first mirror disposed between the first display and the first auxiliary lens to reflect the first image, and between the second display and the second auxiliary lens And a second mirror disposed to reflect the second image,
The first main lens and the second main lens include a plate-shaped beam splitter having a thickness of several millimeters, and transmits and separates the image to show an image formed in a virtual image in the eyes of the user,
Further comprising a rear case having a core portion located in the center and an island-shaped opening formed on both sides of the core portion, respectively,
The rear case is integrated with the first main lens, the first auxiliary lens, the first mirror, the first display, the second main lens, the second auxiliary lens, the second mirror, and the second display Combine with,
Smart glasses having a stepped portion on one side of the rear case, and the first display and the second display having a stepped portion by the rear case. The method according to claim 1,
The first image is output from the first display to a first mirror positioned above the user's eyebrow or nose and positioned above one of the user's eyes, and the first image is output from the top of the eye by the first mirror. It is reflected downwardly and incident on the first auxiliary lens, is enlarged from the first auxiliary lens and transmitted to the first main lens, is reflected and transmitted from the first main lens, and is visible to the user's eyes,
The second image is output from the second display to a second mirror disposed above the user's eyebrow or nose and positioned above the other eye of the user, and is outputted from the upper eye by the second mirror. Smart glasses that are reflected downwardly and incident on the second auxiliary lens, are enlarged from the second auxiliary lens and transmitted to the second main lens, are reflected and transmitted from the second main lens, and are visible to the user's eyes . The method according to claim 1,
Further comprising a communication and power board accommodated in the left or right frame portion of the frame assembly and connected to one or more of the first and second displays, wherein the communication and power board is a wired external control and power supply device Smart glasses connected to and transmitting signal and data communication between the control and power device and the first and second displays. The method of claim 3,
Smart glasses further comprising a front camera installed on the outer surface of the central portion of the frame assembly to photograph the front side and connected to the control and power device through the communication and power board. The method of claim 3,
The control and power supply device includes a control device and a power supply device, and at least one of the control device and the power supply device is supported by the frame assembly or mounted on an external device through data and power lines mounted on the external device. Smart glasses connected to the communication and power board. delete delete delete delete delete delete delete delete delete delete

Images