KR101983249B1 - An augmented reality system with dynamic representation technique of augmented images according to distance from an object - Google Patents

Abstract

The present invention relates to an augmented reality (AR) system applied with a dynamic representation technique of an augmented image in accordance with the distance from an object, which dynamically and automatically adjusts an information amount of a VR object in accordance with the distance between the object and user. According to the present invention, the AR system comprises: AR glasses having an image camera embedded therein to photograph an image around a user to acquire actual image information and displaying a three-dimensional (3D) virtual image corresponding to current location information and the actual image information within a user′s field of view when the 3D virtual image is displayed on a transparent display; and a server providing the AR glasses with the 3D virtual image corresponding to the current location information and the actual image information transmitted from the AR glasses, wherein an information amount of the virtual object of the 3D virtual image allotted and displayed to each actual object of the actual image information is dynamically adjusted in accordance with the distance between the actual object and user to be displayed on the AR glasses.

Description

An augmented reality system with dynamic representation technique of augmented images according to distance from an object}

The present invention relates to an augmented reality system, and more particularly, to an augmented reality system in which the amount of information of a virtual object is adjusted according to a distance from an object.

Recently, the provision of content using an augmented reality technique that overlays a variety of information in the space of reality when photographing with a camera module has been actively studied.

Augmented Reality (AR) is a technology belonging to the field of Virtual Reality (VR), and it synthesizes the virtual environment into the real environment that the user feels and makes it feel as if the virtual environment exists in the original real environment. Is a computer technique.

This augmented reality has the advantage of reinforcing and providing additional information, which is difficult to obtain only by the real world, by synthesizing a virtual object on the basis of the real world, unlike the existing virtual reality targeting only virtual spaces and objects.

That is, augmented reality may be referred to as a reality that is realized by matching a virtual environment, for example, a three-dimensional virtual environment, made of computer graphics with a live image viewed by a user. Here, the 3D virtual environment provides the necessary information in the live image viewed by the user, and the 3D virtual image may be matched with the live image to increase the user's immersion.

Such augmented reality can provide better realism by blurring the distinction between the real environment and the virtual environment by providing a real-time image to the three-dimensional virtual environment as compared to the simple virtual reality technology.

Due to the advantages of such an augmented reality system, active research / development is being progressed in recent years on the technology that combines augmented reality. For example, augmented reality technology is in practical use in the fields of broadcasting, advertising, exhibitions, games, theme parks, military, education and promotion.

The mobile terminal has recently been able to become a handheld augmented reality system by improving the computing capability of mobile devices such as mobile phones, personal digital assistants (PDAs), ultra mobile personal computers (UMPCs) and the development of wireless network devices.

As these systems become possible, many augmented reality applications using mobile devices have been developed. In addition, the spread of mobile devices has become very popular and the environment for accessing augmented reality applications is being created.

In addition, user demand for various value-added services using augmented reality of a terminal is increasing, and attempts to apply various augmented reality contents to a terminal user using the terminal are increasing.

Korean Patent Publication No. 10-2016-0092292 relates to a "system and method for providing augmented reality service for advertisements," wherein the advertiser can easily obtain information related to an advertisement target by applying augmented reality to the advertisements. In addition, it is proposed a system that can deliver effectively, such as to be immersed and learned interestingly.

Meanwhile, various wearable device products that can be worn on a user's body have been released. In particular, by applying mobile technology and transparent display technology to the glasses, a system that allows the user to check a variety of information through the glasses are being developed.

1 is a diagram illustrating a virtual object displayed in a conventional augmented reality system.

Referring to FIG. 1, the conventional augmented reality system displays too many virtual objects on a transparent display of glasses, thereby obscuring the eyes of the user, which causes a problem that the user cannot recognize the necessary information.

KR 10-2016-0092292 A

The present invention has been proposed to solve the above technical problem, and provides an augmented reality system in which the amount of information of the virtual object is automatically adjusted according to the distance between the object and the user.

According to an embodiment of the present invention for solving the above problems, there is a built-in video camera for capturing the image around the user to obtain the actual image information and in displaying a three-dimensional virtual image on a transparent display, the current position information and the The augmented reality glasses for displaying the 3D virtual image corresponding to the actual image information within a user's field of view, the current position information transmitted from the augmented reality glasses, and the 3D virtual image corresponding to the real image information. And a server providing the augmented reality glasses in real time, wherein the amount of information of the virtual object of the 3D virtual image, which is allocated to the real object of the real image information and displayed, is dynamically changed according to the distance between the real object and the user. Provided with augmented reality system characterized in that the controlled to be displayed on the augmented reality glasses .

In addition, the augmented reality system of the present invention starts to display the virtual object assigned to the real object when the distance between the user and the real object reaches within a predetermined distance, between the user and the real object As the distance is closer, the virtual object of more detailed information is displayed.

In addition, the augmented reality glasses included in the present invention, when the vibration occurs in the state staring at the virtual object that the user wants to check, after calculating the moving distance corresponding to the rate of change of the vibration gaze direction and the calculated movement The information amount of the virtual object is reset and displayed based on a distance.

In addition, the augmented reality glasses included in the present invention, characterized in that to provide the satellite position information to the server as the current position information.

The augmented reality glasses included in the present invention provide satellite position information to the server as the current position information, and further identify signal strengths of at least one Wi-Fi repeater to the server. It is characterized by transmitting.

In addition, the augmented reality system of the present invention, the Wi-Fi communication module is built-in further comprises a plurality of sensing units disposed at regular intervals in the room space, the plurality of sensing units Wi-Fi periodically output from the augmented reality glasses Each time a WIFI HOTSPOT signal is detected, the detection information is transmitted to the server.

In the augmented reality system according to an embodiment of the present invention, since the amount of information of the virtual object is automatically adjusted according to the distance between the object and the user, the user can conveniently check the information of the desired virtual object.

Therefore, when the virtual object is displayed in the form of augmented reality advertising, the time for the user to concentrate on the virtual object can be lengthened, thereby increasing the advertising effect.

1 is a view showing a virtual object displayed in a conventional augmented reality system
2 is a block diagram of an augmented reality system 1 according to an embodiment of the present invention
3 and 4 are views showing the operation principle of the augmented reality system (1)
5 is a block diagram of the augmented reality glasses 100 of the augmented reality system (1)
Figure 5a is an illustration of the augmented reality glasses 100
6 is a state in which the safe mode of the augmented reality system 1 operates
7 is a state diagram in which an overhead view mode of the augmented reality system 1 operates.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention.

2 is a configuration diagram of the augmented reality system 1 according to an embodiment of the present invention, Figures 3 and 4 is a view showing the operation principle of the augmented reality system (1).

Augmented reality system 1 according to the present embodiment includes only a brief configuration for clearly explaining the technical idea to be proposed.

2 to 4, the augmented reality system 1 includes an augmented reality glasses 100, a server 200, and a plurality of sensing units 300. Here, the plurality of sensing units 300 may be selectively provided in the augmented reality system 1 according to an embodiment.

The augmented reality glasses 100 have a built-in video camera for capturing images of a user's surroundings to obtain actual image information, and in displaying a 3D virtual image on a transparent display, the 3D virtual image corresponding to the current position information and the actual image information. The image is displayed within the user's field of view.

The server 200 provides the augmented reality glasses 100 with the 3D virtual image corresponding to the current position information and the actual image information transmitted from the augmented reality glasses 100 in real time.

Augmented reality glasses 100 is basically configured to provide the satellite position information to the server 200 as the current position information. If the augmented reality glasses 100 includes a communication module, the location of the Wi-Fi repeater, the location of the base station as well as the satellite location information may be additionally provided to the server 200 as the current location information. have.

For example, in particular, since indoors may not be able to receive satellite location information in many cases, the AR glasses 100 may additionally grasp the signal strength of at least one of the detected Wi-Fi repeaters to further detect the server 200. Can be delivered to. That is, since the absolute position of the Wi-Fi repeater located in the room is stored in advance in the server 200, the augmented reality glasses 100 additionally provides the unique number and signal strength of the detected Wi-Fi repeater If so, the server 200 can determine the relative movement path of the augmented reality glasses 100.

That is, the relative distance between the augmented reality glasses 100 and the Wi-Fi repeater can be confirmed by the signal strength, and the moving direction can be calculated based on the change in signal strength with the neighboring Wi-Fi repeater. . An additional method of acquiring current location information indoors will be described later.

Therefore, the server 200 identifies the virtual object assigned to each real object through the current position information of the user wearing the augmented reality glasses 100 and the real image information captured by the image camera of the augmented reality glasses 100. And, this information is transmitted to the augmented reality glasses 100 in real time.

On the other hand, the amount of information of the virtual object of the three-dimensional virtual image that is assigned to the real object of the real image information, respectively, is dynamically adjusted according to the distance between the real object and the user is displayed on the augmented reality glasses 100.

Therefore, the virtual object displays more detailed information when the user approaches the object, so the user can conveniently check the information of the desired virtual object. That is, the time for the user to concentrate on the virtual object can be lengthened and the information transfer effect can be increased.

In general, users tend to see information about objects of interest more closely, so they display information abstractly when the user is far from objects of interest, and more detailed information when the user is close to objects of interest. To display.

Looking at the detailed configuration and the main operation of the augmented reality system (1) configured as described above in more detail.

3 and 4 are views showing the operating principle of the augmented reality system (1).

3 and 4, when the distance between the user and the real object or the virtual object reaches a predetermined distance D1, the virtual object assigned to the real object starts to be displayed. As the distance between virtual objects gets closer, more detailed virtual objects are displayed.

That is, the information of the virtual object assigned to one real object is layered. As shown in FIG. 4,

The most abstract virtual object A is displayed when the user enters a predetermined distance D1, and the virtual object having more specific information when the user approaches the real object or the virtual object more D2. A1, A2) are displayed. In addition, when the user approaches the real object or the virtual object nearest (D3), the virtual objects A1-1, A1-2, A2-1, and A2-2 having the most specific information are displayed.

For example, suppose that a vending machine is placed in front of a user as a real object.

When the user enters the predetermined distance D1, the virtual object assigned to the vending machine is displayed. Here, the virtual object is assumed to be an icon of the vending machine.

Next, when the user approaches the vending machine D2, the icons of the beverage products sold in the vending machine may be displayed as virtual objects of more detailed information.

Finally, when the user approaches D3 closest to the vending machine, the calories, ingredients, etc. of each beverage product may be displayed as a virtual object of more detailed information.

In another example, suppose there is a car dealership in front of the user as a real object.

When the user enters the predetermined distance D1, the virtual object assigned to the car dealership is displayed. In this case, the virtual object is assumed to be a car brand icon that is sold.

Next, when the user approaches the vehicle dealership (D2) more, various kinds of car icons that are sold may be displayed as virtual objects of more detailed information. In this case, a virtual object may be displayed around a real object if there is a car currently displayed, that is, a real object, and a virtual object may be displayed in a surrounding area even when there is no car, that is, a real object. .

Finally, when the user approaches the car dealership (D3) closest, the specification, price, expected release date, etc. of the car being sold may be displayed as a virtual object of more detailed information.

On the other hand, the augmented reality glasses 100 when the vibration occurs while staring at the virtual object or the actual object that the user wants to check, after calculating the moving distance corresponding to the rate of change of vibration, the gaze direction and the calculated moving distance Based on this, the information amount of the virtual object can be reset and displayed.

That is, it may be assumed that the user has moved virtually through vibration without directly moving, or the moving distance is weighted by vibration, and the information amount of the virtual object may be reset and displayed according to the virtual moving distance.

That is, a large change rate of vibration means that the user runs or moves quickly, and a small change rate of vibration corresponds to a user moving slowly, and thus the moving distance can be calculated based on this. Therefore, the user may reflect the virtual moving distance by giving vibration while shaking the head up and down without actually moving.

When the user gazes at the direction that the user wants to check, for example, when the user turns his head to the right and looks at the right side and the vibration continues to occur, the augmented reality glasses 100 moves based on the gaze direction and vibration of the user. And the moving distance.

That is, the augmented reality glasses 100 detects the rotation of the user's head through the built-in sensor, calculates the virtual current position after detecting the vibration, and grasps the moving distance of the walking or running behavior through the rate of change of the vibration. .

The augmented reality glasses 100 may be configured to detect a gaze direction based on a rotational direction of the head when detecting a direction gazed by a user, and may be configured to sense a gaze direction by sensing a moving direction of a pupil. .

In addition, the direction of rotation of the head and the direction of movement of the pupil are simultaneously sensed, and the gaze direction can be more precisely calculated by varying the priority ratio of the two detection results. That is, it may be configured to calculate the gaze direction by giving a specific gravity of 50% to 100% in the rotation angle detection due to the rotation of the head, and giving a specific gravity of 0% to 60% in the moving direction of the pupil.

In addition, by selecting and executing the movement distance extension setting mode in the augmented reality glasses 100, the user may be set to reflect the distance weight of 2 to 100 times the calculated virtual movement distance.

In addition, the augmented reality glasses 100, in calculating the moving distance corresponding to the rate of change of vibration, in order to exclude the noise value, except for the upper value 10% and the lower value 20% of the magnitude of the vibration, the rate of change of the remaining vibration value Based on this, the moving distance can be calculated.

As a result, a user can identify a virtual object that does not actually access the real object or the virtual object, or has the same amount of information as if the object or virtual object is accessed in front of it.

5 is a configuration diagram of the augmented reality glasses 100 of the augmented reality system 1, Figure 5a is an exemplary view of the augmented reality glasses 100.

5 and 5A, the augmented reality glasses 100 may include a transparent display 110, a left front camera 121, a right front camera 122, a left 3D sensor 131, and a right 3D sensor. 132, a satellite module 141, a communication module 142, a 9-axis sensor 143, a battery 144, a recognition camera 145, and a controller 150.

The transparent display 110 constitutes a lens of the AR glasses 100 as a display of a transparent material. Therefore, the user can check the real object and the virtual object at the same time while looking forward. In this case, the transparent display 110 may be mounted on the entire lens or a part of the lens.

The left front camera 121 is mounted on the left side of the glasses to obtain actual image information of the front side. In addition, the right front camera 122 is mounted on the right side of the glasses to obtain the actual image information of the front.

The left 3D sensor 131 and the right 3D sensor 132 are interlocked with the left front camera 121 and the right front camera 122 to operate to capture a front 3D image. That is, the captured 3D image may be stored in an internal memory or transmitted to the server 200. For reference, according to an embodiment, the front camera and the 3D sensor may be arranged one by one to obtain actual image information. The front camera is preferably configured to capture both an infrared region and a visible light region.

The satellite module 141 is provided to acquire satellite location information, and the communication module 142 may be equipped with a Wi-Fi communication module, a Bluetooth communication module, and a broadband (3G, 4G, LTE) communication module. .

The nine-axis sensor 143 is referred to as a nine-axis sensor because a total of nine axes are measured as three axes of acceleration, three axes of inertia, and three axes of geomagnetism, and a temperature sensor may be additionally provided to compensate for temperature values. . The 9-axis sensor 143 may detect a three-dimensional movement of the augmented reality glasses 100 to detect a gaze direction, a moving direction, and a tilt of the user.

The battery 144 may be configured to supply driving power to the augmented reality glasses 100 and may be configured as a rechargeable lithium ion battery or a pseudo capacitor.

For reference, the battery 144 may be composed of a plurality of pseudo capacitors. Since the pseudo capacitors use two-dimensional redox reactions at the electrodes, they have better capacitance than general capacitors. The advantage is that the service life is relatively long.

The recognition camera 145 detects the movement of the user's eyes, the gaze direction of the eyes, and the change in the size of the eyes. Recognition camera 145 is most preferably disposed on the left and right, respectively, may be disposed in only one direction.

Basically, the recognition camera 145 is photographed in a direction in which the user's eyes are located, but may be configured to detect eye movement, gaze direction, size change, etc. by capturing an image of the eye reflected from the transparent display 110. will be.

The controller 150 includes a transparent display 110, a left front camera 121, a right front camera 122, a left 3D sensor 131, a right 3D sensor 132, a satellite module 141, and a communication module 142. Control operations of the 9-axis sensor 143, the battery 144, and the recognition camera 145.

The controller 150 may be configured to selectively charge at least one of the plurality of pseudo capacitors according to the magnitude of the charging power. The charging method will be described in detail as follows.

It is assumed that when a plurality of pseudo capacitors are arranged, that is, a first pseudo capacitor, a second pseudo capacitor and a third pseudo capacitor are arranged. At this time, it is assumed that the charging capacity of the first pseudo capacitor is the largest, the charging capacity of the second pseudo capacitor is smaller than that of the first pseudo capacitor, and the charging capacity of the third pseudo capacitor is smaller than the second pseudo capacitor.

The controller 150 detects the charging amount of the first pseudo capacitor, the second pseudo capacitor, and the third pseudo capacitor, and then supplies the driving power in the order of the highest charging amount.

For example, when the charge amount of the first pseudo capacitor is 60%, the charge amount of the second pseudo capacitor is 70%, and the charge amount of the third pseudo capacitor is 80%,

While the power of the third pseudo capacitor is first supplied, when the charge amount reaches 40%, the power supply of the third pseudo capacitor is cut off and the power of the second pseudo capacitor is supplied. In addition, when the charge amount of the second pseudo capacitor reaches 40%, the power supply of the second pseudo capacitor is cut off and the power of the first pseudo capacitor is supplied.

In addition, when the charging amount of the first to third pseudo capacitors is all 40% or less, the controller 150 supplies the driving power by connecting the first to the third pseudo capacitors in parallel.

6 is a state diagram in which the safe mode of the augmented reality system 1 operates.

The augmented reality system 1 may be set to a safe mode for the user's safety.

When the safety mode is set, the augmented reality glasses 100 detects a real object approaching the user through the front camera (121, 123). That is, the dangerous situation may be detected on the transparent display 110 by detecting that a real object that may be a danger to the user, such as a car or a bicycle, approaches quickly toward the user.

Referring to FIG. 6, a screen in which a user is looking forward is shown. A rectangular area indicated by a dotted line in the center is defined as a gaze concentration area and the area is defined by a dotted line border. At this time, when the front camera 121, 122 detects that a real object that may be dangerous to the user, such as a car or a bicycle, approaches the user quickly (at a predetermined speed or more),

The size of the focused area is automatically expanded and the virtual objects displayed on the screen are automatically moved in the outward direction of the focused area, or the transparency is further enhanced so that the user can easily recognize the actual object approaching. do.

The size of the gaze concentration zone, the transparency of the virtual object, and the moving speed of the virtual object moving in the outward direction may be automatically determined in proportion to the speed of the real object approaching the user (proportionally or in proportion to the square).

In addition, when the recognition camera 145 detects the direction of the pupil of the user, the gaze concentration zone operates to automatically move according to the direction of the pupil. That is, when the user's eyes stare at the right side, the gaze-focused area is moved in the right direction. At this time, when the front camera (121, 123) detects that a real object that may be dangerous to the user, such as a car, bicycle, approaching the user toward the front-from the front, the gaze-focused area is the safe operation as described above Proceed to, but the gaze-focused area automatically moves in the front direction of the user.

That is, the gaze concentration zone may be set to automatically move in the direction of a real object approaching the user quickly.

For reference, the recognition camera 145 may detect a movement of the user's pupil, a gaze direction of the pupil, and a change in the size of the eyes, and thus may direct an operation command based on the size change of the pupil.

For example, the virtual information corresponding to the lower level information is gradually displayed whenever the user opens the eyes for a predetermined time, and the virtual information corresponding to the upper level information is gradually displayed whenever the eyes are opened for the predetermined time. Can be indicated. In addition, the instruction eyebrow may be attached to the eyebrow of the user in order to improve the command recognition rate of the recognition camera 145. The indication eyebrows are coated with a reflecting paint that reflects a predetermined infrared wavelength, and the recognition camera 145 may be configured to recognize the infrared wavelength, thereby improving the command recognition rate.

7 is a state diagram in which an overhead view mode of the augmented reality system 1 operates.

Referring to FIG. 7, the augmented reality system 1 may set an overhead view mode.

The overhead view mode refers to a mode in which an image captured and synthesized on the user's head is displayed on the transparent display 110.

That is, although not shown in the drawing, a plurality of view cameras capable of capturing an infrared ray region and a visible ray region may be additionally arranged along the glasses frame in the augmented reality glasses 100. Therefore, the images captured by the plurality of view cameras may be synthesized and provided to the user's field of view. In addition to daytime, especially at night, the foot trajectory that the user can safely move may be displayed. At this time, the sole trace may display the height of the ground based on a predetermined previous position to help the user move more safely.

The augmented reality system 1 may further include a plurality of sensing units 300 in which a Wi-Fi communication module is embedded and disposed at regular intervals in an indoor space.

A plurality of sensing unit 300 may be selectively disposed to detect the position of the augmented reality glasses 100 in the room,

Each of the plurality of sensing units 300 transmits the sensing information to the server 200 each time the Wi-Fi HOTSPOT signal is periodically output from the AR glasses 100, and the server 200 transmits the detected information to the server 200. The relative position of the AR glasses 100 may be determined based on the absolute position of the sensing unit 300.

As described above, the proposed system has described a method of acquiring the current location information based on satellite location information outdoors and the current location information using a Wi-Fi signal indoors.

Meanwhile, an additional method of acquiring current location information indoors and outdoors is described as follows.

The method using the Wi-Fi signal can be basically divided into triangulation and finger printing methods.

First, triangulation is a method of measuring Received Signal Strength (RSS) from three or more APs (Access Points), converting signal strength into distance, and calculating a position through an equation.

Next, the fingerprint printing method divides the indoor space into small cells, collects signal strength values directly from each cell, constructs a radio map by database, and then uses the signal strength values received from the user's location. Compared to the database, the cell showing the most similar signal pattern is estimated by the user's location.

Next, a method of collecting location data of each smartphone may be used while exchanging Wi-Fi signals directly or indirectly from a plurality of users having smartphones in the vicinity.

In addition, since the communication module 142 of the augmented reality glasses 100 includes a Bluetooth communication module, it is possible to determine the current location information using Bluetooth communication.

First, there is a method of estimating that a user is located around the beacon when communicating with any one beacon after arranging a plurality of beacons in the indoor space.

Next, after arranging a receiver having a plurality of directional antennas arranged on the surface of the hemisphere in the indoor space, the position of the user is estimated by identifying a specific directional antenna for receiving a signal transmitted from the augmented reality glasses 100 There is a way. In this case, when two or more receivers are arranged, the location of the user may be identified in a three-dimensional form.

In addition, after grasping the current location information of the user based on the satellite location information, when entering the shaded area of the satellite location information, it is a method of estimating the speed and direction of movement using the information of the 9-axis sensor 143. That is, the user's location can be estimated indoors through step counting, stride length estimation, and heading estimation. In this case, in order to increase the accuracy of the estimated information, the user may receive information such as a user's physical condition (key, weight, stride length), and use the information for calculating a location. When using the information of the 9-axis sensor 143, it is possible to improve the accuracy of the estimated information by combining the above-described position estimation technique using the Wi-Fi communication.

In other words, even though the accuracy is somewhat low by the Wi-Fi technique, the absolute position is calculated globally and the relative position of the locally high accuracy is obtained through the information of the 9-axis sensor 143. Can be combined to improve accuracy. In addition, by applying the Bluetooth communication method may be further improved the accuracy of the location estimation information.

In addition, since the unique magnetic field information for distinguishing the location is formed in the indoor space, a method of estimating the current position may be applied after constructing the magnetic field map of each space, similar to the fingerprint printing method using Wi-Fi. In this case, the change trend of the magnetic field generated as the user moves may be used as additional information.

In addition, there is a method of utilizing the lighting installed in the indoor space. That is, while blinking the LED light as fast as the human can not identify, a method of outputting a specific location identifier and the camera of the augmented reality glasses 100 recognizes the specific location identifier to estimate the location.

In addition, there is a technique that makes a database of images taken from various locations and various angles of the indoor space and then matches pictures taken at the user's location, and additionally identifies various landmarks (signboards, trademarks, room numbers, signs, etc.) of the indoor space. Thereby correcting the position can be used.

For reference, the method of acquiring the current location information in the indoor space is most preferable to improve accuracy by combining at least one of the above-described methods.

In addition, when the arithmetic reality glasses 100, and the storage space is sufficient, the augmented reality system 1 to perform the role of the server 200 in the augmented reality glasses 100 itself without the configuration of the server 200 It may be configured.

In the augmented reality system 1 according to the embodiment of the present invention, since the amount of information of the virtual object is dynamically adjusted according to the distance between the object and the user, the user can conveniently check the information of the desired virtual object.

Therefore, when the virtual object is displayed in the form of augmented reality advertising, the time for the user to concentrate on the virtual object can be lengthened, thereby increasing the advertising effect.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

100: Augmented Reality Glasses
200: server
300: sensing unit
110: transparent display
121: left front camera
122: right front camera
131: left 3D sensor
132: right 3D sensor
141: satellite module
142: communication module
143: 9-axis sensor
144: battery
145: Recognition Camera
150: control unit

Claims (6)

Built-in video camera for capturing the image around the user to obtain the actual image information, and in displaying the 3D virtual image on the transparent display, the 3D virtual image corresponding to the current position information and the actual image information to the user's field of view Augmented reality glasses displayed within the range;
A server providing the augmented reality glasses with the 3D virtual image corresponding to the current position information and the actual image information transmitted from the augmented reality glasses in real time; And
Wi-Fi communication module is built-in; a plurality of sensing units disposed at regular intervals in the indoor space; includes;
The amount of information of the virtual object of the 3D virtual image, which is allocated to the real object of the real image information, respectively, is dynamically adjusted according to the distance between the real object and the user, and displayed on the augmented reality glasses.
Each of the plurality of sensing units transmits signal strength to the server every time a Wi-Fi HOTSPOT signal is periodically output from the AR glasses, and the server converts at least three signal strengths into a distance. Applying triangulation to globally grasp the position of the augmented reality glasses, and locally grasping the position of the augmented reality glasses based on information of the 9-axis sensor of the augmented reality glasses and the user's height and information. Augmented reality system characterized by.
The method of claim 1,
When the distance between the user and the real object reaches within a predetermined distance, the virtual object assigned to the real object starts to be displayed, and the closer the distance between the user and the real object is, the more detailed the object is. Augmented reality system, characterized in that the virtual object of the information is displayed.
The method of claim 1,
The augmented reality glasses,
When vibration occurs while gazing at the virtual object that the user wants to check, calculating the moving distance corresponding to the rate of change of vibration, and then resetting and displaying the amount of information of the virtual object based on the gaze direction and the calculated moving distance. Augmented reality system, characterized in that.
The method of claim 1,
The augmented reality glasses,
Augmented reality system, characterized in that to provide the satellite position information to the server as the current position information.
The method of claim 1,
The augmented reality glasses,
Augmented reality system characterized in that to provide the satellite location information to the server as the current location information, the signal strength of the at least one or more Wi-Fi repeater retrieved and forwarded to the server.
delete

Images