KR102605552B1 - Augmented Reality System - Google Patents

Abstract

The present invention relates to an augmented reality system that can increase quality and productivity by improving work efficiency through real-time collaboration with experts. One embodiment of the present invention is carried by a worker and captures on-site image information by filming the work site. , a smart terminal that displays an augmented reality guide related to the on-site image information; A remote support terminal that displays the on-site image information acquired from the smart terminal and provides instruction information instructed by a remote expert to the smart terminal and/or the following server 300; And a server that mutually relays data between the smart terminal and the remote support terminal, generates the augmented reality guide based on the instruction information and provides it to the smart terminal so that it is displayed in accordance with the on-site image information. Provides an augmented reality system that

Description

Augmented Reality System

The present invention relates to an augmented reality system, and more specifically, to an augmented reality system that can increase quality and productivity by improving work efficiency through real-time collaboration with experts.

In industrial settings, there is an urgent need to develop technologies for system control methods, knowledge suggestions, and collaboration tools that can minimize the possibility of safety accidents that may occur in situations where both hands cannot be used.

In addition, existing solutions to support problem solving in remote industrial sites make it difficult to respond by sharing work details in real time, which reduces work efficiency due to workflow interruptions and solves problems based on data specialized for each industry. Quantification and visualization of specific data for diagnosing are not supported, and a lot of costs are incurred to introduce a system to improve work productivity.

Republic of Korea Patent Publication No. 10-2019-0101323

The technical problem that the present invention seeks to solve is to provide an augmented reality system that can increase quality and productivity by improving work efficiency through real-time collaboration with experts.

In addition, the technical problem that the present invention aims to solve is to provide an augmented reality system that can solve safety problems in fields where both hands are not free through voice control.

In addition, the technical problem that the present invention seeks to solve is to provide an augmented reality system that can safely handle potentially dangerous field work using artificial intelligence technology in the vision field.

In addition, the technical problem that the present invention seeks to solve is to provide an augmented reality system that can shorten work time and improve work efficiency through real-time collaboration through remote and digital work management using augmented reality technology.

In addition, the technical problem that the present invention aims to solve is to provide an augmented reality system that can significantly improve sales and customer satisfaction by reducing a company's operating costs through non-expert training and safety improvement using artificial intelligence and augmented reality technology. It is done.

The technical problem to be achieved by the present invention is not limited to the technical problem mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

In order to achieve the above technical problem, an embodiment of the present invention includes a smart terminal carried by a worker, acquiring on-site image information by photographing a work site, and displaying an augmented reality guide related to the on-site image information; A remote support terminal that displays the on-site image information acquired from the smart terminal and provides instruction information instructed by a remote expert to the smart terminal and/or the following server 300; And a server that mutually relays data between the smart terminal and the remote support terminal, generates the augmented reality guide based on the instruction information and provides it to the smart terminal so that it is displayed in accordance with the on-site image information. Provides an augmented reality system that

In an embodiment of the present invention, the smart terminal includes a frame worn on the worker's face, a lens installed on the frame, and a glass module including a display coupled to the frame and set to display a preset coordinate area; A camera module installed in the frame to capture the site viewed by the worker in real time according to the worker's gaze and/or movement to obtain the site image information; At least one voice input module installed in the frame to input and process the worker's voice; A glass communication module installed in the frame and communicating with the remote support terminal and/or the server; And detecting defects and/or cracks set from the field image information using a set artificial intelligence model, displaying the detected defects and/or cracks on the glass module so that they can be confirmed, and displaying the defects and/or cracks received through the glass communication module. It may include a glass control module that processes the augmented reality guide to be displayed on the glass module and performs a set operation in response to the voice.

In an embodiment of the present invention, the glass control module includes an image processing unit that processes the augmented reality guide received from the server and provides the signal to the glass module so that the augmented reality guide is displayed on the glass module; a voice processing unit that processes the voice received from the voice input module into a command and provides a voice command to the server through the glass communication module; And it may include a main control unit that controls the image processing unit and/or the audio processing unit so that the augmented reality guide signal processed by the image processing unit matches the operator's voice and is displayed on the glass module.

In an embodiment of the present invention, when it is determined that a worker's utterance is input, the voice processing unit extracts a keyword for a coordinate area set on the display from the voice or extracts a keyword for an execution command of an augmented reality guide. Thus, the signal can be processed into a voice command and the voice command can be provided to the server.

In an embodiment of the present invention, the server includes a server communication module that communicates with the smart terminal and/or the remote support terminal; An image analysis module that extracts a set object from the on-site image information using the artificial intelligence model; A voice command analysis module that analyzes keywords and/or input signals from the voice command received from the smart terminal; The artificial intelligence model is set based on data of the set industrial domain, the augmented reality guide is generated by reflecting the instruction information on the object, and the augmented reality guide is displayed at each location of the object of the field image information. A content providing module that matches coordinates to; And to receive analysis results from the video analysis module and/or the voice command analysis module, and to match the on-site video information, the instruction information, and/or the augmented reality guide corresponding to the voice command and provide them to the smart terminal. , may include a server control module that controls the content provision module.

In an embodiment of the present invention, the image analysis module analyzes an object using the image recognition model set as an image analysis artificial intelligence program for shape recognition, and the image recognition model includes: 1 for product recognition, Automatic generation of test images that automatically generate 2D barcode data, data arguments that automatically process padding according to changes in image resolution, including image multiplication techniques, and the location of the bounding box that occurs when the resolution of the training image is changed. It can support items that include at least one of the following: resolution change, which introduces an algorithm to compensate for changes, and dataset separation for image restoration, which automatically classifies training data for upscaling of images taken for product and shape recognition. there is.

In an embodiment of the present invention, the voice command analysis module separates noise and voice, learns the separated noise and voice through deep learning, and applies voice recognition techniques to the artificial intelligence model learned through deep learning to generate voice. The voice command can be analyzed using the natural language processing model that converts data into text.

In an embodiment of the present invention, the content providing module samples 360-degree scanning data of the modeling object received from the smart terminal based on vision technology using the artificial intelligence model and produces a plurality of images taken at a set angle. Augmented reality content can be created by extracting and compositing, creating the extracted image as a 3D object, and then correcting it with a 3D editing tool.

According to an embodiment of the present invention, quality and productivity can be increased by improving work efficiency through real-time collaboration with experts.

Additionally, according to an embodiment of the present invention, safety problems can be solved in fields where both hands are not free through voice control.

Additionally, according to an embodiment of the present invention, potentially dangerous field work can be handled safely using artificial intelligence technology in the vision field.

In addition, according to an embodiment of the present invention, working time can be shortened and work efficiency improved through real-time remote collaboration and digital work management using augmented reality technology.

In addition, according to an embodiment of the present invention, sales and customer satisfaction can be significantly improved by reducing a company's operating costs through non-expert training and safety improvement using artificial intelligence and augmented reality technology.

The effects of the present invention are not limited to the effects described above, and should be understood to include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present invention.

1 is a diagram showing the configuration of an augmented reality system according to an embodiment of the present invention.
Figure 2 is a diagram illustrating the configuration of a smart terminal and a server according to an embodiment of the present invention.
Figure 3 is a diagram showing the external appearance of a smart terminal according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating the detailed configuration of the glass control module of FIG. 2.

Hereinafter, the present invention will be described with reference to the attached drawings. However, the present invention may be implemented in various different forms and, therefore, is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected (connected, contacted, combined)" with another part, this means not only "directly connected" but also "indirectly connected" with another member in between. "Includes cases where it is. Additionally, when a part is said to “include” a certain component, this does not mean that other components are excluded, but that other components can be added, unless specifically stated to the contrary.

The terms used herein are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to indicate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

In the present invention, captured images can be analyzed with a self-trained artificial intelligence model to identify defects such as cracks and damage, as well as data quantification and/or visualization technology. In addition, the present invention can implement measurement technology using an augmented reality tape measure, which was previously difficult to implement due to its high dependence on hardware, through various approaches such as gyro sensors and image recognition. In addition, in the present invention, augmented reality marking can be performed by inputting ruler values and areas based on voice commands, and information visualization technology for the area can be implemented. Additionally, in the present invention, worker training and manual provision technology can be implemented using a smooth and advanced chatbot that analyzes the meaning of the user's voice with an artificial intelligence model through natural language processing.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

1 is a diagram showing the configuration of an augmented reality system according to an embodiment of the present invention.

Referring to FIG. 1, the augmented reality system according to an embodiment of the present invention may include a smart terminal 100, a remote support terminal 200, and a server 300.

The smart terminal 100 is connected to the remote support terminal 200 and/or the server 300 through a communication network, acquires on-site image information by photographing the work site, and uses augmented reality (AR) related to the on-site image information. ) A guide can be displayed. Alternatively, the smart terminal 100 is worn on the worker's body (face) and captures images of the work site and/or objects viewed by the worker through the remote support terminal 200 and/or the server 300 in real time. It can be provided as To this end, the smart terminal 100 may include a glass module 110, a camera module 120, a voice input module 130, a glass communication module 140, and a glass control module 150.

Referring further to FIG. 3, the glass module 110 may be formed in the shape of glasses so that it can be worn on the worker's face. To this end, the glass module 110 is set to display a preset coordinate area by combining a frame 112 worn on the worker's face, a lens 114 installed on the frame 112, and the frame 112. It may include a display 116.

Here, the glass module 110 combines the camera module 120, the voice input module 130, the glass communication module 140, and the glass control module 150 with the frame 112 and/or the display. It can be combined and/or embedded in (116).

Additionally, the glass module 110 can have a coordinate area set on the display 116 using a ruler user interface. To this end, the glass module 110 can display the ruler user interface on the display 116 according to a separate fixed output signal, or receive an image signal including the ruler user interface and output it on the display 116. there is.

The camera module 120 is installed on one side of the frame 112 and can capture the object the worker looks at in real time according to the worker's gaze and/or movement to generate an actual image.

At least one voice input module 130 is installed on one side of the frame 112 and can input and process the operator's voice. For example, the voice input module 130 is implemented as a microphone and can detect voice from the utterance of a worker wearing the glass module 110. At this time, the sound detected by the voice input module 130 may include utterances made by the worker and sounds generated by various factors other than the worker.

The glass communication module 140 is installed on one side of the frame 112 and can communicate with the server 300 through a communication network. The glass communication module 140 can connect to the server 300 through a wired/wireless wide area/local area network or local connection method according to the communication protocol of the server 300.

The glass control module 150 detects defects and/or cracks set from the field image information using a set artificial intelligence model, and displays the detected defects and/or cracks on the glass module 110 so that they can be confirmed. , the augmented reality guide received through the glass communication module 140 can be processed to be displayed on the glass module 110 and a set operation can be performed in response to the voice. Additionally, the glass control module 150 can process the received video signal to be displayed on the display 116 of the glass module 110 and perform a preset operation in response to the voice. To this end, the glass control module 150 may include an image processing unit 152, an audio processing unit 154, and a main control unit 156, as shown in FIG. 4.

The image processing unit 152 may process the augmented reality guide received from the server 300 to be displayed on the glass module 110 and provide the signal to the glass module 110 . Here, the image processing unit 152 may perform various image processing processes on image signals included in the received augmented reality guide. Additionally, the image processing unit 152 may output an image signal that has undergone this process through the display 116 of the glass module 110. Through this, the image processing unit 152 can display an image based on the corresponding image signal on the display 116. For example, the image processing unit 152 extracts video, audio, and additional data corresponding to the augmented reality guide from the received augmented reality guide, adjusts it to a preset resolution, and outputs it through the glass module 110. You can.

The type of image processing process performed by the image processing unit 152 is not limited, for example, decoding corresponding to the image format of the image data, converting interlace image data into a progressive method. De-interlacing to convert, scaling to adjust video data to a preset resolution, noise reduction to improve video quality, detail enhancement, and frame refresh rate. May include conversion, etc.

The voice processing unit 154 can process the voice received from the voice input module 130 into a command and provide a voice command to the server 300 through the glass communication module 140.

Specifically, the voice processing unit 154 may perform a voice processing process on the voice and/or sound input to the voice input module 130. Here, when a voice and/or sound is input to the voice input module 130, the voice processing unit 154 determines whether the input voice and/or sound is uttered by an operator or a sound generated by other factors. can do. However, since various structures can be applied to this determination method, it is determined whether the input voice and/or sound corresponds to the wavelength and/or frequency band corresponding to the human voice, or whether it corresponds to the profile of the worker's voice specified in advance. Methods such as judgment can be used.

In addition, when the voice processing unit 154 determines that the operator's utterance has been input, the voice processing unit 154 extracts a keyword for the coordinate area set in the display 116 (hereinafter, coordinate area keyword) from the voice, or executes an augmented reality guide. The keyword for the command (execution command keyword) can be extracted, processed as a voice command, and the voice command can be provided to the server 300. Through this, the voice processing unit 154 can support performing a preset corresponding operation according to the worker's utterance.

When the operator's voice is input through the voice input module 130, the main control unit 156 can control the voice processing unit 154 to signal process the input voice. In addition, the main control unit 156 processes the augmented reality guide into an image signal through the image processing unit 152 and displays it on the glass module 110, and executes content through the voice input module 130. When the operator's voice commanding is input, the image processing unit 152 can be controlled to execute the voice command.

As described above, the glass control module 150 processes images by mounting a SOC (system-on-chip) that integrates various functions, or individual components that can independently perform each process, on a printed circuit board. It may be implemented as a board (not shown) and embedded in the glass module 110.

The remote support terminal 200 displays on-site image information acquired from the smart terminal 100, and provides instruction information instructed by a remote expert to the smart terminal 100 and/or the server 300. You can. Here, the remote support terminal 200 may generate the instruction information in which a preset coordinate area is grafted and/or reflected. Additionally, the remote support terminal 200 can generate a remote expert's utterance as the instruction information. Additionally, the remote support terminal 200 may generate the instruction information in which pointer or drawing information of a remote expert is grafted and/or reflected based on the on-site image information. The remote support terminal 200 can perform remote calls and/or share data (files) with the smart terminal 100 in real time.

The server 300 relays data between the smart terminal 100 and the remote support terminal 200, and generates the augmented reality guide based on the instruction information to be displayed in accordance with the on-site image information. This can be provided to the smart terminal 100. Additionally, the server 300 may receive the voice command from the smart terminal 100, analyze the voice command, and provide the smart terminal 100 with an augmented reality guide corresponding to the voice command. To this end, the server 300 may include a server communication module 210, a video analysis module 220, a voice command analysis module 230, a content provision module 240, and a server control module 250.

The server communication module 210 can communicate with the glass communication module 140 through a communication network. Here, the server communication module 210 can receive on-site image information and/or voice commands from the glass communication module 140, and transmit the augmented reality guide as a video signal.

Additionally, the server communication module 210 can communicate with the remote support terminal 200 through a communication network. Here, the server communication module 210 can receive the instruction information from the remote support terminal 200.

The video analysis module 220 can analyze objects from the on-site video information received from the smart terminal 100 and provide the analysis results to the content provision module 240 and/or the server control module 250. there is. For example, the image analysis module 220 can distinguish objects from an image using a preset image recognition model and analyze the classified objects into living things and objects.

Here, the image recognition model can be set as an image analysis artificial intelligence program for shape recognition, and includes automatic generation of test images that automatically generate 1- and 2-dimensional barcode data for product recognition, and image multiplication techniques to determine image resolution. Data argument that automatically processes padding according to changes, resolution change that introduces an algorithm to correct positional changes in the bounding box that occurs when the resolution of the training image is changed, and images taken for product and shape recognition It can support items such as automatic classification of training data for upscaling, data set separation for image restoration, and recognition processing to simulate (object detection, OCR, barcode or QR code, object tracking, etc.).

For example, the image recognition model can secure an accuracy of about 94% or more based on about 10,000 image datasets to which the data arguments are applied.

In addition, the image analysis module 220 can analyze the on-site image information with a self-trained artificial intelligence model to identify defects such as cracks and damage, as well as implement data quantification and/or visualization technology.

The voice command analysis module 230 analyzes the keywords included in the voice command from the voice command received from the smart terminal 100 and sends them to the content provision module 240 and/or the server control module 250. can be provided. For example, the voice command analysis module 230 can analyze coordinate area keywords or execution command keywords included in the voice command. At this time, the voice command analysis module 230 can analyze the voice command using a processing model related to natural language recognition (hereinafter, natural language processing model).

Here, the natural language processing model can perform deep learning by separating noise and voice. Additionally, the natural language processing model can convert voice data into text by applying a speech-to-text technique to an artificial intelligence model learned through deep learning.

In addition, the voice command analysis module 230 can analyze the worker's emotions using the voice emotion recognition feature (VERF) of the voice emotion recognition engine.

For example, in the pitch aspect of the worker's voice, if the sound trembles and stutters and repeats the same word, or in the timbre aspect if the worker has a unique habit, the tone aspect changes the tone of the voice. In cases where the voice tone is not loud or the pitch of the voice is felt but artificial, the voice command analysis module 230 can analyze the worker's various emotions. In other words, the voice command analysis module 230 can generate analysis results by analyzing anxious parts, rushed parts, ambiguous parts, etc. when the worker speaks.

The content providing module 240 sets the artificial intelligence model based on data of the set industrial domain, generates the augmented reality guide by reflecting the instruction information on the object, and generates the augmented reality guide for each object of the field image information. Coordinates can be matched to the augmented reality guide so that the location is displayed.

Here, the content providing module 240 stores information (hereinafter referred to as image information) about the image captured by the smart terminal 100, and augments the image information, the coordinate area keyword, or the execution command keyword. An augmented reality guide is created using a reality matching tag (coordinate grid information), and the augmented reality guide can be provided to the smart terminal under the control of the server control module 250. At this time, the content providing module 240 may store a relationship database that maps the image information, the coordinate area keyword, the execution command keyword, and the augmented reality guide to each other.

Additionally, the content providing module 240 can easily perform augmented reality modeling. Here, the content provision module 240 samples 360-degree scanning data of the modeling object received from the smart terminal 100 based on vision technology (live augmented reality toolkit) using an artificial intelligence model and captures the image taken at a set angle. Augmented reality content can be created by extracting and combining multiple images, creating the extracted images as 3D objects, and then correcting them with a 3D editing tool. Through this, the content provision module 240 can easily produce optimized augmented reality content at each industrial site just by taking photos without professional skills, and significantly shortens the work time for creating augmented reality content, resulting in excellent work efficiency. You can get it.

The server control module 250 receives analysis results from the video analysis module 320 and/or the voice command analysis module 330 and provides information corresponding to the field video information, the instruction information, and/or the voice command. The content providing module 340 can be controlled to match the augmented reality guide and provide it to the smart terminal 100.

Through this, the server 300 supports the smart terminal 100 and the remote support to simplify data collection and enhance efficiency through transmission and reception of field images, result reports, and necessary documents between field workers and experts at headquarters. The terminal 200 can be relayed.

[Example]

In the augmented reality system according to an embodiment of the present invention, a multi-party video conference capable of multi-party video and voice communication without restrictions on the number of participants on various devices such as PC, mobile, and tablet smart glasses, and information pointed or drawn by an expert on the video is displayed in real time. Augmented reality drawing and pointing that allows for accurate work instructions and quick collaboration, a collaboration board that allows multiple people to share documents at the same time and efficient communication with annotation and drawing functions using drawing tools, and real-time sharing of images, videos, and document files It is possible to store information by recording and capturing real-time video and sharing files that are stored locally or in the cloud, which are useful for search and file management. Recording and capture functions can be performed to identify the cause of the problem and improve the efficiency of work configuration management. You can.

According to an embodiment of the present invention, quality and productivity can be increased by improving work efficiency through real-time collaboration with experts. Additionally, according to an embodiment of the present invention, safety problems can be solved in fields where both hands are not free through voice control. Additionally, according to an embodiment of the present invention, potentially dangerous field work can be handled safely using artificial intelligence technology in the vision field. In addition, according to an embodiment of the present invention, working time can be shortened and work efficiency improved through real-time remote collaboration and digital work management using augmented reality technology. In addition, according to an embodiment of the present invention, sales and customer satisfaction can be significantly improved by reducing a company's operating costs through non-expert training and safety improvement using artificial intelligence and augmented reality technology. In addition, according to an embodiment of the present invention, information about products can be confirmed in real time at facilities and manufacturing sites by facilitating image recognition through image identification technology. Additionally, according to an embodiment of the present invention, a marking technique through voice recognition can be applied to display on the screen. Additionally, according to an embodiment of the present invention, productivity can be improved by eliminating interruptions and distractions by smoothing the workflow by introducing voice recognition technology and/or language processing technology. In addition, according to an embodiment of the present invention, on-site productivity can be improved through technologies such as remote assistance, vision picking, and remote collaboration that can analyze the speaker's intention and deliver auxiliary knowledge to the speaker.

The description of the present invention described above is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as unitary may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the patent claims described below, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention.

100: Smart terminal
200: Remote support terminal
300: server

Claims (8)

It is carried by the worker, and while displaying a preset coordinate area, the work site viewed by the worker is captured according to the worker's gaze and movement to obtain on-site image information, and the coordinate area is recorded from the worker's voice that is input and processed. A smart terminal that extracts keywords, processes them as voice commands, provides them to the server, and displays an augmented reality guide related to the on-site video information;
A remote support terminal that displays the on-site image information acquired from the smart terminal and provides instruction information instructed by a remote expert to the smart terminal or the server; and
The server relays data between the smart terminal and the remote support terminal, generates the augmented reality guide based on the instruction information to be displayed in accordance with the on-site image information, and provides the augmented reality guide to the smart terminal;
Including,
The voice processing unit included in the glass control module,
By checking whether the sound inputted from the voice input module included in the smart terminal corresponds to the wavelength and frequency band corresponding to the human voice or corresponds to the worker's voice profile specified in advance, the sound is matched to the worker's utterance. It is characterized by determining whether it is a voice by
The voice command analysis module included in the server is,
While analyzing the keyword or input signal from the voice command received from the smart terminal, the worker's emotion is analyzed using the voice emotion recognition feature (VERF) of the emotion recognition engine for the voice command. Characterized by,
The voice command analysis module is,
The above voice command is performed using a natural language processing model that separates noise and voice, learns the separated noise and voice through deep learning, and applies voice recognition techniques to the artificial intelligence model learned through deep learning to convert voice data into text. Characterized by analyzing,
The video analysis module included in the server is,
Automatic generation of test images that automatically generate 1- and 2-dimensional barcode data for product recognition while extracting objects set from the on-site image information using an image recognition model set by an image analysis artificial intelligence program for shape recognition. Including image multiplication techniques, data arguments that automatically process padding according to changes in image resolution, resolution changes that introduce an algorithm to correct the change in the position of the bounding box that occurs when the resolution of the training image is changed, product and An augmented reality system, characterized in that it uses the image recognition model to support dataset separation for image restoration that automatically classifies training data for upscaling of images taken for shape recognition.
According to paragraph 1,
The smart terminal is,
A glass module including a frame worn on the worker's face, a lens installed on the frame, and a display coupled to the frame and set to display the coordinate area;
A camera module installed in the frame to capture the work site in real time and obtain the site image information;
The voice input module, at least one of which is installed in the frame, inputs and processes the sound or the worker's voice;
A glass communication module installed in the frame and communicating with the remote support terminal or the server; and
Using the set artificial intelligence model, defects or cracks set from the on-site image information are detected, the detected defects or cracks are displayed on the glass module so that they can be confirmed, and the augmented reality guide received through the glass communication module is displayed on the glass module. a glass control module that processes the display to be displayed on the glass module and performs a set operation in response to the voice;
An augmented reality system comprising:
According to paragraph 2,
The glass control module is,
an image processing unit that processes the augmented reality guide received from the server and provides the signal to the glass module so that the augmented reality guide is displayed on the glass module;
the voice processing unit that processes the sound or voice received from the voice input module into a command and provides the voice command to the server through the glass communication module; and
a main control unit that controls the image processing unit or the audio processing unit so that the augmented reality guide signal processed by the image processing unit matches the voice of the operator and is displayed on the glass module;
An augmented reality system comprising:
According to paragraph 3,
The voice processing unit,
If it is determined that the sound is a voice uttered by the worker, the augmented reality system extracts a keyword for the execution command of the augmented reality guide, processes the signal as the voice command, and provides the voice command to the server. Reality system.
According to paragraph 1,
The server is,
A server communication module that communicates with the smart terminal or the remote support terminal;
The video analysis module;
The voice command analysis module;
The artificial intelligence model is set based on data of the set industrial domain, the augmented reality guide is generated by reflecting the instruction information on the object, and the augmented reality guide is displayed at each location of the object of the field image information. A content providing module that matches coordinates to; and
The content providing module receives analysis results from the video analysis module or the voice command analysis module, matches the on-site video information, the instruction information, or the augmented reality guide corresponding to the voice command, and provides it to the smart terminal. A server control module that controls;
An augmented reality system comprising:
delete delete According to clause 5,
The content provision module is,
Based on vision technology using the artificial intelligence model, 360-degree scanning data of the modeling object received from the smart terminal is sampled, multiple images taken at a set angle are extracted and synthesized, and the extracted images are created as a 3D object. An augmented reality system characterized by creating augmented reality content by correcting it with a 3D editing tool.