KR102436403B1 - Multi-tracking augmented reality system - Google Patents

Abstract

The present invention relates to a multi-tracking augmented reality system, which includes: a training module for initial spatial recognition; and an AR tracking module which supports augmented reality services. The system supports precise spatial matching with virtual space for the augmented reality service for the variable space. The present invention supports precise spatial matching in response to changes in space with the first one-time training for the augmented reality service for the variable space, supports precise spatial matching with the virtual space in real time by calibration, and supports precise spatial matching in response to spatial changes with the first one-time training.

Description

Multi-tracking augmented reality system

The present invention relates to a multi-tracking augmented reality system, and more particularly, to a real-time correction technology-based multi-tracking system that supports precise spatial matching with a virtual space for augmented reality service for a variable space.

In general, tracking technology is a key technology in the field of augmented reality. In the field of augmented reality (hereinafter referred to as AR), research is focused on "tracking technology" that can maximize the user's realistic experience through precise matching between physical and virtual space. Development is in progress. And as a prior art patent, Laid-Open Patent Publication No. 10-2020-0077049 discloses an image receiving unit for receiving an image of an object from a photographing unit;

an image processing unit that extracts feature points of the object from the image, identifies the object by comparing it with reference feature points stored in advance, and creates an augmented reality image by superimposing information on the object on the image; and

An apparatus for providing augmented reality of a markerless method, including an image output unit for outputting the augmented reality image to a display unit, is disclosed.

In addition, Patent Publication No. 10-2017-0134277 discloses an augmented reality service method for coloring games.

And, the tracking technology has recently been applied with sensing technology such as LADAR. is being used

In the existing object tracking using markers and images, the AR service was limited to a limited area centered on the object.

However, as a limitation of the existing space tracking technology, Google's AR Core and Apple's AR Kit are representative, but a training step to recognize the space before use is required every time, and direct connection between contents and surrounding objects is also not easy. Therefore, it is only possible to supply simple virtual content without context with the real space.

And with the continuous development of mobile devices, SLAM (Simultaneous localization and mapping) technology has been recently introduced, but a heavy computational amount is still a burden on the mobile device.

Therefore, precise tracking technology for a space with many variable elements is required.

Google's AR Core and Apple's AR Kit are trained every time, so there is no effect by variable factors, but there is no context with the real space.

SLAM can be executed only by training once for the first time, but when there is a change in the configuration of the space, there is a problem in spatial matching.

Therefore, the present invention has been devised to solve the above problems, and it is an object of the present invention to provide a tracking technology that supports accurate spatial matching in response to a change in space through the first training.

The present invention relates to a multi-tracking augmented reality system, comprising: a training module for initial spatial recognition; AR tracking module that supports augmented reality service; is configured to support precise spatial matching with virtual space for augmented reality service for variable space.

Therefore, the present invention supports accurate spatial matching in response to changes in space with the first training for augmented reality service for variable space,

It supports precise spatial matching with virtual space in real time by correction,

It has a remarkable effect of supporting accurate spatial registration in response to spatial changes with the first training.

1 is a block diagram of a multi-tracking system of the present invention;
2 is a state diagram in which spatial deformation occurs due to the characteristics of the pop-up book;
3 is a diagram of a state in which spatial change recognition is impossible in the case of a conventional single tasking;
4 is a multitasking and correction-based spatial reconstruction diagram of the present invention
5 is a state diagram of a pop-up book reconfigured based on multitasking and correction of the present invention;

The present invention relates to a multi-tracking augmented reality system, comprising: a training module for initial spatial recognition; AR tracking module that supports augmented reality service; is configured to support precise spatial matching with virtual space for augmented reality service for variable space.

In addition, in the training module, it is characterized in that the feature points for fixed space and variable elements are extracted from the image data input from the camera, and classification and positional relationship data are registered.

In addition, the AR tracking module is an execution technology that supports the actual AR service, and the image data input from the camera is matched with the training module in real time to calculate and correct the positional relationship for each target. It also features stable and robust AR service support.

The present invention will be described in detail with reference to the accompanying drawings as follows. 1 is a block diagram of a multi-tracking system of the present invention, FIG. 2 is a diagram of a state in which spatial deformation occurs due to the characteristics of a pop-up book, FIG. 3 is a diagram of a state in which spatial change is impossible in the case of a conventional single tasking, and FIG. Task and correction-based spatial reconstruction diagram, Figure 5 is a state diagram of the multitasking and correction-based spatial reconstructed pop-up book of the present invention.

The present invention is a multi-tracking system based on real-time correction technology that supports precise spatial matching with virtual space for augmented reality service for variable space.

The real-time correction technology-based multi-tracking system consists of a training module for initial spatial recognition and an AR tracking module supporting augmented reality services.

In the training module, feature points for fixed space and variable elements are extracted from the image data input from the camera, and classification and positional relationship data are registered.

And the AR tracking module is an execution technology that supports the actual AR service. By matching the video data input from the camera in real time with the training module, it calculates and corrects the positional relationship for each target, so it is stable even when there is a change due to variable elements in the real space. and supports robust AR services.

The training module and AR tracking module are described in detail as follows.

training module,

① Extract feature points from the image input from the camera.

② Select the feature point area with the greatest fixedness, create coordinates and register global targets.

③ Repeat feature point extraction for each variable spatial element, region selection, coordinate generation, and local target registration.

④ Complete registration for each variable space element.

AR tracking module

⑤ It recognizes each target through the video input from the camera.

⑥ Real-time matching of the location relationship of each local target centered on the global target.

⑦ Correct the coordinates of each target for spatial reconstruction centering on the global target.

When the system of the present invention is described, the app is downloaded and installed on the user's smartphone, which is a terminal, and when the user shines the smartphone camera on the spatially deformed target, a virtual 3D object appears together with the real target.

The app is a video input unit; an image processing unit comprising a filter unit; Training module (training unit); AR tracking module for augmented reality (AR tracking module); a storage unit for storing data; It is configured to include a control unit.

Therefore, the present invention supports accurate spatial matching in response to changes in space with the first training for augmented reality service for variable space, and supports precise spatial matching with virtual space in real time by correction, It has a remarkable effect of supporting accurate spatial registration in response to spatial changes through training.

Claims (3)

a training module for initial spatial recognition; AR tracking module that supports augmented reality service; is configured to support precise spatial matching with virtual space for augmented reality service for variable space, and in the training module, fixed Extracting feature points for spatial and variable elements, and registering classification and positional relationship data,
The AR tracking module is an execution configuration that supports the actual AR service, and it is stable even when there is a change due to a variable element in the real space by calculating and correcting the positional relationship for each target through real-time matching with the training module for the image data input from the camera. And in the multi-tracking augmented reality system that supports the robust AR service,
The training module,
① Extracting feature points from the video input from the camera,
② Create coordinates and register global targets by selecting the feature point area with the greatest stability,
③ Repeat extraction of feature points for each variable spatial element, selection of an area, creation of coordinates and registration of local targets,
Registration is completed for each variable space element,
AR tracking module
⑤ Through the video input from the camera, each target is recognized,
⑥ Real-time matching of the location relationship of each local target centered on the global target,
⑦ By correcting the coordinates of each target for spatial reconstruction centered on the global target,
The system downloads and installs the app on the user's smartphone, which is a terminal, and when the user illuminates the smartphone camera on the spatially deformed target, a virtual 3D object appears along with the real target,
The app is a video input unit; an image processing unit comprising a filter unit; Training module (training unit); AR tracking module for augmented reality (AR tracking module); a storage unit for storing data; Multi-tracking augmented reality system, characterized in that it comprises a control unit delete delete

Images