KR101641672B1 - The system for Augmented Reality of architecture model tracing using mobile terminal - Google Patents

The system for Augmented Reality of architecture model tracing using mobile terminal Download PDF

Info

Publication number
KR101641672B1
KR101641672B1 KR1020150103017A KR20150103017A KR101641672B1 KR 101641672 B1 KR101641672 B1 KR 101641672B1 KR 1020150103017 A KR1020150103017 A KR 1020150103017A KR 20150103017 A KR20150103017 A KR 20150103017A KR 101641672 B1 KR101641672 B1 KR 101641672B1
Authority
KR
South Korea
Prior art keywords
image
building
information
model
augmented reality
Prior art date
Application number
KR1020150103017A
Other languages
Korean (ko)
Inventor
김진만
Original Assignee
(주)디자인비아트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)디자인비아트 filed Critical (주)디자인비아트
Priority to KR1020150103017A priority Critical patent/KR101641672B1/en
Application granted granted Critical
Publication of KR101641672B1 publication Critical patent/KR101641672B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to an augmented reality system for executing a building model using a portable terminal, and its constitution includes a CG or a 3D projection algorithm, and includes a display unit, a mark on a building model, one or more buildings mounted on a linear execution frame, 3D image of stereoscopic data expressed by CG, 3D, and satellite images by combining satellite image or aerial photographed image data with landmark or building model mark and line data. A user terminal; The color difference between the original image and the first image of the background image is corrected by combining the first image of the satellite and the aerial photograph with the second image located by the mark or line of the building or model, An augmented reality device that extracts two-dimensional and three-dimensional tracking information of a tangible object based on a second image, and generates tracking information of the object by matching two-dimensional tracking information and three-dimensional tracking information; And visual information of data located at the mark and line of the exhibition track model by projecting the corresponding area of the exhibition hall and the building model on the basis of the satellite image and aerial image information and the exterior wall line of the building, And a web / app server for providing the photographed image information or the location data image information on the exhibition stand according to the information.
Accordingly, the present invention corrects simulation image background image data execution position errors of CG, 3D, and satellite pictures through execution coordinate commands output from markers built in a wall of a building model or linear markers or markers built on the bottom of a display stand, Based on this information, it is possible to verify the dynamic 3D images of the 3D model by expressing the details of lighting, surrounding background, roads, buildings and other facilities based on the converted information. do.

Description

[0001] The present invention relates to an augmented reality system for implementing a building model using a mobile terminal,

The present invention relates to an augmented reality system for executing a building model using a portable terminal, and more particularly, to an augmented reality system for performing a building model using a portable terminal by recognizing a marker or a line on the outer wall surface of the building model or the floor of the exhibition hall, A virtual display of objects through a portable display device can be used to identify three-dimensional images of three-dimensional models represented by images of CG, 3D, and satellite photographs, such as detailed background structures, roads, buildings, The present invention also relates to an augmented reality system for implementing a building model using a portable terminal capable of realizing real images (real images) by providing only virtual images necessary for actual implementation.

In addition, the present invention can be applied to a virtual space such as a computer graphics on a real-world or real-world image in a space where a physical space and an electronic space are fused using a personal portable object that can be tracked with a marker or a line on a subject located on a display The present invention relates to an augmented reality system for executing a building model using a portable terminal, which can be used to reinforce the real world by adding virtual information to a perception of a user by mixing the augmented reality system.

Generally, the building model is produced and displayed so that the actual building is reduced so that the viewer can easily observe and understand the status of the building type and the layout of the building.

In this case, since the building model is exhibited in a static state, it is difficult to obtain the status of the main road, the merit point, the location status, the parking lot status, the resident facility status, the additional facility status, the building type status, It is very limited.

In order to overcome such a static three-dimensional building model, a model interlocking interactive apparatus and method using a projector image has been proposed as a background technology of the present invention as Korean Registered Patent Registration No. 10 - 577118.

This model is made by using materials such as wood and gypsum to reduce the appearance of the topography, sightseeing spot and submerged area of mountains, valleys, and Korea (Jeolla, Gyeongsang ..), and the entire surface of the model is expressed in white A 3D model part for allowing the light to be projected well and various images provided in the upper part of the 3D model part for the weather changes such as heavy rainfall and heavy snowfall, A model setting unit including a push switch and a track ball so that a specific portion of the stereoscopic model unit is selected in the form of an image pointer; a push switch of the model setting unit; a video of the video output unit, A control unit for controlling the position at which the image is output to the stereoscopic model unit and for controlling the driving of the sound output simultaneously with the image, And the image display unit to display an image of the selected area to the LCD monitor is configured such that sound effects and natural sounds are output at the same time as the video output through a control of the controller.

The above background technique is a method of expressing a model by outputting an image through a project beam to a stereoscopic model part. It is difficult to select and illuminate the model part entirely or individually as compared with the 3D and CG direct implementations. It has a disadvantage that it needs to see the image of the place.

Conventionally, in order to execute a virtual reality, a simple virtual reality technique is set by setting a space in which an image can be simply displayed. In order to view many people at the same time, a signal value of a video device is read through a camera, And realizes the image through.

Many people feel that it is unnecessary to see the display that they want to see at the same time, and it is unnecessary to see the display that is running at the same time. In order to see where they want themselves, a virtual reality is realized by using the device-mounted display. And one person virtually imaged the image of the object in front with the limited safety goggles or the helmet type device.

When a large scale exhibition and demonstration such as a fair or a model house is carried out, a large number of people wait for a long time and can see their desired parts. However, since the devices that are maintained and maintained in the field are unique, they can not easily be used without waiting. Anyone can use the portable display device (mobile phone and tablet PC google glass, etc.) It is a reality that a stereoscopic image is projected on a display device capable of being used.

[Related Technical Literature]

1. Moving object tracking method using moving object characteristics in a video camera system (Patent Application No. 10-2008-0068197)

2. Moving object image extracting device (Patent Application No. 10-1997-0002669)

3. Interactive Interactive Equipment and Method Using Projector Image (Patent Application No. 10-0577118)

4. Lighting control system of miniature model for features (Patent Application No. 10-0930950)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a mobile terminal device capable of recognizing a marker or a line on the outer wall surface of a building model or a floor of a display stand, And a detailed structure of ancillary facilities, it is possible to view a virtual implementation shape of a thing through a portable display device so that a three-dimensional image of a three-dimensional model represented by images of CG, 3D, The present invention is to provide an augmented reality system for implementing a building model using a portable terminal capable of realizing a shape to be actually implemented as an actual space.

In addition, the present invention implements a simulation image by inputting a marker or a linear shape on a line of a shape of a building model or a shape of a model. A detailed structure of a lighting, a surrounding background, a road, a building and an auxiliary facility is expressed, And an object of the present invention is to provide an augmented reality system for executing a building model using a portable terminal capable of confirming a dynamic stereoscopic image.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the AR system of the architectural model execution using the portable terminal according to an embodiment of the present invention includes a CG or a 3D projection algorithm, and displays a building, a building model, A three-dimensional model represented by images formed by CG, 3D, and satellite photographs by combining the image data of buildings, roads, and terrain recorded on satellite or aerial photographs and the data of marks and lines of the exhibition hall or building model A user terminal providing an implementation image of stereoscopic data; The color difference between the original image and the first image of the background image is corrected by combining the first image of the satellite and the aerial photograph with the second image located by the mark or line of the building or model, An augmented reality device that extracts two-dimensional and three-dimensional tracking information of a tangible object based on a second image, and generates tracking information of the object by matching two-dimensional tracking information and three-dimensional tracking information; And visual information of data located at the mark and line of the exhibition track model by projecting the corresponding area of the exhibition hall and the building model on the basis of the satellite image and aerial image information and the exterior wall line of the building, And a web / app server for providing the photographed image information or the location data image information on the exhibition stand according to the information.

In addition, the augmented reality system for executing a building model using the portable terminal according to the present invention is characterized in that the user terminal includes a CG or a 3D projection algorithm for driving an augmented reality, A three-dimensional model represented by images formed by CG, 3D, and satellite photographs by combining the above-mentioned buildings, road facilities, and terrain with image data obtained by satellite or aerial photographing and data located on marks and lines of the exhibition hall or building model , A display unit provided in a web / application server, a corresponding area of a building model, a satellite image and an aerial photographing image, and an outer wall line of a building By projecting and recognizing the image information of the data located at the mark and line of the display track model, A modeling unit for performing three-dimensional modeling by restoring or scaling the inputted reference type and pattern by using pattern recognition, a 3D positional information value received from the 3D or GPS satellite as a three-dimensional coordinate value, A sensor module unit for calculating three-dimensional coordinate values in real time based on the tracking information of the object by matching two-dimensional tracking information and three-dimensional tracking information tracked and presented to the real device, A storage unit for receiving object movement information for movement of a virtual object in the augmented reality apparatus through the server and storing the object movement information, the augmented reality apparatus comprising: And the predetermined augmented reality image data corresponding to the analysis result is photographed according to the implementation function An output unit for outputting the augmented reality contents applied to the augmented reality contents on the basis of the user's driving signal in response to a driving signal of the user based on the object movement control information, Roads, buildings, and units through execution coordinate commands output from markers built in the wall of the building model or linear, or markers built into the floor of the building in response to the user's request signal. A voice transmission unit for expressing the detailed structure of the facility and a three-dimensional model of the augmented reality stereoscopic image together with voice, and a display or model mark form, one or more buildings mounted on a linear execution frame, Simulation image data with facilities and terrain recorded, main road status, merit point And a selection operation unit for selectively reproducing the user terminal device by reproducing guide data such as a location status, a parking lot status, a resident facility status, an incidental facility status, and a building type status.

According to another aspect of the present invention, there is provided an augmented reality system for executing a building model using a portable terminal, the augmented reality system comprising: a recording medium on which simulated image data of a building model and announcement voice data are recorded; A server connected to a user terminal device for reproducing audio data and transmitting an image to be reproduced to the user terminal, and a general operation of the augmented reality device so that necessary augmented reality image information is outputted by controlling the augmented reality device according to a signal An error generation unit for generating a color error table by combining the original background image projected on the first server with the second server by inputting the CG or 3D mark on the original background image and the model mark on the front face, And the color of the first server and the image of the second server A color calibration module for generating a color error table by correcting an error, a first marker installed on the outer wall of the model building as a tangible object based on the second server image, and detecting a position of the tangible object located on the surface of the table, And a matching unit for generating tracking information of the tangible object by matching the two-dimensional tracking information and the three-dimensional tracking information extracted by the extracting unit .

According to another aspect of the present invention, there is provided an augmented reality system for executing a building model using a portable terminal, wherein the extraction unit recognizes a first marker installed on an outer wall of the model building as a tangible object based on the second server image, A two-dimensional tracking information extracting unit for extracting two-dimensional tracking information including at least one of a position and orientation of a tangible object located on a surface of a table after the first image including the first image is corrected, Dimensional tracking information including at least one of three-dimensional position information, azimuth information, and attitude information of the tangible object is recognized by recognizing the second marker input in the shape of the line of the building contour of the tangible object based on the second image And a three-dimensional tracking information extracting unit.

The augmented reality system for executing the architectural model using the portable terminal according to the embodiment of the present invention can be implemented in a computer system such as a CG, a 3D, a 3D, and a 3D system through an execution coordinate command output from a marker built in a wall surface of a building model, Simulation of satellite images Background image It corrects the position error, converts the matched information into the coordinates of the virtual space, and based on it, displays the detailed structure of lighting, surrounding background, road, And thus, it is possible to confirm a dynamic augmented reality stereoscopic image.

In addition, the augmented reality system for executing the architectural model using the portable terminal according to the embodiment of the present invention is a system in which a user places a specific space on a daily basis based on a satellite, aerial photographing, CG, It is possible to provide users with more intuitive and diverse interactions by moving and manipulating the space of a specific virtual object by using the same augmented reality technology as that which is felt and felt in the virtual environment of the model, It is also possible to provide sufficient information to the user by providing the commentary through the guidance voice along with the expression of the stereoscopic image building model.

In addition, the augmented reality system for executing the architectural model using the portable terminal according to the embodiment of the present invention can be applied to a model display system in which a model, which is placed on a floor of a display space or on a display stand or is hung on a wall side of an exhibition space, It is possible to easily recognize the shape of the model or the display layout of the display stand through the display window by recognizing the markers, objects or lines mounted on the display stand, the model, or the like through the user terminal device at a certain distance from the inside or the model display stand to provide.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is an exemplary diagram of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention; Fig.
2 is a block diagram of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention
3 is a block diagram illustrating a detailed configuration of a user terminal of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention.
FIG. 4 is a block diagram illustrating a detailed configuration of an augmented reality system of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention.
5 is a block diagram showing a configuration of a server according to FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.

The present invention relates to a method and apparatus for displaying a dynamic image of a three-dimensional model by expressing a detailed structure of lighting, surrounding roads, buildings, and ancillary facilities by executing a simulation image as a marker or a linear- The present invention relates to an augmented reality system for executing a building model using a portable terminal having a device of a portable terminal so that stereoscopic images can be checked.

FIG. 1 is a diagram illustrating an augmented reality system for implementing a building model using a portable terminal according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a configuration of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention. Fig. 1 and 2, an augmented reality system for executing a building model using a portable terminal according to the present invention includes a user terminal 100, an augmented reality device 200, a web / app server 300, 400).

The detailed configuration and operation of the augmented reality system of the architectural model execution using the portable terminal according to the present invention will be described. First, the user terminal 100 is implemented to be able to download a specific app for driving an augmented reality, Algorithms are embedded in the data to be displayed on the display stand, on the building model, on one or more buildings mounted on the linear execution frame, on the facilities and terrain of the road, Dimensional images of three-dimensional models represented by images formed by CG, 3D, and satellite photographs in combination.

The augmented reality device 200 combines the area of the exhibition hall and the building model with the first image of the satellite and aerial photographs and the second image located by the marks and lines of the exhibition hall or building model, The color error is corrected, the two-dimensional and three-dimensional tracking information of the tangible object is extracted based on the first and second images, and the tracking information of the object is generated by matching the two-dimensional tracking information and the three-dimensional tracking information.

The web / app server 300 projects the corresponding area of the building model on the basis of the satellite image and aerial photographed image information and the outer wall line of the building, and stores the image information of the data located at the mark and line of the exhibition track model And provides the photographed image information or the position data image information on the display unit according to a request signal of the augmented reality device 200.

On the other hand, the server 300 may include a first server for providing a first image by photographing the area by satellite or aerial photographing, and a second server for combining the image of the first server with the image using mark- 2 servers.

In addition, the communication network 400 provides a communication network for the augmented reality system of the architecture model in cooperation with the user terminal 100, the augmented reality device 200, and the web / app server 300, respectively.

In the present invention, the communication network 400 is a high speed communication network of a large communication network capable of large capacity, long distance voice and data service, and may be a next generation wired and wireless network for providing Internet or high speed multimedia service. When the communication network 300 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, although not shown in the drawing, the communication network 300 may include an RNC (Radio Network Controller). Meanwhile, although the WCDMA network is exemplified, it may be a next generation communication network such as a 3G LTE network or a 4G network, or an IP network based on other IP. The communication network 400 transmits signals and data between the user terminal 100, the augmented reality device 200, the web / app server 300, and other systems.

FIG. 3 is a block diagram illustrating a detailed configuration of a user terminal of an augmented reality system for executing a building model using a portable terminal according to an embodiment of the present invention. The user terminal 100 includes a microcomputer 110, a modeling unit 120 A sensor module unit 130, a storage unit 140, an output unit 150, a moving unit 160, a voice transmission unit 170, and a selection operation unit 180.

Hereinafter, the detailed configuration and operation of the user terminal 100 of the augmented reality system of the architectural model execution using the portable terminal according to the present invention will be described with reference to FIGS. 1 to 3. Referring to FIG. 1, , CG or 3D projection algorithms are embedded to display the building, mark on the building model, one or more buildings mounted on the linear execution frame, the facilities and terrain of the road recorded, satellite or aerial photographed image data, Dimensional data represented by CG, 3D, and satellite images in combination with data located on a line by using a plurality of 3D models, and to control the overall operation of the user terminal 100 to provide stereoscopic data of stereoscopic data.

The modeling unit 120 projects the corresponding area of the exhibition hall and the building model provided by the web / app server 300 according to the control signal of the microcomputer 110 on the basis of the satellite image and aerial photographed image information, Dimensional modeling by restoring the outline of the facility by recognizing the image information of the data located at the marks and lines of the exhibition track model or changing the scale of the inputted reference type and pattern by using the pattern recognition.

When acquiring a three-dimensional model of an object to be displayed on the augmented reality in response to the control signal of the microcomputer 110, the modeling unit 120 calculates a three-dimensional model of the object to be augmented, The collimation order of the user can be added as a tag to the collimated and calculated coordinate values.

The sensor module unit 130 calculates the position information value received from the 3D GPS satellite by the control signal of the microcomputer 110 as a three-dimensional coordinate value, Dimensional tracking information and three-dimensional tracking information, and calculates coordinate values in three dimensions in real time based on the tracking information of the object in a predetermined direction and angle.

The storage unit 140 applies the augmented reality contents to the architectural model in response to the control signal of the microcomputer 110 and receives the object movement information for moving the virtual object in the augmented reality apparatus through the server 300 And stores it.

The output unit 150 analyzes an execution position of a user of the user terminal 100 by implementing an image in which the augmented reality device is located in a specific imaging region according to a control signal of the microcomputer 110, And outputs the augmented reality content that is applied to the photographed image according to the performance of the implementing function.

The moving unit 160 responds to a user's driving signal based on an image captured by the user terminal 100, and the augmented reality device 200 responds to a user access based on object movement control information, And to move to the virtual object.

In response to the control signal from the microcomputer 110, the voice transmitter 170 responds to a request signal from the user of the user terminal 100 to output a marker built in the wall of the building model or a marker built in the bottom of the display stand The detailed structure of the surrounding background, the road, the building, and the auxiliary facilities is expressed through the execution coordinate command, so that the three-dimensional model of the augmented reality stereoscopic image can be expressed and the corresponding details can be transmitted by voice.

In addition, the selection operation unit 180 may include simulation data such as a display stand or model mark form, one or more buildings mounted on a linear execution frame, facilities such as roads and terrain, The user terminal 100 can be selectively reproduced by reproducing guide data such as the status of the user terminal 100, the status of the resident facility, the status of the auxiliary facility, and the status of the building type.

FIG. 4 is a block diagram illustrating a detailed configuration of an augmented reality device 200 of an augmented reality system in a building model implementation using a portable terminal according to an embodiment of the present invention. The augmented reality device 200 includes a controller 210, An error generation unit 220, a color calibration module 230, an extraction unit 240, and a matching unit 250.

Hereinafter, the detailed configuration and operation of the augmented reality system 200 of the augmented reality system of the architectural model using the portable terminal according to the present invention will be described with reference to FIGS. 1 to 4. Referring to FIG. The area of the building model is corrected with the first image of the satellite and aerial photographs and the second image located by the marks and lines of the exhibition hall or building model to correct the color error between the original and the first image of the background image, Dimensional tracking information and three-dimensional tracking information of the tangible object based on the two images, and generates tracking information of the object by matching the two-dimensional tracking information and the three- .

The error generation unit 220 synthesizes the original background image projected from the first server with the second server by inputting the CG or 3D mark on the original background image on the model mark and surface in accordance with the control signal of the controller 210 Thereby generating a color error table.

The color calibration module 230 corrects the color difference between the original background image generated through the error generator 220 and the image of the first server and the second server according to the control signal of the controller 210 Thereby generating a color error table.

The extraction unit 240 recognizes the first marker installed on the outer wall of the model building as a tangible object based on the second server image in accordance with the control signal of the controller 210 and determines the position of the tangible object located on the surface of the table, Dimensional orientation information and at least one of orientation information.

The matching unit 250 generates tracking information of the tangible object by matching the two-dimensional tracking information extracted by the extracting unit 240 with the three-dimensional tracking information according to a control signal of the controller 210. [

On the other hand, the control unit 210 is connected to a recording medium on which the simulation image data of the building model and the guidance voice data are recorded, and a user terminal device that reproduces simulation image data and voice data stored in the recording medium, And controls the augmented reality apparatus according to a signal transmitted to the user terminal and a signal so that necessary simulation image information is output.

5 shows a detailed configuration of the extracting unit 240 of the augmented reality device 200 of FIG. 4. The extracting unit 240 includes a two-dimensional trace information extracting unit 242 and a three-dimensional trace information extracting unit 244.

The two-dimensional trace information extracting unit 242 recognizes the first marker installed on the outer wall of the model building as a tangible object based on the second server image, receives the first image including the image of the first marker, Dimensional tracking information including at least one of the position and the orientation of the tangible object positioned on the surface of the table after correcting the color of the table, and the three-dimensional tracking information extracting unit 244 extracts, based on the second image Dimensional tracing information including at least one of three-dimensional position information, azimuth information, and attitude information of a tangible object is recognized by recognizing a second marker input in the shape of a line of a building contour of the tangible object.

As described above, the augmented reality device 200 according to the present invention inputs the original background image in CG or 3D on a model mark or a front surface, and transmits the projected original background image to the second server So that a color error table can be generated.

If the object of the user terminal is not in contact with the surface of the model, the augmented reality providing method generates the tracking information of the object of the user terminal based on the 3D tracking information extracted based on the second image can do.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

100: user terminal
110: Microcomputer 120: Modeling unit
130: Sensor module unit 140: Storage unit
150: output unit 160: moving unit
170: audio transmission unit 180: selection control unit
200: augmented reality device
210: control unit 220:
230: color correction module unit 240:
242: Two-dimensional tracking information extracting unit 244: Three-dimensional tracking information extracting unit
300: Web / App server 400:

Claims (4)

CG or 3D projection algorithms are embedded to display the building, mark on the building model, one or more buildings mounted on the linear execution frame, image data of satellite or aerial photographs of facilities and terrain on the road, and marks and lines of the exhibition hall or building model A user terminal 100 for providing a stereoscopic image of a three-dimensional model represented by an image formed of CG, 3D, and satellite photographs in combination with data positioned therein; The color difference between the original image and the first image of the background image is corrected by combining the first image of the satellite and the aerial photograph with the second image located by the mark or line of the building or model, An augmented reality apparatus 200 for extracting two-dimensional and three-dimensional tracking information of a tangible object based on a second image, and generating tracking information of the object by matching two-dimensional tracking information and three-dimensional tracking information; And visual information of data located on the mark and line of the exhibition track model by projecting the corresponding area of the exhibition hall and the building model on the basis of the satellite image and aerial image information and the outer wall line of the building, And a Web / App server (300) for providing the photographed image information or the location data image information on the display area according to a request signal of the mobile terminal, the augmented reality system comprising:
The user terminal 100
A CG or 3D projection algorithm is embedded for the augmented reality to display the building, mark on the building model, one or more buildings mounted on the linear execution frame, image data of satellite or aerial photographs recorded on the facilities and terrain of the road, Dimensional image of the 3D model represented by CG, 3D, and satellite images by combining the data of the mark and the line positioned at the mark and the line of the user terminal 100 to control the overall operation of the user terminal 100 (110),
According to the control signal of the microcomputer 110, the corresponding area of the exhibition hall and the building model provided by the web / application server 300 is projected based on the satellite image and aerial image information and the exterior wall line of the building, A modeling unit 120 for restoring an outline of a facility through recognition of image information of data positioned in a line or performing three-dimensional modeling by changing scale of input reference type and pattern using pattern recognition,
Dimensional positional information received from the 3D or GPS satellite according to the control signal of the microcomputer 110 as a three-dimensional coordinate value, and outputs the two-dimensional tracking information and three-dimensional tracking information A sensor module 130 for calculating coordinate values in three dimensions in real time based on the tracking information of the object,
A storage unit 140 for receiving the augmented reality contents in response to a control signal of the microcomputer 110 to the building model, receiving object movement information for moving the virtual objects in the augmented reality apparatus through the server 300, ),
The augmented reality device implements an image positioned in a specific photographing area according to a control signal of the microcomputer 110 and analyzes the execution position of the user of the user terminal 100 and outputs predetermined augmented reality image data corresponding to the analysis result An output unit 150 for outputting the augmented reality contents applied to the photographed image according to the implementation function,
The augmented reality device 200 responds to a user's driving signal based on the captured image of the user terminal 100 and moves to a virtual object in the augmented reality contents in response to user access based on object movement control information. (160),
In response to a request signal from the user of the user terminal 100 in response to a control signal from the microcomputer 110, a marker built in a wall of the building model or a marker built in the floor of the building, A voice transmission unit 170 for expressing a detailed structure of a road, a building, and an auxiliary facility and expressing the three-dimensional model of the augmented reality stereoscopic image together with the corresponding details by voice;
Simulation image data and major road status, features, location, parking lot, residents' facilities, additional facilities, etc., which have facilities such as one or more buildings, roads, And a selection operation unit (180) for selectively reproducing the device of the user terminal (100) by reproducing guide data such as the current state of the building type and the like.
delete delete delete
KR1020150103017A 2015-07-21 2015-07-21 The system for Augmented Reality of architecture model tracing using mobile terminal KR101641672B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150103017A KR101641672B1 (en) 2015-07-21 2015-07-21 The system for Augmented Reality of architecture model tracing using mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150103017A KR101641672B1 (en) 2015-07-21 2015-07-21 The system for Augmented Reality of architecture model tracing using mobile terminal

Publications (1)

Publication Number Publication Date
KR101641672B1 true KR101641672B1 (en) 2016-07-21

Family

ID=56680694

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150103017A KR101641672B1 (en) 2015-07-21 2015-07-21 The system for Augmented Reality of architecture model tracing using mobile terminal

Country Status (1)

Country Link
KR (1) KR101641672B1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101874345B1 (en) * 2017-02-08 2018-07-06 (주) 문화상상연구소 Method for displaying royal tomb using an augmented reality
KR20190105989A (en) 2018-03-07 2019-09-18 케이애드에스엔씨 주식회사 Ar guide system for exhibition halls
CN111915608A (en) * 2020-09-11 2020-11-10 北京百度网讯科技有限公司 Building extraction method, device, equipment and storage medium
US11307825B1 (en) 2021-02-28 2022-04-19 International Business Machines Corporation Recording a separated sound from a sound stream mixture on a personal device
CN116489592A (en) * 2023-05-26 2023-07-25 安徽江澜建设工程有限公司 Assembled building construction monitored control system based on three-dimensional model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05242204A (en) * 1992-02-27 1993-09-21 Sekisui House Ltd Method for generating and displaying virtual completion picture of building and its periphery
JP2006018444A (en) * 2004-06-30 2006-01-19 Taisei Corp Image processing system and additional information indicating device
KR20090000777A (en) * 2007-04-02 2009-01-08 광주과학기술원 Augmented reality system using tangible object and method for providing augmented reality
KR20140082610A (en) * 2014-05-20 2014-07-02 (주)비투지 Method and apaaratus for augmented exhibition contents in portable terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05242204A (en) * 1992-02-27 1993-09-21 Sekisui House Ltd Method for generating and displaying virtual completion picture of building and its periphery
JP2006018444A (en) * 2004-06-30 2006-01-19 Taisei Corp Image processing system and additional information indicating device
KR20090000777A (en) * 2007-04-02 2009-01-08 광주과학기술원 Augmented reality system using tangible object and method for providing augmented reality
KR20140082610A (en) * 2014-05-20 2014-07-02 (주)비투지 Method and apaaratus for augmented exhibition contents in portable terminal

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101874345B1 (en) * 2017-02-08 2018-07-06 (주) 문화상상연구소 Method for displaying royal tomb using an augmented reality
KR20190105989A (en) 2018-03-07 2019-09-18 케이애드에스엔씨 주식회사 Ar guide system for exhibition halls
CN111915608A (en) * 2020-09-11 2020-11-10 北京百度网讯科技有限公司 Building extraction method, device, equipment and storage medium
CN111915608B (en) * 2020-09-11 2023-08-15 北京百度网讯科技有限公司 Building extraction method, device, equipment and storage medium
US11307825B1 (en) 2021-02-28 2022-04-19 International Business Machines Corporation Recording a separated sound from a sound stream mixture on a personal device
CN116489592A (en) * 2023-05-26 2023-07-25 安徽江澜建设工程有限公司 Assembled building construction monitored control system based on three-dimensional model
CN116489592B (en) * 2023-05-26 2024-01-26 安徽江澜建设工程有限公司 Assembled building construction monitored control system based on three-dimensional model

Similar Documents

Publication Publication Date Title
US11887312B2 (en) Fiducial marker patterns, their automatic detection in images, and applications thereof
KR102417645B1 (en) AR scene image processing method, device, electronic device and storage medium
EP2579128B1 (en) Portable device, virtual reality system and method
CN110383343B (en) Inconsistency detection system, mixed reality system, program, and inconsistency detection method
KR101641672B1 (en) The system for Augmented Reality of architecture model tracing using mobile terminal
US20190041972A1 (en) Method for providing indoor virtual experience based on a panorama and a 3d building floor plan, a portable terminal using the same, and an operation method thereof
US8963943B2 (en) Three-dimensional urban modeling apparatus and method
US20180096450A1 (en) Shared virtual reality
KR101867020B1 (en) Method and apparatus for implementing augmented reality for museum
CN105393284A (en) Space carving based on human physical data
JP6348732B2 (en) Information processing system, information processing apparatus, information processing program, and information processing method
CN102281455A (en) Image display apparatus, image display system, and image display method
KR101553273B1 (en) Method and Apparatus for Providing Augmented Reality Service
EP3264228A1 (en) Mediated reality
CN113377205B (en) Scene display method and device, equipment, vehicle and computer readable storage medium
Piérard et al. I-see-3d! an interactive and immersive system that dynamically adapts 2d projections to the location of a user's eyes
CN115686233A (en) Interaction method, device and interaction system for active pen and display equipment
KR101860215B1 (en) Content Display System and Method based on Projector Position
Hew et al. Markerless Augmented Reality for iOS Platform: A University Navigational System
KR20190105989A (en) Ar guide system for exhibition halls
JP2013037476A (en) Observation device, observation method and imaging apparatus
WO2021166751A1 (en) Information-processing device, information-processing method, and computer program
CN118155465A (en) Immersive virtual simulation experiment platform and method
CN117716419A (en) Image display system and image display method
CN113450439A (en) Virtual-real fusion method, device and system

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190702

Year of fee payment: 4