KR20130101622A - Apparatus and system for 3 dimensional design using augmented reality and method for design evaluation - Google Patents

Abstract

PURPOSE: A mobile device for design evaluation for AUGMENTED REALITY-based 3D design, a system thereof, and a method thereof are provided to combine a virtual design model with reality situation information obtained from a site by using a portable terminal and to instantly evaluate the model based on the combination result. CONSTITUTION: A mobile device (10) for design evaluation obtains a reality image, obtains a 3D model of an evaluation target facility based on an image of the facility and a vertical angle, a horizontal angle, an azimuth, and coordinates of a measurement position, and generates an augmented reality image by overlapping a virtual augmented reality layer with the reality image. A design server (30) stores 3D model data and image data transceived with the mobile device. [Reference numerals] (11) Three-dimensional modeling unit; (12) Sensor unit; (121) Camera module; (122) Posture sensor; (123) Terrestrial magnetism sensor; (124) Location measuring module; (13) Storage unit; (14) Transmitting unit; (15) Augmented reality generating unit; (16) Simulation unit; (17) Control unit; (31) Model data storage unit; (32) Store images; (33) Transceiver unit; (34) Data processing unit; (35) Model DB; (36) Image DB

Description

{APPARATUS AND SYSTEM FOR 3 DIMENSIONAL DESIGN USING AUGMENTED REALITY AND METHOD FOR DESIGN EVALUATION} for Mobile Device, Design Evaluation System and Design Evaluation Method for 3D Design Based on Augmented Reality

The present invention relates to a design evaluation technique, and more particularly, to a design evaluation technique using a three-dimensional model.

Buildings such as buildings, interior furniture, civil engineering, landscaping facilities, streets and environmental facilities are social infrastructures that make human life easier by constructing artificial structures on the natural environment. These infrastructures must be able to fulfill their functions, keep the facilities safe, and be designed with aesthetics in place to suit their surroundings.

However, existing facility plans or design plans focused on functionality, efficiency, and economic perspectives, so that the consideration of aesthetic or ecological harmony with the natural environment and the surrounding artificial environment was insufficient. In the design planning work in buildings, roads and auxiliary facilities, civil engineering, molding and environmental facilities, the development-oriented concept of planning, design, and alternative evaluation, which mainly considers structural stability and cost, has been dominant in the design work. . As a result, excessive damage to the natural environment may occur in construction, civil engineering, and landscaping, resulting in the occurrence of disasters, or structures that are not harmonized with the surrounding environment are often installed.

But now, not only is it convenient to live in, it is also required to change perceptions that improve the quality of life. In addition to the suitability of the functions, structural stability, and cost-effectiveness of the design target, the design is pleasant and pleasant to look at, and the landscape design is also an important factor to create beautiful facilities and interior and exterior interior spaces that match the surrounding environment. Acts as.

The beauty of the structure, that is, the elements that determine aesthetics and scenery include form, scale, color, and material. The designer must carefully combine design elements in consideration of the local landscape, history, culture, ecosystem, and environment.

Accordingly, it is possible to use the design system of the personal computer that can be easily used in the surroundings or the Internet, or to use the virtual terminal or the portable terminal such as the design simulator to design and design in consideration of the environment-friendly, surrounding environment and the scenery to be inquired. In order to preserve the social, cultural, aesthetic, and emotional values by constructing visually beautiful artistic sculptures, the trend is to evaluate design.

Conventionally, the portable terminal is merely used as a means of receiving simple image information or geographic information. For example, a photo program and a previously prepared photo image and design are stored in the portable terminal after synthesizing the image synthesized from the personal computer terminal in a dedicated program. It was reviewed by, and its utilization in the field was limited.

The problem to be solved by the present invention is a mobile device for design evaluation, which can combine the virtual design model with the actual situation information obtained in the field using a portable terminal, and can immediately evaluate the design model based on the result of the combination, design evaluation To provide a system and design evaluation method.

The augmented reality design evaluation system according to the present invention may include a mobile device for design evaluation, a network, and a design server.

According to an embodiment of the present disclosure, the mobile device for design evaluation may acquire a desired subject and related data using augmented reality in an image acquired using a portable terminal such as a smartphone, and transmit the data to a data server.

According to an embodiment, the mobile device for design evaluation may construct a virtual three-dimensional model from a real model and make a database using augmented reality based on an image of the real world. The mobile device for design evaluation can freely combine three-dimensional models to form and view an entire structure model, and a user can easily set and change design elements such as color, material, and shape of the three-dimensional model.

According to an embodiment, the mobile device for design evaluation projects the 3D model set and changed by the user to the real world through augmented reality, and evaluates the design in real time based on a 3D model virtually superimposed in the real world. Can be modified.

According to a mobile device for design evaluation, a design evaluation system and a method of the present invention, a desired subject and its data are acquired using augmented reality in an image acquired using a portable terminal such as a smartphone, and transmitted to a data server. Can be.

According to the mobile device for design evaluation, the design evaluation system and the method of the present invention, a virtual three-dimensional model can be constructed and databased from a real model using augmented reality based on the image of the real world.

According to the mobile device for design evaluation, design evaluation system and method of the present invention, it is possible to freely combine the three-dimensional models to form and view the entire structure model, the user can design the design elements such as color, material, shape, etc. of the three-dimensional model Easy to set up and change

According to the mobile device for design evaluation, the design evaluation system and the method of the present invention, the 3D model set and changed by the user is projected to the real world through augmented reality, and based on the 3D model virtually superimposed in the real world. Evaluate and modify designs in real time. Users can freely change the dimensions, appearance, color, pattern, shape, and cross-section of a 3D structure model in augmented reality, so that the actual space of a facility, parts, equipment, or furniture can be changed without placing the actual facility, furniture, or equipment. You can immediately examine the color and pattern of the environment, the suitability of the size, dimensions and scale, and the rationality of the facility layout.

1 is a conceptual diagram illustrating a mobile device and system for design evaluation according to an embodiment of the present invention.
2 is a flowchart illustrating a method for creating, arranging, and modifying a 3D model based on augmented reality in a mobile device for design evaluation according to an embodiment of the present invention.
3 is a flowchart illustrating a case of designing a road facility in a method for evaluating a 3D model design based on augmented reality using a mobile device for design evaluation according to an embodiment of the present invention.
4 is a flowchart illustrating a case of designing a bridge in a 3D model design evaluation method based on augmented reality using a mobile device for design evaluation according to an embodiment of the present invention.
5 is a flowchart illustrating a case of designing a landscape plan in an augmented reality-based 3D model design evaluation method using a mobile device for design evaluation according to an embodiment of the present invention.
6 is a flowchart illustrating a 3D model restoration method through 3D spatial recognition and image processing of a facility to display a 3D model based on augmented reality in a mobile device for design evaluation according to an embodiment of the present invention.

For the embodiments of the invention disclosed herein, specific structural and functional descriptions are set forth for the purpose of describing an embodiment of the invention only, and it is to be understood that the embodiments of the invention may be practiced in various forms, The present invention should not be construed as limited to the embodiments described in Figs.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

In design and landscape, a model is generally a target model. The target model includes a real scale model, a map, a drawing, and a three-dimensional augmented model. As a theoretical model, a language model and a mathematical model can be considered. As a factor constituting the quality of design and landscape, it is possible to define its own form, color, and meaning of objects. In this model, in addition to the visual attributes of the subjects themselves, the relations between the subjects can be included in the information.

The design evaluation factors of the facility include the landscape to measure the degree of harmony with the surroundings, the view according to the type of the user, the harmony according to the hierarchy of the facility, the location, scale, form, color, to evaluate the relationship between the location and the view of the facility. It can be composed of eight evaluation elements such as materials.

1 is a conceptual diagram illustrating a mobile device for design evaluation and an augmented reality design evaluation system according to an embodiment of the present invention.

The augmented reality design evaluation system may include a mobile device 10 for design evaluation, a network 20, and a design server 30.

For example, the mobile device 10 for design evaluation, which is a portable terminal such as a smartphone, a PDA, a tablet PC, a small notebook, has a GPS position measuring function, a posture measuring function using a geomagnetic sensor and an acceleration sensor, a direction measuring function, a camera function, It can be implemented by installing and driving a predetermined application in a portable information processing terminal having a communication function. The mobile device 10 for design evaluation may have a processing capacity and a capacity sufficient to smoothly install and run an application.

The network 20 is preferably a mobile communication network, and may use a wired or wireless communication network including a wireless broadband communication network such as WiBro, WCDMA, LTE, or a wireless local area network such as WLAN.

Based on various image data generated by the mobile device 10 for design evaluation using a camera module and various model data generated using various sensor functions such as a GPS sensor, a geomagnetic sensor, and an acceleration sensor, time and When the data is transmitted by adding the spatial information tag of the location information, the design server 30 stores the transmitted data as a database, and in particular, the 3D model information among the transmitted data is databased in the model data DB 35. The video data may be stored in the video data DB 36.

In addition, the design server 30 is a database unit 35, 36 for the model data restored in the three-dimensional from the photographs and video data, images obtained in advance in the product and facilities requested by the mobile device for design evaluation 10, respectively In the search, the searched data may be transmitted to the mobile device 10 for design evaluation.

The augmented reality design evaluation system may further include a web server 40. The web server 40 interlocks with the model storage unit 31 and the image storage unit 32 of the design server 30 to read various data databased in the databases 35 and 36 of the design server 30. It can provide a web service that can.

Specifically, the mobile device 10 for design evaluation includes the 3D modeling unit 11, the sensor unit 12, the storage unit 13, the transmission unit 14, the augmented reality generator 15, and the simulation unit 16. ), And a controller 17.

The 3D modeling unit 11 may measure the amount of energy reflected or transmitted from the object based on the image, and measure the 3D spatial coordinates in a non-contact state with respect to the object to be measured.

According to an embodiment, the three-dimensional modeling unit 11 projects a structured light or a laser light to an object and measures a time of flight (TOF) method for measuring the time when the ultrasound or laser projected on the object is returned. 3D spatial coordinates of an object can be measured.

In another embodiment, the 3D modeling unit 11 may estimate 3D spatial coordinates directly from the input image by using the contrast and the parallax of the image.

For example, a feature point of an image may be extracted from an image acquired by a camera using an automatic correction technique using a position measurement module and a posture sensor, and the image may be reconstructed through image registration. By photographing at various locations around the object, the coordinates of the measurement position may be inferred, the feature points may be extracted from the images, and the images may be matched based on the feature points. Corner extraction algorithms can be used to increase the matching rate. The matched image is processed into a three-dimensional model in the geometric space, and through the camera distortion correction process, a three-dimensional model that differs only in Euclidean geometry and scale may be generated.

In the modeling of the 3D modeling unit 11, a limited extraction of only information necessary for a specific design plan and design from various attributes of the object is performed, and the effect intended for the work or the factors explained between the explained variable and the explanatory variable. By clarifying the relationship, the object can be specified in a form that is easy to manipulate.

The 3D modeling unit 11 may perform 3D modeling through image recognition. For example, 3D modeling may be performed by restoring an outline of a facility through image recognition or by changing a scale of an input reference type and a pattern using pattern recognition.

In image recognition, line segments, character information, images, and the like, which are recognized and extracted by signboards of shops, logos or marks of facilities, road signs, and the like, may be separately managed.

The 3D modeling unit 11 may obtain a 3D model by a user's manipulation. When acquiring a three-dimensional model of an object to be displayed in augmented reality, the user's collimation order can be added as a tag to the collimated and calculated coordinate values with respect to the reference point and the point, the restored line segment and the characters to be augmented. Can be.

The sensor unit 12 may include a camera module 121, an attitude sensor 122, a geomagnetic sensor 123, and a position measuring module 124.

The camera module 121 may acquire an image in a predetermined direction and an angle in real time based on a reference line currently being collimated by the mobile device 10 for design evaluation during operation, preferably optical zoom or digital zoom. This is possible, and more preferably may include a camera shake correction function.

The posture sensor 122 may be implemented as a gravity sensor, an acceleration sensor, a gyroscope sensor, or the like. Preferably, the posture sensor 122 may measure the horizontal angle of the mobile device 10 for design evaluation as a three-axis component.

The geomagnetic sensor 123 may measure the direction of the magnetic north pole on the basis of the mobile device 10 for design evaluation using the earth magnetic field, and preferably the direction of the magnetic north pole as a three-axis component.

The position measuring module 124 may use, for example, a GPS navigation system, and receives a propagation navigation signal from at least three GPS satellites, additionally from a reference station installed on the ground, to design the mobile device 10 for design evaluation. The three-dimensional coordinate value of can be calculated.

The position measurement module 124 is preferably a GPS module, but is not limited thereto. In addition, the position measurement module 124 may be a position measurement module using various commercial satellite navigation systems, or may be a differential GPS (DGPS), assisted GPS (A-GPS), or national measurement. It may be a position measurement module using a triangulation method based on the reference point or the location information of the mobile communication base station.

The storage unit 13 is a photographic data, video data, or previous measurement data, other additional data, received from the design server 30 via the network 20, the measurement data obtained from the mobile device 10 for design evaluation In addition, various measurement performance data such as photographic data and tags added including absolute coordinate values or measurement date and time of the spatial location may be structured and stored in a predetermined storage space.

The transmission unit 14 includes a predetermined communication module that can be connected to the design server 30 or the web server 40 via the network 20, so that the mobile device 10 and the design server 30 or the design evaluation 30 can be connected. Data transmission and reception between the web server 40 is performed.

The transmission unit 14 may include a mobile communication modem module using a mobile communication network, a short range wireless communication network module using a separate communication network, or a long distance wireless communication network module, and may connect to the design server 30 and perform packet communication.

The transmission unit 14, in real time upon acquisition of measurement data, according to a user's instruction, or according to a set condition, the absolute coordinates of the product, the object and the spatial measurement work position in the measurement performance data stored in the storage unit 13. Data including a value or a measurement date and time as a tag may be transmitted to the design server 30 via the network 20.

The augmented reality generating unit 15 is an image of the real world of the user acquired by the camera module 121 in the sensor unit 12, a three-dimensional model generated by the three-dimensional modeling unit 11, and the simulation unit 16 An augmented reality image may be generated by synthesizing at least one virtual layer for performing at least one detailed function for provided design evaluation.

The simulation unit 16 selects and sets the model to be displayed by the user, changes and manipulates the displayed model, evaluates the simulated model, calculates quantities and costs, and performs such a function. At least one virtual layer capable of interacting with a user may be generated and provided to the augmented reality generator 15.

The virtual layer may be designed to select an object displayed in the augmented reality image and perform a specific function by using a user interface of the design mobile device 10.

The simulation unit 16 selects or sets the model according to the instruction input by the user through the virtual layer, changes and manipulates the position or property of the model, manages the design preference result of the simulated model, and realizes the displayed model. We can calculate quantity and cost corresponding to.

The simulation unit 16 allows the user to quickly and easily set and change design elements such as shapes, materials, shapes, patterns, paint materials, cross sections, plane and profile alignments, and member placement in an image of a real environment. have.

The simulation unit 16 may replace colors, patterns, or place structures and members within the closed and segmented regions of the three-dimensional model that has been set and changed, and calculate the approximate length, area, and volume from such arrangements. The cost can be calculated in consideration of the cost.

The simulation unit 16 may store design data extracted from the outline, shape, color, texture, and material of the existing structure in the storage unit 13 or transmit it to the design server 30 by image analysis or a user input. In addition, a design data including a change of a three-dimensional facility model to be newly arranged and a set shape, color, texture, and material may be stored in the storage unit 13 or transmitted to the design server 30.

The simulation unit 16 may reconstruct and arrange the 3D structure in augmented reality in real time by connecting a plurality of modeling data with respect to a desired target structure.

For example, the components of a bridge facility may include shapes, colors, textures, paints or patterns that are visual elements of the bridge itself, and the viewpoint location elements include the height of the viewpoint, the angle of the line of sight, the distance to the bridge, the openness, There are elapsed elements such as heights and lengths of attachments such as railings, columns, lighting, signs, bridges, soundproof walls, etc., and these visual and landscape elements can be displayed by overlaying them on the real facilities through virtual layers of augmented reality. have.

In this case, the user interface is preferably a touch interface using an augmented reality image, and may further include a stylus, a keyboard, an optical mouse, and the like.

The controller 17 may control and manage overall operations of the sensor unit 12, the storage unit 13, the transmission unit 14, and the user interface.

According to an embodiment, each of the sensor unit 12, the storage unit 13, and the transmission unit 14 may use the functions embedded in the smart phone or PDA device that is the basis of the mobile device 10 for design evaluation. It may also be implemented as a professional external device that can be mounted on such a smart phone or PDA.

2 is a flowchart illustrating a method for creating, arranging, modifying and evaluating a 3D model based on augmented reality in a mobile device for design evaluation according to an embodiment of the present invention.

Referring to FIG. 2, in step S21, a new three-dimensional model is manufactured through the mobile device 10 for design evaluation in the field. You can set up a three-dimensional model by entering the type of structure, facility or product, and entering attributes and dimensions. It is possible to set a property that distinguishes a shape, for example, whether it is an integrated type or a detachable type, what a member is, what the cross section is, and how the size and color are.

In step S22, the kind of facility, the member name, the location and the like resources, dimensions, and the position on the three-dimensional space are registered and stored in relation to the three-dimensional model. The registered and stored information can be reused later.

In step S23, the registered and stored information and the 3D model are transmitted from the mobile device 10 to the design server 30.

In step S24, as a linear plan for placing the three-dimensional model in the facility, the baseline of the plane, longitudinal, cross section is input in augmented reality and a three-dimensional complex linearity is generated.

In step S25, the three-dimensional model of the member or part may be arranged based on the reference line. You can set the position and angle of the member first, and then enter the type, color, and material. You can also enter a section.

In operation S26, a specific region and a section are selected from the extracted image to replace, deform, change, or modify the 3D model by region, section, or member.

In step S27, the rough cost may be calculated in consideration of the area, volume, number, quantity of the disposed members or parts, and the characteristics or unit cost of the members or parts.

The three-dimensional model design evaluation method of the present invention can be used for the remodeling design selection of buildings, civil engineering facilities, such as buildings.

Major landscape elements include natural landscapes (green landscape: mountainous and rural areas), water change buildings (rivers, lakes, coastal areas), artificial landscapes (historical and cultural landscapes: historic sites, traditional settlements, cultural areas), living landscapes (residential areas, Amusement areas) can be considered. The elements of landscape can be divided into main elements, sub-structures or subsidiary facilities, surrounding facilities, natural elements and artificial elements. At this time, the separation or combination of the landscape elements can be selected and set automatically or manually.

As an internal scenery, there are landscapes such as bridges, retaining walls, signs, tunnels, and attachments as road facilities, and as external scenery, bridges, roads, mountains, slopes, etc. There is a view to see.

In the far element, there are landmark elements such as landmarks, local landscapes, long bridges, tunnels, steel towers, and artificial elements of large structures.

As a representative example, in the case of bridge remodeling, it is possible to perform remodeling to repair and reinforce by dividing into three types of landscape-specific type, landscape maintenance type, and landscape improvement type, and it is possible to proceed with the bridge design considering the landscape element (aesthetic parameter). have.

Representative design alternatives for the remodeling modules of bridge facilities are as follows.

1. Change color and painting

2. Glyphs and Finishes

3. Adding and changing railing type

4. Upper beam replacement and change, position movement, lower member replacement and change, position movement

5. Application or replacement of PSC bridges, arch bridges, ramen bridges, cable-stayed bridges, suspension bridges, and composite bridges for longevity.

According to an embodiment, the bridge design remodeling may be performed in the following order.

First, survey the site information, structure type, type, height, span number, bridge length, bridge slab height, cross-sectional dimension, and secondly, collect on-site images and photos from the field image using the equipment or portable terminal. , Restore to dimensions and drawings. Thirdly, the scope of the remodeling is selected. The establishment, the partial replacement, the total replacement, the color change, the painting and the pattern change are examined.

The selection of detailed work methods allows you to change or add color, paint, glyphs, finishes, and handrail types. Other alternative implementations include replacing the upper and lower parts or members.

In another example, a specialized replacement method for totally renovating or remodeling a facility may be replaced with a bridge of another type of structure, such as an arch bridge, a ramen bridge, an extra doze bridge, or a replacement to another facility.

The next procedure is to set up the member, allowing top, bottom, integral cross-sectional setup, dimension inputs to determine the size, plan layout, longitudinal placement, and correct placement on the cross section. Next, the landscape important concept is set. The landscape after remodeling of the facility can be reviewed by setting it as a landscape specialized type, landscape maintenance type, or landscape improvement type.

Virtual model placement can superimpose a virtual model of augmented reality on a real picture or image, and share, transmit and distribute the image and data. These images and three-dimensional virtual models can be evaluated later in conjunction with the Internet and other applications to simulate landscapes such as flight, driving, walking and turning, rotating, and section views.

By conducting the design review of the facility at the beginning of the planning and design process even before the construction of the facility, it is possible to reduce frequent planning changes and construction costs, and to significantly shorten the period for reviewing design proposals and design alternatives, and increase work efficiency. Contributions and prompt reviews are economically effective in reducing processing time and costs.

The present invention can be applied not only to the remodeling of large facilities, but also to the interior or product design.

For example, the present invention projects a high-quality three-dimensional model in which a user can quickly and easily set and change design elements such as color, material, and shape, and the operation of the model is generated by user interaction with a natural real image. It can be configured to drive real-time augmented reality-based design evaluation and landscape review, color and pattern preference design elements in real time.

In addition, the user can freely change the dimensions, appearance, color, pattern, shape, and cross-section of the three-dimensional structure model. It is possible to immediately examine the color of the facility, parts, equipment, furniture, the actual space or environment of the facility, the harmony of the pattern, the suitability of the size, dimensions, size, and the rationality of the facility layout without the arrangement of the actual facility, furniture, or equipment.

By conducting design verification at the beginning of the design process, which is the stage before the product launch, such as interiors, it is possible to reduce development and manufacturing costs and to significantly shorten the selection period of product models. Objective reviews of landscape review, color, and pattern preferences can provide specific product design guidelines needed to improve the level of emotion.

3 is a flowchart illustrating a case of designing a road facility in a method for evaluating a 3D model design based on augmented reality using a mobile device for design evaluation according to an embodiment of the present invention.

Referring to FIG. 3, the overall progression step is largely divided into input data creation steps S34 to S36 and influence and evaluation steps S37 to S39 to predict design evaluation.

First, in step S31 of selecting a route section and setting an investigation area and area based on the route, the cut soil section, the bridge, and the tunnel section are extracted mainly using the floor plan as the route data. .

At the point of time and resource extraction step (S33), the location of the viewpoint, hill, road, parking lot, village, temple, outdoor activity facility, and general road is selected as the viewpoint. Resource outflows are typically landscape resources such as mountains, plateaus, plains, wetlands, lakes, canyons, waterfalls, rivers, coasts, capes, islands, islands, rocks, caves, plants, and natural phenomena.

The next step is to create the data data of the evaluation target (S34), and the terrain, the route section, the viewpoint, and the resources of the surveyed region are created as mesh data.

The situation prediction step (S35) of the resource section calculates the firing distance, elevation angle, relief angle, and line of sight angle from the viewpoint of the visual display means to the route section by predicting the projection process by calculating the visual impact evaluation index value.

Thereafter, a step (S36) of generating a 3D model using the mobile device and system for design evaluation of the present invention is performed, and at the same time, after setting the evaluation index (S37), the 3D model and the virtual function layer are performed. The review step S38 through augmented reality, which superimposes the image on the image of the real world, is performed.

Lastly, in the comprehensive evaluation step (S39), the priority of the landscape is determined by evaluating the user survey method on the landscape influence of the visible section, the importance factor, the relationship between the landscape resources, and the harmony with the background. Go through the steps.

4 is a flowchart illustrating a case of designing a bridge in a 3D model design evaluation method based on augmented reality using a mobile device for design evaluation according to an embodiment of the present invention.

Referring to FIG. 4, first, a target route selecting step (S41) is a step of selecting a target route belonging to a bridge. Here, the macroscopic examination is performed on the entire target line including the bridge.

Next, in the target facility selection step (S42) and the section division step (S43), the specific target facility is selected, and the area is set for each part or member of the bridge through augmented reality provided by the three-dimensional design evaluation system of the present invention. An interval division process may be performed.

Subsequently, step S44 is a step of determining the type and pattern of the design elements such as color, shape, etc. of the bridge for harmony with the surrounding landscape.

The subsequent step (S45) is to select a design method when constructing a bridge, and the design plan is determined through one of three lines: model synthesis (S46), photo synthesis (S47), and composite photography (S48). .

The model synthesis method (S46) assumes that there is an existing similar augmented model, and refers to determining a design through a process of recycling the model and overlaying it on the screen of augmented reality.

Photo synthesis (S47) is a method of deciding the design by synthesizing a locally taken photo and a bridge model photo.

The composite photographing method (S48) refers to a process of determining a design by synthesizing a locally photographed photograph and an enhanced bridge model.

5 is a flowchart illustrating a case of designing a landscape plan in an augmented reality-based 3D model design evaluation method using a mobile device for design evaluation according to an embodiment of the present invention.

Referring to FIG. 5, a method of acquiring images and measurement data and performing a landscape review to review a design is illustrated.

First, the basic survey processing step (S51) of the landscape landscape is a step of extracting the area image, landscape image, landscape of landscape by using the topographic map, urban plan, land use, cross-section map for landscape basic survey.

Subsequently, in the landscape element input step (S52) of the route planning, the city planning diagram and the traffic network diagram are input to examine the avoidance and uniformity of the streets which are easily affected.

In the step S53 of inputting the landscape element into the reference plan line of the linear and vertical lines, the construction of the horizontal cross section based on the planar longitudinal linearity is examined.

In the step of determining the transverse landscape and the transverse image processing step S54, the evaluation target is selected in the transverse landscape.

Subsequently, as the structure landscape design processing step S55 using the three-dimensional design evaluation system of the present invention, a step of creating an augmented model to visualize the design is performed.

Landscape improvement plan model generation processing step (S56) refers to the user modified to modify the generated augmented model.

In the superimposition and simulation step (S57) with the natural video, a simulation is performed by superimposing the augmented model on a previously photographed image or an image screen of the surrounding nature which is actually being photographed in real time.

6 is a flowchart illustrating a 3D model restoration method through 3D spatial recognition and image processing of a facility to display a 3D model based on augmented reality in a mobile device for design evaluation according to an embodiment of the present invention.

Referring to FIG. 6, a method of restoring a design of an object model by drawing restoration through spatial recognition and image processing of a facility is illustrated.

For example, the 3D space recognition may measure the amount of energy reflected or transmitted from an object to measure 3D coordinates in a state in which the measurement sensor is in contact with the object to be restored. Alternatively, use a time measurement method of projecting structured light or laser light onto an object to measure the time when the ultrasound or laser projected on the object is reflected back, or directly from the input image using the contrast and color difference of the image. You may.

Looking at the method of obtaining from the input image in more detail, the feature point of the subject is extracted from the plurality of images taken by the camera module 121 of the mobile device for design evaluation 10, the position measuring module 124 and the posture sensor Using 122, the space in the image may be three-dimensionally modeled by performing image registration on the extracted feature points while considering the photographing position, the photographing angle, and the direction.

In this case, in order to increase the matching rate, the corners and the feature points extracted using the corner extraction algorithm may be used together.

A three-dimensional model of a geometric space around a subject may be generated based on the photographing angle of the camera and the relative position of the feature points in each image.

Meanwhile, the coordinates of the photographing position may be inferred based on the position, distance, angle, etc. of the surrounding subjects without using the position measuring module 124.

As a detailed work step, in step S61, an image is acquired from a camera sensor of the terminal, the coordinates of the photographing position are inferred, and the feature points are extracted from the photographed image by a contact or non-contact extraction method (S62). Perform image registration on the basis (S63) to three-dimensional modeling of the subject and the surrounding space (S64), output the generated three-dimensional model on the augmented reality screen (S65), convert the image processing data, save and then transmit ( S66).

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited to the above-described embodiments, which can be variously modified and modified by those skilled in the art. Modifications are possible. Accordingly, the spirit of the present invention should be understood only in accordance with the following claims, and all of the equivalent or equivalent variations will fall within the scope of the present invention.

1 design evaluation system
10 Mobile devices for design evaluation
20 networks
30 design servers
40 web servers

Claims (4)

Acquire a real image, obtain a three-dimensional model of the evaluation target facility based on the image of the facility to be evaluated, the vertical angle, horizontal angle, azimuth and coordinate values of the measurement location, and is generated to obtain a three-dimensional model of the evaluation target facility A mobile device for design evaluation for generating an augmented reality image by overlapping a virtual augmented image layer with a reality image; And
Design evaluation system including a design server for storing the three-dimensional model data and image data exchanged with the mobile device for design evaluation. The mobile device of claim 1, wherein the mobile device for design evaluation
A three-dimensional modeling unit obtaining a three-dimensional model of the facility to be evaluated;
A sensor unit configured to obtain an image, a vertical angle, a horizontal angle, an azimuth angle, and a position coordinate value of a facility to be evaluated based on a collimation reference line;
A storage unit for structuring and storing measurement data necessary for design evaluation and additional data generated by the design evaluation;
An augmented reality generator configured to generate an augmented reality image by synthesizing at least one virtual layer for performing at least one detailed function for a reality image, a 3D model, and a design evaluation; And
For design evaluation, select and set the three-dimensional model to be displayed, change and manipulate the three-dimensional model, evaluate the changed and manipulated three-dimensional model, perform detailed functions of calculating quantities and costs, and the details. And a simulation unit generating at least one virtual layer interacting with a user to perform functions and providing the at least one virtual layer to the augmented reality generator. The method of claim 2, wherein the simulation unit
Overlaid on the reality image, the user can set and change the design elements of shapes, materials, shapes, glyphs, paint materials, sections, plane and profile alignments, and part placement,
Replace colors, glyphs, or place structures and members within closed and segmented areas of the set-up and altered three-dimensional model,
Calculate the length, area, and volume from the replacement or placement,
To store the design data, including the outline, shape, color, texture, and material of the existing facility, or the design data including the changed shape and color, texture, and material set in the 3D model and stored in the storage unit or transmitted to the design server. Design evaluation system, characterized in that the operation. Acquire a real image, obtain a three-dimensional model of the evaluation target facility based on the image of the facility to be evaluated, the vertical angle, horizontal angle, azimuth and coordinate values of the measurement location, and is generated to obtain a three-dimensional model of the evaluation target facility An augmented reality-based design evaluation method using a mobile device for design evaluation that generates an augmented reality image by overlapping a virtual augmented image layer with a reality image,
Manufacturing a new three-dimensional model through the design evaluation mobile device in the field;
Registering and storing resources, dimensions, and locations in three-dimensional space of the facility to be evaluated in relation to the three-dimensional model;
Inputting reference lines of planes, profiles, cross-sections in augmented reality and generating a three-dimensional complex linearity to superimpose the three-dimensional model on the facility to be evaluated;
Placing a three-dimensional model, including the location, angle, type, color, or material of the member or part, relative to a baseline;
Manipulating a 3D model by region, section or member by selecting a specific region and section in the augmented reality image; And
And calculating a rough cost in consideration of the area, volume, number, quantity and quantity of the disposed members or parts, and the characteristics and cost of the members or parts.

Images