KR102608502B1 - Method for Providing Mock-up Image Based on Augumented Reality and Service Providing Server Used Therefor - Google Patents

Abstract

An augmented reality-based mock-up image providing method and a service providing server used therefor are disclosed. The present invention provides a service providing server that receives product category selection information from a user terminal, receives product design image information from the user terminal, and It is implemented through the process of generating augmented reality-based 3D modeling data based on category selection information and product design image information. According to the present invention, it is possible to provide an AR mock-up implemented through augmented reality-based 3D modeling data, thereby greatly increasing the efficiency of mock-up production and the efficiency of requesting modifications to the produced mock-up and the resulting modification production process. There will be.

Description

Method for Providing Mock-up Image Based on Augmented Reality and Service Providing Server Used Therefor}

The present invention relates to a method of providing an augmented reality-based mock-up image and a service providing server used therefor. More specifically, it is possible to provide an AR mock-up implemented through augmented reality-based 3D modeling data, thereby improving the efficiency of mock-up production and The present invention relates to a method for providing an augmented reality-based mock-up image that can significantly increase the efficiency in requesting modifications to a produced mock-up and the resulting modification production process, and a service providing server used therein.

When developing a new product, a full-size mock-up is usually produced in the same form as the product design drawing to review the product's design, shape, function, and productivity in advance.

This is to check design errors, which are problems not visible on the design drawings, through the produced mock-up before manufacturing the mold.

CNC machining or 3D printers are mainly used to produce such physical mock-ups, which not only takes a considerable amount of time to manufacture and deliver, but also requires modifications to the produced mock-ups, and the process of requesting modifications and producing modifications accordingly is very inefficient. there is a problem.

Therefore, the purpose of the present invention is to provide an AR mock-up implemented through augmented reality-based 3D modeling data, thereby greatly increasing the efficiency of mock-up production and the efficiency of requesting modifications to the produced mock-up and the resulting modification production process. The aim is to provide a method of providing an augmented reality-based mock-up image that can be augmented and a service providing server used therefor.

The problem to be solved by the present invention is not limited to the problems mentioned, and includes other technical problems that can be clearly understood by those skilled in the art from the following description.

An augmented reality-based mock-up image providing method according to the present invention for achieving the above object includes the steps of: (a) a service providing server receiving product category selection information from a user terminal; (b) receiving, by the service providing server, product design image information from the user terminal; and (c) the service providing server generating augmented reality-based 3D modeling data based on the product category selection information and the product design image information.

Preferably, it further includes the step of (d) the service providing server transmitting the 3D modeling data to the user terminal.

In addition, (e) the service providing server further includes the step of receiving a request for modification of the 3D modeling data from the user terminal.

Meanwhile, the service providing server according to the present invention includes a receiving unit that receives product category selection information from a user terminal and product design image information from the user terminal; and a calculation unit that generates augmented reality-based 3D modeling data based on the product category selection information and the product design image information.

Preferably, it further includes a transmitter that transmits the 3D modeling data to the user terminal.

Additionally, the receiving unit is characterized in that it receives a request for modification of the 3D modeling data from the user terminal.

According to the present invention, it is possible to provide an AR mock-up implemented through augmented reality-based 3D modeling data, thereby greatly increasing the efficiency of mock-up production and the efficiency of requesting modifications to the produced mock-up and the resulting modification production process. There will be.

The effects of the present invention are not limited to the effects mentioned, and include other effects that can be clearly understood by those skilled in the art from the following description.

1 is a configuration diagram of an augmented reality-based mock-up image providing system according to an embodiment of the present invention;
Figure 2 is a functional block diagram showing the structure of a service providing server executing an augmented reality-based mock-up image providing method according to an embodiment of the present invention, and
Figure 3 is a signal flow diagram illustrating the execution process of an augmented reality-based mock-up image providing method according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings. It should be noted that like elements in the drawings are represented by like symbols wherever possible. Additionally, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the gist of the present invention are omitted.

Figure 1 is a configuration diagram of an augmented reality-based mock-up image providing system according to an embodiment of the present invention. Referring to FIG. 1, an augmented reality-based mock-up image providing system according to an embodiment of the present invention includes a user terminal 100 and a service providing server 200.

The user terminal 100 is a communication terminal such as a smart phone or a PC owned by a user who uses the augmented reality-based mock-up image providing service according to the present invention. The user terminal 100 includes the necessary devices to use the service according to the present invention. A predetermined application program may be installed.

The service providing server 200 is a server installed and operated by a business operator that provides an augmented reality-based mock-up image providing service according to the present invention. The service providing server 200 receives product category selection information and product information from the user terminal 100. Design image information is received, and augmented reality-based 3D modeling data is generated based on product category selection information and product design image information.

Figure 2 is a functional block diagram showing the structure of a service providing server 200 that executes an augmented reality-based mock-up image providing method according to an embodiment of the present invention. Referring to Figure 2, the service providing server 200 executing the augmented reality-based mock-up image providing method according to an embodiment of the present invention includes a receiving unit 210, a storage unit 230, an operation unit 250, and a transmitting unit ( 270).

The receiving unit 210 receives a request for modification of product category selection information, product design image information, and 3D modeling data from the user terminal 100.

The operation unit 250 generates augmented reality-based product 3D modeling data based on the product category selection information and product design image information received from the user terminal 100, and processes corrections to the 3D modeling data according to the user's correction request. Run .

The transmitter 270 transmits augmented reality-based product 3D modeling data or modified 3D modeling data to the user terminal 100.

Meanwhile, various reception information from the receiving unit 210, various creation and modification information from the calculating unit 250, and various transmission information from the transmitting unit 270 are accumulated and stored in the storage unit 230 of the service providing server 200. .

Figure 3 is a signal flow diagram illustrating the execution process of an augmented reality-based mock-up image providing method according to an embodiment of the present invention. Hereinafter, with reference to FIGS. 1 to 3, the execution process of the augmented reality-based mock-up image providing method according to an embodiment of the present invention will be described.

First, a user who does not create a physical mock-up or wants to create an AR mock-up, which is an augmented reality-based digital mock-up, prior to producing a physical mock-up, runs the application installed on the user terminal 100 and then runs the target product. Enter selection information for categories (e.g., clothing, packaging containers, stationery, cafe supplies, etc.) through the application program.

Accordingly, the receiving unit 210 of the service providing server 200 receives product category selection information from the user terminal 100 (S410).

Meanwhile, as the user selects and inputs the design image file of the product for AR mock-up production through the user terminal 100, the service providing server 200 sends a request for AR mock-up creation including the design image file entered by the user to the user. It is received from the terminal 100 (S420).

Accordingly, the calculation unit 250 of the service providing server 200 converts 3D modeling data into an augmented reality-based digital mock-up based on the product design image information received from the user terminal 100 and the product category selection information in the above-described step S410. It can be created as an AR mock-up (S430).

Specifically, when generating 3D modeling data of the product based on the product design image, the calculation unit 250 of the service providing server 200 determines the scale of the product design image included in the AR mockup creation request in step S420 described above. By calculating the actual size information of the product based on the information and generating 3D modeling data of the same size as the calculated size information, the realism of the AR mock-up provided through the augmented reality-based mock-up provision service according to the present invention is maximized. You can do it.

In addition, in implementing the present invention, the service providing server 200 stores the AR mock-up generated as above in association with the product category selected in the above-described step S410, and includes the AR mock-up creation request in the above-described step S420. You will be able to save it in association with the product design file.

In addition, when performing the above-described step S430, the calculation unit 250 of the service providing server 200 stores the product design stored in association with the already generated 3D modeling data stored in association with the product category selected in step S410 described above. Based on the information and the product design information included in the AR mockup creation request in the above-described step S430, the mutual similarity between the two designs is calculated, and the device stored in association with the design with the highest design similarity to the product design in step S430 is stored. You will also be able to search the generated 3D modeling data.

The calculation unit 250 of the service providing server 200 primarily generates the previously generated 3D modeling data retrieved in this way as 3D modeling data for the AR mock-up creation request in step S420 described above, and primarily generates the 3D modeling data 3D modeling data for the AR mock-up creation request in the above-mentioned step S420 by editing the initially generated 3D modeling data to reflect design elements that have differences (e.g., size, shape, color, etc.) in both designs. By finally generating , the computational load of the service providing server 200 in generating 3D modeling data may be minimized.

In addition, in implementing the present invention, the service providing server 200 transmits the primarily generated 3D modeling data to the user terminal 100, and determines the size, shape, color, etc. in the primarily generated 3D modeling data. After receiving the user's edit request from the user terminal 100, the 3D modeling data for the product may be finally generated by editing the initially generated 3D modeling data according to the user's edit request.

The service providing server 200 transmits the 3D modeling data generated in this way to the user terminal 100, so that the user can receive an AR mockup, which is 3D modeling data based on augmented reality, through the user terminal 100 such as a smart phone. becomes possible (S440).

Meanwhile, the user who has confirmed the AR mock-up implemented against the background of the real space where the user is located inputs the user's request for modification regarding the size, proportion, color, texture, illuminance, etc. of the AR mock-up through the user terminal 100. , the service providing server 200 receives a request for modification of the AR mock-up from the user terminal 100 (S450), and executes modification processing on the previously generated 3D modeling data based on this, thereby generating modified 3D modeling data. You may be able to do it (S460).

Specifically, when the camera module of the user terminal 100 is activated, modification of the AR mock-up image displayed on the display as if it actually exists in the real space displayed on the display of the user terminal 100 through the camera module When making a request, as the user selects a specific part on the AR mock-up image displayed on the touch display of the user terminal 100, correction guide information corresponding to the selected part may be output on the display.

For example, when a border area in a 3D modeling image is selected by touching, correction guide information such as (↔)(↕)(↖)(↙) may be output on the display.

Specifically, when the user touches the left and right border border areas of the 3D modeling image and drags in the left and right directions according to the correction guide information (↔) displayed, the 3D modeling image is horizontal depending on the direction and extent of the drag. direction, and the service providing server 200 may receive a modification request including the expanded or reduced 3D modeling image from the user terminal 100.

In addition, when the user touches the upper and lower border areas of the 3D modeling image and drags in the vertical direction according to the correction guide information (↕) displayed, the 3D modeling image expands vertically depending on the drag direction and degree. Alternatively, it may be reduced, and the service providing server 200 may receive a modification request including the expanded or reduced 3D modeling image from the user terminal 100.

In addition, when the user touches the area where the left and right border border areas and the upper and lower border border areas of the 3D modeling image meet, the drag direction and Depending on the degree, the 3D modeling image is expanded or reduced at the same rate in the horizontal and vertical directions, and the service providing server 200 receives a modification request including the expanded or reduced 3D modeling image from the user terminal 100. You might be able to do it.

In this way, according to the present invention, the user can not only execute a request for modification on the AR mock-up image implemented through the user terminal 100 in a very intuitive way such as touch and drag, but also can execute a request for modification in the AR mock-up image implemented through the user terminal 100 in a very intuitive way such as touch and drag. It is possible to modify the AR mock-up image by referring to the size of various objects (e.g., a desk, etc.) displayed on the display of the user terminal 100 along with the AR mock-up image, allowing for more realistic modification of the AR mock-up image. Work becomes possible.

In addition, in carrying out the present invention, correction guide information (e.g., a plurality of colors selectable in the area) is output when the user touches an area where color or texture is implemented in the 3D modeling image through a touch display. When selecting either type information or a plurality of selectable texture type information), the service providing server 200 provides 3D coordinate information of the location touched by the user in the 3D modeling image and color or texture type information selected by the user. A modification request including a may be received from the user terminal 100 and a modification of the 3D modeling data may be performed based on this.

In addition, when the user touches an area outside the 3D modeling image area (i.e., the area where the real space is output) through a touch display, correction guide information (e.g., information that exists at the user's touch location) is displayed. When selecting any one of the selectable illuminance area information in the assumed lighting), the service providing server 200 includes 3D coordinate information of the location touched by the user in the 3D modeling image and illuminance area information selected by the user. On the surface of the AR mock-up image when a correction request is received from the user terminal 100, and there is a light emitting light of the illuminance area selected by the user at a location corresponding to the 3D coordinate information of the location touched by the user. It may be possible to modify 3D modeling data by executing shading processing.

Meanwhile, the service providing server 200 transmits the modified 3D modeling data to the user terminal 100, so that the user can receive a modified AR mock-up according to the user's modification request (S470).

In addition, in implementing the present invention, the user uses the AR mock-up received from the service providing server 200 in step S440 described above and the AR mock-up additionally received from the service providing server 200 to the user terminal 100. You may also be able to request modifications to each AR mockup while it is displayed together.

Specifically, when an AR mock-up image initially received from the service providing server 200 is output together with the real space displayed on the display through the camera module, an AR mock-up image is additionally received from the service providing server 200. The application program of the user terminal 100 displays an input window for inputting the user's selection information for parallel output of a plurality of AR mock-ups, and when the user selects parallel output, the application program additionally displays the received AR mock-up images. It will be possible to output it on the display along with the already printed AR mock-up image.

Accordingly, the user will be able to compare multiple AR mock-up images simultaneously and request modifications to each AR mock-up image as described above.

In addition, in this case, one of the plurality of AR mock-up images output together on the display is the AR mock-up image first received from the service providing server 200 in the above-described step S440, and the other is the AR mock-up image first received from the service providing server 200 in the above-mentioned step S470. It may be a modified AR mock-up image received from (200), through which the user can compare the two versions (before and after modification) of the AR mock-up image implemented together against the background of the same real space and compare the AR mock-up image as described above. Additional modifications may also be performed individually.

In addition, in carrying out the present invention, if a user wishes to produce a physical mock-up based on 3D modeling data constituting the AR mock-up received from the service providing server 200, the user selects the corresponding 3D modeling data through an application program and then After entering the delivery address information, you can select a mock-up production request item, and the service providing server 200 can receive a physical mock-up production request including selection information of 3D modeling data and delivery address information from the user terminal 100. There will be (S480).

Accordingly, the transmitting unit 270 of the service providing server 200 transmits the 3D modeling data and delivery address information selected by the user to an external server installed at the mock-up manufacturing company, thereby enabling the production and delivery of a physical mock-up based on the 3D modeling data. There will be.

In implementing the present invention, a program that executes the augmented reality-based mock-up image providing method according to the present invention or an application program installed on the user terminal 100 is installed on the service providing server 200 according to the present invention or is used on a computer. It may be recorded on various readable recording media or stored on a server that transmits the program through a network.

In addition, the program according to the present invention may be distributed in a computer system connected to a network, and computer-readable code may be stored and executed in a distributed manner, and functional programs, codes, and code segments for implementing the present invention may be provided. These will be easily understood by those skilled in the art to which the present invention pertains.

Meanwhile, the order between the above-described steps (S410 to S480) in the present invention is only an example and is not limited thereto. That is, the order between the above-described steps (S410 to S480) may change, and some of the steps may be executed simultaneously or deleted.

The terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

In the above, preferred embodiments and application examples of the present invention have been shown and described, but the present invention is not limited to the specific embodiments and application examples described above, and the present invention is not limited to the gist of the present invention as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

100: user terminal, 200: service providing server,
210: receiving unit, 230: storage unit,
250: operation unit, 270: transmission unit.

Claims (4)

(a) the service providing server receiving product category selection information from the user terminal;
(b) receiving, by the service providing server, product design image information from the user terminal; and
(c) the service providing server generating augmented reality-based 3D modeling data based on the product category selection information and the product design image information
Includes,
In step (c),
(c1) The service providing server stores the product design image with the highest similarity to the product design image received from the user terminal among the product design images stored in association with the product category selected in step (a). Searching for 3D modeling data and initially generating the retrieved 3D modeling data as the augmented reality-based 3D modeling data; and
(c2) the service providing server editing the first generated 3D modeling data to reflect design elements that differ between the product design image received from the user terminal and the product design image with the highest degree of similarity.
A method of providing an augmented reality-based mock-up image comprising:
According to paragraph 1,
(d) An augmented reality-based mock-up image providing method further comprising the step of transmitting, by the service providing server, the 3D modeling data to the user terminal.
a receiving unit that receives product category selection information from a user terminal and receives product design image information from the user terminal; and
A calculation unit that generates augmented reality-based 3D modeling data based on the product category selection information and the product design image information.
Includes,
The calculation unit searches 3D modeling data stored in association with the product design image with the highest similarity to the product design image received from the user terminal among product design images stored in association with the product category selected by the user, and retrieves the 3D modeling data stored in association with the product design image stored in association with the product category selected by the user. Modeling data is primarily generated as the augmented reality-based 3D modeling data, and the primary generated design elements are reflected in the product design image received from the user terminal and the product design image with the highest degree of similarity. A service providing server that edits 3D modeling data.
According to paragraph 3,
A service providing server further comprising a transmitter that transmits the 3D modeling data to the user terminal.