KR20220045869A - Marketing video providing system based on augmented reality and operation method thereof - Google Patents

Abstract

A marketing video providing system according to an embodiment of the present application includes: a 3D camera part that collects scan data by capturing a human body object wearing a fashion product as a 3D image; a 3D data generation part for generating 3D modeling data for the human body object based on the scan data; an AR conversion part that converts the 3D modeling data into AR data based on an SNS platform; and a content providing part for correcting the AR data into content data based on the fashion product and providing the AR data to the SNS platform.

Description

Augmented reality-based marketing video providing system and its operation method

The present application relates to an augmented reality-based marketing image providing system and an operating method thereof.

Offline media such as public and terrestrial TV, cable TV, and rooftop electric signboards have been the most representative method of advertising so far. For example.

Recently, an On & Off Line style advertisement method that implements the above-mentioned offline and online together is being developed from various angles.

Accordingly, the present application intends to provide an augmented reality-based marketing image providing system capable of providing an augmented reality-based 3D image that can be shared via SNS, and an operating method thereof.

An object of the present application is to provide a marketing image providing system capable of advertising a fashion product in a new SNS marketing method and an operation method thereof by providing an augmented reality-based content image that can be shared via SNS.

A marketing image providing system according to an embodiment of the present application includes a 3D camera unit that collects scan data by photographing a human body object wearing a fashion product as a 3D image, and 3D modeling data of the human body object based on the scan data Based on the 3D data generation unit that generates the 3D data generation unit, the AR conversion unit that converts the 3D modeling data into AR data based on the SNS platform, and the fashion product, the AR data is corrected into contents data and provided to the SNS platform. includes wealth.

As an operating method of a marketing image providing system according to an embodiment of the present application, the 3D camera unit captures a human body object wearing a fashion product as a 3D image to collect scan data, a 3D data generation unit based on the scan data, generating 3D modeling data for the human body object, converting the 3D modeling data into AR data based on an SNS platform by an AR conversion unit, and converting the AR data into content data by a content providing unit based on the fashion product and correcting it and providing it to the SNS platform.

The marketing image providing system according to an embodiment of the present application provides an augmented reality-based content image that can be shared via SNS, thereby having an effect of advertising a fashion product in a new SNS marketing method.

1 is a block diagram of a marketing image providing system according to an embodiment of the present application.
FIG. 2 is a diagram for explaining a method of photographing a human body object wearing the fashion product of FIG. 1 .
FIG. 3 is a block diagram of the 3D data generator of FIG. 1 .
4A and 4B are diagrams illustrating first modeling characteristic information of FIG. 3 .
FIG. 5 is a block diagram of the AR converter of FIG. 1 .
FIG. 6 is a diagram illustrating second modeling characteristic information of FIG. 5 .
FIG. 7 is a block diagram of the content providing unit of FIG. 1 .
FIG. 8 is a diagram illustrating third modeling characteristic information of FIG. 7 .
9 is an operation process of the marketing image providing system of FIG. 1 .
FIG. 10 is an operation process for the 3D data generator of FIG. 3 .
11 is an operation process for the AR converter of FIG. 5 .
12 is an operation process for the content providing unit of FIG. 7 .

Hereinafter, embodiments of the present application will be described with reference to specific embodiments and the accompanying drawings. However, the embodiments of the present application may be modified in various other forms, and the scope of the present application is not limited to the embodiments described below. In addition, the embodiments of the present application are provided in order to more completely explain the present invention to those skilled in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clearer description, and elements indicated by the same reference numerals in the drawings are the same elements.

And in order to clearly explain the present application in the drawings, parts irrelevant to the description are omitted, and the thickness is enlarged to clearly express various layers and regions, and components having the same function within the scope of the same idea are referred to as the same. It is explained using symbols. Furthermore, throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

1 is a block diagram of a marketing image providing system 1000 according to an embodiment of the present application, and FIG. 2 is a diagram for explaining a method of photographing a human body object wearing the fashion product 1 of FIG. 1 .

1 and 2 , the marketing image providing system 1000 may include a 3D camera unit 100 , a 3D data generation unit 200 , an AR conversion unit 300 , and a content providing unit 400 . .

First, the 3D camera unit 100 may collect scan data _DS by capturing a human body object wearing the fashion product 1 as a 3D image. Here, the scan data D _S may include 3D human body images of a T-pose shape wearing the fashion product 1 used for marketing.

For example, as shown in FIG. 2 , the 3D camera unit 100 may include a plurality of cameras 101_1 to 101_N positioned around the human body object wearing the fashion product 1 . The plurality of cameras 101_1 to 101_N may collect scan data D _S by capturing a T-pose shape that is a preset motion of a human body object.

Next, the 3D data generator 200 may generate 3D modeling data D _3M of the human body object based on the scan data D _S . Here, the 3D modeling data D _3M may be data in which a human body object in the scan data D _S is rigged and animated.

The 3D data generator 200 according to the embodiment may load the scan data DS into the Cinema 4D program, and output the scan data _DS as the 3D modeling data _{D 3M} through the Cinema 4D program. .

Next, the AR conversion unit 300 may convert the 3D modeling data (D _3M ) into AR data (D _AR ) based on the SNS platform. Here, AR data (D _AR ) is image data including at least one of a dynamic image, sound, text, 2D image, sticker, and video of a human body wearing an augmented reality-based fashion product, and a screen output according to an SNS platform This may be possible. In this case, the SNS platform may mean an image providing platform of each server that provides social network services (SNS) such as Twitter, Facebook, and Instagram.

The AR converter 300 may load the 3D modeling data D _3M into the Blender program and output the 3D modeling data D _3M as AR data D _AR through the Blender program.

The AR conversion unit 300 according to the embodiment may check which direction image information is derived depending on whether the AR data D _AR is abnormal, and may request it from the 3D camera unit 100 .

Next, the content providing unit 400 may correct the AR data _{D AR} to the content data DC based on the fashion product 1 and provide the content data DC to the corresponding SNS _platform . . Here, the content data D _C may be image data in which AR data D _AR , logo information, and product information are synthesized.

The content providing unit 400 may load the AR data D _AR into the Spark AR program, and output the AR data _{D AR} as the content data DC through the Spark AR program.

The content providing unit 400 according to the embodiment may change the file format, resolution, file size, etc. of the AR data D _AR through the AR conversion unit 300 based on the SNS platform change signal.

Marketing image providing system 1000 according to an embodiment of the present application is based on the 3D camera unit 100, the collected scan data ( _DS ), 3D data generation unit 200, AR conversion unit 300 and content By providing an augmented reality-based content image that can be shared via SNS through the providing unit 400 , there is an effect of advertising a fashion product as a new SNS marketing method.

3 is a block diagram of the 3D data generator 200 of FIG. 1 , and FIGS. 4A and 4B are diagrams illustrating the first modeling characteristic information I _F1 of FIG. 3 .

1, 3, 4A, and 4B , the 3D data generator 200 may include a 3D modeling unit 210 and an fbx file extractor 220 .

First, the 3D modeling unit 210 is a first modeling derived as the rigging modeling and animation modeling for the marketing object 211 of the scan data _DS are sequentially applied through the Cinema 4D program. It is possible to obtain the characteristic information (I _F1 ).

Here, the marketing object 211 may mean an image object including a fashion product and a human body in the scan data _DS . In this case, rigging modeling may refer to an operation of applying dynamic motion to each part of a human body object, and animation modeling may refer to an operation of animating a human body object.

For example, as shown in FIGS. 4A and 4B , the first modeling characteristic information I _F1 is character information for the marketing object 211 in the Cinema 4D program, project setting information, polygon object information, and basic characteristics. may contain information.

Next, the fbx file extraction unit 220 uses the Cinema 4D program to convert the 3D modeling data D _3M generated by applying the first modeling feature information I _F1 to the scan data D _S to the fbx file. can be extracted with

FIG. 5 is a block diagram of the AR converter 300 of FIG. 1 , and FIG. 6 is a diagram illustrating the second modeling characteristic information I _F2 of FIG. 5 .

1, 5, and 6 , the AR conversion unit 300 may include an optimization unit 310 and a gltf file extraction unit 320 .

First, the optimization unit 310 obtains the second modeling characteristic information ( _IF2 ) derived as the optimization modeling for the fbx file extracted through the fbx file extraction unit 220 is applied through the Blender program. can

Here, optimizing modeling may mean an operation that enables output to the SNS platform.

For example, as shown in FIG. 6 , the second modeling characteristic information I _F2 is transform information, relation information, collection information, instancing information, and motion path information for the marketing object 211 in the Blender program. , visibility information, viewport display information, and custom characteristic information.

Next, the gltf file extraction unit 320 uses the Blender program to convert the AR data (D _AR ) generated by applying the second modeling feature information (IF2 ) to the 3D modeling data (D _3M ) into a _gltf file. can be extracted.

7 is a block diagram of the content providing unit 400 of FIG. 1 , and FIG. 8 is a diagram illustrating third modeling characteristic information I _F3 of FIG. 7 .

1, 7 and 8 , the content providing unit 400 may include a detecting unit 410 , a correcting unit 420 , and a content outputting unit 430 .

First, the detection unit 410 may detect the 3D animation object 411 from the gltf file extracted through the gltf file extraction unit 320 using the Spark AR program. Here, the 3D animation object 411 may be an image in which the human body object on which the fashion product 1 is worn is animated in 3D.

Next, the compensator 420 performs third modeling characteristic information ( _IF3 ) derived as sticker & filter modeling for the 3D animation object detected through the detection unit 410 is applied through the Spark AR program. ) can be obtained.

Here, the sticker and filter modeling is a work of synthesizing a logo image on the 3D animation object 411, a texturing operation of the 3D animation object 411, and a world-off of fixing the 3D animation object 411 to the floor. It can refer to a series of correction operations that perform World Object Effect operations.

For example, as shown in FIG. 8 , the third modeling characteristic information I _F3 is patch edit information for the 3D animation object 411 in the Spark AR program, shadow characteristic information, surface parameter information, and tilting option information. , render option information, advanced render option information, and user information may be included.

Next, the content output unit 430 outputs the content data (DC ) generated by applying the third modeling feature information ( _IF3 ) to the AR data ( _{D AR} ) through the Spark AR program, and to the SNS platform. It can be provided to the corresponding server 2000 .

According to an embodiment, the content output unit 430 is a 3D animation object 411 converted through the AR conversion unit 300 based on the user gltf file provided from the user terminal 10, extracted from the user gltf file. The user object may be synthesized and provided to the user terminal 10 .

9 is an operation process of the marketing image providing system 1000 of FIG. 1 .

Referring to FIGS. 1 and 9 , first, in step S110 , the 3D camera unit 100 captures a human body object wearing the fashion product 1 as a 3D image to collect scan data _DS .

Then, in step S120 , the 3D data generator 200 may generate 3D modeling data D _3M of the human body object based on the scan data D _S .

In this case, in step S130 , the AR converter 300 may convert the 3D modeling data D _3M for the human body object into AR data D _AR based on the SNS platform.

Then, in step S140 , the content providing unit 400 corrects the AR data ( _{D AR} ) with the content data (DC ) based on the fashion product (1), and the content data ( _DC ) corresponds to the corresponding SNS platform. It can be provided by a server that

FIG. 10 is an operation process for the 3D data generating unit 200 of FIG. 3 .

Referring to FIGS. 3, 9 and 10 , in step S210 , the 3D modeling unit 210 performs rigging modeling and animation modeling for the marketing object 211 of the scan data _DS . The first modeling characteristic information I _F1 derived as it is sequentially applied through the Cinema 4D program may be acquired.

Then, in step S220 , the fbx file extractor 220 uses the Cinema 4D program to apply the first modeling characteristic information I _F1 to the scan data DS 3D modeling data _{D 3M} ) can be extracted as an fbx file.

11 is an operation process for the AR conversion unit 300 of FIG. 5 .

5, 9 and 11, first, in step S310, the optimization unit 310 optimizes modeling for the fbx file extracted through the fbx file extraction unit 220 is applied through the Blender program. The second modeling characteristic information ( _IF2 ) derived according to can be obtained.

Then, in step S320, the gltf file extraction unit 320 uses the Blender program to apply the second modeling feature information I _F2 to the 3D modeling data D _3M AR data (D _AR ) It can be extracted as a gltf file.

FIG. 12 is an operation process for the content providing unit 400 of FIG. 7 .

7, 9 and 12, first, in step S410, the detection unit 410 uses the Spark AR program, and the 3D animation object 411 from the gltf file extracted through the gltf file extraction unit 320. can be detected.

Then, in step S420, the compensator 420 is the third derived as sticker & filter modeling for the 3D animation object 411 detected through the detection unit 410 is applied through the Spark AR program. 3 It is possible to obtain the modeling characteristic information ( _IF3 ).

Then, in step S430, the content output unit 430 transmits the content data (DC) generated by applying the third modeling characteristic information ( _IF3 ) to the AR data ( _{D AR} ) through the Spark AR program through the network. It may be provided to the server 2000 corresponding to the SNS platform.

Although the present application has been described with reference to one embodiment shown in the drawings, this is merely exemplary, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present application should be determined by the technical spirit of the appended claims.

100: 3D camera unit
200: 3D data generation unit
300: AR conversion unit
400: content provider
1000: marketing video providing system

Claims (16)

a 3D camera unit that collects scan data by capturing a human body object wearing a fashion product as a 3D image;
a 3D data generator configured to generate 3D modeling data for the human body object based on the scan data;
an AR conversion unit that converts the 3D modeling data into AR data based on an SNS platform; and
A system for providing a marketing video, comprising a content providing unit that corrects the AR data into content data based on the fashion product and provides it to the SNS platform. According to claim 1,
The 3D data generating unit includes: a 3D modeling unit for obtaining first modeling characteristic information derived as rigging modeling and animation modeling are applied to the marketing object of the scan data; and
and an fbx file extraction unit for extracting the 3D modeling data generated by applying the first modeling feature information to the scan data as an fbx file. 3. The method of claim 2,
The AR conversion unit may include: an optimization unit configured to obtain second modeling characteristic information derived as optimization modeling for the fbx file is applied; and
and a gltf file extraction unit for extracting the AR data generated by applying the second modeling characteristic information to the 3D modeling data as a gltf file. 4. The method of claim 3,
The content providing unit may include: a detecting unit detecting a 3D animation object from the gltf file;
a correction unit for obtaining third modeling characteristic information derived as sticker and filter modeling is applied to the 3D animation object; and
and a content output unit for outputting the content data generated by applying the third modeling characteristic information to the AR data and providing the content data to a server corresponding to the SNS platform. According to claim 1,
The scan data includes 3D human body images of a T-pose shape taken by the human body object in order to use the fashion product for marketing. 3. The method of claim 2,
The marketing object means an image object including a fashion product and a human body in the scan data ( _DS ), a marketing image providing system. According to claim 1,
The 3D data generating unit uses a Cinema 4D program, a marketing image providing system. According to claim 1,
The AR conversion unit uses the Blender program, a marketing image providing system. According to claim 1,
The content providing unit uses a Spark AR program, a marketing image providing system. According to claim 1,
The content data is image data in which the AR data, logo information, and product information are synthesized, a marketing image providing system. 5. The method of claim 4,
The content output unit adjusts at least two or more output sizes so that the content data is individually arranged in the front and rear with respect to the output screen, and additionally provides at least two or more content data for the content data. 5. The method of claim 4,
The content output unit, based on the face image corresponding to the 3D animation object provided from the user terminal, provides customer content data in which the face image is synthesized with the content data to the user terminal, a marketing image providing system. As a method of operating a marketing image providing system,
Collecting scan data by a 3D camera unit photographing a human body object wearing a fashion product as a 3D image;
generating, by a 3D data generator, 3D modeling data of the human body object based on the scan data;
converting the 3D modeling data into AR data based on an SNS platform by an AR conversion unit; and
A method of operating a marketing video providing system, comprising the step of a content providing unit correcting the AR data into content data based on the fashion product and providing the AR data to the SNS platform. 14. The method of claim 13,
The generating of the 3D modeling data may include: acquiring first modeling characteristic information derived as rigging modeling and animation modeling are applied to the human body object; and
and extracting the 3D modeling data generated by applying the first modeling feature information to the scan data as an fbx file. 15. The method of claim 14,
The converting into the AR data may include: acquiring second modeling feature information derived as optimization modeling for the fbx file is applied; and
and extracting the AR data generated by applying the second modeling characteristic information to the 3D modeling data as a gltf file. 16. The method of claim 15,
The step of providing to the SNS platform includes: detecting a 3D animation object from the gltf file;
obtaining third modeling characteristic information derived as sticker and filter modeling is applied to the 3D animation object;
outputting the content data generated by applying the third modeling feature information to the AR data; and
A method of operating a marketing video providing system comprising the step of providing the content data to a server corresponding to the SNS platform.

Images