KR20210045652A - An apparatus for providing virtual fashion experience contents service - Google Patents

Abstract

According to an embodiment of the present invention, a device for providing a service comprises: a virtual fashion item production service unit providing a virtual fashion item creation tool to change a color, shape, material, and parameter for a basic virtual fashion item created by a brand and a designer; and a virtual fashion item wearing service unit receiving an image of a user for virtual fashion experience, and providing a virtual fashion experience service by wearing the selected virtual fashion item on an image of the user.

Description

An apparatus for providing virtual fashion experience contents service

The present invention relates to a service providing apparatus and a method thereof. More specifically, the present invention relates to a service providing apparatus for providing a virtual fashion experience content service.

As web and SNS-based e-commerce using the Internet become more active, fashion brands' brand marketing methods are also diversifying.

In particular, with the advancement of mobile technology and the advent of the digital native generation, it is common to watch content through mobile, and the speed of sharing and dissemination through SNS is rapidly becoming incomparable with the existing offline market. .

Accordingly, SNS itself is forming a market, and companies using it to conduct fashion brand marketing are also increasing. In recent years, the method of requesting brand promotion through influential SNS accounts such as influencers has been dominated.

However, unlike past fashion magazines, which synthesized very detailed and diverse fashion information and photos as a book, it is not easy to provide a personalized brand experience through a mobile terminal interface whose main purpose is to communicate with each other due to the nature of SNS. Actually.

In addition, the brand information shared through the SNS has a lot of close information or incorrect information, and there is an inconvenience that a user can determine the brand he/she wants to purchase only by collecting and searching various pieces of information in order to actually purchase a specific product.

In order to solve this problem, various technologies for providing brand advertisements based on mobile terminals have been proposed. However, in a small area of mobile terminals, there is a problem that it is difficult to directly display real-based fashion advertisements. For this reason, it is difficult to increase brand immersion, and there is a problem in that it is not possible to provide an experience for the brand, such as offline.

In addition, although a traditional method of providing brand information to a user by producing a video advertisement accompanying an application may be used, there is a problem that the production cost of such a fashion brand advertisement is very expensive, and a related expert is necessarily required.

The present invention was conceived to solve the above problems, and provides a virtual space that can induce a realistic brand experience through an optimized virtual reality or augmented reality interface in a mobile terminal, through which virtual fashion items Its purpose is to provide an interactive fashion content service system that can enhance brand immersion and experience by providing based interactive fashion content.

In addition, the present invention provides a template-based production tool service that enables creators to easily and easily produce interactive fashion contents, thereby providing an interactive fashion contents service system capable of reducing the time and cost of contents production. have.

In addition, the present invention provides a market interface corresponding to a virtual fashion item of interactive fashion content, enabling personalized ignition and installation of a product corresponding to a virtual fashion item in a mobile terminal, thereby inducing user convenience and market activation. Its purpose is to provide a virtual fashion experience content service providing device.

A service providing apparatus according to an embodiment of the present invention for solving the above problems,

A virtual fashion item production service unit that provides a virtual fashion item production tool to change colors, shapes, materials, and parameters for basic virtual fashion items created by brands and designers;

A virtual fashion item market operation service unit that displays and sells virtual fashion items produced through the virtual fashion item production service unit, and enables purchase and payment;

A virtual fashion item ignition service unit that receives a user's image for a virtual fashion experience and provides a virtual fashion experience service by igniting the selected virtual fashion item to the user's image; Includes.

The virtual fashion item ignition service unit may include a user model generation unit that receives an original image of a user model and extracts a depth value to derive a depth map to generate a user model;

An item positioning unit for receiving a virtual fashion item image and performing 3D object targeting to position the virtual fashion item on the user model;

A virtual fashion ignition unit configured to ignite a virtual fashion item by tracking a light source with respect to the image of the user model in which the virtual item is positioned and provide a service image; Includes.

According to an embodiment of the present invention, a virtual space that can induce a realistic brand experience through an optimized virtual reality or augmented reality interface in a mobile terminal is provided, and through this, interactive fashion content based on a virtual fashion item is provided. By doing so, it is possible to provide an interactive fashion content service system that can increase brand immersion and experience.

In addition, according to an embodiment of the present invention, by providing a template-based production tool service that enables creators to easily and easily produce interactive fashion content, an interactive fashion content service system capable of reducing the time and cost of content production is provided. Can provide.

In addition, according to an embodiment of the present invention, by providing a market interface corresponding to a virtual fashion item of interactive fashion content, it is possible to personalize and install a product corresponding to a virtual fashion item in a mobile terminal. It is possible to provide an interactive fashion content service system that induces market activation.

1 is a conceptual diagram schematically showing an entire system according to an embodiment of the present invention.
2 is a diagram illustrating a service providing platform according to an embodiment of the present invention.
3 is a flowchart illustrating a service providing method according to an embodiment of the present invention.
4 is a view for explaining in more detail a virtual fashion item management unit according to an embodiment of the present invention.
5 is a diagram illustrating a process of creating a virtual fashion item according to an embodiment of the present invention.
6 is a block diagram illustrating an interface processing unit according to an embodiment of the present invention.
7 is a diagram illustrating a process of processing an ignition interface of a virtual fashion item according to an exemplary embodiment of the present invention.

Hereinafter, the operating principle of a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description.

However, the drawings and the description to be described below are for a preferred implementation method among various methods for effectively describing the features of the present invention, and the present invention is not limited to the following drawings and description.

In addition, in the following description of the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of users or operators. Therefore, the definition should be made based on the overall contents in this name.

In addition, a preferred embodiment of the present invention to be implemented below is already provided in each system function configuration in order to efficiently describe the technical components constituting the present invention, or system functions commonly provided in the technical field to which the present invention belongs. The configuration will be omitted as much as possible, and the functional configuration that must be additionally provided for the present invention will be mainly described.

If a person of ordinary skill in the art to which the present invention belongs will be able to easily understand the functions of components previously used among functional configurations that are not shown below and omitted, and are omitted as described above. The relationship between the elements and the elements added for the present invention will also be clearly understood.

In addition, the following examples will be used by appropriately modifying terms so that those of ordinary skill in the art to which the present invention pertains can be clearly understood in order to efficiently describe the key technical features of the present invention. It is by no means limited.

As a result, the technical idea of the present invention is determined by the claims, and the following examples are a means for efficiently explaining the technical idea of the present invention to those of ordinary skill in the art to which the present invention pertains. Only.

The "terminal" described herein may include a mobile phone, a smart phone, a laptop computer, a portable terminal for digital broadcasting, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation, etc. , The present invention is not limited thereto, and may be various devices capable of user input and information display.

In addition, the term "service device or server" may refer to a payment relay server that relays electronic payment as an example, but other various types of servers related to electronic payment may correspond to this, and actual payment relay according to a specific function It is also possible to separate the function and other additional functions into a separate server type.

1 shows an overall system according to an embodiment of the present invention.

A system according to an embodiment of the present invention includes a user terminal 100, an interactive fashion content service providing apparatus 200, a brand terminal 300, a producer terminal 400, and an advertiser terminal 500.

The user terminal 100 may perform wireless communication through a general mobile communication network, and may receive at least one of various messages such as a short message service (SMS), a multimedia message service (MMS), and an e-mail message. A cellular phone, a tablet computer, or a smart phone that transmits and receives may be exemplified. In addition, the user terminal 100 may connect to a mobile communication network to transmit and receive data with an Internet Protocol (IP) network such as the Internet.

The user terminal 100 may receive and output interactive fashion content information provided from the interactive fashion content service providing apparatus 200. To this end, the user terminal 100 may access the mobile optimized media platform service provided by the interactive fashion content service providing device 200, and the interactive fashion content service providing device 200 can interact based on the virtual fashion item. Possible interactive fashion content may be provided to the user terminal 100.

Here, the interactive fashion content may include experiential content in which interactive content is updated in response to an input of the user terminal 100. This can be output through a virtual reality or augmented reality interface provided through a mobile terminal, and this interface can increase user immersion, consumption time, brand preference, and purchase conversion rate.

Such interactive fashion content may include a media platform based on virtual reality or augmented reality that has high user immersion and can post effective marketing content. This can provide an effective advertising marketing space for brand marketing.

In addition, the interactive fashion content may include a virtual fashion item that can be interacted with in the user terminal 100. The interactive fashion content service providing apparatus 200 provides 3D information of a virtual fashion item through an interface, or provides an image conversion process, an expected image service when the user of the user terminal 100 wears it, Lets you easily find a brand that fits your style with a lively content experience. Such a virtual fashion item may be linked with an actual market function, and the interactive fashion content service providing apparatus 200 may mediate sales of a brand product corresponding to the virtual fashion item.

In addition, the interactive fashion content service providing apparatus 200 may receive content production information of the brand terminal 300 or the producer terminal 400 through a separate network, the received content production information, and the pre-built interactive Using the fashion content template, it is very easy and fast to create an interactive fashion content template for a brand or producer.

In particular, the interactive fashion content service providing apparatus 200 may provide a content authoring tool that provides various templates suitable for an effective marketing plan. For example, the interactive fashion content service providing device 200 can provide a content type that can be easily edited in a JSON-based script language, and easily apply various and effective interactive element contents that lead to active user participation through a template. can do.

This speeds up the production speed compared to the existing method that had to produce a simple brand video, and can greatly reduce production costs, and creates interactive fashion content based on templates that can be interacted with without an expert and distributes it to the user terminal 100. You will be able to.

In addition, the interactive fashion content service providing device 200 provides advertisement information received from the advertiser terminal 500 in combination with the interactive fashion content service, and in particular, provides user analysis information from the use of the interactive fashion content service and other SNS information. It collects and identifies appropriate brand preferences, thereby facilitating personalized advertisement and effect analysis for each user terminal 100. For example, the interactive fashion content service providing device 200 predicts brand demand through SNS behavior-based filtering and recommendation logic, or provides an effective marketing environment and predicts demand for virtual fashion items through SNS behavior-based filtering and accurate targeting advertisements. can do.

2 is a diagram illustrating a service providing platform according to an embodiment of the present invention.

Referring to FIG. 2, the apparatus 200 for providing an interactive fashion content service according to an embodiment of the present invention may include a service providing unit 240, and the service providing unit 240 includes an interactive content advertisement module and a virtual It may include a fashion item market module.

The interactive fashion content advertisement module may include one or more service modules for providing a virtual fashion item-based interactive advertisement content service, a content creation service, an advertisement management service, and a recommendation service.

First, the interactive fashion content advertisement module collects brand content information and virtual fashion item design information collected from the maker terminal 400 or the brand terminal 300, and advertisement information collected from the advertiser terminal 500, An item-based interactive advertisement content may be generated, and an interactive fashion content service may be provided to the user terminal 100 by using the item-based interactive advertisement content.

To this end, the interactive fashion content advertisement module of the interactive fashion content service providing apparatus 200 provides a production tool service for 3D content based on virtual reality or augmented reality through the content production service module, the maker terminal 400 or the brand terminal ( 300), and providing a plurality of pre-built interactive content templates to the producer terminal 400 or the brand terminal 300 to enable efficient content production.

In addition, the interactive fashion content advertisement module of the interactive fashion content service providing device 200 provides a preset text-based content markup language-based interface for inputting brand information according to the use and editing of the template, so that it is very convenient and highly compatible. Enables content creation.

In addition, the interactive content advertisement module may provide advertisement targeting processing according to user information analysis, advertisement posting processing based on content, and advertisement tracking (TRACKING) processing through the advertisement management service module. This may be processed by the advertisement management service module based on advertisement information received from the advertiser terminal 500, and the advertisement management service module may calculate analysis information such as advertisement effect and provide it to the advertiser terminal 500.

Meanwhile, the virtual fashion item market module,

A virtual fashion item production service unit that provides a virtual fashion item production tool to change colors, shapes, materials, and parameters for basic virtual fashion items created by brands and designers; A virtual fashion item market operation service unit that displays and sells virtual fashion items produced through the virtual fashion item production service unit, and enables purchase and payment; A virtual fashion item ignition service unit that receives a user's image for a virtual fashion experience and provides a virtual fashion experience service by igniting the selected virtual fashion item to the user's image; It may include.

The virtual fashion item ignition service unit may include a user model generation unit that receives an original image of a user model and extracts a depth value to derive a depth map to generate a user model; An item positioning unit for receiving a virtual fashion item image and performing 3D object targeting to position the virtual fashion item on the user model; A virtual fashion ignition unit configured to ignite a virtual fashion item by tracking a light source source with respect to the image of the user model in which the virtual item is positioned and provide a service image; It may include.

First, the virtual fashion item market module may produce and manage virtual fashion item information according to fashion item production information input from the brand terminal 300 or the maker terminal 400. This can be processed based on a template similar to the above-described interactive content, and a maker can easily produce a virtual fashion item through a markup language interface. Here, the virtual fashion item may be applied to interactive fashion content or may include 3D fashion item information directly provided to the user terminal 100, and may be personalized according to the user to provide services such as wearing or wearing.

To this end, the virtual fashion item market module may provide a virtual fashion item ignition interface and a virtual fashion item market interface to the user terminal 100. In particular, the virtual fashion item market interface may provide a display and purchase function of virtual fashion items in virtual reality in the form of a show window.

In addition, the virtual fashion item ignition interface generates an ignition image of a virtual fashion item according to a user element extracted from the image when the user inputs his or her image through the user terminal 100, and the user terminal 100 It may include a function provided by ).

The virtual fashion item production service unit provides a virtual fashion item production tool to change colors, shapes, materials, and parameters for basic virtual fashion items created by brands and designers. Accordingly, it is possible to easily create a virtual fashion item by changing the color, shape, material, and parameters desired by the user for the basic virtual fashion item.

The virtual fashion item ignition service unit may provide a virtual fashion experience service by receiving a user's image for a virtual fashion experience and igniting the selected virtual fashion item to the user's image.

The virtual fashion item market operation service unit may display and sell virtual fashion items produced through the virtual fashion item production service unit, and provide a service to enable purchase and payment.

The virtual fashion item ignition service unit, the user model generation unit, receives a user image for igniting the virtual fashion item. User model A depth map of the original image is derived, and a user model is created.

The item positioning unit receives a virtual fashion item image and performs 3D object targeting to position the virtual fashion item on the user model.

The virtual fashion ignition unit tracks and applies a light source source to the image of the user model in which the virtual item is positioned, and ignites the virtual fashion item.

The applied image rendering unit provides a virtual fashion experience content service by rendering an image on which a virtual fashion item is ignited.

Meanwhile, the advertisement management service unit may collect and analyze reaction information according to exposure of advertisement content provided by the interactive fashion content service providing apparatus 200 to a targeted user. This has the effect of increasing the marketing effect by analyzing the action of the user who exposed the advertisement to adjust the advertisement target or recommending new content through the recommendation service unit.

To this end, the advertisement management service unit can collect user action information in the interactive fashion content service, and builds the collected user action information as tracking information and delivers it to the recommendation service unit, so that brand recommendation tailored to the user profile can be made. .

For example, the advertisement management service unit analyzes the exposure target information of advertisement contents included in the fashion brand interactive advertisement pool and the user's personalized profile to match highly relevant advertisements and deliver targeted advertisements that improve user purchase induction. I can do it.

To this end, the advertisement management service unit may include a classifier for classifying the exposure target by matching content exposure target information included in the advertisement content with the user profile, and the score and advertisement content matched by the user as the advertisement target of the content As the content of the user's taste, matching scores are calculated, and when each score is equal to or greater than a threshold value, it is determined that it is matched, and the advertisement can be displayed.

In addition, the advertisement management service unit may prioritize the exposure target of the content, but may provide a user protection system that can be set so as not to be exposed when a user applies for blocking a corresponding brand or product.

In addition, user profile information may be collected and analyzed through SNS information and interactive services.

In addition, the advertisement management service unit may provide a mobile app-type client to the user terminal 100 by using a commercial 3D engine to display advertisement content in the form of virtual reality or augmented reality. The interactive fashion content provided through this may be configured to correspond to multiple media using the markup language described above, and may be rendered.

In addition, the advertisement management service unit may collect a user's action while the user uses the interactive brand advertisement content and transmit it to the advertisement tracking system.

In addition, the advertisement tracking system may collect raw advertisement data from the user's action and transmit it to the user analysis system.

In addition, for such advertisement and content services, the user terminal 100 predicts the user's action and tracks a download module that receives contents at high speed in the background so that the consumption of the user's content is not stopped, and various social actions of the user. An event module that logs, defines events according to each action, and delivers the event to the user analysis system, and a state module that responds to network changes or user's switching between apps by storing or resuming state information through state transition-based actions. It may contain.

Meanwhile, the recommendation service unit extracts personalized taste analysis data through the user's tracking data, extracts the user's fashion taste data based on images and videos uploaded by the user to SNS, etc., and extracts the extracted taste analysis data and social media. It creates a user profile based on behavioral data, and provides a brand and product recommendation service using the generated user profile. The extraction process may involve a brand image or logo analysis process, which will be described in more detail with reference to FIG. 3.

3 is a flowchart illustrating a service providing method according to an embodiment of the present invention.

Referring to FIG. 3, the apparatus 200 for providing an interactive fashion content service performs brand image or logo analysis from the user's interactive service or SNS activity information.

In addition, the interactive fashion content service providing apparatus 200 extracts fashion taste data for each user and generates a user profile.

Thereafter, the interactive fashion content service providing apparatus 200 provides a brand recommendation service based on the generated user profile.

For example, to analyze a brand image or logo, the interactive fashion content service providing device 200 includes at least one of an image character reading technology (OCR, Optical Character Recognition), Template Matching technology, and Intelligent Video Analysis technology. User media analysis can be performed using one, and accordingly, automated information about brands of interest and fashion trend propensity can be derived.

In addition, the SNS activity information may include at least one of following information related to SNS, canceling following, viewing posts, sharing posts, writing comments, writing large comments, reaction to DM, and information on participating in interactive content, and interactive fashion The content service providing device 200 may generate a more effective user profile through SNS Action Based Filtering.

4 is a view for explaining in more detail a virtual fashion item management unit according to an embodiment of the present invention, and FIG. 5 is a view for explaining a process of generating a virtual fashion item according to an embodiment of the present invention.

First, referring to FIG. 4, the virtual fashion item management unit according to an embodiment of the present invention may be included in the interactive fashion content service providing apparatus 200, and generation and management of virtual fashion items provided through the service providing unit 240 And it can perform functions such as sales.

To this end, the virtual fashion item management unit may include a basic virtual fashion item setting unit, a data input unit, a parameter change unit, a virtual fashion item generation unit, an interface processing unit, and a service providing unit.

As shown in FIG. 5, the virtual fashion item management unit provides a virtual fashion item generation function capable of generating a virtual fashion item by inputting new item information of a creator in a predefined basic virtual fashion item template. Alternatively, it may be provided to the brand terminal 300.

To this end, the basic virtual fashion item setting unit may set a basic virtual fashion item based on 3D graphic data that is divided into an unchangeable area and an area that can be modified as needed by the creator in order to be combined with the user's 3D model later.

Accordingly, the virtual fashion item management unit may provide a tool that enables the creator to complete the virtual fashion item by adding a model and map data to the semi-assembled virtual fashion item template.

More specifically, the data input unit may acquire new additional data input to the basic virtual fashion item template, and the parameter change unit may process parameter change of the basic virtual fashion item according to the additional data.

In addition, the virtual fashion item generation unit may generate and store and manage the changed item as a new virtual fashion item. The virtual fashion item is used for the production of the content creation unit, or according to the market service in the service providing unit 240, the creator creates an item and uploads it to the market to directly sell the item, or to be used for selling linked brand products. I can.

For example, the basic virtual fashion item template can correspond to basic fashion items such as earrings, neckties, T-shirts, dress shirts, jackets, dresses, etc., and fixed vertices to be combined with the user model and connection vertices and setting values that are connected to the creator's model. It can be implemented as template data including joint vertices that can be moved according to, connection vertices that can be connected with the creator's model, and physical variable values that can be changed according to the specificity of the material. As data information for a new virtual fashion item, the user may generate a new virtual fashion item by inputting data such as additional media and images.

In addition, for data input, the markup language described above may be used, thereby improving convenience, reducing manufacturing cost, and reducing time.

6 is a block diagram illustrating a virtual fashion interface processing unit according to an exemplary embodiment of the present invention, and FIG. 7 is a diagram illustrating an interface processing process of a virtual fashion item according to an exemplary embodiment of the present invention.

6 and 7, the virtual fashion interface processing unit according to an embodiment of the present invention may be included in the interactive fashion content service providing apparatus 200, and a user 3D model extracted from an image or video media uploaded by a user To, the virtual fashion item selected by the user is applied, and the applied image or video can be output. The service provider 240 may provide a virtual fashion interface service that provides the output image or video to the user terminal 100.

More specifically, as shown in FIG. 7, the virtual fashion interface processor applies virtual fashion item information to 3D model information obtained from user image or image information, and the user image or image information on which the virtual face item is ignited. Can be printed. Accordingly, the service providing unit 240 provides the user image or video information on which the virtual display item is ignited to the user terminal 100 to facilitate the user's experience of the virtual fashion item and directly determine the state in which the virtual fashion item is ignited. So you can check it.

To this end, referring again to FIG. 6, the virtual fashion interface processing unit may include an image information acquisition unit, a depth value extraction unit, a user model determination unit, an item positioning unit, a light source application unit, and an applied image rendering unit.

The image information acquisition unit acquires image information from a camera image of a user or one or more images input by a user.

In addition, the depth information extracting unit may extract depth information from the image information. The depth information may be information reconstructed in 2.5 dimensions from image information, or distance information from a subject collected through a separate 3D camera may be exemplified.

In addition, the user model determination unit determines user model information in order to reconstruct the user's 3D scene according to the depth information.

The item positioning unit may extract camera factors according to user model information, and project object information of a virtual fashion item in the scene by using the extracted camera factors. In addition, the item positioning unit may apply occlusion according to depth values with other objects in the image information.

Accordingly, 3D image information in a form in which a virtual fashion item is ignited may be extracted from the model information extracted from the user's image information.

In addition, the light source application unit calculates virtual light source location and intensity information irradiated to objects in the 3D image information so that the projected object fits well with the user's image, and predicts possible shadow information. It can be included in 3D image information.

Meanwhile, the applied image rendering unit may render the image information to which the item positioning and the light source are applied as 3D image information or image information. The rendered image information may be provided to the user terminal 100 through the service providing unit 240.

The above-described method of operating an apparatus according to the present invention may be produced as a program to be executed in a computer and stored in a computer-readable recording medium. Examples of computer-readable recording media include ROM, RAM, and CD-ROM. , Magnetic tapes, floppy disks, and optical data storage devices.

The computer-readable recording medium is distributed over a computer system connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (4)

In the service providing device,
A virtual fashion item production service unit that provides a virtual fashion item production tool to change colors, shapes, materials, and parameters for basic virtual fashion items created by brands and designers;
A virtual fashion item ignition service unit that receives a user's image for a virtual fashion experience and provides a virtual fashion experience service by igniting the selected virtual fashion item to the user's image; Including
Virtual fashion gym content service providing device.
The method of claim 1,
Further comprising a virtual fashion item market operation service unit that displays and sells virtual fashion items produced through the virtual fashion item production service unit, and enables purchase and payment.
Virtual fashion gym content service providing device.
The method of claim 1,
The virtual fashion item ignition service unit,
A user model generator configured to generate a user model by receiving a user model original image and extracting a depth value for deriving a depth map;
An item positioning unit for receiving a virtual fashion item image and performing 3D object targeting to position the virtual fashion item on the user model;
A virtual fashion ignition unit configured to ignite a virtual fashion item by applying a light source by tracking a light source with respect to the image of the user model in which the virtual item is positioned; Including
Virtual fashion gym content service providing device.
The method of claim 3,
Further comprising an applied image rendering unit for rendering the image image ignited by the virtual fashion ignition unit to generate and service virtual fashion experience content
Virtual fashion gym content service providing device.

Images