KR101669927B1 - Virtual fitting system, method of providing virtual fitting service for promoting sales and computer program for the same - Google Patents

Abstract

A virtual fitting system includes: a display configured to output an image; A receiving unit configured to detect a user positioned within a predetermined distance from the display unit and acquire image information and body information of the user; A processing unit configured to generate a virtual fitting image of a user using the image information and the body information; And a control unit for controlling the display unit, the receiving unit, and the processor so as to output the virtual fitting image to the display unit when the user senses the receiving unit during output of the preset image to the display unit, can do. The virtual fitting system repeatedly reproduces the advertisement image at normal times, and when a curious customer approaches the display unit, the virtual fitting system automatically induces the virtual fitting of the costume associated with the advertisement image, thereby promoting the purchase of the costume have.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual fitting system, a virtual fitting service providing method for promoting purchase, and a computer program for the same. [0002]

Embodiments relate to a virtual fitting system, a method for providing a virtual fitting service for purchase promotion, and a computer program therefor.

Recently, as a depth sensor has appeared, it has become possible to easily acquire shape information of a user and motion information of a joint. By applying the depth sensor, the user interface used in various services is also changing. Particularly, new user participation services are emerging according to the change of the user interface. Among these participatory services, there is a virtual fitting service that a user can wear without wearing clothes directly.

For the virtual fitting service, a three-dimensional model corresponding to the user is generated by scanning the outer shape of the user using a depth sensor, and the three-dimensional model of the ward prepared in advance is registered in the three-dimensional model of the user. Next, by simulating the three-dimensional model simulated on the basis of the motion of the user provided through the depth sensor, the user synthesizes and displays the synthesized image on the user's image, so that the user can virtually wear the three- Can be worn.

However, until now, the virtual fitting service has only been applied to experimental applications, and research has not been conducted on techniques that can be applied to actual clothing shops to purchase clothes.

Japanese Patent Application Laid-Open No. 10-2014-0116585 Japanese Patent Application Laid-Open No. 10-2014-0077820

According to an aspect of the present invention, there is provided a virtual fitting system capable of automatically promoting the purchase of a costume by inducing a virtual fitting of a costume associated with an advertisement image when a customer who is curious about the advertisement image approaches the display device A virtual fitting service providing method, and a computer program therefor.

According to one embodiment, a virtual fitting system comprises: a display configured to output an image; A receiving unit configured to detect a user positioned within a predetermined distance from the display unit and acquire image information and body information of the user; A processing unit configured to generate a virtual fitting image of a user using the image information and the body information; And a control unit for controlling the display unit, the receiving unit, and the processor so as to output the virtual fitting image to the display unit when the user senses the receiving unit during output of the preset image to the display unit, do.

In one embodiment, the control unit further controls the display unit, the receiving unit, and the processing unit to output the virtual fitting image in response to receiving a fitting request from a user. At this time, the fitting request may be based on a touch input of a user and / or a gesture input.

In one embodiment, the preset image corresponds to one or more garment information. At this time, the processing unit is configured to generate the virtual fitting image by further using the one or more clothes information.

In one embodiment, the control unit controls the display unit to further output detailed information related to the costume information in response to a user's information request received during output of the virtual fitting image. At this time, the detailed information request may be based on a user's touch input and / or gesture input. In addition, the detailed information may include a two-dimensional code corresponding to a web page related to the costume information.

According to an embodiment of the present invention, there is provided a virtual fitting service providing method for facilitating purchase, comprising: outputting a preset image to a display unit; Detecting at a receiving unit a user located within a predetermined distance from the display unit; Acquiring image information and body information of the user detected by the receiving unit; Generating a virtual fitting image of a user at a processing unit using the image information and the body information; And outputting the virtual fitting image to the display unit.

In one embodiment, acquiring the image information and the body information of the user is performed in response to receiving a fitting request from a user. At this time, the fitting request may be based on a user's touch input and / or gesture input.

In one embodiment, the preset image corresponds to one or more garment information. At this time, the step of generating the virtual fitting image is performed using the at least one piece of clothing information.

According to an embodiment of the present invention, a method for providing a virtual fitting service for promoting purchase includes: receiving, during output of a virtual fitting image, a request for information of a user by the receiving unit; And outputting detailed information related to the costume information to the display unit in response to the information request. At this time, the detailed information request may be based on a user's touch input and / or gesture input. In addition, the detailed information may include a two-dimensional code corresponding to a web page related to the costume information.

A computer program according to one embodiment is for execution of the above-described virtual fitting service providing method in combination with hardware, and can be stored in a computer-readable medium.

According to one aspect of the present invention, a virtual fitting system, a method of providing a virtual fitting service for purchasing promotion, and a computer program for the same provide a method of reproducing a commercial image repeatedly, When it comes near, the virtual fitting of the costume associated with the advertisement image can be automatically induced. Further, by displaying more detailed information about the virtual fitted clothing and / or a QR code for the web page from which the customer can purchase the clothes, on the display device, if the customer is interested in the costume of the virtual fitting, So that it can be easily performed. In other words, it can promote the sales of clothes by combining virtual fitting technology with marketing strategy.

1 is a schematic block diagram of a virtual fitting system in accordance with one embodiment.
2 is a flowchart illustrating each step of a virtual fitting service providing method for promoting purchase according to an embodiment.
FIG. 3 is a conceptual diagram illustrating acquisition of a customer's body information by the virtual fitting system according to an embodiment.
4 is a conceptual diagram illustrating providing a virtual fitting image by a virtual fitting system according to one embodiment.
5 is a conceptual diagram illustrating providing detailed information about a garment by a virtual fitting system according to one embodiment.
FIG. 6 is a conceptual diagram showing providing detailed information on a garment by the virtual fitting system according to the embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

1 is a schematic block diagram of a virtual fitting system in accordance with one embodiment.

Referring to FIG. 1, the virtual fitting system includes a receiving unit 10, a display unit 20, a processing unit 30, and a control unit 40. The virtual fitting system according to the embodiments may be entirely hardware, entirely software, or partially hardware, and partially software. For example, the virtual fitting system may be referred to as hardware equipped with data processing capability and operational software for driving it. The terms "unit," "system," and " device "and the like are used herein to refer to a combination of hardware and software driven by that hardware. For example, the hardware may be a data processing device including a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), or another processor. Also, the software may refer to a running process, an object, an executable, a thread of execution, a program, and the like.

Each of the parts 10, 20, 30, 40, 50 constituting the virtual fitting system according to the embodiments is not necessarily intended to refer to a separate component which is physically distinct. 1, the receiving unit 10, the display unit 20, the processing unit 30, and the control unit 40 are shown as separate blocks separated from each other. However, the receiving unit 10, the display unit 20, Some or all of the processing unit 30 and the control unit 40 may be integrated in the same single device (e.g., a display device). Further, each of the units 10, 20, 30, 40, and 50 is a functionally separated device according to the operation performed in the computing device in which they are implemented, and does not necessarily mean a separate device separate from each other. However, this is an example, and in another embodiment, at least one of the receiving unit 10, the display unit 20, the processing unit 30, and the control unit 40 may be implemented as a separate device physically separated from the other unit. For example, the processing unit 30 and / or the control unit 40 may be components communicably connected to the receiving unit 10 and the display unit 20 under a distributed computing environment.

The receiving unit 10 is configured to detect a user located within a predetermined distance from the virtual fitting system, and to acquire image information and body information of the user. For example, the receiving unit 10 may include an RGB camera and a depth camera. In addition, the depth camera may be composed of one or more infrared cameras, but is not limited thereto. In one embodiment, the receiving unit 10 may be configured to be combined with and integrated with the display unit 20, and to detect and measure a user located within a predetermined distance from the display unit 20. [

The display unit 20 is a display device for outputting an image. For example, the display unit 20 may be a liquid crystal display (LCD), but is not limited thereto. The display unit 20 may be electrically connected to the control unit 40 and may be configured to selectively output a preset image of the user, a virtual fitting image of the user to the costume, detailed information on the costume, etc., under the control of the controller 40 have.

The processing unit 30 is configured to generate a virtual fitting image using the image information and the body information of the user received by the receiving unit 10. [ The control unit 40 is electrically connected to the receiving unit 10, the display unit 20, and the processing unit 30 to control them. In this specification, the processing unit 30 and the control unit 40 may functionally distinguish one and the same processor by operations performed thereon, and are not necessarily intended to include separate hardware that is physically separated from each other.

Specifically, the control unit 40 controls the display unit 20 to output a virtual fitting image when a user is detected by the receiving unit 10 during the reproduction of the video image, (10), the display unit (20), and the processing unit (30). In one embodiment, the image normally output to the display unit 20 is an advertisement associated with one or more clothes. When the user is close to the display unit 20, the virtual fitting image is used to display the costume and the user's body information . ≪ / RTI > That is, a user who has come to the virtual fitting system by viewing the advertisement can enjoy the same effect as if he wore a virtual costume image through the virtual fitting image.

In one embodiment, the virtual fitting system may further output detailed information related to the costume worn by the user to the display 20. The detailed information may include information such as the name of the garment, the model name, the image, the color, the size, etc., dimensions, and the price. Alternatively, the detailed information may include a two-dimensional code (e.g., a QR code) corresponding to an address of a web page from which the costume can be purchased. A user scans a two-dimensional code using a user terminal 2 such as a smartphone to access a costume purchasing web page provided by the web server 50 to easily purchase a virtual fitted costume . In one embodiment, the web server 50 may form part of a virtual fitting system.

2 is a flowchart illustrating each step of a virtual fitting service providing method for promoting purchase according to an embodiment. A virtual fitting system and a method of providing a virtual fitting service according to embodiments will be described in detail with reference to FIGS. 1 and 2. FIG.

First, the advertisement image associated with one or more garments may be output to the display unit 20 (S1). This can correspond to a normal state in which no user is approached to the virtual fitting system. In addition, the advertisement image can be repeatedly reproduced until a user approached the display unit 20.

When the user who has viewed the advertisement approaches the virtual fitting system, the receiving unit 10 can detect a user located within a predetermined distance from the display unit 20 using a depth sensor or the like (S2). Various methods for detecting the adjacent user from the signals of the depth sensor are well known in the technical field of the present invention, and therefore, a detailed description thereof will be omitted in order to clarify the gist of the present invention.

When the user is positioned within a predetermined distance from the display unit 20, the control unit 40 can control the display unit 20 to display the interface through which the display unit 20 guides the virtual fitting (S3). An interface for guiding a virtual fitting is an interface for guiding a user through a message, a screen, and / or a sound to induce a user to participate in a scanning process because a scanning process for a user's body information is required to generate a virtual fitting image Quot; For example, when the user is stopped for a predetermined time (for example, several seconds) within a predetermined distance from the display unit 20, the advertisement image being played back on the display unit 20 is stopped and a guidance message is displayed on the display unit 20 .

As an example, the announcement message may be for receiving user input, such as " RAISE YOUR HAND TO START ". The user can deliver the virtual fitting request to the virtual fitting system by performing the operation designated by the guide message (S4). Since the user's motion can be measured using the depth sensor, a user's gesture input, such as a hand gesture, can be used as a virtual fitting request signal. However, this is an exemplary one, and in other embodiments, a touch input to a touchscreen or a push of a physical button may be used for the purpose of a virtual fitting request. Furthermore, in another embodiment, the virtual fitting system may be configured such that the scanning process is started only in response to the user staying or staying within a predetermined distance from the display unit 20 without the step of receiving a separate user input (S4) .

Next, the user's body information can be obtained through the scanning process (S5). FIG. 3 is a conceptual diagram illustrating acquisition of a customer's body information by the virtual fitting system according to an embodiment. Referring to FIG. 3, in the scanning process, the display unit 20 may operate as a mirror. That is, the user 1 located in front of the display unit 20 is photographed through the RGB camera of the receiving unit 10, and the receiving unit 10 and the display unit 20 are arranged such that the photographed user's image 310 is output to the display unit 20. [ Can be controlled. At this time, the display unit 20 may be further provided with one or more guide lines 320 for controlling the position and attitude of the user in order to obtain the body information of the user 1. Further, a message (not shown) may be displayed on the display unit 20 to request that the user 1 adjust his or her body to the guide line 320 as much as possible. Thereafter, the receiving unit 10 can acquire the user's body information using the depth camera.

The user's body information refers to any information for creating a three-dimensional model corresponding to the user's body shape for virtual fitting. For example, the body information may include a length of a straight line such as a user's body height, arm length, leg length and width of each part, waist circumference of a user's body, circumference such as a chest circumference, a thigh circumference, a calf circumference, , Information about the edges of the body, information of the body extremities such as the ends of the fingers, the ends of the fingers, the tips of the fingers and the ends of the fingers, and / or information of the main joints or bones of the body sensed based on the ends of the body However, the present invention is not limited thereto.

1 and 2, after the body information of the user is measured, the processing unit 30 generates a virtual fitting image using the body information of the obtained user and the real-time image information of the user photographed through the RGB camera (S6).

More specifically, the processing unit 30 can generate a three-dimensional model corresponding to the user's body using the user's body information. The process of generating the human body model from the depth information obtained by the depth camera may be various and is well known in the technical field of the present invention, for example, in Japanese Laid-Open Patent Publication No. 10-2014-0077820. A detailed description thereof will be omitted herein. Next, the processing section 30 matches the three-dimensional model of the garment stored in advance on the three-dimensional model of the user. The three-dimensional model of the garment is a three-dimensional model of the garment corresponding to the advertisement being played back on the display unit 20 before the scanning process is started, and may be stored in the processing unit 30 in advance.

Next, the processing unit 30 simulates the three-dimensional model of the user and the motion of the three-dimensional model of the garment matched thereto according to the user's motion information obtained through the depth camera. The 3D model and the technique of rendering the movement of the fabric to an image through computer simulation are well known in the technical field of the present invention, and therefore, a detailed description thereof will be omitted for clarifying the gist of the present invention. In the simulated three - dimensional model, only the costume part is rendered as an image, and synthesized in an overlay form on the RGB image of the user, a virtual fitting image is obtained.

The virtual fitting system outputs the virtual fitting image generated by the above process to the display unit 20 (S7). FIG. 4 is a conceptual view illustrating providing a virtual fitting image by a virtual fitting system according to an embodiment. Referring to FIG. 4, the display unit 20 displays a virtual fitting image, which is rendered on a user's image 310 photographed through an RGB camera The garment image 330 is output in the form of an overlay. As a result, the user can enjoy the same feeling as if he wore the virtual clothes without wearing the costume appearing in the advertisement image. In addition, since the costume image 330 in the virtual fitting image is rendered in real time according to the movement of the user, the user can observe the feeling of the costume while taking various postures.

In one embodiment, the virtual fitting system may further be configured to receive from the user a request for information about the costume worn by the user (S8) and to output detailed information about the costume to the display 20 in response thereto (S9). For example, the detailed information about the garment may include information such as the name of the garment, model name, image, color, size, etc., dimensions, and price. Alternatively, the detailed information about the garment may include a two-dimensional code (e.g., a QR code) corresponding to the address of a web page from which the garment can be purchased.

5 is a conceptual diagram illustrating providing detailed information about a garment by a virtual fitting system according to one embodiment.

Referring to FIGS. 1 and 5, a user can request detailed information about a virtual fitting image by performing a preset operation while viewing a virtual fitting image. For example, a request for detailed information may be made through a touch input such as a gesture input, such as a user picking up a hand, or a user touching a touch screen, but is not limited thereto. When an information request of the user is received, an object 510 including a name, a model name, an image, a color, a size, and the like of a costume worn by the user is displayed in an overlay form on the virtual fitting image, 20. When there are a plurality of clothes in virtual fitting, a plurality of the aforementioned objects 510 and 520 may be displayed on the display unit 20. [ In addition, the detailed information may further include a button object 530 for linking to a purchase page for the costume being worn. The user 1 may request that the function assigned to the button object 530 be executed by positioning itself in the virtual fitting image to be located on the button object 530. [

However, the above-described output forms are illustrative, and the manner in which detailed information on the clothes is provided is not limited to that shown in Fig. For example, in FIG. 5, detailed information on the costume is displayed in an overlay form on the virtual fitting image. However, in another embodiment, the output of the virtual fitting image is stopped at the same time as the detailed information is requested and a separate image and / And may be output to the display unit 20 as information. Further, in the above-described example, detailed information on the costume is provided in response to the user's detailed information request (S8), but this is an illustrative example. In another embodiment, when a certain time has elapsed since the output of the virtual fitting image, Detailed information may be displayed, in which case the step S8 may be omitted.

FIG. 6 is a conceptual diagram showing providing detailed information on a garment by the virtual fitting system according to the embodiment.

1 and 6, in this embodiment, the detailed information on the costume includes at least one object 610, 620 including the name of the costume, model name, image, color, size, etc. dimensions, And QR codes 615 and 625 corresponding to the address of the purchase page with respect to the purchase page. The user can easily access the web page that can purchase the virtual fitted clothing by scanning the QR codes 615 and 625 using the user terminal 2 having the camera and the communication function like the smart phone possessed by the user , The virtual fitted garment can be easily purchased. Thus, by combining virtual fitting techniques with marketing strategies, sales of costumes can be promoted.

Operations according to the virtual fitting system and the virtual fitting service providing method according to the embodiments described above can be at least partially implemented in a computer program and recorded in a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. In addition, functional programs, codes, and code segments for implementing the present embodiment may be easily understood by those skilled in the art to which this embodiment belongs.

While the invention has been shown and described with reference to certain embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. However, it should be understood that such modifications are within the technical scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (15)

A display configured to output an image;
A receiving unit configured to detect a user positioned within a predetermined distance from the display unit and acquire image information and body information of the user;
A processing unit configured to generate a virtual fitting image of a user synthesized in an overlay form on the image information using a three-dimensional model of a costume simulated according to a user's movement using the image information and the body information; And
And a control unit for controlling the display unit, the receiving unit, and the processing unit to output the virtual fitting image to the display unit when the user senses the receiving unit during the output of the preset image, ,
Wherein the predetermined image corresponds to one or more pieces of clothing information,
Wherein the processing unit is configured to generate the virtual fitting image further using the at least one piece of clothing information,
The control unit controls the processing unit to generate the virtual fitting image using the clothing information corresponding to the image being output to the display unit at the time when the user is sensed at the receiving unit when the user is sensed in the receiving unit Controlling the display unit to further output detailed information related to the costume information in response to a user's information request received during the output of the virtual fitting image,
Wherein the detailed information includes a predetermined object displayed in an overlay form on the virtual fitting image,
Wherein the control unit determines whether a body part of the user is located on the object based on the detection result by the receiving unit, and in response to the user's body part being located on the object, And to control the display unit to output a purchase page of a costume to be displayed.
The method according to claim 1,
Wherein the control unit further controls the display unit, the receiving unit, and the processing unit to output the virtual fitting image in response to receiving a fitting request from a user.
3. The method of claim 2,
Wherein the fitting request is based on one or more of a user's touch input or a gesture input.
delete delete The method according to claim 1,
Wherein the detailed information request is based on one or more of a user's touch input or gesture input.
delete A virtual fitting service method performed using a virtual fitting system including a display unit, a receiving unit, and a processing unit,
Outputting a preset image to the display unit;
Detecting by the receiving unit a user located within a predetermined distance from the display unit;
Acquiring image information and body information of the user detected by the receiving unit;
Generating a virtual fitting image of a user synthesized in an overlay form on the image information by using a three-dimensional model of a costume simulated according to a user's movement in the processing unit using the image information and the body information;
Outputting the virtual fitting image to the display unit;
During the output of the virtual fitting image, the receiving unit receives a user's information request;
And outputting detailed information related to the costume information in response to the information request to the display unit, wherein the detailed information includes a predetermined object displayed in an overlay form on the virtual fitting image, To a display unit;
Determining whether a body part of the user is located on the object based on the detection result by the receiving unit; And
And outputting a costume purchase page corresponding to the costume information to the display unit in response to the user's body part being located on the object,
Wherein the predetermined image corresponds to one or more pieces of clothing information,
Wherein the step of generating the virtual fitting image comprises the steps of: using the at least one piece of clothing information, and using the clothing information corresponding to the image being output to the display unit at the time when the user is sensed at the receiving unit, And generating an image based on the generated virtual fitting service.
9. The method of claim 8,
Wherein the step of acquiring the image information and the body information of the user is performed in response to receiving a fitting request from a user.
10. The method of claim 9,
Wherein the fitting request is based on one or more of a user's touch input or a gesture input.
delete delete 9. The method of claim 8,
Wherein the detailed information request is based on one or more of a user's touch input or a gesture input.
delete A computer program stored in a storage medium for executing a virtual fitting service providing method in combination with a virtual fitting system including a display unit, a receiving unit and a processing unit,
The virtual fitting service providing method includes:
Outputting a preset image to the display unit;
Detecting by the receiving unit a user located within a predetermined distance from the display unit;
Acquiring image information and body information of the user detected by the receiving unit;
Generating a virtual fitting image of a user synthesized in an overlay form on the image information by using a three-dimensional model of a costume simulated according to a user's movement in the processing unit using the image information and the body information;
Outputting the virtual fitting image to the display unit;
During the output of the virtual fitting image, the receiving unit receives a user's information request;
And outputting detailed information related to the costume information in response to the information request to the display unit, wherein the detailed information includes a predetermined object displayed in an overlay form on the virtual fitting image, To a display unit;
Determining whether a body part of the user is located on the object based on the detection result by the receiving unit; And
And outputting a costume purchase page corresponding to the costume information to the display unit in response to the user's body part being located on the object,
Wherein the predetermined image corresponds to one or more pieces of clothing information,
Wherein the step of generating the virtual fitting image comprises the steps of: using the at least one piece of clothing information, and using the clothing information corresponding to the image being output to the display unit at the time when the user is sensed at the receiving unit, And generating an image,
Computer program.

Images