JP2022117813A - Virtual try-on system and program used for the same - Google Patents

Abstract

To provide a virtual try-on system which can easily realize positions and shapes of parts that a buyer satisfies in a clothing kit for completing clothing by selecting types and positions of parts.SOLUTION: In a virtual try-on system 100, a clothing image storage unit 1 stores clothing images being images of a plurality of types of clothing, a human body image acquisition unit 2 acquires a human body image being an image of a try-on person before clothing try-on, a clothing image acquisition unit 3 displays the clothing images stored in the clothing image storage unit 1 in a selectable manner, and acquires the selected clothing image, a try-on image display unit 4 generates a try-on image by synthesizing the clothing image acquired by the clothing image acquisition unit 3 on the human body image, and displays the same, and a part operation unit 5, in the try-on image or the clothing image, moves images of prescribed parts composing the clothing, or changes the same to images of other parts.SELECTED DRAWING: Figure 3

Description

Patent Law Article 30, Paragraph 2 Application Applied On January 23, 2021, Shingakusha Co., Ltd. sent flyers to each sales agent.

The present invention relates to a virtual try-on system or the like that displays a virtual try-on state by synthesizing an image of clothes with an image of a human body.

In elementary school home economics classes, relatively simple clothes such as aprons are made, and in recent years, clothes kits for this purpose have also been sold. This clothing kit contains multiple parts, and students complete the clothing by sewing these parts.

For example, in the case of an apron kit, apron parts, neck strap parts, waist strap parts, pocket parts, patch cloth parts, etc. are prepared in advance, and the apron parts include neck strap parts, waist strap parts, pocket parts, patch cloth parts, etc. The apron is configured to be completed by attaching it.

However, in the case of clothing kits that are divided into multiple parts as described above, it is not possible to try them on because they are incomplete. If there are parts whose arrangement can be changed, such as pocket parts, there will be a wide variety of choices, and a situation may occur in which the purchaser cannot decide which part to choose. Moreover, since it is difficult to grasp the image of the finished product in advance, it may happen that the finished clothes are disliked.

In recent years, as shown in Patent Document 1, an image of the human body as a model and an image of clothes desired by the purchaser are superimposed on a computer to form a composite image, which is displayed on a screen to simulate the state of trying on clothes. A virtual try-on system has been proposed, but even such a virtual try-on system cannot simulate various parts of clothes, and cannot solve the above-mentioned problems.

Japanese Patent Application Laid-Open No. 2001-273446

The present invention has been made in view of the above-mentioned problems, and provides a virtual try-on system that enables purchasers, etc., to easily make satisfactory decisions in clothing kits in which clothing is completed by determining the types and positions of parts. It is intended as much as possible.

That is, the virtual try-on system according to the present invention includes: a clothing image storage unit storing clothing images, which are images of a plurality of types of clothing; a clothing image acquisition unit that selectably displays clothing images stored in the clothing image storage unit and acquires the selected clothing image; a fitting image display unit for generating a fitting image by synthesizing it with the image and displaying the fitting image;

In the fitting image or the clothing image, a parts operation unit is provided for moving or changing the image of at least one part among the parts constituting the clothing to an image of another part.

If it is like this, the purchaser can change the position of the parts of the clothes or change to other parts while looking at the virtual image of trying on the clothes. It becomes possible to easily determine the type and position of parts.

If it further has a fitting image storage unit for storing the fitting image, it can be used for reviewing the once determined fitting image later, or for performing a purchase procedure using the fitting image.
It is preferable that the clothes image is a three-dimensional image of the clothes being tried on in order to bring the try-on image closer to reality and make it easier to imagine.

The present invention provides a clothing image storage unit that stores clothing images that are images of a plurality of types of clothing, a human body image acquisition unit that acquires a human body image that is an image of a person trying on clothes before trying on the clothing, and the clothing image storage unit. a clothing image acquisition unit that selectably displays clothing images stored in a storage unit and acquires the selected clothing image; and a fitting image that combines the clothing image acquired by the clothing image acquisition unit with the human body image. and a fitting image display unit for displaying the fitting image, and a parts operation unit for moving or changing the image of at least one of the parts that make up the clothing in the fitting image or the clothing image to an image of another part. A program for a virtual try-on system characterized by causing a computer to exhibit the functions of and .

According to the virtual try-on system according to the present invention, a purchaser or the like can easily determine the types and positions of parts of clothes.

1 is an overall diagram showing the hardware configuration of a virtual try-on system according to an embodiment of the present invention; FIG. It is a schematic diagram of the apron kit in the same embodiment. 2 is a functional block diagram of the virtual try-on system in the same embodiment; FIG. FIG. 10 is a screen display diagram showing a screen displayed on the client device of the virtual try-on system according to the embodiment; FIG. 10 is a screen display diagram showing a screen displayed on the client device of the virtual try-on system according to the embodiment; FIG. 10 is a screen display diagram showing a screen displayed on the client device of the virtual try-on system according to the embodiment;

An embodiment of the present invention will be described below with reference to the drawings.

The virtual fitting system 100 according to the present embodiment is used when purchasing an apron kit provided as a teaching material for home economics, and as shown in FIG. It consists of a server device 200 and a client device 300 which are connected to each other.
Before describing the virtual try-on system 100, the apron kit will be briefly described.

As shown in FIG. 2, this apron kit has an apron part 91, a neck/waist strap part 93, and a pocket part 92. Students who purchase this apron kit sew these parts 91 to 93 to make clothes. apron 9 is completed. This apron kit is prepared in a plurality of types with different colors, patterns or shapes, and the purchaser selects and purchases the one that he/she likes.
Now, returning to the main topic, the virtual try-on system 100 will continue to be described.

The server device 200 includes a computer main body having a CPU, a storage device (including a hard disk, etc.), a communication interface, an input/output interface, etc., and input/output devices such as a keyboard, a mouse, and a display connected to the computer main body. It is a so-called computer equipped with

The client device 300 includes a computer main body having a CPU, a storage device (including a hard disk, etc.), a communication interface, an input/output interface, etc., a touch panel display (hereinafter simply referred to as a display), and an input/output device such as a camera. For example, it is a portable computer such as a smart phone or a tablet computer that is integrated with a device. Of course, a so-called desktop type or notebook type personal computer may also be used.

When predetermined programs (applications) are installed in the server device 200 and the client device 300 and run respectively, the respective devices 200 and 300 cooperate through communication to store the clothes image as shown in FIG. It functions as a unit 1, a human body image acquisition unit 2, a clothing image acquisition unit 3, a fitting image display unit 4, a parts operation unit 5, a fitting image storage unit 6, and the like.

Next, each section will be briefly described.
The clothing image storage unit 1 is set in a predetermined area of the storage device of the server device 200, and a plurality of types of apron images are stored in advance. In this embodiment, the apron image is composed of two images, an image of the pocket parts and an image of all the other parts, which are linked to each other and stored.

The human body image acquiring unit 2 acquires a human body image, which is an image of the person trying on the apron before trying on the apron, which is captured by the camera of the client device 300 or the like, and displays the human body image on the display of the client device 300 .

The clothing image acquisition unit 3 receives a selection input by the user and acquires the image of the apron selected by the selection input from the clothing image storage unit 1 .

The fitting image display unit 4 generates a fitting image by synthesizing the clothing image acquired by the clothing image acquiring unit 3 with the human body image, and displays the fitting image on the display of the client device 300 .

The parts operation unit 5 receives a predetermined operation of the user on the image of the pocket parts in the fitting image displayed on the display of the client device 300, and changes the position of the pocket parts according to the operation.
The fitting image storage unit 6 is set in a predetermined area of the storage device of the client device 300 and stores the fitting images.

Next, the operation of the virtual try-on system 100 configured as described above and the operation method thereof will be described in detail, together with a detailed description of each of the above sections.

First, the user (purchaser) installs an application related to the virtual try-on system 100 on his or her client device 300 .
Then, when the user activates the application, the screen is switched to a predetermined shooting screen.

When the user takes a picture of a person who is not wearing an apron on the photographing screen, a human body image, which is a photographed image of the person being tried on, is acquired by the human body image acquiring unit 2 as shown in FIG. 300 displays. At this time, it is not always necessary to photograph the person trying on the clothes on the application, and an existing photo image of the person trying on the clothes previously taken by the camera of the client device 300 can be selected and used as the human body image.

Next, when the user performs a predetermined touch operation such as swiping or tapping, the fitting image display unit 4 operates, and as shown in FIG. 5, a predetermined default apron image is displayed on the display. is displayed so as to be superimposed on the human body image displayed in .

At this time, the user can change the size and position of the apron image by operations such as pinch-in, pinch-out, and drag, so as to match the size and position of the human body image on the display. Note that the image of the apron displayed at this time is the image in the state of being tried on, and the position of the pocket parts image displayed there is set to a predetermined default position.

As shown in the figure, a switching button B1 is displayed on the screen (fitting image display screen) displaying the fitting image that is a composite image of the human body image and the apron image.

When the user operates this switching button B1, as shown in FIG. 6, a plurality of types of reduced apron images are displayed in a selectable manner under the fitting image display screen. Therefore, when the user selects one of the reduced apron images by, for example, tapping, the apron image in the fitting image is switched to the selected new apron image.

On the other hand, in the fitting image, the user can change the position of the pocket parts image by operations such as dragging due to the functions of the parts operation unit 5. You can move the parts and decide the desired mounting position for the pocket parts.
When the position of the pocket part is determined in this manner, the fitting image is stored in the fitting image storage unit 6 by pressing the shooting button at the bottom of the screen.

In addition, the present invention is not limited to the above embodiments.
In the above-described embodiment, it was possible to simulate a fitting image in which the pocket parts were attached at different positions.
The movable range of the parts image may be limited only to the mountable range.

In addition to moving the parts image, it may be possible to change to another parts image with a different color, pattern, or shape.
The present invention may be applied not only to aprons but also to other clothes, and a single piece of clothing may have a plurality of parts that can be moved or selected.

Furthermore, although the parts image can be moved or changed on the fitting image display screen, the selected clothing image is displayed so that the parts image can be moved or changed on the clothing image display screen. Alternatively, the clothing image in which the types and positions of the parts are determined may be synthesized with the human body image.

In the above embodiment, the virtual try-on system is configured by the server device and the client device, but all functions may be integrated into the client device and the virtual try-on system may be configured by the client device alone.
In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

1 clothing image storage unit 2 human body image acquisition unit 3 clothing image acquisition unit 4 fitting image display unit 5 parts operation unit 6 fitting image storage unit

Claims (4)

a clothing image storage unit storing clothing images, which are images of a plurality of types of clothing;
a human body image acquisition unit that acquires a human body image that is an image of the person trying on the clothes before trying on the clothes;
a clothing image acquisition unit that selectably displays clothing images stored in the clothing image storage unit and acquires the selected clothing image;
a fitting image display unit for synthesizing the clothing image acquired by the clothing image acquisition unit with the human body image to generate a fitting image and displaying the image;
A virtual try-on system, further comprising: a parts operation unit that moves or changes an image of at least one part among the parts that make up the clothes in the fitting image or the clothes image to an image of another part. 2. The virtual try-on system according to claim 1, further comprising a try-on image storage section for storing said try-on images. 3. The virtual try-on system according to claim 1, wherein said clothes image is a three-dimensional image of the clothes being tried on. a clothing image storage unit storing clothing images, which are images of a plurality of types of clothing;
a human body image acquisition unit that acquires a human body image that is an image of the person trying on the clothes before trying on the clothes;
a clothing image acquisition unit that selectably displays clothing images stored in the clothing image storage unit and acquires the selected clothing image;
a fitting image display unit for synthesizing the clothing image acquired by the clothing image acquisition unit with the human body image to generate a fitting image and displaying the fitting image;
and a parts operation unit that moves or changes the image of at least one part of the parts that make up the clothes in the fitting image or the clothes image to an image of another part. A program for a virtual try-on system.

Images