WO2022190954A1

WO2022190954A1 - Information processing device, method, program, system, and beauty care method

Info

Publication number: WO2022190954A1
Application number: PCT/JP2022/008552
Authority: WO
Inventors: 観荒井; みのり大澤
Original assignee: 株式会社資生堂
Priority date: 2021-03-11
Filing date: 2022-03-01
Publication date: 2022-09-15
Also published as: CN116888634A; JPWO2022190954A1

Abstract

The present invention improves the sense of reality of others even when one carries out treatment on oneself. The information processing device according to one embodiment of the present invention comprises a determination unit for determining the position and orientation of an object on the basis of a person in an image, a superimposition unit for superimposing the image and a CG image of the object at the determined position and in the determined orientation, and a display unit for displaying the superimposed image obtained by superimposition.

Description

Information processing device, method, program, system, and beauty method

The present invention relates to an information processing device, method, program, system, and beauty method.

　Conventionally, in esthetic salons, etc., it is known that practitioners such as estheticians perform beauty-related acts on customers. A customer can obtain a sense of satisfaction by receiving an action related to beauty from another person.

On the other hand, there is also known a beauty technique called "self-esthetic" in which the customer, rather than the practitioner, performs beauty-related actions on their own. In addition, customers sometimes perform beauty-related actions by themselves at home or the like by imitating professional actions (Patent Document 1).

JP 2012-37626 A

However, it was difficult for me to feel as if I was being treated by someone else, even though I was treating myself.

Therefore, the purpose of the present invention is to improve the sense of reality of others even when performing treatment on oneself.

An information processing apparatus according to an embodiment of the present invention includes: a determination unit that determines a position and orientation of an object based on a person in an image; A superimposing unit that superimposes a CG image, and a display unit that displays the superimposed image.

In the present invention, even when performing treatment on oneself, it is possible to improve the sense of reality of others.

It is a figure showing the whole composition concerning one embodiment of the present invention. 1 is a diagram showing functional blocks of an information processing device according to an embodiment of the present invention; FIG. 4 is a flowchart showing the flow of superimposed display processing (first embodiment) according to an embodiment of the present invention; 9 is a flow chart showing the flow of superimposed display processing (second embodiment) according to an embodiment of the present invention. 1 is an example of a screen displayed on an information processing apparatus according to an embodiment of the present invention (first embodiment); 7 is an example of a screen displayed on an information processing apparatus according to an embodiment of the present invention (second embodiment); 1 is a diagram showing the hardware configuration of an information processing apparatus according to an embodiment of the invention; FIG.

Each embodiment will be described below with reference to the attached drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

<Description of terms>
- "Real-time image" refers to an image captured by the camera function of the information processing apparatus 10 (described in detail later).
- A “CG (computer graphics) image” refers to an image generated by the information processing apparatus 10 . It should be noted that the CG image may be a processed moving image taken in advance.
・"Beauty-related actions" are arbitrary beauty-related actions (for example, application of cosmetics, etc.) performed by hands, cosmetic tools, and the like.

<Overall composition>
FIG. 1 is a diagram showing the overall configuration according to one embodiment of the present invention. The person 20 receives the treatment (action) from another person by performing any treatment (action) on himself (for example, performing an action related to beauty) while looking at the screen displayed on the information processing device 10. (for example, undergoing a cosmetic procedure).

Specifically, in one embodiment of the present invention, the person 20 performs an action related to beauty while projecting the upper body of the person 20 through the lens of a camera mounted on the side of the screen of the information processing device 10 . do. The information processing apparatus 10 displays a moving image in which a CG image of an object (for example, a practitioner such as an esthetician) is superimposed on a real-time image of the person 20 . A CG image of an object is a CG image in which the object performs an action related to beauty on the person 20 . The person 20 can feel as if he or she is being treated by another person (that is, an object) by performing an action related to beauty while watching such a moving image.

The information processing device 10 captures a moving image of the person 20 and displays a moving image in which a CG image of an object (for example, a practitioner such as an esthetician) is superimposed on the real-time image of the person 20 . For example, the information processing device 10 is a smart phone, a tablet, a personal computer, or the like having a camera (or a 3D camera) function. The information processing apparatus 10 will be described in detail later with reference to FIG.

In this specification, a case where the information processing device 10 is one device (for example, a smartphone having a camera function) will be described, but the information processing device 10 may be a plurality of devices (for example, a device that does not have a camera function). device and digital camera). Further, a device (such as a server) other than the information processing device 10 may execute part of the processing executed by the information processing device 10 described herein.

<Functional Blocks of Information Processing Device 10>
FIG. 2 is a diagram showing functional blocks of the information processing device 10 according to one embodiment of the present invention. The information processing apparatus 10 can include a photographing unit 101 , a specifying unit 102 , a determining unit 103 , a selecting unit 104 , a superimposing unit 105 and a display unit 106 . Further, the information processing apparatus 10 can function as the imaging unit 101, the identification unit 102, the determination unit 103, the selection unit 104, the superimposition unit 105, and the display unit 106 by executing programs. Each of these will be described below.

The imaging unit 101 acquires real-time images. Specifically, the photographing unit 101 photographs a moving image of the person 20 . For example, the imaging unit 101 captures a moving image of the upper body of the person 20 performing an action related to beauty.

The identifying unit 102 identifies a part of the body of the person 20 in the real-time image acquired by the imaging unit 101 . <<specification for erasing (e.g., making transparent) a partial area of the body of the person 20>> and <<specification for determining the position and orientation of the object>> will be described below.

<<Specification for erasing (e.g., making transparent) a partial area of the body of the person 20>>
The identifying unit 102 identifies a partial area of the body of the person 20 (for example, an area including at least a hand, such as from the elbow to the fingertips, from the wrist to the fingertips, etc.) in the real-time image. It should be noted that the person 20 may carry items such as cosmetics. In addition, the identifying unit 102 identifies a partial area of the body of the identified person 20 (for example, an area including at least a hand) and an area of an object possessed by the person 20 (if the person is carrying an object) from the real-time image. Erase (e.g., make transparent). Note that the process of erasing the partial area of the body of the person 20 may or may not be executed.

<<Method for specifying area>>
For example, the identifying unit 102 refers to human skeleton information (positions of feature points, etc.) stored in advance in the information processing apparatus 10 to estimate the skeleton of the person 20, or extract areas of the same color. Alternatively, a region including at least the hands of the person 20 in the real-time image can be specified by extracting a portion of the person 20 that shows fast movements of a certain speed or more in the moving image.

<<Identification for Determining Object Position and Orientation>>
Hereinafter, the first embodiment and the second embodiment will be described separately.

In the first embodiment, the identification unit 102 identifies the position and posture of at least the hand (for example, elbow to fingertip, wrist to fingertip, etc.) of the person 20 in the real-time image. It should be noted that the person 20 may carry items such as cosmetics.

"Position" indicates the position in the image (here, the real-time image) where the person 20 exists. "Posture" indicates how the person 20 holds the body (posture, posture, etc.).

<<Method for specifying position and posture>>
For example, the identifying unit 102 refers to human skeleton information (positions of feature points, etc.) stored in advance in the information processing apparatus 10 to estimate the skeleton of the person 20, or extract areas of the same color. Alternatively, by extracting a portion of the person 20 in the moving image in which the person 20 moves faster than a certain speed, at least the position and posture of the hand of the person 20 in the real-time image can be specified.

In the second embodiment, the identifying unit 102 identifies a contact point between the person's 20 hand or an object held by the person 20 (for example, cosmetics) and the person's 20 face in the real-time image.

<<Method of identifying contact point>>
For example, the identification unit 102 can analyze the real-time image and identify the contact point between the person's 20 hand (eg, finger) or an object held by the person 20 and the person's 20 face in the real-time image. For example, the identifying unit 102 identifies contact points from a real-time image using a machine-learned model that has been machine-learned using a plurality of images in which a hand (e.g., finger) is in contact with a face (e.g., cheek). be able to. Note that the identifying unit 102 detects a contact point between the person's 20 hand (for example, finger) or an object held by the person 20 and the person's face, based on the detection result of the sensor attached to the finger or the like of the person 20. You may make it specify.

The determination unit 103 determines the position and orientation of the object based on the person 20 in the real-time image. "Position" indicates a position in virtual space where an object is assumed to exist. "Position" indicates how the body of an object is held (posture, posture, etc.).

Specifically, the determining unit 103 determines the position and orientation of the object based on the correspondence relationship between the part of the human body and the position and orientation of the object.

The correspondence may be a pre-determined database or a machine-learned model. The database stores information about a part of a person's body (specifically, at least the position and posture of a person's hand, or a point of contact between a person's hand or an object held by a person and a person's face), and information about a person's face. Position and posture information are associated with each other. In addition, the trained model contains information about a part of the person's body (specifically, at least the position and posture of the person's hand, or the point of contact between the person's hand or an object held by the person and the person's face). is a prediction model that outputs information on the position and orientation of an object when is input.

The following description will be divided into the first embodiment and the second embodiment.

<<First Embodiment>>
In the first embodiment, the determination unit 103 determines the position and orientation of the object based on the position and orientation of at least the hand (for example, elbow to fingertip, wrist to fingertip, etc.) of the person 20 identified by the identification unit 102. to decide. For example, the determining unit 103 can make the position and posture of at least the hand of the person 20 the same as the position and posture of at least the hand of the object. Furthermore, the determination unit 103 determines the operator's possible standing position during the treatment, such as at least the position and posture of the hands of the person 20 and the object being the same, and the object standing obliquely behind the person 20. , the position and pose of other parts of the object (ie, at least parts other than the hand) can be determined.

<<Second Embodiment>>
In the second embodiment, the determination unit 103 determines the object based on the contact point between the hand of the person 20 or the object (for example, cosmetics) possessed by the person 20 identified by the identification unit 102 and the face of the person 20. Determine position and posture. For example, the determining unit 103 determines the point of contact between the person's 20 hand or an object (eg, cosmetic tool) held by the person 20 and the person's 20 face, and the hand of the object or the object (eg, cosmetic tool) held by the object. and the point of contact with the face of the person 20 can be the same. Furthermore, the determining unit 103 determines whether the contact point of the hand of the person 20 is the same as the contact point of the hand of the object, and that the object is standing behind the person 20. Conditioned on the standing position, the position and pose of other parts of the object (at least parts other than the hand) can be determined.

The selection unit 104 selects an object. For example, the selection unit 104 can select an object specified by the person 20 or the like from among a plurality of objects. The person 20 can select an object on a screen on which a plurality of objects (for example, images of faces of objects) are displayed.

Also, for example, the selection unit 104 can select an object suitable for the person 20 predicted by machine learning. Also, for example, the selection unit 104 can select a predetermined object (a uniform object for all persons).

Now, let me explain the objects. An object is not limited to a person, and may be an animal, a character, or the like. For example, the object is a person who has performed beauty-related actions on the person 20 in the past. It should be noted that a person who has performed a beauty-related act on the person 20 in the past is selected by referring to the treatment history or the like linked to the identification information (registered member ID or the like) of the person 20. good too. Note that the CG image of the object is not limited to the CG image of the whole body of the object, and may be a CG image of a part of the object (for example, a hand of the object, etc.). Also, the CG image of the object may be a CG image in which the object is holding an object (for example, the same object as the person 20 is carrying (eg, cosmetic tools)).

The superimposing unit 105 superimposes a real-time image of the person 20 (a real-time image in which an area including at least the hand of the person 20 is removed) and a CG image of the object having the position and orientation determined by the determining unit 103. do. Specifically, the superimposing unit 105 superimposes the CG image on the real-time image.

Furthermore, the superimposing unit 105 can complement the image. Specifically, the superimposing unit 105 reproduces a part of the body of the person 20 (for example, an image before the person 20 starts performing an action related to beauty) based on a complementary image (for example, an image before the person 20 starts performing an action related to beauty). The CG image of the hand in the untouched state can be superimposed on the superimposed image of the real-time image and the CG image of the object. As a result, it is possible to generate a moving image in which the person 20 himself does not perform an action related to beauty.

Further, specifically, the superimposing unit 105 superimposes an image for complementation (for example, the person 20 is The image of the region in the image before starting the action related to beauty) can be superimposed. That is, after the area including at least the hand of the person 20 in the real-time image is erased (e.g., made transparent), the superimposing unit 105 complements the background that should exist in this area, and then superimposes the object. As a result, it is possible to generate a moving image in which the erased area is supplemented.

Note that the superimposing unit 105 may change the position and posture of the CG image of the object (for example, move the standing position of the object) so that the object moves naturally. In addition, the superimposing unit 105 may not link the position and orientation of the CG image of the object with the person 20 (or , the speed of following the movement of the person 20 may be temporarily reduced). This makes it possible to generate a moving image in which the object does not stop too much or move too much.

The display unit 106 displays the image superimposed by the superimposing unit 105 .

<Processing method>
A superimposed display processing method according to the first embodiment and a superimposed display processing method according to the second embodiment will be described below.

<<First Embodiment>>
FIG. 3 is a flow chart showing the flow of superimposed display processing (first embodiment) according to an embodiment of the present invention.

At step 11 (S11), the imaging unit 101 acquires a real-time image. Specifically, the photographing unit 101 photographs a moving image of the person 20 .

In step 12 (S12), the identifying unit 102 identifies an area including at least the hand of the person 20 (for example, an area from the elbow to the fingertip, from the wrist to the fingertip, etc.) in the real-time image of S11. The identifying unit 102 also identifies the position and posture of at least the hand (for example, from the elbow to the fingertip, from the wrist to the fingertip, etc.) of the person 20 in the real-time image in S11. It should be noted that the person 20 may carry items such as cosmetics.

In step 13 (S13), the identifying unit 102 erases (for example, , transparency).

At step 14 (S14), the determination unit 103 determines the position and orientation of the object based on the person 20 in the real-time image of S11. Specifically, the determination unit 103 determines the position and orientation of the object based on the position and orientation of at least the hand (for example, elbow to fingertip, wrist to fingertip, etc.) of the person 20 identified in S12. .

In step 15 (S15), the superimposing unit 105 combines the real-time image in which the person 20 is shot (the real-time image in which the area including at least the hand of the person 20 is deleted in S13) and the position and orientation determined in S14. A CG image of the object is superimposed. Furthermore, the superimposing unit 105 can complement the image.

At step 16 (S16), the display unit 106 displays the image superimposed at S15. Specifically, the display unit 106 displays a plurality of images generated by the processes of S11 to S15 as moving images.

<<Second Embodiment>>
FIG. 4 is a flow chart showing the flow of superimposed display processing (second embodiment) according to an embodiment of the present invention.

At step 21 (S21), the imaging unit 101 acquires a real-time image. Specifically, the photographing unit 101 photographs a moving image of the person 20 .

In step 22 (S22), the identifying unit 102 identifies an area including at least the hands of the person 20 (for example, an area from the elbow to the fingertips, from the wrist to the fingertips, etc.) in the real-time image of S21. It should be noted that the person 20 may carry items such as cosmetics.

In step 23 (S23), the identifying unit 102 erases (for example, , transparency).

In step 24 (S24), the identifying unit 102 identifies the contact point between the person's 20 hand or an object (for example, cosmetics) held by the person 20 and the person's 20 face in the real-time image of S21.

At step 25 (S25), the determination unit 103 determines the position and orientation of the object based on the person 20 in the real-time image of S21. Specifically, the determination unit 103 determines the position and orientation of the object based on the contact point between the hand of the person 20 identified in S24 or the object (for example, makeup) held by the person 20 and the face of the person 20. to decide.

In step 26 (S26), the superimposing unit 105 combines the real-time image of the person 20 captured (the real-time image in which at least the area including the hand of the person 20 is deleted in S23) and the position and orientation determined in S25. A CG image of the object is superimposed. Furthermore, the superimposing unit 105 can complement the image.

At step 27 (S27), the display unit 106 displays the image superimposed at S26. Specifically, the display unit 106 displays a plurality of images generated by the processes of S21 to S26 as moving images.

<<Creation of CG image>>
In one embodiment of the present invention, a person performing a beauty act can be clipped from the video. As a clipping method, a moving image shot with a green screen (chroma key) or the like may be clipped, or a portion to be clipped may be specified and clipped from a normal moving image. In one embodiment of the present invention, the object is a person who performs beauty-related actions on a person, and the CG image of the object is a predetermined color (for example, green) that is a background of a predetermined color (for example, green). It is created using a video that captures the appearance of an object performing beauty-related actions on the shape of the face (also called a green screen). For example, a person who performs an action related to beauty on a person may The state of doing the act is filmed. In this filmed video, by cutting out the hands of a person who performs beauty-related acts on a person (including parts of the body including hands and beauty tools held by hands), or A CG image of the object is created.

<<other embodiments>>
In one embodiment of the present invention, the movement of the hand of the person 20 and the movement of the CG object are not linked. Specifically, the identification unit 102 identifies a partial area of the body of the person 20 (for example, an area including at least a hand) and an area of an object possessed by the person 20 (if the object is in possession) from the real-time image. Erase (e.g., make transparent). Then, the determining unit 103 determines the position of the object based on the person 20 in the real-time image (specifically, based on the position of the person 20 in the real-time image (for example, the position and posture of the face of the person 20)). and determine posture. For example, the determination unit 103 determines the position and orientation of the object such that the hand of the object touches the face of the person 20 in the real-time image. Then, the superimposing unit 105 superimposes the real-time image of the person 20 (the real-time image in which at least the area including the hand of the person 20 is removed) and the CG image of the object. The person 20 performs an action related to beauty according to the movement of the CG of the object.

In this specification, an embodiment in which a CG image is superimposed on a real-time image has been described, but the present invention is not limited to this, and can also be applied to an embodiment in which a CG image is superimposed on an image that has been captured in advance. can be done.

<Display screen>
A display screen according to the first embodiment and a display screen according to the second embodiment will be described below. In one embodiment of the present invention, the information processing device 10 displays a moving image in which the person 20 is receiving an action related to beauty from an object (for example, a practitioner such as an esthetician).

<<First Embodiment>>
FIG. 5 is an example (first embodiment) of a screen displayed on the information processing apparatus 10 according to one embodiment of the present invention. In the first embodiment, the position and posture of the CG image of the object (for example, a practitioner such as an esthetician) is the position and posture of at least the hand of the person 20 (for example, from the elbow to the fingertips, from the wrist to the fingertips, etc.). are linked. For example, the person 20 can watch a video in which the person 20 is seated and undergoes an action related to beauty (the person 20 in FIG. 5 faces the screen displayed on the information processing device 10 in FIG. 5). perform beauty-related acts while

<<Second Embodiment>>
FIG. 6 is an example (second embodiment) of a screen displayed on the information processing apparatus 10 according to one embodiment of the present invention. In the second embodiment, the position and posture of the CG image of an object (for example, a practitioner such as an esthetician) are determined by the relationship between the hand of the person 20 or an object (for example, makeup tools) held by the person 20 and the face of the person 20. Linked to contact points. For example, the person 20 can watch a video in which the person 20 is lying on his or her back and undergoes an action related to beauty care (the person 20 in FIG. 6 is a screen image displayed on the information processing apparatus 10 in FIG. 6). perform beauty-related acts while facing the woman).

<Beauty method>
One embodiment of the present invention is a beauty method for performing beauty-related actions while viewing the images described above. That is, one embodiment of the present invention is a beauty method for performing beauty-related actions while viewing an image, wherein the image is a real-time image in which the position and orientation of an object are determined based on a person in the real-time image. , and the CG image of the object at the determined position and orientation are superimposed.

<effect>
As described above, in one embodiment of the present invention, the person 20 performs beauty-related actions on themselves while looking at the screen displayed on the information processing device 10, thereby making other people (that is, objects (for example, estheticians) You can feel as if you are receiving an action related to beauty from a practitioner such as)).

<Hardware configuration>
FIG. 7 is a diagram showing the hardware configuration of the information processing apparatus according to one embodiment of the present invention.

The information processing device 10 has a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 . The CPU 1001, ROM 1002, and RAM 1003 form a so-called computer.

The information processing device 10 can also have an auxiliary storage device 1004 , a display device 1005 , an operation device 1006 , an I/F (Interface) device 1007 and a drive device 1008 .

Each piece of hardware of the information processing device 10 is interconnected via a bus B.

The CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004 .

The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004 . Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface).

The RAM 1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The RAM 1003 functions as a main storage device that provides a work area that is developed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001 .

The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.

The display device 1005 is a display device that displays the internal state of the information processing device 10 and the like.

The operation device 1006 is an input device through which a person who operates the information processing device 10 inputs various instructions to the information processing device 10 .

The I/F device 1007 is a communication device for connecting to a network and communicating with other devices.

A drive device 1008 is a device for setting a storage medium 1009 . The storage medium 1009 here includes media such as CD-ROMs, flexible disks, magneto-optical disks, etc., which record information optically, electrically or magnetically. The storage medium 1009 may also include a semiconductor memory that electrically records information such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, or the like.

Various programs to be installed in the auxiliary storage device 1004 are installed by, for example, setting the distributed storage medium 1009 in the drive device 1008 and reading the various programs recorded in the storage medium 1009 by the drive device 1008. be done. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007 .

The information processing device 10 has an imaging device 1010 . A photographing device 1010 photographs the person 20 .

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications can be made within the scope of the gist of the present invention described in the claims.・Changes are possible.

This international application claims priority based on Japanese Patent Application No. 2021-039295 filed on March 11, 2021, and the entire contents of No. 2021-039295 are hereby incorporated into this international application.

10 information processing device 20 person 101 photographing unit 102 identifying unit 103 determining unit 104 selecting unit 105 superimposing unit 106 display unit 1001 CPU
1002 ROMs
1003 RAM
1004 auxiliary storage device 1005 display device 1006 operation device 1007 I/F device 1008 drive device 1009 storage medium 1010 imaging device

Claims

a determiner that determines the position and pose of the object based on the person in the image;
a superimposing unit that superimposes the image and a CG image of the object at the determined position and orientation;
An information processing device comprising: a display unit that displays a superimposed image.
The information processing apparatus according to claim 1, wherein the image is a real-time image.
The information processing apparatus according to claim 1, wherein the image is an image that has been captured in advance.
The information processing apparatus according to any one of claims 1 to 3, wherein the determination unit determines the position and orientation of the object based on at least the position and orientation of the hand of the person.
4. The determining unit determines the position and posture of the object based on a contact point between the person's hand or an object held by the person and the person's face. The information processing device according to the item.
The information processing apparatus according to any one of claims 1 to 3, wherein the determination unit determines the position and orientation of the object based on the position and orientation of the face of the person.
The information processing apparatus according to any one of claims 1 to 6, wherein the superimposing unit further superimposes a CG image of a part of the person's body.
8. The determining unit according to any one of claims 1 to 7, wherein the determination unit determines the position and orientation of the object based on a correspondence relationship between a part of a person's body and the position and orientation of the object. Information processing equipment.
The information processing apparatus according to any one of claims 1 to 8, wherein the person is engaged in an action related to beauty.
The information processing apparatus according to claim 9, wherein the CG image of the object is a CG image of the object performing an action related to beauty on the person.
The information processing apparatus according to claim 10, wherein the CG image of the object is created using a moving image of the object performing an action related to beauty with respect to the shape of the face.
12. The CG image of the object is a CG image of at least a hand of a person or character performing an action related to beauty and an object held by the person or character performing an action related to beauty. The information processing device according to .
The information processing apparatus according to any one of claims 10 to 12, wherein the object is a person who has performed an action related to beauty on the person in the past.
The information processing apparatus according to any one of claims 1 to 13, further comprising a selection unit that selects the object.
A computer implemented method comprising:
determining the position and pose of an object based on the person in the image;
superimposing the image and a CG image of the object at the determined position and pose;
and displaying a superimposed superimposed image.
a determination unit that determines the position and pose of an object based on the person in the image;
a superimposition unit that superimposes the image and a CG image of the object at the determined position and orientation;
A program for functioning as a display unit that displays superimposed images.
A system including an information processing device and a server,
a determiner that determines the position and pose of the object based on the person in the image;
a superimposing unit that superimposes the image and a CG image of the object at the determined position and orientation;
A system comprising: a display unit for displaying a superimposed superimposed image;
A beauty method for performing beauty-related actions while viewing images,
The image is
Based on the person in the image, the position and pose of the object are determined,
A cosmetic method, wherein the image and a CG image of the object having the determined position and posture are superimposed on each other to form a superimposed image.