KR20200025285A - System and method for entertainer experience - Google Patents

Abstract

The present invention relates to a content experience center, and more particularly, to a content experience center that makes audiences or the public expect more developed popular culture while providing the audiences or the public with deep impressions and memories for a long time by allowing the audiences or the public to directly participate in acting and performing actions for delivering themes, meanings, feelings and stories of performances, movies, CFs, music videos, dramas, or the like from perspectives of production staffs or actors to be a main experienced person to lead popular culture, and an experience method thereof. The content experience center comprises a database, an input device, a body shape photographing device, a stage background screen, an original voice extraction part, and an original image extraction part.

Description

Content Experience Center and Celebrity Experiences {SYSTEM AND METHOD FOR ENTERTAINER EXPERIENCE}

The present invention relates to a content experience hall, and more specifically, a theme, meaning, feeling, and story to be conveyed in a performance, a film CF, a music video, or a drama, etc., as a production step or an actor's position, and the audience or the general public appear directly. It is related to a content experience hall and a method of experiencing it so that you can have a deep impression and memories for a long time by becoming a subjective experience leader who leads the popular culture while acting.

In general, movies, performances, dramas, etc. require a lot of equipment and manpower, and once produced movies can be inexpensive one by one, but the sales can be considerable by watching a lot of people. In particular, most of the characters become envy, and viewers have a desire to act with the envy.

In particular, the popularity of the Korean Wave has increased the number of foreign tourists who are heard in the background of dramas and movies, and the sales of goods and clothing used by actors are also increasing.

In addition, tourists shoot in the backgrounds related to movies and dramas or photographs reflecting the shooting, but it is not easy to meet real people.

And most tourists want to be the main characters by being the relative actors of the actors who are envyed in the video, but it is difficult to realize this.

Therefore, experience skills are needed to experience the acting of these actors.

Patent Registration No. 10-0724620 (June 04, 2007) Publication No. 10-2012-0012292 (published February 09, 2012)

The present invention has been made to solve the above problems, an object of the present invention is to reflect the situation that meets the actual user's body shape or conditions, so that the user can produce the desired video content, to provide a user-specific content experience hall It is to provide a content experience hall and entertainer experience.

Another object of the present invention, if the user's body type is different from the person's body shape, it is possible to edit the actor's acting according to the user's body shape, the actual user was taken as the original character in the video acted by the user It is to provide a content experience hall and celebrity experience that can be done together.

It is still another object of the present invention to provide a content experience hall and a celebrity experience method in which a user can perform a dialogue with a partner by determining the last dialogue of the user when a dialogue is exchanged between the user and the virtual person. .

The content experience hall according to the present invention for achieving the above objects, the data of any one or more of the original image of the performance, movie, CF, music video, and drama is stored, the metabolic information of the original image, image information of the people Extracting information is stored in the database, the body body information of the user, the voice information of the user, the database storing the shooting information including the user; An input device for inputting user's body information; A body type photographing apparatus for photographing a user; A background screen of the stage on which the original image is displayed; An original sound extracting unit for extracting metabolic information of persons from an original video object; And an original image extracting unit extracting image information of persons from an original image.

A relative robot for performing a relative role of the user; A dialogue screen positioned around the stage to display the dialogue of the user; A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And a user dialogue editing unit configured to receive a dialogue voice of the user and edit the dialogue of the original video.

The counterpart robot may include a humanoid body having joints of a leg, a body, and an arm; And a face part manufactured using the 3D printer and having the same human face shape as that of the other actor's face.

In addition, the virtual reality providing unit for generating a virtual actor to play the role of the user; A dialogue screen positioned around the stage to display the dialogue of the user; A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And a user dialogue edit unit configured to receive a user's dialogue voice and to edit the dialogue of the original video.

In addition, an augmented reality providing unit for generating a virtual actor to play the role of the user; A dialogue screen positioned around the stage to display the dialogue of the user; A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And a user dialogue edit unit configured to receive a user's dialogue voice and to edit the dialogue of the original video.

The celebrity experience method according to the present invention for achieving the above objects, extracts the metabolism information of the characters from the original video content of any one or more of the performance, movie, CF, music video, and drama stored in the database by the original audio extractor Raw metabolic information extraction step for storing; An original actor image extracting step of extracting and storing image information of persons from the original image stored in the database by an original image extracting unit; A user information storage step of inputting information of a user who wants to use a content experience hall through a predetermined input device and storing the information in a database; Storing the user's body information by directly inputting the user's body information through the input device and storing the user's body information by storing the user's body information by analyzing the image information photographed by the user through the input device; A basic background image play step of displaying a basic background image on a wallpaper; A user dialogue screen display step of displaying a dialogue to be spoken by a user on a dialogue screen positioned around a stage; A user dialogue input step of receiving a voice of the user according to the dialogue of the user displayed on the dialogue screen and storing the voice in the database; And an image capturing step (S120) of photographing with a camera and recording with a voice recorder for the acting of the opponent virtual actor and the acting of the user according to the steps after the execution of the basic background image playing step.

In this case, it is preferable to include a virtual actor acting information editing step of editing and storing the video image of the opponent virtual actor through the virtual actor acting information editing unit according to the user's body type stored in the user body type information storing step.

In addition, according to the basic background image play step, the background image of the original image is displayed on the stage background of the content experience hall, and the person acting as the other actor on the background screen, holographic 3D image, avatar, virtual reality and augmentation A virtual actor acting play step of displaying a character of the opponent actor role in at least one of the display as reality, or playing the opponent actor role as the opponent robot; And the opponent virtual actor voice play step of generating a speech of the opponent virtual actor to the speaker of the stage or the speaker of the robot together with the opponent virtual actor acting play step.

In addition, after performing the relative virtual actor voice play step, when a user voice is input from the user dialogue displayed on the dialogue screen by the user dialogue editor, for the last dialogue of the user dialogue of one scene, the dialogue of one scene of the corresponding user is performed. And determining a user termination dialogue step for performing any one or more of the following steps of playing the opponent virtual actor and the opponent virtual actor voice for the next opponent virtual actor.

The method may further include generating an image output generated by displaying the image generated by the image capturing step on a display screen, outputting it to a speaker, storing it in a memory, or storing it in a temporary storage device.

According to the content experience hall and celebrity experience method according to the present invention configured as described above, it is possible to create a video experience desired by the user by reflecting the situation that fits the actual user's body type or condition, and provides a user-customized content experience hall. have.

In addition, if the user's body type is different from the person's body type, the user can edit the actor's acting according to the user's body shape. In the video acted by the user, the actual user can be made as if the original character was photographed. There is also.

In addition, when talking between a user and an opponent virtual person, there is an advantage that the acting with the other actor is naturally performed by determining the user's last dialogue.

1 is an exemplary configuration diagram of a state in which user information is input to a content experience hall according to the present invention.
2 is an exemplary configuration diagram of a stage for a content experience hall according to the present invention.
3 is an exemplary configuration diagram for generating an image output such as a DVD photographed by a content experience hall according to the present invention.
4 is a system control configuration diagram for a content experience hall according to the present invention.
5 is a flowchart illustrating a celebrity experience method according to a content experience hall according to the present invention.

The present invention can be embodied in many different forms without departing from the spirit or main features thereof. Accordingly, the embodiments of the present invention are merely examples in all respects and should not be construed as limiting.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms.

The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

When a component is said to be "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that another component may be present in the middle. Should be.

On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprise", "comprise", "have", etc., are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, one Or other features or numbers, steps, operations, components, components or combinations thereof, or those in combination thereof should not be excluded in advance.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art.

Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, the most preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. .

1 is an exemplary configuration diagram of a state of inputting user information for a content experience hall according to the present invention, FIG. 2 is an exemplary configuration diagram of a stage for a content experience hall according to the present invention, and FIG. 3 is a content example according to the present invention. FIG. 4 is an exemplary configuration diagram for generating an image output such as a DVD photographed by an experience hall, and FIG. 4 is a system control configuration diagram for a content experience hall according to the present invention.

As shown, in the content experience hall according to the present invention, users are introduced into the characters appearing in the video, such as performances, movies, CFs, music videos, and dramas, and experience acting as if they are acting as heroes of the drama. .

In particular, in recent years, due to the influence of the Korean Wave, popular actors, such as dramas and movies, which are desired by the user, act virtually as the envy of the user. .

In addition, as in the following example, it may be implemented to be continuously stored in a CD, DVD, memory and the like.

First, looking at an example of the configuration of the content experience hall according to the present invention, the data of any one or more of the original image of the performance, movie, CF, music video, and drama is stored, and the metabolic information of the original image, image information of the people The extraction information is stored, and a database 20 is provided to store body shape information of the user, voice information of the user, and photographing information including the user.

And including the original audio extracting unit 31 for extracting the metabolic information of the characters from the original video material, and extracts the actor's metabolic information from the original video material, and edits the extracted dialogue to the user in the subsequent process to customize the user Enable recording.

It also includes an original image extraction unit 32 for extracting the image information of the person from the original image. For the actor's video, a newly edited video can be produced by substituting the user.

In addition, in order for the user to enjoy it, information such as information about the user or body shape should be stored as digital information in the system.

To this end, an input device 12 for inputting user's body information is provided.

In addition, a body type photographing apparatus 13 for photographing a user is provided.

As such, the original image is prepared, and while the user's information is input, the new image is generated by photographing the user as the stage person while the stage image reflecting the user and the virtual person is displayed.

Here, the background screen 14 of the stage on which the basic original image is displayed is provided.

In addition, the opponent can be displayed together on the background (14). Alternatively, the holographic technology may be used to represent the virtual actor of the opponent in front of or around the user, and the virtual actor may be photographed with the user.

Alternatively, the virtual actor may be displayed in front of or around the user using virtual reality technology, and with the user, the virtual actor may be photographed.

To this end, it may include a virtual reality provider (not shown) that can represent the virtual actor of the opponent in front of or around the user using the virtual reality technology.

Alternatively, the augmented reality technology may be used to represent the virtual actor of the opponent in front of or around the user, and with the user, the virtual actor may be photographed.

To this end, it may include an augmented reality provider (not shown) that can represent the virtual actor of the opponent in front of or around the user using augmented reality technology.

Furthermore, it may be provided with a counterpart robot 15 to play a role of the user. Thus, the opponent robot 15 plays the role of the virtual opponent actor, it is possible to shoot the acting with the user to produce an image.

Here, the counterpart robot 15 includes a humanoid body part having joints of a leg, a body, and an arm, and a face part having a human face shape manufactured using a 3D printer.

That is, the human body of the legs, the body, and the arms connected by the joints are first manufactured, and then a three-dimensional scanning operation is performed using a scanner, and then easily and easily used for color printing using a 3D printer. By doing so, the same face part as that of the actor or celebrity face can be produced.

On the other hand, the face portion which is located above the body of the counterpart robot 15, which is the humanoid robot, and constitutes a human face, for example, uses a scanner to perform a well-known 360-degree scanning operation. After performing the 3D printer, it is possible to easily and easily perform color printing to produce the same face part as the shape of the human face, and further, the face part having the human face to the upper head of the human body robot body part. Easily combined to complete the humanoid robot, as well as a camera mounted on the eye portion of the face coupled to the body of the humanoid robot, a speaker is mounted on the mouth, the recognition and voice of the object in the humanoid robot The signal can be easily delivered. Since the method for manufacturing a face of such a humanoid robot is a known technology, further detailed description will be omitted.

Subsequently, the opponent robot 15 may be completed by joining or bonding the same face part as the actor or entertainer face above the body part of the humanoid robot by riveting or bonding means.

In addition, since the user may not be familiar with the dialogue easily, it is provided with a dialogue screen 16 positioned around the stage to display the dialogue of the user.

Next, a virtual actor acting information editing unit 33 for editing and storing the video material of the opponent virtual actor according to the user's body type is provided. In other words, the actual actor to be played by the user from the actual original video, if the user's body shape is different, reflecting the physical conditions such as height and weight, edit the arm or walking degree of the virtual actor, the other actor to act the other actor Information will be provided.

In addition, the user dialogue further includes a user dialogue editing unit 34 for receiving the user's speech voice and editing the dialogue of the original video.

That is, the voice of the user's dialogue is inputted and stored in a microphone, and the voice information spoken by the user is edited in the original video instead of the person's dialogue.

FIG. 5 is a flowchart illustrating a celebrity experience method according to a content experience hall according to the present invention. The celebrity experience method in which a user directly acts as an actor through the content experience hall according to the present invention will be described with reference to FIGS. 1 to 4. do.

First, the original image information is stored. And raw metabolic information extraction step of extracting and storing the metabolic information of the characters from the original video content of any one or more of the performance, movie, CF, music video, and drama stored in the database 20 by the original audio extracting unit 31 (S10) ).

For the metabolic information of the extracted characters, the metabolic information of the casted user is deleted from the video, and the metabolic of the other actor can be edited and stored by reflecting the user's name or the desired metabolism for the other actor's dialogue. do.

Next, an original actor image extraction step (S20) of extracting and storing image information of persons from the original image stored in the database 20 by the original image extracting unit 32 is performed.

Thus, in a newly edited video that reflects the user's performance, the character of the cast in charge of the user will then have to be removed from the footage, while the virtual character of the user's relative cast will have to move his arm or body to match the user's body shape. It will be edited and new footage will be edited.

In addition, the user information storage step (S30) of inputting information of the user who wants to use the content experience hall 10 through the predetermined input device 12 and storing it in the database 20 is performed. That is, as the information of the user to be reflected in the original video material, the user inputs the desired information as the condition information referred to in the video material such as the user's name, place of residence, and the shooting area or place desired by the user. If necessary, it may reflect the user's voice or, in the case of a necessary scene, an image or a picture that replaces the original scene.

Next, the user's body information is directly input through the input device 12 and stored in the database 20, or the image information photographed by the user is analyzed by the body imaging device 13 to store the user's body information. A user body type information storing step S40 is performed.

In other words, if the user's body shape is different from the actual body shape, the relative height or distance in various scenes such as hugs, face touches, and tacks may be different, so that the user's body shape information may be reflected. There is a need. Therefore, the user's body type information is input. The input of the user may use the input device 12, or may be photographed by the body type photographing device 13, and then the user's body information may be analyzed by analyzing the photographed image of the user.

Subsequently, according to the user's body type stored in the user's body type information storage step (S40), the virtual actor acting information editing step (S50) is edited and stored through the virtual actor acting information editing unit 33 according to the user's body type. ).

That is, since the person and the user may have different body types in the original video to be played by the user, the actor image is edited to reflect the actor's acting image information. In other words, the editing process is performed on acting images such as hugs, face touching, and humping.

Next, after inputting the basic condition and undergoing the necessary editing process, the user takes a picture of the incoming video and receives an ambassador voice to generate a video of the entertainer experience.

First, by reflecting the basic background, the basic background image play step (S60) of displaying the basic background image of the actual original image on the background screen 14 is performed.

In addition, according to the basic background image play step (S60), while displaying the background image of the original video on the stage background screen 14 of the content experience hall, the person who acts as the other actor on the background screen, and the hologram three-dimensional image , Display the person of the opponent actor role in at least one of the display in virtual reality, augmented reality, or perform the opponent virtual actor act play step (S70) to play the opponent actor role to the opponent robot (15).

The method of displaying the role of the other actor may be displayed on a screen, display of a 3D image by applying hologram technology, technology using an avatar, technology using virtual reality, technology using augmented reality, and acting with other robots. The technology can be used, and the general technique can be applied to the image display, hologram technology, virtual reality, augmented reality, and robot operation for this purpose, and specific technologies for this are determined according to the original image or stage facility to be applied. The disclosed general image display, hologram technology, virtual reality, augmented reality and robot technologies are commonly used technologies, and thus detailed descriptions thereof will be omitted.

Here, when using the avatar, by using a 3D motion capture technology that reproduces the user's expression on the avatar face in real time, tracking the facial feature point that can detect the facial expression change for the user's face from the captured image; Reconstructing a facial expression change for the user's face using a first mapping feature extracted from prestored 3D motion capture data and a second mapping feature extracted from the facial expression feature point; Converting coordinates of the facial feature point into control coordinates on a face mesh for controlling an avatar corresponding to the face of the user; And constructing a 3D face animation such that the user's facial expression change appears in the avatar using the control coordinates.

In this case, the reconstructing the facial expression change of the user's face may be performed using the correlation between the motion capture data representing the meaningful facial expression matching the first mapping feature and the second mapping feature. The motion capture data representing the facial expression is selected by selecting at least one motion capture data.

Since the 3D motion capture technology is a known technology, further description will be omitted.

In addition to performing the opponent virtual actor act play step (S70) and performs the voice of the opponent virtual actor voice play step (S80) to generate the speech of the opponent virtual actor to the speaker of the stage or the speaker of the robot. Therefore, the user can act while listening to the voice of the other actor.

However, it reflects the metabolic voice of the other actor by reflecting the metabolic information such as the name or place of the user input in advance. Therefore, while listening to the dialogue of the other actors, the user will postpone the next dialogue.

Next, a user dialogue screen display step S90 of displaying a dialogue to be spoken by a user on a dialogue screen 16 positioned around a stage is performed. Thus, the user can easily postpone the dialogue without forgetting.

Subsequently, the user's voice is input according to the user's voice displayed on the dialogue screen 16 and the user's voice input step S100 is stored in the database 20.

In particular, during the user's dialogue, it is necessary to recognize the user's last dialogue. To this end, after performing the relative virtual actor voice play step (S80), among the user dialogues displayed on the dialogue screen 16 by the user dialogue editor 34, the user's voice for the last dialogue of the user dialogue of a scene is input. If it is received, the user is determined by the dialogue of one scene of the user, and the user exits any one or more of the following steps of the opponent virtual actor acting play (S70) and the opponent virtual actor voice play step (S80) for the next opponent virtual actor The metabolic determination step S110 is performed.

This will allow the virtual actor to start playing once the dialogue is over for the user's scene, and once the scene of the virtual actor finishes playing, the user will wait for input while the user is acting again. When the last line is entered, the player plays a virtual actor's act again.

As described above, during the user's acting, the camera performs recording of the opponent virtual actor and the user's acting according to the stages after the basic background image play step 50 is performed by the camera and records the recording with the recorder (S120). do. Thus, an image is generated.

In addition, an image output generation step (S130) of displaying the image generated by the image capturing step (S120) on a display screen, outputting to a speaker, storing in a memory, or storing in a temporary storage device is performed.

If necessary, the generated video can be produced by CD, DVD, etc., and can be provided to the user by storing in a memory.

The embodiments of the present invention have been described in detail above, but since the embodiments have been described so that those skilled in the art to which the present invention pertains may easily carry out the present invention, The technical spirit of the present invention should not be interpreted limitedly.

12: input device 13: body type recording device
14: Wallpapers 15: Opposing Robots
16: Metabolic Screen 20: Database
31: original sound extraction unit 32: original image extraction unit
33: virtual actor acting information editor 34: user dialogue editor

Claims (15)

Data of any one or more of the original image of the performance, movie, CF, music video, and drama is stored, and metabolic information of the original image, extracting information about the image information of the person, is stored, the user's body shape information, the user's voice A database storing information, photographing information including a user;
An input device for inputting user's body information;
A body type photographing apparatus for photographing a user;
A background screen of the stage on which the original image is displayed;
An original sound extracting unit for extracting metabolic information of persons from an original video object; And
Content experience hall, characterized in that it comprises an original image extraction unit for extracting the image information of the person from the original image.
The method of claim 1,
An opponent robot for playing a role of a user;
A dialogue screen positioned around the stage to display the dialogue of the user;
A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And
Content experience hall, characterized in that further comprises a user dialogue editing unit for receiving the user's speech voice and editing the dialogue of the original video.
The method of claim 2,
The opponent robot,
A humanoid body having joints of the legs, the body, and the arms; And
And a face part coupled to the humanoid body part and having a human face that is the same as the other actor's face shape.
The method of claim 3, wherein
The face part of the opponent robot is a content experience hall, characterized in that produced by the 3D printer.
The method of claim 4, wherein
Content experience hall, characterized in that the face portion of the opponent robot is provided with a camera and a speaker.
The method of claim 1,
A virtual reality providing unit generating a virtual actor to play a role of a user;
A dialogue screen positioned around the stage to display the dialogue of the user;
A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And
Content experience hall, characterized in that further comprises a user dialogue editing unit for receiving the user's speech voice and editing the dialogue of the original video.
The method of claim 1,
An augmented reality providing unit generating a virtual actor to play a role of a user;
A dialogue screen positioned around the stage to display the dialogue of the user;
A virtual actor acting information editing unit for editing and storing a video of an opponent's virtual actor according to a user's body type; And
Content experience hall, characterized in that further comprises a user dialogue editing unit for receiving the user's speech voice and editing the dialogue of the original video.
An original metabolic information extraction step of extracting and storing metabolic information of persons from an original video image of any one or more of a performance, a movie, a CF, a music video, and a drama stored in a database by an original audio extracting unit;
An original actor image extracting step of extracting and storing image information of persons from the original image stored in the database by an original image extracting unit;
A user information storage step of inputting information of a user who wants to use a content experience hall through a predetermined input device and storing the information in a database;
Storing the user's body information by directly inputting the user's body information through the input device and storing the user's body information by storing the user's body information by analyzing the image information photographed by the user through the input device;
A basic background image play step of displaying a basic background image on a wallpaper;
A user dialogue screen display step of displaying a dialogue to be spoken by a user on a dialogue screen positioned around a stage;
A user dialogue input step of receiving a voice of the user according to the dialogue of the user displayed on the dialogue screen and storing the voice in the database; And
According to a step after the execution of the basic background image play step, the celebrity experience method comprising a video recording step of recording with a camera and recording with the recording of the smoke of the opponent virtual actor and the user.
The method of claim 8,
And a virtual actor acting information editing step of editing and storing a virtual actor's video through a virtual actor acting information editing unit according to the user's body type stored by the user body type information storing step.
The method of claim 8,
According to the basic background image play step, while displaying the background image of the original image on the stage background screen of the content experience hall, the person who acts as the other actor of the user on the background screen to display the person of the other actor role acting the virtual actor Play step; And
And an opponent virtual actor voice play step of generating a speech of the opponent virtual actor to the speaker of the stage together with the opponent virtual actor acting play step.
The method of claim 8,
According to the basic background image play step, at least one of a holographic three-dimensional image, an avatar, a virtual reality, or an augmented reality display of a person who acts as a relative actor of the user while displaying a background image of the original image on a stage background of a content experience hall A virtual actor acting play step of displaying a character of the opponent actor role; And
And an opponent virtual actor voice play step of generating a speech of the opponent virtual actor to the speaker of the stage together with the opponent virtual actor acting play step.
The method of claim 8,
An acting virtual actor acting to play the role of the opponent actor as the opponent robot while displaying the background image of the original video on the stage background of the content experience hall according to the basic background image playing step; And
And the opponent virtual actor voice play step of generating a speech of the opponent virtual actor to the speaker of the stage or the speaker of the robot together with the opponent virtual actor acting play step.
The method of claim 8,
After performing the relative virtual actor voice play step, when the user's voice is input from the user dialogue displayed on the dialogue screen by the user dialogue editor, the user's voice for the last dialogue of the user dialogue of one scene is used as the dialogue of the scene of the corresponding user. And determining a user-terminated dialogue to perform one or more of the following steps of the opponent virtual actor acting play and the opponent virtual actor voice play for the next opponent virtual actor.
The method of claim 8,
And an image output generation step of displaying the image generated by the image photographing step on a display screen, outputting to a speaker, storing in a memory, or storing in a temporary storage device.
The method of claim 11,
Displaying the role of the opponent actor using the avatar,
Tracking a facial feature point capable of detecting a change in facial expression of a user's face from the captured image;
Reconstructing a facial expression change for the user's face using a first mapping feature extracted from prestored 3D motion capture data and a second mapping feature extracted from the facial expression feature point;
Converting coordinates of the facial expression feature points to control coordinates on a face mesh for controlling an avatar corresponding to the face of the user; And constructing a 3D face animation such that the user's facial expression changes in the avatar using the control coordinates.

Images